2023-03-03T06:12:53.600 INFO:root:teuthology version: 0.0.1.dev49+gc7c3cc8 2023-03-03T06:12:53.601 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} --verbose --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192149 -- /home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192149/orig.config.yaml 2023-03-03T06:12:53.721 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-03-03T06:12:53.816 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192149 branch: wip-vshankar-testing-20230303.023823 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} email: vshankar@redhat.com first_in_suite: false job_id: '7192149' kernel: client: sha1: distro flavor: default kdb: true sha1: 75534f74ac3dd06f86697ff862e8be2945b3c8e6 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing-20230303.023823 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - RECENT_CRASH sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: dry_run: true install: ceph: flavor: default sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230303.023823 sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230303.023823 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - exec: mon.a: - ceph config set mgr mgr/crash/warn_recent_interval 0 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_snapshots teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6 timestamp: 2023-03-03_04:39:14 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.31660 2023-03-03T06:12:53.817 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa; will attempt to use it 2023-03-03T06:12:53.818 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa/tasks 2023-03-03T06:12:53.818 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-03-03T06:12:53.820 INFO:teuthology.task.internal:Checking packages... 2023-03-03T06:12:53.850 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '472aaef4ec3b3a2c29f73ca67854785a910f1f9b' 2023-03-03T06:12:53.850 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-03-03T06:12:53.851 INFO:teuthology.packaging:ref: None 2023-03-03T06:12:53.851 INFO:teuthology.packaging:tag: None 2023-03-03T06:12:53.851 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230303.023823 2023-03-03T06:12:53.851 INFO:teuthology.packaging:sha1: 472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-03T06:12:53.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230303.023823 2023-03-03T06:12:54.006 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2739.g472aaef4 2023-03-03T06:12:54.006 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-03-03T06:12:54.015 INFO:teuthology.task.internal:no buildpackages task found 2023-03-03T06:12:54.016 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-03-03T06:12:54.114 INFO:teuthology.task.internal:Saving configuration 2023-03-03T06:12:54.138 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-03-03T06:12:54.191 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-03T06:12:54.220 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-03 06:07:55.274627', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-03-03T06:12:54.249 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192149', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-03-03 06:07:55.273153', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-03-03T06:12:54.250 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-03-03T06:12:54.255 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-03-03T06:12:54.256 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-03-03T06:12:54.256 INFO:teuthology.run_tasks:Running task console_log... 2023-03-03T06:12:54.390 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f51c2ce05e0>, signals=[15]) 2023-03-03T06:12:54.391 INFO:teuthology.run_tasks:Running task internal.connect... 2023-03-03T06:12:54.403 INFO:teuthology.task.internal:Opening connections... 2023-03-03T06:12:54.404 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2023-03-03T06:12:54.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-03T06:12:54.485 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2023-03-03T06:12:54.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-03T06:12:54.552 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-03-03T06:12:54.576 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2023-03-03T06:12:54.598 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2023-03-03T06:12:54.599 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-03-03T06:12:54.658 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2023-03-03T06:12:54.659 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)" 2023-03-03T06:12:54.659 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2023-03-03T06:12:54.659 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2023-03-03T06:12:54.659 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6" 2023-03-03T06:12:54.660 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2023-03-03T06:12:54.660 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-03T06:12:54.660 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-03-03T06:12:54.660 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-03T06:12:54.660 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2023-03-03T06:12:54.660 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-03T06:12:54.660 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-03T06:12:54.661 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:12:54.661 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-03T06:12:54.661 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-03T06:12:54.661 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-03T06:12:54.661 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-03T06:12:54.662 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-03-03T06:12:54.684 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-03-03T06:12:54.705 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-03-03T06:12:54.706 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-03-03T06:12:54.765 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2023-03-03T06:12:54.766 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)" 2023-03-03T06:12:54.766 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2023-03-03T06:12:54.766 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2023-03-03T06:12:54.767 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6" 2023-03-03T06:12:54.767 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-03-03T06:12:54.767 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-03T06:12:54.767 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-03-03T06:12:54.768 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-03T06:12:54.768 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2023-03-03T06:12:54.768 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-03T06:12:54.768 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-03T06:12:54.768 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:12:54.769 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-03T06:12:54.769 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-03T06:12:54.769 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-03T06:12:54.769 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-03T06:12:54.770 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-03-03T06:12:54.792 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-03-03T06:12:54.826 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-03-03T06:12:54.919 INFO:teuthology.task.internal:Checking for old test directory... 2023-03-03T06:12:54.920 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2023-03-03T06:12:54.924 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2023-03-03T06:12:54.943 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-03-03T06:12:54.985 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-03-03T06:12:54.986 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2023-03-03T06:12:54.988 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2023-03-03T06:12:55.021 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-03-03T06:12:55.101 INFO:teuthology.run_tasks:Running task kernel... 2023-03-03T06:12:55.127 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'} 2023-03-03T06:12:55.128 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-03-03T06:12:55.129 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-03-03T06:12:55.129 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-03T06:12:55.130 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2023-03-03T06:12:55.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T06:12:55.150 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2023-03-03T06:12:55.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T06:12:55.152 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2023-03-03T06:12:55.208 INFO:teuthology.orchestra.run.smithi191.stdout:4.18.0-372.9.1.el8.x86_64 2023-03-03T06:12:55.208 INFO:teuthology.task.kernel:Running kernel on smithi191: 4.18.0-372.9.1.el8.x86_64 2023-03-03T06:12:55.209 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum install -y kernel 2023-03-03T06:12:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:4.18.0-372.9.1.el8.x86_64 2023-03-03T06:12:55.212 INFO:teuthology.task.kernel:Running kernel on smithi005: 4.18.0-372.9.1.el8.x86_64 2023-03-03T06:12:55.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2023-03-03T06:12:56.466 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-03-03T06:12:56.466 INFO:teuthology.orchestra.run.smithi191.stdout:Unable to read consumer identity 2023-03-03T06:12:56.503 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-03-03T06:12:56.503 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2023-03-03T06:13:00.336 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-03-03T06:13:00.507 INFO:teuthology.orchestra.run.smithi191.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-03-03T06:13:01.837 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 14 MB 00:01 2023-03-03T06:13:02.666 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 6.4 MB/s | 14 MB 00:02 2023-03-03T06:13:05.081 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 542 kB/s | 24 kB 00:00 2023-03-03T06:13:05.748 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-03-03T06:13:05.749 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 410 kB/s | 24 kB 00:00 2023-03-03T06:13:05.805 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-03-03T06:13:05.807 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2023-03-03T06:13:05.807 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-03-03T06:13:05.939 DEBUG:teuthology.orchestra.run.smithi005:> echo no | sudo yum reinstall kernel || true 2023-03-03T06:13:06.291 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-03-03T06:13:06.291 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2023-03-03T06:13:06.462 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-03-03T06:13:06.526 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2023-03-03T06:13:06.527 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2023-03-03T06:13:06.527 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2023-03-03T06:13:06.560 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:01 ago on Fri 03 Mar 2023 06:13:05 AM UTC. 2023-03-03T06:13:06.605 INFO:teuthology.orchestra.run.smithi005.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-03T06:13:06.637 INFO:teuthology.orchestra.run.smithi005.stderr:Error: No packages marked for reinstall. 2023-03-03T06:13:06.648 DEBUG:teuthology.orchestra.run.smithi191:> echo no | sudo yum reinstall kernel || true 2023-03-03T06:13:06.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum reinstall -y kernel || true 2023-03-03T06:13:07.021 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-03-03T06:13:07.021 INFO:teuthology.orchestra.run.smithi191.stdout:Unable to read consumer identity 2023-03-03T06:13:07.033 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-03-03T06:13:07.034 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2023-03-03T06:13:07.274 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:02 ago on Fri 03 Mar 2023 06:13:05 AM UTC. 2023-03-03T06:13:07.293 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:02 ago on Fri 03 Mar 2023 06:13:05 AM UTC. 2023-03-03T06:13:07.325 INFO:teuthology.orchestra.run.smithi191.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-03T06:13:07.334 INFO:teuthology.orchestra.run.smithi005.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-03T06:13:07.356 INFO:teuthology.orchestra.run.smithi191.stderr:Error: No packages marked for reinstall. 2023-03-03T06:13:07.364 INFO:teuthology.orchestra.run.smithi005.stderr:Error: No packages marked for reinstall. 2023-03-03T06:13:07.403 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum reinstall -y kernel || true 2023-03-03T06:13:07.412 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel --last | head -n 1 2023-03-03T06:13:07.494 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-03-03T06:13:07.495 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-03-03T06:13:07.496 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-03-03T06:13:07.496 DEBUG:teuthology.parallel:result is None 2023-03-03T06:13:07.736 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-03-03T06:13:07.736 INFO:teuthology.orchestra.run.smithi191.stdout:Unable to read consumer identity 2023-03-03T06:13:07.984 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:02 ago on Fri 03 Mar 2023 06:13:05 AM UTC. 2023-03-03T06:13:08.022 INFO:teuthology.orchestra.run.smithi191.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-03-03T06:13:08.042 INFO:teuthology.orchestra.run.smithi191.stderr:Error: No packages marked for reinstall. 2023-03-03T06:13:08.089 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel --last | head -n 1 2023-03-03T06:13:08.168 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-03-03T06:13:08.170 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-03-03T06:13:08.170 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-03-03T06:13:08.170 DEBUG:teuthology.parallel:result is None 2023-03-03T06:13:08.171 INFO:teuthology.run_tasks:Running task internal.base... 2023-03-03T06:13:08.211 INFO:teuthology.task.internal:Creating test directory... 2023-03-03T06:13:08.212 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-03T06:13:08.215 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-03-03T06:13:08.233 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-03-03T06:13:08.289 INFO:teuthology.run_tasks:Running task internal.archive... 2023-03-03T06:13:08.376 INFO:teuthology.task.internal:Creating archive directory... 2023-03-03T06:13:08.377 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-03T06:13:08.379 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-03-03T06:13:08.404 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-03-03T06:13:08.453 INFO:teuthology.task.internal:Enabling coredump saving... 2023-03-03T06:13:08.454 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-03T06:13:08.457 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-03-03T06:13:08.496 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-03T06:13:08.500 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-03T06:13:08.512 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-03T06:13:08.514 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-03-03T06:13:08.515 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-03-03T06:13:08.538 INFO:teuthology.task.internal:Configuring sudo... 2023-03-03T06:13:08.539 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-03T06:13:08.542 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-03-03T06:13:08.582 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-03-03T06:13:08.613 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-03-03T06:13:08.614 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-03T06:13:08.616 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-03-03T06:13:08.638 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-03T06:13:08.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-03T06:13:08.770 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-03T06:13:08.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-03T06:13:08.901 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:13:08.902 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-03T06:13:08.972 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-03T06:13:09.018 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-03-03T06:13:09.068 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-03T06:13:09.156 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-03-03T06:13:09.193 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:13:09.194 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-03-03T06:13:09.260 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2023-03-03T06:13:09.263 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2023-03-03T06:13:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-03T06:13:09.353 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-03-03T06:13:09.724 INFO:teuthology.run_tasks:Running task internal.timer... 2023-03-03T06:13:09.842 INFO:teuthology.task.internal:Starting timer... 2023-03-03T06:13:09.842 INFO:teuthology.run_tasks:Running task pcp... 2023-03-03T06:13:09.892 INFO:teuthology.run_tasks:Running task selinux... 2023-03-03T06:13:09.933 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-03-03T06:13:09.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2023-03-03T06:13:09.995 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2023-03-03T06:13:09.996 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2023-03-03T06:13:10.060 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2023-03-03T06:13:10.062 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-03-03T06:13:10.062 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2023-03-03T06:13:10.086 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2023-03-03T06:13:10.086 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2023-03-03T06:13:10.105 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2023-03-03T06:13:10.106 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2023-03-03T06:13:10.106 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-03T06:13:10.155 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T06:13:10.155 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-03-03T06:13:10.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T06:13:10.183 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-03-03T06:13:10.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2023-03-03T06:13:10.224 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2023-03-03T06:13:10.252 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-03-03T06:13:10.303 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-03-03T06:13:10.303 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-03-03T06:13:10.326 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-03-03T06:13:10.328 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-03-03T06:20:30.167 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2023-03-03T06:20:30.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-03-03T06:20:30.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-03T06:20:30.241 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-03-03T06:20:30.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-03-03T06:20:30.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-03-03T06:20:30.381 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-03-03T06:20:30.455 INFO:teuthology.run_tasks:Running task clock... 2023-03-03T06:20:30.482 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-03-03T06:20:30.483 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-03T06:20:30.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-03T06:20:30.486 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-03-03T06:20:30.486 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-03-03T06:20:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-03T06:20:30.529 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-03-03T06:20:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-03T06:20:30.544 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-03-03T06:20:30.614 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2023-03-03T06:20:30.627 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2023-03-03T06:20:30.630 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2023-03-03T06:20:30.642 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2023-03-03T06:20:30.642 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-03T06:20:30.656 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-03-03T06:20:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-03T06:20:30.670 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-03-03T06:20:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2023-03-03T06:20:30.733 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-03T06:20:30.733 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2023-03-03T06:20:30.734 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-03T06:20:30.734 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-03T06:20:30.734 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-03T06:20:30.734 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-03T06:20:30.738 INFO:teuthology.orchestra.run.smithi191.stderr:bash: ntpq: command not found 2023-03-03T06:20:30.742 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-03-03T06:20:30.742 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2023-03-03T06:20:30.742 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-03T06:20:30.742 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-03T06:20:30.742 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-03T06:20:30.742 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-03-03T06:20:30.743 INFO:teuthology.run_tasks:Running task install... 2023-03-03T06:20:30.753 DEBUG:teuthology.task.install:project ceph 2023-03-03T06:20:30.754 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}} 2023-03-03T06:20:30.754 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'} 2023-03-03T06:20:30.754 INFO:teuthology.task.install:Using flavor: default 2023-03-03T06:20:30.760 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-03-03T06:20:30.760 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-03-03T06:20:30.761 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'tag': None, 'wait_for_package': False} 2023-03-03T06:20:30.762 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-03T06:20:30.764 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'tag': None, 'wait_for_package': False} 2023-03-03T06:20:30.764 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-03T06:20:30.899 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/ 2023-03-03T06:20:30.900 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2739.g472aaef4 2023-03-03T06:20:30.909 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/ 2023-03-03T06:20:30.909 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2739.g472aaef4 2023-03-03T06:20:31.008 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-03T06:20:31.008 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:20:31.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-03T06:20:31.011 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230303.023823/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-03-03T06:20:31.012 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:20:31.012 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-03-03T06:20:31.040 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-03T06:20:31.041 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-03T06:20:31.042 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-03-03T06:20:31.042 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/472aaef4ec3b3a2c29f73ca67854785a910f1f9b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-03-03T06:20:31.107 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-03T06:20:31.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-03-03T06:20:31.184 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-03T06:20:31.191 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-03-03T06:20:31.250 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2023-03-03T06:20:31.251 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2023-03-03T06:20:31.257 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2023-03-03T06:20:31.259 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2023-03-03T06:20:31.620 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-03-03T06:20:31.650 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-03-03T06:20:31.854 INFO:teuthology.orchestra.run.smithi191.stdout:44 files removed 2023-03-03T06:20:31.899 INFO:teuthology.orchestra.run.smithi005.stdout:44 files removed 2023-03-03T06:20:31.903 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-03T06:20:31.946 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-03-03T06:20:32.232 INFO:teuthology.orchestra.run.smithi191.stdout:Updating Subscription Management repositories. 2023-03-03T06:20:32.298 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2023-03-03T06:20:32.839 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 320 kB/s | 80 kB 00:00 2023-03-03T06:20:32.920 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 317 kB/s | 80 kB 00:00 2023-03-03T06:20:33.123 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 37 kB/s | 9.4 kB 00:00 2023-03-03T06:20:33.188 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 40 kB/s | 9.4 kB 00:00 2023-03-03T06:20:33.374 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-03-03T06:20:33.438 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-03-03T06:20:35.783 INFO:teuthology.orchestra.run.smithi191.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-03-03T06:20:36.047 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-03-03T06:20:38.225 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 5.7 MB/s | 14 MB 00:02 2023-03-03T06:20:38.582 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 14 MB 00:02 2023-03-03T06:20:41.325 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 417 kB/s | 24 kB 00:00 2023-03-03T06:20:41.882 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 398 kB/s | 24 kB 00:00 2023-03-03T06:20:42.227 INFO:teuthology.orchestra.run.smithi191.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-03-03T06:20:42.767 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-03-03T06:20:50.136 INFO:teuthology.orchestra.run.smithi191.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-03-03T06:20:51.159 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 MB/s | 53 MB 00:00 2023-03-03T06:21:01.310 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-03T06:21:01.311 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-03T06:21:01.326 INFO:teuthology.orchestra.run.smithi191.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-03-03T06:21:01.327 INFO:teuthology.orchestra.run.smithi191.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-03-03T06:21:01.328 INFO:teuthology.orchestra.run.smithi191.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-03-03T06:21:01.329 INFO:teuthology.orchestra.run.smithi191.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-03T06:21:01.331 INFO:teuthology.orchestra.run.smithi191.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-03T06:21:01.335 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-03T06:21:01.336 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-03T06:21:01.470 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2023-03-03T06:21:01.482 INFO:teuthology.orchestra.run.smithi191.stdout:=========================================================================================================================== 2023-03-03T06:21:01.482 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2023-03-03T06:21:01.482 INFO:teuthology.orchestra.run.smithi191.stdout:=========================================================================================================================== 2023-03-03T06:21:01.482 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2023-03-03T06:21:01.483 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-03-03T06:21:01.483 INFO:teuthology.orchestra.run.smithi191.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-03-03T06:21:01.483 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 6.4 k 2023-03-03T06:21:01.483 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 5.4 M 2023-03-03T06:21:01.483 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 845 k 2023-03-03T06:21:01.483 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 166 k 2023-03-03T06:21:01.483 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 1.5 M 2023-03-03T06:21:01.484 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 123 k 2023-03-03T06:21:01.484 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 1.7 M 2023-03-03T06:21:01.484 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 7.4 M 2023-03-03T06:21:01.484 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 47 k 2023-03-03T06:21:01.484 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 13 M 2023-03-03T06:21:01.484 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 47 M 2023-03-03T06:21:01.484 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 263 k 2023-03-03T06:21:01.485 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 83 k 2023-03-03T06:21:01.485 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 257 k 2023-03-03T06:21:01.485 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 18 k 2023-03-03T06:21:01.485 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-03-03T06:21:01.485 INFO:teuthology.orchestra.run.smithi191.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-03-03T06:21:01.485 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-03-03T06:21:01.485 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 30 k 2023-03-03T06:21:01.486 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 767 k 2023-03-03T06:21:01.486 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 139 k 2023-03-03T06:21:01.486 INFO:teuthology.orchestra.run.smithi191.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-03-03T06:21:01.486 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-03-03T06:21:01.486 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-03-03T06:21:01.486 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-03-03T06:21:01.486 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-03-03T06:21:01.486 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-03-03T06:21:01.487 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 190 k 2023-03-03T06:21:01.487 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 371 k 2023-03-03T06:21:01.487 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 364 k 2023-03-03T06:21:01.487 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 107 k 2023-03-03T06:21:01.487 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 94 k 2023-03-03T06:21:01.487 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.4 M 2023-03-03T06:21:01.487 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 180 k 2023-03-03T06:21:01.488 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-03-03T06:21:01.488 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2023-03-03T06:21:01.488 INFO:teuthology.orchestra.run.smithi191.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-03-03T06:21:01.488 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.7 M 2023-03-03T06:21:01.488 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.6 M 2023-03-03T06:21:01.488 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2023-03-03T06:21:01.488 INFO:teuthology.orchestra.run.smithi191.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-03-03T06:21:01.488 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 22 M 2023-03-03T06:21:01.489 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 23 k 2023-03-03T06:21:01.489 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 2.3 M 2023-03-03T06:21:01.489 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 236 k 2023-03-03T06:21:01.489 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 4.6 M 2023-03-03T06:21:01.489 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 18 M 2023-03-03T06:21:01.489 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 15 k 2023-03-03T06:21:01.489 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 24 k 2023-03-03T06:21:01.490 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-03-03T06:21:01.490 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-03T06:21:01.490 INFO:teuthology.orchestra.run.smithi191.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-03-03T06:21:01.490 INFO:teuthology.orchestra.run.smithi191.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-03-03T06:21:01.490 INFO:teuthology.orchestra.run.smithi191.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-03-03T06:21:01.490 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 137 k 2023-03-03T06:21:01.490 INFO:teuthology.orchestra.run.smithi191.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-03-03T06:21:01.491 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-03-03T06:21:01.491 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-03T06:21:01.491 INFO:teuthology.orchestra.run.smithi191.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-03-03T06:21:01.491 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-03-03T06:21:01.491 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-03-03T06:21:01.491 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 474 k 2023-03-03T06:21:01.491 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-03-03T06:21:01.492 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 6.5 M 2023-03-03T06:21:01.492 INFO:teuthology.orchestra.run.smithi191.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-03-03T06:21:01.492 INFO:teuthology.orchestra.run.smithi191.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-03-03T06:21:01.492 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-03T06:21:01.492 INFO:teuthology.orchestra.run.smithi191.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-03-03T06:21:01.492 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-03-03T06:21:01.492 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-03-03T06:21:01.492 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-03-03T06:21:01.493 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-03-03T06:21:01.493 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-03-03T06:21:01.493 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-03-03T06:21:01.493 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-03-03T06:21:01.493 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-03T06:21:01.493 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-03-03T06:21:01.493 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-03T06:21:01.494 INFO:teuthology.orchestra.run.smithi191.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-03T06:21:01.494 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-03T06:21:01.494 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 45 k 2023-03-03T06:21:01.494 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 117 k 2023-03-03T06:21:01.494 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-03T06:21:01.494 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-03-03T06:21:01.494 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-03T06:21:01.494 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-03T06:21:01.495 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-03-03T06:21:01.495 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-03T06:21:01.495 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-03T06:21:01.495 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-03T06:21:01.495 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-03-03T06:21:01.495 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-03-03T06:21:01.495 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-03-03T06:21:01.496 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-03T06:21:01.496 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-03T06:21:01.496 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-03T06:21:01.496 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-03-03T06:21:01.496 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-03-03T06:21:01.496 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-03T06:21:01.496 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-03T06:21:01.496 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-03-03T06:21:01.497 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-03-03T06:21:01.497 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-03-03T06:21:01.497 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-03T06:21:01.497 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-03T06:21:01.497 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-03-03T06:21:01.497 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-03-03T06:21:01.497 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-03-03T06:21:01.498 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-03-03T06:21:01.498 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-03-03T06:21:01.498 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-03T06:21:01.498 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-03T06:21:01.498 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-03T06:21:01.498 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-03T06:21:01.498 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-03T06:21:01.499 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-03-03T06:21:01.499 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-03T06:21:01.499 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-03T06:21:01.499 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-03T06:21:01.499 INFO:teuthology.orchestra.run.smithi191.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-03T06:21:01.499 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-03T06:21:01.499 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-03T06:21:01.499 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-03T06:21:01.500 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-03T06:21:01.500 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-03-03T06:21:01.500 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-03T06:21:01.500 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-03-03T06:21:01.500 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-03T06:21:01.500 INFO:teuthology.orchestra.run.smithi191.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-03-03T06:21:01.500 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-03-03T06:21:01.500 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-03-03T06:21:01.501 INFO:teuthology.orchestra.run.smithi191.stdout:Enabling module streams: 2023-03-03T06:21:01.501 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql 10 2023-03-03T06:21:01.501 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:21:01.501 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2023-03-03T06:21:01.501 INFO:teuthology.orchestra.run.smithi191.stdout:=========================================================================================================================== 2023-03-03T06:21:01.501 INFO:teuthology.orchestra.run.smithi191.stdout:Install 128 Packages 2023-03-03T06:21:01.501 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 3 Packages 2023-03-03T06:21:01.502 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:21:01.502 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 203 M 2023-03-03T06:21:01.502 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2023-03-03T06:21:01.627 INFO:teuthology.orchestra.run.smithi191.stdout:(1/131): ceph-18.0.0-2739.g472aaef4.el8.x86_64. 49 kB/s | 6.4 kB 00:00 2023-03-03T06:21:01.951 INFO:teuthology.orchestra.run.smithi191.stdout:(2/131): ceph-fuse-18.0.0-2739.g472aaef4.el8.x8 2.6 MB/s | 845 kB 00:00 2023-03-03T06:21:02.045 INFO:teuthology.orchestra.run.smithi191.stdout:(3/131): ceph-immutable-object-cache-18.0.0-273 1.7 MB/s | 166 kB 00:00 2023-03-03T06:21:02.128 INFO:teuthology.orchestra.run.smithi191.stdout:(4/131): ceph-base-18.0.0-2739.g472aaef4.el8.x8 8.5 MB/s | 5.4 MB 00:00 2023-03-03T06:21:02.379 INFO:teuthology.orchestra.run.smithi191.stdout:(5/131): ceph-mgr-18.0.0-2739.g472aaef4.el8.x86 6.2 MB/s | 1.5 MB 00:00 2023-03-03T06:21:02.545 INFO:teuthology.orchestra.run.smithi191.stdout:(6/131): ceph-mds-18.0.0-2739.g472aaef4.el8.x86 4.5 MB/s | 2.3 MB 00:00 2023-03-03T06:21:03.012 INFO:teuthology.orchestra.run.smithi191.stdout:(7/131): ceph-common-18.0.0-2739.g472aaef4.el8. 14 MB/s | 22 MB 00:01 2023-03-03T06:21:03.050 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-03T06:21:03.051 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-03-03T06:21:03.066 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-03-03T06:21:03.067 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-03-03T06:21:03.068 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-03-03T06:21:03.069 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-03-03T06:21:03.071 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-03-03T06:21:03.075 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-03-03T06:21:03.076 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-03-03T06:21:03.220 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2023-03-03T06:21:03.233 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-03-03T06:21:03.233 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2023-03-03T06:21:03.233 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-03-03T06:21:03.233 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2023-03-03T06:21:03.233 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-03-03T06:21:03.234 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-03-03T06:21:03.234 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 6.4 k 2023-03-03T06:21:03.234 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 5.4 M 2023-03-03T06:21:03.234 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 845 k 2023-03-03T06:21:03.234 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 166 k 2023-03-03T06:21:03.234 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 1.5 M 2023-03-03T06:21:03.234 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 123 k 2023-03-03T06:21:03.235 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 1.7 M 2023-03-03T06:21:03.235 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 7.4 M 2023-03-03T06:21:03.235 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 47 k 2023-03-03T06:21:03.235 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 13 M 2023-03-03T06:21:03.235 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 47 M 2023-03-03T06:21:03.235 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 263 k 2023-03-03T06:21:03.235 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 83 k 2023-03-03T06:21:03.236 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 257 k 2023-03-03T06:21:03.236 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 18 k 2023-03-03T06:21:03.236 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-03-03T06:21:03.236 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-03-03T06:21:03.236 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-03-03T06:21:03.236 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 30 k 2023-03-03T06:21:03.236 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 767 k 2023-03-03T06:21:03.237 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 139 k 2023-03-03T06:21:03.237 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-03-03T06:21:03.237 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-03-03T06:21:03.237 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-03-03T06:21:03.237 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-03-03T06:21:03.237 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-03-03T06:21:03.237 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-03-03T06:21:03.238 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 190 k 2023-03-03T06:21:03.238 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 371 k 2023-03-03T06:21:03.238 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 364 k 2023-03-03T06:21:03.238 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 107 k 2023-03-03T06:21:03.238 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 94 k 2023-03-03T06:21:03.238 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.4 M 2023-03-03T06:21:03.238 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 180 k 2023-03-03T06:21:03.238 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-03-03T06:21:03.239 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2023-03-03T06:21:03.239 INFO:teuthology.orchestra.run.smithi005.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-03-03T06:21:03.239 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.7 M 2023-03-03T06:21:03.239 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 3.6 M 2023-03-03T06:21:03.239 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2023-03-03T06:21:03.239 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-03-03T06:21:03.239 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 22 M 2023-03-03T06:21:03.240 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 23 k 2023-03-03T06:21:03.240 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 2.3 M 2023-03-03T06:21:03.240 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 236 k 2023-03-03T06:21:03.240 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 4.6 M 2023-03-03T06:21:03.240 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 18 M 2023-03-03T06:21:03.240 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2739.g472aaef4.el8 ceph-noarch 15 k 2023-03-03T06:21:03.240 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 24 k 2023-03-03T06:21:03.240 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-03-03T06:21:03.241 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-03-03T06:21:03.241 INFO:teuthology.orchestra.run.smithi005.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-03-03T06:21:03.241 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-03-03T06:21:03.241 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-03-03T06:21:03.241 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 137 k 2023-03-03T06:21:03.241 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-03-03T06:21:03.241 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-03-03T06:21:03.242 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-03-03T06:21:03.242 INFO:teuthology.orchestra.run.smithi005.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-03-03T06:21:03.242 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-03-03T06:21:03.242 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-03-03T06:21:03.242 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 474 k 2023-03-03T06:21:03.242 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-03-03T06:21:03.242 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 6.5 M 2023-03-03T06:21:03.242 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-03-03T06:21:03.243 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-03-03T06:21:03.243 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-03-03T06:21:03.243 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-03-03T06:21:03.243 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-03-03T06:21:03.243 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-03-03T06:21:03.243 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-03-03T06:21:03.243 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-03-03T06:21:03.244 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-03-03T06:21:03.244 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-03-03T06:21:03.244 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-03-03T06:21:03.244 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-03-03T06:21:03.244 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-03-03T06:21:03.244 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-03-03T06:21:03.244 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-03-03T06:21:03.245 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-03-03T06:21:03.245 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 45 k 2023-03-03T06:21:03.245 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:18.0.0-2739.g472aaef4.el8 ceph 117 k 2023-03-03T06:21:03.245 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-03-03T06:21:03.245 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-03-03T06:21:03.245 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-03-03T06:21:03.245 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-03-03T06:21:03.245 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-03-03T06:21:03.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-03-03T06:21:03.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-03-03T06:21:03.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-03-03T06:21:03.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-03-03T06:21:03.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-03-03T06:21:03.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-03-03T06:21:03.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-03T06:21:03.247 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-03-03T06:21:03.247 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-03-03T06:21:03.247 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-03-03T06:21:03.247 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-03-03T06:21:03.247 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-03-03T06:21:03.248 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-03-03T06:21:03.248 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-03-03T06:21:03.248 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-03-03T06:21:03.248 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-03-03T06:21:03.248 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-03-03T06:21:03.248 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-03-03T06:21:03.249 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-03-03T06:21:03.249 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-03-03T06:21:03.249 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-03-03T06:21:03.249 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-03-03T06:21:03.249 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-03-03T06:21:03.249 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-03-03T06:21:03.250 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-03-03T06:21:03.250 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-03-03T06:21:03.250 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-03-03T06:21:03.250 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-03-03T06:21:03.250 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-03-03T06:21:03.250 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-03-03T06:21:03.251 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-03-03T06:21:03.251 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-03-03T06:21:03.251 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-03-03T06:21:03.251 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-03-03T06:21:03.251 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-03-03T06:21:03.251 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-03-03T06:21:03.251 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-03-03T06:21:03.251 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-03-03T06:21:03.252 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-03-03T06:21:03.252 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-03-03T06:21:03.252 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-03-03T06:21:03.252 INFO:teuthology.orchestra.run.smithi005.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-03-03T06:21:03.252 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-03-03T06:21:03.252 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-03-03T06:21:03.252 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling module streams: 2023-03-03T06:21:03.253 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql 10 2023-03-03T06:21:03.253 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:21:03.253 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2023-03-03T06:21:03.253 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2023-03-03T06:21:03.253 INFO:teuthology.orchestra.run.smithi005.stdout:Install 128 Packages 2023-03-03T06:21:03.253 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 3 Packages 2023-03-03T06:21:03.253 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:21:03.254 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 203 M 2023-03-03T06:21:03.254 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2023-03-03T06:21:03.622 INFO:teuthology.orchestra.run.smithi005.stdout:(1/131): ceph-18.0.0-2739.g472aaef4.el8.x86_64. 17 kB/s | 6.4 kB 00:00 2023-03-03T06:21:04.054 INFO:teuthology.orchestra.run.smithi191.stdout:(8/131): ceph-radosgw-18.0.0-2739.g472aaef4.el8 13 MB/s | 13 MB 00:01 2023-03-03T06:21:04.092 INFO:teuthology.orchestra.run.smithi005.stdout:(2/131): ceph-fuse-18.0.0-2739.g472aaef4.el8.x8 1.8 MB/s | 845 kB 00:00 2023-03-03T06:21:04.121 INFO:teuthology.orchestra.run.smithi191.stdout:(9/131): ceph-mon-18.0.0-2739.g472aaef4.el8.x86 2.6 MB/s | 4.6 MB 00:01 2023-03-03T06:21:04.146 INFO:teuthology.orchestra.run.smithi191.stdout:(10/131): ceph-selinux-18.0.0-2739.g472aaef4.el 265 kB/s | 24 kB 00:00 2023-03-03T06:21:04.192 INFO:teuthology.orchestra.run.smithi005.stdout:(3/131): ceph-immutable-object-cache-18.0.0-273 1.6 MB/s | 166 kB 00:00 2023-03-03T06:21:04.239 INFO:teuthology.orchestra.run.smithi191.stdout:(11/131): cephfs-mirror-18.0.0-2739.g472aaef4.e 2.7 MB/s | 257 kB 00:00 2023-03-03T06:21:04.268 INFO:teuthology.orchestra.run.smithi005.stdout:(4/131): ceph-base-18.0.0-2739.g472aaef4.el8.x8 5.3 MB/s | 5.4 MB 00:01 2023-03-03T06:21:04.289 INFO:teuthology.orchestra.run.smithi191.stdout:(12/131): libcephfs-devel-18.0.0-2739.g472aaef4 611 kB/s | 30 kB 00:00 2023-03-03T06:21:04.485 INFO:teuthology.orchestra.run.smithi005.stdout:(5/131): ceph-mgr-18.0.0-2739.g472aaef4.el8.x86 7.1 MB/s | 1.5 MB 00:00 2023-03-03T06:21:04.664 INFO:teuthology.orchestra.run.smithi191.stdout:(13/131): ceph-osd-18.0.0-2739.g472aaef4.el8.x8 8.3 MB/s | 18 MB 00:02 2023-03-03T06:21:04.685 INFO:teuthology.orchestra.run.smithi005.stdout:(6/131): ceph-mds-18.0.0-2739.g472aaef4.el8.x86 4.6 MB/s | 2.3 MB 00:00 2023-03-03T06:21:04.731 INFO:teuthology.orchestra.run.smithi191.stdout:(14/131): libcephsqlite-18.0.0-2739.g472aaef4.e 2.0 MB/s | 137 kB 00:00 2023-03-03T06:21:04.847 INFO:teuthology.orchestra.run.smithi191.stdout:(15/131): librados-devel-18.0.0-2739.g472aaef4. 1.2 MB/s | 139 kB 00:00 2023-03-03T06:21:04.910 INFO:teuthology.orchestra.run.smithi005.stdout:(7/131): ceph-mon-18.0.0-2739.g472aaef4.el8.x86 11 MB/s | 4.6 MB 00:00 2023-03-03T06:21:04.915 INFO:teuthology.orchestra.run.smithi191.stdout:(16/131): libcephfs2-18.0.0-2739.g472aaef4.el8. 1.2 MB/s | 767 kB 00:00 2023-03-03T06:21:04.940 INFO:teuthology.orchestra.run.smithi191.stdout:(17/131): libradosstriper1-18.0.0-2739.g472aaef 5.0 MB/s | 474 kB 00:00 2023-03-03T06:21:05.032 INFO:teuthology.orchestra.run.smithi191.stdout:(18/131): python3-ceph-argparse-18.0.0-2739.g47 486 kB/s | 45 kB 00:00 2023-03-03T06:21:05.133 INFO:teuthology.orchestra.run.smithi191.stdout:(19/131): python3-ceph-common-18.0.0-2739.g472a 1.1 MB/s | 117 kB 00:00 2023-03-03T06:21:05.658 INFO:teuthology.orchestra.run.smithi191.stdout:(20/131): python3-cephfs-18.0.0-2739.g472aaef4. 362 kB/s | 190 kB 00:00 2023-03-03T06:21:05.800 INFO:teuthology.orchestra.run.smithi191.stdout:(21/131): librgw2-18.0.0-2739.g472aaef4.el8.x86 7.3 MB/s | 6.5 MB 00:00 2023-03-03T06:21:05.825 INFO:teuthology.orchestra.run.smithi191.stdout:(22/131): python3-rados-18.0.0-2739.g472aaef4.e 2.2 MB/s | 371 kB 00:00 2023-03-03T06:21:05.884 INFO:teuthology.orchestra.run.smithi191.stdout:(23/131): python3-rbd-18.0.0-2739.g472aaef4.el8 4.3 MB/s | 364 kB 00:00 2023-03-03T06:21:05.909 INFO:teuthology.orchestra.run.smithi191.stdout:(24/131): python3-rgw-18.0.0-2739.g472aaef4.el8 1.2 MB/s | 107 kB 00:00 2023-03-03T06:21:05.951 INFO:teuthology.orchestra.run.smithi191.stdout:(25/131): rbd-fuse-18.0.0-2739.g472aaef4.el8.x8 1.4 MB/s | 94 kB 00:00 2023-03-03T06:21:06.059 INFO:teuthology.orchestra.run.smithi191.stdout:(26/131): rbd-nbd-18.0.0-2739.g472aaef4.el8.x86 1.6 MB/s | 180 kB 00:00 2023-03-03T06:21:06.143 INFO:teuthology.orchestra.run.smithi191.stdout:(27/131): ceph-grafana-dashboards-18.0.0-2739.g 277 kB/s | 23 kB 00:00 2023-03-03T06:21:06.235 INFO:teuthology.orchestra.run.smithi191.stdout:(28/131): ceph-mgr-cephadm-18.0.0-2739.g472aaef 1.3 MB/s | 123 kB 00:00 2023-03-03T06:21:06.294 INFO:teuthology.orchestra.run.smithi005.stdout:(8/131): ceph-radosgw-18.0.0-2739.g472aaef4.el8 9.4 MB/s | 13 MB 00:01 2023-03-03T06:21:06.369 INFO:teuthology.orchestra.run.smithi005.stdout:(9/131): ceph-selinux-18.0.0-2739.g472aaef4.el8 325 kB/s | 24 kB 00:00 2023-03-03T06:21:06.469 INFO:teuthology.orchestra.run.smithi191.stdout:(29/131): ceph-mgr-dashboard-18.0.0-2739.g472aa 7.4 MB/s | 1.7 MB 00:00 2023-03-03T06:21:06.578 INFO:teuthology.orchestra.run.smithi191.stdout:(30/131): rbd-mirror-18.0.0-2739.g472aaef4.el8. 5.2 MB/s | 3.4 MB 00:00 2023-03-03T06:21:06.678 INFO:teuthology.orchestra.run.smithi191.stdout:(31/131): ceph-mgr-modules-core-18.0.0-2739.g47 2.3 MB/s | 236 kB 00:00 2023-03-03T06:21:06.761 INFO:teuthology.orchestra.run.smithi191.stdout:(32/131): ceph-mgr-rook-18.0.0-2739.g472aaef4.e 571 kB/s | 47 kB 00:00 2023-03-03T06:21:06.854 INFO:teuthology.orchestra.run.smithi191.stdout:(33/131): ceph-prometheus-alerts-18.0.0-2739.g4 158 kB/s | 15 kB 00:00 2023-03-03T06:21:06.954 INFO:teuthology.orchestra.run.smithi191.stdout:(34/131): ceph-volume-18.0.0-2739.g472aaef4.el8 2.6 MB/s | 263 kB 00:00 2023-03-03T06:21:07.037 INFO:teuthology.orchestra.run.smithi191.stdout:(35/131): cephadm-18.0.0-2739.g472aaef4.el8.noa 996 kB/s | 83 kB 00:00 2023-03-03T06:21:07.129 INFO:teuthology.orchestra.run.smithi191.stdout:(36/131): cephfs-top-18.0.0-2739.g472aaef4.el8. 197 kB/s | 18 kB 00:00 2023-03-03T06:21:07.355 INFO:teuthology.orchestra.run.smithi191.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-03-03T06:21:07.403 INFO:teuthology.orchestra.run.smithi005.stdout:(10/131): ceph-osd-18.0.0-2739.g472aaef4.el8.x8 6.5 MB/s | 18 MB 00:02 2023-03-03T06:21:07.463 INFO:teuthology.orchestra.run.smithi005.stdout:(11/131): cephfs-mirror-18.0.0-2739.g472aaef4.e 4.3 MB/s | 257 kB 00:00 2023-03-03T06:21:07.480 INFO:teuthology.orchestra.run.smithi191.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 7.3 MB/s | 7.4 MB 00:01 2023-03-03T06:21:07.505 INFO:teuthology.orchestra.run.smithi191.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 392 kB/s | 59 kB 00:00 2023-03-03T06:21:07.512 INFO:teuthology.orchestra.run.smithi005.stdout:(12/131): libcephfs-devel-18.0.0-2739.g472aaef4 610 kB/s | 30 kB 00:00 2023-03-03T06:21:07.643 INFO:teuthology.orchestra.run.smithi191.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 462 kB/s | 75 kB 00:00 2023-03-03T06:21:07.645 INFO:teuthology.orchestra.run.smithi005.stdout:(13/131): libcephfs2-18.0.0-2739.g472aaef4.el8. 5.6 MB/s | 767 kB 00:00 2023-03-03T06:21:07.704 INFO:teuthology.orchestra.run.smithi005.stdout:(14/131): libcephsqlite-18.0.0-2739.g472aaef4.e 2.3 MB/s | 137 kB 00:00 2023-03-03T06:21:07.706 INFO:teuthology.orchestra.run.smithi191.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2023-03-03T06:21:07.723 INFO:teuthology.orchestra.run.smithi191.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 548 kB/s | 44 kB 00:00 2023-03-03T06:21:07.765 INFO:teuthology.orchestra.run.smithi191.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 798 kB/s | 33 kB 00:00 2023-03-03T06:21:07.771 INFO:teuthology.orchestra.run.smithi005.stdout:(15/131): librados-devel-18.0.0-2739.g472aaef4. 2.0 MB/s | 139 kB 00:00 2023-03-03T06:21:07.790 INFO:teuthology.orchestra.run.smithi191.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2023-03-03T06:21:07.807 INFO:teuthology.orchestra.run.smithi191.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 390 kB/s | 16 kB 00:00 2023-03-03T06:21:07.866 INFO:teuthology.orchestra.run.smithi191.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-03-03T06:21:07.879 INFO:teuthology.orchestra.run.smithi005.stdout:(16/131): libradosstriper1-18.0.0-2739.g472aaef 4.3 MB/s | 474 kB 00:00 2023-03-03T06:21:07.916 INFO:teuthology.orchestra.run.smithi191.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-03-03T06:21:07.958 INFO:teuthology.orchestra.run.smithi191.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 267 kB/s | 11 kB 00:00 2023-03-03T06:21:07.983 INFO:teuthology.orchestra.run.smithi191.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.1 MB/s | 384 kB 00:00 2023-03-03T06:21:08.008 INFO:teuthology.orchestra.run.smithi191.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-03-03T06:21:08.076 INFO:teuthology.orchestra.run.smithi191.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 730 kB/s | 49 kB 00:00 2023-03-03T06:21:08.126 INFO:teuthology.orchestra.run.smithi191.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.2 MB/s | 59 kB 00:00 2023-03-03T06:21:08.168 INFO:teuthology.orchestra.run.smithi191.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-03-03T06:21:08.276 INFO:teuthology.orchestra.run.smithi191.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-03-03T06:21:08.326 INFO:teuthology.orchestra.run.smithi191.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 313 kB/s | 16 kB 00:00 2023-03-03T06:21:08.377 INFO:teuthology.orchestra.run.smithi191.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 674 kB/s | 34 kB 00:00 2023-03-03T06:21:08.410 INFO:teuthology.orchestra.run.smithi191.stdout:(57/131): python3-kubernetes-11.0.0-6.el8.noarc 2.7 MB/s | 1.2 MB 00:00 2023-03-03T06:21:08.477 INFO:teuthology.orchestra.run.smithi191.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-03-03T06:21:08.503 INFO:teuthology.orchestra.run.smithi191.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 669 kB/s | 61 kB 00:00 2023-03-03T06:21:08.528 INFO:teuthology.orchestra.run.smithi191.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 374 kB/s | 19 kB 00:00 2023-03-03T06:21:08.553 INFO:teuthology.orchestra.run.smithi191.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 476 kB/s | 24 kB 00:00 2023-03-03T06:21:08.579 INFO:teuthology.orchestra.run.smithi191.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 582 kB/s | 29 kB 00:00 2023-03-03T06:21:08.604 INFO:teuthology.orchestra.run.smithi191.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 548 kB/s | 27 kB 00:00 2023-03-03T06:21:08.662 INFO:teuthology.orchestra.run.smithi191.stdout:(64/131): python3-waitress-1.2.1-2.el8.1.noarch 2.8 MB/s | 241 kB 00:00 2023-03-03T06:21:08.688 INFO:teuthology.orchestra.run.smithi191.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-03-03T06:21:08.688 INFO:teuthology.orchestra.run.smithi005.stdout:(17/131): librgw2-18.0.0-2739.g472aaef4.el8.x86 8.0 MB/s | 6.5 MB 00:00 2023-03-03T06:21:08.713 INFO:teuthology.orchestra.run.smithi191.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-03-03T06:21:08.738 INFO:teuthology.orchestra.run.smithi191.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-03-03T06:21:08.747 INFO:teuthology.orchestra.run.smithi005.stdout:(18/131): python3-ceph-argparse-18.0.0-2739.g47 767 kB/s | 45 kB 00:00 2023-03-03T06:21:08.764 INFO:teuthology.orchestra.run.smithi191.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 457 kB/s | 23 kB 00:00 2023-03-03T06:21:08.781 INFO:teuthology.orchestra.run.smithi191.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2023-03-03T06:21:08.814 INFO:teuthology.orchestra.run.smithi005.stdout:(19/131): python3-ceph-common-18.0.0-2739.g472a 1.7 MB/s | 117 kB 00:00 2023-03-03T06:21:08.881 INFO:teuthology.orchestra.run.smithi005.stdout:(20/131): python3-cephfs-18.0.0-2739.g472aaef4. 2.8 MB/s | 190 kB 00:00 2023-03-03T06:21:08.956 INFO:teuthology.orchestra.run.smithi005.stdout:(21/131): python3-rados-18.0.0-2739.g472aaef4.e 4.8 MB/s | 371 kB 00:00 2023-03-03T06:21:09.032 INFO:teuthology.orchestra.run.smithi005.stdout:(22/131): python3-rbd-18.0.0-2739.g472aaef4.el8 4.7 MB/s | 364 kB 00:00 2023-03-03T06:21:09.098 INFO:teuthology.orchestra.run.smithi191.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 43 MB/s | 14 MB 00:00 2023-03-03T06:21:09.099 INFO:teuthology.orchestra.run.smithi005.stdout:(23/131): python3-rgw-18.0.0-2739.g472aaef4.el8 1.6 MB/s | 107 kB 00:00 2023-03-03T06:21:09.148 INFO:teuthology.orchestra.run.smithi191.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-03-03T06:21:09.165 INFO:teuthology.orchestra.run.smithi005.stdout:(24/131): rbd-fuse-18.0.0-2739.g472aaef4.el8.x8 1.4 MB/s | 94 kB 00:00 2023-03-03T06:21:09.198 INFO:teuthology.orchestra.run.smithi191.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 3.8 MB/s | 1.7 MB 00:00 2023-03-03T06:21:09.251 INFO:teuthology.orchestra.run.smithi191.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 525 kB/s | 54 kB 00:00 2023-03-03T06:21:09.315 INFO:teuthology.orchestra.run.smithi191.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-03-03T06:21:09.341 INFO:teuthology.orchestra.run.smithi191.stdout:(75/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2023-03-03T06:21:09.375 INFO:teuthology.orchestra.run.smithi191.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 661 kB/s | 39 kB 00:00 2023-03-03T06:21:09.417 INFO:teuthology.orchestra.run.smithi191.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 8.9 MB/s | 688 kB 00:00 2023-03-03T06:21:09.450 INFO:teuthology.orchestra.run.smithi191.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.0 MB/s | 538 kB 00:00 2023-03-03T06:21:09.475 INFO:teuthology.orchestra.run.smithi191.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-03-03T06:21:09.501 INFO:teuthology.orchestra.run.smithi191.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-03-03T06:21:09.542 INFO:teuthology.orchestra.run.smithi191.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-03-03T06:21:09.593 INFO:teuthology.orchestra.run.smithi191.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 530 kB/s | 27 kB 00:00 2023-03-03T06:21:09.607 INFO:teuthology.orchestra.run.smithi005.stdout:(25/131): rbd-mirror-18.0.0-2739.g472aaef4.el8. 7.8 MB/s | 3.4 MB 00:00 2023-03-03T06:21:09.674 INFO:teuthology.orchestra.run.smithi005.stdout:(26/131): rbd-nbd-18.0.0-2739.g472aaef4.el8.x86 2.6 MB/s | 180 kB 00:00 2023-03-03T06:21:09.701 INFO:teuthology.orchestra.run.smithi191.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-03-03T06:21:09.727 INFO:teuthology.orchestra.run.smithi191.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-03-03T06:21:09.733 INFO:teuthology.orchestra.run.smithi005.stdout:(27/131): ceph-grafana-dashboards-18.0.0-2739.g 395 kB/s | 23 kB 00:00 2023-03-03T06:21:09.752 INFO:teuthology.orchestra.run.smithi191.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 875 kB/s | 44 kB 00:00 2023-03-03T06:21:09.792 INFO:teuthology.orchestra.run.smithi005.stdout:(28/131): ceph-mgr-cephadm-18.0.0-2739.g472aaef 2.0 MB/s | 123 kB 00:00 2023-03-03T06:21:09.811 INFO:teuthology.orchestra.run.smithi191.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2023-03-03T06:21:09.869 INFO:teuthology.orchestra.run.smithi191.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 26 MB/s | 3.7 MB 00:00 2023-03-03T06:21:09.895 INFO:teuthology.orchestra.run.smithi191.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.6 MB/s | 225 kB 00:00 2023-03-03T06:21:09.920 INFO:teuthology.orchestra.run.smithi191.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-03-03T06:21:09.937 INFO:teuthology.orchestra.run.smithi191.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.0 MB/s | 126 kB 00:00 2023-03-03T06:21:09.971 INFO:teuthology.orchestra.run.smithi191.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-03-03T06:21:09.996 INFO:teuthology.orchestra.run.smithi191.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2023-03-03T06:21:10.065 INFO:teuthology.orchestra.run.smithi191.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 7.4 MB/s | 709 kB 00:00 2023-03-03T06:21:10.139 INFO:teuthology.orchestra.run.smithi191.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2023-03-03T06:21:10.214 INFO:teuthology.orchestra.run.smithi191.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 22 MB/s | 4.9 MB 00:00 2023-03-03T06:21:10.242 INFO:teuthology.orchestra.run.smithi005.stdout:(29/131): ceph-test-18.0.0-2739.g472aaef4.el8.x 12 MB/s | 47 MB 00:03 2023-03-03T06:21:10.264 INFO:teuthology.orchestra.run.smithi191.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.0 MB/s | 202 kB 00:00 2023-03-03T06:21:10.292 INFO:teuthology.orchestra.run.smithi005.stdout:(30/131): ceph-mgr-dashboard-18.0.0-2739.g472aa 3.5 MB/s | 1.7 MB 00:00 2023-03-03T06:21:10.339 INFO:teuthology.orchestra.run.smithi191.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2023-03-03T06:21:10.351 INFO:teuthology.orchestra.run.smithi005.stdout:(31/131): ceph-mgr-modules-core-18.0.0-2739.g47 4.0 MB/s | 236 kB 00:00 2023-03-03T06:21:10.365 INFO:teuthology.orchestra.run.smithi191.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.4 MB/s | 354 kB 00:00 2023-03-03T06:21:10.401 INFO:teuthology.orchestra.run.smithi005.stdout:(32/131): ceph-mgr-rook-18.0.0-2739.g472aaef4.e 954 kB/s | 47 kB 00:00 2023-03-03T06:21:10.452 INFO:teuthology.orchestra.run.smithi005.stdout:(33/131): ceph-prometheus-alerts-18.0.0-2739.g4 293 kB/s | 15 kB 00:00 2023-03-03T06:21:10.462 INFO:teuthology.orchestra.run.smithi191.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 8.1 MB/s | 808 kB 00:00 2023-03-03T06:21:10.535 INFO:teuthology.orchestra.run.smithi005.stdout:(34/131): ceph-volume-18.0.0-2739.g472aaef4.el8 3.1 MB/s | 263 kB 00:00 2023-03-03T06:21:10.540 INFO:teuthology.orchestra.run.smithi191.stdout:(100/131): postgresql-server-10.21-2.module+el8 25 MB/s | 5.1 MB 00:00 2023-03-03T06:21:10.577 INFO:teuthology.orchestra.run.smithi005.stdout:(35/131): cephadm-18.0.0-2739.g472aaef4.el8.noa 2.0 MB/s | 83 kB 00:00 2023-03-03T06:21:10.582 INFO:teuthology.orchestra.run.smithi191.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-03-03T06:21:10.607 INFO:teuthology.orchestra.run.smithi191.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 700 kB/s | 47 kB 00:00 2023-03-03T06:21:10.628 INFO:teuthology.orchestra.run.smithi005.stdout:(36/131): cephfs-top-18.0.0-2739.g472aaef4.el8. 362 kB/s | 18 kB 00:00 2023-03-03T06:21:10.633 INFO:teuthology.orchestra.run.smithi191.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-03-03T06:21:10.658 INFO:teuthology.orchestra.run.smithi191.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-03-03T06:21:10.684 INFO:teuthology.orchestra.run.smithi191.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-03-03T06:21:10.709 INFO:teuthology.orchestra.run.smithi191.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 954 kB/s | 48 kB 00:00 2023-03-03T06:21:10.734 INFO:teuthology.orchestra.run.smithi191.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-03-03T06:21:10.759 INFO:teuthology.orchestra.run.smithi191.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 849 kB/s | 43 kB 00:00 2023-03-03T06:21:10.778 INFO:teuthology.orchestra.run.smithi005.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 14 MB/s | 7.4 MB 00:00 2023-03-03T06:21:10.785 INFO:teuthology.orchestra.run.smithi191.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-03-03T06:21:10.810 INFO:teuthology.orchestra.run.smithi191.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-03-03T06:21:10.862 INFO:teuthology.orchestra.run.smithi005.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-03-03T06:21:10.877 INFO:teuthology.orchestra.run.smithi191.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.9 MB/s | 560 kB 00:00 2023-03-03T06:21:10.911 INFO:teuthology.orchestra.run.smithi191.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 186 kB/s | 19 kB 00:00 2023-03-03T06:21:10.912 INFO:teuthology.orchestra.run.smithi005.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 441 kB/s | 59 kB 00:00 2023-03-03T06:21:10.936 INFO:teuthology.orchestra.run.smithi191.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 2.6 MB/s | 155 kB 00:00 2023-03-03T06:21:10.937 INFO:teuthology.orchestra.run.smithi005.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2023-03-03T06:21:10.970 INFO:teuthology.orchestra.run.smithi191.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 9.3 MB/s | 559 kB 00:00 2023-03-03T06:21:10.987 INFO:teuthology.orchestra.run.smithi005.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 873 kB/s | 44 kB 00:00 2023-03-03T06:21:10.995 INFO:teuthology.orchestra.run.smithi191.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-03-03T06:21:11.029 INFO:teuthology.orchestra.run.smithi191.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-03-03T06:21:11.054 INFO:teuthology.orchestra.run.smithi191.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-03-03T06:21:11.089 INFO:teuthology.orchestra.run.smithi005.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2023-03-03T06:21:11.112 INFO:teuthology.orchestra.run.smithi191.stdout:(118/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 28 MB/s | 2.3 MB 00:00 2023-03-03T06:21:11.121 INFO:teuthology.orchestra.run.smithi005.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.2 MB/s | 476 kB 00:00 2023-03-03T06:21:11.137 INFO:teuthology.orchestra.run.smithi191.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 865 kB/s | 72 kB 00:00 2023-03-03T06:21:11.146 INFO:teuthology.orchestra.run.smithi005.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 581 kB/s | 33 kB 00:00 2023-03-03T06:21:11.163 INFO:teuthology.orchestra.run.smithi191.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-03-03T06:21:11.172 INFO:teuthology.orchestra.run.smithi005.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2023-03-03T06:21:11.188 INFO:teuthology.orchestra.run.smithi191.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-03-03T06:21:11.214 INFO:teuthology.orchestra.run.smithi005.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.5 MB/s | 173 kB 00:00 2023-03-03T06:21:11.214 INFO:teuthology.orchestra.run.smithi191.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-03-03T06:21:11.239 INFO:teuthology.orchestra.run.smithi191.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-03-03T06:21:11.256 INFO:teuthology.orchestra.run.smithi005.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2023-03-03T06:21:11.290 INFO:teuthology.orchestra.run.smithi191.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 511 kB/s | 39 kB 00:00 2023-03-03T06:21:11.306 INFO:teuthology.orchestra.run.smithi005.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.8 MB/s | 384 kB 00:00 2023-03-03T06:21:11.331 INFO:teuthology.orchestra.run.smithi005.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-03-03T06:21:11.357 INFO:teuthology.orchestra.run.smithi005.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-03-03T06:21:11.407 INFO:teuthology.orchestra.run.smithi005.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 976 kB/s | 49 kB 00:00 2023-03-03T06:21:11.457 INFO:teuthology.orchestra.run.smithi005.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-03-03T06:21:11.498 INFO:teuthology.orchestra.run.smithi191.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 2.4 MB/s | 644 kB 00:00 2023-03-03T06:21:11.507 INFO:teuthology.orchestra.run.smithi005.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-03-03T06:21:11.524 INFO:teuthology.orchestra.run.smithi191.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 732 kB/s | 171 kB 00:00 2023-03-03T06:21:11.557 INFO:teuthology.orchestra.run.smithi191.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.3 MB/s | 138 kB 00:00 2023-03-03T06:21:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-03-03T06:21:11.691 INFO:teuthology.orchestra.run.smithi005.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 3.2 MB/s | 1.2 MB 00:00 2023-03-03T06:21:11.717 INFO:teuthology.orchestra.run.smithi005.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-03-03T06:21:11.742 INFO:teuthology.orchestra.run.smithi005.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 667 kB/s | 34 kB 00:00 2023-03-03T06:21:11.826 INFO:teuthology.orchestra.run.smithi005.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 738 kB/s | 61 kB 00:00 2023-03-03T06:21:11.859 INFO:teuthology.orchestra.run.smithi005.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.3 MB/s | 196 kB 00:00 2023-03-03T06:21:12.032 INFO:teuthology.orchestra.run.smithi191.stdout:(128/131): librbd1-18.0.0-2739.g472aaef4.el8.x8 7.5 MB/s | 3.6 MB 00:00 2023-03-03T06:21:12.103 INFO:teuthology.orchestra.run.smithi005.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 67 kB/s | 19 kB 00:00 2023-03-03T06:21:12.127 INFO:teuthology.orchestra.run.smithi005.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 89 kB/s | 24 kB 00:00 2023-03-03T06:21:12.133 INFO:teuthology.orchestra.run.smithi191.stdout:(129/131): librados2-18.0.0-2739.g472aaef4.el8. 6.0 MB/s | 3.7 MB 00:00 2023-03-03T06:21:12.152 INFO:teuthology.orchestra.run.smithi005.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 604 kB/s | 29 kB 00:00 2023-03-03T06:21:12.166 INFO:teuthology.orchestra.run.smithi191.stdout:(130/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 5.8 MB/s | 798 kB 00:00 2023-03-03T06:21:12.178 INFO:teuthology.orchestra.run.smithi005.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 547 kB/s | 27 kB 00:00 2023-03-03T06:21:12.261 INFO:teuthology.orchestra.run.smithi005.stdout:(64/131): python3-waitress-1.2.1-2.el8.1.noarch 2.2 MB/s | 241 kB 00:00 2023-03-03T06:21:12.287 INFO:teuthology.orchestra.run.smithi005.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-03-03T06:21:12.312 INFO:teuthology.orchestra.run.smithi005.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-03-03T06:21:12.345 INFO:teuthology.orchestra.run.smithi005.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-03-03T06:21:12.362 INFO:teuthology.orchestra.run.smithi005.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 458 kB/s | 23 kB 00:00 2023-03-03T06:21:12.396 INFO:teuthology.orchestra.run.smithi005.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 70 kB 00:00 2023-03-03T06:21:12.608 INFO:teuthology.orchestra.run.smithi191.stdout:(131/131): ceph-test-18.0.0-2739.g472aaef4.el8. 5.5 MB/s | 47 MB 00:08 2023-03-03T06:21:12.611 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2023-03-03T06:21:12.612 INFO:teuthology.orchestra.run.smithi191.stdout:Total 18 MB/s | 203 MB 00:11 2023-03-03T06:21:12.746 INFO:teuthology.orchestra.run.smithi005.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 39 MB/s | 14 MB 00:00 2023-03-03T06:21:12.814 INFO:teuthology.orchestra.run.smithi005.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-03-03T06:21:12.847 INFO:teuthology.orchestra.run.smithi005.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-03-03T06:21:12.889 INFO:teuthology.orchestra.run.smithi005.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-03-03T06:21:12.931 INFO:teuthology.orchestra.run.smithi005.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-03-03T06:21:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:(75/131): thrift-0.13.0-2.el8.x86_64.rpm 2.8 MB/s | 1.7 MB 00:00 2023-03-03T06:21:12.998 INFO:teuthology.orchestra.run.smithi005.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 579 kB/s | 39 kB 00:00 2023-03-03T06:21:13.057 INFO:teuthology.orchestra.run.smithi005.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2023-03-03T06:21:13.082 INFO:teuthology.orchestra.run.smithi005.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 6.2 MB/s | 688 kB 00:00 2023-03-03T06:21:13.107 INFO:teuthology.orchestra.run.smithi005.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.0 MB/s | 157 kB 00:00 2023-03-03T06:21:13.132 INFO:teuthology.orchestra.run.smithi005.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-03-03T06:21:13.174 INFO:teuthology.orchestra.run.smithi005.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-03-03T06:21:13.208 INFO:teuthology.orchestra.run.smithi005.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 795 kB/s | 27 kB 00:00 2023-03-03T06:21:13.250 INFO:teuthology.orchestra.run.smithi005.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-03-03T06:21:13.284 INFO:teuthology.orchestra.run.smithi005.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-03-03T06:21:13.360 INFO:teuthology.orchestra.run.smithi005.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-03-03T06:21:13.410 INFO:teuthology.orchestra.run.smithi005.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-03-03T06:21:13.452 INFO:teuthology.orchestra.run.smithi005.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-03-03T06:21:13.452 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2023-03-03T06:21:13.519 INFO:teuthology.orchestra.run.smithi005.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 16 MB/s | 3.7 MB 00:00 2023-03-03T06:21:13.572 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2023-03-03T06:21:13.573 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2023-03-03T06:21:13.735 INFO:teuthology.orchestra.run.smithi005.stdout:(89/131): ceph-common-18.0.0-2739.g472aaef4.el8 2.1 MB/s | 22 MB 00:10 2023-03-03T06:21:13.761 INFO:teuthology.orchestra.run.smithi005.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 207 kB/s | 64 kB 00:00 2023-03-03T06:21:13.786 INFO:teuthology.orchestra.run.smithi005.stdout:(91/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 473 kB/s | 126 kB 00:00 2023-03-03T06:21:13.819 INFO:teuthology.orchestra.run.smithi005.stdout:(92/131): python3-jsonpointer-1.10-11.el8.noarc 343 kB/s | 20 kB 00:00 2023-03-03T06:21:13.845 INFO:teuthology.orchestra.run.smithi005.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.2 MB/s | 103 kB 00:00 2023-03-03T06:21:13.887 INFO:teuthology.orchestra.run.smithi005.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 7.5 MB/s | 709 kB 00:00 2023-03-03T06:21:13.912 INFO:teuthology.orchestra.run.smithi005.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2023-03-03T06:21:13.987 INFO:teuthology.orchestra.run.smithi005.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 2.6 MB/s | 202 kB 00:00 2023-03-03T06:21:14.038 INFO:teuthology.orchestra.run.smithi005.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-03-03T06:21:14.130 INFO:teuthology.orchestra.run.smithi005.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 16 MB/s | 4.9 MB 00:00 2023-03-03T06:21:14.213 INFO:teuthology.orchestra.run.smithi005.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-03-03T06:21:14.255 INFO:teuthology.orchestra.run.smithi005.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-03-03T06:21:14.280 INFO:teuthology.orchestra.run.smithi005.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2023-03-03T06:21:14.322 INFO:teuthology.orchestra.run.smithi005.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 14 MB/s | 1.5 MB 00:00 2023-03-03T06:21:14.347 INFO:teuthology.orchestra.run.smithi005.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-03-03T06:21:14.365 INFO:teuthology.orchestra.run.smithi005.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-03-03T06:21:14.390 INFO:teuthology.orchestra.run.smithi005.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-03-03T06:21:14.407 INFO:teuthology.orchestra.run.smithi005.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.1 MB/s | 48 kB 00:00 2023-03-03T06:21:14.432 INFO:teuthology.orchestra.run.smithi005.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-03-03T06:21:14.466 INFO:teuthology.orchestra.run.smithi005.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 728 kB/s | 43 kB 00:00 2023-03-03T06:21:14.491 INFO:teuthology.orchestra.run.smithi005.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 1.8 MB/s | 109 kB 00:00 2023-03-03T06:21:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:(110/131): postgresql-server-10.21-2.module+el8 9.3 MB/s | 5.1 MB 00:00 2023-03-03T06:21:14.608 INFO:teuthology.orchestra.run.smithi005.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2023-03-03T06:21:14.634 INFO:teuthology.orchestra.run.smithi005.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 371 kB/s | 19 kB 00:00 2023-03-03T06:21:14.659 INFO:teuthology.orchestra.run.smithi005.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-03-03T06:21:14.671 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2023-03-03T06:21:14.675 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2023-03-03T06:21:14.693 INFO:teuthology.orchestra.run.smithi005.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.7 MB/s | 560 kB 00:00 2023-03-03T06:21:14.718 INFO:teuthology.orchestra.run.smithi005.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-03-03T06:21:14.743 INFO:teuthology.orchestra.run.smithi005.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 5.0 MB/s | 559 kB 00:00 2023-03-03T06:21:14.769 INFO:teuthology.orchestra.run.smithi005.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2023-03-03T06:21:14.802 INFO:teuthology.orchestra.run.smithi005.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-03-03T06:21:14.827 INFO:teuthology.orchestra.run.smithi005.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-03-03T06:21:14.853 INFO:teuthology.orchestra.run.smithi005.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-03-03T06:21:14.878 INFO:teuthology.orchestra.run.smithi005.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-03-03T06:21:14.903 INFO:teuthology.orchestra.run.smithi005.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-03-03T06:21:14.929 INFO:teuthology.orchestra.run.smithi005.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-03-03T06:21:14.954 INFO:teuthology.orchestra.run.smithi005.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 769 kB/s | 39 kB 00:00 2023-03-03T06:21:14.996 INFO:teuthology.orchestra.run.smithi005.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-03-03T06:21:15.021 INFO:teuthology.orchestra.run.smithi005.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-03-03T06:21:15.046 INFO:teuthology.orchestra.run.smithi005.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-03-03T06:21:15.135 INFO:teuthology.orchestra.run.smithi005.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 5.9 MB/s | 2.3 MB 00:00 2023-03-03T06:21:15.197 INFO:teuthology.orchestra.run.smithi005.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-03-03T06:21:15.439 INFO:teuthology.orchestra.run.smithi005.stdout:(130/131): librbd1-18.0.0-2739.g472aaef4.el8.x8 9.1 MB/s | 3.6 MB 00:00 2023-03-03T06:21:15.506 INFO:teuthology.orchestra.run.smithi005.stdout:(131/131): librados2-18.0.0-2739.g472aaef4.el8. 7.6 MB/s | 3.7 MB 00:00 2023-03-03T06:21:15.508 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2023-03-03T06:21:15.509 INFO:teuthology.orchestra.run.smithi005.stdout:Total 17 MB/s | 203 MB 00:12 2023-03-03T06:21:16.373 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2023-03-03T06:21:16.505 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2023-03-03T06:21:16.505 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2023-03-03T06:21:17.736 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2023-03-03T06:21:17.740 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2023-03-03T06:21:19.695 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2023-03-03T06:21:19.886 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-03-03T06:21:20.051 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-03-03T06:21:20.277 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-03-03T06:21:20.463 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-03T06:21:20.616 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-03T06:21:20.838 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-03T06:21:21.237 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-03T06:21:21.488 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-03T06:21:21.872 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-03T06:21:22.304 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-03T06:21:22.433 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-03T06:21:22.629 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-03T06:21:22.714 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-03T06:21:22.912 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 9/134 2023-03-03T06:21:22.962 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2023-03-03T06:21:23.146 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-03-03T06:21:23.166 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-03-03T06:21:23.334 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-03-03T06:21:23.374 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-03-03T06:21:23.524 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-03-03T06:21:23.672 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-03T06:21:23.790 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-03-03T06:21:23.845 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-03-03T06:21:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-03T06:21:24.041 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-03-03T06:21:24.212 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 14/134 2023-03-03T06:21:24.362 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 14/134 2023-03-03T06:21:24.442 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-03-03T06:21:24.529 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 15/134 2023-03-03T06:21:24.597 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 15/134 2023-03-03T06:21:24.631 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-03T06:21:24.762 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-03T06:21:24.902 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-03T06:21:25.037 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-03T06:21:25.045 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-03T06:21:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-03T06:21:25.385 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-03T06:21:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-03T06:21:25.672 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-03T06:21:25.683 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-03T06:21:25.854 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 9/134 2023-03-03T06:21:25.880 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-03T06:21:26.137 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-03-03T06:21:26.317 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-03-03T06:21:26.484 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-03T06:21:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-03-03T06:21:26.720 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-03-03T06:21:26.960 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-03-03T06:21:27.139 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 14/134 2023-03-03T06:21:27.270 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 14/134 2023-03-03T06:21:27.398 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-03-03T06:21:27.438 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 15/134 2023-03-03T06:21:27.500 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 15/134 2023-03-03T06:21:27.613 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-03T06:21:27.700 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-03-03T06:21:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-03-03T06:21:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-03T06:21:27.921 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-03-03T06:21:28.140 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-03-03T06:21:28.331 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-03-03T06:21:28.533 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-03-03T06:21:28.563 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-03-03T06:21:28.721 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-03T06:21:28.765 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-03-03T06:21:28.934 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:18.0.0-2739.g472aaef4.el8. 26/134 2023-03-03T06:21:29.080 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el 27/134 2023-03-03T06:21:29.360 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-03-03T06:21:29.571 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-03-03T06:21:30.025 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_6 28/134 2023-03-03T06:21:30.330 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-03-03T06:21:30.341 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-03-03T06:21:30.587 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-03-03T06:21:30.588 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-03-03T06:21:30.848 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-03-03T06:21:30.857 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-03-03T06:21:31.034 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-03-03T06:21:31.053 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-03T06:21:31.212 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-03-03T06:21:31.434 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-03-03T06:21:31.651 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-03-03T06:21:31.861 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:18.0.0-2739.g472aaef4.el8. 26/134 2023-03-03T06:21:32.000 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el 27/134 2023-03-03T06:21:32.824 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-03T06:21:32.961 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_6 28/134 2023-03-03T06:21:33.146 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-03-03T06:21:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-03-03T06:21:33.347 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-03-03T06:21:33.527 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-03-03T06:21:33.537 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-03-03T06:21:33.739 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 36/134 2023-03-03T06:21:33.782 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-03-03T06:21:33.907 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_6 37/134 2023-03-03T06:21:34.021 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-03T06:21:34.097 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-03-03T06:21:34.271 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-03-03T06:21:34.463 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-03-03T06:21:34.606 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-03-03T06:21:34.828 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-03-03T06:21:35.025 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-03-03T06:21:35.409 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-03-03T06:21:35.747 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-03-03T06:21:35.891 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-03-03T06:21:35.945 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-03-03T06:21:36.188 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-03-03T06:21:36.208 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-03-03T06:21:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-03-03T06:21:36.439 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-03-03T06:21:36.608 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-03-03T06:21:36.767 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-03-03T06:21:36.769 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 36/134 2023-03-03T06:21:36.900 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_6 37/134 2023-03-03T06:21:37.034 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-03-03T06:21:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-03-03T06:21:37.223 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-03-03T06:21:37.244 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-03-03T06:21:37.381 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-03-03T06:21:37.433 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-03-03T06:21:37.509 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-03-03T06:21:37.627 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-03-03T06:21:37.731 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-03-03T06:21:37.797 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-03-03T06:21:37.923 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-03-03T06:21:38.158 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-03-03T06:21:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-03-03T06:21:38.437 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-03-03T06:21:38.541 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-03-03T06:21:38.682 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-03-03T06:21:38.892 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-03-03T06:21:38.925 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-03-03T06:21:39.100 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-03-03T06:21:39.253 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-03-03T06:21:39.303 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-03-03T06:21:39.468 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-03-03T06:21:39.536 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-03-03T06:21:39.556 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-03-03T06:21:39.782 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-03-03T06:21:39.849 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-03-03T06:21:39.987 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-03-03T06:21:40.104 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-03-03T06:21:40.168 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-03T06:21:40.231 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-03T06:21:40.289 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-03-03T06:21:40.448 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-03-03T06:21:40.505 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-03-03T06:21:40.618 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-03-03T06:21:40.703 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-03-03T06:21:40.767 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-03-03T06:21:40.867 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-03-03T06:21:40.990 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-03-03T06:21:41.164 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-03-03T06:21:41.262 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-03-03T06:21:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-03-03T06:21:41.492 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-03-03T06:21:41.645 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-03-03T06:21:41.689 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-03-03T06:21:41.846 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-03-03T06:21:41.894 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-03-03T06:21:42.037 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-03-03T06:21:42.061 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-03-03T06:21:42.214 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-03-03T06:21:42.239 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-03-03T06:21:42.411 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-03-03T06:21:42.421 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-03-03T06:21:42.484 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-03-03T06:21:42.604 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-03-03T06:21:42.714 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-03-03T06:21:42.749 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-03-03T06:21:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-03-03T06:21:42.998 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-03-03T06:21:43.086 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-03T06:21:43.171 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-03-03T06:21:43.238 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-03-03T06:21:43.404 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-03-03T06:21:43.456 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-03-03T06:21:43.580 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-03-03T06:21:43.706 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-03-03T06:21:43.746 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-03-03T06:21:43.935 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-03-03T06:21:43.941 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-03-03T06:21:44.141 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-03-03T06:21:44.219 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-03-03T06:21:44.352 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-03-03T06:21:44.436 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-03-03T06:21:44.608 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-03-03T06:21:44.765 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-03-03T06:21:44.965 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-03-03T06:21:45.184 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-03-03T06:21:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-03-03T06:21:45.448 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-03-03T06:21:45.498 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-03-03T06:21:45.626 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-03-03T06:21:45.696 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-03-03T06:21:45.862 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-03-03T06:21:45.942 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-03-03T06:21:46.049 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-03-03T06:21:46.242 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-03-03T06:21:46.259 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-03-03T06:21:46.531 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-03-03T06:21:46.578 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-03-03T06:21:46.796 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-03-03T06:21:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-03-03T06:21:47.062 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-03-03T06:21:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-03-03T06:21:47.592 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-03-03T06:21:47.783 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 92/134 2023-03-03T06:21:47.859 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 92/134 2023-03-03T06:21:48.025 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 93/134 2023-03-03T06:21:48.442 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-03-03T06:21:48.709 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-03-03T06:21:48.938 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-03-03T06:21:49.223 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-03-03T06:21:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-03-03T06:21:49.828 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-03-03T06:21:50.638 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-03-03T06:21:50.935 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 92/134 2023-03-03T06:21:50.997 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 92/134 2023-03-03T06:21:51.161 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 93/134 2023-03-03T06:21:51.611 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-03T06:21:51.849 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-03T06:21:52.452 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-03T06:21:52.774 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 95/134 2023-03-03T06:21:52.863 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 95/134 2023-03-03T06:21:53.032 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 96/134 2023-03-03T06:21:54.946 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-03T06:21:55.469 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-03T06:21:56.111 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 94/134 2023-03-03T06:21:56.371 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 95/134 2023-03-03T06:21:56.456 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 95/134 2023-03-03T06:21:56.617 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 96/134 2023-03-03T06:22:11.940 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 96/134 2023-03-03T06:22:11.941 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2023-03-03T06:22:11.941 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2023-03-03T06:22:11.941 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /dev 2023-03-03T06:22:11.941 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /run 2023-03-03T06:22:11.942 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2023-03-03T06:22:11.942 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2023-03-03T06:22:11.942 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2023-03-03T06:22:11.942 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2023-03-03T06:22:11.942 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /dev 2023-03-03T06:22:11.942 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:12.312 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 97/134 2023-03-03T06:22:13.884 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 97/134 2023-03-03T06:22:14.062 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 98/134 2023-03-03T06:22:14.280 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 98/134 2023-03-03T06:22:14.445 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 99/134 2023-03-03T06:22:14.894 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 99/134 2023-03-03T06:22:15.095 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 100/134 2023-03-03T06:22:15.112 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 100/134 2023-03-03T06:22:16.027 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 96/134 2023-03-03T06:22:16.027 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2023-03-03T06:22:16.027 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2023-03-03T06:22:16.027 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2023-03-03T06:22:16.028 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /run 2023-03-03T06:22:16.028 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2023-03-03T06:22:16.028 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2023-03-03T06:22:16.028 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2023-03-03T06:22:16.028 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2023-03-03T06:22:16.028 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2023-03-03T06:22:16.028 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:16.382 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 97/134 2023-03-03T06:22:16.702 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 101/134 2023-03-03T06:22:16.889 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 101/134 2023-03-03T06:22:17.042 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.e 102/134 2023-03-03T06:22:17.233 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4. 103/134 2023-03-03T06:22:17.444 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 104/134 2023-03-03T06:22:17.659 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 104/134 2023-03-03T06:22:17.928 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 105/134 2023-03-03T06:22:18.057 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 97/134 2023-03-03T06:22:18.226 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 98/134 2023-03-03T06:22:18.456 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 98/134 2023-03-03T06:22:18.615 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 99/134 2023-03-03T06:22:18.887 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 105/134 2023-03-03T06:22:19.077 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 106/134 2023-03-03T06:22:19.093 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 99/134 2023-03-03T06:22:19.166 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 106/134 2023-03-03T06:22:19.256 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 100/134 2023-03-03T06:22:19.274 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 100/134 2023-03-03T06:22:19.564 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el 107/134 2023-03-03T06:22:19.761 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 108/134 2023-03-03T06:22:19.797 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 108/134 2023-03-03T06:22:19.994 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 109/134 2023-03-03T06:22:20.005 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 109/134 2023-03-03T06:22:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 101/134 2023-03-03T06:22:21.245 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 110/134 2023-03-03T06:22:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 101/134 2023-03-03T06:22:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.e 102/134 2023-03-03T06:22:21.499 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 111/134 2023-03-03T06:22:21.533 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 111/134 2023-03-03T06:22:21.614 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4. 103/134 2023-03-03T06:22:21.686 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2739.g472aa 112/134 2023-03-03T06:22:21.727 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2739.g472aa 112/134 2023-03-03T06:22:21.780 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 104/134 2023-03-03T06:22:21.911 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 113/134 2023-03-03T06:22:22.004 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 104/134 2023-03-03T06:22:22.256 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 113/134 2023-03-03T06:22:22.300 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 105/134 2023-03-03T06:22:22.435 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 114/134 2023-03-03T06:22:23.324 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 105/134 2023-03-03T06:22:23.480 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 106/134 2023-03-03T06:22:23.576 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 106/134 2023-03-03T06:22:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el 107/134 2023-03-03T06:22:24.175 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 108/134 2023-03-03T06:22:24.212 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 108/134 2023-03-03T06:22:24.414 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 109/134 2023-03-03T06:22:24.425 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 109/134 2023-03-03T06:22:25.747 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 110/134 2023-03-03T06:22:25.983 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 111/134 2023-03-03T06:22:26.018 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 111/134 2023-03-03T06:22:26.163 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2739.g472aa 112/134 2023-03-03T06:22:26.207 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2739.g472aa 112/134 2023-03-03T06:22:26.347 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 113/134 2023-03-03T06:22:26.724 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 113/134 2023-03-03T06:22:26.861 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 114/134 2023-03-03T06:22:26.863 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 114/134 2023-03-03T06:22:27.166 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 115/134 2023-03-03T06:22:27.300 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-03-03T06:22:27.492 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-03-03T06:22:28.393 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-03-03T06:22:28.740 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-03-03T06:22:28.913 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 119/134 2023-03-03T06:22:29.130 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-03T06:22:29.288 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_ 121/134 2023-03-03T06:22:29.435 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-03T06:22:31.579 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 114/134 2023-03-03T06:22:31.638 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-03T06:22:31.900 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 115/134 2023-03-03T06:22:31.925 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-03T06:22:31.943 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-03T06:22:32.046 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-03-03T06:22:32.205 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 124/134 2023-03-03T06:22:32.254 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-03-03T06:22:32.433 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 125/134 2023-03-03T06:22:32.731 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 126/134 2023-03-03T06:22:33.051 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-03-03T06:22:33.186 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-03-03T06:22:33.199 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-03T06:22:33.208 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-03T06:22:33.382 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-03-03T06:22:33.481 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-03-03T06:22:33.599 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-03-03T06:22:33.646 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 119/134 2023-03-03T06:22:33.683 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-03-03T06:22:33.842 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-03T06:22:33.875 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-03-03T06:22:33.887 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-03-03T06:22:33.887 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-03T06:22:34.059 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_ 121/134 2023-03-03T06:22:34.111 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-03T06:22:34.111 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-03T06:22:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-03T06:22:34.373 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-03T06:22:34.565 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-03T06:22:34.840 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-03-03T06:22:34.840 INFO:teuthology.orchestra.run.smithi191.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-03T06:22:34.840 INFO:teuthology.orchestra.run.smithi191.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-03T06:22:34.840 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:35.060 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 1/134 2023-03-03T06:22:35.061 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 2/134 2023-03-03T06:22:35.061 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 3/134 2023-03-03T06:22:35.061 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 4/134 2023-03-03T06:22:35.061 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2739.g472aa 5/134 2023-03-03T06:22:35.061 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-03T06:22:35.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-03T06:22:35.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-03T06:22:35.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 9/134 2023-03-03T06:22:35.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 10/134 2023-03-03T06:22:35.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 11/134 2023-03-03T06:22:35.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 12/134 2023-03-03T06:22:35.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 13/134 2023-03-03T06:22:35.062 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_ 14/134 2023-03-03T06:22:35.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 15/134 2023-03-03T06:22:35.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 16/134 2023-03-03T06:22:35.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_6 17/134 2023-03-03T06:22:35.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 18/134 2023-03-03T06:22:35.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 19/134 2023-03-03T06:22:35.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el 20/134 2023-03-03T06:22:35.063 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:18.0.0-2739.g472aaef4.el8. 21/134 2023-03-03T06:22:35.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_6 22/134 2023-03-03T06:22:35.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 23/134 2023-03-03T06:22:35.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 24/134 2023-03-03T06:22:35.064 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 25/134 2023-03-03T06:22:35.071 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 26/134 2023-03-03T06:22:35.071 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 27/134 2023-03-03T06:22:35.071 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 28/134 2023-03-03T06:22:35.071 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4. 29/134 2023-03-03T06:22:35.072 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 30/134 2023-03-03T06:22:35.072 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 31/134 2023-03-03T06:22:35.072 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 32/134 2023-03-03T06:22:35.072 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el 33/134 2023-03-03T06:22:35.072 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 34/134 2023-03-03T06:22:35.072 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.e 35/134 2023-03-03T06:22:35.072 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 36/134 2023-03-03T06:22:35.072 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 37/134 2023-03-03T06:22:35.073 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 38/134 2023-03-03T06:22:35.073 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-03-03T06:22:35.073 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-03-03T06:22:35.073 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-03-03T06:22:35.073 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-03-03T06:22:35.073 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-03-03T06:22:35.073 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-03-03T06:22:35.074 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-03-03T06:22:35.074 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-03-03T06:22:35.074 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-03-03T06:22:35.074 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-03-03T06:22:35.074 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-03-03T06:22:35.074 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-03-03T06:22:35.074 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-03-03T06:22:35.075 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-03-03T06:22:35.075 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-03-03T06:22:35.075 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-03-03T06:22:35.075 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-03-03T06:22:35.075 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-03-03T06:22:35.075 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-03-03T06:22:35.075 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-03-03T06:22:35.075 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-03-03T06:22:35.076 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-03-03T06:22:35.076 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-03-03T06:22:35.076 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-03-03T06:22:35.076 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-03-03T06:22:35.076 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-03-03T06:22:35.076 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-03-03T06:22:35.076 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-03-03T06:22:35.076 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-03-03T06:22:35.077 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-03-03T06:22:35.077 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-03-03T06:22:35.077 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-03-03T06:22:35.077 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-03-03T06:22:35.077 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-03-03T06:22:35.077 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-03-03T06:22:35.077 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-03-03T06:22:35.078 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-03-03T06:22:35.078 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-03-03T06:22:35.078 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-03-03T06:22:35.078 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-03-03T06:22:35.078 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-03-03T06:22:35.078 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-03-03T06:22:35.078 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-03-03T06:22:35.078 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-03-03T06:22:35.079 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-03-03T06:22:35.079 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-03-03T06:22:35.079 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-03-03T06:22:35.079 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-03-03T06:22:35.079 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-03-03T06:22:35.079 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-03-03T06:22:35.079 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-03-03T06:22:35.079 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-03-03T06:22:35.080 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-03-03T06:22:35.080 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-03-03T06:22:35.080 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-03-03T06:22:35.080 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-03-03T06:22:35.080 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-03-03T06:22:35.080 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-03-03T06:22:35.080 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-03-03T06:22:35.081 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-03-03T06:22:35.081 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-03-03T06:22:35.081 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-03-03T06:22:35.081 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-03-03T06:22:35.081 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-03-03T06:22:35.081 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-03-03T06:22:35.081 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-03-03T06:22:35.081 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-03-03T06:22:35.082 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-03-03T06:22:35.082 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-03-03T06:22:35.082 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-03-03T06:22:35.082 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-03-03T06:22:35.082 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-03-03T06:22:35.082 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-03-03T06:22:35.082 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-03-03T06:22:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-03-03T06:22:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-03-03T06:22:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-03-03T06:22:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-03-03T06:22:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-03-03T06:22:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-03-03T06:22:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-03-03T06:22:35.083 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-03T06:22:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-03-03T06:22:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-03T06:22:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-03-03T06:22:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-03-03T06:22:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-03-03T06:22:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-03-03T06:22:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-03-03T06:22:35.084 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-03T06:22:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 129/134 2023-03-03T06:22:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-03-03T06:22:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 131/134 2023-03-03T06:22:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-03T06:22:35.085 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-03-03T06:22:36.561 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-03T06:22:36.762 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-03T06:22:36.780 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-03-03T06:22:36.954 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 124/134 2023-03-03T06:22:37.204 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 125/134 2023-03-03T06:22:37.491 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 126/134 2023-03-03T06:22:37.789 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-03-03T06:22:37.801 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-03T06:22:37.801 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:48 ago on Fri 03 Mar 2023 06:20:49 AM UTC. 2023-03-03T06:22:37.920 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-03T06:22:37.929 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-03T06:22:38.145 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-03-03T06:22:38.311 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-03-03T06:22:38.402 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-03-03T06:22:38.578 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-03-03T06:22:38.591 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-03-03T06:22:38.592 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-03T06:22:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-03T06:22:38.815 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-03T06:22:39.035 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-03-03T06:22:39.212 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-03T06:22:39.531 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-03-03T06:22:39.532 INFO:teuthology.orchestra.run.smithi005.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-03-03T06:22:39.532 INFO:teuthology.orchestra.run.smithi005.stdout:All rules containing unresolvable specifiers will be skipped. 2023-03-03T06:22:39.532 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:39.762 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 1/134 2023-03-03T06:22:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 2/134 2023-03-03T06:22:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 3/134 2023-03-03T06:22:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 4/134 2023-03-03T06:22:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2739.g472aa 5/134 2023-03-03T06:22:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 6/134 2023-03-03T06:22:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 7/134 2023-03-03T06:22:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 8/134 2023-03-03T06:22:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 9/134 2023-03-03T06:22:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 10/134 2023-03-03T06:22:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 11/134 2023-03-03T06:22:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 12/134 2023-03-03T06:22:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 13/134 2023-03-03T06:22:39.764 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_ 14/134 2023-03-03T06:22:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 15/134 2023-03-03T06:22:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 16/134 2023-03-03T06:22:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_6 17/134 2023-03-03T06:22:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86 18/134 2023-03-03T06:22:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 19/134 2023-03-03T06:22:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el 20/134 2023-03-03T06:22:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:18.0.0-2739.g472aaef4.el8. 21/134 2023-03-03T06:22:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_6 22/134 2023-03-03T06:22:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 23/134 2023-03-03T06:22:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 24/134 2023-03-03T06:22:39.766 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 25/134 2023-03-03T06:22:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 26/134 2023-03-03T06:22:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 27/134 2023-03-03T06:22:39.773 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 28/134 2023-03-03T06:22:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4. 29/134 2023-03-03T06:22:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noa 30/134 2023-03-03T06:22:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.n 31/134 2023-03-03T06:22:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2739.g472 32/134 2023-03-03T06:22:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el 33/134 2023-03-03T06:22:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 34/134 2023-03-03T06:22:39.774 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.e 35/134 2023-03-03T06:22:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 36/134 2023-03-03T06:22:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 37/134 2023-03-03T06:22:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 38/134 2023-03-03T06:22:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-03-03T06:22:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-03-03T06:22:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-03-03T06:22:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-03-03T06:22:39.775 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-03-03T06:22:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-03-03T06:22:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-03-03T06:22:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-03-03T06:22:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-03-03T06:22:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-03-03T06:22:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-03-03T06:22:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-03-03T06:22:39.776 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-03-03T06:22:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-03-03T06:22:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-03-03T06:22:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-03-03T06:22:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-03-03T06:22:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-03-03T06:22:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-03-03T06:22:39.777 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-03-03T06:22:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-03-03T06:22:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-03-03T06:22:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-03-03T06:22:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-03-03T06:22:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-03-03T06:22:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-03-03T06:22:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-03-03T06:22:39.778 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-03-03T06:22:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-03-03T06:22:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-03-03T06:22:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-03-03T06:22:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-03-03T06:22:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-03-03T06:22:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-03-03T06:22:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-03-03T06:22:39.779 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-03-03T06:22:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-03-03T06:22:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-03-03T06:22:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-03-03T06:22:39.780 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-03-03T06:22:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-03-03T06:22:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-03-03T06:22:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-03-03T06:22:39.781 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-03-03T06:22:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-03-03T06:22:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-03-03T06:22:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-03-03T06:22:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-03-03T06:22:39.782 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-03-03T06:22:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-03-03T06:22:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-03-03T06:22:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-03-03T06:22:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-03-03T06:22:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-03-03T06:22:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-03-03T06:22:39.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-03-03T06:22:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-03-03T06:22:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-03-03T06:22:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-03-03T06:22:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-03-03T06:22:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-03-03T06:22:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-03-03T06:22:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-03-03T06:22:39.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-03-03T06:22:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-03-03T06:22:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-03-03T06:22:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-03-03T06:22:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-03-03T06:22:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-03-03T06:22:39.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-03-03T06:22:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-03-03T06:22:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-03-03T06:22:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-03-03T06:22:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-03-03T06:22:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-03-03T06:22:39.786 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-03-03T06:22:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-03-03T06:22:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-03-03T06:22:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-03-03T06:22:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-03-03T06:22:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-03-03T06:22:39.787 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-03-03T06:22:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-03-03T06:22:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-03-03T06:22:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-03-03T06:22:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-03-03T06:22:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-03-03T06:22:39.788 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-03-03T06:22:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-03-03T06:22:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-03-03T06:22:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 129/134 2023-03-03T06:22:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-03-03T06:22:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 131/134 2023-03-03T06:22:39.790 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-03-03T06:22:39.790 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-03-03T06:22:40.449 INFO:teuthology.orchestra.run.smithi191.stdout:Installed products updated. 2023-03-03T06:22:40.688 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:40.688 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2023-03-03T06:22:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-03-03T06:22:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.689 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2023-03-03T06:22:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-03-03T06:22:40.689 INFO:teuthology.orchestra.run.smithi191.stdout: automake-1.16.1-7.el8.noarch 2023-03-03T06:22:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: bison-3.0.4-10.el8.x86_64 2023-03-03T06:22:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:40.690 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:40.691 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.692 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.692 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:40.692 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.692 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.692 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.692 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:40.692 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-03-03T06:22:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: flex-2.6.1-9.el8.x86_64 2023-03-03T06:22:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: fuse-2.9.7-15.el8.x86_64 2023-03-03T06:22:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-03T06:22:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: jq-1.6-3.el8.x86_64 2023-03-03T06:22:40.693 INFO:teuthology.orchestra.run.smithi191.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-03T06:22:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-03-03T06:22:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-03T06:22:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-03-03T06:22:40.694 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-03-03T06:22:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-03T06:22:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: libpq-13.5-1.el8.x86_64 2023-03-03T06:22:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-03-03T06:22:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-03T06:22:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-03T06:22:40.695 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-03-03T06:22:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-03T06:22:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-03T06:22:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-03T06:22:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-03-03T06:22:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-03-03T06:22:40.696 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-03T06:22:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-03T06:22:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.15-3.el8.x86_64 2023-03-03T06:22:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-03-03T06:22:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-03-03T06:22:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-03-03T06:22:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-03-03T06:22:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-03-03T06:22:40.697 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-03T06:22:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-03T06:22:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-03T06:22:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-03T06:22:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-03T06:22:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-03T06:22:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-03T06:22:40.698 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-03T06:22:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-03T06:22:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-03T06:22:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-03T06:22:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-03T06:22:40.699 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-03T06:22:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-03T06:22:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-03T06:22:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-03T06:22:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-03T06:22:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-03T06:22:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-03T06:22:40.700 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-03T06:22:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-03T06:22:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-03T06:22:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.0.6-13.el8.noarch 2023-03-03T06:22:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-03T06:22:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-03T06:22:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-03T06:22:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-03T06:22:40.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-03T06:22:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-03T06:22:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-03T06:22:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-2.6-1.el8.noarch 2023-03-03T06:22:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-03T06:22:40.702 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-03T06:22:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-03T06:22:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-03T06:22:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-03T06:22:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-03T06:22:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.703 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-03T06:22:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-03T06:22:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-03T06:22:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-03T06:22:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-03-03T06:22:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-03T06:22:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-03T06:22:40.704 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-03T06:22:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-03T06:22:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-03T06:22:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-03T06:22:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-03T06:22:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-03T06:22:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-03T06:22:40.705 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-03T06:22:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-03T06:22:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-03T06:22:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-03T06:22:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-03T06:22:40.706 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-03T06:22:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-03-03T06:22:40.707 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:40.707 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2023-03-03T06:22:40.916 DEBUG:teuthology.parallel:result is None 2023-03-03T06:22:42.409 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-03-03T06:22:42.409 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:52 ago on Fri 03 Mar 2023 06:20:50 AM UTC. 2023-03-03T06:22:45.087 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. 2023-03-03T06:22:45.337 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:45.337 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2023-03-03T06:22:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-03-03T06:22:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.338 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.338 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2023-03-03T06:22:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-03-03T06:22:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.1-7.el8.noarch 2023-03-03T06:22:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.0.4-10.el8.x86_64 2023-03-03T06:22:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.339 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:45.340 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.341 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:45.342 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.343 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:45.344 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:18.0.0-2739.g472aaef4.el8.noarch 2023-03-03T06:22:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-03-03T06:22:45.345 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.1-9.el8.x86_64 2023-03-03T06:22:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.7-15.el8.x86_64 2023-03-03T06:22:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-03-03T06:22:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: jq-1.6-3.el8.x86_64 2023-03-03T06:22:45.346 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-03-03T06:22:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-03-03T06:22:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-03-03T06:22:45.347 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-03-03T06:22:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-03-03T06:22:45.348 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.2-3.el8.x86_64 2023-03-03T06:22:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: libpq-13.5-1.el8.x86_64 2023-03-03T06:22:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-03-03T06:22:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-03-03T06:22:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.349 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-03-03T06:22:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-03-03T06:22:45.350 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-03-03T06:22:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-25.el8.x86_64 2023-03-03T06:22:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.3.1-3.el8.x86_64 2023-03-03T06:22:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-03-03T06:22:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-03-03T06:22:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-03-03T06:22:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-03-03T06:22:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.15-3.el8.x86_64 2023-03-03T06:22:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-03-03T06:22:45.352 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-03-03T06:22:45.353 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-03-03T06:22:45.353 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-03-03T06:22:45.353 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-03-03T06:22:45.353 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-03T06:22:45.353 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-03T06:22:45.354 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-03-03T06:22:45.354 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-03-03T06:22:45.354 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.5.1-7.el8.noarch 2023-03-03T06:22:45.354 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-03-03T06:22:45.354 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-03-03T06:22:45.354 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-03-03T06:22:45.355 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.355 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.355 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.355 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-03-03T06:22:45.355 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-03-03T06:22:45.356 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-03-03T06:22:45.356 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-03-03T06:22:45.357 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-03-03T06:22:45.357 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-03-03T06:22:45.357 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-6.2-6.el8.noarch 2023-03-03T06:22:45.357 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-03-03T06:22:45.357 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-03-03T06:22:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-03-03T06:22:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-03-03T06:22:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-03-03T06:22:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-03-03T06:22:45.359 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-03-03T06:22:45.359 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.0.6-13.el8.noarch 2023-03-03T06:22:45.359 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-03-03T06:22:45.359 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-03-03T06:22:45.359 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-03-03T06:22:45.360 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-03-03T06:22:45.360 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-03-03T06:22:45.360 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-03-03T06:22:45.360 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-03-03T06:22:45.360 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-2.6-1.el8.noarch 2023-03-03T06:22:45.360 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-03-03T06:22:45.361 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-03-03T06:22:45.361 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-03-03T06:22:45.361 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-03-03T06:22:45.361 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.14-14.el8.noarch 2023-03-03T06:22:45.362 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2017.2-9.el8.noarch 2023-03-03T06:22:45.362 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.362 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.362 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-03-03T06:22:45.362 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-03-03T06:22:45.363 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.363 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.4.1-12.el8.noarch 2023-03-03T06:22:45.363 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.8-1.el8.noarch 2023-03-03T06:22:45.363 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-03-03T06:22:45.363 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-03-03T06:22:45.364 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-03-03T06:22:45.364 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-03-03T06:22:45.364 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-03-03T06:22:45.364 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-03-03T06:22:45.364 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-03-03T06:22:45.365 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-03-03T06:22:45.365 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-03-03T06:22:45.365 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-03-03T06:22:45.365 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-03-03T06:22:45.366 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.366 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.366 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:18.0.0-2739.g472aaef4.el8.x86_64 2023-03-03T06:22:45.367 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-1.el8.x86_64 2023-03-03T06:22:45.367 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.13.0-2.el8.x86_64 2023-03-03T06:22:45.367 INFO:teuthology.orchestra.run.smithi005.stdout: uuid-1.6.2-43.el8.x86_64 2023-03-03T06:22:45.367 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-03-03T06:22:45.367 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-03-03T06:22:45.368 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-03-03T06:22:45.368 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:45.369 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2023-03-03T06:22:45.534 DEBUG:teuthology.parallel:result is None 2023-03-03T06:22:45.535 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-03T06:22:45.681 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-03T06:22:45.705 INFO:teuthology.orchestra.run.smithi005.stdout:18.0.0-2739.g472aaef4.el8 2023-03-03T06:22:45.706 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2739.g472aaef4.el8 2023-03-03T06:22:45.706 INFO:teuthology.task.install:The correct ceph version 18.0.0-2739.g472aaef4 is installed. 2023-03-03T06:22:45.707 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=472aaef4ec3b3a2c29f73ca67854785a910f1f9b 2023-03-03T06:22:45.844 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-03-03T06:22:45.872 INFO:teuthology.orchestra.run.smithi191.stdout:18.0.0-2739.g472aaef4.el8 2023-03-03T06:22:45.873 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2739.g472aaef4.el8 2023-03-03T06:22:45.873 INFO:teuthology.task.install:The correct ceph version 18.0.0-2739.g472aaef4 is installed. 2023-03-03T06:22:45.873 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-03-03T06:22:45.874 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:22:45.874 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-03T06:22:45.918 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:22:45.918 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-03-03T06:22:45.962 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-03-03T06:22:45.963 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:22:45.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2023-03-03T06:22:45.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-03T06:22:46.057 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:22:46.058 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2023-03-03T06:22:46.088 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-03-03T06:22:46.158 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-03-03T06:22:46.159 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:22:46.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-03T06:22:46.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-03T06:22:46.253 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:22:46.253 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2023-03-03T06:22:46.283 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-03-03T06:22:46.352 INFO:teuthology.run_tasks:Running task ceph... 2023-03-03T06:22:46.437 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-03-03T06:22:46.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2023-03-03T06:22:46.440 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /var/log/ceph 2023-03-03T06:22:46.467 INFO:tasks.ceph:Disabling ceph logrotate... 2023-03-03T06:22:46.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-03T06:22:46.508 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/logrotate.d/ceph 2023-03-03T06:22:46.535 INFO:tasks.ceph:Creating extra log directories... 2023-03-03T06:22:46.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-03T06:22:46.602 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-03-03T06:22:46.636 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-03-03T06:22:46.636 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-03-03T06:22:46.636 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-03-03T06:22:46.637 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:22:46.637 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-03T06:22:46.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-03T06:22:46.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-03-03T06:22:46.853 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:22:46.853 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-03-03T06:22:46.871 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-03-03T06:22:47.003 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-03-03T06:22:47.035 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-03-03T06:22:47.036 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-03-03T06:22:47.036 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi/7192149', 'branch': 'wip-vshankar-testing-20230303.023823', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7192149', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-03-03_04:39:14-fs-wip-vshankar-testing-20230303.023823-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230303.023823'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'dry_run': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230303.023823', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230303.023823', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_472aaef4ec3b3a2c29f73ca67854785a910f1f9b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi005.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi191.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '75534f74ac3dd06f86697ff862e8be2945b3c8e6'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '472aaef4ec3b3a2c29f73ca67854785a910f1f9b'}}, {'ceph': None}, {'kclient': None}, {'exec': {'mon.a': ['ceph config set mgr mgr/crash/warn_recent_interval 0']}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_snapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6', 'timestamp': '2023-03-03_04:39:14', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.31660'} 2023-03-03T06:22:47.037 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-03T06:22:47.039 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-03-03T06:22:47.086 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2023-03-03T06:22:47.095 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/run/ceph 2023-03-03T06:22:47.152 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:22:47.153 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2023-03-03T06:22:47.178 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-03T06:22:47.178 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2023-03-03T06:22:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-03T06:22:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-03T06:22:47.235 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 343843 Links: 1 2023-03-03T06:22:47.235 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T06:22:47.236 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-03-03T06:22:47.236 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-03-03 06:22:39.443605757 +0000 2023-03-03T06:22:47.236 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-03-03 06:20:01.731704258 +0000 2023-03-03T06:22:47.236 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-03-03 06:20:01.731704258 +0000 2023-03-03T06:22:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-03-03T06:22:47.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-03T06:22:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-03-03T06:22:47.300 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-03-03T06:22:47.301 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000118153 s, 4.3 MB/s 2023-03-03T06:22:47.301 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-03T06:22:47.359 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2023-03-03T06:22:47.416 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-03T06:22:47.417 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-03T06:22:47.417 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 343938 Links: 1 2023-03-03T06:22:47.417 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T06:22:47.417 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-03-03T06:22:47.417 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-03-03 06:22:39.444605737 +0000 2023-03-03T06:22:47.418 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-03-03 06:20:02.278693077 +0000 2023-03-03T06:22:47.418 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-03-03 06:20:02.278693077 +0000 2023-03-03T06:22:47.418 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-03-03T06:22:47.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-03T06:22:47.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-03-03T06:22:47.482 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-03-03T06:22:47.482 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.00011238 s, 4.6 MB/s 2023-03-03T06:22:47.483 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-03T06:22:47.541 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2023-03-03T06:22:47.598 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-03T06:22:47.599 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-03T06:22:47.599 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 363581 Links: 1 2023-03-03T06:22:47.599 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T06:22:47.599 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-03-03T06:22:47.599 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-03-03 06:22:39.444605737 +0000 2023-03-03T06:22:47.600 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-03-03 06:20:02.866681058 +0000 2023-03-03T06:22:47.600 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-03-03 06:20:02.866681058 +0000 2023-03-03T06:22:47.600 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-03-03T06:22:47.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-03T06:22:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-03-03T06:22:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-03-03T06:22:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000107297 s, 4.8 MB/s 2023-03-03T06:22:47.666 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-03T06:22:47.724 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2023-03-03T06:22:47.782 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-03T06:22:47.782 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-03T06:22:47.782 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 362053 Links: 1 2023-03-03T06:22:47.782 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T06:22:47.783 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2023-03-03T06:22:47.783 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2023-03-03 06:22:39.444605737 +0000 2023-03-03T06:22:47.783 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2023-03-03 06:20:03.397670278 +0000 2023-03-03T06:22:47.783 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2023-03-03 06:20:03.397670278 +0000 2023-03-03T06:22:47.783 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2023-03-03T06:22:47.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-03T06:22:47.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2023-03-03T06:22:47.847 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2023-03-03T06:22:47.847 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000108933 s, 4.7 MB/s 2023-03-03T06:22:47.848 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-03T06:22:47.907 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-03T06:22:47.907 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:22:47.908 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2023-03-03T06:22:47.928 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-03-03T06:22:47.928 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2023-03-03T06:22:47.988 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-03-03T06:22:47.988 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-03T06:22:47.988 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 363526 Links: 1 2023-03-03T06:22:47.988 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T06:22:47.988 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-03-03T06:22:47.988 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-03-03 06:22:34.760985222 +0000 2023-03-03T06:22:47.989 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-03-03 06:19:51.739762744 +0000 2023-03-03T06:22:47.989 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-03-03 06:19:51.739762744 +0000 2023-03-03T06:22:47.989 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-03-03T06:22:47.989 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-03-03T06:22:48.056 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-03-03T06:22:48.057 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-03-03T06:22:48.057 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000282371 s, 1.8 MB/s 2023-03-03T06:22:48.058 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-03-03T06:22:48.120 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2023-03-03T06:22:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-03-03T06:22:48.179 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-03T06:22:48.179 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 363637 Links: 1 2023-03-03T06:22:48.179 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T06:22:48.180 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-03-03T06:22:48.180 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-03-03 06:22:34.760985222 +0000 2023-03-03T06:22:48.180 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-03-03 06:19:52.276753619 +0000 2023-03-03T06:22:48.180 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-03-03 06:19:52.276753619 +0000 2023-03-03T06:22:48.180 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-03-03T06:22:48.180 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-03-03T06:22:48.247 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-03-03T06:22:48.247 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-03-03T06:22:48.247 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000233408 s, 2.2 MB/s 2023-03-03T06:22:48.248 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-03-03T06:22:48.308 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2023-03-03T06:22:48.367 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-03-03T06:22:48.367 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-03T06:22:48.367 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 364548 Links: 1 2023-03-03T06:22:48.367 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T06:22:48.368 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-03-03T06:22:48.368 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-03-03 06:22:34.760985222 +0000 2023-03-03T06:22:48.368 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-03-03 06:19:52.786744953 +0000 2023-03-03T06:22:48.368 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-03-03 06:19:52.786744953 +0000 2023-03-03T06:22:48.368 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-03-03T06:22:48.368 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-03-03T06:22:48.434 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-03-03T06:22:48.434 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-03-03T06:22:48.435 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000234203 s, 2.2 MB/s 2023-03-03T06:22:48.436 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-03-03T06:22:48.493 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2023-03-03T06:22:48.552 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-03-03T06:22:48.553 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-03-03T06:22:48.553 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 365581 Links: 1 2023-03-03T06:22:48.553 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-03-03T06:22:48.553 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2023-03-03T06:22:48.554 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-03-03 06:22:34.760985222 +0000 2023-03-03T06:22:48.554 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-03-03 06:19:53.303736168 +0000 2023-03-03T06:22:48.554 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-03-03 06:19:53.303736168 +0000 2023-03-03T06:22:48.555 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-03-03T06:22:48.555 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-03-03T06:22:48.619 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-03-03T06:22:48.619 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-03-03T06:22:48.619 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000214524 s, 2.4 MB/s 2023-03-03T06:22:48.620 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-03-03T06:22:48.679 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-03T06:22:48.679 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-03-03T06:22:48.680 INFO:tasks.ceph:Generating config... 2023-03-03T06:22:48.682 INFO:tasks.ceph:[client] client mount timeout = 600 2023-03-03T06:22:48.682 INFO:tasks.ceph:[client] debug client = 20 2023-03-03T06:22:48.683 INFO:tasks.ceph:[client] debug ms = 1 2023-03-03T06:22:48.683 INFO:tasks.ceph:[client] pid file = 2023-03-03T06:22:48.683 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-03-03T06:22:48.683 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-03-03T06:22:48.684 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-03-03T06:22:48.684 INFO:tasks.ceph:[mds] debug mds = 20 2023-03-03T06:22:48.684 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-03-03T06:22:48.685 INFO:tasks.ceph:[mds] debug ms = 1 2023-03-03T06:22:48.685 INFO:tasks.ceph:[mds] mds debug frag = True 2023-03-03T06:22:48.685 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-03-03T06:22:48.685 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-03-03T06:22:48.686 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-03-03T06:22:48.686 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-03-03T06:22:48.686 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-03-03T06:22:48.687 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-03-03T06:22:48.687 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-03-03T06:22:48.687 INFO:tasks.ceph:[mgr] debug ms = 1 2023-03-03T06:22:48.687 INFO:tasks.ceph:[mon] debug mon = 20 2023-03-03T06:22:48.688 INFO:tasks.ceph:[mon] debug ms = 1 2023-03-03T06:22:48.688 INFO:tasks.ceph:[mon] debug paxos = 20 2023-03-03T06:22:48.688 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-03-03T06:22:48.688 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-03-03T06:22:48.689 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-03-03T06:22:48.689 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-03-03T06:22:48.689 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-03-03T06:22:48.690 INFO:tasks.ceph:[osd] debug ms = 1 2023-03-03T06:22:48.690 INFO:tasks.ceph:[osd] debug osd = 20 2023-03-03T06:22:48.690 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-03-03T06:22:48.691 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-03-03T06:22:48.691 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-03-03T06:22:48.691 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-03-03T06:22:48.691 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-03-03T06:22:48.692 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-03-03T06:22:48.692 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-03-03T06:22:48.692 INFO:tasks.ceph:Setting up mon.a... 2023-03-03T06:22:48.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-03-03T06:22:48.751 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2023-03-03T06:22:48.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-03-03T06:22:48.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-03T06:22:48.834 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.b', '172.21.15.191'), ('mon.c', '[v2:172.21.15.191:3301,v1:172.21.15.191:6790]')] 2023-03-03T06:22:48.835 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-03-03T06:22:48.835 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:22:48.836 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-03-03T06:22:48.891 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --add b 172.21.15.191 --addv c '[v2:172.21.15.191:3301,v1:172.21.15.191:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:22:48.980 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:22:48.981 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6 2023-03-03T06:22:48.981 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = pacific 2023-03-03T06:22:48.981 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2023-03-03T06:22:48.981 INFO:teuthology.orchestra.run.smithi005.stdout:fsid b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6 2023-03-03T06:22:48.981 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2023-03-03T06:22:48.979530+0000 2023-03-03T06:22:48.982 INFO:teuthology.orchestra.run.smithi005.stdout:created 2023-03-03T06:22:48.979530+0000 2023-03-03T06:22:48.982 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 16 (pacific) 2023-03-03T06:22:48.982 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2023-03-03T06:22:48.982 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2023-03-03T06:22:48.982 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2023-03-03T06:22:48.982 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] mon.c 2023-03-03T06:22:48.982 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-03-03T06:22:48.984 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-03-03T06:22:49.000 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6... 2023-03-03T06:22:49.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-03T06:22:49.042 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-03-03T06:22:49.086 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2023-03-03T06:22:49.087 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2023-03-03T06:22:49.087 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-03T06:22:49.087 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2023-03-03T06:22:49.087 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.087 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2023-03-03T06:22:49.088 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.088 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2023-03-03T06:22:49.088 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.088 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2023-03-03T06:22:49.088 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2023-03-03T06:22:49.088 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.088 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2023-03-03T06:22:49.089 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2023-03-03T06:22:49.089 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.089 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-03T06:22:49.089 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2023-03-03T06:22:49.089 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.089 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2023-03-03T06:22:49.089 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-03T06:22:49.089 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.090 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2023-03-03T06:22:49.090 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.090 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2023-03-03T06:22:49.090 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2023-03-03T06:22:49.090 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2023-03-03T06:22:49.090 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2023-03-03T06:22:49.090 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2023-03-03T06:22:49.090 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2023-03-03T06:22:49.091 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2023-03-03T06:22:49.091 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-03T06:22:49.091 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-03T06:22:49.091 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2023-03-03T06:22:49.091 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.091 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-03T06:22:49.091 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.092 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2023-03-03T06:22:49.092 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.092 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2023-03-03T06:22:49.092 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.092 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2023-03-03T06:22:49.092 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2023-03-03T06:22:49.092 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2023-03-03T06:22:49.092 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-03-03T06:22:49.093 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on skipped message = False 2023-03-03T06:22:49.093 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6 2023-03-03T06:22:49.093 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.093 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2023-03-03T06:22:49.093 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2023-03-03T06:22:49.093 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.093 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2023-03-03T06:22:49.093 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2023-03-03T06:22:49.094 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.094 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2023-03-03T06:22:49.094 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2023-03-03T06:22:49.094 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.094 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2023-03-03T06:22:49.094 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2023-03-03T06:22:49.094 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2023-03-03T06:22:49.094 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.095 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2023-03-03T06:22:49.095 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2023-03-03T06:22:49.095 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.095 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2023-03-03T06:22:49.095 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.095 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2023-03-03T06:22:49.095 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.095 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2023-03-03T06:22:49.096 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.096 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2023-03-03T06:22:49.096 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2023-03-03T06:22:49.096 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.096 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2023-03-03T06:22:49.096 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2023-03-03T06:22:49.096 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2023-03-03T06:22:49.096 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2023-03-03T06:22:49.097 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2023-03-03T06:22:49.097 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2023-03-03T06:22:49.097 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-03-03T06:22:49.097 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2023-03-03T06:22:49.097 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2023-03-03T06:22:49.097 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2023-03-03T06:22:49.097 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2023-03-03T06:22:49.098 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2023-03-03T06:22:49.098 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2023-03-03T06:22:49.098 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2023-03-03T06:22:49.098 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2023-03-03T06:22:49.098 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.099 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2023-03-03T06:22:49.099 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-03-03T06:22:49.099 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2023-03-03T06:22:49.099 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2023-03-03T06:22:49.099 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2023-03-03T06:22:49.099 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2023-03-03T06:22:49.099 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2023-03-03T06:22:49.099 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2023-03-03T06:22:49.100 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.100 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2023-03-03T06:22:49.100 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-03-03T06:22:49.100 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2023-03-03T06:22:49.100 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2023-03-03T06:22:49.100 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2023-03-03T06:22:49.101 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2023-03-03T06:22:49.101 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2023-03-03T06:22:49.101 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2023-03-03T06:22:49.101 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2023-03-03T06:22:49.101 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2023-03-03T06:22:49.101 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2023-03-03T06:22:49.101 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.102 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-03T06:22:49.102 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2023-03-03T06:22:49.102 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2023-03-03T06:22:49.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.102 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2023-03-03T06:22:49.102 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-03T06:22:49.102 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-03T06:22:49.103 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.103 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2023-03-03T06:22:49.103 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2023-03-03T06:22:49.103 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.103 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2023-03-03T06:22:49.103 INFO:teuthology.orchestra.run.smithi005.stdout: mon op complaint time = 120 2023-03-03T06:22:49.103 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:22:49.103 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2023-03-03T06:22:49.104 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2023-03-03T06:22:49.104 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2023-03-03T06:22:49.104 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2023-03-03T06:22:49.104 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-03T06:22:49.104 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-03T06:22:49.104 INFO:teuthology.orchestra.run.smithi005.stdout: client mount timeout = 600 2023-03-03T06:22:49.104 INFO:teuthology.orchestra.run.smithi005.stdout: debug client = 20 2023-03-03T06:22:49.105 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-03-03T06:22:49.105 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = "" 2023-03-03T06:22:49.105 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2023-03-03T06:22:49.105 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2023-03-03T06:22:49.105 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2023-03-03T06:22:49.105 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2023-03-03T06:22:49.105 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2023-03-03T06:22:49.105 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2023-03-03T06:22:49.106 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2023-03-03T06:22:49.106 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2023-03-03T06:22:49.106 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2023-03-03T06:22:49.106 INFO:teuthology.orchestra.run.smithi005.stdout:[mds] 2023-03-03T06:22:49.106 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds = 20 2023-03-03T06:22:49.106 INFO:teuthology.orchestra.run.smithi005.stdout: debug mds balancer = 20 2023-03-03T06:22:49.106 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2023-03-03T06:22:49.107 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug frag = True 2023-03-03T06:22:49.107 INFO:teuthology.orchestra.run.smithi005.stdout: mds debug scatterstat = True 2023-03-03T06:22:49.107 INFO:teuthology.orchestra.run.smithi005.stdout: mds op complaint time = 180 2023-03-03T06:22:49.107 INFO:teuthology.orchestra.run.smithi005.stdout: mds verify scatter = True 2023-03-03T06:22:49.107 INFO:teuthology.orchestra.run.smithi005.stdout: osd op complaint time = 180 2023-03-03T06:22:49.107 INFO:teuthology.orchestra.run.smithi005.stdout: rados mon op timeout = 900 2023-03-03T06:22:49.107 INFO:teuthology.orchestra.run.smithi005.stdout: rados osd op timeout = 900 2023-03-03T06:22:49.109 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2023-03-03T06:22:49.109 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2023-03-03T06:22:49.109 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-03-03T06:22:49.109 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2023-03-03T06:22:49.110 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.110 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2023-03-03T06:22:49.110 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.110 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2023-03-03T06:22:49.110 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.110 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2023-03-03T06:22:49.110 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2023-03-03T06:22:49.110 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.111 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2023-03-03T06:22:49.111 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2023-03-03T06:22:49.111 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.111 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2023-03-03T06:22:49.111 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2023-03-03T06:22:49.111 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.111 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2023-03-03T06:22:49.112 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2023-03-03T06:22:49.112 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.112 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2023-03-03T06:22:49.112 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.112 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2023-03-03T06:22:49.112 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2023-03-03T06:22:49.112 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2023-03-03T06:22:49.112 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2023-03-03T06:22:49.113 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2023-03-03T06:22:49.113 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2023-03-03T06:22:49.113 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2023-03-03T06:22:49.113 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-03-03T06:22:49.113 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2023-03-03T06:22:49.113 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2023-03-03T06:22:49.113 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.113 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-03-03T06:22:49.114 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.114 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2023-03-03T06:22:49.114 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.114 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2023-03-03T06:22:49.114 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.114 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2023-03-03T06:22:49.114 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2023-03-03T06:22:49.115 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2023-03-03T06:22:49.115 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.5,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2023-03-03T06:22:49.115 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on skipped message = False 2023-03-03T06:22:49.115 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6 2023-03-03T06:22:49.115 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.115 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2023-03-03T06:22:49.115 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2023-03-03T06:22:49.115 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.116 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2023-03-03T06:22:49.116 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2023-03-03T06:22:49.116 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.116 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2023-03-03T06:22:49.116 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2023-03-03T06:22:49.116 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.116 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2023-03-03T06:22:49.116 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2023-03-03T06:22:49.117 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2023-03-03T06:22:49.117 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.117 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2023-03-03T06:22:49.117 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2023-03-03T06:22:49.117 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.117 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2023-03-03T06:22:49.117 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.117 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2023-03-03T06:22:49.118 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.118 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2023-03-03T06:22:49.118 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.118 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2023-03-03T06:22:49.118 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2023-03-03T06:22:49.118 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.118 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2023-03-03T06:22:49.119 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2023-03-03T06:22:49.119 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2023-03-03T06:22:49.119 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2023-03-03T06:22:49.119 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 20 2023-03-03T06:22:49.119 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 20 2023-03-03T06:22:49.119 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-03-03T06:22:49.119 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2023-03-03T06:22:49.119 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 10 2023-03-03T06:22:49.120 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2023-03-03T06:22:49.120 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2023-03-03T06:22:49.120 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2023-03-03T06:22:49.120 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2023-03-03T06:22:49.120 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2023-03-03T06:22:49.120 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-03-03T06:22:49.120 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.120 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2023-03-03T06:22:49.121 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-03-03T06:22:49.121 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2023-03-03T06:22:49.121 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-03-03T06:22:49.121 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-03-03T06:22:49.121 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-03-03T06:22:49.121 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-03-03T06:22:49.121 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2023-03-03T06:22:49.122 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.122 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2023-03-03T06:22:49.122 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-03-03T06:22:49.122 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-03-03T06:22:49.122 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2023-03-03T06:22:49.122 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-03-03T06:22:49.122 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2023-03-03T06:22:49.122 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2023-03-03T06:22:49.123 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-03-03T06:22:49.123 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2023-03-03T06:22:49.123 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2023-03-03T06:22:49.123 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-03-03T06:22:49.123 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.123 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-03-03T06:22:49.123 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2023-03-03T06:22:49.124 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2023-03-03T06:22:49.124 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.124 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2023-03-03T06:22:49.124 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-03-03T06:22:49.124 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-03-03T06:22:49.124 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.124 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2023-03-03T06:22:49.124 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2023-03-03T06:22:49.125 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.125 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2023-03-03T06:22:49.125 INFO:teuthology.orchestra.run.smithi191.stdout: mon op complaint time = 120 2023-03-03T06:22:49.125 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-03-03T06:22:49.125 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2023-03-03T06:22:49.125 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2023-03-03T06:22:49.125 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2023-03-03T06:22:49.125 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2023-03-03T06:22:49.126 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-03-03T06:22:49.126 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-03-03T06:22:49.126 INFO:teuthology.orchestra.run.smithi191.stdout: client mount timeout = 600 2023-03-03T06:22:49.126 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2023-03-03T06:22:49.126 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-03-03T06:22:49.126 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = "" 2023-03-03T06:22:49.126 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-03-03T06:22:49.127 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-03-03T06:22:49.127 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2023-03-03T06:22:49.127 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2023-03-03T06:22:49.127 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2023-03-03T06:22:49.127 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2023-03-03T06:22:49.127 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2023-03-03T06:22:49.127 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2023-03-03T06:22:49.127 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2023-03-03T06:22:49.128 INFO:teuthology.orchestra.run.smithi191.stdout:[mds] 2023-03-03T06:22:49.128 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds = 20 2023-03-03T06:22:49.128 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds balancer = 20 2023-03-03T06:22:49.128 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-03-03T06:22:49.128 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug frag = True 2023-03-03T06:22:49.128 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug scatterstat = True 2023-03-03T06:22:49.128 INFO:teuthology.orchestra.run.smithi191.stdout: mds op complaint time = 180 2023-03-03T06:22:49.128 INFO:teuthology.orchestra.run.smithi191.stdout: mds verify scatter = True 2023-03-03T06:22:49.129 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2023-03-03T06:22:49.129 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2023-03-03T06:22:49.129 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2023-03-03T06:22:49.129 INFO:tasks.ceph:Creating admin key on mon.a... 2023-03-03T06:22:49.129 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-03-03T06:22:49.207 INFO:tasks.ceph:Copying monmap to all nodes... 2023-03-03T06:22:49.207 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:22:49.207 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-03-03T06:22:49.224 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:22:49.225 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-03-03T06:22:49.281 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2023-03-03T06:22:49.281 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:22:49.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-03T06:22:49.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-03T06:22:49.358 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:22:49.358 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:22:49.414 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi191.front.sepia.ceph.com 2023-03-03T06:22:49.415 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:22:49.415 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.keyring 2023-03-03T06:22:49.415 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-03-03T06:22:49.458 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:22:49.458 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:22:49.515 INFO:tasks.ceph:Setting up mon nodes... 2023-03-03T06:22:49.516 INFO:tasks.ceph:Setting up mgr nodes... 2023-03-03T06:22:49.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-03-03T06:22:49.572 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-03-03T06:22:49.575 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-03-03T06:22:49.640 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-03-03T06:22:49.643 INFO:tasks.ceph:Setting up mds nodes... 2023-03-03T06:22:49.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-03-03T06:22:49.699 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-03-03T06:22:49.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-03-03T06:22:49.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-03-03T06:22:49.824 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-03-03T06:22:49.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-03-03T06:22:49.853 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-03-03T06:22:49.912 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-03-03T06:22:49.914 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-03-03T06:22:49.942 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-03-03T06:22:50.035 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-03-03T06:22:50.038 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-03-03T06:22:50.064 INFO:tasks.ceph_client:Setting up client nodes... 2023-03-03T06:22:50.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-03-03T06:22:50.111 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-03-03T06:22:50.124 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-03-03T06:22:50.167 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-03-03T06:22:50.180 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-03-03T06:22:50.223 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-03-03T06:22:50.236 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-03-03T06:22:50.279 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-03-03T06:22:50.292 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-03-03T06:22:50.292 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-03-03T06:22:50.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-03-03T06:22:50.320 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-03T06:22:50.320 INFO:tasks.ceph:role: osd.0 2023-03-03T06:22:50.320 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2023-03-03T06:22:50.320 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-03-03T06:22:50.386 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-03-03T06:22:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-03T06:22:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-03T06:22:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-03T06:22:50.387 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-03T06:22:50.387 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-03-03T06:22:50.387 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-03T06:22:50.388 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-03T06:22:50.388 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-03T06:22:50.388 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-03T06:22:50.409 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-03-03T06:22:50.411 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-03-03T06:22:50.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-03-03T06:22:50.491 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-03-03T06:22:50.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-03-03T06:22:50.630 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-03T06:22:50.631 INFO:tasks.ceph:role: osd.1 2023-03-03T06:22:50.631 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2023-03-03T06:22:50.631 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-03-03T06:22:50.697 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-03-03T06:22:50.698 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-03T06:22:50.698 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-03T06:22:50.698 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-03T06:22:50.698 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-03T06:22:50.698 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-03-03T06:22:50.698 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-03T06:22:50.699 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-03T06:22:50.699 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-03T06:22:50.699 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-03T06:22:50.720 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-03-03T06:22:50.722 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-03-03T06:22:50.722 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-03-03T06:22:50.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-03-03T06:22:50.874 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-03-03T06:22:50.940 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-03T06:22:50.941 INFO:tasks.ceph:role: osd.2 2023-03-03T06:22:50.941 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2023-03-03T06:22:50.941 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-03-03T06:22:51.007 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-03-03T06:22:51.007 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-03T06:22:51.007 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-03T06:22:51.008 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-03T06:22:51.008 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-03T06:22:51.008 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-03-03T06:22:51.008 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-03T06:22:51.008 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-03T06:22:51.008 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-03T06:22:51.008 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-03T06:22:51.030 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-03-03T06:22:51.032 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-03-03T06:22:51.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-03-03T06:22:51.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-03-03T06:22:51.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-03-03T06:22:51.253 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-03-03T06:22:51.254 INFO:tasks.ceph:role: osd.3 2023-03-03T06:22:51.254 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2023-03-03T06:22:51.254 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-03-03T06:22:51.320 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-03-03T06:22:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-03T06:22:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-03T06:22:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-03T06:22:51.321 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-03T06:22:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2023-03-03T06:22:51.321 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-03T06:22:51.321 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-03T06:22:51.321 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-03T06:22:51.322 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-03T06:22:51.343 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2023-03-03T06:22:51.344 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2023-03-03T06:22:51.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-03-03T06:22:51.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-03-03T06:22:51.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:22:51.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:51.698+0000 7fa998862640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-03-03T06:22:51.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:51.698+0000 7fa998862640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-03-03T06:22:51.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:51.698+0000 7fa998862640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-03T06:22:51.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:51.698+0000 7fa998862640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-03T06:22:51.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:51.698+0000 7fa998862640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-03-03T06:22:51.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:51.698+0000 7fa998862640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-03-03T06:22:54.561 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-03-03T06:22:54.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:22:54.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:54.686+0000 7fe2165ad640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-03-03T06:22:54.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:54.686+0000 7fe2165ad640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-03-03T06:22:54.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:54.686+0000 7fe2165ad640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-03T06:22:54.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:54.686+0000 7fe2165ad640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-03T06:22:54.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:54.686+0000 7fe2165ad640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-03-03T06:22:54.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:54.686+0000 7fe2165ad640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-03-03T06:22:57.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-03-03T06:22:57.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:22:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:57.665+0000 7f2330b1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-03-03T06:22:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:57.665+0000 7f2330b1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-03-03T06:22:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:57.665+0000 7f2330b1b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-03T06:22:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:57.665+0000 7f2330b1b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-03T06:22:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:57.665+0000 7f2330b1b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-03-03T06:22:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:22:57.666+0000 7f2330b1b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-03-03T06:23:00.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-03-03T06:23:00.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:23:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:00.657+0000 7ff06328d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-03-03T06:23:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:00.657+0000 7ff06328d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-03-03T06:23:00.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:00.657+0000 7ff06328d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-03T06:23:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:00.658+0000 7ff06328d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-03T06:23:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:00.658+0000 7ff06328d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-03-03T06:23:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:00.658+0000 7ff06328d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-03-03T06:23:03.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-03-03T06:23:03.554 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-03-03T06:23:03.587 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-03T06:23:03.587 INFO:tasks.ceph:role: osd.4 2023-03-03T06:23:03.588 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com 2023-03-03T06:23:03.588 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-03-03T06:23:03.665 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-03-03T06:23:03.665 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-03T06:23:03.665 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-03T06:23:03.665 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-03T06:23:03.665 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-03T06:23:03.666 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-03-03T06:23:03.666 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-03T06:23:03.666 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-03T06:23:03.666 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-03T06:23:03.666 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-03T06:23:04.088 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-03-03T06:23:04.090 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-03-03T06:23:04.090 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-03-03T06:23:04.254 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-03-03T06:23:04.293 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-03-03T06:23:04.361 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-03T06:23:04.361 INFO:tasks.ceph:role: osd.5 2023-03-03T06:23:04.362 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com 2023-03-03T06:23:04.362 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-03-03T06:23:04.437 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-03-03T06:23:04.438 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-03T06:23:04.438 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-03T06:23:04.438 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-03T06:23:04.438 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-03T06:23:04.438 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-03-03T06:23:04.438 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-03T06:23:04.438 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-03T06:23:04.439 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-03T06:23:04.439 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-03T06:23:04.861 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-03-03T06:23:04.863 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-03-03T06:23:04.863 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-03-03T06:23:04.973 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-03-03T06:23:05.007 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-03-03T06:23:05.075 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-03T06:23:05.075 INFO:tasks.ceph:role: osd.6 2023-03-03T06:23:05.076 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com 2023-03-03T06:23:05.076 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-03-03T06:23:05.152 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-03-03T06:23:05.152 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-03T06:23:05.152 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-03T06:23:05.152 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-03T06:23:05.153 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-03T06:23:05.153 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-03-03T06:23:05.153 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-03T06:23:05.153 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-03T06:23:05.153 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-03T06:23:05.153 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-03T06:23:05.600 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-03-03T06:23:05.602 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-03-03T06:23:05.602 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-03-03T06:23:05.764 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-03-03T06:23:05.801 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-03-03T06:23:05.869 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-03-03T06:23:05.870 INFO:tasks.ceph:role: osd.7 2023-03-03T06:23:05.870 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com 2023-03-03T06:23:05.870 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-03-03T06:23:05.946 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-03-03T06:23:05.946 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-03-03T06:23:05.946 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-03-03T06:23:05.946 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-03-03T06:23:05.946 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-03-03T06:23:05.946 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-03-03T06:23:05.947 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-03-03T06:23:05.947 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-03-03T06:23:05.947 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-03-03T06:23:05.947 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-03-03T06:23:06.383 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-03-03T06:23:06.385 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-03-03T06:23:06.385 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-03-03T06:23:06.537 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-03-03T06:23:06.571 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:23:06.684 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:06.682+0000 7f45576a2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-03-03T06:23:06.685 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:06.683+0000 7f45576a2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-03-03T06:23:06.685 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:06.683+0000 7f45576a2640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-03T06:23:06.685 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:06.683+0000 7f45576a2640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-03T06:23:06.685 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:06.683+0000 7f45576a2640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-03-03T06:23:06.686 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:06.683+0000 7f45576a2640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-03-03T06:23:09.542 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-03-03T06:23:09.574 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:23:09.665 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:09.663+0000 7f80e33cf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-03-03T06:23:09.666 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:09.663+0000 7f80e33cf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-03-03T06:23:09.666 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:09.663+0000 7f80e33cf640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-03T06:23:09.666 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:09.663+0000 7f80e33cf640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-03T06:23:09.666 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:09.663+0000 7f80e33cf640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-03-03T06:23:09.666 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:09.664+0000 7f80e33cf640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-03-03T06:23:12.530 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-03-03T06:23:12.566 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:23:12.656 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:12.654+0000 7f7da4cbc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-03-03T06:23:12.657 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:12.655+0000 7f7da4cbc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-03-03T06:23:12.657 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:12.655+0000 7f7da4cbc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-03T06:23:12.657 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:12.655+0000 7f7da4cbc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-03T06:23:12.657 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:12.655+0000 7f7da4cbc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-03-03T06:23:12.658 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:12.655+0000 7f7da4cbc640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-03-03T06:23:15.523 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-03-03T06:23:15.555 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:23:15.646 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:15.644+0000 7f128fe1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-03-03T06:23:15.647 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:15.645+0000 7f128fe1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-03-03T06:23:15.647 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:15.645+0000 7f128fe1e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-03T06:23:15.648 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:15.645+0000 7f128fe1e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-03T06:23:15.648 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:15.645+0000 7f128fe1e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-03-03T06:23:15.648 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:15.645+0000 7f128fe1e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-03-03T06:23:17.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:23:17.042 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:23:18.505 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-03-03T06:23:18.536 INFO:tasks.ceph:Reading keys from all nodes... 2023-03-03T06:23:18.537 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:18.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-03-03T06:23:18.570 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:18.571 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-03-03T06:23:18.643 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:18.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-03-03T06:23:18.714 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:18.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-03-03T06:23:18.784 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:18.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-03-03T06:23:18.854 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:18.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-03-03T06:23:18.923 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:18.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-03-03T06:23:18.995 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:23:18.996 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-03-03T06:23:19.031 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:23:19.031 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-03-03T06:23:19.100 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:23:19.100 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-03-03T06:23:19.168 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:23:19.169 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-03-03T06:23:19.236 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:23:19.237 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-03-03T06:23:19.304 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:23:19.304 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-03-03T06:23:19.371 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:23:19.372 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-03-03T06:23:19.437 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:19.437 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-03-03T06:23:19.458 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:19.459 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-03-03T06:23:19.519 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:23:19.519 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-03-03T06:23:19.536 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:23:19.536 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-03-03T06:23:19.591 INFO:tasks.ceph:Adding keys to all mons... 2023-03-03T06:23:19.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2023-03-03T06:23:19.595 DEBUG:teuthology.orchestra.run.smithi191:> sudo tee -a /etc/ceph/ceph.keyring 2023-03-03T06:23:19.634 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2023-03-03T06:23:19.635 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA5kgFktxgZIhAAsvbF/OzJf4OZ7a85LkWKtw== 2023-03-03T06:23:19.635 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a] 2023-03-03T06:23:19.635 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA5kgFkziqmKRAARZXnnbV545/aKwJvt9QAgw== 2023-03-03T06:23:19.636 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c] 2023-03-03T06:23:19.636 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA5kgFk23MbMRAA1E6lR036GpHdLG9WAVzE2A== 2023-03-03T06:23:19.636 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2023-03-03T06:23:19.636 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA7kgFkiS2tKRAAuYbICLnn3CQtdepNk9uG7Q== 2023-03-03T06:23:19.636 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2023-03-03T06:23:19.636 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA+kgFkpDf4KBAA77yBycaKiSFdrCP9F0C5IA== 2023-03-03T06:23:19.637 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2023-03-03T06:23:19.637 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBBkgFk/OK7JxAAQFCaUo0b/+8gDkgP1Ifqwg== 2023-03-03T06:23:19.637 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2023-03-03T06:23:19.637 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBEkgFkhcBFJxAA3Q62rulwQRz9/VZeV938sg== 2023-03-03T06:23:19.637 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2023-03-03T06:23:19.638 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA5kgFkRHQbJhAAq2ZAqxUiXeNQLLcfaVvj7g== 2023-03-03T06:23:19.638 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b] 2023-03-03T06:23:19.638 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA5kgFkYP9KNhAA/yyEBoBn/eJ8/6mufuiznQ== 2023-03-03T06:23:19.639 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d] 2023-03-03T06:23:19.639 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA6kgFkQYUSAhAAt9Hj4Yq5VW5NJENi11Gsag== 2023-03-03T06:23:19.639 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2023-03-03T06:23:19.639 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBKkgFkHSO9KBAATkFiqiMet/gmDP9rNTozLA== 2023-03-03T06:23:19.640 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2023-03-03T06:23:19.640 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBNkgFkOUmVJxAA4gVwSp2IhnyXKPt+72wXOw== 2023-03-03T06:23:19.640 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2023-03-03T06:23:19.640 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBQkgFkBHsSJxAA0kN0Sob1BvksDKPj4e/yTA== 2023-03-03T06:23:19.641 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2023-03-03T06:23:19.641 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBTkgFkusR5JhAAsvEY2m5hImRjdFSqtEFVBw== 2023-03-03T06:23:19.641 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2023-03-03T06:23:19.641 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA6kgFkkZyRBhAA/Q44zwMnP6p4QwYJUCk0Ow== 2023-03-03T06:23:19.642 INFO:teuthology.orchestra.run.smithi005.stdout:[client.2] 2023-03-03T06:23:19.642 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA6kgFk6W3zCRAAMk0SzOs1po/kkiSR41EAbA== 2023-03-03T06:23:19.642 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2023-03-03T06:23:19.642 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA6kgFke8dHDRAA5tXiSg31lHzCfcffU+ycDw== 2023-03-03T06:23:19.643 INFO:teuthology.orchestra.run.smithi005.stdout:[client.3] 2023-03-03T06:23:19.643 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQA6kgFk4NGTEBAAQne/fOUfeZe1sWAZXnJ5Cw== 2023-03-03T06:23:19.656 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.y] 2023-03-03T06:23:19.656 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA5kgFktxgZIhAAsvbF/OzJf4OZ7a85LkWKtw== 2023-03-03T06:23:19.657 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2023-03-03T06:23:19.657 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA5kgFkziqmKRAARZXnnbV545/aKwJvt9QAgw== 2023-03-03T06:23:19.657 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2023-03-03T06:23:19.657 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA5kgFk23MbMRAA1E6lR036GpHdLG9WAVzE2A== 2023-03-03T06:23:19.657 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.0] 2023-03-03T06:23:19.657 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA7kgFkiS2tKRAAuYbICLnn3CQtdepNk9uG7Q== 2023-03-03T06:23:19.657 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.1] 2023-03-03T06:23:19.658 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA+kgFkpDf4KBAA77yBycaKiSFdrCP9F0C5IA== 2023-03-03T06:23:19.658 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.2] 2023-03-03T06:23:19.658 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBBkgFk/OK7JxAAQFCaUo0b/+8gDkgP1Ifqwg== 2023-03-03T06:23:19.658 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.3] 2023-03-03T06:23:19.658 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBEkgFkhcBFJxAA3Q62rulwQRz9/VZeV938sg== 2023-03-03T06:23:19.658 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.x] 2023-03-03T06:23:19.658 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA5kgFkRHQbJhAAq2ZAqxUiXeNQLLcfaVvj7g== 2023-03-03T06:23:19.659 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2023-03-03T06:23:19.659 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA5kgFkYP9KNhAA/yyEBoBn/eJ8/6mufuiznQ== 2023-03-03T06:23:19.659 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2023-03-03T06:23:19.659 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA6kgFkQYUSAhAAt9Hj4Yq5VW5NJENi11Gsag== 2023-03-03T06:23:19.659 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.4] 2023-03-03T06:23:19.659 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBKkgFkHSO9KBAATkFiqiMet/gmDP9rNTozLA== 2023-03-03T06:23:19.660 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.5] 2023-03-03T06:23:19.660 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBNkgFkOUmVJxAA4gVwSp2IhnyXKPt+72wXOw== 2023-03-03T06:23:19.660 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.6] 2023-03-03T06:23:19.660 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBQkgFkBHsSJxAA0kN0Sob1BvksDKPj4e/yTA== 2023-03-03T06:23:19.660 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.7] 2023-03-03T06:23:19.660 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBTkgFkusR5JhAAsvEY2m5hImRjdFSqtEFVBw== 2023-03-03T06:23:19.660 INFO:teuthology.orchestra.run.smithi191.stdout:[client.0] 2023-03-03T06:23:19.661 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA6kgFkkZyRBhAA/Q44zwMnP6p4QwYJUCk0Ow== 2023-03-03T06:23:19.661 INFO:teuthology.orchestra.run.smithi191.stdout:[client.2] 2023-03-03T06:23:19.661 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA6kgFk6W3zCRAAMk0SzOs1po/kkiSR41EAbA== 2023-03-03T06:23:19.661 INFO:teuthology.orchestra.run.smithi191.stdout:[client.1] 2023-03-03T06:23:19.661 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA6kgFke8dHDRAA5tXiSg31lHzCfcffU+ycDw== 2023-03-03T06:23:19.661 INFO:teuthology.orchestra.run.smithi191.stdout:[client.3] 2023-03-03T06:23:19.661 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQA6kgFk4NGTEBAAQne/fOUfeZe1sWAZXnJ5Cw== 2023-03-03T06:23:19.662 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-03T06:23:19.687 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-03T06:23:19.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-03T06:23:19.758 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-03T06:23:19.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-03T06:23:19.818 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-03T06:23:19.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:19.878 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:19.931 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:19.934 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:19.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:19.989 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:20.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:20.046 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:20.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-03T06:23:20.101 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-03-03T06:23:20.153 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-03T06:23:20.156 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-03T06:23:20.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-03T06:23:20.215 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-03-03T06:23:20.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:20.274 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:20.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:20.329 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:20.382 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:20.384 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:20.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:20.441 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-03-03T06:23:20.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-03T06:23:20.496 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-03T06:23:20.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-03T06:23:20.555 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-03T06:23:20.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-03T06:23:20.613 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-03T06:23:20.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-03T06:23:20.672 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-03-03T06:23:20.728 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-03-03T06:23:20.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-03-03T06:23:20.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-03T06:23:20.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-03-03T06:23:20.883 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-03-03T06:23:20.909 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-03T06:23:21.007 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-03-03T06:23:21.033 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-03-03T06:23:21.099 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-03-03T06:23:21.197 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-03-03T06:23:21.223 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:23:21.226 DEBUG:teuthology.orchestra.run.smithi191:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-03-03T06:23:21.280 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-03-03T06:23:21.280 INFO:tasks.ceph.mon.a:Restarting daemon 2023-03-03T06:23:21.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-03-03T06:23:21.284 INFO:tasks.ceph.mon.a:Started 2023-03-03T06:23:21.284 INFO:tasks.ceph.mon.b:Restarting daemon 2023-03-03T06:23:21.284 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-03-03T06:23:21.322 INFO:tasks.ceph.mon.b:Started 2023-03-03T06:23:21.323 INFO:tasks.ceph.mon.c:Restarting daemon 2023-03-03T06:23:21.323 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-03-03T06:23:21.325 INFO:tasks.ceph.mon.c:Started 2023-03-03T06:23:21.325 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-03-03T06:23:21.326 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-03-03T06:23:21.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-03-03T06:23:21.328 INFO:tasks.ceph.mgr.y:Started 2023-03-03T06:23:21.328 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-03-03T06:23:21.329 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-03-03T06:23:21.330 INFO:tasks.ceph.mgr.x:Started 2023-03-03T06:23:21.331 INFO:tasks.ceph:Setting crush tunables to default 2023-03-03T06:23:21.331 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2023-03-03T06:23:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.454+0000 7f949684a700 1 Processor -- start 2023-03-03T06:23:21.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.455+0000 7f949684a700 1 -- start start 2023-03-03T06:23:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.455+0000 7f949684a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f949006d1f0 0x7f949006b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.455+0000 7f949684a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9490160c40 con 0x7f949006b860 2023-03-03T06:23:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.456+0000 7f949684a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9490160ea0 con 0x7f949015c980 2023-03-03T06:23:21.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.456+0000 7f949684a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9490161460 con 0x7f949006d1f0 2023-03-03T06:23:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.456+0000 7f9494de7700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f949006b860 0x7f949006dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58388/0 (socket says 172.21.15.5:58388) 2023-03-03T06:23:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.456+0000 7f9494de7700 1 -- 172.21.15.5:0/940338765 learned_addr learned my addr 172.21.15.5:0/940338765 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.456+0000 7f948f7fe700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f949006d1f0 0x7f949006b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.456+0000 7f948f7fe700 1 -- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f949006d1f0 msgr2=0x7f949006b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-03-03T06:23:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.456+0000 7f948f7fe700 1 -- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f949006d1f0 msgr2=0x7f949006b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-03-03T06:23:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.456+0000 7f948f7fe700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f949006d1f0 0x7f949006b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-03-03T06:23:21.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.456+0000 7f948f7fe700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f949006d1f0 0x7f949006b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-03-03T06:23:21.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.643+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158389617 0 0) 0x7f9490160c40 con 0x7f949006b860 2023-03-03T06:23:21.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.643+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f947c0035b0 con 0x7f949006b860 2023-03-03T06:23:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2964165951 0 0) 0x7f947c0035b0 con 0x7f949006b860 2023-03-03T06:23:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f949006d1f0 msgr2=0x7f949006b320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-03T06:23:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948effd700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f949006d1f0 0x7f949006b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:21.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 >> v1:172.21.15.191:6789/0 conn(0x7f949015c980 legacy=0x7f9490160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9490161180 con 0x7f949006b860 2023-03-03T06:23:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f94880019f0 con 0x7f949006b860 2023-03-03T06:23:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 >> v1:172.21.15.5:6789/0 conn(0x7f949006b860 legacy=0x7f949006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948effd700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947c003a30 0x7f947c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948effd700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f949006d1f0 0x7f947c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:21.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948effd700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f947c004d90 0x7f947c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9490161460 con 0x7f947c003a30 2023-03-03T06:23:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c00bbd0 con 0x7f947c004d90 2023-03-03T06:23:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c00bd90 con 0x7f949006d1f0 2023-03-03T06:23:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948ffff700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947c003a30 0x7f947c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f948f7fe700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f949006d1f0 0x7f947c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.644+0000 7f9494de7700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f947c004d90 0x7f947c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.645+0000 7f948ffff700 1 -- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f949006d1f0 msgr2=0x7f947c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:21.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.645+0000 7f948ffff700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f949006d1f0 0x7f947c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.645+0000 7f948ffff700 1 -- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f947c004d90 msgr2=0x7f947c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.645+0000 7f948ffff700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f947c004d90 0x7f947c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.645+0000 7f948ffff700 1 -- 172.21.15.5:0/940338765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c0035b0 con 0x7f947c003a30 2023-03-03T06:23:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.645+0000 7f948ffff700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947c003a30 0x7f947c003e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f94800017c0 tx=0x7f947c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242714c0f2eb6b2c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.645+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800052d0 con 0x7f947c003a30 2023-03-03T06:23:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.645+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9480005430 con 0x7f947c003a30 2023-03-03T06:23:21.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.645+0000 7f948effd700 1 -- 172.21.15.5:0/940338765 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800038c0 con 0x7f947c003a30 2023-03-03T06:23:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.646+0000 7f949684a700 1 -- 172.21.15.5:0/940338765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947c003a30 msgr2=0x7f947c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.646+0000 7f949684a700 1 --2- 172.21.15.5:0/940338765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f947c003a30 0x7f947c003e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f94800017c0 tx=0x7f947c005880 comp rx=0 tx=0).stop 2023-03-03T06:23:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.646+0000 7f9494de7700 1 -- 172.21.15.5:0/940338765 reap_dead start 2023-03-03T06:23:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.646+0000 7f949684a700 1 -- 172.21.15.5:0/940338765 shutdown_connections 2023-03-03T06:23:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.646+0000 7f949684a700 1 -- 172.21.15.5:0/940338765 >> 172.21.15.5:0/940338765 conn(0x7f94900cfd00 msgr2=0x7f94900d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.646+0000 7f949684a700 1 -- 172.21.15.5:0/940338765 shutdown_connections 2023-03-03T06:23:21.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.646+0000 7f949684a700 1 -- 172.21.15.5:0/940338765 wait complete. 2023-03-03T06:23:21.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.648+0000 7f949684a700 1 Processor -- start 2023-03-03T06:23:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.648+0000 7f949684a700 1 -- start start 2023-03-03T06:23:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.649+0000 7f949684a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f947c003a30 0x7f94901577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.649+0000 7f949684a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94900c9320 0x7f94900c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.649+0000 7f949684a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94900ad3f0 0x7f94900cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.649+0000 7f949684a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900c7e20 con 0x7f94900ad3f0 2023-03-03T06:23:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.649+0000 7f949684a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900c83e0 con 0x7f947c003a30 2023-03-03T06:23:21.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.649+0000 7f949684a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900add60 con 0x7f94900c9320 2023-03-03T06:23:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.649+0000 7f948ffff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f947c003a30 0x7f94901577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.649+0000 7f948f7fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94900c9320 0x7f94900c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.649+0000 7f948ffff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f947c003a30 0x7f94901577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:40702/0 (socket says 172.21.15.5:40702) 2023-03-03T06:23:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.649+0000 7f948ffff700 1 -- 172.21.15.5:0/2075913824 learned_addr learned my addr 172.21.15.5:0/2075913824 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.650+0000 7f9494de7700 1 --2- 172.21.15.5:0/2075913824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94900ad3f0 0x7f94900cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.650+0000 7f948f7fe700 1 -- 172.21.15.5:0/2075913824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f947c003a30 msgr2=0x7f94901577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:21.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.650+0000 7f948f7fe700 1 --2- 172.21.15.5:0/2075913824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f947c003a30 0x7f94901577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.650+0000 7f948f7fe700 1 -- 172.21.15.5:0/2075913824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94900ad3f0 msgr2=0x7f94900cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.650+0000 7f948f7fe700 1 --2- 172.21.15.5:0/2075913824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94900ad3f0 0x7f94900cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.650+0000 7f948f7fe700 1 -- 172.21.15.5:0/2075913824 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900ceb70 con 0x7f94900c9320 2023-03-03T06:23:21.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.650+0000 7f948f7fe700 1 --2- 172.21.15.5:0/2075913824 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94900c9320 0x7f94900c8870 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f94780108d0 tx=0x7f9478010be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.653+0000 7f948cff9700 1 -- 172.21.15.5:0/2075913824 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478006ea0 con 0x7f94900c9320 2023-03-03T06:23:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.653+0000 7f948cff9700 1 -- 172.21.15.5:0/2075913824 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9478015880 con 0x7f94900c9320 2023-03-03T06:23:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.653+0000 7f949684a700 1 -- 172.21.15.5:0/2075913824 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94900ce890 con 0x7f94900c9320 2023-03-03T06:23:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.653+0000 7f948cff9700 1 -- 172.21.15.5:0/2075913824 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478015c30 con 0x7f94900c9320 2023-03-03T06:23:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.654+0000 7f949684a700 1 -- 172.21.15.5:0/2075913824 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949015cd50 con 0x7f94900c9320 2023-03-03T06:23:21.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.654+0000 7f948cff9700 1 -- 172.21.15.5:0/2075913824 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f9478026070 con 0x7f94900c9320 2023-03-03T06:23:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.654+0000 7f948cff9700 1 -- 172.21.15.5:0/2075913824 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9478016b50 con 0x7f94900c9320 2023-03-03T06:23:21.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.654+0000 7f949684a700 1 -- 172.21.15.5:0/2075913824 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94900c8550 con 0x7f94900c9320 2023-03-03T06:23:21.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.657+0000 7f948cff9700 1 -- 172.21.15.5:0/2075913824 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f947803eb00 con 0x7f94900c9320 2023-03-03T06:23:21.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.735+0000 7f949684a700 1 -- 172.21.15.5:0/2075913824 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f949004e6e0 con 0x7f94900c9320 2023-03-03T06:23:21.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.743+0000 7f948cff9700 1 -- 172.21.15.5:0/2075913824 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f947802d020 con 0x7f94900c9320 2023-03-03T06:23:21.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.744+0000 7f949684a700 1 -- 172.21.15.5:0/2075913824 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94900c9320 msgr2=0x7f94900c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:21.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.744+0000 7f949684a700 1 --2- 172.21.15.5:0/2075913824 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94900c9320 0x7f94900c8870 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f94780108d0 tx=0x7f9478010be0 comp rx=0 tx=0).stop 2023-03-03T06:23:21.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.744+0000 7f949684a700 1 -- 172.21.15.5:0/2075913824 shutdown_connections 2023-03-03T06:23:21.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.744+0000 7f949684a700 1 --2- 172.21.15.5:0/2075913824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94900ad3f0 0x7f94900cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:21.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.744+0000 7f949684a700 1 --2- 172.21.15.5:0/2075913824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f947c003a30 0x7f94901577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:21.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.744+0000 7f949684a700 1 --2- 172.21.15.5:0/2075913824 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94900c9320 0x7f94900c8870 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:21.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.744+0000 7f949684a700 1 -- 172.21.15.5:0/2075913824 >> 172.21.15.5:0/2075913824 conn(0x7f94900cfd00 msgr2=0x7f949006f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:21.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.744+0000 7f949684a700 1 -- 172.21.15.5:0/2075913824 shutdown_connections 2023-03-03T06:23:21.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:21.744+0000 7f949684a700 1 -- 172.21.15.5:0/2075913824 wait complete. 2023-03-03T06:23:21.748 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2023-03-03T06:23:21.758 INFO:tasks.ceph:check_enable_crimson: False 2023-03-03T06:23:21.758 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-03-03T06:23:21.759 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:21.759 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-03-03T06:23:21.767 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:21.766+0000 7fa70143c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-03T06:23:21.786 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:21.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-03-03T06:23:21.838 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:21.836+0000 7fa70143c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-03T06:23:21.852 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:21.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-03-03T06:23:21.919 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:21.917+0000 7fa70143c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-03T06:23:21.920 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:21.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-03-03T06:23:21.986 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:23:21.986 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-03-03T06:23:22.004 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:22.002+0000 7fa70143c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-03T06:23:22.015 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:23:22.015 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-03-03T06:23:22.081 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:23:22.082 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-03-03T06:23:22.127 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:22.125+0000 7fb25fb6a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-03-03T06:23:22.149 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:23:22.149 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-03-03T06:23:22.155 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:22.153+0000 7fa70143c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-03T06:23:22.197 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:22.195+0000 7fb25fb6a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-03-03T06:23:22.214 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 06e0f092-7bc0-4b44-8161-959f105c6cc9 0 2023-03-03T06:23:22.276 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:22.274+0000 7fb25fb6a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-03-03T06:23:22.360 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:22.358+0000 7fb25fb6a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-03-03T06:23:22.377 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.375+0000 7fc79dfa7700 1 Processor -- start 2023-03-03T06:23:22.377 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.375+0000 7fc79dfa7700 1 -- start start 2023-03-03T06:23:22.379 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.376+0000 7fc79dfa7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc79806e310 0x7fc7980cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.379 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.376+0000 7fc79dfa7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7980cf010 0x7fc7980cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.379 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.376+0000 7fc79dfa7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79815e110 con 0x7fc79806d130 2023-03-03T06:23:22.379 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.376+0000 7fc79dfa7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7980cf720 con 0x7fc79806e310 2023-03-03T06:23:22.379 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.376+0000 7fc79dfa7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980cf470 con 0x7fc7980cf010 2023-03-03T06:23:22.380 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc7977fe700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fc79806d130 0x7fc79806dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:46634/0 (socket says 172.21.15.191:46634) 2023-03-03T06:23:22.380 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc797fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7980cf010 0x7fc7980cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.380 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc7977fe700 1 -- 172.21.15.191:0/3900728364 learned_addr learned my addr 172.21.15.191:0/3900728364 (peer_addr_for_me v1:172.21.15.191:0/0) 2023-03-03T06:23:22.380 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc796ffd700 1 --2- 172.21.15.191:0/3900728364 >> v2:172.21.15.5:3300/0 conn(0x7fc79806e310 0x7fc7980cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.380 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc797fff700 1 -- 172.21.15.191:0/3900728364 >> v2:172.21.15.5:3300/0 conn(0x7fc79806e310 msgr2=0x7fc7980cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:22.380 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc7967fc700 1 -- 172.21.15.191:0/3900728364 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763451860 0 0) 0x7fc79815e110 con 0x7fc79806d130 2023-03-03T06:23:22.380 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc797fff700 1 --2- 172.21.15.191:0/3900728364 >> v2:172.21.15.5:3300/0 conn(0x7fc79806e310 0x7fc7980cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.381 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc797fff700 1 -- 172.21.15.191:0/3900728364 >> v1:172.21.15.191:6789/0 conn(0x7fc79806d130 legacy=0x7fc79806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.381 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc797fff700 1 -- 172.21.15.191:0/3900728364 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79815d350 con 0x7fc7980cf010 2023-03-03T06:23:22.381 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc796ffd700 1 --2- 172.21.15.191:0/3900728364 >> v2:172.21.15.5:3300/0 conn(0x7fc79806e310 0x7fc7980cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:22.381 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc797fff700 1 --2- 172.21.15.191:0/3900728364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7980cf010 0x7fc7980cb260 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc790009840 tx=0x7fc790009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deddc7f2697058b1 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:22.381 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc7967fc700 1 -- 172.21.15.191:0/3900728364 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc790011830 con 0x7fc7980cf010 2023-03-03T06:23:22.381 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc7967fc700 1 -- 172.21.15.191:0/3900728364 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc790011990 con 0x7fc7980cf010 2023-03-03T06:23:22.381 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.377+0000 7fc7967fc700 1 -- 172.21.15.191:0/3900728364 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc790011d20 con 0x7fc7980cf010 2023-03-03T06:23:22.383 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.378+0000 7fc79dfa7700 1 -- 172.21.15.191:0/3900728364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7980cf010 msgr2=0x7fc7980cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.384 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.378+0000 7fc79dfa7700 1 --2- 172.21.15.191:0/3900728364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7980cf010 0x7fc7980cb260 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc790009840 tx=0x7fc790009b50 comp rx=0 tx=0).stop 2023-03-03T06:23:22.384 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.378+0000 7fc79dfa7700 1 -- 172.21.15.191:0/3900728364 shutdown_connections 2023-03-03T06:23:22.384 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.378+0000 7fc79dfa7700 1 --2- 172.21.15.191:0/3900728364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7980cf010 0x7fc7980cb260 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.384 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.378+0000 7fc79dfa7700 1 --2- 172.21.15.191:0/3900728364 >> v2:172.21.15.5:3300/0 conn(0x7fc79806e310 0x7fc7980cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.384 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.378+0000 7fc79dfa7700 1 -- 172.21.15.191:0/3900728364 >> 172.21.15.191:0/3900728364 conn(0x7fc7980cfd00 msgr2=0x7fc7980d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:22.385 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.378+0000 7fc79dfa7700 1 -- 172.21.15.191:0/3900728364 shutdown_connections 2023-03-03T06:23:22.385 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.378+0000 7fc79dfa7700 1 -- 172.21.15.191:0/3900728364 wait complete. 2023-03-03T06:23:22.385 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.379+0000 7fc79dfa7700 1 Processor -- start 2023-03-03T06:23:22.385 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.379+0000 7fc79dfa7700 1 -- start start 2023-03-03T06:23:22.385 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc79dfa7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc79806d130 0x7fc7980c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.385 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc79dfa7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc79806e310 0x7fc7980c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.385 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc79dfa7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7980cf010 0x7fc798151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.386 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc79dfa7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980c4710 con 0x7fc79806e310 2023-03-03T06:23:22.386 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc79dfa7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980c5530 con 0x7fc7980cf010 2023-03-03T06:23:22.386 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc79dfa7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc798159bb0 con 0x7fc79806d130 2023-03-03T06:23:22.386 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc7977fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc79806d130 0x7fc7980c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.386 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc7977fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc79806d130 0x7fc7980c6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:46946/0 (socket says 172.21.15.191:46946) 2023-03-03T06:23:22.386 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc7977fe700 1 -- 172.21.15.191:0/495386415 learned_addr learned my addr 172.21.15.191:0/495386415 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-03T06:23:22.386 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc796ffd700 1 --2- 172.21.15.191:0/495386415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc79806e310 0x7fc7980c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.386 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc797fff700 1 --2- 172.21.15.191:0/495386415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7980cf010 0x7fc798151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.387 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc7977fe700 1 -- 172.21.15.191:0/495386415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7980cf010 msgr2=0x7fc798151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.387 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc7977fe700 1 --2- 172.21.15.191:0/495386415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7980cf010 0x7fc798151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.387 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc7977fe700 1 -- 172.21.15.191:0/495386415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc79806e310 msgr2=0x7fc7980c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.387 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc7977fe700 1 --2- 172.21.15.191:0/495386415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc79806e310 0x7fc7980c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.387 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc7977fe700 1 -- 172.21.15.191:0/495386415 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7900094a0 con 0x7fc79806d130 2023-03-03T06:23:22.387 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.380+0000 7fc797fff700 1 --2- 172.21.15.191:0/495386415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7980cf010 0x7fc798151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:22.387 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.381+0000 7fc7977fe700 1 --2- 172.21.15.191:0/495386415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc79806d130 0x7fc7980c6dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc788001f80 tx=0x7fc78800a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:22.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.381+0000 7fc78ffff700 1 -- 172.21.15.191:0/495386415 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78800acd0 con 0x7fc79806d130 2023-03-03T06:23:22.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.381+0000 7fc78ffff700 1 -- 172.21.15.191:0/495386415 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78800ae50 con 0x7fc79806d130 2023-03-03T06:23:22.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.381+0000 7fc79dfa7700 1 -- 172.21.15.191:0/495386415 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79815d910 con 0x7fc79806d130 2023-03-03T06:23:22.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.381+0000 7fc78ffff700 1 -- 172.21.15.191:0/495386415 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc788007310 con 0x7fc79806d130 2023-03-03T06:23:22.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.381+0000 7fc79dfa7700 1 -- 172.21.15.191:0/495386415 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79815d630 con 0x7fc79806d130 2023-03-03T06:23:22.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.381+0000 7fc78ffff700 1 -- 172.21.15.191:0/495386415 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc78801a030 con 0x7fc79806d130 2023-03-03T06:23:22.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.381+0000 7fc78ffff700 1 -- 172.21.15.191:0/495386415 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc78801d870 con 0x7fc79806d130 2023-03-03T06:23:22.388 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.382+0000 7fc79dfa7700 1 -- 172.21.15.191:0/495386415 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79815dbf0 con 0x7fc79806d130 2023-03-03T06:23:22.389 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.384+0000 7fc78ffff700 1 -- 172.21.15.191:0/495386415 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fc788018070 con 0x7fc79806d130 2023-03-03T06:23:22.468 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.466+0000 7fc79dfa7700 1 -- 172.21.15.191:0/495386415 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "06e0f092-7bc0-4b44-8161-959f105c6cc9", "id": 0} v 0) v1 -- 0x7fc79806d840 con 0x7fc79806d130 2023-03-03T06:23:22.471 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.469+0000 7fc78ffff700 1 -- 172.21.15.191:0/495386415 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "06e0f092-7bc0-4b44-8161-959f105c6cc9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc78801db00 con 0x7fc79806d130 2023-03-03T06:23:22.472 INFO:teuthology.orchestra.run.smithi191.stdout:0 2023-03-03T06:23:22.472 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.470+0000 7fc79dfa7700 1 -- 172.21.15.191:0/495386415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc79806d130 msgr2=0x7fc7980c6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.473 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.470+0000 7fc79dfa7700 1 --2- 172.21.15.191:0/495386415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc79806d130 0x7fc7980c6dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc788001f80 tx=0x7fc78800a340 comp rx=0 tx=0).stop 2023-03-03T06:23:22.473 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.470+0000 7fc79dfa7700 1 -- 172.21.15.191:0/495386415 shutdown_connections 2023-03-03T06:23:22.473 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.470+0000 7fc79dfa7700 1 --2- 172.21.15.191:0/495386415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7980cf010 0x7fc798151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.473 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.470+0000 7fc79dfa7700 1 --2- 172.21.15.191:0/495386415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc79806d130 0x7fc7980c6dd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.473 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.470+0000 7fc79dfa7700 1 --2- 172.21.15.191:0/495386415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc79806e310 0x7fc7980c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.473 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.470+0000 7fc79dfa7700 1 -- 172.21.15.191:0/495386415 >> 172.21.15.191:0/495386415 conn(0x7fc7980cfd00 msgr2=0x7fc7980cbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:22.473 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.471+0000 7fc79dfa7700 1 -- 172.21.15.191:0/495386415 shutdown_connections 2023-03-03T06:23:22.474 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.471+0000 7fc79dfa7700 1 -- 172.21.15.191:0/495386415 wait complete. 2023-03-03T06:23:22.484 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new f418f313-4365-4dcb-b1c3-fb1cd7d7d137 1 2023-03-03T06:23:22.509 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:22.507+0000 7fb25fb6a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-03-03T06:23:22.631 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.629+0000 7ff94b80f700 1 Processor -- start 2023-03-03T06:23:22.631 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.629+0000 7ff94b80f700 1 -- start start 2023-03-03T06:23:22.632 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.630+0000 7ff94b80f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415a8d0 0x7ff9440cb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.633 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.630+0000 7ff94b80f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff94415e230 0x7ff9440b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.633 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.630+0000 7ff94b80f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9440c9f70 con 0x7ff94406d580 2023-03-03T06:23:22.633 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.630+0000 7ff94b80f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94415e7a0 con 0x7ff94415e230 2023-03-03T06:23:22.633 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.630+0000 7ff94b80f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94415ea80 con 0x7ff94415a8d0 2023-03-03T06:23:22.633 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.630+0000 7ff9495ab700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415a8d0 0x7ff9440cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.633 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.630+0000 7ff9495ab700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415a8d0 0x7ff9440cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:46952/0 (socket says 172.21.15.191:46952) 2023-03-03T06:23:22.634 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.630+0000 7ff9495ab700 1 -- 172.21.15.191:0/2415040734 learned_addr learned my addr 172.21.15.191:0/2415040734 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-03T06:23:22.634 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.630+0000 7ff948daa700 1 --2- 172.21.15.191:0/2415040734 >> v2:172.21.15.5:3300/0 conn(0x7ff94415e230 0x7ff9440b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.634 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.630+0000 7ff9495ab700 1 -- 172.21.15.191:0/2415040734 >> v2:172.21.15.5:3300/0 conn(0x7ff94415e230 msgr2=0x7ff9440b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:22.634 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.630+0000 7ff9495ab700 1 --2- 172.21.15.191:0/2415040734 >> v2:172.21.15.5:3300/0 conn(0x7ff94415e230 0x7ff9440b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.634 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.630+0000 7ff9495ab700 1 -- 172.21.15.191:0/2415040734 >> v1:172.21.15.5:6789/0 conn(0x7ff94406d580 legacy=0x7ff9440ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.634 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.630+0000 7ff9495ab700 1 -- 172.21.15.191:0/2415040734 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94415ed60 con 0x7ff94415a8d0 2023-03-03T06:23:22.634 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.631+0000 7ff9495ab700 1 --2- 172.21.15.191:0/2415040734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415a8d0 0x7ff9440cb680 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9400098f0 tx=0x7ff940009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdd5c21fe2256ad server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:22.635 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.631+0000 7ff93bfff700 1 -- 172.21.15.191:0/2415040734 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940011830 con 0x7ff94415a8d0 2023-03-03T06:23:22.635 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.631+0000 7ff93bfff700 1 -- 172.21.15.191:0/2415040734 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff940011990 con 0x7ff94415a8d0 2023-03-03T06:23:22.635 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.631+0000 7ff93bfff700 1 -- 172.21.15.191:0/2415040734 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940011d20 con 0x7ff94415a8d0 2023-03-03T06:23:22.637 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.631+0000 7ff94b80f700 1 -- 172.21.15.191:0/2415040734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415a8d0 msgr2=0x7ff9440cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.637 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.631+0000 7ff94b80f700 1 --2- 172.21.15.191:0/2415040734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415a8d0 0x7ff9440cb680 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9400098f0 tx=0x7ff940009c00 comp rx=0 tx=0).stop 2023-03-03T06:23:22.637 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.631+0000 7ff94b80f700 1 -- 172.21.15.191:0/2415040734 shutdown_connections 2023-03-03T06:23:22.637 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.631+0000 7ff94b80f700 1 --2- 172.21.15.191:0/2415040734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415a8d0 0x7ff9440cb680 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.638 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.631+0000 7ff94b80f700 1 --2- 172.21.15.191:0/2415040734 >> v2:172.21.15.5:3300/0 conn(0x7ff94415e230 0x7ff9440b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.638 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.631+0000 7ff94b80f700 1 -- 172.21.15.191:0/2415040734 >> 172.21.15.191:0/2415040734 conn(0x7ff9440cf4b0 msgr2=0x7ff9440cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:22.638 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.631+0000 7ff94b80f700 1 -- 172.21.15.191:0/2415040734 shutdown_connections 2023-03-03T06:23:22.638 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.631+0000 7ff94b80f700 1 -- 172.21.15.191:0/2415040734 wait complete. 2023-03-03T06:23:22.638 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.633+0000 7ff94b80f700 1 Processor -- start 2023-03-03T06:23:22.639 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.633+0000 7ff94b80f700 1 -- start start 2023-03-03T06:23:22.639 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.633+0000 7ff94b80f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff94406d580 0x7ff94414ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.639 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.633+0000 7ff94b80f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff94415a8d0 0x7ff9440714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.639 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.633+0000 7ff94b80f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415e230 0x7ff9440719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.639 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.633+0000 7ff94b80f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94415d460 con 0x7ff94415a8d0 2023-03-03T06:23:22.639 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.633+0000 7ff94b80f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440cead0 con 0x7ff94406d580 2023-03-03T06:23:22.639 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.633+0000 7ff94b80f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440abb00 con 0x7ff94415e230 2023-03-03T06:23:22.640 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.633+0000 7ff949dac700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415e230 0x7ff9440719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.640 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.633+0000 7ff9495ab700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff94406d580 0x7ff94414ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.640 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.633+0000 7ff9495ab700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff94406d580 0x7ff94414ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:52828/0 (socket says 172.21.15.191:52828) 2023-03-03T06:23:22.640 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.633+0000 7ff949dac700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415e230 0x7ff9440719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:46962/0 (socket says 172.21.15.191:46962) 2023-03-03T06:23:22.640 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff9495ab700 1 -- 172.21.15.191:0/3567794054 learned_addr learned my addr 172.21.15.191:0/3567794054 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-03T06:23:22.640 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff948daa700 1 --2- 172.21.15.191:0/3567794054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff94415a8d0 0x7ff9440714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.640 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff9495ab700 1 -- 172.21.15.191:0/3567794054 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415e230 msgr2=0x7ff9440719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.640 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff9495ab700 1 --2- 172.21.15.191:0/3567794054 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415e230 0x7ff9440719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.641 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff9495ab700 1 -- 172.21.15.191:0/3567794054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff94415a8d0 msgr2=0x7ff9440714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.641 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff9495ab700 1 --2- 172.21.15.191:0/3567794054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff94415a8d0 0x7ff9440714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.641 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff9495ab700 1 -- 172.21.15.191:0/3567794054 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff940009550 con 0x7ff94406d580 2023-03-03T06:23:22.641 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff949dac700 1 --2- 172.21.15.191:0/3567794054 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415e230 0x7ff9440719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:22.641 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff948daa700 1 --2- 172.21.15.191:0/3567794054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff94415a8d0 0x7ff9440714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:22.641 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff9495ab700 1 --2- 172.21.15.191:0/3567794054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff94406d580 0x7ff94414ec60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff940000c00 tx=0x7ff940004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:22.641 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff939ffb700 1 -- 172.21.15.191:0/3567794054 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940004400 con 0x7ff94406d580 2023-03-03T06:23:22.642 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff939ffb700 1 -- 172.21.15.191:0/3567794054 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94001f070 con 0x7ff94406d580 2023-03-03T06:23:22.642 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff939ffb700 1 -- 172.21.15.191:0/3567794054 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9400038e0 con 0x7ff94406d580 2023-03-03T06:23:22.642 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff94b80f700 1 -- 172.21.15.191:0/3567794054 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9440cbbc0 con 0x7ff94406d580 2023-03-03T06:23:22.642 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff94b80f700 1 -- 172.21.15.191:0/3567794054 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94415f040 con 0x7ff94406d580 2023-03-03T06:23:22.642 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.634+0000 7ff939ffb700 1 -- 172.21.15.191:0/3567794054 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7ff94002a020 con 0x7ff94406d580 2023-03-03T06:23:22.642 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.635+0000 7ff939ffb700 1 -- 172.21.15.191:0/3567794054 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7ff94001a6b0 con 0x7ff94406d580 2023-03-03T06:23:22.642 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.635+0000 7ff94b80f700 1 -- 172.21.15.191:0/3567794054 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9440b2840 con 0x7ff94406d580 2023-03-03T06:23:22.643 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.637+0000 7ff939ffb700 1 -- 172.21.15.191:0/3567794054 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ff940015020 con 0x7ff94406d580 2023-03-03T06:23:22.723 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.721+0000 7ff94b80f700 1 -- 172.21.15.191:0/3567794054 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f418f313-4365-4dcb-b1c3-fb1cd7d7d137", "id": 1} v 0) v1 -- 0x7ff9440ab8d0 con 0x7ff94406d580 2023-03-03T06:23:22.726 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.724+0000 7ff939ffb700 1 -- 172.21.15.191:0/3567794054 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f418f313-4365-4dcb-b1c3-fb1cd7d7d137", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff9440ab8d0 con 0x7ff94406d580 2023-03-03T06:23:22.726 INFO:teuthology.orchestra.run.smithi191.stdout:1 2023-03-03T06:23:22.727 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.725+0000 7ff94b80f700 1 -- 172.21.15.191:0/3567794054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff94406d580 msgr2=0x7ff94414ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.727 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.725+0000 7ff94b80f700 1 --2- 172.21.15.191:0/3567794054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff94406d580 0x7ff94414ec60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff940000c00 tx=0x7ff940004750 comp rx=0 tx=0).stop 2023-03-03T06:23:22.727 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.725+0000 7ff94b80f700 1 -- 172.21.15.191:0/3567794054 shutdown_connections 2023-03-03T06:23:22.727 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.725+0000 7ff94b80f700 1 --2- 172.21.15.191:0/3567794054 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff94415e230 0x7ff9440719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.728 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.725+0000 7ff94b80f700 1 --2- 172.21.15.191:0/3567794054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff94406d580 0x7ff94414ec60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.728 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.725+0000 7ff94b80f700 1 --2- 172.21.15.191:0/3567794054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff94415a8d0 0x7ff9440714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.728 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.725+0000 7ff94b80f700 1 -- 172.21.15.191:0/3567794054 >> 172.21.15.191:0/3567794054 conn(0x7ff9440cf4b0 msgr2=0x7ff944159af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:22.728 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.725+0000 7ff94b80f700 1 -- 172.21.15.191:0/3567794054 shutdown_connections 2023-03-03T06:23:22.728 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.725+0000 7ff94b80f700 1 -- 172.21.15.191:0/3567794054 wait complete. 2023-03-03T06:23:22.739 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 17bea630-650a-4d58-a2d4-d3670996e8e8 2 2023-03-03T06:23:22.860 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.858+0000 7f627ee04700 1 Processor -- start 2023-03-03T06:23:22.860 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.858+0000 7f627ee04700 1 -- start start 2023-03-03T06:23:22.862 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627ee04700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62781597d0 0x7f62780b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.862 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627ee04700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62780b1d80 0x7f62780b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.863 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627ee04700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f62780b56d0 0x7f62780cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.863 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627ee04700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62780b21f0 con 0x7f62780b1d80 2023-03-03T06:23:22.863 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627ee04700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627806bcd0 con 0x7f62780b56d0 2023-03-03T06:23:22.863 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627ee04700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627806cce0 con 0x7f62781597d0 2023-03-03T06:23:22.863 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627cba0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62781597d0 0x7f62780b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.863 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627d3a1700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f62780b56d0 0x7f62780cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627cba0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62781597d0 0x7f62780b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:46964/0 (socket says 172.21.15.191:46964) 2023-03-03T06:23:22.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627cba0700 1 -- 172.21.15.191:0/3782764506 learned_addr learned my addr 172.21.15.191:0/3782764506 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-03T06:23:22.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f6277fff700 1 --2- 172.21.15.191:0/3782764506 >> v2:172.21.15.5:3300/0 conn(0x7f62780b1d80 0x7f62780b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627d3a1700 1 -- 172.21.15.191:0/3782764506 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62781597d0 msgr2=0x7f62780b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:22.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627d3a1700 1 --2- 172.21.15.191:0/3782764506 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62781597d0 0x7f62780b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627d3a1700 1 -- 172.21.15.191:0/3782764506 >> v2:172.21.15.5:3300/0 conn(0x7f62780b1d80 msgr2=0x7f62780b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:22.864 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627d3a1700 1 --2- 172.21.15.191:0/3782764506 >> v2:172.21.15.5:3300/0 conn(0x7f62780b1d80 0x7f62780b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627d3a1700 1 -- 172.21.15.191:0/3782764506 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627806bf20 con 0x7f62780b56d0 2023-03-03T06:23:22.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.859+0000 7f627cba0700 1 --2- 172.21.15.191:0/3782764506 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62781597d0 0x7f62780b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:22.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.860+0000 7f627d3a1700 1 --2- 172.21.15.191:0/3782764506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62780b56d0 0x7f62780cd990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6278072a00 tx=0x7f627000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b3a189cb964e8f8 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:22.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.860+0000 7f62777fe700 1 -- 172.21.15.191:0/3782764506 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627000e070 con 0x7f62780b56d0 2023-03-03T06:23:22.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.860+0000 7f62777fe700 1 -- 172.21.15.191:0/3782764506 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627000bb20 con 0x7f62780b56d0 2023-03-03T06:23:22.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.860+0000 7f62777fe700 1 -- 172.21.15.191:0/3782764506 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270012430 con 0x7f62780b56d0 2023-03-03T06:23:22.865 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.860+0000 7f627ee04700 1 -- 172.21.15.191:0/3782764506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62780b56d0 msgr2=0x7f62780cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.866 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.860+0000 7f627ee04700 1 --2- 172.21.15.191:0/3782764506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62780b56d0 0x7f62780cd990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6278072a00 tx=0x7f627000b330 comp rx=0 tx=0).stop 2023-03-03T06:23:22.866 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.860+0000 7f627ee04700 1 -- 172.21.15.191:0/3782764506 shutdown_connections 2023-03-03T06:23:22.866 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.860+0000 7f627ee04700 1 --2- 172.21.15.191:0/3782764506 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62781597d0 0x7f62780b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.866 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.860+0000 7f627ee04700 1 --2- 172.21.15.191:0/3782764506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62780b56d0 0x7f62780cd990 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.866 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.860+0000 7f627ee04700 1 --2- 172.21.15.191:0/3782764506 >> v2:172.21.15.5:3300/0 conn(0x7f62780b1d80 0x7f62780b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.866 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.860+0000 7f627ee04700 1 -- 172.21.15.191:0/3782764506 >> 172.21.15.191:0/3782764506 conn(0x7f62780cc840 msgr2=0x7f62780ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:22.867 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.860+0000 7f627ee04700 1 -- 172.21.15.191:0/3782764506 shutdown_connections 2023-03-03T06:23:22.867 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.860+0000 7f627ee04700 1 -- 172.21.15.191:0/3782764506 wait complete. 2023-03-03T06:23:22.869 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.862+0000 7f627ee04700 1 Processor -- start 2023-03-03T06:23:22.869 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.862+0000 7f627ee04700 1 -- start start 2023-03-03T06:23:22.869 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.862+0000 7f627ee04700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62780b1d80 0x7f6278151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.869 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.862+0000 7f627ee04700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62780b56d0 0x7f6278150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.869 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.862+0000 7f627ee04700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62781597d0 0x7f62781e6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:22.870 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f627ee04700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627815b150 con 0x7f62781597d0 2023-03-03T06:23:22.870 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f627ee04700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627815ab90 con 0x7f62780b1d80 2023-03-03T06:23:22.870 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f627ee04700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627815ae70 con 0x7f62780b56d0 2023-03-03T06:23:22.870 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f6277fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62780b56d0 0x7f6278150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.870 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f627cba0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62780b1d80 0x7f6278151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.870 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f6277fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62780b56d0 0x7f6278150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:46972/0 (socket says 172.21.15.191:46972) 2023-03-03T06:23:22.870 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f6277fff700 1 -- 172.21.15.191:0/2168928146 learned_addr learned my addr 172.21.15.191:0/2168928146 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-03T06:23:22.871 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f627d3a1700 1 --2- 172.21.15.191:0/2168928146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62781597d0 0x7f62781e6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:22.871 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f627cba0700 1 -- 172.21.15.191:0/2168928146 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62780b56d0 msgr2=0x7f6278150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.871 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f627cba0700 1 --2- 172.21.15.191:0/2168928146 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62780b56d0 0x7f6278150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.871 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f627cba0700 1 -- 172.21.15.191:0/2168928146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62781597d0 msgr2=0x7f62781e6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.871 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f627cba0700 1 --2- 172.21.15.191:0/2168928146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62781597d0 0x7f62781e6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.871 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f627cba0700 1 -- 172.21.15.191:0/2168928146 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c009550 con 0x7f62780b1d80 2023-03-03T06:23:22.871 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f6277fff700 1 --2- 172.21.15.191:0/2168928146 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62780b56d0 0x7f6278150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:22.871 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f627cba0700 1 --2- 172.21.15.191:0/2168928146 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62780b1d80 0x7f6278151e50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f626c00e9a0 tx=0x7f626c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:22.872 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f62757fa700 1 -- 172.21.15.191:0/2168928146 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c004030 con 0x7f62780b1d80 2023-03-03T06:23:22.872 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f62757fa700 1 -- 172.21.15.191:0/2168928146 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c004190 con 0x7f62780b1d80 2023-03-03T06:23:22.872 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f627ee04700 1 -- 172.21.15.191:0/2168928146 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6270009a70 con 0x7f62780b1d80 2023-03-03T06:23:22.872 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f62757fa700 1 -- 172.21.15.191:0/2168928146 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c004520 con 0x7f62780b1d80 2023-03-03T06:23:22.872 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.863+0000 7f627ee04700 1 -- 172.21.15.191:0/2168928146 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627806c4e0 con 0x7f62780b1d80 2023-03-03T06:23:22.872 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.864+0000 7f62757fa700 1 -- 172.21.15.191:0/2168928146 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f626c019070 con 0x7f62780b1d80 2023-03-03T06:23:22.872 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.864+0000 7f62757fa700 1 -- 172.21.15.191:0/2168928146 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f626c003e20 con 0x7f62780b1d80 2023-03-03T06:23:22.872 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.865+0000 7f627ee04700 1 -- 172.21.15.191:0/2168928146 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627806c200 con 0x7f62780b1d80 2023-03-03T06:23:22.873 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.867+0000 7f62757fa700 1 -- 172.21.15.191:0/2168928146 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f626c020060 con 0x7f62780b1d80 2023-03-03T06:23:22.891 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:22.889+0000 7fa70143c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-03T06:23:22.968 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.967+0000 7f627ee04700 1 -- 172.21.15.191:0/2168928146 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "17bea630-650a-4d58-a2d4-d3670996e8e8", "id": 2} v 0) v1 -- 0x7f62780b3660 con 0x7f62780b1d80 2023-03-03T06:23:22.970 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:22.968+0000 7fa70143c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-03T06:23:22.971 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.970+0000 7f62757fa700 1 -- 172.21.15.191:0/2168928146 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "17bea630-650a-4d58-a2d4-d3670996e8e8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f626c00c7a0 con 0x7f62780b1d80 2023-03-03T06:23:22.972 INFO:teuthology.orchestra.run.smithi191.stdout:2 2023-03-03T06:23:22.973 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.970+0000 7f627ee04700 1 -- 172.21.15.191:0/2168928146 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62780b1d80 msgr2=0x7f6278151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:22.973 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.970+0000 7f627ee04700 1 --2- 172.21.15.191:0/2168928146 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62780b1d80 0x7f6278151e50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f626c00e9a0 tx=0x7f626c00ecb0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.973 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.971+0000 7f627ee04700 1 -- 172.21.15.191:0/2168928146 shutdown_connections 2023-03-03T06:23:22.973 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.971+0000 7f627ee04700 1 --2- 172.21.15.191:0/2168928146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62781597d0 0x7f62781e6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.974 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.971+0000 7f627ee04700 1 --2- 172.21.15.191:0/2168928146 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62780b1d80 0x7f6278151e50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.974 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.971+0000 7f627ee04700 1 --2- 172.21.15.191:0/2168928146 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62780b56d0 0x7f6278150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:22.974 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.971+0000 7f627ee04700 1 -- 172.21.15.191:0/2168928146 >> 172.21.15.191:0/2168928146 conn(0x7f62780cc840 msgr2=0x7f6278158700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:22.974 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.971+0000 7f627ee04700 1 -- 172.21.15.191:0/2168928146 shutdown_connections 2023-03-03T06:23:22.974 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:22.971+0000 7f627ee04700 1 -- 172.21.15.191:0/2168928146 wait complete. 2023-03-03T06:23:22.984 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 55eebce2-ba64-423a-a787-39fe21a2975e 3 2023-03-03T06:23:23.061 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:23.059+0000 7fa70143c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-03T06:23:23.104 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.102+0000 7fcfe1806700 1 Processor -- start 2023-03-03T06:23:23.104 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.102+0000 7fcfe1806700 1 -- start start 2023-03-03T06:23:23.106 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.103+0000 7fcfe1806700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfdc0b1960 0x7fcfdc06cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.106 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.103+0000 7fcfe1806700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfdc15d110 con 0x7fcfdc15cd40 2023-03-03T06:23:23.106 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.103+0000 7fcfe1806700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfdc06bf10 con 0x7fcfdc0cb050 2023-03-03T06:23:23.106 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.103+0000 7fcfe1806700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc06c1f0 con 0x7fcfdc0b1960 2023-03-03T06:23:23.106 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.103+0000 7fcfda7fc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfdc0b1960 0x7fcfdc06cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.106 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.103+0000 7fcfdb7fe700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fcfdc0cb050 0x7fcfdc0cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:46674/0 (socket says 172.21.15.191:46674) 2023-03-03T06:23:23.107 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.103+0000 7fcfdb7fe700 1 -- 172.21.15.191:0/4128858764 learned_addr learned my addr 172.21.15.191:0/4128858764 (peer_addr_for_me v1:172.21.15.191:0/0) 2023-03-03T06:23:23.107 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.103+0000 7fcfd9ffb700 1 -- 172.21.15.191:0/4128858764 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022388437 0 0) 0x7fcfdc06bf10 con 0x7fcfdc0cb050 2023-03-03T06:23:23.107 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.103+0000 7fcfda7fc700 1 -- 172.21.15.191:0/4128858764 >> v1:172.21.15.191:6789/0 conn(0x7fcfdc0cb050 legacy=0x7fcfdc0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.107 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.103+0000 7fcfda7fc700 1 -- 172.21.15.191:0/4128858764 >> v1:172.21.15.5:6789/0 conn(0x7fcfdc15cd40 legacy=0x7fcfdc06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.107 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.103+0000 7fcfda7fc700 1 -- 172.21.15.191:0/4128858764 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc06c4d0 con 0x7fcfdc0b1960 2023-03-03T06:23:23.107 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.104+0000 7fcfda7fc700 1 --2- 172.21.15.191:0/4128858764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfdc0b1960 0x7fcfdc06cfb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009870 tx=0x7fcfcc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a224a2d51decc414 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:23.107 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.104+0000 7fcfd9ffb700 1 -- 172.21.15.191:0/4128858764 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc011830 con 0x7fcfdc0b1960 2023-03-03T06:23:23.108 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.104+0000 7fcfd9ffb700 1 -- 172.21.15.191:0/4128858764 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc011990 con 0x7fcfdc0b1960 2023-03-03T06:23:23.108 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.104+0000 7fcfd9ffb700 1 -- 172.21.15.191:0/4128858764 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc011d20 con 0x7fcfdc0b1960 2023-03-03T06:23:23.110 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.104+0000 7fcfe1806700 1 -- 172.21.15.191:0/4128858764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfdc0b1960 msgr2=0x7fcfdc06cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.110 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.104+0000 7fcfe1806700 1 --2- 172.21.15.191:0/4128858764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfdc0b1960 0x7fcfdc06cfb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009870 tx=0x7fcfcc009b80 comp rx=0 tx=0).stop 2023-03-03T06:23:23.110 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.105+0000 7fcfe1806700 1 -- 172.21.15.191:0/4128858764 shutdown_connections 2023-03-03T06:23:23.110 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.105+0000 7fcfe1806700 1 --2- 172.21.15.191:0/4128858764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfdc0b1960 0x7fcfdc06cfb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.111 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.105+0000 7fcfe1806700 1 -- 172.21.15.191:0/4128858764 >> 172.21.15.191:0/4128858764 conn(0x7fcfdc0cc8d0 msgr2=0x7fcfdc0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:23.111 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.105+0000 7fcfe1806700 1 -- 172.21.15.191:0/4128858764 shutdown_connections 2023-03-03T06:23:23.111 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.105+0000 7fcfe1806700 1 -- 172.21.15.191:0/4128858764 wait complete. 2023-03-03T06:23:23.111 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.106+0000 7fcfe1806700 1 Processor -- start 2023-03-03T06:23:23.111 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.106+0000 7fcfe1806700 1 -- start start 2023-03-03T06:23:23.111 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfe1806700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfdc0b1960 0x7fcfdc0ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.111 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfe1806700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfdc0cb050 0x7fcfdc15e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.112 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfe1806700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc15cd40 0x7fcfdc15a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.112 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfe1806700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc0b3cd0 con 0x7fcfdc15cd40 2023-03-03T06:23:23.112 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfe1806700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc0aded0 con 0x7fcfdc0cb050 2023-03-03T06:23:23.112 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfe1806700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc0ae1a0 con 0x7fcfdc0b1960 2023-03-03T06:23:23.112 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfdaffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfdc0b1960 0x7fcfdc0ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.112 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfda7fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfdc0cb050 0x7fcfdc15e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.112 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfdaffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfdc0b1960 0x7fcfdc0ad990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:46982/0 (socket says 172.21.15.191:46982) 2023-03-03T06:23:23.112 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfdaffd700 1 -- 172.21.15.191:0/865845417 learned_addr learned my addr 172.21.15.191:0/865845417 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-03T06:23:23.113 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfdb7fe700 1 --2- 172.21.15.191:0/865845417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc15cd40 0x7fcfdc15a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.113 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfdaffd700 1 -- 172.21.15.191:0/865845417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfdc0cb050 msgr2=0x7fcfdc15e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.113 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfdaffd700 1 --2- 172.21.15.191:0/865845417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfdc0cb050 0x7fcfdc15e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.113 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfdaffd700 1 -- 172.21.15.191:0/865845417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc15cd40 msgr2=0x7fcfdc15a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.113 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfdaffd700 1 --2- 172.21.15.191:0/865845417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc15cd40 0x7fcfdc15a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.113 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfdaffd700 1 -- 172.21.15.191:0/865845417 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc0094a0 con 0x7fcfdc0b1960 2023-03-03T06:23:23.113 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfda7fc700 1 --2- 172.21.15.191:0/865845417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfdc0cb050 0x7fcfdc15e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:23.114 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfdaffd700 1 --2- 172.21.15.191:0/865845417 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfdc0b1960 0x7fcfdc0ad990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000c450 tx=0x7fcfd000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:23.114 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfc3fff700 1 -- 172.21.15.191:0/865845417 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00052d0 con 0x7fcfdc0b1960 2023-03-03T06:23:23.114 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.107+0000 7fcfc3fff700 1 -- 172.21.15.191:0/865845417 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd0005430 con 0x7fcfdc0b1960 2023-03-03T06:23:23.114 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.108+0000 7fcfe1806700 1 -- 172.21.15.191:0/865845417 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfdc06ca90 con 0x7fcfdc0b1960 2023-03-03T06:23:23.114 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.108+0000 7fcfc3fff700 1 -- 172.21.15.191:0/865845417 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00038c0 con 0x7fcfdc0b1960 2023-03-03T06:23:23.114 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.108+0000 7fcfe1806700 1 -- 172.21.15.191:0/865845417 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfdc06c7b0 con 0x7fcfdc0b1960 2023-03-03T06:23:23.114 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.108+0000 7fcfc3fff700 1 -- 172.21.15.191:0/865845417 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fcfd0019030 con 0x7fcfdc0b1960 2023-03-03T06:23:23.114 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.108+0000 7fcfc3fff700 1 -- 172.21.15.191:0/865845417 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fcfd0011bb0 con 0x7fcfdc0b1960 2023-03-03T06:23:23.115 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.109+0000 7fcfe1806700 1 -- 172.21.15.191:0/865845417 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfdc06bbb0 con 0x7fcfdc0b1960 2023-03-03T06:23:23.115 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.111+0000 7fcfc3fff700 1 -- 172.21.15.191:0/865845417 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fcfd0017070 con 0x7fcfdc0b1960 2023-03-03T06:23:23.196 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.195+0000 7fcfe1806700 1 -- 172.21.15.191:0/865845417 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "55eebce2-ba64-423a-a787-39fe21a2975e", "id": 3} v 0) v1 -- 0x7fcfdc04e6e0 con 0x7fcfdc0b1960 2023-03-03T06:23:23.200 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.198+0000 7fcfc3fff700 1 -- 172.21.15.191:0/865845417 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "55eebce2-ba64-423a-a787-39fe21a2975e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcfd0011e10 con 0x7fcfdc0b1960 2023-03-03T06:23:23.200 INFO:teuthology.orchestra.run.smithi191.stdout:3 2023-03-03T06:23:23.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.199+0000 7fcfe1806700 1 -- 172.21.15.191:0/865845417 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfdc0b1960 msgr2=0x7fcfdc0ad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.199+0000 7fcfe1806700 1 --2- 172.21.15.191:0/865845417 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfdc0b1960 0x7fcfdc0ad990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000c450 tx=0x7fcfd000c760 comp rx=0 tx=0).stop 2023-03-03T06:23:23.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.199+0000 7fcfe1806700 1 -- 172.21.15.191:0/865845417 shutdown_connections 2023-03-03T06:23:23.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.199+0000 7fcfe1806700 1 --2- 172.21.15.191:0/865845417 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfdc15cd40 0x7fcfdc15a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.201 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.199+0000 7fcfe1806700 1 --2- 172.21.15.191:0/865845417 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcfdc0b1960 0x7fcfdc0ad990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.202 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.199+0000 7fcfe1806700 1 --2- 172.21.15.191:0/865845417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcfdc0cb050 0x7fcfdc15e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.202 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.199+0000 7fcfe1806700 1 -- 172.21.15.191:0/865845417 >> 172.21.15.191:0/865845417 conn(0x7fcfdc0cc8d0 msgr2=0x7fcfdc0b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:23.202 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.199+0000 7fcfe1806700 1 -- 172.21.15.191:0/865845417 shutdown_connections 2023-03-03T06:23:23.202 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.199+0000 7fcfe1806700 1 -- 172.21.15.191:0/865845417 wait complete. 2023-03-03T06:23:23.203 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:23.201+0000 7fa70143c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-03T06:23:23.212 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 13d87455-2c5f-46d2-b0f7-b7f93df0556b 4 2023-03-03T06:23:23.240 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:23.239+0000 7fb25fb6a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-03-03T06:23:23.319 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:23.317+0000 7fb25fb6a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-03-03T06:23:23.332 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.330+0000 7f5f510ba700 1 Processor -- start 2023-03-03T06:23:23.333 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.331+0000 7f5f510ba700 1 -- start start 2023-03-03T06:23:23.334 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f510ba700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f4c06b320 0x7f5f4c06b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.334 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f510ba700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 0x7f5f4c06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.334 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f510ba700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c0af5d0 con 0x7f5f4c15cbf0 2023-03-03T06:23:23.335 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f510ba700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4c0ce760 con 0x7f5f4c06b320 2023-03-03T06:23:23.335 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f510ba700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0ced20 con 0x7f5f4c06dc00 2023-03-03T06:23:23.335 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f4b59e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 0x7f5f4c06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.335 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f4b59e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 0x7f5f4c06e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:46992/0 (socket says 172.21.15.191:46992) 2023-03-03T06:23:23.335 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f4b59e700 1 -- 172.21.15.191:0/3645352221 learned_addr learned my addr 172.21.15.191:0/3645352221 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-03T06:23:23.335 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f4a59c700 1 --2- 172.21.15.191:0/3645352221 >> v2:172.21.15.5:3300/0 conn(0x7f5f4c06b320 0x7f5f4c06b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.335 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f4b59e700 1 -- 172.21.15.191:0/3645352221 >> v2:172.21.15.5:3300/0 conn(0x7f5f4c06b320 msgr2=0x7f5f4c06b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:23.336 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f4b59e700 1 --2- 172.21.15.191:0/3645352221 >> v2:172.21.15.5:3300/0 conn(0x7f5f4c06b320 0x7f5f4c06b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.336 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f4b59e700 1 -- 172.21.15.191:0/3645352221 >> v1:172.21.15.5:6789/0 conn(0x7f5f4c15cbf0 legacy=0x7f5f4c160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.336 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f4b59e700 1 -- 172.21.15.191:0/3645352221 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c06e580 con 0x7f5f4c06dc00 2023-03-03T06:23:23.336 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f4a59c700 1 --2- 172.21.15.191:0/3645352221 >> v2:172.21.15.5:3300/0 conn(0x7f5f4c06b320 0x7f5f4c06b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:23.336 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f4b59e700 1 --2- 172.21.15.191:0/3645352221 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 0x7f5f4c06e040 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009e50 tx=0x7f5f4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89f6964d903373f6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:23.336 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.332+0000 7f5f49d9b700 1 -- 172.21.15.191:0/3645352221 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400e070 con 0x7f5f4c06dc00 2023-03-03T06:23:23.336 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.333+0000 7f5f49d9b700 1 -- 172.21.15.191:0/3645352221 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4400b910 con 0x7f5f4c06dc00 2023-03-03T06:23:23.337 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.333+0000 7f5f49d9b700 1 -- 172.21.15.191:0/3645352221 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400bcc0 con 0x7f5f4c06dc00 2023-03-03T06:23:23.339 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.333+0000 7f5f510ba700 1 -- 172.21.15.191:0/3645352221 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 msgr2=0x7f5f4c06e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.339 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.333+0000 7f5f510ba700 1 --2- 172.21.15.191:0/3645352221 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 0x7f5f4c06e040 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009e50 tx=0x7f5f4400b330 comp rx=0 tx=0).stop 2023-03-03T06:23:23.339 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.333+0000 7f5f510ba700 1 -- 172.21.15.191:0/3645352221 shutdown_connections 2023-03-03T06:23:23.339 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.333+0000 7f5f510ba700 1 --2- 172.21.15.191:0/3645352221 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 0x7f5f4c06e040 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.339 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.333+0000 7f5f510ba700 1 --2- 172.21.15.191:0/3645352221 >> v2:172.21.15.5:3300/0 conn(0x7f5f4c06b320 0x7f5f4c06b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.340 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.333+0000 7f5f510ba700 1 -- 172.21.15.191:0/3645352221 >> 172.21.15.191:0/3645352221 conn(0x7f5f4c0cfd00 msgr2=0x7f5f4c0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:23.340 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.333+0000 7f5f510ba700 1 -- 172.21.15.191:0/3645352221 shutdown_connections 2023-03-03T06:23:23.340 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.333+0000 7f5f510ba700 1 -- 172.21.15.191:0/3645352221 wait complete. 2023-03-03T06:23:23.340 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.335+0000 7f5f510ba700 1 Processor -- start 2023-03-03T06:23:23.340 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.335+0000 7f5f510ba700 1 -- start start 2023-03-03T06:23:23.340 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f510ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f4c06b320 0x7f5f4c1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.340 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f510ba700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 0x7f5f4c0c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.340 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f510ba700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f4c15cbf0 0x7f5f4c15af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.341 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f510ba700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0abde0 con 0x7f5f4c06b320 2023-03-03T06:23:23.341 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f510ba700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0c82a0 con 0x7f5f4c15cbf0 2023-03-03T06:23:23.341 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f510ba700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0c8580 con 0x7f5f4c06dc00 2023-03-03T06:23:23.341 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f4a59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 0x7f5f4c0c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.341 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f4a59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 0x7f5f4c0c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:46996/0 (socket says 172.21.15.191:46996) 2023-03-03T06:23:23.341 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f4a59c700 1 -- 172.21.15.191:0/3093801700 learned_addr learned my addr 172.21.15.191:0/3093801700 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-03T06:23:23.341 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f4b59e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f4c15cbf0 0x7f5f4c15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.342 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f4ad9d700 1 --2- 172.21.15.191:0/3093801700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f4c06b320 0x7f5f4c1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.342 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f4a59c700 1 -- 172.21.15.191:0/3093801700 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f4c15cbf0 msgr2=0x7f5f4c15af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.342 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f4a59c700 1 --2- 172.21.15.191:0/3093801700 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f4c15cbf0 0x7f5f4c15af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.342 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f4a59c700 1 -- 172.21.15.191:0/3093801700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f4c06b320 msgr2=0x7f5f4c1574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.342 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f4a59c700 1 --2- 172.21.15.191:0/3093801700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f4c06b320 0x7f5f4c1574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.342 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f4a59c700 1 -- 172.21.15.191:0/3093801700 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f400094a0 con 0x7f5f4c06dc00 2023-03-03T06:23:23.342 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f4ad9d700 1 --2- 172.21.15.191:0/3093801700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f4c06b320 0x7f5f4c1574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:23.342 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.336+0000 7f5f4b59e700 1 --2- 172.21.15.191:0/3093801700 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f4c15cbf0 0x7f5f4c15af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:23.343 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.337+0000 7f5f4a59c700 1 --2- 172.21.15.191:0/3093801700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 0x7f5f4c0c77e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000ebe0 tx=0x7f5f4000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:23.343 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.337+0000 7f5f337fe700 1 -- 172.21.15.191:0/3093801700 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000c850 con 0x7f5f4c06dc00 2023-03-03T06:23:23.343 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.337+0000 7f5f337fe700 1 -- 172.21.15.191:0/3093801700 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4000c9b0 con 0x7f5f4c06dc00 2023-03-03T06:23:23.343 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.337+0000 7f5f510ba700 1 -- 172.21.15.191:0/3093801700 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f44009b30 con 0x7f5f4c06dc00 2023-03-03T06:23:23.343 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.337+0000 7f5f337fe700 1 -- 172.21.15.191:0/3093801700 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000cd40 con 0x7f5f4c06dc00 2023-03-03T06:23:23.343 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.337+0000 7f5f510ba700 1 -- 172.21.15.191:0/3093801700 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c161290 con 0x7f5f4c06dc00 2023-03-03T06:23:23.343 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.337+0000 7f5f337fe700 1 -- 172.21.15.191:0/3093801700 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f5f40019030 con 0x7f5f4c06dc00 2023-03-03T06:23:23.343 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.337+0000 7f5f337fe700 1 -- 172.21.15.191:0/3093801700 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f5f400067b0 con 0x7f5f4c06dc00 2023-03-03T06:23:23.344 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.338+0000 7f5f510ba700 1 -- 172.21.15.191:0/3093801700 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4c160fb0 con 0x7f5f4c06dc00 2023-03-03T06:23:23.344 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.340+0000 7f5f337fe700 1 -- 172.21.15.191:0/3093801700 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f5f40021060 con 0x7f5f4c06dc00 2023-03-03T06:23:23.414 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:23.413+0000 7fb25fb6a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-03-03T06:23:23.425 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.423+0000 7f5f510ba700 1 -- 172.21.15.191:0/3093801700 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "13d87455-2c5f-46d2-b0f7-b7f93df0556b", "id": 4} v 0) v1 -- 0x7f5f4c0ce9b0 con 0x7f5f4c06dc00 2023-03-03T06:23:23.428 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.426+0000 7f5f337fe700 1 -- 172.21.15.191:0/3093801700 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "13d87455-2c5f-46d2-b0f7-b7f93df0556b", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5f40017070 con 0x7f5f4c06dc00 2023-03-03T06:23:23.428 INFO:teuthology.orchestra.run.smithi191.stdout:4 2023-03-03T06:23:23.429 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.427+0000 7f5f510ba700 1 -- 172.21.15.191:0/3093801700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 msgr2=0x7f5f4c0c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.429 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.427+0000 7f5f510ba700 1 --2- 172.21.15.191:0/3093801700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 0x7f5f4c0c77e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000ebe0 tx=0x7f5f4000eef0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.429 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.427+0000 7f5f510ba700 1 -- 172.21.15.191:0/3093801700 shutdown_connections 2023-03-03T06:23:23.429 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.427+0000 7f5f510ba700 1 --2- 172.21.15.191:0/3093801700 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f4c15cbf0 0x7f5f4c15af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.430 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.427+0000 7f5f510ba700 1 --2- 172.21.15.191:0/3093801700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f4c06b320 0x7f5f4c1574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.430 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.427+0000 7f5f510ba700 1 --2- 172.21.15.191:0/3093801700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f4c06dc00 0x7f5f4c0c77e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.430 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.427+0000 7f5f510ba700 1 -- 172.21.15.191:0/3093801700 >> 172.21.15.191:0/3093801700 conn(0x7f5f4c0cfd00 msgr2=0x7f5f4c0cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:23.430 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.427+0000 7f5f510ba700 1 -- 172.21.15.191:0/3093801700 shutdown_connections 2023-03-03T06:23:23.430 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.427+0000 7f5f510ba700 1 -- 172.21.15.191:0/3093801700 wait complete. 2023-03-03T06:23:23.441 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new b342359e-e495-4668-9f25-bf6e1f7d878b 5 2023-03-03T06:23:23.558 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:23.556+0000 7fb25fb6a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-03-03T06:23:23.601 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.599+0000 7fe0cd101700 1 Processor -- start 2023-03-03T06:23:23.602 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.600+0000 7fe0cd101700 1 -- start start 2023-03-03T06:23:23.603 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0cd101700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0c80b1fe0 0x7fe0c815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.603 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0cd101700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c80cc5d0 con 0x7fe0c80b55b0 2023-03-03T06:23:23.603 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0cd101700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c8159c30 con 0x7fe0c80cd500 2023-03-03T06:23:23.604 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0cd101700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c815e290 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.604 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0c659c700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fe0c80cd500 0x7fe0c80cdf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:46696/0 (socket says 172.21.15.191:46696) 2023-03-03T06:23:23.604 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0c659c700 1 -- 172.21.15.191:0/3884735098 learned_addr learned my addr 172.21.15.191:0/3884735098 (peer_addr_for_me v1:172.21.15.191:0/0) 2023-03-03T06:23:23.604 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0c759e700 1 --2- 172.21.15.191:0/3884735098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0c80b1fe0 0x7fe0c815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.604 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0c5d9b700 1 -- 172.21.15.191:0/3884735098 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990787505 0 0) 0x7fe0c8159c30 con 0x7fe0c80cd500 2023-03-03T06:23:23.604 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0c759e700 1 -- 172.21.15.191:0/3884735098 >> v1:172.21.15.191:6789/0 conn(0x7fe0c80cd500 legacy=0x7fe0c80cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.604 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0c759e700 1 -- 172.21.15.191:0/3884735098 >> v1:172.21.15.5:6789/0 conn(0x7fe0c80b55b0 legacy=0x7fe0c80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.604 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0c759e700 1 -- 172.21.15.191:0/3884735098 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c80b5980 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.605 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0c759e700 1 --2- 172.21.15.191:0/3884735098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0c80b1fe0 0x7fe0c815dd50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009dc0 tx=0x7fe0c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67a35bfe0d4d43f9 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:23.605 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0c5d9b700 1 -- 172.21.15.191:0/3884735098 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c000e070 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.605 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0c5d9b700 1 -- 172.21.15.191:0/3884735098 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c000bad0 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.605 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.601+0000 7fe0c5d9b700 1 -- 172.21.15.191:0/3884735098 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c000be80 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.606 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.602+0000 7fe0cd101700 1 -- 172.21.15.191:0/3884735098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0c80b1fe0 msgr2=0x7fe0c815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.606 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.602+0000 7fe0cd101700 1 --2- 172.21.15.191:0/3884735098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0c80b1fe0 0x7fe0c815dd50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009dc0 tx=0x7fe0c000b330 comp rx=0 tx=0).stop 2023-03-03T06:23:23.606 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.602+0000 7fe0cd101700 1 -- 172.21.15.191:0/3884735098 shutdown_connections 2023-03-03T06:23:23.606 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.602+0000 7fe0cd101700 1 --2- 172.21.15.191:0/3884735098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0c80b1fe0 0x7fe0c815dd50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.607 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.602+0000 7fe0cd101700 1 -- 172.21.15.191:0/3884735098 >> 172.21.15.191:0/3884735098 conn(0x7fe0c80cc8d0 msgr2=0x7fe0c80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:23.607 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.602+0000 7fe0cd101700 1 -- 172.21.15.191:0/3884735098 shutdown_connections 2023-03-03T06:23:23.607 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.602+0000 7fe0cd101700 1 -- 172.21.15.191:0/3884735098 wait complete. 2023-03-03T06:23:23.607 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.604+0000 7fe0cd101700 1 Processor -- start 2023-03-03T06:23:23.607 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.604+0000 7fe0cd101700 1 -- start start 2023-03-03T06:23:23.609 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0cd101700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0c80b1fe0 0x7fe0c815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.609 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0cd101700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0c80b55b0 0x7fe0c815a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.609 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0cd101700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c80cd500 0x7fe0c81581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.610 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0cd101700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c815c3d0 con 0x7fe0c80cd500 2023-03-03T06:23:23.610 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0cd101700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c815b500 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.610 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0cd101700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c815cd30 con 0x7fe0c80b55b0 2023-03-03T06:23:23.610 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0c659c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0c80b55b0 0x7fe0c815a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.610 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0c6d9d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0c80b1fe0 0x7fe0c815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0c659c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0c80b55b0 0x7fe0c815a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:47006/0 (socket says 172.21.15.191:47006) 2023-03-03T06:23:23.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0c659c700 1 -- 172.21.15.191:0/1377075508 learned_addr learned my addr 172.21.15.191:0/1377075508 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-03T06:23:23.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0c759e700 1 --2- 172.21.15.191:0/1377075508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c80cd500 0x7fe0c81581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0c6d9d700 1 -- 172.21.15.191:0/1377075508 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0c80b55b0 msgr2=0x7fe0c815a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.611 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0c6d9d700 1 --2- 172.21.15.191:0/1377075508 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0c80b55b0 0x7fe0c815a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.612 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0c6d9d700 1 -- 172.21.15.191:0/1377075508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c80cd500 msgr2=0x7fe0c81581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.612 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0c6d9d700 1 --2- 172.21.15.191:0/1377075508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c80cd500 0x7fe0c81581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.612 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0c6d9d700 1 -- 172.21.15.191:0/1377075508 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0009a70 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.613 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.605+0000 7fe0c659c700 1 --2- 172.21.15.191:0/1377075508 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0c80b55b0 0x7fe0c815a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:23.613 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.606+0000 7fe0c6d9d700 1 --2- 172.21.15.191:0/1377075508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0c80b1fe0 0x7fe0c815c7f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800c750 tx=0x7fe0b800ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:23.613 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.606+0000 7fe0af7fe700 1 -- 172.21.15.191:0/1377075508 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80054e0 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.613 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.606+0000 7fe0af7fe700 1 -- 172.21.15.191:0/1377075508 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b8003680 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.613 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.606+0000 7fe0cd101700 1 -- 172.21.15.191:0/1377075508 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c80cbca0 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.614 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.606+0000 7fe0af7fe700 1 -- 172.21.15.191:0/1377075508 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8003a30 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.614 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.606+0000 7fe0cd101700 1 -- 172.21.15.191:0/1377075508 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c80cb9c0 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.614 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.606+0000 7fe0af7fe700 1 -- 172.21.15.191:0/1377075508 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fe0b8019030 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.614 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.606+0000 7fe0af7fe700 1 -- 172.21.15.191:0/1377075508 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fe0b801b930 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.614 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.607+0000 7fe0cd101700 1 -- 172.21.15.191:0/1377075508 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c80cbf80 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.615 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:23.611+0000 7fa70143c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-03T06:23:23.615 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.609+0000 7fe0af7fe700 1 -- 172.21.15.191:0/1377075508 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fe0b8017070 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.695 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.693+0000 7fe0cd101700 1 -- 172.21.15.191:0/1377075508 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b342359e-e495-4668-9f25-bf6e1f7d878b", "id": 5} v 0) v1 -- 0x7fe0c804e6e0 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.704 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.702+0000 7fe0af7fe700 1 -- 172.21.15.191:0/1377075508 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b342359e-e495-4668-9f25-bf6e1f7d878b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe0b8003b90 con 0x7fe0c80b1fe0 2023-03-03T06:23:23.705 INFO:teuthology.orchestra.run.smithi191.stdout:5 2023-03-03T06:23:23.707 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.703+0000 7fe0cd101700 1 -- 172.21.15.191:0/1377075508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0c80b1fe0 msgr2=0x7fe0c815c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.707 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.703+0000 7fe0cd101700 1 --2- 172.21.15.191:0/1377075508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0c80b1fe0 0x7fe0c815c7f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800c750 tx=0x7fe0b800ca60 comp rx=0 tx=0).stop 2023-03-03T06:23:23.707 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.703+0000 7fe0cd101700 1 -- 172.21.15.191:0/1377075508 shutdown_connections 2023-03-03T06:23:23.708 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.703+0000 7fe0cd101700 1 --2- 172.21.15.191:0/1377075508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c80cd500 0x7fe0c81581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.708 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.703+0000 7fe0cd101700 1 --2- 172.21.15.191:0/1377075508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0c80b1fe0 0x7fe0c815c7f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.708 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.703+0000 7fe0cd101700 1 --2- 172.21.15.191:0/1377075508 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0c80b55b0 0x7fe0c815a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.708 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.703+0000 7fe0cd101700 1 -- 172.21.15.191:0/1377075508 >> 172.21.15.191:0/1377075508 conn(0x7fe0c80cc8d0 msgr2=0x7fe0c80b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:23.709 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.703+0000 7fe0cd101700 1 -- 172.21.15.191:0/1377075508 shutdown_connections 2023-03-03T06:23:23.709 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.703+0000 7fe0cd101700 1 -- 172.21.15.191:0/1377075508 wait complete. 2023-03-03T06:23:23.717 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 2bdd211e-4f39-42c0-bf51-3fe2c94029ac 6 2023-03-03T06:23:23.840 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.838+0000 7f2f3b1ae700 1 Processor -- start 2023-03-03T06:23:23.840 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.838+0000 7f2f3b1ae700 1 -- start start 2023-03-03T06:23:23.844 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.838+0000 7f2f3b1ae700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f340cb420 0x7f2f340cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.845 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.839+0000 7f2f3b1ae700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3415d020 con 0x7f2f3415c950 2023-03-03T06:23:23.845 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.839+0000 7f2f3b1ae700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3415cd20 con 0x7f2f3415d4b0 2023-03-03T06:23:23.845 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.839+0000 7f2f3b1ae700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f340b2bf0 con 0x7f2f340cb420 2023-03-03T06:23:23.845 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.839+0000 7f2f3974b700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f2f3415d4b0 0x7f2f340ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:46708/0 (socket says 172.21.15.191:46708) 2023-03-03T06:23:23.845 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.839+0000 7f2f3974b700 1 -- 172.21.15.191:0/2900875263 learned_addr learned my addr 172.21.15.191:0/2900875263 (peer_addr_for_me v1:172.21.15.191:0/0) 2023-03-03T06:23:23.845 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.839+0000 7f2f33fff700 1 --2- 172.21.15.191:0/2900875263 >> v2:172.21.15.5:3300/0 conn(0x7f2f340cb420 0x7f2f340cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.845 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.839+0000 7f2f337fe700 1 -- 172.21.15.191:0/2900875263 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968239516 0 0) 0x7f2f3415cd20 con 0x7f2f3415d4b0 2023-03-03T06:23:23.846 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.839+0000 7f2f337fe700 1 -- 172.21.15.191:0/2900875263 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f240035b0 con 0x7f2f3415d4b0 2023-03-03T06:23:23.846 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.839+0000 7f2f337fe700 1 -- 172.21.15.191:0/2900875263 <== mon.1 v1:172.21.15.191:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1587183089 0 0) 0x7f2f240035b0 con 0x7f2f3415d4b0 2023-03-03T06:23:23.846 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.839+0000 7f2f33fff700 1 -- 172.21.15.191:0/2900875263 >> v1:172.21.15.191:6789/0 conn(0x7f2f3415d4b0 legacy=0x7f2f340ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.846 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.839+0000 7f2f33fff700 1 -- 172.21.15.191:0/2900875263 >> v1:172.21.15.5:6789/0 conn(0x7f2f3415c950 legacy=0x7f2f34160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.846 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.839+0000 7f2f33fff700 1 -- 172.21.15.191:0/2900875263 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340b2ed0 con 0x7f2f340cb420 2023-03-03T06:23:23.846 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.839+0000 7f2f33fff700 1 --2- 172.21.15.191:0/2900875263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f340cb420 0x7f2f340cb890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009840 tx=0x7f2f20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576f96b66062548a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:23.846 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.840+0000 7f2f337fe700 1 -- 172.21.15.191:0/2900875263 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c0019f0 con 0x7f2f340cb420 2023-03-03T06:23:23.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.840+0000 7f2f337fe700 1 -- 172.21.15.191:0/2900875263 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f20004030 con 0x7f2f340cb420 2023-03-03T06:23:23.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.840+0000 7f2f337fe700 1 -- 172.21.15.191:0/2900875263 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f200043c0 con 0x7f2f340cb420 2023-03-03T06:23:23.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.840+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/2900875263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f340cb420 msgr2=0x7f2f340cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.840+0000 7f2f3b1ae700 1 --2- 172.21.15.191:0/2900875263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f340cb420 0x7f2f340cb890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009840 tx=0x7f2f20009b50 comp rx=0 tx=0).stop 2023-03-03T06:23:23.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.840+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/2900875263 shutdown_connections 2023-03-03T06:23:23.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.840+0000 7f2f3b1ae700 1 --2- 172.21.15.191:0/2900875263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f340cb420 0x7f2f340cb890 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.840+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/2900875263 >> 172.21.15.191:0/2900875263 conn(0x7f2f34070010 msgr2=0x7f2f340cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:23.847 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.840+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/2900875263 shutdown_connections 2023-03-03T06:23:23.848 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.840+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/2900875263 wait complete. 2023-03-03T06:23:23.848 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.842+0000 7f2f3b1ae700 1 Processor -- start 2023-03-03T06:23:23.848 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.842+0000 7f2f3b1ae700 1 -- start start 2023-03-03T06:23:23.850 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.844+0000 7f2f3b1ae700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f340cb420 0x7f2f341f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.850 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.844+0000 7f2f3b1ae700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f3415c950 0x7f2f341f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.850 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.844+0000 7f2f3b1ae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f3415d4b0 0x7f2f341551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:23.850 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.844+0000 7f2f3b1ae700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f34152e30 con 0x7f2f3415d4b0 2023-03-03T06:23:23.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.844+0000 7f2f3b1ae700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340c7430 con 0x7f2f340cb420 2023-03-03T06:23:23.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.844+0000 7f2f3b1ae700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f34152520 con 0x7f2f3415c950 2023-03-03T06:23:23.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.844+0000 7f2f33fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f3415c950 0x7f2f341f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.844+0000 7f2f33fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f3415c950 0x7f2f341f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:47016/0 (socket says 172.21.15.191:47016) 2023-03-03T06:23:23.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.844+0000 7f2f33fff700 1 -- 172.21.15.191:0/3129913395 learned_addr learned my addr 172.21.15.191:0/3129913395 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-03T06:23:23.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.844+0000 7f2f38f4a700 1 --2- 172.21.15.191:0/3129913395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f340cb420 0x7f2f341f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.851 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.844+0000 7f2f3974b700 1 --2- 172.21.15.191:0/3129913395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f3415d4b0 0x7f2f341551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:23.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f33fff700 1 -- 172.21.15.191:0/3129913395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f340cb420 msgr2=0x7f2f341f3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f33fff700 1 --2- 172.21.15.191:0/3129913395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f340cb420 0x7f2f341f3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f33fff700 1 -- 172.21.15.191:0/3129913395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f3415d4b0 msgr2=0x7f2f341551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f33fff700 1 --2- 172.21.15.191:0/3129913395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f3415d4b0 0x7f2f341551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f33fff700 1 -- 172.21.15.191:0/3129913395 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200094a0 con 0x7f2f3415c950 2023-03-03T06:23:23.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f38f4a700 1 --2- 172.21.15.191:0/3129913395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f340cb420 0x7f2f341f3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:23.852 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f33fff700 1 --2- 172.21.15.191:0/3129913395 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f3415c950 0x7f2f341f5400 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2f340cd490 tx=0x7f2f20004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:23.853 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f317fa700 1 -- 172.21.15.191:0/3129913395 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f200045b0 con 0x7f2f3415c950 2023-03-03T06:23:23.853 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f317fa700 1 -- 172.21.15.191:0/3129913395 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f20010590 con 0x7f2f3415c950 2023-03-03T06:23:23.853 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/3129913395 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f340b0520 con 0x7f2f3415c950 2023-03-03T06:23:23.853 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f317fa700 1 -- 172.21.15.191:0/3129913395 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20010960 con 0x7f2f3415c950 2023-03-03T06:23:23.853 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/3129913395 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f340b31b0 con 0x7f2f3415c950 2023-03-03T06:23:23.853 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f317fa700 1 -- 172.21.15.191:0/3129913395 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f2f2000f050 con 0x7f2f3415c950 2023-03-03T06:23:23.853 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.845+0000 7f2f317fa700 1 -- 172.21.15.191:0/3129913395 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f2f2001ca10 con 0x7f2f3415c950 2023-03-03T06:23:23.853 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.846+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/3129913395 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f340b2850 con 0x7f2f3415c950 2023-03-03T06:23:23.854 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.848+0000 7f2f317fa700 1 -- 172.21.15.191:0/3129913395 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f2f20020070 con 0x7f2f3415c950 2023-03-03T06:23:23.932 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.931+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/3129913395 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2bdd211e-4f39-42c0-bf51-3fe2c94029ac", "id": 6} v 0) v1 -- 0x7f2f34152f70 con 0x7f2f3415c950 2023-03-03T06:23:23.940 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.938+0000 7f2f317fa700 1 -- 172.21.15.191:0/3129913395 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2bdd211e-4f39-42c0-bf51-3fe2c94029ac", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2f34152f70 con 0x7f2f3415c950 2023-03-03T06:23:23.940 INFO:teuthology.orchestra.run.smithi191.stdout:6 2023-03-03T06:23:23.941 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.939+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/3129913395 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f3415c950 msgr2=0x7f2f341f5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:23.941 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.939+0000 7f2f3b1ae700 1 --2- 172.21.15.191:0/3129913395 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f3415c950 0x7f2f341f5400 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2f340cd490 tx=0x7f2f20004750 comp rx=0 tx=0).stop 2023-03-03T06:23:23.942 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.939+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/3129913395 shutdown_connections 2023-03-03T06:23:23.942 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.939+0000 7f2f3b1ae700 1 --2- 172.21.15.191:0/3129913395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f3415d4b0 0x7f2f341551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.942 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.939+0000 7f2f3b1ae700 1 --2- 172.21.15.191:0/3129913395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f340cb420 0x7f2f341f3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.942 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.939+0000 7f2f3b1ae700 1 --2- 172.21.15.191:0/3129913395 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f3415c950 0x7f2f341f5400 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:23.942 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.940+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/3129913395 >> 172.21.15.191:0/3129913395 conn(0x7f2f34070010 msgr2=0x7f2f3406c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:23.942 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.940+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/3129913395 shutdown_connections 2023-03-03T06:23:23.942 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:23.940+0000 7f2f3b1ae700 1 -- 172.21.15.191:0/3129913395 wait complete. 2023-03-03T06:23:23.953 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new c53926ae-653b-41ec-84a5-4156012714a5 7 2023-03-03T06:23:23.968 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:23.967+0000 7fb25fb6a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-03-03T06:23:24.074 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.072+0000 7fe2ccaf5700 1 Processor -- start 2023-03-03T06:23:24.074 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.072+0000 7fe2ccaf5700 1 -- start start 2023-03-03T06:23:24.076 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2ccaf5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe2c806e310 0x7fe2c80cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:24.076 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2ccaf5700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe2c80cf010 0x7fe2c80cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:24.076 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2ccaf5700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c815e110 con 0x7fe2c806d130 2023-03-03T06:23:24.077 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2ccaf5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c80cf720 con 0x7fe2c806e310 2023-03-03T06:23:24.077 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2ccaf5700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c815d350 con 0x7fe2c80cf010 2023-03-03T06:23:24.077 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2c659c700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fe2c806d130 0x7fe2c806dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:46716/0 (socket says 172.21.15.191:46716) 2023-03-03T06:23:24.077 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2c6d9d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe2c80cf010 0x7fe2c80cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:24.077 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2c659c700 1 -- 172.21.15.191:0/2168989034 learned_addr learned my addr 172.21.15.191:0/2168989034 (peer_addr_for_me v1:172.21.15.191:0/0) 2023-03-03T06:23:24.077 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2c5d9b700 1 --2- 172.21.15.191:0/2168989034 >> v2:172.21.15.5:3300/0 conn(0x7fe2c806e310 0x7fe2c80cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:24.077 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2c6d9d700 1 -- 172.21.15.191:0/2168989034 >> v2:172.21.15.5:3300/0 conn(0x7fe2c806e310 msgr2=0x7fe2c80cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:24.078 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2c6d9d700 1 --2- 172.21.15.191:0/2168989034 >> v2:172.21.15.5:3300/0 conn(0x7fe2c806e310 0x7fe2c80cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.078 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2c6d9d700 1 -- 172.21.15.191:0/2168989034 >> v1:172.21.15.191:6789/0 conn(0x7fe2c806d130 legacy=0x7fe2c806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:24.078 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2c6d9d700 1 -- 172.21.15.191:0/2168989034 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c815d630 con 0x7fe2c80cf010 2023-03-03T06:23:24.078 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2c559a700 1 -- 172.21.15.191:0/2168989034 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759604787 0 0) 0x7fe2c815e110 con 0x7fe2c806d130 2023-03-03T06:23:24.078 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2c6d9d700 1 --2- 172.21.15.191:0/2168989034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c80cf010 0x7fe2c80cb260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80718c0 tx=0x7fe2c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f22c10768d2d304c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:24.078 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2c559a700 1 -- 172.21.15.191:0/2168989034 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000e070 con 0x7fe2c80cf010 2023-03-03T06:23:24.078 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2c559a700 1 -- 172.21.15.191:0/2168989034 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c000bbd0 con 0x7fe2c80cf010 2023-03-03T06:23:24.078 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.074+0000 7fe2c559a700 1 -- 172.21.15.191:0/2168989034 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0012430 con 0x7fe2c80cf010 2023-03-03T06:23:24.081 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.075+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/2168989034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c80cf010 msgr2=0x7fe2c80cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:24.081 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.075+0000 7fe2ccaf5700 1 --2- 172.21.15.191:0/2168989034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c80cf010 0x7fe2c80cb260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80718c0 tx=0x7fe2c000b330 comp rx=0 tx=0).stop 2023-03-03T06:23:24.081 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.075+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/2168989034 shutdown_connections 2023-03-03T06:23:24.081 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.075+0000 7fe2ccaf5700 1 --2- 172.21.15.191:0/2168989034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c80cf010 0x7fe2c80cb260 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.081 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.075+0000 7fe2ccaf5700 1 --2- 172.21.15.191:0/2168989034 >> v2:172.21.15.5:3300/0 conn(0x7fe2c806e310 0x7fe2c80cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.081 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.075+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/2168989034 >> 172.21.15.191:0/2168989034 conn(0x7fe2c80cfd00 msgr2=0x7fe2c80d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:24.081 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.075+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/2168989034 shutdown_connections 2023-03-03T06:23:24.082 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.075+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/2168989034 wait complete. 2023-03-03T06:23:24.082 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.077+0000 7fe2ccaf5700 1 Processor -- start 2023-03-03T06:23:24.082 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.077+0000 7fe2ccaf5700 1 -- start start 2023-03-03T06:23:24.082 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2ccaf5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c806d130 0x7fe2c8157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:24.082 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2ccaf5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2c806e310 0x7fe2c80c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:24.082 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2ccaf5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2c80cf010 0x7fe2c81efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:24.082 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2ccaf5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8156ec0 con 0x7fe2c806e310 2023-03-03T06:23:24.083 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2ccaf5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c80c9da0 con 0x7fe2c806d130 2023-03-03T06:23:24.083 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2ccaf5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c81572e0 con 0x7fe2c80cf010 2023-03-03T06:23:24.083 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2c659c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c806d130 0x7fe2c8157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:24.083 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2c659c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c806d130 0x7fe2c8157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:52898/0 (socket says 172.21.15.191:52898) 2023-03-03T06:23:24.083 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2c659c700 1 -- 172.21.15.191:0/632625860 learned_addr learned my addr 172.21.15.191:0/632625860 (peer_addr_for_me v2:172.21.15.191:0/0) 2023-03-03T06:23:24.083 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2c6d9d700 1 --2- 172.21.15.191:0/632625860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2c80cf010 0x7fe2c81efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:24.083 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2c5d9b700 1 --2- 172.21.15.191:0/632625860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2c806e310 0x7fe2c80c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:24.083 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2c659c700 1 -- 172.21.15.191:0/632625860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2c80cf010 msgr2=0x7fe2c81efbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:24.084 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2c659c700 1 --2- 172.21.15.191:0/632625860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2c80cf010 0x7fe2c81efbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.084 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2c659c700 1 -- 172.21.15.191:0/632625860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2c806e310 msgr2=0x7fe2c80c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:24.084 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2c659c700 1 --2- 172.21.15.191:0/632625860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2c806e310 0x7fe2c80c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.084 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2c659c700 1 -- 172.21.15.191:0/632625860 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c0009a70 con 0x7fe2c806d130 2023-03-03T06:23:24.084 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.078+0000 7fe2c659c700 1 --2- 172.21.15.191:0/632625860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c806d130 0x7fe2c8157d90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c750 tx=0x7fe2b800ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:24.084 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.079+0000 7fe2b6ffd700 1 -- 172.21.15.191:0/632625860 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8004c80 con 0x7fe2c806d130 2023-03-03T06:23:24.084 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.079+0000 7fe2b6ffd700 1 -- 172.21.15.191:0/632625860 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b8004e00 con 0x7fe2c806d130 2023-03-03T06:23:24.085 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.079+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/632625860 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c815dbf0 con 0x7fe2c806d130 2023-03-03T06:23:24.085 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.079+0000 7fe2b6ffd700 1 -- 172.21.15.191:0/632625860 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8007310 con 0x7fe2c806d130 2023-03-03T06:23:24.085 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.079+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/632625860 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c815d910 con 0x7fe2c806d130 2023-03-03T06:23:24.085 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.079+0000 7fe2b6ffd700 1 -- 172.21.15.191:0/632625860 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fe2b801a020 con 0x7fe2c806d130 2023-03-03T06:23:24.085 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.079+0000 7fe2b6ffd700 1 -- 172.21.15.191:0/632625860 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fe2b8013a20 con 0x7fe2c806d130 2023-03-03T06:23:24.086 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.079+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/632625860 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c80cf420 con 0x7fe2c806d130 2023-03-03T06:23:24.086 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.083+0000 7fe2b6ffd700 1 -- 172.21.15.191:0/632625860 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fe2b8013d30 con 0x7fe2c806d130 2023-03-03T06:23:24.168 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.166+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/632625860 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c53926ae-653b-41ec-84a5-4156012714a5", "id": 7} v 0) v1 -- 0x7fe2c806d840 con 0x7fe2c806d130 2023-03-03T06:23:24.178 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.177+0000 7fe2b6ffd700 1 -- 172.21.15.191:0/632625860 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c53926ae-653b-41ec-84a5-4156012714a5", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe2b801d3f0 con 0x7fe2c806d130 2023-03-03T06:23:24.179 INFO:teuthology.orchestra.run.smithi191.stdout:7 2023-03-03T06:23:24.180 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.178+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/632625860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c806d130 msgr2=0x7fe2c8157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:24.180 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.178+0000 7fe2ccaf5700 1 --2- 172.21.15.191:0/632625860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c806d130 0x7fe2c8157d90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800c750 tx=0x7fe2b800ca60 comp rx=0 tx=0).stop 2023-03-03T06:23:24.180 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.178+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/632625860 shutdown_connections 2023-03-03T06:23:24.180 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.178+0000 7fe2ccaf5700 1 --2- 172.21.15.191:0/632625860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe2c80cf010 0x7fe2c81efbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.180 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.178+0000 7fe2ccaf5700 1 --2- 172.21.15.191:0/632625860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe2c806d130 0x7fe2c8157d90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.181 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.178+0000 7fe2ccaf5700 1 --2- 172.21.15.191:0/632625860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2c806e310 0x7fe2c80c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.181 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.178+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/632625860 >> 172.21.15.191:0/632625860 conn(0x7fe2c80cfd00 msgr2=0x7fe2c81561e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:24.181 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.178+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/632625860 shutdown_connections 2023-03-03T06:23:24.181 INFO:teuthology.orchestra.run.smithi191.stderr:2023-03-03T06:23:24.178+0000 7fe2ccaf5700 1 -- 172.21.15.191:0/632625860 wait complete. 2023-03-03T06:23:24.192 INFO:tasks.ceph.osd.0:Restarting daemon 2023-03-03T06:23:24.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-03-03T06:23:24.194 INFO:tasks.ceph.osd.0:Started 2023-03-03T06:23:24.195 INFO:tasks.ceph.osd.1:Restarting daemon 2023-03-03T06:23:24.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-03-03T06:23:24.197 INFO:tasks.ceph.osd.1:Started 2023-03-03T06:23:24.197 INFO:tasks.ceph.osd.2:Restarting daemon 2023-03-03T06:23:24.197 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-03-03T06:23:24.202 INFO:tasks.ceph.osd.2:Started 2023-03-03T06:23:24.202 INFO:tasks.ceph.osd.3:Restarting daemon 2023-03-03T06:23:24.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-03-03T06:23:24.205 INFO:tasks.ceph.osd.3:Started 2023-03-03T06:23:24.205 INFO:tasks.ceph.osd.4:Restarting daemon 2023-03-03T06:23:24.205 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-03-03T06:23:24.227 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:24.225+0000 7fa70143c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-03T06:23:24.234 INFO:tasks.ceph.osd.4:Started 2023-03-03T06:23:24.235 INFO:tasks.ceph.osd.5:Restarting daemon 2023-03-03T06:23:24.236 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-03-03T06:23:24.238 INFO:tasks.ceph.osd.5:Started 2023-03-03T06:23:24.238 INFO:tasks.ceph.osd.6:Restarting daemon 2023-03-03T06:23:24.238 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-03-03T06:23:24.240 INFO:tasks.ceph.osd.6:Started 2023-03-03T06:23:24.241 INFO:tasks.ceph.osd.7:Restarting daemon 2023-03-03T06:23:24.241 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-03-03T06:23:24.243 INFO:tasks.ceph.osd.7:Started 2023-03-03T06:23:24.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:23:24.326 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:24.324+0000 7fa70143c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-03T06:23:24.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.388+0000 7f5c14d09700 1 Processor -- start 2023-03-03T06:23:24.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.388+0000 7f5c14d09700 1 -- start start 2023-03-03T06:23:24.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.390+0000 7f5c14d09700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c101573f0 0x7f5c1015d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:24.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.390+0000 7f5c14d09700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c101577c0 con 0x7f5c100cc1a0 2023-03-03T06:23:24.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.390+0000 7f5c14d09700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c10159e60 con 0x7f5c100b18d0 2023-03-03T06:23:24.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.390+0000 7f5c14d09700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c100cd790 con 0x7f5c101573f0 2023-03-03T06:23:24.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.390+0000 7f5c0e59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c101573f0 0x7f5c1015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:24.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.390+0000 7f5c0dd9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5c100cc1a0 0x7f5c100cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58452/0 (socket says 172.21.15.5:58452) 2023-03-03T06:23:24.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.390+0000 7f5c0e59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5c101573f0 0x7f5c1015d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40378/0 (socket says 172.21.15.5:40378) 2023-03-03T06:23:24.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.390+0000 7f5c0dd9b700 1 -- 172.21.15.5:0/2327250898 learned_addr learned my addr 172.21.15.5:0/2327250898 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:24.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.390+0000 7f5c0e59c700 1 -- 172.21.15.5:0/2327250898 >> v1:172.21.15.191:6789/0 conn(0x7f5c100b18d0 legacy=0x7f5c100b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:24.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.390+0000 7f5c0e59c700 1 -- 172.21.15.5:0/2327250898 >> v1:172.21.15.5:6789/0 conn(0x7f5c100cc1a0 legacy=0x7f5c100cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:24.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.390+0000 7f5c0e59c700 1 -- 172.21.15.5:0/2327250898 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100ce460 con 0x7f5c101573f0 2023-03-03T06:23:24.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.390+0000 7f5c0d59a700 1 -- 172.21.15.5:0/2327250898 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270748649 0 0) 0x7f5c101577c0 con 0x7f5c100cc1a0 2023-03-03T06:23:24.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.391+0000 7f5c0e59c700 1 --2- 172.21.15.5:0/2327250898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c101573f0 0x7f5c1015d320 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009840 tx=0x7f5c00009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fdbfd176824e40 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:24.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.391+0000 7f5c0d59a700 1 -- 172.21.15.5:0/2327250898 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c00011830 con 0x7f5c101573f0 2023-03-03T06:23:24.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.391+0000 7f5c0d59a700 1 -- 172.21.15.5:0/2327250898 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c00011990 con 0x7f5c101573f0 2023-03-03T06:23:24.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.391+0000 7f5c0d59a700 1 -- 172.21.15.5:0/2327250898 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c00011d20 con 0x7f5c101573f0 2023-03-03T06:23:24.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.391+0000 7f5c14d09700 1 -- 172.21.15.5:0/2327250898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c101573f0 msgr2=0x7f5c1015d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:24.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.391+0000 7f5c14d09700 1 --2- 172.21.15.5:0/2327250898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c101573f0 0x7f5c1015d320 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009840 tx=0x7f5c00009b50 comp rx=0 tx=0).stop 2023-03-03T06:23:24.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.391+0000 7f5c14d09700 1 -- 172.21.15.5:0/2327250898 shutdown_connections 2023-03-03T06:23:24.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.391+0000 7f5c14d09700 1 --2- 172.21.15.5:0/2327250898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c101573f0 0x7f5c1015d320 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.391+0000 7f5c14d09700 1 -- 172.21.15.5:0/2327250898 >> 172.21.15.5:0/2327250898 conn(0x7f5c100cc8d0 msgr2=0x7f5c100cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:24.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.391+0000 7f5c14d09700 1 -- 172.21.15.5:0/2327250898 shutdown_connections 2023-03-03T06:23:24.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.391+0000 7f5c14d09700 1 -- 172.21.15.5:0/2327250898 wait complete. 2023-03-03T06:23:24.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.394+0000 7f5c14d09700 1 Processor -- start 2023-03-03T06:23:24.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.394+0000 7f5c14d09700 1 -- start start 2023-03-03T06:23:24.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c14d09700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5c100b18d0 0x7f5c100b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:24.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c14d09700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c100cc1a0 0x7f5c100c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:24.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c14d09700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c101573f0 0x7f5c101543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:24.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c14d09700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100c9960 con 0x7f5c101573f0 2023-03-03T06:23:24.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c14d09700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100c8e20 con 0x7f5c100cc1a0 2023-03-03T06:23:24.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c14d09700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100c90c0 con 0x7f5c100b18d0 2023-03-03T06:23:24.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c0ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c101573f0 0x7f5c101543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:24.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c0ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c101573f0 0x7f5c101543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40388/0 (socket says 172.21.15.5:40388) 2023-03-03T06:23:24.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c0ed9d700 1 -- 172.21.15.5:0/120081254 learned_addr learned my addr 172.21.15.5:0/120081254 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c0dd9b700 1 --2- 172.21.15.5:0/120081254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c100cc1a0 0x7f5c100c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c0ed9d700 1 -- 172.21.15.5:0/120081254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5c100b18d0 msgr2=0x7f5c100b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c0ed9d700 1 --2- 172.21.15.5:0/120081254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5c100b18d0 0x7f5c100b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c0ed9d700 1 -- 172.21.15.5:0/120081254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c100cc1a0 msgr2=0x7f5c100c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c0ed9d700 1 --2- 172.21.15.5:0/120081254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c100cc1a0 0x7f5c100c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.395+0000 7f5c0ed9d700 1 -- 172.21.15.5:0/120081254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c000094a0 con 0x7f5c101573f0 2023-03-03T06:23:24.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.396+0000 7f5c0ed9d700 1 --2- 172.21.15.5:0/120081254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c101573f0 0x7f5c101543a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800cc50 tx=0x7f5c0800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.396+0000 7f5bfeffd700 1 -- 172.21.15.5:0/120081254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08003c00 con 0x7f5c101573f0 2023-03-03T06:23:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.396+0000 7f5bfeffd700 1 -- 172.21.15.5:0/120081254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c08003d60 con 0x7f5c101573f0 2023-03-03T06:23:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.396+0000 7f5c14d09700 1 -- 172.21.15.5:0/120081254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1015dbe0 con 0x7f5c101573f0 2023-03-03T06:23:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.396+0000 7f5bfeffd700 1 -- 172.21.15.5:0/120081254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0800aba0 con 0x7f5c101573f0 2023-03-03T06:23:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.396+0000 7f5c14d09700 1 -- 172.21.15.5:0/120081254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1015d900 con 0x7f5c101573f0 2023-03-03T06:23:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.396+0000 7f5bfeffd700 1 -- 172.21.15.5:0/120081254 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f5c08010050 con 0x7f5c101573f0 2023-03-03T06:23:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.396+0000 7f5bfeffd700 1 -- 172.21.15.5:0/120081254 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5c08012af0 con 0x7f5c101573f0 2023-03-03T06:23:24.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.397+0000 7f5c14d09700 1 -- 172.21.15.5:0/120081254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1015dec0 con 0x7f5c101573f0 2023-03-03T06:23:24.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.399+0000 7f5bfeffd700 1 -- 172.21.15.5:0/120081254 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f5c08012df0 con 0x7f5c101573f0 2023-03-03T06:23:24.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.471+0000 7f5c14d09700 1 -- 172.21.15.5:0/120081254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c1004e6e0 con 0x7f5c101573f0 2023-03-03T06:23:24.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.471+0000 7f5bfeffd700 1 -- 172.21.15.5:0/120081254 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5c080124d0 con 0x7f5c101573f0 2023-03-03T06:23:24.474 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:24.474 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:24.168371+0000","last_up_change":"0.000000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:23:24.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.472+0000 7f5c14d09700 1 -- 172.21.15.5:0/120081254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c101573f0 msgr2=0x7f5c101543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:24.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.472+0000 7f5c14d09700 1 --2- 172.21.15.5:0/120081254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c101573f0 0x7f5c101543a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800cc50 tx=0x7f5c0800cf60 comp rx=0 tx=0).stop 2023-03-03T06:23:24.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.472+0000 7f5c14d09700 1 -- 172.21.15.5:0/120081254 shutdown_connections 2023-03-03T06:23:24.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.472+0000 7f5c14d09700 1 --2- 172.21.15.5:0/120081254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c101573f0 0x7f5c101543a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.472+0000 7f5c14d09700 1 --2- 172.21.15.5:0/120081254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5c100b18d0 0x7f5c100b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.472+0000 7f5c14d09700 1 --2- 172.21.15.5:0/120081254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5c100cc1a0 0x7f5c100c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:24.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.472+0000 7f5c14d09700 1 -- 172.21.15.5:0/120081254 >> 172.21.15.5:0/120081254 conn(0x7f5c100cc8d0 msgr2=0x7f5c100ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:24.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.472+0000 7f5c14d09700 1 -- 172.21.15.5:0/120081254 shutdown_connections 2023-03-03T06:23:24.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:24.472+0000 7f5c14d09700 1 -- 172.21.15.5:0/120081254 wait complete. 2023-03-03T06:23:24.491 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-03-03T06:23:24.492 INFO:tasks.ceph:Waiting for OSDs to come up 2023-03-03T06:23:24.567 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:24.565+0000 7fb25fb6a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-03-03T06:23:24.637 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:24.635+0000 7fb25fb6a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-03-03T06:23:24.819 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-03-03T06:23:24.817+0000 7f539f045640 -1 Falling back to public interface 2023-03-03T06:23:24.822 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-03-03T06:23:24.820+0000 7fe90edd1640 -1 Falling back to public interface 2023-03-03T06:23:24.829 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-03-03T06:23:24.827+0000 7fe7ad9aa640 -1 Falling back to public interface 2023-03-03T06:23:24.830 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-03-03T06:23:24.827+0000 7fd02b132640 -1 Falling back to public interface 2023-03-03T06:23:24.830 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-03-03T06:23:24.827+0000 7fd0224f0700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2023-03-03T06:23:24.858 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-03T06:23:24.856+0000 7f8b8b9fc640 -1 Falling back to public interface 2023-03-03T06:23:24.864 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-03T06:23:24.862+0000 7f9ea98a1640 -1 Falling back to public interface 2023-03-03T06:23:24.864 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-03T06:23:24.862+0000 7f3b5a6de640 -1 Falling back to public interface 2023-03-03T06:23:24.866 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-03T06:23:24.864+0000 7f9ea0c5f700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6820/0: (98) Address already in use 2023-03-03T06:23:24.873 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-03T06:23:24.871+0000 7f33b2cb4640 -1 Falling back to public interface 2023-03-03T06:23:25.057 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:25.055+0000 7fa70143c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-03T06:23:25.139 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:25.137+0000 7fa70143c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-03T06:23:25.285 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:25.283+0000 7fa70143c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-03T06:23:25.298 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-03T06:23:25.314 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:25.312+0000 7fb25fb6a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-03-03T06:23:25.391 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:25.389+0000 7fb25fb6a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-03-03T06:23:25.415 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.413+0000 7f7326efd700 1 Processor -- start 2023-03-03T06:23:25.415 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.413+0000 7f7326efd700 1 -- start start 2023-03-03T06:23:25.416 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.413+0000 7f7326efd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f732015ad20 0x7f73200cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:25.417 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.413+0000 7f7326efd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73200cb0d0 con 0x7f73200cc130 2023-03-03T06:23:25.417 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.414+0000 7f7326efd700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732006bba0 con 0x7f732015a950 2023-03-03T06:23:25.417 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.414+0000 7f7326efd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732006be80 con 0x7f732015ad20 2023-03-03T06:23:25.417 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.414+0000 7f732549a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f73200cc130 0x7f73200b18b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58468/0 (socket says 172.21.15.5:58468) 2023-03-03T06:23:25.417 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.414+0000 7f732549a700 1 -- 172.21.15.5:0/2454993605 learned_addr learned my addr 172.21.15.5:0/2454993605 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:25.417 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.414+0000 7f731ffff700 1 --2- 172.21.15.5:0/2454993605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f732015ad20 0x7f73200cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:25.417 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.414+0000 7f731f7fe700 1 -- 172.21.15.5:0/2454993605 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737333708 0 0) 0x7f73200cb0d0 con 0x7f73200cc130 2023-03-03T06:23:25.418 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.414+0000 7f731f7fe700 1 -- 172.21.15.5:0/2454993605 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73100035b0 con 0x7f73200cc130 2023-03-03T06:23:25.418 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.414+0000 7f731f7fe700 1 -- 172.21.15.5:0/2454993605 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544811536 0 0) 0x7f732006bba0 con 0x7f732015a950 2023-03-03T06:23:25.418 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.414+0000 7f731f7fe700 1 -- 172.21.15.5:0/2454993605 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73200cb0d0 con 0x7f732015a950 2023-03-03T06:23:25.418 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.414+0000 7f731ffff700 1 -- 172.21.15.5:0/2454993605 >> v1:172.21.15.191:6789/0 conn(0x7f732015a950 legacy=0x7f732015f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:25.418 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.414+0000 7f731ffff700 1 -- 172.21.15.5:0/2454993605 >> v1:172.21.15.5:6789/0 conn(0x7f73200cc130 legacy=0x7f73200b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:25.418 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.414+0000 7f731ffff700 1 -- 172.21.15.5:0/2454993605 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732006c160 con 0x7f732015ad20 2023-03-03T06:23:25.418 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.414+0000 7f731ffff700 1 --2- 172.21.15.5:0/2454993605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f732015ad20 0x7f73200cbbf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f730c009870 tx=0x7f730c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c91aaca4c826396 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:25.419 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.415+0000 7f731f7fe700 1 -- 172.21.15.5:0/2454993605 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c011830 con 0x7f732015ad20 2023-03-03T06:23:25.419 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.415+0000 7f731f7fe700 1 -- 172.21.15.5:0/2454993605 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c011990 con 0x7f732015ad20 2023-03-03T06:23:25.419 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.415+0000 7f731f7fe700 1 -- 172.21.15.5:0/2454993605 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c011d20 con 0x7f732015ad20 2023-03-03T06:23:25.421 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.415+0000 7f7326efd700 1 -- 172.21.15.5:0/2454993605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f732015ad20 msgr2=0x7f73200cbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:25.421 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.415+0000 7f7326efd700 1 --2- 172.21.15.5:0/2454993605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f732015ad20 0x7f73200cbbf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f730c009870 tx=0x7f730c009b80 comp rx=0 tx=0).stop 2023-03-03T06:23:25.421 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.415+0000 7f7326efd700 1 -- 172.21.15.5:0/2454993605 shutdown_connections 2023-03-03T06:23:25.422 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.415+0000 7f7326efd700 1 --2- 172.21.15.5:0/2454993605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f732015ad20 0x7f73200cbbf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:25.422 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.415+0000 7f7326efd700 1 -- 172.21.15.5:0/2454993605 >> 172.21.15.5:0/2454993605 conn(0x7f73200cc8b0 msgr2=0x7f73200ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:25.422 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.415+0000 7f7326efd700 1 -- 172.21.15.5:0/2454993605 shutdown_connections 2023-03-03T06:23:25.422 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.415+0000 7f7326efd700 1 -- 172.21.15.5:0/2454993605 wait complete. 2023-03-03T06:23:25.422 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.416+0000 7f7326efd700 1 Processor -- start 2023-03-03T06:23:25.422 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.416+0000 7f7326efd700 1 -- start start 2023-03-03T06:23:25.422 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.417+0000 7f7326efd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73200cc130 0x7f73200b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:25.423 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.417+0000 7f7326efd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f732015a950 0x7f732014e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:25.423 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.417+0000 7f7326efd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f732015ad20 0x7f73200c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:25.423 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.417+0000 7f7326efd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73200c5730 con 0x7f732015ad20 2023-03-03T06:23:25.423 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.417+0000 7f7326efd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73200c4050 con 0x7f732015a950 2023-03-03T06:23:25.423 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.417+0000 7f7326efd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732014e760 con 0x7f73200cc130 2023-03-03T06:23:25.423 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.417+0000 7f732549a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f732015ad20 0x7f73200c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:25.423 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.417+0000 7f731ffff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f732015a950 0x7f732014e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:25.423 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f731ffff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f732015a950 0x7f732014e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:40758/0 (socket says 172.21.15.5:40758) 2023-03-03T06:23:25.424 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f7324c99700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73200cc130 0x7f73200b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:25.424 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f731ffff700 1 -- 172.21.15.5:0/874423866 learned_addr learned my addr 172.21.15.5:0/874423866 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:25.424 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f731ffff700 1 -- 172.21.15.5:0/874423866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73200cc130 msgr2=0x7f73200b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:25.424 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f731ffff700 1 --2- 172.21.15.5:0/874423866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73200cc130 0x7f73200b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:25.424 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f731ffff700 1 -- 172.21.15.5:0/874423866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f732015ad20 msgr2=0x7f73200c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:25.424 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f731ffff700 1 --2- 172.21.15.5:0/874423866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f732015ad20 0x7f73200c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:25.424 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f731ffff700 1 -- 172.21.15.5:0/874423866 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730c0094a0 con 0x7f732015a950 2023-03-03T06:23:25.425 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f732549a700 1 --2- 172.21.15.5:0/874423866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f732015ad20 0x7f73200c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:25.425 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f731ffff700 1 --2- 172.21.15.5:0/874423866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f732015a950 0x7f732014e220 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f730c0090b0 tx=0x7f730c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:25.425 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f731d7fa700 1 -- 172.21.15.5:0/874423866 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c01a8f0 con 0x7f732015a950 2023-03-03T06:23:25.425 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f731d7fa700 1 -- 172.21.15.5:0/874423866 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c01aa50 con 0x7f732015a950 2023-03-03T06:23:25.425 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f7326efd700 1 -- 172.21.15.5:0/874423866 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73200cb6d0 con 0x7f732015a950 2023-03-03T06:23:25.425 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f731d7fa700 1 -- 172.21.15.5:0/874423866 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c01adc0 con 0x7f732015a950 2023-03-03T06:23:25.425 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f7326efd700 1 -- 172.21.15.5:0/874423866 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73200cb3f0 con 0x7f732015a950 2023-03-03T06:23:25.426 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f731d7fa700 1 -- 172.21.15.5:0/874423866 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f730c00f050 con 0x7f732015a950 2023-03-03T06:23:25.426 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.418+0000 7f731d7fa700 1 -- 172.21.15.5:0/874423866 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f730c02dc70 con 0x7f732015a950 2023-03-03T06:23:25.426 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.419+0000 7f7326efd700 1 -- 172.21.15.5:0/874423866 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732006b700 con 0x7f732015a950 2023-03-03T06:23:25.426 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.421+0000 7f731d7fa700 1 -- 172.21.15.5:0/874423866 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f730c015020 con 0x7f732015a950 2023-03-03T06:23:25.495 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.493+0000 7f7326efd700 1 -- 172.21.15.5:0/874423866 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7320067680 con 0x7f732015a950 2023-03-03T06:23:25.496 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.494+0000 7f731d7fa700 1 -- 172.21.15.5:0/874423866 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f730c02d450 con 0x7f732015a950 2023-03-03T06:23:25.496 INFO:teuthology.misc.health.smithi005.stdout: 2023-03-03T06:23:25.496 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:24.168371+0000","last_up_change":"0.000000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:23:25.497 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.495+0000 7f7326efd700 1 -- 172.21.15.5:0/874423866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f732015a950 msgr2=0x7f732014e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:25.498 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.495+0000 7f7326efd700 1 --2- 172.21.15.5:0/874423866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f732015a950 0x7f732014e220 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f730c0090b0 tx=0x7f730c004750 comp rx=0 tx=0).stop 2023-03-03T06:23:25.498 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.495+0000 7f7326efd700 1 -- 172.21.15.5:0/874423866 shutdown_connections 2023-03-03T06:23:25.498 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.495+0000 7f7326efd700 1 --2- 172.21.15.5:0/874423866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f732015ad20 0x7f73200c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:25.498 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.495+0000 7f7326efd700 1 --2- 172.21.15.5:0/874423866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73200cc130 0x7f73200b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:25.499 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.495+0000 7f7326efd700 1 --2- 172.21.15.5:0/874423866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f732015a950 0x7f732014e220 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:25.499 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.495+0000 7f7326efd700 1 -- 172.21.15.5:0/874423866 >> 172.21.15.5:0/874423866 conn(0x7f73200cc8b0 msgr2=0x7f732014f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:25.499 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.495+0000 7f7326efd700 1 -- 172.21.15.5:0/874423866 shutdown_connections 2023-03-03T06:23:25.499 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:25.495+0000 7f7326efd700 1 -- 172.21.15.5:0/874423866 wait complete. 2023-03-03T06:23:25.508 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-03-03T06:23:25.533 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:25.531+0000 7fb25fb6a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-03-03T06:23:25.601 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:25.599+0000 7fa70143c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-03T06:23:25.743 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:25.741+0000 7fa70143c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-03T06:23:25.834 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:25.832+0000 7fb25fb6a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-03-03T06:23:25.965 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:25.963+0000 7fb25fb6a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-03-03T06:23:25.970 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:25.968+0000 7fa70143c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-03T06:23:26.132 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:26.130+0000 7fa70143c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-03T06:23:26.182 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:26.180+0000 7fb25fb6a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-03-03T06:23:26.254 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:26.251+0000 7fa70143c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-03T06:23:26.337 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:26.335+0000 7fb25fb6a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-03-03T06:23:26.452 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:26.450+0000 7fb25fb6a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-03-03T06:23:26.585 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:26.583+0000 7fa70143c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-03T06:23:26.690 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:26.688+0000 7fa70143c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-03T06:23:26.775 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:26.773+0000 7fb25fb6a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-03-03T06:23:26.876 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:26.874+0000 7fb25fb6a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-03-03T06:23:26.881 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:26.879+0000 7fa70143c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-03T06:23:27.058 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:27.056+0000 7fb25fb6a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-03-03T06:23:27.440 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:27.438+0000 7fa70143c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-03T06:23:27.586 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-03-03T06:23:27.584+0000 7fb25fb6a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-03-03T06:23:28.392 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-03-03T06:23:28.390+0000 7fe90edd1640 -1 osd.1 0 log_to_monitors true 2023-03-03T06:23:28.404 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-03-03T06:23:28.402+0000 7f539f045640 -1 osd.3 0 log_to_monitors true 2023-03-03T06:23:28.411 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-03-03T06:23:28.409+0000 7fe7ad9aa640 -1 osd.0 0 log_to_monitors true 2023-03-03T06:23:28.414 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-03-03T06:23:28.412+0000 7fd02b132640 -1 osd.2 0 log_to_monitors true 2023-03-03T06:23:28.462 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-03T06:23:28.460+0000 7f9ea98a1640 -1 osd.4 0 log_to_monitors true 2023-03-03T06:23:28.466 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:28.464+0000 7fa6b86a5700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-03-03T06:23:28.468 INFO:tasks.ceph.mgr.y.smithi005.stderr:2023-03-03T06:23:28.466+0000 7fa6b86a5700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-03-03T06:23:28.477 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-03T06:23:28.475+0000 7f33b2cb4640 -1 osd.6 0 log_to_monitors true 2023-03-03T06:23:28.479 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-03T06:23:28.477+0000 7f3b5a6de640 -1 osd.7 0 log_to_monitors true 2023-03-03T06:23:28.494 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-03T06:23:28.492+0000 7f8b8b9fc640 -1 osd.5 0 log_to_monitors true 2023-03-03T06:23:30.819 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-03-03T06:23:30.816+0000 7fe7a1d62700 -1 osd.0 0 waiting for initial osdmap 2023-03-03T06:23:30.847 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-03-03T06:23:30.844+0000 7fe903189700 -1 osd.1 0 waiting for initial osdmap 2023-03-03T06:23:30.848 INFO:tasks.ceph.osd.0.smithi005.stderr:2023-03-03T06:23:30.846+0000 7fe79993c700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-03T06:23:30.860 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-03-03T06:23:30.858+0000 7f53933fd700 -1 osd.3 0 waiting for initial osdmap 2023-03-03T06:23:30.887 INFO:tasks.ceph.osd.1.smithi005.stderr:2023-03-03T06:23:30.885+0000 7fe8fad63700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-03T06:23:30.927 INFO:tasks.ceph.osd.3.smithi005.stderr:2023-03-03T06:23:30.925+0000 7f538afd7700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-03T06:23:31.203 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-03-03T06:23:31.201+0000 7fd01f4ea700 -1 osd.2 0 waiting for initial osdmap 2023-03-03T06:23:31.218 INFO:tasks.ceph.osd.2.smithi005.stderr:2023-03-03T06:23:31.216+0000 7fd0170c4700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-03T06:23:31.534 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-03T06:23:31.532+0000 7f9e9dc59700 -1 osd.4 0 waiting for initial osdmap 2023-03-03T06:23:31.545 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-03T06:23:31.544+0000 7f8b7fdb4700 -1 osd.5 0 waiting for initial osdmap 2023-03-03T06:23:31.552 INFO:tasks.ceph.osd.4.smithi191.stderr:2023-03-03T06:23:31.547+0000 7f9e95833700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-03T06:23:31.562 INFO:tasks.ceph.osd.5.smithi191.stderr:2023-03-03T06:23:31.561+0000 7f8b7798e700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-03T06:23:31.564 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-03T06:23:31.562+0000 7f3b4ea96700 -1 osd.7 0 waiting for initial osdmap 2023-03-03T06:23:31.565 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-03T06:23:31.563+0000 7f33a706c700 -1 osd.6 0 waiting for initial osdmap 2023-03-03T06:23:31.579 INFO:tasks.ceph.osd.6.smithi191.stderr:2023-03-03T06:23:31.577+0000 7f339ec46700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-03T06:23:31.579 INFO:tasks.ceph.osd.7.smithi191.stderr:2023-03-03T06:23:31.577+0000 7f3b46670700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-03-03T06:23:32.315 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-03-03T06:23:32.443 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.441+0000 7f47a1136700 1 Processor -- start 2023-03-03T06:23:32.443 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.441+0000 7f47a1136700 1 -- start start 2023-03-03T06:23:32.446 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.441+0000 7f47a1136700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f479c0cb9a0 0x7f479c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.446 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.441+0000 7f47a1136700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f479c0b1fc0 0x7f479c160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.446 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.441+0000 7f47a1136700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c15acb0 con 0x7f479c15d240 2023-03-03T06:23:32.446 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.441+0000 7f47a1136700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c0cbd70 con 0x7f479c0b1fc0 2023-03-03T06:23:32.446 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.441+0000 7f47a1136700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c15d740 con 0x7f479c0cb9a0 2023-03-03T06:23:32.447 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f479a59c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f479c15d240 0x7f479c0b18b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58706/0 (socket says 172.21.15.5:58706) 2023-03-03T06:23:32.447 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f479a59c700 1 -- 172.21.15.5:0/3145750802 learned_addr learned my addr 172.21.15.5:0/3145750802 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:32.447 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f479b59e700 1 --2- 172.21.15.5:0/3145750802 >> v2:172.21.15.191:3300/0 conn(0x7f479c0b1fc0 0x7f479c160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.447 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274878698 0 0) 0x7f479c15acb0 con 0x7f479c15d240 2023-03-03T06:23:32.447 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f479ad9d700 1 --2- 172.21.15.5:0/3145750802 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f479c0cb9a0 0x7f479c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.447 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47880035b0 con 0x7f479c15d240 2023-03-03T06:23:32.447 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2977120614 0 0) 0x7f47880035b0 con 0x7f479c15d240 2023-03-03T06:23:32.448 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f479c0cb9a0 msgr2=0x7f479c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:32.448 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 --2- 172.21.15.5:0/3145750802 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f479c0cb9a0 0x7f479c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.448 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 >> v2:172.21.15.191:3300/0 conn(0x7f479c0b1fc0 msgr2=0x7f479c160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:32.448 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 --2- 172.21.15.5:0/3145750802 >> v2:172.21.15.191:3300/0 conn(0x7f479c0b1fc0 0x7f479c160bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.448 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c15da20 con 0x7f479c15d240 2023-03-03T06:23:32.450 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f4784001670 con 0x7f479c15d240 2023-03-03T06:23:32.450 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 >> v1:172.21.15.5:6789/0 conn(0x7f479c15d240 legacy=0x7f479c0b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:32.450 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 --2- 172.21.15.5:0/3145750802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4788003a00 0x7f4788003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.451 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 --2- 172.21.15.5:0/3145750802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4788004430 0x7f47880048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.451 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 --2- 172.21.15.5:0/3145750802 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f479c0cb9a0 0x7f4788005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.451 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0cbd70 con 0x7f4788003a00 2023-03-03T06:23:32.451 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c15d740 con 0x7f4788004430 2023-03-03T06:23:32.451 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478800ba10 con 0x7f479c0cb9a0 2023-03-03T06:23:32.452 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f479ad9d700 1 --2- 172.21.15.5:0/3145750802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4788003a00 0x7f4788003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.452 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f479a59c700 1 --2- 172.21.15.5:0/3145750802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4788004430 0x7f47880048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.452 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.442+0000 7f479b59e700 1 --2- 172.21.15.5:0/3145750802 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f479c0cb9a0 0x7f4788005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.452 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.443+0000 7f479ad9d700 1 -- 172.21.15.5:0/3145750802 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f479c0cb9a0 msgr2=0x7f4788005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:32.452 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.443+0000 7f479ad9d700 1 --2- 172.21.15.5:0/3145750802 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f479c0cb9a0 0x7f4788005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.452 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.443+0000 7f479ad9d700 1 -- 172.21.15.5:0/3145750802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4788004430 msgr2=0x7f47880048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:32.453 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.443+0000 7f479ad9d700 1 --2- 172.21.15.5:0/3145750802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4788004430 0x7f47880048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.453 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.443+0000 7f479ad9d700 1 -- 172.21.15.5:0/3145750802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47880035b0 con 0x7f4788003a00 2023-03-03T06:23:32.453 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.443+0000 7f479a59c700 1 --2- 172.21.15.5:0/3145750802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4788004430 0x7f47880048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:32.453 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.443+0000 7f479ad9d700 1 --2- 172.21.15.5:0/3145750802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4788003a00 0x7f4788003e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f478c009b90 tx=0x7f4788005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a418a65e0c4f28a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:32.453 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.443+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00e6c0 con 0x7f4788003a00 2023-03-03T06:23:32.453 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.443+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c00e820 con 0x7f4788003a00 2023-03-03T06:23:32.454 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.443+0000 7f4799d9b700 1 -- 172.21.15.5:0/3145750802 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00eb90 con 0x7f4788003a00 2023-03-03T06:23:32.454 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.443+0000 7f47a1136700 1 -- 172.21.15.5:0/3145750802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4788003a00 msgr2=0x7f4788003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:32.454 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.443+0000 7f47a1136700 1 --2- 172.21.15.5:0/3145750802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4788003a00 0x7f4788003e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f478c009b90 tx=0x7f4788005880 comp rx=0 tx=0).stop 2023-03-03T06:23:32.454 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.443+0000 7f479b59e700 1 -- 172.21.15.5:0/3145750802 reap_dead start 2023-03-03T06:23:32.454 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.444+0000 7f47a1136700 1 -- 172.21.15.5:0/3145750802 shutdown_connections 2023-03-03T06:23:32.454 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.444+0000 7f47a1136700 1 -- 172.21.15.5:0/3145750802 >> 172.21.15.5:0/3145750802 conn(0x7f479c0cc8b0 msgr2=0x7f479c0ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:32.454 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.444+0000 7f47a1136700 1 -- 172.21.15.5:0/3145750802 shutdown_connections 2023-03-03T06:23:32.454 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.444+0000 7f47a1136700 1 -- 172.21.15.5:0/3145750802 wait complete. 2023-03-03T06:23:32.458 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.445+0000 7f47a1136700 1 Processor -- start 2023-03-03T06:23:32.459 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.445+0000 7f47a1136700 1 -- start start 2023-03-03T06:23:32.459 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f47a1136700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4788003a00 0x7f479c0c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.459 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f47a1136700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f479c0ac920 0x7f479c0acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.459 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f47a1136700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f479c14c230 0x7f479c14c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.459 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f47a1136700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0ad5e0 con 0x7f479c0ac920 2023-03-03T06:23:32.459 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f47a1136700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0ad8c0 con 0x7f479c14c230 2023-03-03T06:23:32.460 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f47a1136700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0adba0 con 0x7f4788003a00 2023-03-03T06:23:32.460 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f479a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f479c0ac920 0x7f479c0acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.460 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f479a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f479c0ac920 0x7f479c0acd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40646/0 (socket says 172.21.15.5:40646) 2023-03-03T06:23:32.460 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f479a59c700 1 -- 172.21.15.5:0/575682145 learned_addr learned my addr 172.21.15.5:0/575682145 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:32.461 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f479b59e700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f479c14c230 0x7f479c14c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.461 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f479ad9d700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4788003a00 0x7f479c0c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.461 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f479a59c700 1 -- 172.21.15.5:0/575682145 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4788003a00 msgr2=0x7f479c0c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:32.461 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f479a59c700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4788003a00 0x7f479c0c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.461 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f479a59c700 1 -- 172.21.15.5:0/575682145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f479c14c230 msgr2=0x7f479c14c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:32.461 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f479a59c700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f479c14c230 0x7f479c14c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.462 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f479a59c700 1 -- 172.21.15.5:0/575682145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c15dfe0 con 0x7f479c0ac920 2023-03-03T06:23:32.462 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.446+0000 7f479b59e700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f479c14c230 0x7f479c14c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:32.462 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.447+0000 7f479a59c700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f479c0ac920 0x7f479c0acd90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f478400eaf0 tx=0x7f478400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:32.462 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.447+0000 7f47937fe700 1 -- 172.21.15.5:0/575682145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784005e00 con 0x7f479c0ac920 2023-03-03T06:23:32.462 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.447+0000 7f47937fe700 1 -- 172.21.15.5:0/575682145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478400c7b0 con 0x7f479c0ac920 2023-03-03T06:23:32.462 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.447+0000 7f47a1136700 1 -- 172.21.15.5:0/575682145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c15dd00 con 0x7f479c0ac920 2023-03-03T06:23:32.462 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.447+0000 7f47937fe700 1 -- 172.21.15.5:0/575682145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400cb20 con 0x7f479c0ac920 2023-03-03T06:23:32.463 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.447+0000 7f47a1136700 1 -- 172.21.15.5:0/575682145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c0af370 con 0x7f479c0ac920 2023-03-03T06:23:32.463 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.448+0000 7f47a1136700 1 -- 172.21.15.5:0/575682145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c067680 con 0x7f479c0ac920 2023-03-03T06:23:32.463 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.448+0000 7f47937fe700 1 -- 172.21.15.5:0/575682145 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7f478400cc80 con 0x7f479c0ac920 2023-03-03T06:23:32.463 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.449+0000 7f47937fe700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f477c0682a0 0x7f477c06a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.463 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.449+0000 7f47937fe700 1 -- 172.21.15.5:0/575682145 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f4784085560 con 0x7f479c0ac920 2023-03-03T06:23:32.464 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.449+0000 7f479ad9d700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f477c0682a0 0x7f477c06a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.464 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.449+0000 7f479ad9d700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f477c0682a0 0x7f477c06a750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f478c009ab0 tx=0x7f478c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:32.464 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.453+0000 7f47937fe700 1 -- 172.21.15.5:0/575682145 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4784052440 con 0x7f479c0ac920 2023-03-03T06:23:32.656 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.654+0000 7f47a1136700 1 -- 172.21.15.5:0/575682145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f479c0b5db0 con 0x7f479c0ac920 2023-03-03T06:23:32.657 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.655+0000 7f47937fe700 1 -- 172.21.15.5:0/575682145 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10392 (secure 0 0 0) 0x7f4784055a60 con 0x7f479c0ac920 2023-03-03T06:23:32.657 INFO:teuthology.misc.health.smithi005.stdout: 2023-03-03T06:23:32.658 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":13,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:31.841992+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:23:32.660 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.657+0000 7f47a1136700 1 -- 172.21.15.5:0/575682145 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f477c0682a0 msgr2=0x7f477c06a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:32.660 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.657+0000 7f47a1136700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f477c0682a0 0x7f477c06a750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f478c009ab0 tx=0x7f478c008030 comp rx=0 tx=0).stop 2023-03-03T06:23:32.660 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.657+0000 7f47a1136700 1 -- 172.21.15.5:0/575682145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f479c0ac920 msgr2=0x7f479c0acd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:32.660 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.657+0000 7f47a1136700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f479c0ac920 0x7f479c0acd90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f478400eaf0 tx=0x7f478400eeb0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.661 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.657+0000 7f47a1136700 1 -- 172.21.15.5:0/575682145 shutdown_connections 2023-03-03T06:23:32.661 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.657+0000 7f47a1136700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f479c14c230 0x7f479c14c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.661 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.657+0000 7f47a1136700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f477c0682a0 0x7f477c06a750 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.662 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.657+0000 7f47a1136700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4788003a00 0x7f479c0c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.662 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.657+0000 7f47a1136700 1 --2- 172.21.15.5:0/575682145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f479c0ac920 0x7f479c0acd90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.662 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.657+0000 7f47a1136700 1 -- 172.21.15.5:0/575682145 >> 172.21.15.5:0/575682145 conn(0x7f479c0cc8b0 msgr2=0x7f479c0ceae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:32.663 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.657+0000 7f47a1136700 1 -- 172.21.15.5:0/575682145 shutdown_connections 2023-03-03T06:23:32.663 INFO:teuthology.misc.health.smithi005.stderr:2023-03-03T06:23:32.657+0000 7f47a1136700 1 -- 172.21.15.5:0/575682145 wait complete. 2023-03-03T06:23:32.670 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-03-03T06:23:32.671 INFO:tasks.ceph:Creating RBD pool 2023-03-03T06:23:32.671 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool create rbd 8 2023-03-03T06:23:32.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.792+0000 7f7129a12700 1 Processor -- start 2023-03-03T06:23:32.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.792+0000 7f7129a12700 1 -- start start 2023-03-03T06:23:32.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.793+0000 7f7129a12700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f71240c9b00 0x7f71241677b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.793+0000 7f7129a12700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71240ca7f0 con 0x7f71240ce050 2023-03-03T06:23:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.793+0000 7f7129a12700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7124160930 con 0x7f712406d580 2023-03-03T06:23:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.793+0000 7f7129a12700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71240ce4c0 con 0x7f71240c9b00 2023-03-03T06:23:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.793+0000 7f71227fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f71240ce050 0x7f7124160dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58752/0 (socket says 172.21.15.5:58752) 2023-03-03T06:23:32.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.793+0000 7f71227fc700 1 -- 172.21.15.5:0/3742820267 learned_addr learned my addr 172.21.15.5:0/3742820267 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429737422 0 0) 0x7f7114001110 con 0x7f71240ce050 2023-03-03T06:23:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f71237fe700 1 --2- 172.21.15.5:0/3742820267 >> v2:172.21.15.191:3300/0 conn(0x7f71240c9b00 0x7f71241677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f710c0035b0 con 0x7f71240ce050 2023-03-03T06:23:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2261937241 0 0) 0x7f710c0035b0 con 0x7f71240ce050 2023-03-03T06:23:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 >> v2:172.21.15.191:3300/0 conn(0x7f71240c9b00 msgr2=0x7f71241677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:32.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 --2- 172.21.15.5:0/3742820267 >> v2:172.21.15.191:3300/0 conn(0x7f71240c9b00 0x7f71241677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 >> v1:172.21.15.191:6789/0 conn(0x7f712406d580 legacy=0x7f712406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71240c9f80 con 0x7f71240ce050 2023-03-03T06:23:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f7114001800 con 0x7f71240ce050 2023-03-03T06:23:32.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 >> v1:172.21.15.5:6789/0 conn(0x7f71240ce050 legacy=0x7f7124160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 --2- 172.21.15.5:0/3742820267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f710c003a00 0x7f710c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 --2- 172.21.15.5:0/3742820267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f710c004850 0x7f710c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 --2- 172.21.15.5:0/3742820267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f710c005200 0x7f710c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71240ce4c0 con 0x7f710c003a00 2023-03-03T06:23:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c00c110 con 0x7f710c005200 2023-03-03T06:23:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710c00c2d0 con 0x7f710c004850 2023-03-03T06:23:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7122ffd700 1 --2- 172.21.15.5:0/3742820267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f710c003a00 0x7f710c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f71227fc700 1 --2- 172.21.15.5:0/3742820267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f710c004850 0x7f710c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f71237fe700 1 --2- 172.21.15.5:0/3742820267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f710c005200 0x7f710c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7122ffd700 1 -- 172.21.15.5:0/3742820267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f710c004850 msgr2=0x7f710c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:32.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7122ffd700 1 --2- 172.21.15.5:0/3742820267 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f710c004850 0x7f710c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7122ffd700 1 -- 172.21.15.5:0/3742820267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f710c005200 msgr2=0x7f710c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7122ffd700 1 --2- 172.21.15.5:0/3742820267 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f710c005200 0x7f710c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f71237fe700 1 -- 172.21.15.5:0/3742820267 reap_dead start 2023-03-03T06:23:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.794+0000 7f7122ffd700 1 -- 172.21.15.5:0/3742820267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c0035b0 con 0x7f710c003a00 2023-03-03T06:23:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.795+0000 7f7122ffd700 1 --2- 172.21.15.5:0/3742820267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f710c003a00 0x7f710c003e10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71180017c0 tx=0x7f710c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba020e1cd1f4072 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.795+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71180052d0 con 0x7f710c003a00 2023-03-03T06:23:32.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.795+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7118005450 con 0x7f710c003a00 2023-03-03T06:23:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.795+0000 7f7121ffb700 1 -- 172.21.15.5:0/3742820267 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71180038c0 con 0x7f710c003a00 2023-03-03T06:23:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.795+0000 7f7129a12700 1 -- 172.21.15.5:0/3742820267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f710c003a00 msgr2=0x7f710c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.795+0000 7f7129a12700 1 --2- 172.21.15.5:0/3742820267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f710c003a00 0x7f710c003e10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71180017c0 tx=0x7f710c005880 comp rx=0 tx=0).stop 2023-03-03T06:23:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.795+0000 7f7129a12700 1 -- 172.21.15.5:0/3742820267 shutdown_connections 2023-03-03T06:23:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.795+0000 7f7129a12700 1 --2- 172.21.15.5:0/3742820267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f710c003a00 0x7f710c003e10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.795+0000 7f7129a12700 1 -- 172.21.15.5:0/3742820267 >> 172.21.15.5:0/3742820267 conn(0x7f71240cf4b0 msgr2=0x7f71240cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:32.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.795+0000 7f7129a12700 1 -- 172.21.15.5:0/3742820267 shutdown_connections 2023-03-03T06:23:32.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.795+0000 7f7129a12700 1 -- 172.21.15.5:0/3742820267 wait complete. 2023-03-03T06:23:32.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.797+0000 7f7129a12700 1 Processor -- start 2023-03-03T06:23:32.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.797+0000 7f7129a12700 1 -- start start 2023-03-03T06:23:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f7129a12700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f710c003a00 0x7f71240b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f7129a12700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71240b5060 0x7f7124152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f7129a12700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71240c7080 0x7f712415f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f7129a12700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7124152c90 con 0x7f71240c7080 2023-03-03T06:23:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f7129a12700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71240b3fc0 con 0x7f71240b5060 2023-03-03T06:23:32.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f7129a12700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71240b42a0 con 0x7f710c003a00 2023-03-03T06:23:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f71237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71240c7080 0x7f712415f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f71237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71240c7080 0x7f712415f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40692/0 (socket says 172.21.15.5:40692) 2023-03-03T06:23:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f71237fe700 1 -- 172.21.15.5:0/3596928034 learned_addr learned my addr 172.21.15.5:0/3596928034 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f71227fc700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71240b5060 0x7f7124152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f7122ffd700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f710c003a00 0x7f71240b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f71237fe700 1 -- 172.21.15.5:0/3596928034 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f710c003a00 msgr2=0x7f71240b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f71237fe700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f710c003a00 0x7f71240b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f71237fe700 1 -- 172.21.15.5:0/3596928034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71240b5060 msgr2=0x7f7124152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f71237fe700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71240b5060 0x7f7124152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.798+0000 7f71237fe700 1 -- 172.21.15.5:0/3596928034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71240ca510 con 0x7f71240c7080 2023-03-03T06:23:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.799+0000 7f71237fe700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71240c7080 0x7f712415f840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f712406ce60 tx=0x7f711c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.799+0000 7f710bfff700 1 -- 172.21.15.5:0/3596928034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c00e040 con 0x7f71240c7080 2023-03-03T06:23:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.799+0000 7f710bfff700 1 -- 172.21.15.5:0/3596928034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c00f040 con 0x7f71240c7080 2023-03-03T06:23:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.799+0000 7f7129a12700 1 -- 172.21.15.5:0/3596928034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71240ca230 con 0x7f71240c7080 2023-03-03T06:23:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.799+0000 7f710bfff700 1 -- 172.21.15.5:0/3596928034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c00fdb0 con 0x7f71240c7080 2023-03-03T06:23:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.799+0000 7f7129a12700 1 -- 172.21.15.5:0/3596928034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71241605c0 con 0x7f71240c7080 2023-03-03T06:23:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.800+0000 7f7129a12700 1 -- 172.21.15.5:0/3596928034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712404e6e0 con 0x7f71240c7080 2023-03-03T06:23:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.800+0000 7f710bfff700 1 -- 172.21.15.5:0/3596928034 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7f711c022460 con 0x7f71240c7080 2023-03-03T06:23:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.801+0000 7f710bfff700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f71100682a0 0x7f711006a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.801+0000 7f710bfff700 1 -- 172.21.15.5:0/3596928034 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f711c085e00 con 0x7f71240c7080 2023-03-03T06:23:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.801+0000 7f7122ffd700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f71100682a0 0x7f711006a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.801+0000 7f7122ffd700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f71100682a0 0x7f711006a750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7118005040 tx=0x7f7118009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.805+0000 7f710bfff700 1 -- 172.21.15.5:0/3596928034 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f711c052b90 con 0x7f71240c7080 2023-03-03T06:23:33.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:32.998+0000 7f7129a12700 1 -- 172.21.15.5:0/3596928034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f71240b5430 con 0x7f71240c7080 2023-03-03T06:23:33.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:33.870+0000 7f710bfff700 1 -- 172.21.15.5:0/3596928034 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f711c0561b0 con 0x7f71240c7080 2023-03-03T06:23:33.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:33.873+0000 7f7129a12700 1 -- 172.21.15.5:0/3596928034 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f71100682a0 msgr2=0x7f711006a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:33.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:33.873+0000 7f7129a12700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f71100682a0 0x7f711006a750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7118005040 tx=0x7f7118009030 comp rx=0 tx=0).stop 2023-03-03T06:23:33.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:33.873+0000 7f7129a12700 1 -- 172.21.15.5:0/3596928034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71240c7080 msgr2=0x7f712415f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:33.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:33.873+0000 7f7129a12700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71240c7080 0x7f712415f840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f712406ce60 tx=0x7f711c011f80 comp rx=0 tx=0).stop 2023-03-03T06:23:33.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:33.874+0000 7f7129a12700 1 -- 172.21.15.5:0/3596928034 shutdown_connections 2023-03-03T06:23:33.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:33.874+0000 7f7129a12700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71240c7080 0x7f712415f840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:33.874+0000 7f7129a12700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f71100682a0 0x7f711006a750 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:33.874+0000 7f7129a12700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f710c003a00 0x7f71240b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:33.874+0000 7f7129a12700 1 --2- 172.21.15.5:0/3596928034 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71240b5060 0x7f7124152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:33.874+0000 7f7129a12700 1 -- 172.21.15.5:0/3596928034 >> 172.21.15.5:0/3596928034 conn(0x7f71240cf4b0 msgr2=0x7f7124071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:33.874+0000 7f7129a12700 1 -- 172.21.15.5:0/3596928034 shutdown_connections 2023-03-03T06:23:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:33.874+0000 7f7129a12700 1 -- 172.21.15.5:0/3596928034 wait complete. 2023-03-03T06:23:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'rbd' created 2023-03-03T06:23:33.891 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-03-03T06:23:34.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.022+0000 7f4171701700 1 Processor -- start 2023-03-03T06:23:34.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.022+0000 7f4171701700 1 -- start start 2023-03-03T06:23:34.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f4171701700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f416c15c970 0x7f416c0b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:34.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f4171701700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416c0b63b0 con 0x7f416c0cf3c0 2023-03-03T06:23:34.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f4171701700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416c0d0db0 con 0x7f416c0b4aa0 2023-03-03T06:23:34.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f4171701700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416c15cd40 con 0x7f416c15c970 2023-03-03T06:23:34.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f416a7fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f416c0cf3c0 0x7f416c06ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58784/0 (socket says 172.21.15.5:58784) 2023-03-03T06:23:34.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f416a7fc700 1 -- 172.21.15.5:0/3077741903 learned_addr learned my addr 172.21.15.5:0/3077741903 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:34.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f416affd700 1 --2- 172.21.15.5:0/3077741903 >> v2:172.21.15.191:3300/0 conn(0x7f416c15c970 0x7f416c0b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:34.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507758574 0 0) 0x7f416c0b63b0 con 0x7f416c0cf3c0 2023-03-03T06:23:34.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41540035b0 con 0x7f416c0cf3c0 2023-03-03T06:23:34.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 864207708 0 0) 0x7f41540035b0 con 0x7f416c0cf3c0 2023-03-03T06:23:34.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 >> v2:172.21.15.191:3300/0 conn(0x7f416c15c970 msgr2=0x7f416c0b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:34.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f4169ffb700 1 --2- 172.21.15.5:0/3077741903 >> v2:172.21.15.191:3300/0 conn(0x7f416c15c970 0x7f416c0b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:34.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 >> v1:172.21.15.191:6789/0 conn(0x7f416c0b4aa0 legacy=0x7f416c0b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:34.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.023+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c0cd780 con 0x7f416c0cf3c0 2023-03-03T06:23:34.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f415c001670 con 0x7f416c0cf3c0 2023-03-03T06:23:34.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 >> v1:172.21.15.5:6789/0 conn(0x7f416c0cf3c0 legacy=0x7f416c06ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:34.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f4169ffb700 1 --2- 172.21.15.5:0/3077741903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4154003a00 0x7f4154003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:34.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f4169ffb700 1 --2- 172.21.15.5:0/3077741903 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4154004850 0x7f4154004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:34.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f4169ffb700 1 --2- 172.21.15.5:0/3077741903 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4154005200 0x7f415400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:34.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c15cd40 con 0x7f4154003a00 2023-03-03T06:23:34.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415400c0e0 con 0x7f4154005200 2023-03-03T06:23:34.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415400c2a0 con 0x7f4154004850 2023-03-03T06:23:34.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f416affd700 1 --2- 172.21.15.5:0/3077741903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4154003a00 0x7f4154003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:34.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f416a7fc700 1 --2- 172.21.15.5:0/3077741903 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4154004850 0x7f4154004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:34.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f416b7fe700 1 --2- 172.21.15.5:0/3077741903 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4154005200 0x7f415400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:34.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f416affd700 1 -- 172.21.15.5:0/3077741903 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4154004850 msgr2=0x7f4154004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:34.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f416affd700 1 --2- 172.21.15.5:0/3077741903 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4154004850 0x7f4154004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:34.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f416affd700 1 -- 172.21.15.5:0/3077741903 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4154005200 msgr2=0x7f415400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f416affd700 1 --2- 172.21.15.5:0/3077741903 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4154005200 0x7f415400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f416affd700 1 -- 172.21.15.5:0/3077741903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41540035b0 con 0x7f4154003a00 2023-03-03T06:23:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f416b7fe700 1 --2- 172.21.15.5:0/3077741903 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4154005200 0x7f415400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f416b7fe700 1 -- 172.21.15.5:0/3077741903 reap_dead start 2023-03-03T06:23:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f416affd700 1 --2- 172.21.15.5:0/3077741903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4154003a00 0x7f4154003dd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4160009b30 tx=0x7f4154005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f760af0a7b88c86b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416000e6c0 con 0x7f4154003a00 2023-03-03T06:23:34.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416000e820 con 0x7f4154003a00 2023-03-03T06:23:34.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.024+0000 7f4169ffb700 1 -- 172.21.15.5:0/3077741903 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416000eb90 con 0x7f4154003a00 2023-03-03T06:23:34.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.025+0000 7f4171701700 1 -- 172.21.15.5:0/3077741903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4154003a00 msgr2=0x7f4154003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:34.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.025+0000 7f4171701700 1 --2- 172.21.15.5:0/3077741903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4154003a00 0x7f4154003dd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4160009b30 tx=0x7f4154005880 comp rx=0 tx=0).stop 2023-03-03T06:23:34.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.025+0000 7f4171701700 1 -- 172.21.15.5:0/3077741903 shutdown_connections 2023-03-03T06:23:34.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.025+0000 7f4171701700 1 --2- 172.21.15.5:0/3077741903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4154003a00 0x7f4154003dd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:34.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.025+0000 7f4171701700 1 -- 172.21.15.5:0/3077741903 >> 172.21.15.5:0/3077741903 conn(0x7f416c0d0730 msgr2=0x7f416c0d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:34.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.025+0000 7f4171701700 1 -- 172.21.15.5:0/3077741903 shutdown_connections 2023-03-03T06:23:34.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.025+0000 7f4171701700 1 -- 172.21.15.5:0/3077741903 wait complete. 2023-03-03T06:23:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.026+0000 7f4171701700 1 Processor -- start 2023-03-03T06:23:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.026+0000 7f4171701700 1 -- start start 2023-03-03T06:23:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f4171701700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4154003a00 0x7f416c1517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:34.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f4171701700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f416c151050 0x7f416c1f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f4171701700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f416c1f5f60 0x7f416c1f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f4171701700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c15ac10 con 0x7f416c151050 2023-03-03T06:23:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f4171701700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c15aef0 con 0x7f4154003a00 2023-03-03T06:23:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f4171701700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416c15b1d0 con 0x7f416c1f5f60 2023-03-03T06:23:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f416a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f416c151050 0x7f416c1f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f416a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f416c151050 0x7f416c1f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40724/0 (socket says 172.21.15.5:40724) 2023-03-03T06:23:34.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f416a7fc700 1 -- 172.21.15.5:0/2635066408 learned_addr learned my addr 172.21.15.5:0/2635066408 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f416affd700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4154003a00 0x7f416c1517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f416b7fe700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f416c1f5f60 0x7f416c1f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f416a7fc700 1 -- 172.21.15.5:0/2635066408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f416c1f5f60 msgr2=0x7f416c1f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f416a7fc700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f416c1f5f60 0x7f416c1f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f416a7fc700 1 -- 172.21.15.5:0/2635066408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4154003a00 msgr2=0x7f416c1517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f416a7fc700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4154003a00 0x7f416c1517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:34.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f416a7fc700 1 -- 172.21.15.5:0/2635066408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c0d1050 con 0x7f416c151050 2023-03-03T06:23:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.027+0000 7f416b7fe700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f416c1f5f60 0x7f416c1f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.028+0000 7f416a7fc700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f416c151050 0x7f416c1f5a20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f415c00e780 tx=0x7f415c00ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.028+0000 7f41537fe700 1 -- 172.21.15.5:0/2635066408 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c012590 con 0x7f416c151050 2023-03-03T06:23:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.028+0000 7f41537fe700 1 -- 172.21.15.5:0/2635066408 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c0126f0 con 0x7f416c151050 2023-03-03T06:23:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.028+0000 7f41537fe700 1 -- 172.21.15.5:0/2635066408 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c012aa0 con 0x7f416c151050 2023-03-03T06:23:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.028+0000 7f4171701700 1 -- 172.21.15.5:0/2635066408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416c0cda60 con 0x7f416c151050 2023-03-03T06:23:34.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.028+0000 7f4171701700 1 -- 172.21.15.5:0/2635066408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416c0cdd40 con 0x7f416c151050 2023-03-03T06:23:34.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.029+0000 7f4171701700 1 -- 172.21.15.5:0/2635066408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416c0b6360 con 0x7f416c151050 2023-03-03T06:23:34.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.029+0000 7f41537fe700 1 -- 172.21.15.5:0/2635066408 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7f415c012c00 con 0x7f416c151050 2023-03-03T06:23:34.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.030+0000 7f41537fe700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f41580682a0 0x7f415806a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:34.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.030+0000 7f41537fe700 1 -- 172.21.15.5:0/2635066408 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f415c085730 con 0x7f416c151050 2023-03-03T06:23:34.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.030+0000 7f416affd700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f41580682a0 0x7f415806a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:34.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.030+0000 7f416affd700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f41580682a0 0x7f415806a750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f41600090b0 tx=0x7f416001e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:34.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.034+0000 7f41537fe700 1 -- 172.21.15.5:0/2635066408 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f415c052340 con 0x7f416c151050 2023-03-03T06:23:34.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.227+0000 7f4171701700 1 -- 172.21.15.5:0/2635066408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f416c15ad50 con 0x7f416c151050 2023-03-03T06:23:34.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.875+0000 7f41537fe700 1 -- 172.21.15.5:0/2635066408 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f416c15ad50 con 0x7f416c151050 2023-03-03T06:23:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.879+0000 7f4171701700 1 -- 172.21.15.5:0/2635066408 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f41580682a0 msgr2=0x7f415806a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.879+0000 7f4171701700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f41580682a0 0x7f415806a750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f41600090b0 tx=0x7f416001e040 comp rx=0 tx=0).stop 2023-03-03T06:23:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.879+0000 7f4171701700 1 -- 172.21.15.5:0/2635066408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f416c151050 msgr2=0x7f416c1f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.879+0000 7f4171701700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f416c151050 0x7f416c1f5a20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f415c00e780 tx=0x7f415c00ea90 comp rx=0 tx=0).stop 2023-03-03T06:23:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.879+0000 7f4171701700 1 -- 172.21.15.5:0/2635066408 shutdown_connections 2023-03-03T06:23:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.879+0000 7f4171701700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f41580682a0 0x7f415806a750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.879+0000 7f4171701700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f416c1f5f60 0x7f416c1f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.879+0000 7f4171701700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4154003a00 0x7f416c1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:34.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.879+0000 7f4171701700 1 --2- 172.21.15.5:0/2635066408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f416c151050 0x7f416c1f5a20 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f415c00e780 tx=0x7f415c00ea90 comp rx=0 tx=0).stop 2023-03-03T06:23:34.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.879+0000 7f4171701700 1 -- 172.21.15.5:0/2635066408 >> 172.21.15.5:0/2635066408 conn(0x7f416c0d0730 msgr2=0x7f416c15f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:34.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.881+0000 7f4171701700 1 -- 172.21.15.5:0/2635066408 shutdown_connections 2023-03-03T06:23:34.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:34.881+0000 7f4171701700 1 -- 172.21.15.5:0/2635066408 wait complete. 2023-03-03T06:23:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:enabled application 'rbd' on pool 'rbd' 2023-03-03T06:23:34.899 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-03-03T06:23:34.900 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-03T06:23:34.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-03T06:23:34.904 INFO:tasks.ceph.mds.a:Started 2023-03-03T06:23:34.904 INFO:tasks.ceph.mds.c:Restarting daemon 2023-03-03T06:23:34.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-03-03T06:23:34.907 INFO:tasks.ceph.mds.c:Started 2023-03-03T06:23:34.908 INFO:tasks.ceph.mds.b:Restarting daemon 2023-03-03T06:23:34.908 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-03-03T06:23:34.910 INFO:tasks.ceph.mds.b:Started 2023-03-03T06:23:34.910 INFO:tasks.ceph.mds.d:Restarting daemon 2023-03-03T06:23:34.911 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-03-03T06:23:34.912 INFO:tasks.ceph.mds.d:Started 2023-03-03T06:23:34.913 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-03-03T06:23:34.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:23:35.004 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-03-03T06:23:35.005 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-03-03T06:23:35.005 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-03-03T06:23:35.007 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-03-03T06:23:35.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.060+0000 7f6fce3b2700 1 Processor -- start 2023-03-03T06:23:35.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.060+0000 7f6fce3b2700 1 -- start start 2023-03-03T06:23:35.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.061+0000 7f6fce3b2700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6fc806c830 0x7f6fc8160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.061+0000 7f6fce3b2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fc80cf2a0 0x7f6fc80d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.061+0000 7f6fce3b2700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc80d2e10 con 0x7f6fc80b8a40 2023-03-03T06:23:35.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.061+0000 7f6fce3b2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc8161490 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.061+0000 7f6fce3b2700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc80cd8d0 con 0x7f6fc806c830 2023-03-03T06:23:35.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.061+0000 7f6fcc94f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fc80cf2a0 0x7f6fc80d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.061+0000 7f6fcc94f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6fc80cf2a0 0x7f6fc80d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40782/0 (socket says 172.21.15.5:40782) 2023-03-03T06:23:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.061+0000 7f6fcc94f700 1 -- 172.21.15.5:0/3938628589 learned_addr learned my addr 172.21.15.5:0/3938628589 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.061+0000 7f6fc77fe700 1 --2- 172.21.15.5:0/3938628589 >> v2:172.21.15.191:3300/0 conn(0x7f6fc806c830 0x7f6fc8160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.061+0000 7f6fcc94f700 1 -- 172.21.15.5:0/3938628589 >> v2:172.21.15.191:3300/0 conn(0x7f6fc806c830 msgr2=0x7f6fc8160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.061+0000 7f6fcc94f700 1 --2- 172.21.15.5:0/3938628589 >> v2:172.21.15.191:3300/0 conn(0x7f6fc806c830 0x7f6fc8160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.061+0000 7f6fcc94f700 1 -- 172.21.15.5:0/3938628589 >> v1:172.21.15.191:6789/0 conn(0x7f6fc80b8a40 legacy=0x7f6fc806c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.062+0000 7f6fcc94f700 1 -- 172.21.15.5:0/3938628589 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc80d2520 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.062+0000 7f6fcc94f700 1 --2- 172.21.15.5:0/3938628589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc80cf2a0 0x7f6fc80d0c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6fc81604a0 tx=0x7f6fc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81851ad70d38178c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.062+0000 7f6fc6ffd700 1 -- 172.21.15.5:0/3938628589 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000e070 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.062+0000 7f6fc6ffd700 1 -- 172.21.15.5:0/3938628589 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc000b910 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.062+0000 7f6fc6ffd700 1 -- 172.21.15.5:0/3938628589 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000bcc0 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.062+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3938628589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc80cf2a0 msgr2=0x7f6fc80d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.062+0000 7f6fce3b2700 1 --2- 172.21.15.5:0/3938628589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc80cf2a0 0x7f6fc80d0c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6fc81604a0 tx=0x7f6fc000b330 comp rx=0 tx=0).stop 2023-03-03T06:23:35.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.062+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3938628589 shutdown_connections 2023-03-03T06:23:35.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.062+0000 7f6fce3b2700 1 --2- 172.21.15.5:0/3938628589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc80cf2a0 0x7f6fc80d0c20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.062+0000 7f6fce3b2700 1 --2- 172.21.15.5:0/3938628589 >> v2:172.21.15.191:3300/0 conn(0x7f6fc806c830 0x7f6fc8160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.062+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3938628589 >> 172.21.15.5:0/3938628589 conn(0x7f6fc80d05d0 msgr2=0x7f6fc80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:35.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.062+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3938628589 shutdown_connections 2023-03-03T06:23:35.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.062+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3938628589 wait complete. 2023-03-03T06:23:35.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.064+0000 7f6fce3b2700 1 Processor -- start 2023-03-03T06:23:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.064+0000 7f6fce3b2700 1 -- start start 2023-03-03T06:23:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.064+0000 7f6fce3b2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fc806c830 0x7f6fc814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fce3b2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fc80b8a40 0x7f6fc80c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fce3b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc80cf2a0 0x7f6fc814bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fce3b2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80cd180 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fce3b2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80c9d90 con 0x7f6fc806c830 2023-03-03T06:23:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fce3b2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc8150060 con 0x7f6fc80b8a40 2023-03-03T06:23:35.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fcc94f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc80cf2a0 0x7f6fc814bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fcc94f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc80cf2a0 0x7f6fc814bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40788/0 (socket says 172.21.15.5:40788) 2023-03-03T06:23:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fcc94f700 1 -- 172.21.15.5:0/3717504949 learned_addr learned my addr 172.21.15.5:0/3717504949 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fc77fe700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fc80b8a40 0x7f6fc80c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fc7fff700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fc806c830 0x7f6fc814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fcc94f700 1 -- 172.21.15.5:0/3717504949 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fc80b8a40 msgr2=0x7f6fc80c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fcc94f700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fc80b8a40 0x7f6fc80c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fcc94f700 1 -- 172.21.15.5:0/3717504949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fc806c830 msgr2=0x7f6fc814fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fcc94f700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fc806c830 0x7f6fc814fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fcc94f700 1 -- 172.21.15.5:0/3717504949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0009b30 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fc7fff700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fc806c830 0x7f6fc814fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:35.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fcc94f700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc80cf2a0 0x7f6fc814bd80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000b370 tx=0x7f6fc0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fc4ff9700 1 -- 172.21.15.5:0/3717504949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0004880 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fc4ff9700 1 -- 172.21.15.5:0/3717504949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc00099b0 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3717504949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc80d2850 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.065+0000 7f6fc4ff9700 1 -- 172.21.15.5:0/3717504949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc001c680 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.066+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3717504949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc815ce30 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.066+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3717504949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc80d2b30 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.067+0000 7f6fc4ff9700 1 -- 172.21.15.5:0/3717504949 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7f6fc0022030 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.067+0000 7f6fc4ff9700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6fa80682a0 0x7f6fa806a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.067+0000 7f6fc4ff9700 1 -- 172.21.15.5:0/3717504949 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6fc0087070 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.068+0000 7f6fc7fff700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6fa80682a0 0x7f6fa806a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.068+0000 7f6fc7fff700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6fa80682a0 0x7f6fa806a750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8007fd0 tx=0x7f6fb8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:35.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.072+0000 7f6fc4ff9700 1 -- 172.21.15.5:0/3717504949 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6fc0053c70 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.271+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3717504949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fc804e6e0 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.272+0000 7f6fc4ff9700 1 -- 172.21.15.5:0/3717504949 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14089 (secure 0 0 0) 0x7f6fc0057290 con 0x7f6fc80cf2a0 2023-03-03T06:23:35.275 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:35.275 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":16,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:34.869494+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:23:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.274+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3717504949 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6fa80682a0 msgr2=0x7f6fa806a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.274+0000 7f6fce3b2700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6fa80682a0 0x7f6fa806a750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8007fd0 tx=0x7f6fb8009040 comp rx=0 tx=0).stop 2023-03-03T06:23:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.274+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3717504949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc80cf2a0 msgr2=0x7f6fc814bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.274+0000 7f6fce3b2700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc80cf2a0 0x7f6fc814bd80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000b370 tx=0x7f6fc0004ad0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.274+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3717504949 shutdown_connections 2023-03-03T06:23:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.274+0000 7f6fce3b2700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fc80cf2a0 0x7f6fc814bd80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.274+0000 7f6fce3b2700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fc806c830 0x7f6fc814fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.274+0000 7f6fce3b2700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6fa80682a0 0x7f6fa806a750 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.274+0000 7f6fce3b2700 1 --2- 172.21.15.5:0/3717504949 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fc80b8a40 0x7f6fc80c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.274+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3717504949 >> 172.21.15.5:0/3717504949 conn(0x7f6fc80d05d0 msgr2=0x7f6fc80d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.274+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3717504949 shutdown_connections 2023-03-03T06:23:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.274+0000 7f6fce3b2700 1 -- 172.21.15.5:0/3717504949 wait complete. 2023-03-03T06:23:35.290 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T06:23:35.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:23:35.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.419+0000 7f99c4cfa700 1 Processor -- start 2023-03-03T06:23:35.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.419+0000 7f99c4cfa700 1 -- start start 2023-03-03T06:23:35.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.420+0000 7f99c4cfa700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f99c015a410 0x7f99c00d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.420+0000 7f99c4cfa700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99c015a7e0 0x7f99c00cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.420+0000 7f99c4cfa700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c00cb4a0 con 0x7f99c00cd6c0 2023-03-03T06:23:35.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.420+0000 7f99c4cfa700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c00cebe0 con 0x7f99c015a7e0 2023-03-03T06:23:35.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.420+0000 7f99c4cfa700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c00cb6f0 con 0x7f99c015a410 2023-03-03T06:23:35.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.420+0000 7f99bdd9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99c015a7e0 0x7f99c00cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.420+0000 7f99bdd9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f99c015a7e0 0x7f99c00cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40800/0 (socket says 172.21.15.5:40800) 2023-03-03T06:23:35.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.420+0000 7f99bdd9b700 1 -- 172.21.15.5:0/2986513761 learned_addr learned my addr 172.21.15.5:0/2986513761 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:35.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.420+0000 7f99be59c700 1 --2- 172.21.15.5:0/2986513761 >> v2:172.21.15.191:3300/0 conn(0x7f99c015a410 0x7f99c00d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.420+0000 7f99bdd9b700 1 -- 172.21.15.5:0/2986513761 >> v2:172.21.15.191:3300/0 conn(0x7f99c015a410 msgr2=0x7f99c00d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:35.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.420+0000 7f99bdd9b700 1 --2- 172.21.15.5:0/2986513761 >> v2:172.21.15.191:3300/0 conn(0x7f99c015a410 0x7f99c00d1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.420+0000 7f99bdd9b700 1 -- 172.21.15.5:0/2986513761 >> v1:172.21.15.191:6789/0 conn(0x7f99c00cd6c0 legacy=0x7f99c00cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.421+0000 7f99bdd9b700 1 -- 172.21.15.5:0/2986513761 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c00cb9d0 con 0x7f99c015a7e0 2023-03-03T06:23:35.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.421+0000 7f99bdd9b700 1 --2- 172.21.15.5:0/2986513761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c015a7e0 0x7f99c00cd180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f99c0072b10 tx=0x7f99b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d59b6f124904c6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:35.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.421+0000 7f99bd59a700 1 -- 172.21.15.5:0/2986513761 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4004230 con 0x7f99c015a7e0 2023-03-03T06:23:35.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.421+0000 7f99bd59a700 1 -- 172.21.15.5:0/2986513761 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b4004390 con 0x7f99c015a7e0 2023-03-03T06:23:35.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.421+0000 7f99bd59a700 1 -- 172.21.15.5:0/2986513761 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40036a0 con 0x7f99c015a7e0 2023-03-03T06:23:35.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.421+0000 7f99c4cfa700 1 -- 172.21.15.5:0/2986513761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c015a7e0 msgr2=0x7f99c00cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.421+0000 7f99c4cfa700 1 --2- 172.21.15.5:0/2986513761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c015a7e0 0x7f99c00cd180 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f99c0072b10 tx=0x7f99b4009bd0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.422+0000 7f99c4cfa700 1 -- 172.21.15.5:0/2986513761 shutdown_connections 2023-03-03T06:23:35.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.422+0000 7f99c4cfa700 1 --2- 172.21.15.5:0/2986513761 >> v2:172.21.15.191:3300/0 conn(0x7f99c015a410 0x7f99c00d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.422+0000 7f99c4cfa700 1 --2- 172.21.15.5:0/2986513761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c015a7e0 0x7f99c00cd180 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.422+0000 7f99c4cfa700 1 -- 172.21.15.5:0/2986513761 >> 172.21.15.5:0/2986513761 conn(0x7f99c006f3c0 msgr2=0x7f99c006f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:35.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.422+0000 7f99c4cfa700 1 -- 172.21.15.5:0/2986513761 shutdown_connections 2023-03-03T06:23:35.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.422+0000 7f99c4cfa700 1 -- 172.21.15.5:0/2986513761 wait complete. 2023-03-03T06:23:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.423+0000 7f99c4cfa700 1 Processor -- start 2023-03-03T06:23:35.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.423+0000 7f99c4cfa700 1 -- start start 2023-03-03T06:23:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99c4cfa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c00cd6c0 0x7f99c00af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99c4cfa700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99c015a410 0x7f99c00c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99c4cfa700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99c015a7e0 0x7f99c00c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99c4cfa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c006c310 con 0x7f99c00cd6c0 2023-03-03T06:23:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99c4cfa700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c015cbd0 con 0x7f99c015a7e0 2023-03-03T06:23:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99c4cfa700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c015ceb0 con 0x7f99c015a410 2023-03-03T06:23:35.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99be59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c00cd6c0 0x7f99c00af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99be59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c00cd6c0 0x7f99c00af070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40804/0 (socket says 172.21.15.5:40804) 2023-03-03T06:23:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99be59c700 1 -- 172.21.15.5:0/895761845 learned_addr learned my addr 172.21.15.5:0/895761845 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99bed9d700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99c015a7e0 0x7f99c00c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99bdd9b700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99c015a410 0x7f99c00c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99be59c700 1 -- 172.21.15.5:0/895761845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99c015a410 msgr2=0x7f99c00c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99be59c700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99c015a410 0x7f99c00c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99be59c700 1 -- 172.21.15.5:0/895761845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99c015a7e0 msgr2=0x7f99c00c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99be59c700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99c015a7e0 0x7f99c00c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99be59c700 1 -- 172.21.15.5:0/895761845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b4009550 con 0x7f99c00cd6c0 2023-03-03T06:23:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99bdd9b700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99c015a410 0x7f99c00c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.424+0000 7f99be59c700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c00cd6c0 0x7f99c00af070 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99b000e810 tx=0x7f99b000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.425+0000 7f99aeffd700 1 -- 172.21.15.5:0/895761845 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0013610 con 0x7f99c00cd6c0 2023-03-03T06:23:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.425+0000 7f99aeffd700 1 -- 172.21.15.5:0/895761845 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b0013770 con 0x7f99c00cd6c0 2023-03-03T06:23:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.425+0000 7f99aeffd700 1 -- 172.21.15.5:0/895761845 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0013b20 con 0x7f99c00cd6c0 2023-03-03T06:23:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.425+0000 7f99c4cfa700 1 -- 172.21.15.5:0/895761845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c00cf070 con 0x7f99c00cd6c0 2023-03-03T06:23:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.425+0000 7f99c4cfa700 1 -- 172.21.15.5:0/895761845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c00cbcb0 con 0x7f99c00cd6c0 2023-03-03T06:23:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.426+0000 7f99c4cfa700 1 -- 172.21.15.5:0/895761845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c00cf200 con 0x7f99c00cd6c0 2023-03-03T06:23:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.426+0000 7f99aeffd700 1 -- 172.21.15.5:0/895761845 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7f99b0023070 con 0x7f99c00cd6c0 2023-03-03T06:23:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.427+0000 7f99aeffd700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f99a00682a0 0x7f99a006a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.427+0000 7f99aeffd700 1 -- 172.21.15.5:0/895761845 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f99b0085530 con 0x7f99c00cd6c0 2023-03-03T06:23:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.427+0000 7f99bdd9b700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f99a00682a0 0x7f99a006a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.427+0000 7f99bdd9b700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f99a00682a0 0x7f99a006a750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f99c0072b10 tx=0x7f99b4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.432+0000 7f99aeffd700 1 -- 172.21.15.5:0/895761845 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f99b00520b0 con 0x7f99c00cd6c0 2023-03-03T06:23:35.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.627+0000 7f99c4cfa700 1 -- 172.21.15.5:0/895761845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f99c004e6e0 con 0x7f99c00cd6c0 2023-03-03T06:23:35.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.627+0000 7f99aeffd700 1 -- 172.21.15.5:0/895761845 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f99b00556d0 con 0x7f99c00cd6c0 2023-03-03T06:23:35.630 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:23:35.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.629+0000 7f99c4cfa700 1 -- 172.21.15.5:0/895761845 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f99a00682a0 msgr2=0x7f99a006a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.629+0000 7f99c4cfa700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f99a00682a0 0x7f99a006a750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f99c0072b10 tx=0x7f99b4008030 comp rx=0 tx=0).stop 2023-03-03T06:23:35.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.629+0000 7f99c4cfa700 1 -- 172.21.15.5:0/895761845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c00cd6c0 msgr2=0x7f99c00af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.629+0000 7f99c4cfa700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c00cd6c0 0x7f99c00af070 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99b000e810 tx=0x7f99b000eb20 comp rx=0 tx=0).stop 2023-03-03T06:23:35.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.629+0000 7f99c4cfa700 1 -- 172.21.15.5:0/895761845 shutdown_connections 2023-03-03T06:23:35.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.629+0000 7f99c4cfa700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f99c015a7e0 0x7f99c00c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.629+0000 7f99c4cfa700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99c00cd6c0 0x7f99c00af070 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.629+0000 7f99c4cfa700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f99a00682a0 0x7f99a006a750 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.629+0000 7f99c4cfa700 1 --2- 172.21.15.5:0/895761845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99c015a410 0x7f99c00c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.629+0000 7f99c4cfa700 1 -- 172.21.15.5:0/895761845 >> 172.21.15.5:0/895761845 conn(0x7f99c006f3c0 msgr2=0x7f99c00d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:35.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.629+0000 7f99c4cfa700 1 -- 172.21.15.5:0/895761845 shutdown_connections 2023-03-03T06:23:35.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.630+0000 7f99c4cfa700 1 -- 172.21.15.5:0/895761845 wait complete. 2023-03-03T06:23:35.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:23:35.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.769+0000 7fac02ec7700 1 Processor -- start 2023-03-03T06:23:35.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.769+0000 7fac02ec7700 1 -- start start 2023-03-03T06:23:35.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.770+0000 7fac02ec7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabfc15cd40 0x7fabfc0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.770+0000 7fac02ec7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fabfc0cb9d0 0x7fabfc0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.770+0000 7fac02ec7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc15e160 con 0x7fabfc0cd3e0 2023-03-03T06:23:35.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.770+0000 7fac02ec7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc0cd870 con 0x7fabfc15cd40 2023-03-03T06:23:35.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.770+0000 7fac02ec7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc15d110 con 0x7fabfc0cb9d0 2023-03-03T06:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.770+0000 7fac00c63700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fabfc15cd40 0x7fabfc0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.770+0000 7fabfbfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fabfc0cd3e0 0x7fabfc160720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58896/0 (socket says 172.21.15.5:58896) 2023-03-03T06:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.770+0000 7fabfbfff700 1 -- 172.21.15.5:0/270301457 learned_addr learned my addr 172.21.15.5:0/270301457 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.770+0000 7fac01464700 1 --2- 172.21.15.5:0/270301457 >> v2:172.21.15.191:3300/0 conn(0x7fabfc0cb9d0 0x7fabfc0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fac00c63700 1 -- 172.21.15.5:0/270301457 >> v2:172.21.15.191:3300/0 conn(0x7fabfc0cb9d0 msgr2=0x7fabfc0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fac00c63700 1 --2- 172.21.15.5:0/270301457 >> v2:172.21.15.191:3300/0 conn(0x7fabfc0cb9d0 0x7fabfc0b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fac00c63700 1 -- 172.21.15.5:0/270301457 >> v1:172.21.15.5:6789/0 conn(0x7fabfc0cd3e0 legacy=0x7fabfc160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fabfb7fe700 1 -- 172.21.15.5:0/270301457 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268799166 0 0) 0x7fabfc15e160 con 0x7fabfc0cd3e0 2023-03-03T06:23:35.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fac00c63700 1 -- 172.21.15.5:0/270301457 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc15d3c0 con 0x7fabfc15cd40 2023-03-03T06:23:35.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fac00c63700 1 --2- 172.21.15.5:0/270301457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc15cd40 0x7fabfc0b18d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fabfc068620 tx=0x7fabf0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfb7216c21431c9 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:35.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fabfb7fe700 1 -- 172.21.15.5:0/270301457 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0011830 con 0x7fabfc15cd40 2023-03-03T06:23:35.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fabfb7fe700 1 -- 172.21.15.5:0/270301457 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf0011990 con 0x7fabfc15cd40 2023-03-03T06:23:35.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fabfb7fe700 1 -- 172.21.15.5:0/270301457 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0011d20 con 0x7fabfc15cd40 2023-03-03T06:23:35.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fac02ec7700 1 -- 172.21.15.5:0/270301457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc15cd40 msgr2=0x7fabfc0b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fac02ec7700 1 --2- 172.21.15.5:0/270301457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc15cd40 0x7fabfc0b18d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fabfc068620 tx=0x7fabf0009b20 comp rx=0 tx=0).stop 2023-03-03T06:23:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fac02ec7700 1 -- 172.21.15.5:0/270301457 shutdown_connections 2023-03-03T06:23:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fac02ec7700 1 --2- 172.21.15.5:0/270301457 >> v2:172.21.15.191:3300/0 conn(0x7fabfc0cb9d0 0x7fabfc0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fac02ec7700 1 --2- 172.21.15.5:0/270301457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc15cd40 0x7fabfc0b18d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.771+0000 7fac02ec7700 1 -- 172.21.15.5:0/270301457 >> 172.21.15.5:0/270301457 conn(0x7fabfc0cc8d0 msgr2=0x7fabfc0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.772+0000 7fac02ec7700 1 -- 172.21.15.5:0/270301457 shutdown_connections 2023-03-03T06:23:35.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.772+0000 7fac02ec7700 1 -- 172.21.15.5:0/270301457 wait complete. 2023-03-03T06:23:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.773+0000 7fac02ec7700 1 Processor -- start 2023-03-03T06:23:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.773+0000 7fac02ec7700 1 -- start start 2023-03-03T06:23:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac02ec7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabfc0cb9d0 0x7fabfc0b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac02ec7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabfc0cd3e0 0x7fabfc14e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac02ec7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc15cd40 0x7fabfc14afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac02ec7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0b59b0 con 0x7fabfc15cd40 2023-03-03T06:23:35.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac02ec7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc14e8a0 con 0x7fabfc0cb9d0 2023-03-03T06:23:35.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac02ec7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0b4d30 con 0x7fabfc0cd3e0 2023-03-03T06:23:35.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac01464700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc15cd40 0x7fabfc14afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac01464700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc15cd40 0x7fabfc14afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40830/0 (socket says 172.21.15.5:40830) 2023-03-03T06:23:35.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac01464700 1 -- 172.21.15.5:0/2088728467 learned_addr learned my addr 172.21.15.5:0/2088728467 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:35.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac00c63700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabfc0cb9d0 0x7fabfc0b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fabfbfff700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabfc0cd3e0 0x7fabfc14e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac01464700 1 -- 172.21.15.5:0/2088728467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabfc0cd3e0 msgr2=0x7fabfc14e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac01464700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabfc0cd3e0 0x7fabfc14e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac01464700 1 -- 172.21.15.5:0/2088728467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabfc0cb9d0 msgr2=0x7fabfc0b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac01464700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabfc0cb9d0 0x7fabfc0b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac01464700 1 -- 172.21.15.5:0/2088728467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00094a0 con 0x7fabfc15cd40 2023-03-03T06:23:35.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac01464700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc15cd40 0x7fabfc14afe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fabf400efc0 tx=0x7fabf400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:35.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fabf97fa700 1 -- 172.21.15.5:0/2088728467 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf4009ea0 con 0x7fabfc15cd40 2023-03-03T06:23:35.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fabf97fa700 1 -- 172.21.15.5:0/2088728467 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf400f040 con 0x7fabfc15cd40 2023-03-03T06:23:35.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac02ec7700 1 -- 172.21.15.5:0/2088728467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc15d980 con 0x7fabfc15cd40 2023-03-03T06:23:35.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fabf97fa700 1 -- 172.21.15.5:0/2088728467 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400ced0 con 0x7fabfc15cd40 2023-03-03T06:23:35.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.774+0000 7fac02ec7700 1 -- 172.21.15.5:0/2088728467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc15d6a0 con 0x7fabfc15cd40 2023-03-03T06:23:35.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.775+0000 7fac02ec7700 1 -- 172.21.15.5:0/2088728467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabfc15dc60 con 0x7fabfc15cd40 2023-03-03T06:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.776+0000 7fabf97fa700 1 -- 172.21.15.5:0/2088728467 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7fabf4014480 con 0x7fabfc15cd40 2023-03-03T06:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.776+0000 7fabf97fa700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fabe00682a0 0x7fabe006a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.776+0000 7fabf97fa700 1 -- 172.21.15.5:0/2088728467 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fabf4086250 con 0x7fabfc15cd40 2023-03-03T06:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.776+0000 7fac00c63700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fabe00682a0 0x7fabe006a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:35.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.777+0000 7fac00c63700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fabe00682a0 0x7fabe006a750 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fabf00090b0 tx=0x7fabf001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:35.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.781+0000 7fabf97fa700 1 -- 172.21.15.5:0/2088728467 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fabf4052df0 con 0x7fabfc15cd40 2023-03-03T06:23:35.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.975+0000 7fac02ec7700 1 -- 172.21.15.5:0/2088728467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabfc04e6e0 con 0x7fabfc15cd40 2023-03-03T06:23:35.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.976+0000 7fabf97fa700 1 -- 172.21.15.5:0/2088728467 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabf4056410 con 0x7fabfc15cd40 2023-03-03T06:23:35.978 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:23:35.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.978+0000 7fac02ec7700 1 -- 172.21.15.5:0/2088728467 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fabe00682a0 msgr2=0x7fabe006a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.978+0000 7fac02ec7700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fabe00682a0 0x7fabe006a750 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fabf00090b0 tx=0x7fabf001c040 comp rx=0 tx=0).stop 2023-03-03T06:23:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.978+0000 7fac02ec7700 1 -- 172.21.15.5:0/2088728467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc15cd40 msgr2=0x7fabfc14afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.978+0000 7fac02ec7700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc15cd40 0x7fabfc14afe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fabf400efc0 tx=0x7fabf400c3a0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.978+0000 7fac02ec7700 1 -- 172.21.15.5:0/2088728467 shutdown_connections 2023-03-03T06:23:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.978+0000 7fac02ec7700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fabfc15cd40 0x7fabfc14afe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.978+0000 7fac02ec7700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabfc0cb9d0 0x7fabfc0b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.978+0000 7fac02ec7700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fabe00682a0 0x7fabe006a750 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.978+0000 7fac02ec7700 1 --2- 172.21.15.5:0/2088728467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fabfc0cd3e0 0x7fabfc14e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.978+0000 7fac02ec7700 1 -- 172.21.15.5:0/2088728467 >> 172.21.15.5:0/2088728467 conn(0x7fabfc0cc8d0 msgr2=0x7fabfc0aeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.978+0000 7fac02ec7700 1 -- 172.21.15.5:0/2088728467 shutdown_connections 2023-03-03T06:23:35.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:35.978+0000 7fac02ec7700 1 -- 172.21.15.5:0/2088728467 wait complete. 2023-03-03T06:23:35.992 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:23:36.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.117+0000 7feb37165700 1 Processor -- start 2023-03-03T06:23:36.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.117+0000 7feb37165700 1 -- start start 2023-03-03T06:23:36.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb37165700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb3015cd40 0x7feb300b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb37165700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7feb300cba50 0x7feb300b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb37165700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3015d4e0 con 0x7feb300cd3e0 2023-03-03T06:23:36.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb37165700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3015d7c0 con 0x7feb300cba50 2023-03-03T06:23:36.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb37165700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3015daa0 con 0x7feb3015cd40 2023-03-03T06:23:36.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb35702700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feb300cd3e0 0x7feb30160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58922/0 (socket says 172.21.15.5:58922) 2023-03-03T06:23:36.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb35702700 1 -- 172.21.15.5:0/269152210 learned_addr learned my addr 172.21.15.5:0/269152210 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:36.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb34f01700 1 --2- 172.21.15.5:0/269152210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb3015cd40 0x7feb300b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2ffff700 1 --2- 172.21.15.5:0/269152210 >> v2:172.21.15.191:3300/0 conn(0x7feb300cba50 0x7feb300b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558894633 0 0) 0x7feb3015d4e0 con 0x7feb300cd3e0 2023-03-03T06:23:36.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb200035b0 con 0x7feb300cd3e0 2023-03-03T06:23:36.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1156659873 0 0) 0x7feb200035b0 con 0x7feb300cd3e0 2023-03-03T06:23:36.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb3015cd40 msgr2=0x7feb300b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:36.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 --2- 172.21.15.5:0/269152210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb3015cd40 0x7feb300b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 >> v2:172.21.15.191:3300/0 conn(0x7feb300cba50 msgr2=0x7feb300b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:36.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 --2- 172.21.15.5:0/269152210 >> v2:172.21.15.191:3300/0 conn(0x7feb300cba50 0x7feb300b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3015dd80 con 0x7feb300cd3e0 2023-03-03T06:23:36.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7feb280019f0 con 0x7feb300cd3e0 2023-03-03T06:23:36.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 >> v1:172.21.15.5:6789/0 conn(0x7feb300cd3e0 legacy=0x7feb30160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 --2- 172.21.15.5:0/269152210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb20003a70 0x7feb20003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 --2- 172.21.15.5:0/269152210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb20004850 0x7feb20004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 --2- 172.21.15.5:0/269152210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb20005200 0x7feb2000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3015d7c0 con 0x7feb20004850 2023-03-03T06:23:36.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3015daa0 con 0x7feb20003a70 2023-03-03T06:23:36.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.118+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2000bf50 con 0x7feb20005200 2023-03-03T06:23:36.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb34f01700 1 --2- 172.21.15.5:0/269152210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb3015cd40 0x7feb300b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:36.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb2ffff700 1 --2- 172.21.15.5:0/269152210 >> v2:172.21.15.191:3300/0 conn(0x7feb300cba50 0x7feb300b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:36.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb35702700 1 --2- 172.21.15.5:0/269152210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb20005200 0x7feb2000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb2ffff700 1 --2- 172.21.15.5:0/269152210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb20004850 0x7feb20004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb34f01700 1 --2- 172.21.15.5:0/269152210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb20003a70 0x7feb20003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb2ffff700 1 -- 172.21.15.5:0/269152210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb20005200 msgr2=0x7feb2000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:36.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb2ffff700 1 --2- 172.21.15.5:0/269152210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb20005200 0x7feb2000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb2ffff700 1 -- 172.21.15.5:0/269152210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb20003a70 msgr2=0x7feb20003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:36.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb2ffff700 1 --2- 172.21.15.5:0/269152210 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb20003a70 0x7feb20003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb2ffff700 1 -- 172.21.15.5:0/269152210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb200035b0 con 0x7feb20004850 2023-03-03T06:23:36.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb2ffff700 1 --2- 172.21.15.5:0/269152210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb20004850 0x7feb20004cc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feb1c009cf0 tx=0x7feb20005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b30d970fb67b2c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:36.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c004030 con 0x7feb20004850 2023-03-03T06:23:36.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c004190 con 0x7feb20004850 2023-03-03T06:23:36.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.119+0000 7feb2f7fe700 1 -- 172.21.15.5:0/269152210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c004500 con 0x7feb20004850 2023-03-03T06:23:36.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.120+0000 7feb37165700 1 -- 172.21.15.5:0/269152210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb20004850 msgr2=0x7feb20004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.120+0000 7feb37165700 1 --2- 172.21.15.5:0/269152210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb20004850 0x7feb20004cc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feb1c009cf0 tx=0x7feb20005880 comp rx=0 tx=0).stop 2023-03-03T06:23:36.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.120+0000 7feb35702700 1 -- 172.21.15.5:0/269152210 reap_dead start 2023-03-03T06:23:36.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.120+0000 7feb37165700 1 -- 172.21.15.5:0/269152210 shutdown_connections 2023-03-03T06:23:36.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.120+0000 7feb37165700 1 -- 172.21.15.5:0/269152210 >> 172.21.15.5:0/269152210 conn(0x7feb300cc8d0 msgr2=0x7feb300cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:36.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.120+0000 7feb37165700 1 -- 172.21.15.5:0/269152210 shutdown_connections 2023-03-03T06:23:36.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.120+0000 7feb37165700 1 -- 172.21.15.5:0/269152210 wait complete. 2023-03-03T06:23:36.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.121+0000 7feb37165700 1 Processor -- start 2023-03-03T06:23:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.121+0000 7feb37165700 1 -- start start 2023-03-03T06:23:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb37165700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb20004850 0x7feb300b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb37165700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb301521e0 0x7feb300cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb37165700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb30152650 0x7feb300cf670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb37165700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb301f28b0 con 0x7feb301521e0 2023-03-03T06:23:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb37165700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb301f2b90 con 0x7feb20004850 2023-03-03T06:23:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb37165700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb301f2e70 con 0x7feb30152650 2023-03-03T06:23:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb2ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb301521e0 0x7feb300cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb2ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb301521e0 0x7feb300cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40858/0 (socket says 172.21.15.5:40858) 2023-03-03T06:23:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb2ffff700 1 -- 172.21.15.5:0/1242380790 learned_addr learned my addr 172.21.15.5:0/1242380790 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:36.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb34f01700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb20004850 0x7feb300b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb2ffff700 1 -- 172.21.15.5:0/1242380790 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb30152650 msgr2=0x7feb300cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb35702700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb30152650 0x7feb300cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb2ffff700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb30152650 0x7feb300cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb2ffff700 1 -- 172.21.15.5:0/1242380790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb20004850 msgr2=0x7feb300b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb2ffff700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb20004850 0x7feb300b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb2ffff700 1 -- 172.21.15.5:0/1242380790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb300ca530 con 0x7feb301521e0 2023-03-03T06:23:36.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.122+0000 7feb2ffff700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb301521e0 0x7feb300cf130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00e4b0 tx=0x7feb1c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.123+0000 7feb2d7fa700 1 -- 172.21.15.5:0/1242380790 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c021070 con 0x7feb301521e0 2023-03-03T06:23:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.123+0000 7feb2d7fa700 1 -- 172.21.15.5:0/1242380790 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c0038b0 con 0x7feb301521e0 2023-03-03T06:23:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.123+0000 7feb37165700 1 -- 172.21.15.5:0/1242380790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3015e060 con 0x7feb301521e0 2023-03-03T06:23:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.123+0000 7feb2d7fa700 1 -- 172.21.15.5:0/1242380790 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c004030 con 0x7feb301521e0 2023-03-03T06:23:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.123+0000 7feb37165700 1 -- 172.21.15.5:0/1242380790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3015d110 con 0x7feb301521e0 2023-03-03T06:23:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.124+0000 7feb37165700 1 -- 172.21.15.5:0/1242380790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb301f34c0 con 0x7feb301521e0 2023-03-03T06:23:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.124+0000 7feb2d7fa700 1 -- 172.21.15.5:0/1242380790 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7feb1c02c020 con 0x7feb301521e0 2023-03-03T06:23:36.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.125+0000 7feb2d7fa700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feb140682a0 0x7feb1406a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.125+0000 7feb2d7fa700 1 -- 172.21.15.5:0/1242380790 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feb1c086c40 con 0x7feb301521e0 2023-03-03T06:23:36.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.125+0000 7feb34f01700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feb140682a0 0x7feb1406a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.125+0000 7feb34f01700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feb140682a0 0x7feb1406a750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb300cef40 tx=0x7feb24008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:36.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.129+0000 7feb2d7fa700 1 -- 172.21.15.5:0/1242380790 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7feb1c0b85e0 con 0x7feb301521e0 2023-03-03T06:23:36.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.148+0000 7feb2d7fa700 1 -- 172.21.15.5:0/1242380790 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7feb1c019070 con 0x7feb301521e0 2023-03-03T06:23:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.368+0000 7feb37165700 1 -- 172.21.15.5:0/1242380790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb3004e6e0 con 0x7feb301521e0 2023-03-03T06:23:36.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.368+0000 7feb2d7fa700 1 -- 172.21.15.5:0/1242380790 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3518 (secure 0 0 0) 0x7feb1c06c020 con 0x7feb301521e0 2023-03-03T06:23:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:36.371 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/277386051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":277386051},{"type":"v1","addr":"172.21.15.5:6837","nonce":277386051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2875199515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2875199515},{"type":"v1","addr":"172.21.15.191:6835","nonce":2875199515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2122425608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2122425608},{"type":"v1","addr":"172.21.15.191:6833","nonce":2122425608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/305842942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":305842942},{"type":"v1","addr":"172.21.15.5:6836","nonce":305842942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-03-03T06:23:36.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.370+0000 7feb37165700 1 -- 172.21.15.5:0/1242380790 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feb140682a0 msgr2=0x7feb1406a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.370+0000 7feb37165700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feb140682a0 0x7feb1406a750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb300cef40 tx=0x7feb24008040 comp rx=0 tx=0).stop 2023-03-03T06:23:36.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.370+0000 7feb37165700 1 -- 172.21.15.5:0/1242380790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb301521e0 msgr2=0x7feb300cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.370+0000 7feb37165700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb301521e0 0x7feb300cf130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00e4b0 tx=0x7feb1c0047c0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.371+0000 7feb37165700 1 -- 172.21.15.5:0/1242380790 shutdown_connections 2023-03-03T06:23:36.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.371+0000 7feb37165700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feb140682a0 0x7feb1406a750 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.371+0000 7feb37165700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb30152650 0x7feb300cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.371+0000 7feb37165700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb20004850 0x7feb300b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.371+0000 7feb37165700 1 --2- 172.21.15.5:0/1242380790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb301521e0 0x7feb300cf130 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.371+0000 7feb37165700 1 -- 172.21.15.5:0/1242380790 >> 172.21.15.5:0/1242380790 conn(0x7feb300cc8d0 msgr2=0x7feb300cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.371+0000 7feb37165700 1 -- 172.21.15.5:0/1242380790 shutdown_connections 2023-03-03T06:23:36.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.371+0000 7feb37165700 1 -- 172.21.15.5:0/1242380790 wait complete. 2023-03-03T06:23:36.375 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2023-03-03T06:23:36.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:23:36.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.508+0000 7f1b47fd6700 1 Processor -- start 2023-03-03T06:23:36.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.508+0000 7f1b47fd6700 1 -- start start 2023-03-03T06:23:36.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.509+0000 7f1b47fd6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b4015cd40 0x7f1b400b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.509+0000 7f1b47fd6700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b401615b0 con 0x7f1b400cef60 2023-03-03T06:23:36.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.509+0000 7f1b47fd6700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4015d4e0 con 0x7f1b400cba50 2023-03-03T06:23:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.509+0000 7f1b47fd6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4015d7c0 con 0x7f1b4015cd40 2023-03-03T06:23:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.509+0000 7f1b46573700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1b400cef60 0x7f1b40160ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58942/0 (socket says 172.21.15.5:58942) 2023-03-03T06:23:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.509+0000 7f1b46573700 1 -- 172.21.15.5:0/4111072315 learned_addr learned my addr 172.21.15.5:0/4111072315 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.509+0000 7f1b45d72700 1 --2- 172.21.15.5:0/4111072315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b4015cd40 0x7f1b400b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.510+0000 7f1b44d70700 1 -- 172.21.15.5:0/4111072315 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115838281 0 0) 0x7f1b401615b0 con 0x7f1b400cef60 2023-03-03T06:23:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.510+0000 7f1b44d70700 1 -- 172.21.15.5:0/4111072315 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b2c0035b0 con 0x7f1b400cef60 2023-03-03T06:23:36.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.510+0000 7f1b44d70700 1 -- 172.21.15.5:0/4111072315 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944425038 0 0) 0x7f1b4015d4e0 con 0x7f1b400cba50 2023-03-03T06:23:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.510+0000 7f1b44d70700 1 -- 172.21.15.5:0/4111072315 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b401615b0 con 0x7f1b400cba50 2023-03-03T06:23:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.510+0000 7f1b45d72700 1 -- 172.21.15.5:0/4111072315 >> v1:172.21.15.191:6789/0 conn(0x7f1b400cba50 legacy=0x7f1b40160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.510+0000 7f1b45d72700 1 -- 172.21.15.5:0/4111072315 >> v1:172.21.15.5:6789/0 conn(0x7f1b400cef60 legacy=0x7f1b40160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.510+0000 7f1b45d72700 1 -- 172.21.15.5:0/4111072315 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4015daa0 con 0x7f1b4015cd40 2023-03-03T06:23:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.510+0000 7f1b45d72700 1 --2- 172.21.15.5:0/4111072315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b4015cd40 0x7f1b400b18d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009870 tx=0x7f1b30009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5306f8189123691 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.510+0000 7f1b44d70700 1 -- 172.21.15.5:0/4111072315 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30011830 con 0x7f1b4015cd40 2023-03-03T06:23:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.510+0000 7f1b44d70700 1 -- 172.21.15.5:0/4111072315 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30011990 con 0x7f1b4015cd40 2023-03-03T06:23:36.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.510+0000 7f1b44d70700 1 -- 172.21.15.5:0/4111072315 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30011d00 con 0x7f1b4015cd40 2023-03-03T06:23:36.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.511+0000 7f1b47fd6700 1 -- 172.21.15.5:0/4111072315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b4015cd40 msgr2=0x7f1b400b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.511+0000 7f1b47fd6700 1 --2- 172.21.15.5:0/4111072315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b4015cd40 0x7f1b400b18d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009870 tx=0x7f1b30009b80 comp rx=0 tx=0).stop 2023-03-03T06:23:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.511+0000 7f1b47fd6700 1 -- 172.21.15.5:0/4111072315 shutdown_connections 2023-03-03T06:23:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.511+0000 7f1b47fd6700 1 --2- 172.21.15.5:0/4111072315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b4015cd40 0x7f1b400b18d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.511+0000 7f1b47fd6700 1 -- 172.21.15.5:0/4111072315 >> 172.21.15.5:0/4111072315 conn(0x7f1b400cc8d0 msgr2=0x7f1b400cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.511+0000 7f1b47fd6700 1 -- 172.21.15.5:0/4111072315 shutdown_connections 2023-03-03T06:23:36.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.511+0000 7f1b47fd6700 1 -- 172.21.15.5:0/4111072315 wait complete. 2023-03-03T06:23:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.512+0000 7f1b47fd6700 1 Processor -- start 2023-03-03T06:23:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.512+0000 7f1b47fd6700 1 -- start start 2023-03-03T06:23:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.513+0000 7f1b47fd6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b400cba50 0x7f1b40151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.513+0000 7f1b47fd6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b400cef60 0x7f1b400ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.513+0000 7f1b47fd6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b4015cd40 0x7f1b400b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.513+0000 7f1b47fd6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400ad600 con 0x7f1b4015cd40 2023-03-03T06:23:36.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.513+0000 7f1b47fd6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400acd60 con 0x7f1b400cba50 2023-03-03T06:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.513+0000 7f1b47fd6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400ad040 con 0x7f1b400cef60 2023-03-03T06:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.513+0000 7f1b46573700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b4015cd40 0x7f1b400b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.513+0000 7f1b46573700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b4015cd40 0x7f1b400b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40874/0 (socket says 172.21.15.5:40874) 2023-03-03T06:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.513+0000 7f1b46573700 1 -- 172.21.15.5:0/1880852444 learned_addr learned my addr 172.21.15.5:0/1880852444 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.513+0000 7f1b45571700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b400cef60 0x7f1b400ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.513+0000 7f1b45d72700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b400cba50 0x7f1b40151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.514+0000 7f1b46573700 1 -- 172.21.15.5:0/1880852444 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b400cef60 msgr2=0x7f1b400ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.514+0000 7f1b46573700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b400cef60 0x7f1b400ac2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.514+0000 7f1b46573700 1 -- 172.21.15.5:0/1880852444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b400cba50 msgr2=0x7f1b40151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.514+0000 7f1b46573700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b400cba50 0x7f1b40151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.514+0000 7f1b46573700 1 -- 172.21.15.5:0/1880852444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b300094a0 con 0x7f1b4015cd40 2023-03-03T06:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.514+0000 7f1b46573700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b4015cd40 0x7f1b400b4b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800cba0 tx=0x7f1b3800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.514+0000 7f1b367fc700 1 -- 172.21.15.5:0/1880852444 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3800aa40 con 0x7f1b4015cd40 2023-03-03T06:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.514+0000 7f1b367fc700 1 -- 172.21.15.5:0/1880852444 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3800aba0 con 0x7f1b4015cd40 2023-03-03T06:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.514+0000 7f1b47fd6700 1 -- 172.21.15.5:0/1880852444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4015e060 con 0x7f1b4015cd40 2023-03-03T06:23:36.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.514+0000 7f1b367fc700 1 -- 172.21.15.5:0/1880852444 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38012400 con 0x7f1b4015cd40 2023-03-03T06:23:36.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.514+0000 7f1b47fd6700 1 -- 172.21.15.5:0/1880852444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4015dd80 con 0x7f1b4015cd40 2023-03-03T06:23:36.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.515+0000 7f1b47fd6700 1 -- 172.21.15.5:0/1880852444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b400ca530 con 0x7f1b4015cd40 2023-03-03T06:23:36.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.515+0000 7f1b367fc700 1 -- 172.21.15.5:0/1880852444 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1b38019030 con 0x7f1b4015cd40 2023-03-03T06:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.516+0000 7f1b367fc700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1b240682f0 0x7f1b2406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.516+0000 7f1b367fc700 1 -- 172.21.15.5:0/1880852444 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1b380854a0 con 0x7f1b4015cd40 2023-03-03T06:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.516+0000 7f1b45d72700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1b240682f0 0x7f1b2406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.516+0000 7f1b45d72700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1b240682f0 0x7f1b2406a7a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b300090b0 tx=0x7f1b30008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:36.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.520+0000 7f1b367fc700 1 -- 172.21.15.5:0/1880852444 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1b38052050 con 0x7f1b4015cd40 2023-03-03T06:23:36.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.716+0000 7f1b47fd6700 1 -- 172.21.15.5:0/1880852444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b4004e6e0 con 0x7f1b4015cd40 2023-03-03T06:23:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.716+0000 7f1b367fc700 1 -- 172.21.15.5:0/1880852444 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14063 (secure 0 0 0) 0x7f1b38055670 con 0x7f1b4015cd40 2023-03-03T06:23:36.719 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:36.719 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:35.876259+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:23:36.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.718+0000 7f1b47fd6700 1 -- 172.21.15.5:0/1880852444 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1b240682f0 msgr2=0x7f1b2406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.718+0000 7f1b47fd6700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1b240682f0 0x7f1b2406a7a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b300090b0 tx=0x7f1b30008030 comp rx=0 tx=0).stop 2023-03-03T06:23:36.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.719+0000 7f1b47fd6700 1 -- 172.21.15.5:0/1880852444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b4015cd40 msgr2=0x7f1b400b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.719+0000 7f1b47fd6700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b4015cd40 0x7f1b400b4b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800cba0 tx=0x7f1b3800ceb0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.719+0000 7f1b47fd6700 1 -- 172.21.15.5:0/1880852444 shutdown_connections 2023-03-03T06:23:36.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.719+0000 7f1b47fd6700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b4015cd40 0x7f1b400b4b20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.719+0000 7f1b47fd6700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1b400cba50 0x7f1b40151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.719+0000 7f1b47fd6700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1b240682f0 0x7f1b2406a7a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.719+0000 7f1b47fd6700 1 --2- 172.21.15.5:0/1880852444 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1b400cef60 0x7f1b400ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.719+0000 7f1b47fd6700 1 -- 172.21.15.5:0/1880852444 >> 172.21.15.5:0/1880852444 conn(0x7f1b400cc8d0 msgr2=0x7f1b400cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:36.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.719+0000 7f1b47fd6700 1 -- 172.21.15.5:0/1880852444 shutdown_connections 2023-03-03T06:23:36.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.719+0000 7f1b47fd6700 1 -- 172.21.15.5:0/1880852444 wait complete. 2023-03-03T06:23:36.733 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T06:23:36.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:23:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.858+0000 7f1e5806e700 1 Processor -- start 2023-03-03T06:23:36.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.859+0000 7f1e5806e700 1 -- start start 2023-03-03T06:23:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.859+0000 7f1e5806e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1e500b1fe0 0x7f1e5015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.859+0000 7f1e5806e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e500cc5d0 con 0x7f1e500cd500 2023-03-03T06:23:36.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.859+0000 7f1e5806e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e50159c30 con 0x7f1e500b55b0 2023-03-03T06:23:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.859+0000 7f1e5806e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5015e290 con 0x7f1e500b1fe0 2023-03-03T06:23:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.859+0000 7f1e55609700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1e500cd500 0x7f1e500cdf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58954/0 (socket says 172.21.15.5:58954) 2023-03-03T06:23:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.859+0000 7f1e55609700 1 -- 172.21.15.5:0/4112231587 learned_addr learned my addr 172.21.15.5:0/4112231587 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:36.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.860+0000 7f1e5660b700 1 --2- 172.21.15.5:0/4112231587 >> v2:172.21.15.191:3300/0 conn(0x7f1e500b1fe0 0x7f1e5015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.860+0000 7f1e54e08700 1 -- 172.21.15.5:0/4112231587 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197326150 0 0) 0x7f1e500cc5d0 con 0x7f1e500cd500 2023-03-03T06:23:36.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.860+0000 7f1e54e08700 1 -- 172.21.15.5:0/4112231587 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e3c0035b0 con 0x7f1e500cd500 2023-03-03T06:23:36.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.860+0000 7f1e5660b700 1 -- 172.21.15.5:0/4112231587 >> v1:172.21.15.191:6789/0 conn(0x7f1e500b55b0 legacy=0x7f1e500b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.860+0000 7f1e54e08700 1 -- 172.21.15.5:0/4112231587 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2985740507 0 0) 0x7f1e3c0035b0 con 0x7f1e500cd500 2023-03-03T06:23:36.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.860+0000 7f1e5660b700 1 -- 172.21.15.5:0/4112231587 >> v1:172.21.15.5:6789/0 conn(0x7f1e500cd500 legacy=0x7f1e500cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.860+0000 7f1e5660b700 1 -- 172.21.15.5:0/4112231587 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e500b5980 con 0x7f1e500b1fe0 2023-03-03T06:23:36.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.860+0000 7f1e5660b700 1 --2- 172.21.15.5:0/4112231587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e500b1fe0 0x7f1e5015dd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009d90 tx=0x7f1e4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=891f5090294951d2 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:36.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.860+0000 7f1e54e08700 1 -- 172.21.15.5:0/4112231587 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4800e070 con 0x7f1e500b1fe0 2023-03-03T06:23:36.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.860+0000 7f1e54e08700 1 -- 172.21.15.5:0/4112231587 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e48003a20 con 0x7f1e500b1fe0 2023-03-03T06:23:36.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.860+0000 7f1e54e08700 1 -- 172.21.15.5:0/4112231587 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c001670 con 0x7f1e500b1fe0 2023-03-03T06:23:36.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.861+0000 7f1e5806e700 1 -- 172.21.15.5:0/4112231587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e500b1fe0 msgr2=0x7f1e5015dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.861+0000 7f1e5806e700 1 --2- 172.21.15.5:0/4112231587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e500b1fe0 0x7f1e5015dd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009d90 tx=0x7f1e4800b330 comp rx=0 tx=0).stop 2023-03-03T06:23:36.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.861+0000 7f1e5806e700 1 -- 172.21.15.5:0/4112231587 shutdown_connections 2023-03-03T06:23:36.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.861+0000 7f1e5806e700 1 --2- 172.21.15.5:0/4112231587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e500b1fe0 0x7f1e5015dd50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.861+0000 7f1e5806e700 1 -- 172.21.15.5:0/4112231587 >> 172.21.15.5:0/4112231587 conn(0x7f1e500cc8d0 msgr2=0x7f1e500cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:36.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.861+0000 7f1e5806e700 1 -- 172.21.15.5:0/4112231587 shutdown_connections 2023-03-03T06:23:36.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.861+0000 7f1e5806e700 1 -- 172.21.15.5:0/4112231587 wait complete. 2023-03-03T06:23:36.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.863+0000 7f1e5806e700 1 Processor -- start 2023-03-03T06:23:36.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.863+0000 7f1e5806e700 1 -- start start 2023-03-03T06:23:36.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.863+0000 7f1e5806e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e500b1fe0 0x7f1e50154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5806e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e500b55b0 0x7f1e501ef030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5806e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e500cd500 0x7f1e5015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5806e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500c6fc0 con 0x7f1e500cd500 2023-03-03T06:23:36.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5806e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500c7260 con 0x7f1e500b55b0 2023-03-03T06:23:36.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5806e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500c7540 con 0x7f1e500b1fe0 2023-03-03T06:23:36.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5660b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e500cd500 0x7f1e5015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5660b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e500cd500 0x7f1e5015a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40888/0 (socket says 172.21.15.5:40888) 2023-03-03T06:23:36.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5660b700 1 -- 172.21.15.5:0/4228205996 learned_addr learned my addr 172.21.15.5:0/4228205996 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:36.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e55e0a700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e500b1fe0 0x7f1e50154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e55609700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e500b55b0 0x7f1e501ef030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5660b700 1 -- 172.21.15.5:0/4228205996 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e500b1fe0 msgr2=0x7f1e50154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5660b700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e500b1fe0 0x7f1e50154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5660b700 1 -- 172.21.15.5:0/4228205996 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e500b55b0 msgr2=0x7f1e501ef030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:36.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5660b700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e500b55b0 0x7f1e501ef030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:36.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5660b700 1 -- 172.21.15.5:0/4228205996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e48009a70 con 0x7f1e500cd500 2023-03-03T06:23:36.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e55609700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e500b55b0 0x7f1e501ef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:36.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5660b700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e500cd500 0x7f1e5015a7d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800b370 tx=0x7f1e48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:36.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e467fc700 1 -- 172.21.15.5:0/4228205996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e48009450 con 0x7f1e500cd500 2023-03-03T06:23:36.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5806e700 1 -- 172.21.15.5:0/4228205996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e500cbca0 con 0x7f1e500cd500 2023-03-03T06:23:36.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e467fc700 1 -- 172.21.15.5:0/4228205996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e480045e0 con 0x7f1e500cd500 2023-03-03T06:23:36.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e467fc700 1 -- 172.21.15.5:0/4228205996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e48012450 con 0x7f1e500cd500 2023-03-03T06:23:36.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.864+0000 7f1e5806e700 1 -- 172.21.15.5:0/4228205996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e500cb9c0 con 0x7f1e500cd500 2023-03-03T06:23:36.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.865+0000 7f1e5806e700 1 -- 172.21.15.5:0/4228205996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e500cbf80 con 0x7f1e500cd500 2023-03-03T06:23:36.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.866+0000 7f1e467fc700 1 -- 172.21.15.5:0/4228205996 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1e48024030 con 0x7f1e500cd500 2023-03-03T06:23:36.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.866+0000 7f1e467fc700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1e340682f0 0x7f1e3406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:36.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.866+0000 7f1e467fc700 1 -- 172.21.15.5:0/4228205996 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1e48087310 con 0x7f1e500cd500 2023-03-03T06:23:36.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.866+0000 7f1e55e0a700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1e340682f0 0x7f1e3406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:36.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.867+0000 7f1e55e0a700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1e340682f0 0x7f1e3406a7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1e40001300 tx=0x7f1e40009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:36.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:36.871+0000 7f1e467fc700 1 -- 172.21.15.5:0/4228205996 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1e48053cf0 con 0x7f1e500cd500 2023-03-03T06:23:37.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.066+0000 7f1e5806e700 1 -- 172.21.15.5:0/4228205996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1e5004e6e0 con 0x7f1e500cd500 2023-03-03T06:23:37.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.066+0000 7f1e467fc700 1 -- 172.21.15.5:0/4228205996 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1e48057310 con 0x7f1e500cd500 2023-03-03T06:23:37.069 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:23:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.068+0000 7f1e5806e700 1 -- 172.21.15.5:0/4228205996 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1e340682f0 msgr2=0x7f1e3406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.068+0000 7f1e5806e700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1e340682f0 0x7f1e3406a7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1e40001300 tx=0x7f1e40009040 comp rx=0 tx=0).stop 2023-03-03T06:23:37.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.068+0000 7f1e5806e700 1 -- 172.21.15.5:0/4228205996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e500cd500 msgr2=0x7f1e5015a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.068+0000 7f1e5806e700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e500cd500 0x7f1e5015a7d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800b370 tx=0x7f1e48004ad0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.068+0000 7f1e5806e700 1 -- 172.21.15.5:0/4228205996 shutdown_connections 2023-03-03T06:23:37.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.068+0000 7f1e5806e700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e500cd500 0x7f1e5015a7d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.068+0000 7f1e5806e700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1e340682f0 0x7f1e3406a7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.068+0000 7f1e5806e700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1e500b1fe0 0x7f1e50154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.068+0000 7f1e5806e700 1 --2- 172.21.15.5:0/4228205996 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e500b55b0 0x7f1e501ef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.068+0000 7f1e5806e700 1 -- 172.21.15.5:0/4228205996 >> 172.21.15.5:0/4228205996 conn(0x7f1e500cc8d0 msgr2=0x7f1e50158fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.068+0000 7f1e5806e700 1 -- 172.21.15.5:0/4228205996 shutdown_connections 2023-03-03T06:23:37.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.068+0000 7f1e5806e700 1 -- 172.21.15.5:0/4228205996 wait complete. 2023-03-03T06:23:37.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:23:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.209+0000 7f3de73a3700 1 Processor -- start 2023-03-03T06:23:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.209+0000 7f3de73a3700 1 -- start start 2023-03-03T06:23:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3de73a3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3de00cd500 0x7f3de015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3de73a3700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de00cc5d0 con 0x7f3de00b1fe0 2023-03-03T06:23:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3de73a3700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de0159c30 con 0x7f3de00b55b0 2023-03-03T06:23:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3de73a3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de015e290 con 0x7f3de00cd500 2023-03-03T06:23:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3de5940700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3de00b1fe0 0x7f3de00cdf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:58970/0 (socket says 172.21.15.5:58970) 2023-03-03T06:23:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3de5940700 1 -- 172.21.15.5:0/2048135549 learned_addr learned my addr 172.21.15.5:0/2048135549 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3de493e700 1 --2- 172.21.15.5:0/2048135549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3de00cd500 0x7f3de015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447752033 0 0) 0x7f3de00cc5d0 con 0x7f3de00b1fe0 2023-03-03T06:23:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dcc0057c0 con 0x7f3de00b1fe0 2023-03-03T06:23:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666567883 0 0) 0x7f3de0159c30 con 0x7f3de00b55b0 2023-03-03T06:23:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de00cc5d0 con 0x7f3de00b55b0 2023-03-03T06:23:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1014791341 0 0) 0x7f3dcc0057c0 con 0x7f3de00b1fe0 2023-03-03T06:23:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3de00cd500 msgr2=0x7f3de015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:37.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3dd7fff700 1 --2- 172.21.15.5:0/2048135549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3de00cd500 0x7f3de015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 >> v1:172.21.15.191:6789/0 conn(0x7f3de00b55b0 legacy=0x7f3de00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00b5980 con 0x7f3de00b1fe0 2023-03-03T06:23:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f3dd80019f0 con 0x7f3de00b1fe0 2023-03-03T06:23:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3de493e700 1 --2- 172.21.15.5:0/2048135549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3de00cd500 0x7f3de015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 >> v1:172.21.15.5:6789/0 conn(0x7f3de00b1fe0 legacy=0x7f3de00cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.210+0000 7f3dd7fff700 1 --2- 172.21.15.5:0/2048135549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3de00cd500 0x7f3dcc005dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3dd7fff700 1 --2- 172.21.15.5:0/2048135549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dcc006360 0x7f3dcc006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3dd7fff700 1 --2- 172.21.15.5:0/2048135549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc006fa0 0x7f3dcc007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc00dcd0 con 0x7f3dcc006fa0 2023-03-03T06:23:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc00de40 con 0x7f3dcc006360 2023-03-03T06:23:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc00e000 con 0x7f3de00cd500 2023-03-03T06:23:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3de5940700 1 --2- 172.21.15.5:0/2048135549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc006fa0 0x7f3dcc007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3de513f700 1 --2- 172.21.15.5:0/2048135549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3de00cd500 0x7f3dcc005dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3de493e700 1 --2- 172.21.15.5:0/2048135549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dcc006360 0x7f3dcc006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3de5940700 1 -- 172.21.15.5:0/2048135549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3de00cd500 msgr2=0x7f3dcc005dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3de5940700 1 --2- 172.21.15.5:0/2048135549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3de00cd500 0x7f3dcc005dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3de5940700 1 -- 172.21.15.5:0/2048135549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dcc006360 msgr2=0x7f3dcc006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3de5940700 1 --2- 172.21.15.5:0/2048135549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3dcc006360 0x7f3dcc006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3de5940700 1 -- 172.21.15.5:0/2048135549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00094a0 con 0x7f3dcc006fa0 2023-03-03T06:23:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3de5940700 1 --2- 172.21.15.5:0/2048135549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc006fa0 0x7f3dcc007410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3de0070cf0 tx=0x7f3dcc007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a3135a880ba407 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd80072d0 con 0x7f3dcc006fa0 2023-03-03T06:23:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd8007430 con 0x7f3dcc006fa0 2023-03-03T06:23:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.211+0000 7f3dd7fff700 1 -- 172.21.15.5:0/2048135549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd80077e0 con 0x7f3dcc006fa0 2023-03-03T06:23:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.212+0000 7f3de73a3700 1 -- 172.21.15.5:0/2048135549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc006fa0 msgr2=0x7f3dcc007410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.212+0000 7f3de73a3700 1 --2- 172.21.15.5:0/2048135549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3dcc006fa0 0x7f3dcc007410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3de0070cf0 tx=0x7f3dcc007a90 comp rx=0 tx=0).stop 2023-03-03T06:23:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.212+0000 7f3de5940700 1 -- 172.21.15.5:0/2048135549 reap_dead start 2023-03-03T06:23:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.212+0000 7f3de73a3700 1 -- 172.21.15.5:0/2048135549 shutdown_connections 2023-03-03T06:23:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.212+0000 7f3de73a3700 1 -- 172.21.15.5:0/2048135549 >> 172.21.15.5:0/2048135549 conn(0x7f3de00cc8d0 msgr2=0x7f3de00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.212+0000 7f3de73a3700 1 -- 172.21.15.5:0/2048135549 shutdown_connections 2023-03-03T06:23:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.212+0000 7f3de73a3700 1 -- 172.21.15.5:0/2048135549 wait complete. 2023-03-03T06:23:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.213+0000 7f3de73a3700 1 Processor -- start 2023-03-03T06:23:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.213+0000 7f3de73a3700 1 -- start start 2023-03-03T06:23:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de73a3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3dcc006fa0 0x7f3de00afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de73a3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3de00b0080 0x7f3de00c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de73a3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de00c8380 0x7f3de00c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de73a3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00c8d30 con 0x7f3de00c8380 2023-03-03T06:23:37.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de73a3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00c39f0 con 0x7f3de00b0080 2023-03-03T06:23:37.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de73a3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de014d8a0 con 0x7f3dcc006fa0 2023-03-03T06:23:37.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de5940700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de00c8380 0x7f3de00c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de5940700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de00c8380 0x7f3de00c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40908/0 (socket says 172.21.15.5:40908) 2023-03-03T06:23:37.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de5940700 1 -- 172.21.15.5:0/2436170518 learned_addr learned my addr 172.21.15.5:0/2436170518 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de513f700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3dcc006fa0 0x7f3de00afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de493e700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3de00b0080 0x7f3de00c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de5940700 1 -- 172.21.15.5:0/2436170518 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3dcc006fa0 msgr2=0x7f3de00afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de5940700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3dcc006fa0 0x7f3de00afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de5940700 1 -- 172.21.15.5:0/2436170518 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3de00b0080 msgr2=0x7f3de00c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de5940700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3de00b0080 0x7f3de00c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de5940700 1 -- 172.21.15.5:0/2436170518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00cbca0 con 0x7f3de00c8380 2023-03-03T06:23:37.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3de5940700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de00c8380 0x7f3de00c87f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00de10 tx=0x7f3dd8001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:37.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.214+0000 7f3dd5ffb700 1 -- 172.21.15.5:0/2436170518 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8025030 con 0x7f3de00c8380 2023-03-03T06:23:37.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.215+0000 7f3dd5ffb700 1 -- 172.21.15.5:0/2436170518 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd80079b0 con 0x7f3de00c8380 2023-03-03T06:23:37.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.215+0000 7f3dd5ffb700 1 -- 172.21.15.5:0/2436170518 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8012640 con 0x7f3de00c8380 2023-03-03T06:23:37.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.215+0000 7f3de73a3700 1 -- 172.21.15.5:0/2436170518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de00cb9c0 con 0x7f3de00c8380 2023-03-03T06:23:37.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.215+0000 7f3de73a3700 1 -- 172.21.15.5:0/2436170518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de00cbf80 con 0x7f3de00c8380 2023-03-03T06:23:37.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.216+0000 7f3de73a3700 1 -- 172.21.15.5:0/2436170518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de004e6e0 con 0x7f3de00c8380 2023-03-03T06:23:37.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.216+0000 7f3dd5ffb700 1 -- 172.21.15.5:0/2436170518 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3dd8010070 con 0x7f3de00c8380 2023-03-03T06:23:37.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.216+0000 7f3dd5ffb700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3dc40682f0 0x7f3dc406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.217+0000 7f3dd5ffb700 1 -- 172.21.15.5:0/2436170518 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3dd8026070 con 0x7f3de00c8380 2023-03-03T06:23:37.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.217+0000 7f3de513f700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3dc40682f0 0x7f3dc406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.217+0000 7f3de513f700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3dc40682f0 0x7f3dc406a7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3de015d270 tx=0x7f3ddc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:37.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.221+0000 7f3dd5ffb700 1 -- 172.21.15.5:0/2436170518 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3dd8054250 con 0x7f3de00c8380 2023-03-03T06:23:37.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.413+0000 7f3de73a3700 1 -- 172.21.15.5:0/2436170518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3de00b5d90 con 0x7f3de00c8380 2023-03-03T06:23:37.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.413+0000 7f3dd5ffb700 1 -- 172.21.15.5:0/2436170518 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3dd80180a0 con 0x7f3de00c8380 2023-03-03T06:23:37.416 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:23:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.415+0000 7f3de73a3700 1 -- 172.21.15.5:0/2436170518 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3dc40682f0 msgr2=0x7f3dc406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.415+0000 7f3de73a3700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3dc40682f0 0x7f3dc406a7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3de015d270 tx=0x7f3ddc009040 comp rx=0 tx=0).stop 2023-03-03T06:23:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.415+0000 7f3de73a3700 1 -- 172.21.15.5:0/2436170518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de00c8380 msgr2=0x7f3de00c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.415+0000 7f3de73a3700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de00c8380 0x7f3de00c87f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00de10 tx=0x7f3dd8001cb0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.415+0000 7f3de73a3700 1 -- 172.21.15.5:0/2436170518 shutdown_connections 2023-03-03T06:23:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.415+0000 7f3de73a3700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3de00c8380 0x7f3de00c87f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.415+0000 7f3de73a3700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3dc40682f0 0x7f3dc406a7a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.415+0000 7f3de73a3700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3dcc006fa0 0x7f3de00afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.415+0000 7f3de73a3700 1 --2- 172.21.15.5:0/2436170518 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3de00b0080 0x7f3de00c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.415+0000 7f3de73a3700 1 -- 172.21.15.5:0/2436170518 >> 172.21.15.5:0/2436170518 conn(0x7f3de00cc8d0 msgr2=0x7f3de00cde90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.415+0000 7f3de73a3700 1 -- 172.21.15.5:0/2436170518 shutdown_connections 2023-03-03T06:23:37.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.416+0000 7f3de73a3700 1 -- 172.21.15.5:0/2436170518 wait complete. 2023-03-03T06:23:37.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-03T06:23:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.553+0000 7f247dd37700 1 Processor -- start 2023-03-03T06:23:37.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.553+0000 7f247dd37700 1 -- start start 2023-03-03T06:23:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.554+0000 7f247dd37700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f247815cd40 0x7f24780b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.554+0000 7f247dd37700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24780cba50 0x7f24780b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.554+0000 7f247dd37700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f24780cd3e0 0x7f2478160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.554+0000 7f247dd37700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247815d4e0 con 0x7f24780cd3e0 2023-03-03T06:23:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.554+0000 7f247dd37700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247815d7c0 con 0x7f247815cd40 2023-03-03T06:23:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.554+0000 7f247dd37700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247815daa0 con 0x7f24780cba50 2023-03-03T06:23:37.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.554+0000 7f2477fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f24780cd3e0 0x7f2478160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.554+0000 7f2477fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f24780cd3e0 0x7f2478160790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40916/0 (socket says 172.21.15.5:40916) 2023-03-03T06:23:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.554+0000 7f2477fff700 1 -- 172.21.15.5:0/404842391 learned_addr learned my addr 172.21.15.5:0/404842391 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.554+0000 7f2476ffd700 1 --2- 172.21.15.5:0/404842391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24780cba50 0x7f24780b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.554+0000 7f24777fe700 1 --2- 172.21.15.5:0/404842391 >> v2:172.21.15.191:3300/0 conn(0x7f247815cd40 0x7f24780b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.554+0000 7f2477fff700 1 -- 172.21.15.5:0/404842391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24780cba50 msgr2=0x7f24780b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.554+0000 7f2477fff700 1 --2- 172.21.15.5:0/404842391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24780cba50 0x7f24780b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f2477fff700 1 -- 172.21.15.5:0/404842391 >> v2:172.21.15.191:3300/0 conn(0x7f247815cd40 msgr2=0x7f24780b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f2477fff700 1 --2- 172.21.15.5:0/404842391 >> v2:172.21.15.191:3300/0 conn(0x7f247815cd40 0x7f24780b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f2477fff700 1 -- 172.21.15.5:0/404842391 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247815dd80 con 0x7f24780cd3e0 2023-03-03T06:23:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f2477fff700 1 --2- 172.21.15.5:0/404842391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24780cd3e0 0x7f2478160790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2478071020 tx=0x7f247000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92f3357aeeeb12d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f24767fc700 1 -- 172.21.15.5:0/404842391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247000e070 con 0x7f24780cd3e0 2023-03-03T06:23:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f24767fc700 1 -- 172.21.15.5:0/404842391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247000b9c0 con 0x7f24780cd3e0 2023-03-03T06:23:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f24767fc700 1 -- 172.21.15.5:0/404842391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247000bd70 con 0x7f24780cd3e0 2023-03-03T06:23:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f247dd37700 1 -- 172.21.15.5:0/404842391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24780cd3e0 msgr2=0x7f2478160790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f247dd37700 1 --2- 172.21.15.5:0/404842391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24780cd3e0 0x7f2478160790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2478071020 tx=0x7f247000b330 comp rx=0 tx=0).stop 2023-03-03T06:23:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f247dd37700 1 -- 172.21.15.5:0/404842391 shutdown_connections 2023-03-03T06:23:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f247dd37700 1 --2- 172.21.15.5:0/404842391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24780cd3e0 0x7f2478160790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f247dd37700 1 --2- 172.21.15.5:0/404842391 >> v2:172.21.15.191:3300/0 conn(0x7f247815cd40 0x7f24780b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f247dd37700 1 --2- 172.21.15.5:0/404842391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24780cba50 0x7f24780b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f247dd37700 1 -- 172.21.15.5:0/404842391 >> 172.21.15.5:0/404842391 conn(0x7f24780cc8d0 msgr2=0x7f24780cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f247dd37700 1 -- 172.21.15.5:0/404842391 shutdown_connections 2023-03-03T06:23:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.555+0000 7f247dd37700 1 -- 172.21.15.5:0/404842391 wait complete. 2023-03-03T06:23:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.557+0000 7f247dd37700 1 Processor -- start 2023-03-03T06:23:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.557+0000 7f247dd37700 1 -- start start 2023-03-03T06:23:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f247dd37700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24780cba50 0x7f24781f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f247dd37700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24780cd3e0 0x7f24780b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f247dd37700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247815cd40 0x7f24780c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f247dd37700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24781f3840 con 0x7f247815cd40 2023-03-03T06:23:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f247dd37700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24781f6d70 con 0x7f24780cba50 2023-03-03T06:23:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f247dd37700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24780c87a0 con 0x7f24780cd3e0 2023-03-03T06:23:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f2477fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247815cd40 0x7f24780c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f2477fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247815cd40 0x7f24780c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40922/0 (socket says 172.21.15.5:40922) 2023-03-03T06:23:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f2477fff700 1 -- 172.21.15.5:0/3674963242 learned_addr learned my addr 172.21.15.5:0/3674963242 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f2476ffd700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24780cd3e0 0x7f24780b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f24777fe700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24780cba50 0x7f24781f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f2477fff700 1 -- 172.21.15.5:0/3674963242 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24780cd3e0 msgr2=0x7f24780b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f2477fff700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24780cd3e0 0x7f24780b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f2477fff700 1 -- 172.21.15.5:0/3674963242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24780cba50 msgr2=0x7f24781f6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f2477fff700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24780cba50 0x7f24781f6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f2477fff700 1 -- 172.21.15.5:0/3674963242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2470009b30 con 0x7f247815cd40 2023-03-03T06:23:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f2476ffd700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24780cd3e0 0x7f24780b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f24777fe700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24780cba50 0x7f24781f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f2477fff700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247815cd40 0x7f24780c9560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2478071050 tx=0x7f2470004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f246ffff700 1 -- 172.21.15.5:0/3674963242 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470004250 con 0x7f247815cd40 2023-03-03T06:23:37.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f246ffff700 1 -- 172.21.15.5:0/3674963242 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24700043d0 con 0x7f247815cd40 2023-03-03T06:23:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f246ffff700 1 -- 172.21.15.5:0/3674963242 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470004780 con 0x7f247815cd40 2023-03-03T06:23:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f247dd37700 1 -- 172.21.15.5:0/3674963242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24780ca530 con 0x7f247815cd40 2023-03-03T06:23:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.558+0000 7f247dd37700 1 -- 172.21.15.5:0/3674963242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247815e060 con 0x7f247815cd40 2023-03-03T06:23:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.559+0000 7f247dd37700 1 -- 172.21.15.5:0/3674963242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247815d110 con 0x7f247815cd40 2023-03-03T06:23:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.560+0000 7f246ffff700 1 -- 172.21.15.5:0/3674963242 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f247001c440 con 0x7f247815cd40 2023-03-03T06:23:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.560+0000 7f246ffff700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f24580682f0 0x7f245806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.560+0000 7f246ffff700 1 -- 172.21.15.5:0/3674963242 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2470086ff0 con 0x7f247815cd40 2023-03-03T06:23:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.560+0000 7f24777fe700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f24580682f0 0x7f245806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.561+0000 7f24777fe700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f24580682f0 0x7f245806a7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f24780b13c0 tx=0x7f2460008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.564+0000 7f246ffff700 1 -- 172.21.15.5:0/3674963242 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2470053b40 con 0x7f247815cd40 2023-03-03T06:23:37.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.761+0000 7f247dd37700 1 -- 172.21.15.5:0/3674963242 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f24780cc1e0 con 0x7f247815cd40 2023-03-03T06:23:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.762+0000 7f246ffff700 1 -- 172.21.15.5:0/3674963242 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f2470020090 con 0x7f247815cd40 2023-03-03T06:23:37.764 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:37.764 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-03-03T06:23:37.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:23:37.765 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-03-03T06:23:37.765 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-03-03T06:23:37.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:23:37.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:23:37.765 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-03-03T06:23:37.766 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-03-03T06:23:37.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:23:37.766 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-03-03T06:23:37.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.763+0000 7f247dd37700 1 -- 172.21.15.5:0/3674963242 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f24580682f0 msgr2=0x7f245806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.763+0000 7f247dd37700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f24580682f0 0x7f245806a7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f24780b13c0 tx=0x7f2460008040 comp rx=0 tx=0).stop 2023-03-03T06:23:37.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.763+0000 7f247dd37700 1 -- 172.21.15.5:0/3674963242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247815cd40 msgr2=0x7f24780c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.763+0000 7f247dd37700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247815cd40 0x7f24780c9560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2478071050 tx=0x7f2470004ad0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.763+0000 7f247dd37700 1 -- 172.21.15.5:0/3674963242 shutdown_connections 2023-03-03T06:23:37.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.763+0000 7f247dd37700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f247815cd40 0x7f24780c9560 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.763+0000 7f247dd37700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24780cba50 0x7f24781f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.763+0000 7f247dd37700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f24580682f0 0x7f245806a7a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.763+0000 7f247dd37700 1 --2- 172.21.15.5:0/3674963242 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24780cd3e0 0x7f24780b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.763+0000 7f247dd37700 1 -- 172.21.15.5:0/3674963242 >> 172.21.15.5:0/3674963242 conn(0x7f24780cc8d0 msgr2=0x7f247806cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.764+0000 7f247dd37700 1 -- 172.21.15.5:0/3674963242 shutdown_connections 2023-03-03T06:23:37.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.764+0000 7f247dd37700 1 -- 172.21.15.5:0/3674963242 wait complete. 2023-03-03T06:23:37.777 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-03T06:23:37.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-03T06:23:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.905+0000 7f8921ebd700 1 Processor -- start 2023-03-03T06:23:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.905+0000 7f8921ebd700 1 -- start start 2023-03-03T06:23:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f8921ebd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f891c0af110 0x7f891c0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f8921ebd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f891c0b2250 0x7f891c0cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f8921ebd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891c0cd990 con 0x7f891c0cb3b0 2023-03-03T06:23:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f8921ebd700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f891c0cb830 con 0x7f891c0af110 2023-03-03T06:23:37.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f8921ebd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c0cdf50 con 0x7f891c0b2250 2023-03-03T06:23:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f891c0cb3b0 0x7f891c0ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59004/0 (socket says 172.21.15.5:59004) 2023-03-03T06:23:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891bfff700 1 -- 172.21.15.5:0/1215146009 learned_addr learned my addr 172.21.15.5:0/1215146009 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891affd700 1 --2- 172.21.15.5:0/1215146009 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f891c0b2250 0x7f891c0cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891b7fe700 1 --2- 172.21.15.5:0/1215146009 >> v2:172.21.15.191:3300/0 conn(0x7f891c0af110 0x7f891c0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497418059 0 0) 0x7f891c0cd990 con 0x7f891c0cb3b0 2023-03-03T06:23:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89040035b0 con 0x7f891c0cb3b0 2023-03-03T06:23:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3167741886 0 0) 0x7f89040035b0 con 0x7f891c0cb3b0 2023-03-03T06:23:37.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f891c0b2250 msgr2=0x7f891c0cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:37.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891a7fc700 1 --2- 172.21.15.5:0/1215146009 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f891c0b2250 0x7f891c0cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 >> v2:172.21.15.191:3300/0 conn(0x7f891c0af110 msgr2=0x7f891c0cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:37.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891a7fc700 1 --2- 172.21.15.5:0/1215146009 >> v2:172.21.15.191:3300/0 conn(0x7f891c0af110 0x7f891c0cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c0cf690 con 0x7f891c0cb3b0 2023-03-03T06:23:37.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f89140019f0 con 0x7f891c0cb3b0 2023-03-03T06:23:37.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 >> v1:172.21.15.5:6789/0 conn(0x7f891c0cb3b0 legacy=0x7f891c0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891a7fc700 1 --2- 172.21.15.5:0/1215146009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8904003a00 0x7f8904003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.906+0000 7f891a7fc700 1 --2- 172.21.15.5:0/1215146009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8904004430 0x7f89040048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891a7fc700 1 --2- 172.21.15.5:0/1215146009 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f891c0b2250 0x7f8904004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c0cb830 con 0x7f8904003a00 2023-03-03T06:23:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c0cdf50 con 0x7f8904004430 2023-03-03T06:23:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890400ba10 con 0x7f891c0b2250 2023-03-03T06:23:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891b7fe700 1 --2- 172.21.15.5:0/1215146009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8904003a00 0x7f8904003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891affd700 1 --2- 172.21.15.5:0/1215146009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8904004430 0x7f89040048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891bfff700 1 --2- 172.21.15.5:0/1215146009 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f891c0b2250 0x7f8904004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891b7fe700 1 -- 172.21.15.5:0/1215146009 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f891c0b2250 msgr2=0x7f8904004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891b7fe700 1 --2- 172.21.15.5:0/1215146009 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f891c0b2250 0x7f8904004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891b7fe700 1 -- 172.21.15.5:0/1215146009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8904004430 msgr2=0x7f89040048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891b7fe700 1 --2- 172.21.15.5:0/1215146009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8904004430 0x7f89040048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891b7fe700 1 -- 172.21.15.5:0/1215146009 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89040035b0 con 0x7f8904003a00 2023-03-03T06:23:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891b7fe700 1 --2- 172.21.15.5:0/1215146009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8904003a00 0x7f8904003e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8910009b60 tx=0x7f8904005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7c1af2c7abec34 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000e6c0 con 0x7f8904003a00 2023-03-03T06:23:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891000e820 con 0x7f8904003a00 2023-03-03T06:23:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.907+0000 7f891a7fc700 1 -- 172.21.15.5:0/1215146009 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000eb90 con 0x7f8904003a00 2023-03-03T06:23:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.908+0000 7f8921ebd700 1 -- 172.21.15.5:0/1215146009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8904003a00 msgr2=0x7f8904003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.908+0000 7f8921ebd700 1 --2- 172.21.15.5:0/1215146009 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8904003a00 0x7f8904003e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8910009b60 tx=0x7f8904005880 comp rx=0 tx=0).stop 2023-03-03T06:23:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.908+0000 7f891bfff700 1 -- 172.21.15.5:0/1215146009 reap_dead start 2023-03-03T06:23:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.908+0000 7f8921ebd700 1 -- 172.21.15.5:0/1215146009 shutdown_connections 2023-03-03T06:23:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.908+0000 7f8921ebd700 1 -- 172.21.15.5:0/1215146009 >> 172.21.15.5:0/1215146009 conn(0x7f891c0cc840 msgr2=0x7f891c0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.908+0000 7f8921ebd700 1 -- 172.21.15.5:0/1215146009 shutdown_connections 2023-03-03T06:23:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.908+0000 7f8921ebd700 1 -- 172.21.15.5:0/1215146009 wait complete. 2023-03-03T06:23:37.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.909+0000 7f8921ebd700 1 Processor -- start 2023-03-03T06:23:37.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.909+0000 7f8921ebd700 1 -- start start 2023-03-03T06:23:37.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.910+0000 7f8921ebd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8904003a00 0x7f891c15f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.910+0000 7f8921ebd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f891c0c9320 0x7f891c14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.910+0000 7f8921ebd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0c9790 0x7f891c150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.910+0000 7f8921ebd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c0ac9a0 con 0x7f891c0c9790 2023-03-03T06:23:37.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.910+0000 7f8921ebd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c15e9f0 con 0x7f8904003a00 2023-03-03T06:23:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.910+0000 7f8921ebd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c15fed0 con 0x7f891c0c9320 2023-03-03T06:23:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.910+0000 7f891bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0c9790 0x7f891c150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.910+0000 7f891bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0c9790 0x7f891c150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40942/0 (socket says 172.21.15.5:40942) 2023-03-03T06:23:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.910+0000 7f891bfff700 1 -- 172.21.15.5:0/1764339412 learned_addr learned my addr 172.21.15.5:0/1764339412 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.910+0000 7f891affd700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f891c0c9320 0x7f891c14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.910+0000 7f891b7fe700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8904003a00 0x7f891c15f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.911+0000 7f891bfff700 1 -- 172.21.15.5:0/1764339412 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f891c0c9320 msgr2=0x7f891c14fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.911+0000 7f891bfff700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f891c0c9320 0x7f891c14fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.911+0000 7f891bfff700 1 -- 172.21.15.5:0/1764339412 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8904003a00 msgr2=0x7f891c15f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.911+0000 7f891bfff700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8904003a00 0x7f891c15f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.911+0000 7f891bfff700 1 -- 172.21.15.5:0/1764339412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c0cdbe0 con 0x7f891c0c9790 2023-03-03T06:23:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.911+0000 7f891b7fe700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8904003a00 0x7f891c15f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.911+0000 7f891bfff700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0c9790 0x7f891c150370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f891c0cc810 tx=0x7f891400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:37.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.911+0000 7f8903fff700 1 -- 172.21.15.5:0/1764339412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891400ad50 con 0x7f891c0c9790 2023-03-03T06:23:37.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.911+0000 7f8903fff700 1 -- 172.21.15.5:0/1764339412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89140133f0 con 0x7f891c0c9790 2023-03-03T06:23:37.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.911+0000 7f8921ebd700 1 -- 172.21.15.5:0/1764339412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891c06c850 con 0x7f891c0c9790 2023-03-03T06:23:37.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.911+0000 7f8903fff700 1 -- 172.21.15.5:0/1764339412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89140137a0 con 0x7f891c0c9790 2023-03-03T06:23:37.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.911+0000 7f8921ebd700 1 -- 172.21.15.5:0/1764339412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891c06d3d0 con 0x7f891c0c9790 2023-03-03T06:23:37.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.912+0000 7f8921ebd700 1 -- 172.21.15.5:0/1764339412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f891c04e6e0 con 0x7f891c0c9790 2023-03-03T06:23:37.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.912+0000 7f8903fff700 1 -- 172.21.15.5:0/1764339412 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8914023070 con 0x7f891c0c9790 2023-03-03T06:23:37.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.913+0000 7f8903fff700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89080682f0 0x7f890806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:37.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.913+0000 7f8903fff700 1 -- 172.21.15.5:0/1764339412 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f89140863b0 con 0x7f891c0c9790 2023-03-03T06:23:37.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.913+0000 7f891b7fe700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89080682f0 0x7f890806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:37.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.913+0000 7f891b7fe700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89080682f0 0x7f890806a7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f89100090b0 tx=0x7f8910008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:37.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:37.917+0000 7f8903fff700 1 -- 172.21.15.5:0/1764339412 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8914052f60 con 0x7f891c0c9790 2023-03-03T06:23:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.110+0000 7f8921ebd700 1 -- 172.21.15.5:0/1764339412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f891c0717e0 con 0x7f891c0c9790 2023-03-03T06:23:38.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.888+0000 7f8903fff700 1 -- 172.21.15.5:0/1764339412 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f89140170b0 con 0x7f891c0c9790 2023-03-03T06:23:38.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.892+0000 7f8921ebd700 1 -- 172.21.15.5:0/1764339412 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89080682f0 msgr2=0x7f890806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:38.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.892+0000 7f8921ebd700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89080682f0 0x7f890806a7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f89100090b0 tx=0x7f8910008030 comp rx=0 tx=0).stop 2023-03-03T06:23:38.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.892+0000 7f8921ebd700 1 -- 172.21.15.5:0/1764339412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0c9790 msgr2=0x7f891c150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:38.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.892+0000 7f8921ebd700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0c9790 0x7f891c150370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f891c0cc810 tx=0x7f891400a640 comp rx=0 tx=0).stop 2023-03-03T06:23:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.892+0000 7f8921ebd700 1 -- 172.21.15.5:0/1764339412 shutdown_connections 2023-03-03T06:23:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.892+0000 7f8921ebd700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f891c0c9790 0x7f891c150370 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.892+0000 7f8921ebd700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8904003a00 0x7f891c15f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.892+0000 7f8921ebd700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89080682f0 0x7f890806a7a0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f89100090b0 tx=0x7f8910008030 comp rx=0 tx=0).stop 2023-03-03T06:23:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.892+0000 7f8921ebd700 1 --2- 172.21.15.5:0/1764339412 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f891c0c9320 0x7f891c14fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:38.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.892+0000 7f8921ebd700 1 -- 172.21.15.5:0/1764339412 >> 172.21.15.5:0/1764339412 conn(0x7f891c0cc840 msgr2=0x7f891c15c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:38.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.893+0000 7f8921ebd700 1 -- 172.21.15.5:0/1764339412 shutdown_connections 2023-03-03T06:23:38.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:38.893+0000 7f8921ebd700 1 -- 172.21.15.5:0/1764339412 wait complete. 2023-03-03T06:23:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-03-03T06:23:38.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-03-03T06:23:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.049+0000 7f28d0af1700 1 Processor -- start 2023-03-03T06:23:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.049+0000 7f28d0af1700 1 -- start start 2023-03-03T06:23:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.050+0000 7f28d0af1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28cc0af110 0x7f28cc0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.050+0000 7f28d0af1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28cc0b2250 0x7f28cc0cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.050+0000 7f28d0af1700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28cc0cd990 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.050+0000 7f28d0af1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28cc0cb830 con 0x7f28cc0b2250 2023-03-03T06:23:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.050+0000 7f28d0af1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0cdf50 con 0x7f28cc0af110 2023-03-03T06:23:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.050+0000 7f28c9d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f28cc0b2250 0x7f28cc0cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.050+0000 7f28cad9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f28cc0cb3b0 0x7f28cc0ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59024/0 (socket says 172.21.15.5:59024) 2023-03-03T06:23:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.050+0000 7f28cad9d700 1 -- 172.21.15.5:0/3087719449 learned_addr learned my addr 172.21.15.5:0/3087719449 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.050+0000 7f28ca59c700 1 --2- 172.21.15.5:0/3087719449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28cc0af110 0x7f28cc0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:39.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.050+0000 7f28c9d9b700 1 -- 172.21.15.5:0/3087719449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28cc0af110 msgr2=0x7f28cc0cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.050+0000 7f28c9d9b700 1 --2- 172.21.15.5:0/3087719449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28cc0af110 0x7f28cc0cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.050+0000 7f28c9d9b700 1 -- 172.21.15.5:0/3087719449 >> v1:172.21.15.5:6789/0 conn(0x7f28cc0cb3b0 legacy=0x7f28cc0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.051+0000 7f28c9d9b700 1 -- 172.21.15.5:0/3087719449 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc0cf690 con 0x7f28cc0b2250 2023-03-03T06:23:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.050+0000 7f28c959a700 1 -- 172.21.15.5:0/3087719449 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924099266 0 0) 0x7f28cc0cd990 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.051+0000 7f28c9d9b700 1 --2- 172.21.15.5:0/3087719449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28cc0b2250 0x7f28cc0cae70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009840 tx=0x7f28bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868dc2736f7da573 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.051+0000 7f28c959a700 1 -- 172.21.15.5:0/3087719449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc011830 con 0x7f28cc0b2250 2023-03-03T06:23:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.051+0000 7f28c959a700 1 -- 172.21.15.5:0/3087719449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc011990 con 0x7f28cc0b2250 2023-03-03T06:23:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.051+0000 7f28c959a700 1 -- 172.21.15.5:0/3087719449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc011d20 con 0x7f28cc0b2250 2023-03-03T06:23:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.051+0000 7f28d0af1700 1 -- 172.21.15.5:0/3087719449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28cc0b2250 msgr2=0x7f28cc0cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.051+0000 7f28d0af1700 1 --2- 172.21.15.5:0/3087719449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28cc0b2250 0x7f28cc0cae70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009840 tx=0x7f28bc009b50 comp rx=0 tx=0).stop 2023-03-03T06:23:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.051+0000 7f28d0af1700 1 -- 172.21.15.5:0/3087719449 shutdown_connections 2023-03-03T06:23:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.051+0000 7f28d0af1700 1 --2- 172.21.15.5:0/3087719449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28cc0af110 0x7f28cc0cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.051+0000 7f28d0af1700 1 --2- 172.21.15.5:0/3087719449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28cc0b2250 0x7f28cc0cae70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.051+0000 7f28d0af1700 1 -- 172.21.15.5:0/3087719449 >> 172.21.15.5:0/3087719449 conn(0x7f28cc0cc840 msgr2=0x7f28cc0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.051+0000 7f28d0af1700 1 -- 172.21.15.5:0/3087719449 shutdown_connections 2023-03-03T06:23:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.051+0000 7f28d0af1700 1 -- 172.21.15.5:0/3087719449 wait complete. 2023-03-03T06:23:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.053+0000 7f28d0af1700 1 Processor -- start 2023-03-03T06:23:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.053+0000 7f28d0af1700 1 -- start start 2023-03-03T06:23:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28d0af1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28cc0af110 0x7f28cc15e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28d0af1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28cc0b2250 0x7f28cc0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28d0af1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28cc0cb3b0 0x7f28cc0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28d0af1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0b3fb0 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28d0af1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0b3100 con 0x7f28cc0b2250 2023-03-03T06:23:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28d0af1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0b33a0 con 0x7f28cc0af110 2023-03-03T06:23:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28cad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28cc0cb3b0 0x7f28cc0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28cad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28cc0cb3b0 0x7f28cc0ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40956/0 (socket says 172.21.15.5:40956) 2023-03-03T06:23:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28cad9d700 1 -- 172.21.15.5:0/1042426012 learned_addr learned my addr 172.21.15.5:0/1042426012 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28ca59c700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28cc0af110 0x7f28cc15e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28c9d9b700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28cc0b2250 0x7f28cc0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28cad9d700 1 -- 172.21.15.5:0/1042426012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28cc0af110 msgr2=0x7f28cc15e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28cad9d700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28cc0af110 0x7f28cc15e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28cad9d700 1 -- 172.21.15.5:0/1042426012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28cc0b2250 msgr2=0x7f28cc0ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28cad9d700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28cc0b2250 0x7f28cc0ae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28cad9d700 1 -- 172.21.15.5:0/1042426012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc0094a0 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28ca59c700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28cc0af110 0x7f28cc15e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28cad9d700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28cc0cb3b0 0x7f28cc0ae750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28c4002230 tx=0x7f28c400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28baffd700 1 -- 172.21.15.5:0/1042426012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400ac20 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28baffd700 1 -- 172.21.15.5:0/1042426012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c400ada0 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28d0af1700 1 -- 172.21.15.5:0/1042426012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28cc0cdbe0 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28baffd700 1 -- 172.21.15.5:0/1042426012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4007310 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.054+0000 7f28d0af1700 1 -- 172.21.15.5:0/1042426012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28cc06c850 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.055+0000 7f28d0af1700 1 -- 172.21.15.5:0/1042426012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28cc06d3d0 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.056+0000 7f28baffd700 1 -- 172.21.15.5:0/1042426012 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f28c401a030 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.056+0000 7f28baffd700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f28ac0682f0 0x7f28ac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.056+0000 7f28baffd700 1 -- 172.21.15.5:0/1042426012 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f28c4085870 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.056+0000 7f28ca59c700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f28ac0682f0 0x7f28ac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.057+0000 7f28ca59c700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f28ac0682f0 0x7f28ac06a7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009820 tx=0x7f28c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:39.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.061+0000 7f28baffd700 1 -- 172.21.15.5:0/1042426012 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f28c40522b0 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.252+0000 7f28d0af1700 1 -- 172.21.15.5:0/1042426012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f28cc04e6e0 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.895+0000 7f28baffd700 1 -- 172.21.15.5:0/1042426012 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f28c40180d0 con 0x7f28cc0cb3b0 2023-03-03T06:23:39.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.902+0000 7f28d0af1700 1 -- 172.21.15.5:0/1042426012 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f28ac0682f0 msgr2=0x7f28ac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:39.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.902+0000 7f28d0af1700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f28ac0682f0 0x7f28ac06a7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009820 tx=0x7f28c0008040 comp rx=0 tx=0).stop 2023-03-03T06:23:39.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.902+0000 7f28d0af1700 1 -- 172.21.15.5:0/1042426012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28cc0cb3b0 msgr2=0x7f28cc0ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:39.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.902+0000 7f28d0af1700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28cc0cb3b0 0x7f28cc0ae750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28c4002230 tx=0x7f28c400a060 comp rx=0 tx=0).stop 2023-03-03T06:23:39.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.903+0000 7f28d0af1700 1 -- 172.21.15.5:0/1042426012 shutdown_connections 2023-03-03T06:23:39.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.903+0000 7f28d0af1700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28cc0cb3b0 0x7f28cc0ae750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:39.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.903+0000 7f28d0af1700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f28ac0682f0 0x7f28ac06a7a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:39.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.903+0000 7f28d0af1700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28cc0af110 0x7f28cc15e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.903+0000 7f28d0af1700 1 --2- 172.21.15.5:0/1042426012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28cc0b2250 0x7f28cc0ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.903+0000 7f28d0af1700 1 -- 172.21.15.5:0/1042426012 >> 172.21.15.5:0/1042426012 conn(0x7f28cc0cc840 msgr2=0x7f28cc0b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:39.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.904+0000 7f28d0af1700 1 -- 172.21.15.5:0/1042426012 shutdown_connections 2023-03-03T06:23:39.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:39.905+0000 7f28d0af1700 1 -- 172.21.15.5:0/1042426012 wait complete. 2023-03-03T06:23:39.914 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-03-03T06:23:39.931 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-03T06:23:40.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.062+0000 7f25656db700 1 Processor -- start 2023-03-03T06:23:40.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.062+0000 7f25656db700 1 -- start start 2023-03-03T06:23:40.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f25656db700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256006bab0 0x7f25600cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f25656db700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f256006c120 0x7f256006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f25656db700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25600d2d60 con 0x7f25600b8720 2023-03-03T06:23:40.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f25656db700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256006cae0 con 0x7f256006c120 2023-03-03T06:23:40.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f25656db700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25600cdd90 con 0x7f256006bab0 2023-03-03T06:23:40.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255effd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f25600b8720 0x7f2560160d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59034/0 (socket says 172.21.15.5:59034) 2023-03-03T06:23:40.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255effd700 1 -- 172.21.15.5:0/2332134398 learned_addr learned my addr 172.21.15.5:0/2332134398 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:40.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255f7fe700 1 --2- 172.21.15.5:0/2332134398 >> v2:172.21.15.191:3300/0 conn(0x7f256006c120 0x7f256006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:40.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255e7fc700 1 --2- 172.21.15.5:0/2332134398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256006bab0 0x7f25600cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:40.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367253759 0 0) 0x7f25600d2d60 con 0x7f25600b8720 2023-03-03T06:23:40.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25480035b0 con 0x7f25600b8720 2023-03-03T06:23:40.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 563293132 0 0) 0x7f25480035b0 con 0x7f25600b8720 2023-03-03T06:23:40.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256006bab0 msgr2=0x7f25600cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:40.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255dffb700 1 --2- 172.21.15.5:0/2332134398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256006bab0 0x7f25600cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 >> v2:172.21.15.191:3300/0 conn(0x7f256006c120 msgr2=0x7f256006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:40.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255dffb700 1 --2- 172.21.15.5:0/2332134398 >> v2:172.21.15.191:3300/0 conn(0x7f256006c120 0x7f256006c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600cf400 con 0x7f25600b8720 2023-03-03T06:23:40.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f2554001670 con 0x7f25600b8720 2023-03-03T06:23:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 >> v1:172.21.15.5:6789/0 conn(0x7f25600b8720 legacy=0x7f2560160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255dffb700 1 --2- 172.21.15.5:0/2332134398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2548003a00 0x7f2548003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.063+0000 7f255dffb700 1 --2- 172.21.15.5:0/2332134398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256006bab0 0x7f2548004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255dffb700 1 --2- 172.21.15.5:0/2332134398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2548004d90 0x7f2548005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256006cae0 con 0x7f2548003a00 2023-03-03T06:23:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600cdd90 con 0x7f2548004d90 2023-03-03T06:23:40.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254800ba10 con 0x7f256006bab0 2023-03-03T06:23:40.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255effd700 1 --2- 172.21.15.5:0/2332134398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2548003a00 0x7f2548003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:40.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255e7fc700 1 --2- 172.21.15.5:0/2332134398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256006bab0 0x7f2548004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:40.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255f7fe700 1 --2- 172.21.15.5:0/2332134398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2548004d90 0x7f2548005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:40.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255effd700 1 -- 172.21.15.5:0/2332134398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256006bab0 msgr2=0x7f2548004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:40.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255effd700 1 --2- 172.21.15.5:0/2332134398 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f256006bab0 0x7f2548004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255effd700 1 -- 172.21.15.5:0/2332134398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2548004d90 msgr2=0x7f2548005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:40.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255effd700 1 --2- 172.21.15.5:0/2332134398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2548004d90 0x7f2548005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255effd700 1 -- 172.21.15.5:0/2332134398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25480035b0 con 0x7f2548003a00 2023-03-03T06:23:40.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255f7fe700 1 --2- 172.21.15.5:0/2332134398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2548004d90 0x7f2548005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:40.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255effd700 1 --2- 172.21.15.5:0/2332134398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2548003a00 0x7f2548003e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f255400c2f0 tx=0x7f2548005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c305227e80260c99 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:40.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255400ce30 con 0x7f2548003a00 2023-03-03T06:23:40.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2554005960 con 0x7f2548003a00 2023-03-03T06:23:40.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.064+0000 7f255dffb700 1 -- 172.21.15.5:0/2332134398 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2554005d10 con 0x7f2548003a00 2023-03-03T06:23:40.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.065+0000 7f25656db700 1 -- 172.21.15.5:0/2332134398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2548003a00 msgr2=0x7f2548003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:40.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.065+0000 7f25656db700 1 --2- 172.21.15.5:0/2332134398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2548003a00 0x7f2548003e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f255400c2f0 tx=0x7f2548005880 comp rx=0 tx=0).stop 2023-03-03T06:23:40.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.065+0000 7f255f7fe700 1 -- 172.21.15.5:0/2332134398 reap_dead start 2023-03-03T06:23:40.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.065+0000 7f25656db700 1 -- 172.21.15.5:0/2332134398 shutdown_connections 2023-03-03T06:23:40.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.065+0000 7f25656db700 1 -- 172.21.15.5:0/2332134398 >> 172.21.15.5:0/2332134398 conn(0x7f25600d0590 msgr2=0x7f25600d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:40.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.065+0000 7f25656db700 1 -- 172.21.15.5:0/2332134398 shutdown_connections 2023-03-03T06:23:40.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.065+0000 7f25656db700 1 -- 172.21.15.5:0/2332134398 wait complete. 2023-03-03T06:23:40.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.066+0000 7f25656db700 1 Processor -- start 2023-03-03T06:23:40.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.066+0000 7f25656db700 1 -- start start 2023-03-03T06:23:40.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f25656db700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2548003a00 0x7f25600c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f25656db700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25600cc030 0x7f25600cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f25656db700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25600b67b0 0x7f25600b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f25656db700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600b7160 con 0x7f25600cc030 2023-03-03T06:23:40.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f25656db700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2560156c90 con 0x7f25600b67b0 2023-03-03T06:23:40.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f25656db700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2560156080 con 0x7f2548003a00 2023-03-03T06:23:40.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f255e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25600cc030 0x7f25600cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:40.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f255e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25600cc030 0x7f25600cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40974/0 (socket says 172.21.15.5:40974) 2023-03-03T06:23:40.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f255e7fc700 1 -- 172.21.15.5:0/4109580619 learned_addr learned my addr 172.21.15.5:0/4109580619 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:40.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f255f7fe700 1 --2- 172.21.15.5:0/4109580619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25600b67b0 0x7f25600b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:40.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f255e7fc700 1 -- 172.21.15.5:0/4109580619 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2548003a00 msgr2=0x7f25600c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:40.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f255e7fc700 1 --2- 172.21.15.5:0/4109580619 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2548003a00 0x7f25600c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f255e7fc700 1 -- 172.21.15.5:0/4109580619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25600b67b0 msgr2=0x7f25600b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:40.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f255e7fc700 1 --2- 172.21.15.5:0/4109580619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25600b67b0 0x7f25600b6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f255e7fc700 1 -- 172.21.15.5:0/4109580619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600d29f0 con 0x7f25600cc030 2023-03-03T06:23:40.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.067+0000 7f255e7fc700 1 --2- 172.21.15.5:0/4109580619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25600cc030 0x7f25600cc4a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2550011ad0 tx=0x7f2550011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:40.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.068+0000 7f25477fe700 1 -- 172.21.15.5:0/4109580619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255000fa00 con 0x7f25600cc030 2023-03-03T06:23:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.068+0000 7f25477fe700 1 -- 172.21.15.5:0/4109580619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255000fb60 con 0x7f25600cc030 2023-03-03T06:23:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.068+0000 7f25477fe700 1 -- 172.21.15.5:0/4109580619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550014440 con 0x7f25600cc030 2023-03-03T06:23:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.068+0000 7f25656db700 1 -- 172.21.15.5:0/4109580619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25600cf6e0 con 0x7f25600cc030 2023-03-03T06:23:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.068+0000 7f25656db700 1 -- 172.21.15.5:0/4109580619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25600b8af0 con 0x7f25600cc030 2023-03-03T06:23:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.069+0000 7f25656db700 1 -- 172.21.15.5:0/4109580619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256004e6e0 con 0x7f25600cc030 2023-03-03T06:23:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.069+0000 7f25477fe700 1 -- 172.21.15.5:0/4109580619 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f25500145a0 con 0x7f25600cc030 2023-03-03T06:23:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.070+0000 7f25477fe700 1 --2- 172.21.15.5:0/4109580619 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f254c0682f0 0x7f254c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.070+0000 7f25477fe700 1 -- 172.21.15.5:0/4109580619 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f2550086660 con 0x7f25600cc030 2023-03-03T06:23:40.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.070+0000 7f255effd700 1 --2- 172.21.15.5:0/4109580619 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f254c0682f0 0x7f254c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:40.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.070+0000 7f255effd700 1 --2- 172.21.15.5:0/4109580619 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f254c0682f0 0x7f254c06a7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25600cba10 tx=0x7f255400f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:40.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.074+0000 7f25477fe700 1 -- 172.21.15.5:0/4109580619 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2550052ef0 con 0x7f25600cc030 2023-03-03T06:23:40.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.313+0000 7f25656db700 1 -- 172.21.15.5:0/4109580619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f256006b890 con 0x7f25600cc030 2023-03-03T06:23:40.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.318+0000 7f25477fe700 1 -- 172.21.15.5:0/4109580619 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f25500220c0 con 0x7f25600cc030 2023-03-03T06:23:40.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.326+0000 7f25656db700 1 -- 172.21.15.5:0/4109580619 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f254c0682f0 msgr2=0x7f254c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:40.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.326+0000 7f25656db700 1 --2- 172.21.15.5:0/4109580619 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f254c0682f0 0x7f254c06a7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25600cba10 tx=0x7f255400f000 comp rx=0 tx=0).stop 2023-03-03T06:23:40.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.326+0000 7f25656db700 1 -- 172.21.15.5:0/4109580619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25600cc030 msgr2=0x7f25600cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:40.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.326+0000 7f25656db700 1 --2- 172.21.15.5:0/4109580619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25600cc030 0x7f25600cc4a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2550011ad0 tx=0x7f2550011e90 comp rx=0 tx=0).stop 2023-03-03T06:23:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.332+0000 7f25656db700 1 -- 172.21.15.5:0/4109580619 shutdown_connections 2023-03-03T06:23:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.332+0000 7f25656db700 1 --2- 172.21.15.5:0/4109580619 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25600b67b0 0x7f25600b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.332+0000 7f25656db700 1 --2- 172.21.15.5:0/4109580619 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f254c0682f0 0x7f254c06a7a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.332+0000 7f25656db700 1 --2- 172.21.15.5:0/4109580619 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2548003a00 0x7f25600c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.332+0000 7f25656db700 1 --2- 172.21.15.5:0/4109580619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25600cc030 0x7f25600cc4a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.332+0000 7f25656db700 1 -- 172.21.15.5:0/4109580619 >> 172.21.15.5:0/4109580619 conn(0x7f25600d0590 msgr2=0x7f25600b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:40.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.333+0000 7f25656db700 1 -- 172.21.15.5:0/4109580619 shutdown_connections 2023-03-03T06:23:40.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.333+0000 7f25656db700 1 -- 172.21.15.5:0/4109580619 wait complete. 2023-03-03T06:23:40.342 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 3 and data pool 4 2023-03-03T06:23:40.358 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-03-03T06:23:40.359 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-03-03T06:23:40.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.486+0000 7fa2a9969700 1 Processor -- start 2023-03-03T06:23:40.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.487+0000 7fa2a9969700 1 -- start start 2023-03-03T06:23:40.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.487+0000 7fa2a9969700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2a415a110 0x7fa2a415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.487+0000 7fa2a9969700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa2a415a4e0 0x7fa2a40b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.487+0000 7fa2a9969700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a40cf370 con 0x7fa2a40d0940 2023-03-03T06:23:40.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.487+0000 7fa2a9969700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a415d330 con 0x7fa2a415a110 2023-03-03T06:23:40.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.487+0000 7fa2a9969700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a415d600 con 0x7fa2a415a4e0 2023-03-03T06:23:40.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.487+0000 7fa2a2ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2a415a110 0x7fa2a415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.487+0000 7fa2a2ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa2a415a110 0x7fa2a415cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40992/0 (socket says 172.21.15.5:40992) 2023-03-03T06:23:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.487+0000 7fa2a2ffd700 1 -- 172.21.15.5:0/2997635031 learned_addr learned my addr 172.21.15.5:0/2997635031 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.488+0000 7fa2a2ffd700 1 -- 172.21.15.5:0/2997635031 >> v2:172.21.15.191:3300/0 conn(0x7fa2a415a4e0 msgr2=0x7fa2a40b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.488+0000 7fa2a2ffd700 1 --2- 172.21.15.5:0/2997635031 >> v2:172.21.15.191:3300/0 conn(0x7fa2a415a4e0 0x7fa2a40b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.488+0000 7fa2a2ffd700 1 -- 172.21.15.5:0/2997635031 >> v1:172.21.15.191:6789/0 conn(0x7fa2a40d0940 legacy=0x7fa2a40cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.488+0000 7fa2a2ffd700 1 -- 172.21.15.5:0/2997635031 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a415d8e0 con 0x7fa2a415a110 2023-03-03T06:23:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.488+0000 7fa2a2ffd700 1 --2- 172.21.15.5:0/2997635031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2a415a110 0x7fa2a415cdf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4071290 tx=0x7fa294009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f237beda8acac540 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:40.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.488+0000 7fa2a1ffb700 1 -- 172.21.15.5:0/2997635031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294004230 con 0x7fa2a415a110 2023-03-03T06:23:40.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.488+0000 7fa2a1ffb700 1 -- 172.21.15.5:0/2997635031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa294004390 con 0x7fa2a415a110 2023-03-03T06:23:40.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.488+0000 7fa2a1ffb700 1 -- 172.21.15.5:0/2997635031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2940036a0 con 0x7fa2a415a110 2023-03-03T06:23:40.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.489+0000 7fa2a9969700 1 -- 172.21.15.5:0/2997635031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2a415a110 msgr2=0x7fa2a415cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:40.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.489+0000 7fa2a9969700 1 --2- 172.21.15.5:0/2997635031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2a415a110 0x7fa2a415cdf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4071290 tx=0x7fa294009bd0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.489+0000 7fa2a9969700 1 -- 172.21.15.5:0/2997635031 shutdown_connections 2023-03-03T06:23:40.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.489+0000 7fa2a9969700 1 --2- 172.21.15.5:0/2997635031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2a415a110 0x7fa2a415cdf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.489+0000 7fa2a9969700 1 --2- 172.21.15.5:0/2997635031 >> v2:172.21.15.191:3300/0 conn(0x7fa2a415a4e0 0x7fa2a40b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.489+0000 7fa2a9969700 1 -- 172.21.15.5:0/2997635031 >> 172.21.15.5:0/2997635031 conn(0x7fa2a406f3c0 msgr2=0x7fa2a406f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:40.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.489+0000 7fa2a9969700 1 -- 172.21.15.5:0/2997635031 shutdown_connections 2023-03-03T06:23:40.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.489+0000 7fa2a9969700 1 -- 172.21.15.5:0/2997635031 wait complete. 2023-03-03T06:23:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.490+0000 7fa2a9969700 1 Processor -- start 2023-03-03T06:23:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.490+0000 7fa2a9969700 1 -- start start 2023-03-03T06:23:40.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a9969700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2a40d0940 0x7fa2a41552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a9969700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a415a110 0x7fa2a40c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a9969700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2a415a4e0 0x7fa2a40b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a9969700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40c6180 con 0x7fa2a40d0940 2023-03-03T06:23:40.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a9969700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40c5e50 con 0x7fa2a415a4e0 2023-03-03T06:23:40.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a9969700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40b02c0 con 0x7fa2a415a110 2023-03-03T06:23:40.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2a40d0940 0x7fa2a41552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:40.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2a40d0940 0x7fa2a41552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40998/0 (socket says 172.21.15.5:40998) 2023-03-03T06:23:40.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a2ffd700 1 -- 172.21.15.5:0/713368863 learned_addr learned my addr 172.21.15.5:0/713368863 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:40.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a37fe700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2a415a4e0 0x7fa2a40b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:40.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a27fc700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a415a110 0x7fa2a40c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:40.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a2ffd700 1 -- 172.21.15.5:0/713368863 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a415a110 msgr2=0x7fa2a40c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:40.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a2ffd700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a415a110 0x7fa2a40c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a2ffd700 1 -- 172.21.15.5:0/713368863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2a415a4e0 msgr2=0x7fa2a40b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:40.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a2ffd700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2a415a4e0 0x7fa2a40b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:40.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a2ffd700 1 -- 172.21.15.5:0/713368863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294009550 con 0x7fa2a40d0940 2023-03-03T06:23:40.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a37fe700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2a415a4e0 0x7fa2a40b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:40.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a27fc700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a415a110 0x7fa2a40c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:40.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.491+0000 7fa2a2ffd700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2a40d0940 0x7fa2a41552e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40b3a10 tx=0x7fa294004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:40.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.492+0000 7fa28bfff700 1 -- 172.21.15.5:0/713368863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294003dc0 con 0x7fa2a40d0940 2023-03-03T06:23:40.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.492+0000 7fa28bfff700 1 -- 172.21.15.5:0/713368863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29401f070 con 0x7fa2a40d0940 2023-03-03T06:23:40.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.492+0000 7fa2a9969700 1 -- 172.21.15.5:0/713368863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a406bd70 con 0x7fa2a40d0940 2023-03-03T06:23:40.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.492+0000 7fa28bfff700 1 -- 172.21.15.5:0/713368863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294011870 con 0x7fa2a40d0940 2023-03-03T06:23:40.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.492+0000 7fa2a9969700 1 -- 172.21.15.5:0/713368863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a415dbc0 con 0x7fa2a40d0940 2023-03-03T06:23:40.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.493+0000 7fa2a9969700 1 -- 172.21.15.5:0/713368863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a406c050 con 0x7fa2a40d0940 2023-03-03T06:23:40.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.493+0000 7fa28bfff700 1 -- 172.21.15.5:0/713368863 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa294017020 con 0x7fa2a40d0940 2023-03-03T06:23:40.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.493+0000 7fa28bfff700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa2900682f0 0x7fa29006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:40.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.494+0000 7fa28bfff700 1 -- 172.21.15.5:0/713368863 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa294087610 con 0x7fa2a40d0940 2023-03-03T06:23:40.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.494+0000 7fa2a27fc700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa2900682f0 0x7fa29006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:40.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.494+0000 7fa2a27fc700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa2900682f0 0x7fa29006a7a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40ce400 tx=0x7fa298008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:40.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.498+0000 7fa28bfff700 1 -- 172.21.15.5:0/713368863 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa294053d80 con 0x7fa2a40d0940 2023-03-03T06:23:40.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:40.702+0000 7fa2a9969700 1 -- 172.21.15.5:0/713368863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa2a40c6460 con 0x7fa2a40d0940 2023-03-03T06:23:41.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.325+0000 7fa28bfff700 1 -- 172.21.15.5:0/713368863 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa2940573a0 con 0x7fa2a40d0940 2023-03-03T06:23:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.329+0000 7fa2a9969700 1 -- 172.21.15.5:0/713368863 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa2900682f0 msgr2=0x7fa29006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.329+0000 7fa2a9969700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa2900682f0 0x7fa29006a7a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40ce400 tx=0x7fa298008040 comp rx=0 tx=0).stop 2023-03-03T06:23:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.329+0000 7fa2a9969700 1 -- 172.21.15.5:0/713368863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2a40d0940 msgr2=0x7fa2a41552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.329+0000 7fa2a9969700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2a40d0940 0x7fa2a41552e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40b3a10 tx=0x7fa294004750 comp rx=0 tx=0).stop 2023-03-03T06:23:41.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.329+0000 7fa2a9969700 1 -- 172.21.15.5:0/713368863 shutdown_connections 2023-03-03T06:23:41.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.329+0000 7fa2a9969700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2a415a4e0 0x7fa2a40b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:41.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.329+0000 7fa2a9969700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2a40d0940 0x7fa2a41552e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:41.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.329+0000 7fa2a9969700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa2900682f0 0x7fa29006a7a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:41.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.329+0000 7fa2a9969700 1 --2- 172.21.15.5:0/713368863 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2a415a110 0x7fa2a40c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:41.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.329+0000 7fa2a9969700 1 -- 172.21.15.5:0/713368863 >> 172.21.15.5:0/713368863 conn(0x7fa2a406f3c0 msgr2=0x7fa2a4160840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:41.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.329+0000 7fa2a9969700 1 -- 172.21.15.5:0/713368863 shutdown_connections 2023-03-03T06:23:41.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.329+0000 7fa2a9969700 1 -- 172.21.15.5:0/713368863 wait complete. 2023-03-03T06:23:41.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-03-03T06:23:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.484+0000 7f563077c700 1 Processor -- start 2023-03-03T06:23:41.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.484+0000 7f563077c700 1 -- start start 2023-03-03T06:23:41.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f563077c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f562815a850 0x7f56280cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:41.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f563077c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56280b27b0 con 0x7f56280b17d0 2023-03-03T06:23:41.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f563077c700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56280cae50 con 0x7f562806b9c0 2023-03-03T06:23:41.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f563077c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56280cb130 con 0x7f562815a850 2023-03-03T06:23:41.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f562dd17700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f56280b17d0 0x7f562806b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59080/0 (socket says 172.21.15.5:59080) 2023-03-03T06:23:41.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f562dd17700 1 -- 172.21.15.5:0/1343912849 learned_addr learned my addr 172.21.15.5:0/1343912849 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f562e518700 1 --2- 172.21.15.5:0/1343912849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f562815a850 0x7f56280cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f562d516700 1 -- 172.21.15.5:0/1343912849 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267594698 0 0) 0x7f56280b27b0 con 0x7f56280b17d0 2023-03-03T06:23:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f562d516700 1 -- 172.21.15.5:0/1343912849 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56140035b0 con 0x7f56280b17d0 2023-03-03T06:23:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f562d516700 1 -- 172.21.15.5:0/1343912849 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033683021 0 0) 0x7f56280cae50 con 0x7f562806b9c0 2023-03-03T06:23:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f562d516700 1 -- 172.21.15.5:0/1343912849 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56280b27b0 con 0x7f562806b9c0 2023-03-03T06:23:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f562e518700 1 -- 172.21.15.5:0/1343912849 >> v1:172.21.15.191:6789/0 conn(0x7f562806b9c0 legacy=0x7f56280b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f562e518700 1 -- 172.21.15.5:0/1343912849 >> v1:172.21.15.5:6789/0 conn(0x7f56280b17d0 legacy=0x7f562806b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:41.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f562d516700 1 -- 172.21.15.5:0/1343912849 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3833756138 0 0) 0x7f56140035b0 con 0x7f56280b17d0 2023-03-03T06:23:41.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.485+0000 7f562e518700 1 -- 172.21.15.5:0/1343912849 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56280cb410 con 0x7f562815a850 2023-03-03T06:23:41.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.486+0000 7f562e518700 1 --2- 172.21.15.5:0/1343912849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f562815a850 0x7f56280cbc10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5618009870 tx=0x7f5618009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f4cc7ea56823ee server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:41.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.486+0000 7f562d516700 1 -- 172.21.15.5:0/1343912849 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624001670 con 0x7f562815a850 2023-03-03T06:23:41.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.486+0000 7f562d516700 1 -- 172.21.15.5:0/1343912849 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5618004030 con 0x7f562815a850 2023-03-03T06:23:41.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.486+0000 7f562d516700 1 -- 172.21.15.5:0/1343912849 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56180043c0 con 0x7f562815a850 2023-03-03T06:23:41.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.486+0000 7f563077c700 1 -- 172.21.15.5:0/1343912849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f562815a850 msgr2=0x7f56280cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:41.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.486+0000 7f563077c700 1 --2- 172.21.15.5:0/1343912849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f562815a850 0x7f56280cbc10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5618009870 tx=0x7f5618009b80 comp rx=0 tx=0).stop 2023-03-03T06:23:41.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.486+0000 7f563077c700 1 -- 172.21.15.5:0/1343912849 shutdown_connections 2023-03-03T06:23:41.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.486+0000 7f563077c700 1 --2- 172.21.15.5:0/1343912849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f562815a850 0x7f56280cbc10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:41.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.486+0000 7f563077c700 1 -- 172.21.15.5:0/1343912849 >> 172.21.15.5:0/1343912849 conn(0x7f562806ea80 msgr2=0x7f56280cc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:41.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.487+0000 7f563077c700 1 -- 172.21.15.5:0/1343912849 shutdown_connections 2023-03-03T06:23:41.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.487+0000 7f563077c700 1 -- 172.21.15.5:0/1343912849 wait complete. 2023-03-03T06:23:41.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.488+0000 7f563077c700 1 Processor -- start 2023-03-03T06:23:41.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.488+0000 7f563077c700 1 -- start start 2023-03-03T06:23:41.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.488+0000 7f563077c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f562806b9c0 0x7f56281f0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:41.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.488+0000 7f563077c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56280b17d0 0x7f5628155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:41.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.488+0000 7f563077c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f562815a850 0x7f56280a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:41.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.488+0000 7f563077c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56280a8c40 con 0x7f56280b17d0 2023-03-03T06:23:41.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.488+0000 7f563077c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56280c88a0 con 0x7f562806b9c0 2023-03-03T06:23:41.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.488+0000 7f563077c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56280a8960 con 0x7f562815a850 2023-03-03T06:23:41.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f562dd17700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56280b17d0 0x7f5628155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:41.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f562dd17700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56280b17d0 0x7f5628155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41014/0 (socket says 172.21.15.5:41014) 2023-03-03T06:23:41.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f562dd17700 1 -- 172.21.15.5:0/2480509118 learned_addr learned my addr 172.21.15.5:0/2480509118 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f562e518700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f562806b9c0 0x7f56281f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f562ed19700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f562815a850 0x7f56280a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f562dd17700 1 -- 172.21.15.5:0/2480509118 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f562815a850 msgr2=0x7f56280a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f562dd17700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f562815a850 0x7f56280a7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f562dd17700 1 -- 172.21.15.5:0/2480509118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f562806b9c0 msgr2=0x7f56281f0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f562dd17700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f562806b9c0 0x7f56281f0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f562dd17700 1 -- 172.21.15.5:0/2480509118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56180094a0 con 0x7f56280b17d0 2023-03-03T06:23:41.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f562dd17700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56280b17d0 0x7f5628155800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f562400c750 tx=0x7f562400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f561effd700 1 -- 172.21.15.5:0/2480509118 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624004d40 con 0x7f56280b17d0 2023-03-03T06:23:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f561effd700 1 -- 172.21.15.5:0/2480509118 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56240070d0 con 0x7f56280b17d0 2023-03-03T06:23:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f563077c700 1 -- 172.21.15.5:0/2480509118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56280cc150 con 0x7f56280b17d0 2023-03-03T06:23:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f561effd700 1 -- 172.21.15.5:0/2480509118 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624004ea0 con 0x7f56280b17d0 2023-03-03T06:23:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.489+0000 7f563077c700 1 -- 172.21.15.5:0/2480509118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56280cb6f0 con 0x7f56280b17d0 2023-03-03T06:23:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.490+0000 7f563077c700 1 -- 172.21.15.5:0/2480509118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f562806be90 con 0x7f56280b17d0 2023-03-03T06:23:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.491+0000 7f561effd700 1 -- 172.21.15.5:0/2480509118 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f562401a020 con 0x7f56280b17d0 2023-03-03T06:23:41.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.491+0000 7f561effd700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f560c0682f0 0x7f560c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.491+0000 7f561effd700 1 -- 172.21.15.5:0/2480509118 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f5624085a40 con 0x7f56280b17d0 2023-03-03T06:23:41.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.491+0000 7f562e518700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f560c0682f0 0x7f560c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:41.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.491+0000 7f562e518700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f560c0682f0 0x7f560c06a7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f56180097c0 tx=0x7f5618008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:41.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.495+0000 7f561effd700 1 -- 172.21.15.5:0/2480509118 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f56240521c0 con 0x7f56280b17d0 2023-03-03T06:23:41.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:41.689+0000 7f563077c700 1 -- 172.21.15.5:0/2480509118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f56280c93e0 con 0x7f56280b17d0 2023-03-03T06:23:43.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.393+0000 7f561effd700 1 -- 172.21.15.5:0/2480509118 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f56240557e0 con 0x7f56280b17d0 2023-03-03T06:23:43.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.403+0000 7f563077c700 1 -- 172.21.15.5:0/2480509118 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f560c0682f0 msgr2=0x7f560c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:43.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.403+0000 7f563077c700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f560c0682f0 0x7f560c06a7a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f56180097c0 tx=0x7f5618008030 comp rx=0 tx=0).stop 2023-03-03T06:23:43.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.403+0000 7f563077c700 1 -- 172.21.15.5:0/2480509118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56280b17d0 msgr2=0x7f5628155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:43.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.403+0000 7f563077c700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56280b17d0 0x7f5628155800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f562400c750 tx=0x7f562400ca60 comp rx=0 tx=0).stop 2023-03-03T06:23:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.403+0000 7f563077c700 1 -- 172.21.15.5:0/2480509118 shutdown_connections 2023-03-03T06:23:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.403+0000 7f563077c700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f560c0682f0 0x7f560c06a7a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.403+0000 7f563077c700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f562815a850 0x7f56280a7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:43.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.403+0000 7f563077c700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f562806b9c0 0x7f56281f0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.403+0000 7f563077c700 1 --2- 172.21.15.5:0/2480509118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56280b17d0 0x7f5628155800 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:43.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.403+0000 7f563077c700 1 -- 172.21.15.5:0/2480509118 >> 172.21.15.5:0/2480509118 conn(0x7f562806ea80 msgr2=0x7f56280b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.404+0000 7f563077c700 1 -- 172.21.15.5:0/2480509118 shutdown_connections 2023-03-03T06:23:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.404+0000 7f563077c700 1 -- 172.21.15.5:0/2480509118 wait complete. 2023-03-03T06:23:43.409 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' created 2023-03-03T06:23:43.421 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-03-03T06:23:43.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.555+0000 7fcf46e13700 1 Processor -- start 2023-03-03T06:23:43.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.555+0000 7fcf46e13700 1 -- start start 2023-03-03T06:23:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf46e13700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf400cd090 0x7fcf400cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf46e13700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf400cddb0 con 0x7fcf400b17b0 2023-03-03T06:23:43.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf46e13700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf400cebf0 con 0x7fcf400cb430 2023-03-03T06:23:43.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf46e13700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4015cd70 con 0x7fcf400cd090 2023-03-03T06:23:43.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf3ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf400cd090 0x7fcf400cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:43.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf453b0700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcf400b17b0 0x7fcf4006b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59096/0 (socket says 172.21.15.5:59096) 2023-03-03T06:23:43.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf453b0700 1 -- 172.21.15.5:0/1943350300 learned_addr learned my addr 172.21.15.5:0/1943350300 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:43.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf3ffff700 1 -- 172.21.15.5:0/1943350300 >> v1:172.21.15.191:6789/0 conn(0x7fcf400cb430 legacy=0x7fcf400cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:43.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf3ffff700 1 -- 172.21.15.5:0/1943350300 >> v1:172.21.15.5:6789/0 conn(0x7fcf400b17b0 legacy=0x7fcf4006b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:43.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf3ffff700 1 -- 172.21.15.5:0/1943350300 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf400cb800 con 0x7fcf400cd090 2023-03-03T06:23:43.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf3f7fe700 1 -- 172.21.15.5:0/1943350300 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100391287 0 0) 0x7fcf400cddb0 con 0x7fcf400b17b0 2023-03-03T06:23:43.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf3ffff700 1 --2- 172.21.15.5:0/1943350300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400cd090 0x7fcf400cd870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009870 tx=0x7fcf2c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30796ecaa6cc5b0e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:43.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf3f7fe700 1 -- 172.21.15.5:0/1943350300 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c011830 con 0x7fcf400cd090 2023-03-03T06:23:43.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf3f7fe700 1 -- 172.21.15.5:0/1943350300 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c011990 con 0x7fcf400cd090 2023-03-03T06:23:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.556+0000 7fcf3f7fe700 1 -- 172.21.15.5:0/1943350300 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c011d20 con 0x7fcf400cd090 2023-03-03T06:23:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.557+0000 7fcf46e13700 1 -- 172.21.15.5:0/1943350300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400cd090 msgr2=0x7fcf400cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.557+0000 7fcf46e13700 1 --2- 172.21.15.5:0/1943350300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400cd090 0x7fcf400cd870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009870 tx=0x7fcf2c009b80 comp rx=0 tx=0).stop 2023-03-03T06:23:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.557+0000 7fcf46e13700 1 -- 172.21.15.5:0/1943350300 shutdown_connections 2023-03-03T06:23:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.557+0000 7fcf46e13700 1 --2- 172.21.15.5:0/1943350300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400cd090 0x7fcf400cd870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.557+0000 7fcf46e13700 1 -- 172.21.15.5:0/1943350300 >> 172.21.15.5:0/1943350300 conn(0x7fcf400d09c0 msgr2=0x7fcf400cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.557+0000 7fcf46e13700 1 -- 172.21.15.5:0/1943350300 shutdown_connections 2023-03-03T06:23:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.557+0000 7fcf46e13700 1 -- 172.21.15.5:0/1943350300 wait complete. 2023-03-03T06:23:43.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.559+0000 7fcf46e13700 1 Processor -- start 2023-03-03T06:23:43.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.559+0000 7fcf46e13700 1 -- start start 2023-03-03T06:23:43.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf46e13700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf400b17b0 0x7fcf400b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:43.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf46e13700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400cb430 0x7fcf401f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:43.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf46e13700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf400cd090 0x7fcf401f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:43.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf46e13700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf400b2b60 con 0x7fcf400cb430 2023-03-03T06:23:43.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf46e13700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf400b2db0 con 0x7fcf400b17b0 2023-03-03T06:23:43.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf46e13700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf400b3090 con 0x7fcf400cd090 2023-03-03T06:23:43.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400cb430 0x7fcf401f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:43.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf3ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400cb430 0x7fcf401f2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41028/0 (socket says 172.21.15.5:41028) 2023-03-03T06:23:43.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf3ffff700 1 -- 172.21.15.5:0/2272260691 learned_addr learned my addr 172.21.15.5:0/2272260691 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:43.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf44baf700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf400b17b0 0x7fcf400b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf453b0700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf400cd090 0x7fcf401f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf3ffff700 1 -- 172.21.15.5:0/2272260691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf400cd090 msgr2=0x7fcf401f1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf3ffff700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf400cd090 0x7fcf401f1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf3ffff700 1 -- 172.21.15.5:0/2272260691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf400b17b0 msgr2=0x7fcf400b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf3ffff700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf400b17b0 0x7fcf400b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf3ffff700 1 -- 172.21.15.5:0/2272260691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0094a0 con 0x7fcf400cb430 2023-03-03T06:23:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf453b0700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf400cd090 0x7fcf401f1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf3ffff700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400cb430 0x7fcf401f2440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009bc0 tx=0x7fcf2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf3d7fa700 1 -- 172.21.15.5:0/2272260691 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0038a0 con 0x7fcf400cb430 2023-03-03T06:23:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf3d7fa700 1 -- 172.21.15.5:0/2272260691 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c003a00 con 0x7fcf400cb430 2023-03-03T06:23:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf46e13700 1 -- 172.21.15.5:0/2272260691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf400ce2c0 con 0x7fcf400cb430 2023-03-03T06:23:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.560+0000 7fcf3d7fa700 1 -- 172.21.15.5:0/2272260691 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c003db0 con 0x7fcf400cb430 2023-03-03T06:23:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.561+0000 7fcf46e13700 1 -- 172.21.15.5:0/2272260691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf400cdfe0 con 0x7fcf400cb430 2023-03-03T06:23:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.561+0000 7fcf46e13700 1 -- 172.21.15.5:0/2272260691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf400ce5a0 con 0x7fcf400cb430 2023-03-03T06:23:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.562+0000 7fcf3d7fa700 1 -- 172.21.15.5:0/2272260691 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fcf2c00f050 con 0x7fcf400cb430 2023-03-03T06:23:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.562+0000 7fcf3d7fa700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcf240682f0 0x7fcf2406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.562+0000 7fcf3d7fa700 1 -- 172.21.15.5:0/2272260691 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fcf2c0874c0 con 0x7fcf400cb430 2023-03-03T06:23:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.562+0000 7fcf44baf700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcf240682f0 0x7fcf2406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.563+0000 7fcf44baf700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcf240682f0 0x7fcf2406a7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf34000f60 tx=0x7fcf34009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.567+0000 7fcf3d7fa700 1 -- 172.21.15.5:0/2272260691 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fcf2c053960 con 0x7fcf400cb430 2023-03-03T06:23:43.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:43.760+0000 7fcf46e13700 1 -- 172.21.15.5:0/2272260691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fcf4004e6e0 con 0x7fcf400cb430 2023-03-03T06:23:44.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.394+0000 7fcf3d7fa700 1 -- 172.21.15.5:0/2272260691 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcf2c056f80 con 0x7fcf400cb430 2023-03-03T06:23:44.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.400+0000 7fcf46e13700 1 -- 172.21.15.5:0/2272260691 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcf240682f0 msgr2=0x7fcf2406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:44.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.400+0000 7fcf46e13700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcf240682f0 0x7fcf2406a7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf34000f60 tx=0x7fcf34009040 comp rx=0 tx=0).stop 2023-03-03T06:23:44.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.400+0000 7fcf46e13700 1 -- 172.21.15.5:0/2272260691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400cb430 msgr2=0x7fcf401f2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:44.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.400+0000 7fcf46e13700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400cb430 0x7fcf401f2440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009bc0 tx=0x7fcf2c004750 comp rx=0 tx=0).stop 2023-03-03T06:23:44.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.412+0000 7fcf46e13700 1 -- 172.21.15.5:0/2272260691 shutdown_connections 2023-03-03T06:23:44.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.412+0000 7fcf46e13700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcf240682f0 0x7fcf2406a7a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.412+0000 7fcf46e13700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf400cd090 0x7fcf401f1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.412+0000 7fcf46e13700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf400b17b0 0x7fcf400b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.412+0000 7fcf46e13700 1 --2- 172.21.15.5:0/2272260691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf400cb430 0x7fcf401f2440 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.412+0000 7fcf46e13700 1 -- 172.21.15.5:0/2272260691 >> 172.21.15.5:0/2272260691 conn(0x7fcf400d09c0 msgr2=0x7fcf4006cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:44.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.414+0000 7fcf46e13700 1 -- 172.21.15.5:0/2272260691 shutdown_connections 2023-03-03T06:23:44.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.414+0000 7fcf46e13700 1 -- 172.21.15.5:0/2272260691 wait complete. 2023-03-03T06:23:44.420 INFO:teuthology.orchestra.run.smithi005.stderr:set pool 5 allow_ec_overwrites to true 2023-03-03T06:23:44.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-03-03T06:23:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.565+0000 7fae26c1c700 1 Processor -- start 2023-03-03T06:23:44.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.565+0000 7fae26c1c700 1 -- start start 2023-03-03T06:23:44.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.566+0000 7fae26c1c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fae200b55b0 0x7fae2015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.566+0000 7fae26c1c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae200b1fe0 0x7fae200cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.566+0000 7fae26c1c700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae200cc5d0 con 0x7fae200cd500 2023-03-03T06:23:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.566+0000 7fae26c1c700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2015e290 con 0x7fae200b55b0 2023-03-03T06:23:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.566+0000 7fae26c1c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae20159c30 con 0x7fae200b1fe0 2023-03-03T06:23:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.566+0000 7fae251b9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae200b1fe0 0x7fae200cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.566+0000 7fae249b8700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fae200b55b0 0x7fae2015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.566+0000 7fae251b9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae200b1fe0 0x7fae200cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39116/0 (socket says 172.21.15.5:39116) 2023-03-03T06:23:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.566+0000 7fae1ffff700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fae200cd500 0x7fae200b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:45404/0 (socket says 172.21.15.5:45404) 2023-03-03T06:23:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.566+0000 7fae249b8700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fae200b55b0 0x7fae2015dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:41394/0 (socket says 172.21.15.5:41394) 2023-03-03T06:23:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.566+0000 7fae251b9700 1 -- 172.21.15.5:0/837068231 learned_addr learned my addr 172.21.15.5:0/837068231 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.567+0000 7fae249b8700 1 -- 172.21.15.5:0/837068231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae200b1fe0 msgr2=0x7fae200cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.567+0000 7fae249b8700 1 --2- 172.21.15.5:0/837068231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae200b1fe0 0x7fae200cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.567+0000 7fae249b8700 1 -- 172.21.15.5:0/837068231 >> v1:172.21.15.191:6789/0 conn(0x7fae200cd500 legacy=0x7fae200b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.567+0000 7fae249b8700 1 -- 172.21.15.5:0/837068231 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200b5980 con 0x7fae200b55b0 2023-03-03T06:23:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.567+0000 7fae1f7fe700 1 -- 172.21.15.5:0/837068231 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2981156223 0 0) 0x7fae200cc5d0 con 0x7fae200cd500 2023-03-03T06:23:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.567+0000 7fae251b9700 1 --2- 172.21.15.5:0/837068231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae200b1fe0 0x7fae200cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.567+0000 7fae249b8700 1 --2- 172.21.15.5:0/837068231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae200b55b0 0x7fae2015dd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fae1400bae0 tx=0x7fae1400bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb565467f428ff20 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.567+0000 7fae1f7fe700 1 -- 172.21.15.5:0/837068231 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1400dc70 con 0x7fae200b55b0 2023-03-03T06:23:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.567+0000 7fae1f7fe700 1 -- 172.21.15.5:0/837068231 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1400ddd0 con 0x7fae200b55b0 2023-03-03T06:23:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.567+0000 7fae1f7fe700 1 -- 172.21.15.5:0/837068231 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14010690 con 0x7fae200b55b0 2023-03-03T06:23:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.568+0000 7fae26c1c700 1 -- 172.21.15.5:0/837068231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae200b55b0 msgr2=0x7fae2015dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.568+0000 7fae26c1c700 1 --2- 172.21.15.5:0/837068231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae200b55b0 0x7fae2015dd50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fae1400bae0 tx=0x7fae1400bdf0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.568+0000 7fae26c1c700 1 -- 172.21.15.5:0/837068231 shutdown_connections 2023-03-03T06:23:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.568+0000 7fae26c1c700 1 --2- 172.21.15.5:0/837068231 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae200b1fe0 0x7fae200cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.568+0000 7fae26c1c700 1 --2- 172.21.15.5:0/837068231 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae200b55b0 0x7fae2015dd50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.568+0000 7fae26c1c700 1 -- 172.21.15.5:0/837068231 >> 172.21.15.5:0/837068231 conn(0x7fae200cc8d0 msgr2=0x7fae200cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.568+0000 7fae26c1c700 1 -- 172.21.15.5:0/837068231 shutdown_connections 2023-03-03T06:23:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.568+0000 7fae26c1c700 1 -- 172.21.15.5:0/837068231 wait complete. 2023-03-03T06:23:44.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.569+0000 7fae26c1c700 1 Processor -- start 2023-03-03T06:23:44.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.569+0000 7fae26c1c700 1 -- start start 2023-03-03T06:23:44.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae26c1c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae200b1fe0 0x7fae20150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae26c1c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae200b55b0 0x7fae200c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae26c1c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae200cd500 0x7fae200c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae26c1c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae20154470 con 0x7fae200b55b0 2023-03-03T06:23:44.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae26c1c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae200c79b0 con 0x7fae200cd500 2023-03-03T06:23:44.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae26c1c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae200c66a0 con 0x7fae200b1fe0 2023-03-03T06:23:44.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae1ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae200b55b0 0x7fae200c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:44.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae1ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae200b55b0 0x7fae200c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41042/0 (socket says 172.21.15.5:41042) 2023-03-03T06:23:44.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae1ffff700 1 -- 172.21.15.5:0/3925446089 learned_addr learned my addr 172.21.15.5:0/3925446089 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:44.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae249b8700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae200b1fe0 0x7fae20150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:44.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae251b9700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae200cd500 0x7fae200c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:44.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae1ffff700 1 -- 172.21.15.5:0/3925446089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae200b1fe0 msgr2=0x7fae20150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:44.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae1ffff700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae200b1fe0 0x7fae20150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae1ffff700 1 -- 172.21.15.5:0/3925446089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae200cd500 msgr2=0x7fae200c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:44.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae1ffff700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae200cd500 0x7fae200c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae1ffff700 1 -- 172.21.15.5:0/3925446089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae18009b30 con 0x7fae200b55b0 2023-03-03T06:23:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.570+0000 7fae1ffff700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae200b55b0 0x7fae200c94b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00c550 tx=0x7fae0c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.571+0000 7fae1d7fa700 1 -- 172.21.15.5:0/3925446089 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c004c80 con 0x7fae200b55b0 2023-03-03T06:23:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.571+0000 7fae1d7fa700 1 -- 172.21.15.5:0/3925446089 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c004e00 con 0x7fae200b55b0 2023-03-03T06:23:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.571+0000 7fae26c1c700 1 -- 172.21.15.5:0/3925446089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1400b740 con 0x7fae200b55b0 2023-03-03T06:23:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.571+0000 7fae1d7fa700 1 -- 172.21.15.5:0/3925446089 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c007310 con 0x7fae200b55b0 2023-03-03T06:23:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.571+0000 7fae26c1c700 1 -- 172.21.15.5:0/3925446089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae200cbca0 con 0x7fae200b55b0 2023-03-03T06:23:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.572+0000 7fae26c1c700 1 -- 172.21.15.5:0/3925446089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae200cb9c0 con 0x7fae200b55b0 2023-03-03T06:23:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.572+0000 7fae1d7fa700 1 -- 172.21.15.5:0/3925446089 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fae0c01a020 con 0x7fae200b55b0 2023-03-03T06:23:44.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.572+0000 7fae1d7fa700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fae040682f0 0x7fae0406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.573+0000 7fae1d7fa700 1 -- 172.21.15.5:0/3925446089 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fae0c085a50 con 0x7fae200b55b0 2023-03-03T06:23:44.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.573+0000 7fae249b8700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fae040682f0 0x7fae0406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:44.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.573+0000 7fae249b8700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fae040682f0 0x7fae0406a7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae1400be30 tx=0x7fae14013000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:44.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.577+0000 7fae1d7fa700 1 -- 172.21.15.5:0/3925446089 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fae0c051f60 con 0x7fae200b55b0 2023-03-03T06:23:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.816+0000 7fae26c1c700 1 -- 172.21.15.5:0/3925446089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fae200cbf80 con 0x7fae200b55b0 2023-03-03T06:23:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.821+0000 7fae1d7fa700 1 -- 172.21.15.5:0/3925446089 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fae0c055580 con 0x7fae200b55b0 2023-03-03T06:23:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.824+0000 7fae26c1c700 1 -- 172.21.15.5:0/3925446089 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fae040682f0 msgr2=0x7fae0406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.824+0000 7fae26c1c700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fae040682f0 0x7fae0406a7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae1400be30 tx=0x7fae14013000 comp rx=0 tx=0).stop 2023-03-03T06:23:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.824+0000 7fae26c1c700 1 -- 172.21.15.5:0/3925446089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae200b55b0 msgr2=0x7fae200c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.824+0000 7fae26c1c700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae200b55b0 0x7fae200c94b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00c550 tx=0x7fae0c00c860 comp rx=0 tx=0).stop 2023-03-03T06:23:44.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.824+0000 7fae26c1c700 1 -- 172.21.15.5:0/3925446089 shutdown_connections 2023-03-03T06:23:44.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.824+0000 7fae26c1c700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae200cd500 0x7fae200c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.824+0000 7fae26c1c700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fae040682f0 0x7fae0406a7a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.824+0000 7fae26c1c700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae200b1fe0 0x7fae20150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.824+0000 7fae26c1c700 1 --2- 172.21.15.5:0/3925446089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae200b55b0 0x7fae200c94b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.824+0000 7fae26c1c700 1 -- 172.21.15.5:0/3925446089 >> 172.21.15.5:0/3925446089 conn(0x7fae200cc8d0 msgr2=0x7fae200b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:44.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.824+0000 7fae26c1c700 1 -- 172.21.15.5:0/3925446089 shutdown_connections 2023-03-03T06:23:44.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.824+0000 7fae26c1c700 1 -- 172.21.15.5:0/3925446089 wait complete. 2023-03-03T06:23:44.828 INFO:teuthology.orchestra.run.smithi005.stderr:added data pool 5 to fsmap 2023-03-03T06:23:44.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:23:44.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.960+0000 7f9c7e22d700 1 Processor -- start 2023-03-03T06:23:44.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.960+0000 7f9c7e22d700 1 -- start start 2023-03-03T06:23:44.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.961+0000 7f9c7e22d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9c7815fcb0 0x7f9c780cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.961+0000 7f9c7e22d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c780d1c00 con 0x7f9c780b03f0 2023-03-03T06:23:44.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.961+0000 7f9c7e22d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c78160080 con 0x7f9c7806d0c0 2023-03-03T06:23:44.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.961+0000 7f9c7e22d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c78160cf0 con 0x7f9c7815fcb0 2023-03-03T06:23:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.961+0000 7f9c76ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9c780b03f0 0x7f9c780d0de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59122/0 (socket says 172.21.15.5:59122) 2023-03-03T06:23:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.961+0000 7f9c76ffd700 1 -- 172.21.15.5:0/3352770476 learned_addr learned my addr 172.21.15.5:0/3352770476 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255323229 0 0) 0x7f9c780d1c00 con 0x7f9c780b03f0 2023-03-03T06:23:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c777fe700 1 --2- 172.21.15.5:0/3352770476 >> v2:172.21.15.191:3300/0 conn(0x7f9c7815fcb0 0x7f9c780cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:44.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c600035b0 con 0x7f9c780b03f0 2023-03-03T06:23:44.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3243538775 0 0) 0x7f9c600035b0 con 0x7f9c780b03f0 2023-03-03T06:23:44.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 >> v2:172.21.15.191:3300/0 conn(0x7f9c7815fcb0 msgr2=0x7f9c780cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:44.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 --2- 172.21.15.5:0/3352770476 >> v2:172.21.15.191:3300/0 conn(0x7f9c7815fcb0 0x7f9c780cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 >> v1:172.21.15.191:6789/0 conn(0x7f9c7806d0c0 legacy=0x7f9c780d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:44.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78160ee0 con 0x7f9c780b03f0 2023-03-03T06:23:44.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f9c6c001670 con 0x7f9c780b03f0 2023-03-03T06:23:44.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 >> v1:172.21.15.5:6789/0 conn(0x7f9c780b03f0 legacy=0x7f9c780d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:44.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 --2- 172.21.15.5:0/3352770476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c60003a70 0x7f9c60003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 --2- 172.21.15.5:0/3352770476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c60004850 0x7f9c60004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 --2- 172.21.15.5:0/3352770476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c60005250 0x7f9c6000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6000c160 con 0x7f9c60004850 2023-03-03T06:23:44.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6000c2d0 con 0x7f9c60005250 2023-03-03T06:23:44.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6000c490 con 0x7f9c60003a70 2023-03-03T06:23:44.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c76ffd700 1 --2- 172.21.15.5:0/3352770476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c60004850 0x7f9c60004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:44.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c77fff700 1 --2- 172.21.15.5:0/3352770476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c60005250 0x7f9c6000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:44.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c777fe700 1 --2- 172.21.15.5:0/3352770476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c60003a70 0x7f9c60003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:44.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c76ffd700 1 -- 172.21.15.5:0/3352770476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c60003a70 msgr2=0x7f9c60003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:44.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c76ffd700 1 --2- 172.21.15.5:0/3352770476 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c60003a70 0x7f9c60003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c76ffd700 1 -- 172.21.15.5:0/3352770476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c60005250 msgr2=0x7f9c6000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:44.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c76ffd700 1 --2- 172.21.15.5:0/3352770476 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c60005250 0x7f9c6000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c77fff700 1 -- 172.21.15.5:0/3352770476 reap_dead start 2023-03-03T06:23:44.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.962+0000 7f9c76ffd700 1 -- 172.21.15.5:0/3352770476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c600035b0 con 0x7f9c60004850 2023-03-03T06:23:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.963+0000 7f9c76ffd700 1 --2- 172.21.15.5:0/3352770476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c60004850 0x7f9c60004cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c780b0830 tx=0x7f9c60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988e5bd172252716 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.963+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c007c10 con 0x7f9c60004850 2023-03-03T06:23:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.963+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c00cda0 con 0x7f9c60004850 2023-03-03T06:23:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.963+0000 7f9c767fc700 1 -- 172.21.15.5:0/3352770476 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c005ba0 con 0x7f9c60004850 2023-03-03T06:23:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.963+0000 7f9c7e22d700 1 -- 172.21.15.5:0/3352770476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c60004850 msgr2=0x7f9c60004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.963+0000 7f9c7e22d700 1 --2- 172.21.15.5:0/3352770476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c60004850 0x7f9c60004cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c780b0830 tx=0x7f9c60005880 comp rx=0 tx=0).stop 2023-03-03T06:23:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.963+0000 7f9c7e22d700 1 -- 172.21.15.5:0/3352770476 shutdown_connections 2023-03-03T06:23:44.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.963+0000 7f9c7e22d700 1 --2- 172.21.15.5:0/3352770476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c60004850 0x7f9c60004cc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.963+0000 7f9c7e22d700 1 -- 172.21.15.5:0/3352770476 >> 172.21.15.5:0/3352770476 conn(0x7f9c7806f3c0 msgr2=0x7f9c7806f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:44.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.963+0000 7f9c7e22d700 1 -- 172.21.15.5:0/3352770476 shutdown_connections 2023-03-03T06:23:44.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.963+0000 7f9c7e22d700 1 -- 172.21.15.5:0/3352770476 wait complete. 2023-03-03T06:23:44.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.965+0000 7f9c7e22d700 1 Processor -- start 2023-03-03T06:23:44.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.965+0000 7f9c7e22d700 1 -- start start 2023-03-03T06:23:44.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c7e22d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c60004850 0x7f9c781f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c7e22d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c780adf00 0x7f9c7814c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c7e22d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c7814c690 0x7f9c780abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c7e22d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7814ccc0 con 0x7f9c780adf00 2023-03-03T06:23:44.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c7e22d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7814cfa0 con 0x7f9c60004850 2023-03-03T06:23:44.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c7e22d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780c5aa0 con 0x7f9c7814c690 2023-03-03T06:23:44.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c76ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c780adf00 0x7f9c7814c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:44.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c76ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c780adf00 0x7f9c7814c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41062/0 (socket says 172.21.15.5:41062) 2023-03-03T06:23:44.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c76ffd700 1 -- 172.21.15.5:0/236371668 learned_addr learned my addr 172.21.15.5:0/236371668 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:44.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c777fe700 1 --2- 172.21.15.5:0/236371668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c60004850 0x7f9c781f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:44.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c76ffd700 1 -- 172.21.15.5:0/236371668 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c7814c690 msgr2=0x7f9c780abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:44.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c76ffd700 1 --2- 172.21.15.5:0/236371668 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c7814c690 0x7f9c780abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c76ffd700 1 -- 172.21.15.5:0/236371668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c60004850 msgr2=0x7f9c781f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:44.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c76ffd700 1 --2- 172.21.15.5:0/236371668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c60004850 0x7f9c781f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:44.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c76ffd700 1 -- 172.21.15.5:0/236371668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c780ceac0 con 0x7f9c780adf00 2023-03-03T06:23:44.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c76ffd700 1 --2- 172.21.15.5:0/236371668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c780adf00 0x7f9c7814c150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000c2a0 tx=0x7f9c6c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:44.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c5ffff700 1 -- 172.21.15.5:0/236371668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c001670 con 0x7f9c780adf00 2023-03-03T06:23:44.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c5ffff700 1 -- 172.21.15.5:0/236371668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c0070d0 con 0x7f9c780adf00 2023-03-03T06:23:44.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c7e22d700 1 -- 172.21.15.5:0/236371668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c781611c0 con 0x7f9c780adf00 2023-03-03T06:23:44.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c5ffff700 1 -- 172.21.15.5:0/236371668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c007480 con 0x7f9c780adf00 2023-03-03T06:23:44.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.966+0000 7f9c7e22d700 1 -- 172.21.15.5:0/236371668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c780ceda0 con 0x7f9c780adf00 2023-03-03T06:23:44.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.967+0000 7f9c7e22d700 1 -- 172.21.15.5:0/236371668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7804e6e0 con 0x7f9c780adf00 2023-03-03T06:23:44.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.968+0000 7f9c5ffff700 1 -- 172.21.15.5:0/236371668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9c6c024070 con 0x7f9c780adf00 2023-03-03T06:23:44.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.968+0000 7f9c5ffff700 1 --2- 172.21.15.5:0/236371668 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9c640682f0 0x7f9c6406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:44.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.968+0000 7f9c5ffff700 1 -- 172.21.15.5:0/236371668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9c6c086eb0 con 0x7f9c780adf00 2023-03-03T06:23:44.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.968+0000 7f9c777fe700 1 --2- 172.21.15.5:0/236371668 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9c640682f0 0x7f9c6406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:44.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.968+0000 7f9c777fe700 1 --2- 172.21.15.5:0/236371668 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9c640682f0 0x7f9c6406a7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009b20 tx=0x7f9c68008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:44.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:44.972+0000 7f9c5ffff700 1 -- 172.21.15.5:0/236371668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9c6c053420 con 0x7f9c780adf00 2023-03-03T06:23:45.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.209+0000 7f9c7e22d700 1 -- 172.21.15.5:0/236371668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c780b3370 con 0x7f9c780adf00 2023-03-03T06:23:45.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.209+0000 7f9c5ffff700 1 -- 172.21.15.5:0/236371668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4638 (secure 0 0 0) 0x7f9c6c056a40 con 0x7f9c780adf00 2023-03-03T06:23:45.212 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:45.212 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/277386051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":277386051},{"type":"v1","addr":"172.21.15.5:6837","nonce":277386051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2875199515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2875199515},{"type":"v1","addr":"172.21.15.191:6835","nonce":2875199515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2122425608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2122425608},{"type":"v1","addr":"172.21.15.191:6833","nonce":2122425608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:23:40.315678+0000","modified":"2023-03-03T06:23:44.818612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/305842942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":305842942},{"type":"v1","addr":"172.21.15.5:6836","nonce":305842942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-03-03T06:23:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.212+0000 7f9c7e22d700 1 -- 172.21.15.5:0/236371668 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9c640682f0 msgr2=0x7f9c6406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.212+0000 7f9c7e22d700 1 --2- 172.21.15.5:0/236371668 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9c640682f0 0x7f9c6406a7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009b20 tx=0x7f9c68008040 comp rx=0 tx=0).stop 2023-03-03T06:23:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.212+0000 7f9c7e22d700 1 -- 172.21.15.5:0/236371668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c780adf00 msgr2=0x7f9c7814c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.212+0000 7f9c7e22d700 1 --2- 172.21.15.5:0/236371668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c780adf00 0x7f9c7814c150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000c2a0 tx=0x7f9c6c001a00 comp rx=0 tx=0).stop 2023-03-03T06:23:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.212+0000 7f9c7e22d700 1 -- 172.21.15.5:0/236371668 shutdown_connections 2023-03-03T06:23:45.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.212+0000 7f9c7e22d700 1 --2- 172.21.15.5:0/236371668 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9c640682f0 0x7f9c6406a7a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.212+0000 7f9c7e22d700 1 --2- 172.21.15.5:0/236371668 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9c7814c690 0x7f9c780abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.212+0000 7f9c7e22d700 1 --2- 172.21.15.5:0/236371668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9c60004850 0x7f9c781f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.212+0000 7f9c7e22d700 1 --2- 172.21.15.5:0/236371668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c780adf00 0x7f9c7814c150 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.212+0000 7f9c7e22d700 1 -- 172.21.15.5:0/236371668 >> 172.21.15.5:0/236371668 conn(0x7f9c7806f3c0 msgr2=0x7f9c780b5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:45.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.212+0000 7f9c7e22d700 1 -- 172.21.15.5:0/236371668 shutdown_connections 2023-03-03T06:23:45.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.212+0000 7f9c7e22d700 1 -- 172.21.15.5:0/236371668 wait complete. 2023-03-03T06:23:45.216 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2023-03-03T06:23:45.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:23:45.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.350+0000 7fdbe1f47700 1 Processor -- start 2023-03-03T06:23:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.350+0000 7fdbe1f47700 1 -- start start 2023-03-03T06:23:45.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.351+0000 7fdbe1f47700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdbdc0b1f80 0x7fdbdc0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.351+0000 7fdbe1f47700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc159bd0 con 0x7fdbdc0cf3d0 2023-03-03T06:23:45.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.351+0000 7fdbe1f47700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc15d650 con 0x7fdbdc0cf7a0 2023-03-03T06:23:45.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.351+0000 7fdbe1f47700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc15e1d0 con 0x7fdbdc0b1f80 2023-03-03T06:23:45.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.351+0000 7fdbdb7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdbdc0cf3d0 0x7fdbdc0cb510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59142/0 (socket says 172.21.15.5:59142) 2023-03-03T06:23:45.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.351+0000 7fdbdb7fe700 1 -- 172.21.15.5:0/1789012563 learned_addr learned my addr 172.21.15.5:0/1789012563 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:45.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.351+0000 7fdbdbfff700 1 --2- 172.21.15.5:0/1789012563 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdbdc0b1f80 0x7fdbdc0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326102965 0 0) 0x7fdbcc001110 con 0x7fdbdc0cf3d0 2023-03-03T06:23:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc80035b0 con 0x7fdbdc0cf3d0 2023-03-03T06:23:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2327032941 0 0) 0x7fdbc80035b0 con 0x7fdbdc0cf3d0 2023-03-03T06:23:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdbdc0b1f80 msgr2=0x7fdbdc0cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 --2- 172.21.15.5:0/1789012563 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdbdc0b1f80 0x7fdbdc0cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 >> v1:172.21.15.191:6789/0 conn(0x7fdbdc0cf7a0 legacy=0x7fdbdc0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc15d930 con 0x7fdbdc0cf3d0 2023-03-03T06:23:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fdbcc001800 con 0x7fdbdc0cf3d0 2023-03-03T06:23:45.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 >> v1:172.21.15.5:6789/0 conn(0x7fdbdc0cf3d0 legacy=0x7fdbdc0cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 --2- 172.21.15.5:0/1789012563 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdbdc0b1f80 0x7fdbc8003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 --2- 172.21.15.5:0/1789012563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbc8004020 0x7fdbc8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 --2- 172.21.15.5:0/1789012563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbc8004d90 0x7fdbc8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc15e1d0 con 0x7fdbc8004d90 2023-03-03T06:23:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc800bb50 con 0x7fdbc8004020 2023-03-03T06:23:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc800bd10 con 0x7fdbdc0b1f80 2023-03-03T06:23:45.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbdbfff700 1 --2- 172.21.15.5:0/1789012563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbc8004d90 0x7fdbc8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbdb7fe700 1 --2- 172.21.15.5:0/1789012563 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdbdc0b1f80 0x7fdbc8003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbdaffd700 1 --2- 172.21.15.5:0/1789012563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbc8004020 0x7fdbc8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbdbfff700 1 -- 172.21.15.5:0/1789012563 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdbdc0b1f80 msgr2=0x7fdbc8003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbdbfff700 1 --2- 172.21.15.5:0/1789012563 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdbdc0b1f80 0x7fdbc8003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbdbfff700 1 -- 172.21.15.5:0/1789012563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbc8004020 msgr2=0x7fdbc8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbdbfff700 1 --2- 172.21.15.5:0/1789012563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbc8004020 0x7fdbc8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbdbfff700 1 -- 172.21.15.5:0/1789012563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc80035b0 con 0x7fdbc8004d90 2023-03-03T06:23:45.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbdaffd700 1 --2- 172.21.15.5:0/1789012563 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbc8004020 0x7fdbc8004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.352+0000 7fdbdbfff700 1 --2- 172.21.15.5:0/1789012563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbc8004d90 0x7fdbc8005200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009fc0 tx=0x7fdbc8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e61c1324e1f10ea server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.353+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400ec30 con 0x7fdbc8004d90 2023-03-03T06:23:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.353+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd400f040 con 0x7fdbc8004d90 2023-03-03T06:23:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.353+0000 7fdbda7fc700 1 -- 172.21.15.5:0/1789012563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4014480 con 0x7fdbc8004d90 2023-03-03T06:23:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.353+0000 7fdbe1f47700 1 -- 172.21.15.5:0/1789012563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbc8004d90 msgr2=0x7fdbc8005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.353+0000 7fdbe1f47700 1 --2- 172.21.15.5:0/1789012563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbc8004d90 0x7fdbc8005200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009fc0 tx=0x7fdbc8005880 comp rx=0 tx=0).stop 2023-03-03T06:23:45.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.353+0000 7fdbdbfff700 1 -- 172.21.15.5:0/1789012563 reap_dead start 2023-03-03T06:23:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.353+0000 7fdbe1f47700 1 -- 172.21.15.5:0/1789012563 shutdown_connections 2023-03-03T06:23:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.353+0000 7fdbe1f47700 1 -- 172.21.15.5:0/1789012563 >> 172.21.15.5:0/1789012563 conn(0x7fdbdc06ea70 msgr2=0x7fdbdc0cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.353+0000 7fdbe1f47700 1 -- 172.21.15.5:0/1789012563 shutdown_connections 2023-03-03T06:23:45.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.353+0000 7fdbe1f47700 1 -- 172.21.15.5:0/1789012563 wait complete. 2023-03-03T06:23:45.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.354+0000 7fdbe1f47700 1 Processor -- start 2023-03-03T06:23:45.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.355+0000 7fdbe1f47700 1 -- start start 2023-03-03T06:23:45.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.355+0000 7fdbe1f47700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0c92b0 0x7fdbdc0c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.355+0000 7fdbe1f47700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbdc1e41a0 0x7fdbdc0c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.355+0000 7fdbe1f47700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdbdc1e57b0 0x7fdbdc0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.355+0000 7fdbe1f47700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0c7940 con 0x7fdbdc0c92b0 2023-03-03T06:23:45.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.355+0000 7fdbe1f47700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc1e4710 con 0x7fdbdc1e41a0 2023-03-03T06:23:45.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.355+0000 7fdbe1f47700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc1e49f0 con 0x7fdbdc1e57b0 2023-03-03T06:23:45.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.355+0000 7fdbdb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0c92b0 0x7fdbdc0c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.355+0000 7fdbdb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0c92b0 0x7fdbdc0c6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41080/0 (socket says 172.21.15.5:41080) 2023-03-03T06:23:45.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.355+0000 7fdbdb7fe700 1 -- 172.21.15.5:0/3361599051 learned_addr learned my addr 172.21.15.5:0/3361599051 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:45.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.355+0000 7fdbdbfff700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdbdc1e57b0 0x7fdbdc0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.355+0000 7fdbdaffd700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbdc1e41a0 0x7fdbdc0c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.356+0000 7fdbdb7fe700 1 -- 172.21.15.5:0/3361599051 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdbdc1e57b0 msgr2=0x7fdbdc0c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.356+0000 7fdbdb7fe700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdbdc1e57b0 0x7fdbdc0c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.356+0000 7fdbdb7fe700 1 -- 172.21.15.5:0/3361599051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbdc1e41a0 msgr2=0x7fdbdc0c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.356+0000 7fdbdb7fe700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbdc1e41a0 0x7fdbdc0c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.356+0000 7fdbdb7fe700 1 -- 172.21.15.5:0/3361599051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc15def0 con 0x7fdbdc0c92b0 2023-03-03T06:23:45.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.356+0000 7fdbdb7fe700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0c92b0 0x7fdbdc0c6ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc001270 tx=0x7fdbcc0075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.356+0000 7fdbd3fff700 1 -- 172.21.15.5:0/3361599051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc00f5d0 con 0x7fdbdc0c92b0 2023-03-03T06:23:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.356+0000 7fdbd3fff700 1 -- 172.21.15.5:0/3361599051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc00f730 con 0x7fdbdc0c92b0 2023-03-03T06:23:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.356+0000 7fdbe1f47700 1 -- 172.21.15.5:0/3361599051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbdc15dc10 con 0x7fdbdc0c92b0 2023-03-03T06:23:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.356+0000 7fdbd3fff700 1 -- 172.21.15.5:0/3361599051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc00fae0 con 0x7fdbdc0c92b0 2023-03-03T06:23:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.356+0000 7fdbe1f47700 1 -- 172.21.15.5:0/3361599051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc15d270 con 0x7fdbdc0c92b0 2023-03-03T06:23:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.357+0000 7fdbe1f47700 1 -- 172.21.15.5:0/3361599051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc04e6e0 con 0x7fdbdc0c92b0 2023-03-03T06:23:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.357+0000 7fdbd3fff700 1 -- 172.21.15.5:0/3361599051 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdbcc00fc40 con 0x7fdbdc0c92b0 2023-03-03T06:23:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.358+0000 7fdbd3fff700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdbbc0682f0 0x7fdbbc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.358+0000 7fdbd3fff700 1 -- 172.21.15.5:0/3361599051 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdbcc085e40 con 0x7fdbdc0c92b0 2023-03-03T06:23:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.358+0000 7fdbdaffd700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdbbc0682f0 0x7fdbbc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.358+0000 7fdbdaffd700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdbbc0682f0 0x7fdbbc06a7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4001750 tx=0x7fdbc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:45.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.362+0000 7fdbd3fff700 1 -- 172.21.15.5:0/3361599051 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdbcc052460 con 0x7fdbdc0c92b0 2023-03-03T06:23:45.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.560+0000 7fdbe1f47700 1 -- 172.21.15.5:0/3361599051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbdc159bd0 con 0x7fdbdc0c92b0 2023-03-03T06:23:45.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.561+0000 7fdbd3fff700 1 -- 172.21.15.5:0/3361599051 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7fdbdc159bd0 con 0x7fdbdc0c92b0 2023-03-03T06:23:45.564 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:45.564 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:23:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.563+0000 7fdbe1f47700 1 -- 172.21.15.5:0/3361599051 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdbbc0682f0 msgr2=0x7fdbbc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.563+0000 7fdbe1f47700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdbbc0682f0 0x7fdbbc06a7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4001750 tx=0x7fdbc4009040 comp rx=0 tx=0).stop 2023-03-03T06:23:45.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.563+0000 7fdbe1f47700 1 -- 172.21.15.5:0/3361599051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0c92b0 msgr2=0x7fdbdc0c6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.563+0000 7fdbe1f47700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0c92b0 0x7fdbdc0c6ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc001270 tx=0x7fdbcc0075f0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.563+0000 7fdbe1f47700 1 -- 172.21.15.5:0/3361599051 shutdown_connections 2023-03-03T06:23:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.563+0000 7fdbe1f47700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdbbc0682f0 0x7fdbbc06a7a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.563+0000 7fdbe1f47700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdbdc1e57b0 0x7fdbdc0c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.563+0000 7fdbe1f47700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbdc0c92b0 0x7fdbdc0c6ec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.563+0000 7fdbe1f47700 1 --2- 172.21.15.5:0/3361599051 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdbdc1e41a0 0x7fdbdc0c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.563+0000 7fdbe1f47700 1 -- 172.21.15.5:0/3361599051 >> 172.21.15.5:0/3361599051 conn(0x7fdbdc06ea70 msgr2=0x7fdbdc0cfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.564+0000 7fdbe1f47700 1 -- 172.21.15.5:0/3361599051 shutdown_connections 2023-03-03T06:23:45.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.564+0000 7fdbe1f47700 1 -- 172.21.15.5:0/3361599051 wait complete. 2023-03-03T06:23:45.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:23:45.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.701+0000 7f13571e7700 1 Processor -- start 2023-03-03T06:23:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.701+0000 7f13571e7700 1 -- start start 2023-03-03T06:23:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.701+0000 7f13571e7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1350159730 0x7f135015d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f13571e7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f13500714c0 0x7f1350071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f13571e7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135015aa90 con 0x7f13500cec00 2023-03-03T06:23:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f13571e7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1350071ea0 con 0x7f1350159730 2023-03-03T06:23:45.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f13571e7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135015a220 con 0x7f13500714c0 2023-03-03T06:23:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f1354f83700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1350159730 0x7f135015d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f1354f83700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1350159730 0x7f135015d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41088/0 (socket says 172.21.15.5:41088) 2023-03-03T06:23:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f1354f83700 1 -- 172.21.15.5:0/1962333195 learned_addr learned my addr 172.21.15.5:0/1962333195 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f1355784700 1 --2- 172.21.15.5:0/1962333195 >> v2:172.21.15.191:3300/0 conn(0x7f13500714c0 0x7f1350071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f1354f83700 1 -- 172.21.15.5:0/1962333195 >> v2:172.21.15.191:3300/0 conn(0x7f13500714c0 msgr2=0x7f1350071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f1354f83700 1 --2- 172.21.15.5:0/1962333195 >> v2:172.21.15.191:3300/0 conn(0x7f13500714c0 0x7f1350071960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f1354f83700 1 -- 172.21.15.5:0/1962333195 >> v1:172.21.15.191:6789/0 conn(0x7f13500cec00 legacy=0x7f1350159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f1354f83700 1 -- 172.21.15.5:0/1962333195 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135015a4d0 con 0x7f1350159730 2023-03-03T06:23:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f1354f83700 1 --2- 172.21.15.5:0/1962333195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1350159730 0x7f135015d9f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1350072290 tx=0x7f1344009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da790c7d98658703 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f134f7fe700 1 -- 172.21.15.5:0/1962333195 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344004230 con 0x7f1350159730 2023-03-03T06:23:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f134f7fe700 1 -- 172.21.15.5:0/1962333195 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1344004390 con 0x7f1350159730 2023-03-03T06:23:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.702+0000 7f134f7fe700 1 -- 172.21.15.5:0/1962333195 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13440036a0 con 0x7f1350159730 2023-03-03T06:23:45.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.703+0000 7f13571e7700 1 -- 172.21.15.5:0/1962333195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1350159730 msgr2=0x7f135015d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.703+0000 7f13571e7700 1 --2- 172.21.15.5:0/1962333195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1350159730 0x7f135015d9f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1350072290 tx=0x7f1344009bd0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.703+0000 7f13571e7700 1 -- 172.21.15.5:0/1962333195 shutdown_connections 2023-03-03T06:23:45.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.703+0000 7f13571e7700 1 --2- 172.21.15.5:0/1962333195 >> v2:172.21.15.191:3300/0 conn(0x7f13500714c0 0x7f1350071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.703+0000 7f13571e7700 1 --2- 172.21.15.5:0/1962333195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1350159730 0x7f135015d9f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.703+0000 7f13571e7700 1 -- 172.21.15.5:0/1962333195 >> 172.21.15.5:0/1962333195 conn(0x7f13500cf4b0 msgr2=0x7f13500cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:45.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.703+0000 7f13571e7700 1 -- 172.21.15.5:0/1962333195 shutdown_connections 2023-03-03T06:23:45.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.703+0000 7f13571e7700 1 -- 172.21.15.5:0/1962333195 wait complete. 2023-03-03T06:23:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.704+0000 7f13571e7700 1 Processor -- start 2023-03-03T06:23:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.704+0000 7f13571e7700 1 -- start start 2023-03-03T06:23:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f13571e7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13500714c0 0x7f13500c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f13571e7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13500cec00 0x7f135006b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f13571e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135015cb00 0x7f1350152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f13571e7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13500b3280 con 0x7f135015cb00 2023-03-03T06:23:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f13571e7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135006bf60 con 0x7f13500714c0 2023-03-03T06:23:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f13571e7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135006b9a0 con 0x7f13500cec00 2023-03-03T06:23:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f1355784700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135015cb00 0x7f1350152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f1355784700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135015cb00 0x7f1350152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41098/0 (socket says 172.21.15.5:41098) 2023-03-03T06:23:45.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f1355784700 1 -- 172.21.15.5:0/1038328662 learned_addr learned my addr 172.21.15.5:0/1038328662 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f134ffff700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13500cec00 0x7f135006b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f1354f83700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13500714c0 0x7f13500c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f1355784700 1 -- 172.21.15.5:0/1038328662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13500cec00 msgr2=0x7f135006b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f1355784700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13500cec00 0x7f135006b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f1355784700 1 -- 172.21.15.5:0/1038328662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13500714c0 msgr2=0x7f13500c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f1355784700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13500714c0 0x7f13500c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f1355784700 1 -- 172.21.15.5:0/1038328662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1344009550 con 0x7f135015cb00 2023-03-03T06:23:45.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.705+0000 7f134ffff700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13500cec00 0x7f135006b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.706+0000 7f1355784700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135015cb00 0x7f1350152b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f134800cc30 tx=0x7f134800a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.706+0000 7f134d7fa700 1 -- 172.21.15.5:0/1038328662 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134800ab70 con 0x7f135015cb00 2023-03-03T06:23:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.706+0000 7f134d7fa700 1 -- 172.21.15.5:0/1038328662 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134800acd0 con 0x7f135015cb00 2023-03-03T06:23:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.706+0000 7f134d7fa700 1 -- 172.21.15.5:0/1038328662 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348003c40 con 0x7f135015cb00 2023-03-03T06:23:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.706+0000 7f13571e7700 1 -- 172.21.15.5:0/1038328662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135015d1f0 con 0x7f135015cb00 2023-03-03T06:23:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.706+0000 7f13571e7700 1 -- 172.21.15.5:0/1038328662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135015a7b0 con 0x7f135015cb00 2023-03-03T06:23:45.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.707+0000 7f13571e7700 1 -- 172.21.15.5:0/1038328662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135015d4d0 con 0x7f135015cb00 2023-03-03T06:23:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.707+0000 7f134d7fa700 1 -- 172.21.15.5:0/1038328662 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f134801f070 con 0x7f135015cb00 2023-03-03T06:23:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.708+0000 7f134d7fa700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13340682f0 0x7f133406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.708+0000 7f134d7fa700 1 -- 172.21.15.5:0/1038328662 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1348086170 con 0x7f135015cb00 2023-03-03T06:23:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.708+0000 7f1354f83700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13340682f0 0x7f133406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.708+0000 7f1354f83700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13340682f0 0x7f133406a7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1344009130 tx=0x7f1344008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:45.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.712+0000 7f134d7fa700 1 -- 172.21.15.5:0/1038328662 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1348052590 con 0x7f135015cb00 2023-03-03T06:23:45.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.905+0000 7f13571e7700 1 -- 172.21.15.5:0/1038328662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f135004e6e0 con 0x7f135015cb00 2023-03-03T06:23:45.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.907+0000 7f134d7fa700 1 -- 172.21.15.5:0/1038328662 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7f1348055bb0 con 0x7f135015cb00 2023-03-03T06:23:45.909 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:45.909 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:23:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.909+0000 7f13571e7700 1 -- 172.21.15.5:0/1038328662 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13340682f0 msgr2=0x7f133406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.909+0000 7f13571e7700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13340682f0 0x7f133406a7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1344009130 tx=0x7f1344008030 comp rx=0 tx=0).stop 2023-03-03T06:23:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.909+0000 7f13571e7700 1 -- 172.21.15.5:0/1038328662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135015cb00 msgr2=0x7f1350152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:45.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.909+0000 7f13571e7700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135015cb00 0x7f1350152b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f134800cc30 tx=0x7f134800a1f0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.909+0000 7f13571e7700 1 -- 172.21.15.5:0/1038328662 shutdown_connections 2023-03-03T06:23:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.909+0000 7f13571e7700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f135015cb00 0x7f1350152b10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.909+0000 7f13571e7700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13500714c0 0x7f13500c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.909+0000 7f13571e7700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13340682f0 0x7f133406a7a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.909+0000 7f13571e7700 1 --2- 172.21.15.5:0/1038328662 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13500cec00 0x7f135006b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.909+0000 7f13571e7700 1 -- 172.21.15.5:0/1038328662 >> 172.21.15.5:0/1038328662 conn(0x7f13500cf4b0 msgr2=0x7f13500cd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.909+0000 7f13571e7700 1 -- 172.21.15.5:0/1038328662 shutdown_connections 2023-03-03T06:23:45.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:45.909+0000 7f13571e7700 1 -- 172.21.15.5:0/1038328662 wait complete. 2023-03-03T06:23:45.940 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:23:46.030 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-03-03T06:23:46.028+0000 7fe5a6f69700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-03T06:23:46.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.062+0000 7fbac624a700 1 Processor -- start 2023-03-03T06:23:46.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.062+0000 7fbac624a700 1 -- start start 2023-03-03T06:23:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.063+0000 7fbac624a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbac00d0290 0x7fbac00cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.063+0000 7fbac624a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbac00b2850 0x7fbac00b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.063+0000 7fbac624a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac015f270 con 0x7fbac00d0660 2023-03-03T06:23:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.063+0000 7fbabeffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbac00d0660 0x7fbac00cb420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59176/0 (socket says 172.21.15.5:59176) 2023-03-03T06:23:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.063+0000 7fbabeffd700 1 -- 172.21.15.5:0/2340212913 learned_addr learned my addr 172.21.15.5:0/2340212913 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.063+0000 7fbac624a700 1 -- 172.21.15.5:0/2340212913 --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac00cbc50 con 0x7fbac00d0290 2023-03-03T06:23:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.063+0000 7fbac624a700 1 -- 172.21.15.5:0/2340212913 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00b31d0 con 0x7fbac00b2850 2023-03-03T06:23:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.063+0000 7fbabf7fe700 1 --2- 172.21.15.5:0/2340212913 >> v2:172.21.15.191:3300/0 conn(0x7fbac00d0290 0x7fbac00cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.063+0000 7fbabffff700 1 --2- 172.21.15.5:0/2340212913 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbac00b2850 0x7fbac00b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.063+0000 7fbabe7fc700 1 -- 172.21.15.5:0/2340212913 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968762330 0 0) 0x7fbac015f270 con 0x7fbac00d0660 2023-03-03T06:23:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.064+0000 7fbabe7fc700 1 -- 172.21.15.5:0/2340212913 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaac0035b0 con 0x7fbac00d0660 2023-03-03T06:23:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.064+0000 7fbabf7fe700 1 -- 172.21.15.5:0/2340212913 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbac00b2850 msgr2=0x7fbac00b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.064+0000 7fbabf7fe700 1 --2- 172.21.15.5:0/2340212913 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbac00b2850 0x7fbac00b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.064+0000 7fbabe7fc700 1 -- 172.21.15.5:0/2340212913 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3804043079 0 0) 0x7fbaac0035b0 con 0x7fbac00d0660 2023-03-03T06:23:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.064+0000 7fbabf7fe700 1 -- 172.21.15.5:0/2340212913 >> v1:172.21.15.5:6789/0 conn(0x7fbac00d0660 legacy=0x7fbac00cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.064+0000 7fbabf7fe700 1 -- 172.21.15.5:0/2340212913 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac015e4b0 con 0x7fbac00d0290 2023-03-03T06:23:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.064+0000 7fbabffff700 1 --2- 172.21.15.5:0/2340212913 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbac00b2850 0x7fbac00b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.064+0000 7fbabf7fe700 1 --2- 172.21.15.5:0/2340212913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac00d0290 0x7fbac00cd270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009840 tx=0x7fbab0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f9d28c80f4dcc22 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.064+0000 7fbabe7fc700 1 -- 172.21.15.5:0/2340212913 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8001670 con 0x7fbac00d0290 2023-03-03T06:23:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.064+0000 7fbabe7fc700 1 -- 172.21.15.5:0/2340212913 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab0004030 con 0x7fbac00d0290 2023-03-03T06:23:46.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.064+0000 7fbabe7fc700 1 -- 172.21.15.5:0/2340212913 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab00043a0 con 0x7fbac00d0290 2023-03-03T06:23:46.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.065+0000 7fbac624a700 1 -- 172.21.15.5:0/2340212913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac00d0290 msgr2=0x7fbac00cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.065+0000 7fbac624a700 1 --2- 172.21.15.5:0/2340212913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac00d0290 0x7fbac00cd270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009840 tx=0x7fbab0009b50 comp rx=0 tx=0).stop 2023-03-03T06:23:46.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.065+0000 7fbac624a700 1 -- 172.21.15.5:0/2340212913 shutdown_connections 2023-03-03T06:23:46.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.065+0000 7fbac624a700 1 --2- 172.21.15.5:0/2340212913 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbac00b2850 0x7fbac00b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.065+0000 7fbac624a700 1 --2- 172.21.15.5:0/2340212913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac00d0290 0x7fbac00cd270 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.065+0000 7fbac624a700 1 -- 172.21.15.5:0/2340212913 >> 172.21.15.5:0/2340212913 conn(0x7fbac0070050 msgr2=0x7fbac00cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:46.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.065+0000 7fbac624a700 1 -- 172.21.15.5:0/2340212913 shutdown_connections 2023-03-03T06:23:46.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.065+0000 7fbac624a700 1 -- 172.21.15.5:0/2340212913 wait complete. 2023-03-03T06:23:46.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.066+0000 7fbac624a700 1 Processor -- start 2023-03-03T06:23:46.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.066+0000 7fbac624a700 1 -- start start 2023-03-03T06:23:46.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbac624a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbac00b2850 0x7fbac00ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbac624a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac00d0290 0x7fbac00c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbac624a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac00d0660 0x7fbac00c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbac624a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac01f2420 con 0x7fbac00d0660 2023-03-03T06:23:46.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbac624a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00c4a20 con 0x7fbac00d0290 2023-03-03T06:23:46.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbac624a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00c55a0 con 0x7fbac00b2850 2023-03-03T06:23:46.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbabffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac00d0660 0x7fbac00c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbabffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac00d0660 0x7fbac00c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41112/0 (socket says 172.21.15.5:41112) 2023-03-03T06:23:46.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbabffff700 1 -- 172.21.15.5:0/3385054940 learned_addr learned my addr 172.21.15.5:0/3385054940 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:46.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbabf7fe700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbac00b2850 0x7fbac00ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbabeffd700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac00d0290 0x7fbac00c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbabffff700 1 -- 172.21.15.5:0/3385054940 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbac00b2850 msgr2=0x7fbac00ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbabffff700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbac00b2850 0x7fbac00ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbabffff700 1 -- 172.21.15.5:0/3385054940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac00d0290 msgr2=0x7fbac00c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbabffff700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac00d0290 0x7fbac00c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbabffff700 1 -- 172.21.15.5:0/3385054940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8009a70 con 0x7fbac00d0660 2023-03-03T06:23:46.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.067+0000 7fbabffff700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac00d0660 0x7fbac00c9950 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbab800efc0 tx=0x7fbab800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:46.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.068+0000 7fbab7fff700 1 -- 172.21.15.5:0/3385054940 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8009d70 con 0x7fbac00d0660 2023-03-03T06:23:46.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.068+0000 7fbab7fff700 1 -- 172.21.15.5:0/3385054940 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab800f040 con 0x7fbac00d0660 2023-03-03T06:23:46.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.068+0000 7fbab7fff700 1 -- 172.21.15.5:0/3385054940 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab800ce00 con 0x7fbac00d0660 2023-03-03T06:23:46.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.068+0000 7fbac624a700 1 -- 172.21.15.5:0/3385054940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab00094a0 con 0x7fbac00d0660 2023-03-03T06:23:46.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.068+0000 7fbac624a700 1 -- 172.21.15.5:0/3385054940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac015ea70 con 0x7fbac00d0660 2023-03-03T06:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.069+0000 7fbac624a700 1 -- 172.21.15.5:0/3385054940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac015e790 con 0x7fbac00d0660 2023-03-03T06:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.069+0000 7fbab7fff700 1 -- 172.21.15.5:0/3385054940 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbab8014480 con 0x7fbac00d0660 2023-03-03T06:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.069+0000 7fbab7fff700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbaa00682f0 0x7fbaa006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.069+0000 7fbab7fff700 1 -- 172.21.15.5:0/3385054940 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbab80869b0 con 0x7fbac00d0660 2023-03-03T06:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.069+0000 7fbabf7fe700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbaa00682f0 0x7fbaa006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.070+0000 7fbabf7fe700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbaa00682f0 0x7fbaa006a7a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbab00090b0 tx=0x7fbab0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:46.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.074+0000 7fbab7fff700 1 -- 172.21.15.5:0/3385054940 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbab8052dd0 con 0x7fbac00d0660 2023-03-03T06:23:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.312+0000 7fbac624a700 1 -- 172.21.15.5:0/3385054940 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbac015ed50 con 0x7fbac00d0660 2023-03-03T06:23:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.312+0000 7fbab7fff700 1 -- 172.21.15.5:0/3385054940 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4638 (secure 0 0 0) 0x7fbab80563f0 con 0x7fbac00d0660 2023-03-03T06:23:46.315 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/277386051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":277386051},{"type":"v1","addr":"172.21.15.5:6837","nonce":277386051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2875199515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2875199515},{"type":"v1","addr":"172.21.15.191:6835","nonce":2875199515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2122425608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2122425608},{"type":"v1","addr":"172.21.15.191:6833","nonce":2122425608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:23:40.315678+0000","modified":"2023-03-03T06:23:44.818612+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/305842942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":305842942},{"type":"v1","addr":"172.21.15.5:6836","nonce":305842942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-03-03T06:23:46.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.314+0000 7fbac624a700 1 -- 172.21.15.5:0/3385054940 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbaa00682f0 msgr2=0x7fbaa006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.314+0000 7fbac624a700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbaa00682f0 0x7fbaa006a7a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbab00090b0 tx=0x7fbab0008030 comp rx=0 tx=0).stop 2023-03-03T06:23:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.314+0000 7fbac624a700 1 -- 172.21.15.5:0/3385054940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac00d0660 msgr2=0x7fbac00c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.314+0000 7fbac624a700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac00d0660 0x7fbac00c9950 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbab800efc0 tx=0x7fbab800c3a0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.315+0000 7fbac624a700 1 -- 172.21.15.5:0/3385054940 shutdown_connections 2023-03-03T06:23:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.315+0000 7fbac624a700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbac00d0660 0x7fbac00c9950 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.315+0000 7fbac624a700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbaa00682f0 0x7fbaa006a7a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.315+0000 7fbac624a700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbac00b2850 0x7fbac00ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.315+0000 7fbac624a700 1 --2- 172.21.15.5:0/3385054940 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac00d0290 0x7fbac00c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.315+0000 7fbac624a700 1 -- 172.21.15.5:0/3385054940 >> 172.21.15.5:0/3385054940 conn(0x7fbac0070050 msgr2=0x7fbac00b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.315+0000 7fbac624a700 1 -- 172.21.15.5:0/3385054940 shutdown_connections 2023-03-03T06:23:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.315+0000 7fbac624a700 1 -- 172.21.15.5:0/3385054940 wait complete. 2023-03-03T06:23:46.319 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2023-03-03T06:23:46.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-03T06:23:40.315678+0000', 'modified': '2023-03-03T06:23:44.818612+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6836/305842942', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 305842942}, {'type': 'v1', 'addr': '172.21.15.5:6836', 'nonce': 305842942}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-03-03T06:23:46.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-03T06:23:46.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-03-03T06:23:46.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.859+0000 7f2a133af700 1 Processor -- start 2023-03-03T06:23:46.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.859+0000 7f2a133af700 1 -- start start 2023-03-03T06:23:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a133af700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c0cb690 0x7f2a0c15ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a133af700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a0c15ef50 0x7f2a0c06a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a133af700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0c15e580 con 0x7f2a0c15a7d0 2023-03-03T06:23:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a133af700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0c0ca710 con 0x7f2a0c15ef50 2023-03-03T06:23:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a133af700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c0ca9f0 con 0x7f2a0c0cb690 2023-03-03T06:23:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a1194c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a0c15ef50 0x7f2a0c06a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a1194c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a0c15ef50 0x7f2a0c06a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41120/0 (socket says 172.21.15.5:41120) 2023-03-03T06:23:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a1194c700 1 -- 172.21.15.5:0/2938309024 learned_addr learned my addr 172.21.15.5:0/2938309024 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a1094a700 1 --2- 172.21.15.5:0/2938309024 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c0cb690 0x7f2a0c15ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a1194c700 1 -- 172.21.15.5:0/2938309024 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c0cb690 msgr2=0x7f2a0c15ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a1194c700 1 --2- 172.21.15.5:0/2938309024 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c0cb690 0x7f2a0c15ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a1194c700 1 -- 172.21.15.5:0/2938309024 >> v1:172.21.15.191:6789/0 conn(0x7f2a0c15a7d0 legacy=0x7f2a0c0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a1194c700 1 -- 172.21.15.5:0/2938309024 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c0cacd0 con 0x7f2a0c15ef50 2023-03-03T06:23:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a1094a700 1 --2- 172.21.15.5:0/2938309024 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c0cb690 0x7f2a0c15ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a1194c700 1 --2- 172.21.15.5:0/2938309024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c15ef50 0x7f2a0c06a330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009e50 tx=0x7f2a0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62529e85b301d030 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:46.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a03fff700 1 -- 172.21.15.5:0/2938309024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0400e070 con 0x7f2a0c15ef50 2023-03-03T06:23:46.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.860+0000 7f2a03fff700 1 -- 172.21.15.5:0/2938309024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a04003a20 con 0x7f2a0c15ef50 2023-03-03T06:23:46.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.861+0000 7f2a03fff700 1 -- 172.21.15.5:0/2938309024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04003dd0 con 0x7f2a0c15ef50 2023-03-03T06:23:46.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.861+0000 7f2a133af700 1 -- 172.21.15.5:0/2938309024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c15ef50 msgr2=0x7f2a0c06a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.861+0000 7f2a133af700 1 --2- 172.21.15.5:0/2938309024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c15ef50 0x7f2a0c06a330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009e50 tx=0x7f2a0400b330 comp rx=0 tx=0).stop 2023-03-03T06:23:46.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.861+0000 7f2a133af700 1 -- 172.21.15.5:0/2938309024 shutdown_connections 2023-03-03T06:23:46.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.861+0000 7f2a133af700 1 --2- 172.21.15.5:0/2938309024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c15ef50 0x7f2a0c06a330 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.861+0000 7f2a133af700 1 --2- 172.21.15.5:0/2938309024 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c0cb690 0x7f2a0c15ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.861+0000 7f2a133af700 1 -- 172.21.15.5:0/2938309024 >> 172.21.15.5:0/2938309024 conn(0x7f2a0c0cf4b0 msgr2=0x7f2a0c0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.861+0000 7f2a133af700 1 -- 172.21.15.5:0/2938309024 shutdown_connections 2023-03-03T06:23:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.861+0000 7f2a133af700 1 -- 172.21.15.5:0/2938309024 wait complete. 2023-03-03T06:23:46.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.862+0000 7f2a133af700 1 Processor -- start 2023-03-03T06:23:46.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.862+0000 7f2a133af700 1 -- start start 2023-03-03T06:23:46.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a133af700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a0c0cb690 0x7f2a0c0ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a133af700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c15a7d0 0x7f2a0c0ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a133af700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c15ef50 0x7f2a0c154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a133af700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c0ce810 con 0x7f2a0c15ef50 2023-03-03T06:23:46.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a133af700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c0cf070 con 0x7f2a0c0cb690 2023-03-03T06:23:46.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a133af700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c154f70 con 0x7f2a0c15a7d0 2023-03-03T06:23:46.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a1194c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c15ef50 0x7f2a0c154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a1194c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c15ef50 0x7f2a0c154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41126/0 (socket says 172.21.15.5:41126) 2023-03-03T06:23:46.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a1194c700 1 -- 172.21.15.5:0/3170620196 learned_addr learned my addr 172.21.15.5:0/3170620196 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:46.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a1114b700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a0c0cb690 0x7f2a0c0ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a1094a700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c15a7d0 0x7f2a0c0ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a1194c700 1 -- 172.21.15.5:0/3170620196 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c15a7d0 msgr2=0x7f2a0c0ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a1194c700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c15a7d0 0x7f2a0c0ce2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a1194c700 1 -- 172.21.15.5:0/3170620196 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a0c0cb690 msgr2=0x7f2a0c0ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a1194c700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a0c0cb690 0x7f2a0c0ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a1194c700 1 -- 172.21.15.5:0/3170620196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a04009b30 con 0x7f2a0c15ef50 2023-03-03T06:23:46.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.863+0000 7f2a1094a700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c15a7d0 0x7f2a0c0ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:46.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.864+0000 7f2a1194c700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c15ef50 0x7f2a0c154a30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c06cfe0 tx=0x7f2a04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:46.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.864+0000 7f2a01ffb700 1 -- 172.21.15.5:0/3170620196 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04004440 con 0x7f2a0c15ef50 2023-03-03T06:23:46.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.864+0000 7f2a01ffb700 1 -- 172.21.15.5:0/3170620196 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a040045c0 con 0x7f2a0c15ef50 2023-03-03T06:23:46.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.864+0000 7f2a133af700 1 -- 172.21.15.5:0/3170620196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0c06a870 con 0x7f2a0c15ef50 2023-03-03T06:23:46.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.864+0000 7f2a01ffb700 1 -- 172.21.15.5:0/3170620196 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04004970 con 0x7f2a0c15ef50 2023-03-03T06:23:46.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.864+0000 7f2a133af700 1 -- 172.21.15.5:0/3170620196 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0c15e210 con 0x7f2a0c15ef50 2023-03-03T06:23:46.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.865+0000 7f2a01ffb700 1 -- 172.21.15.5:0/3170620196 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2a04022030 con 0x7f2a0c15ef50 2023-03-03T06:23:46.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.866+0000 7f2a01ffb700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f29f00682f0 0x7f29f006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.866+0000 7f2a01ffb700 1 -- 172.21.15.5:0/3170620196 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a040872f0 con 0x7f2a0c15ef50 2023-03-03T06:23:46.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.866+0000 7f2a1114b700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f29f00682f0 0x7f29f006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.866+0000 7f2a1114b700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f29f00682f0 0x7f29f006a7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2a08007fd0 tx=0x7f2a08007ec0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:46.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.868+0000 7f2a1f538b80 1 Processor -- start 2023-03-03T06:23:46.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.868+0000 7f2a1f538b80 1 -- start start 2023-03-03T06:23:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1f538b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364ce0d70 0x563364cc21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1f538b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cbf2e0 0x563364ce1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1f538b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cebc20 0x563364cec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1f538b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364babbc0 con 0x563364cbf2e0 2023-03-03T06:23:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1f538b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364c1a350 con 0x563364ce0d70 2023-03-03T06:23:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1f538b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x563364c13880 con 0x563364cebc20 2023-03-03T06:23:46.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1094a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cbf2e0 0x563364ce1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1094a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cbf2e0 0x563364ce1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41132/0 (socket says 172.21.15.5:41132) 2023-03-03T06:23:46.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1094a700 1 -- 172.21.15.5:0/2045327452 learned_addr learned my addr 172.21.15.5:0/2045327452 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:46.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1194c700 1 --2- 172.21.15.5:0/2045327452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cebc20 0x563364cec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1114b700 1 --2- 172.21.15.5:0/2045327452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364ce0d70 0x563364cc21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1094a700 1 -- 172.21.15.5:0/2045327452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cebc20 msgr2=0x563364cec090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:46.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1094a700 1 --2- 172.21.15.5:0/2045327452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cebc20 0x563364cec090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1094a700 1 -- 172.21.15.5:0/2045327452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364ce0d70 msgr2=0x563364cc21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1094a700 1 --2- 172.21.15.5:0/2045327452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364ce0d70 0x563364cc21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1094a700 1 -- 172.21.15.5:0/2045327452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563364a955e0 con 0x563364cbf2e0 2023-03-03T06:23:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.869+0000 7f2a1094a700 1 --2- 172.21.15.5:0/2045327452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cbf2e0 0x563364ce1140 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00abf0 tx=0x7f29fc00af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ad4d7edcc1d3a1 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.870+0000 7f29f6ffd700 1 -- 172.21.15.5:0/2045327452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00e9e0 con 0x563364cbf2e0 2023-03-03T06:23:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.870+0000 7f29f6ffd700 1 -- 172.21.15.5:0/2045327452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc00c050 con 0x563364cbf2e0 2023-03-03T06:23:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.870+0000 7f29f6ffd700 1 -- 172.21.15.5:0/2045327452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00eda0 con 0x563364cbf2e0 2023-03-03T06:23:46.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.870+0000 7f2a1f538b80 1 -- 172.21.15.5:0/2045327452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cbf2e0 msgr2=0x563364ce1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.870+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/2045327452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cbf2e0 0x563364ce1140 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00abf0 tx=0x7f29fc00af00 comp rx=0 tx=0).stop 2023-03-03T06:23:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.870+0000 7f2a1f538b80 1 -- 172.21.15.5:0/2045327452 shutdown_connections 2023-03-03T06:23:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.870+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/2045327452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cebc20 0x563364cec090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.870+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/2045327452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364ce0d70 0x563364cc21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.870+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/2045327452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cbf2e0 0x563364ce1140 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.870+0000 7f2a1f538b80 1 -- 172.21.15.5:0/2045327452 >> 172.21.15.5:0/2045327452 conn(0x563364cb6720 msgr2=0x563364cbbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.870+0000 7f2a1f538b80 1 -- 172.21.15.5:0/2045327452 shutdown_connections 2023-03-03T06:23:46.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.870+0000 7f2a1f538b80 1 -- 172.21.15.5:0/2045327452 wait complete. 2023-03-03T06:23:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.871+0000 7f2a1f538b80 1 -- start start 2023-03-03T06:23:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.871+0000 7f2a1f538b80 1 Processor -- start 2023-03-03T06:23:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.872+0000 7f2a1f538b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cbf2e0 0x563364d01250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.872+0000 7f2a1f538b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364ce0d70 0x563364cbdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.872+0000 7f2a1f538b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cebc20 0x563364cbe010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.872+0000 7f2a1f538b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364a978d0 con 0x563364cebc20 2023-03-03T06:23:46.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.872+0000 7f2a1f538b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364ce2df0 con 0x563364cbf2e0 2023-03-03T06:23:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.872+0000 7f2a1f538b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x563364cfefa0 con 0x563364ce0d70 2023-03-03T06:23:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1194c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cebc20 0x563364cbe010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1f538b80 10 client.0 _ll_register_callbacks cb 0x563364bb1630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T06:23:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1194c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cebc20 0x563364cbe010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41140/0 (socket says 172.21.15.5:41140) 2023-03-03T06:23:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1194c700 1 -- 172.21.15.5:0/2209173391 learned_addr learned my addr 172.21.15.5:0/2209173391 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1114b700 1 --2- 172.21.15.5:0/2209173391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cbf2e0 0x563364d01250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1094a700 1 --2- 172.21.15.5:0/2209173391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364ce0d70 0x563364cbdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1194c700 1 -- 172.21.15.5:0/2209173391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364ce0d70 msgr2=0x563364cbdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1194c700 1 --2- 172.21.15.5:0/2209173391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364ce0d70 0x563364cbdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1194c700 1 -- 172.21.15.5:0/2209173391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cbf2e0 msgr2=0x563364d01250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1194c700 1 --2- 172.21.15.5:0/2209173391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cbf2e0 0x563364d01250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1194c700 1 -- 172.21.15.5:0/2209173391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29fc00a7c0 con 0x563364cebc20 2023-03-03T06:23:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1194c700 1 --2- 172.21.15.5:0/2209173391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cebc20 0x563364cbe010 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2a04055870 tx=0x7f2a0405f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c93dcd8acc1a32a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f29ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-03-03T06:23:46.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f29ebfff700 1 -- 172.21.15.5:0/2209173391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a040092e0 con 0x563364cebc20 2023-03-03T06:23:46.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f29ebfff700 1 -- 172.21.15.5:0/2209173391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a0405f120 con 0x563364cebc20 2023-03-03T06:23:46.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1f538b80 1 -- 172.21.15.5:0/2209173391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563364be1140 con 0x563364cebc20 2023-03-03T06:23:46.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f29ebfff700 1 -- 172.21.15.5:0/2209173391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a0405f2e0 con 0x563364cebc20 2023-03-03T06:23:46.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1f538b80 10 client.4428 fetch_fsmap learned FSMap version 7 2023-03-03T06:23:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f2a1f538b80 1 -- 172.21.15.5:0/2209173391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x563364a41d90 con 0x563364cebc20 2023-03-03T06:23:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f29ebfff700 1 -- 172.21.15.5:0/2209173391 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563364be1140 con 0x563364cebc20 2023-03-03T06:23:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.873+0000 7f29ebfff700 1 -- 172.21.15.5:0/2209173391 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2a040851a0 con 0x563364cebc20 2023-03-03T06:23:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.874+0000 7f2a1f538b80 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2023-03-03T06:23:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.874+0000 7f2a1f538b80 10 client.4428 resolve_mds: resolved name 'a' to daemon mds.a 2023-03-03T06:23:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.874+0000 7f2a1f538b80 20 client.4428 populate_metadata read hostname 'smithi005' 2023-03-03T06:23:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.874+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/2209173391 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x563364cfe4a0 0x563364ce1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.874+0000 7f2a1f538b80 4 client.4428 mds_command: new command op to 4285 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-03T06:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.874+0000 7f2a1f538b80 1 -- 172.21.15.5:0/2209173391 --> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563364a97f10 con 0x563364cfe4a0 2023-03-03T06:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.874+0000 7f2a1114b700 1 --2- 172.21.15.5:0/2209173391 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x563364cfe4a0 0x563364ce1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.874+0000 7f29ebfff700 10 client.4428 ms_handle_connect on v2:172.21.15.5:6834/305842942 2023-03-03T06:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.874+0000 7f2a1114b700 1 --2- 172.21.15.5:0/2209173391 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x563364cfe4a0 0x563364ce1140 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58f7742557f82532 server_cookie=2a5da60c2b0ad239 in_seq=0 out_seq=0 2023-03-03T06:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f29ebfff700 1 -- 172.21.15.5:0/2209173391 <== mds.0 v2:172.21.15.5:6834/305842942 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x563364a97f10 con 0x563364cfe4a0 2023-03-03T06:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f29ebfff700 10 client.4428 handle_command_reply: tid=0 2023-03-03T06:23:46.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f2a1f538b80 1 client.4428 shutdown 2023-03-03T06:23:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f2a1f538b80 1 -- 172.21.15.5:0/2209173391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cebc20 msgr2=0x563364cbe010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/2209173391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cebc20 0x563364cbe010 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2a04055870 tx=0x7f2a0405f6a0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f2a1f538b80 1 -- 172.21.15.5:0/2209173391 shutdown_connections 2023-03-03T06:23:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/2209173391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364cebc20 0x563364cbe010 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/2209173391 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x563364cfe4a0 0x563364ce1140 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/2209173391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cbf2e0 0x563364d01250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f29ebfff700 0 client.4428 ms_handle_reset on v2:172.21.15.5:6834/305842942 2023-03-03T06:23:46.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/2209173391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364ce0d70 0x563364cbdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f2a1f538b80 1 -- 172.21.15.5:0/2209173391 >> 172.21.15.5:0/2209173391 conn(0x563364cb6720 msgr2=0x563364cbbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f2a1f538b80 1 -- 172.21.15.5:0/2209173391 shutdown_connections 2023-03-03T06:23:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f2a1f538b80 1 -- 172.21.15.5:0/2209173391 wait complete. 2023-03-03T06:23:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.875+0000 7f2a1f538b80 20 client.4428 trim_cache size 0 max 16384 2023-03-03T06:23:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.893+0000 7f2a1f538b80 1 Processor -- start 2023-03-03T06:23:46.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.893+0000 7f2a1f538b80 1 -- start start 2023-03-03T06:23:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1f538b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cbf2e0 0x563364cbbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1f538b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 0x563364cbc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1f538b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cebc20 0x563364cbce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1f538b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364ce0070 con 0x563364ce0d70 2023-03-03T06:23:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1f538b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364ce2f30 con 0x563364cebc20 2023-03-03T06:23:46.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1f538b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x563364d014b0 con 0x563364cbf2e0 2023-03-03T06:23:46.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1094a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 0x563364cbc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1094a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 0x563364cbc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41146/0 (socket says 172.21.15.5:41146) 2023-03-03T06:23:46.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1094a700 1 -- 172.21.15.5:0/816126413 learned_addr learned my addr 172.21.15.5:0/816126413 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:46.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1114b700 1 --2- 172.21.15.5:0/816126413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cbf2e0 0x563364cbbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1194c700 1 --2- 172.21.15.5:0/816126413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cebc20 0x563364cbce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1094a700 1 -- 172.21.15.5:0/816126413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cbf2e0 msgr2=0x563364cbbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:46.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1094a700 1 --2- 172.21.15.5:0/816126413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cbf2e0 0x563364cbbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1094a700 1 -- 172.21.15.5:0/816126413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cebc20 msgr2=0x563364cbce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1094a700 1 --2- 172.21.15.5:0/816126413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cebc20 0x563364cbce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.894+0000 7f2a1094a700 1 -- 172.21.15.5:0/816126413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563364bda140 con 0x563364ce0d70 2023-03-03T06:23:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.895+0000 7f2a1094a700 1 --2- 172.21.15.5:0/816126413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 0x563364cbc920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00abc0 tx=0x7f29fc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc87ab9b2c41bc0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.895+0000 7f29f77fe700 1 -- 172.21.15.5:0/816126413 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00ee40 con 0x563364ce0d70 2023-03-03T06:23:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.895+0000 7f29f77fe700 1 -- 172.21.15.5:0/816126413 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc004030 con 0x563364ce0d70 2023-03-03T06:23:46.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.895+0000 7f29f77fe700 1 -- 172.21.15.5:0/816126413 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0043c0 con 0x563364ce0d70 2023-03-03T06:23:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.895+0000 7f2a1f538b80 1 -- 172.21.15.5:0/816126413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 msgr2=0x563364cbc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.895+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/816126413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 0x563364cbc920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00abc0 tx=0x7f29fc014000 comp rx=0 tx=0).stop 2023-03-03T06:23:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.895+0000 7f2a1f538b80 1 -- 172.21.15.5:0/816126413 shutdown_connections 2023-03-03T06:23:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.895+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/816126413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cebc20 0x563364cbce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.895+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/816126413 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cbf2e0 0x563364cbbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.895+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/816126413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 0x563364cbc920 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.895+0000 7f2a1f538b80 1 -- 172.21.15.5:0/816126413 >> 172.21.15.5:0/816126413 conn(0x563364cb6720 msgr2=0x563364cfe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.895+0000 7f2a1f538b80 1 -- 172.21.15.5:0/816126413 shutdown_connections 2023-03-03T06:23:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.895+0000 7f2a1f538b80 1 -- 172.21.15.5:0/816126413 wait complete. 2023-03-03T06:23:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.896+0000 7f2a1f538b80 1 -- start start 2023-03-03T06:23:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.896+0000 7f2a1f538b80 1 Processor -- start 2023-03-03T06:23:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1f538b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cbf2e0 0x563364cc0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1f538b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 0x563364d70e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1f538b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cebc20 0x563364cbc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1f538b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364d141a0 con 0x563364ce0d70 2023-03-03T06:23:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1f538b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364ce41a0 con 0x563364cbf2e0 2023-03-03T06:23:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1f538b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x563364ce43f0 con 0x563364cebc20 2023-03-03T06:23:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1f538b80 10 client.0 _ll_register_callbacks cb 0x563364bb1630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T06:23:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1094a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 0x563364d70e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1094a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 0x563364d70e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41152/0 (socket says 172.21.15.5:41152) 2023-03-03T06:23:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1094a700 1 -- 172.21.15.5:0/1531391686 learned_addr learned my addr 172.21.15.5:0/1531391686 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:46.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1114b700 1 --2- 172.21.15.5:0/1531391686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cbf2e0 0x563364cc0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1194c700 1 --2- 172.21.15.5:0/1531391686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cebc20 0x563364cbc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1094a700 1 -- 172.21.15.5:0/1531391686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cebc20 msgr2=0x563364cbc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1094a700 1 --2- 172.21.15.5:0/1531391686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cebc20 0x563364cbc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1094a700 1 -- 172.21.15.5:0/1531391686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cbf2e0 msgr2=0x563364cc0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1094a700 1 --2- 172.21.15.5:0/1531391686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cbf2e0 0x563364cc0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.897+0000 7f2a1094a700 1 -- 172.21.15.5:0/1531391686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563364a955e0 con 0x563364ce0d70 2023-03-03T06:23:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f2a1094a700 1 --2- 172.21.15.5:0/1531391686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 0x563364d70e90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00af40 tx=0x7f29fc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2304686b60dfa58 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f29ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-03-03T06:23:46.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f29ebfff700 1 -- 172.21.15.5:0/1531391686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc003de0 con 0x563364ce0d70 2023-03-03T06:23:46.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f2a1f538b80 1 -- 172.21.15.5:0/1531391686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563364bd1160 con 0x563364ce0d70 2023-03-03T06:23:46.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f29ebfff700 1 -- 172.21.15.5:0/1531391686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f29fc02f070 con 0x563364ce0d70 2023-03-03T06:23:46.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f29ebfff700 1 -- 172.21.15.5:0/1531391686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29fc0045a0 con 0x563364ce0d70 2023-03-03T06:23:46.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f2a1f538b80 10 client.4434 fetch_fsmap learned FSMap version 7 2023-03-03T06:23:46.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f2a1f538b80 1 -- 172.21.15.5:0/1531391686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x563364a68200 con 0x563364ce0d70 2023-03-03T06:23:46.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f29ebfff700 1 -- 172.21.15.5:0/1531391686 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563364bd1160 con 0x563364ce0d70 2023-03-03T06:23:46.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f29ebfff700 1 -- 172.21.15.5:0/1531391686 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f29fc01b070 con 0x563364ce0d70 2023-03-03T06:23:46.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f2a1f538b80 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2023-03-03T06:23:46.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f2a1f538b80 10 client.4434 resolve_mds: resolved name 'a' to daemon mds.a 2023-03-03T06:23:46.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f2a1f538b80 20 client.4434 populate_metadata read hostname 'smithi005' 2023-03-03T06:23:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/1531391686 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x563364ceeb30 0x563364ceef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f2a1f538b80 4 client.4434 mds_command: new command op to 4285 tid=0[{"prefix": "status"}] 2023-03-03T06:23:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f2a1f538b80 1 -- 172.21.15.5:0/1531391686 --> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563364bbb170 con 0x563364ceeb30 2023-03-03T06:23:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.898+0000 7f2a1114b700 1 --2- 172.21.15.5:0/1531391686 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x563364ceeb30 0x563364ceef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f2a1114b700 1 --2- 172.21.15.5:0/1531391686 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x563364ceeb30 0x563364ceef00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21559662eeb28576 server_cookie=850d2674307d0f4 in_seq=0 out_seq=0 2023-03-03T06:23:46.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f29ebfff700 10 client.4434 ms_handle_connect on v2:172.21.15.5:6834/305842942 2023-03-03T06:23:46.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f29ebfff700 1 -- 172.21.15.5:0/1531391686 <== mds.0 v2:172.21.15.5:6834/305842942 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x563364bbb170 con 0x563364ceeb30 2023-03-03T06:23:46.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f29ebfff700 10 client.4434 handle_command_reply: tid=0 2023-03-03T06:23:46.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f2a1f538b80 1 client.4434 shutdown 2023-03-03T06:23:46.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f2a1f538b80 1 -- 172.21.15.5:0/1531391686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 msgr2=0x563364d70e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/1531391686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 0x563364d70e90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00af40 tx=0x7f29fc011000 comp rx=0 tx=0).stop 2023-03-03T06:23:46.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f2a1f538b80 1 -- 172.21.15.5:0/1531391686 shutdown_connections 2023-03-03T06:23:46.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/1531391686 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563364cebc20 0x563364cbc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/1531391686 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x563364ceeb30 0x563364ceef00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/1531391686 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563364cbf2e0 0x563364cc0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f29ebfff700 0 client.4434 ms_handle_reset on v2:172.21.15.5:6834/305842942 2023-03-03T06:23:46.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f2a1f538b80 1 --2- 172.21.15.5:0/1531391686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563364ce0d70 0x563364d70e90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f2a1f538b80 1 -- 172.21.15.5:0/1531391686 >> 172.21.15.5:0/1531391686 conn(0x563364cb6720 msgr2=0x563364ce2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:46.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f2a1f538b80 1 -- 172.21.15.5:0/1531391686 shutdown_connections 2023-03-03T06:23:46.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f2a1f538b80 1 -- 172.21.15.5:0/1531391686 wait complete. 2023-03-03T06:23:46.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.899+0000 7f2a1f538b80 20 client.4434 trim_cache size 0 max 16384 2023-03-03T06:23:46.919 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-03-03T06:23:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6", 2023-03-03T06:23:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-03-03T06:23:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4285, 2023-03-03T06:23:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-03-03T06:23:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-03-03T06:23:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-03-03T06:23:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 6.5772924640000001, 2023-03-03T06:23:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 7, 2023-03-03T06:23:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 25, 2023-03-03T06:23:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 24, 2023-03-03T06:23:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 11.893841484999999 2023-03-03T06:23:46.920 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-03-03T06:23:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.900+0000 7f2a133af700 1 -- 172.21.15.5:0/3170620196 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f29f00682f0 msgr2=0x7f29f006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.900+0000 7f2a133af700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f29f00682f0 0x7f29f006a7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2a08007fd0 tx=0x7f2a08007ec0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.900+0000 7f2a133af700 1 -- 172.21.15.5:0/3170620196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c15ef50 msgr2=0x7f2a0c154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.900+0000 7f2a133af700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c15ef50 0x7f2a0c154a30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c06cfe0 tx=0x7f2a04004ad0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.900+0000 7f2a133af700 1 -- 172.21.15.5:0/3170620196 shutdown_connections 2023-03-03T06:23:46.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.900+0000 7f2a133af700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a0c15ef50 0x7f2a0c154a30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.900+0000 7f2a133af700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2a0c0cb690 0x7f2a0c0ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.900+0000 7f2a133af700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f29f00682f0 0x7f29f006a7a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.900+0000 7f2a133af700 1 --2- 172.21.15.5:0/3170620196 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2a0c15a7d0 0x7f2a0c0ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:46.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.900+0000 7f2a133af700 1 -- 172.21.15.5:0/3170620196 >> 172.21.15.5:0/3170620196 conn(0x7f2a0c0cf4b0 msgr2=0x7f2a0c071ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:46.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.900+0000 7f2a133af700 1 -- 172.21.15.5:0/3170620196 shutdown_connections 2023-03-03T06:23:46.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:46.900+0000 7f2a133af700 1 -- 172.21.15.5:0/3170620196 wait complete. 2023-03-03T06:23:46.924 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-03T06:23:46.925 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-03-03T06:23:46.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-03T06:23:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.047+0000 7fdfd1bc0700 1 Processor -- start 2023-03-03T06:23:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.047+0000 7fdfd1bc0700 1 -- start start 2023-03-03T06:23:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfd1bc0700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdfcc15a7d0 0x7fdfcc0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfd1bc0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdfcc0cb690 0x7fdfcc15ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfd1bc0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfcc15ef50 0x7fdfcc06a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfd1bc0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc15e580 con 0x7fdfcc0cb690 2023-03-03T06:23:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfd1bc0700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc0ca710 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfd1bc0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0ca9f0 con 0x7fdfcc15ef50 2023-03-03T06:23:47.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfcaffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdfcc0cb690 0x7fdfcc15ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfcaffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdfcc0cb690 0x7fdfcc15ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41158/0 (socket says 172.21.15.5:41158) 2023-03-03T06:23:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfcaffd700 1 -- 172.21.15.5:0/2435910452 learned_addr learned my addr 172.21.15.5:0/2435910452 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:47.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfcb7fe700 1 --2- 172.21.15.5:0/2435910452 >> v2:172.21.15.191:3300/0 conn(0x7fdfcc15a7d0 0x7fdfcc0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfcbfff700 1 --2- 172.21.15.5:0/2435910452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfcc15ef50 0x7fdfcc06a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfcaffd700 1 -- 172.21.15.5:0/2435910452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfcc15ef50 msgr2=0x7fdfcc06a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:47.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfcaffd700 1 --2- 172.21.15.5:0/2435910452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfcc15ef50 0x7fdfcc06a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfcaffd700 1 -- 172.21.15.5:0/2435910452 >> v2:172.21.15.191:3300/0 conn(0x7fdfcc15a7d0 msgr2=0x7fdfcc0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfcaffd700 1 --2- 172.21.15.5:0/2435910452 >> v2:172.21.15.191:3300/0 conn(0x7fdfcc15a7d0 0x7fdfcc0c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:47.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfcaffd700 1 -- 172.21.15.5:0/2435910452 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc0cacd0 con 0x7fdfcc0cb690 2023-03-03T06:23:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.048+0000 7fdfcb7fe700 1 --2- 172.21.15.5:0/2435910452 >> v2:172.21.15.191:3300/0 conn(0x7fdfcc15a7d0 0x7fdfcc0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.049+0000 7fdfcaffd700 1 --2- 172.21.15.5:0/2435910452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfcc0cb690 0x7fdfcc15ea10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0d05b0 tx=0x7fdfbc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad298c705116f78 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.049+0000 7fdfca7fc700 1 -- 172.21.15.5:0/2435910452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc00b870 con 0x7fdfcc0cb690 2023-03-03T06:23:47.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.049+0000 7fdfca7fc700 1 -- 172.21.15.5:0/2435910452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc00b9d0 con 0x7fdfcc0cb690 2023-03-03T06:23:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.049+0000 7fdfca7fc700 1 -- 172.21.15.5:0/2435910452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc00bd60 con 0x7fdfcc0cb690 2023-03-03T06:23:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.049+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/2435910452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfcc0cb690 msgr2=0x7fdfcc15ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:47.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.049+0000 7fdfd1bc0700 1 --2- 172.21.15.5:0/2435910452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfcc0cb690 0x7fdfcc15ea10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0d05b0 tx=0x7fdfbc009bd0 comp rx=0 tx=0).stop 2023-03-03T06:23:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.049+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/2435910452 shutdown_connections 2023-03-03T06:23:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.049+0000 7fdfd1bc0700 1 --2- 172.21.15.5:0/2435910452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfcc15ef50 0x7fdfcc06a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.049+0000 7fdfd1bc0700 1 --2- 172.21.15.5:0/2435910452 >> v2:172.21.15.191:3300/0 conn(0x7fdfcc15a7d0 0x7fdfcc0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:47.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.049+0000 7fdfd1bc0700 1 --2- 172.21.15.5:0/2435910452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfcc0cb690 0x7fdfcc15ea10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.049+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/2435910452 >> 172.21.15.5:0/2435910452 conn(0x7fdfcc0cf4b0 msgr2=0x7fdfcc0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:47.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.049+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/2435910452 shutdown_connections 2023-03-03T06:23:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.049+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/2435910452 wait complete. 2023-03-03T06:23:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.050+0000 7fdfd1bc0700 1 Processor -- start 2023-03-03T06:23:47.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.051+0000 7fdfd1bc0700 1 -- start start 2023-03-03T06:23:47.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.051+0000 7fdfd1bc0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfcc0cb690 0x7fdfcc150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:47.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.051+0000 7fdfd1bc0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfcc15a7d0 0x7fdfcc0c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:47.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.051+0000 7fdfd1bc0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfcc15ef50 0x7fdfcc0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.051+0000 7fdfd1bc0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0c48e0 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.051+0000 7fdfd1bc0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0c4bc0 con 0x7fdfcc15ef50 2023-03-03T06:23:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.051+0000 7fdfd1bc0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0c4ea0 con 0x7fdfcc0cb690 2023-03-03T06:23:47.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.051+0000 7fdfcaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfcc15a7d0 0x7fdfcc0c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.051+0000 7fdfcaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfcc15a7d0 0x7fdfcc0c5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41166/0 (socket says 172.21.15.5:41166) 2023-03-03T06:23:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.051+0000 7fdfcaffd700 1 -- 172.21.15.5:0/785239861 learned_addr learned my addr 172.21.15.5:0/785239861 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.052+0000 7fdfcb7fe700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfcc0cb690 0x7fdfcc150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:47.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.052+0000 7fdfcbfff700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfcc15ef50 0x7fdfcc0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.052+0000 7fdfcaffd700 1 -- 172.21.15.5:0/785239861 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfcc0cb690 msgr2=0x7fdfcc150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.052+0000 7fdfcaffd700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfcc0cb690 0x7fdfcc150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:47.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.052+0000 7fdfcaffd700 1 -- 172.21.15.5:0/785239861 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfcc15ef50 msgr2=0x7fdfcc0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.052+0000 7fdfcaffd700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfcc15ef50 0x7fdfcc0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.052+0000 7fdfcaffd700 1 -- 172.21.15.5:0/785239861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc009550 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.052+0000 7fdfcaffd700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfcc15a7d0 0x7fdfcc0c5980 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc000c00 tx=0x7fdfbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:47.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.052+0000 7fdfc3fff700 1 -- 172.21.15.5:0/785239861 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc004480 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.052+0000 7fdfc3fff700 1 -- 172.21.15.5:0/785239861 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc0045e0 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.052+0000 7fdfc3fff700 1 -- 172.21.15.5:0/785239861 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0038e0 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.052+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/785239861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc0ca400 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.052+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/785239861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc15e210 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.053+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/785239861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc06a870 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.054+0000 7fdfc3fff700 1 -- 172.21.15.5:0/785239861 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdfbc00f050 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.054+0000 7fdfc3fff700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdfac0682f0 0x7fdfac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.054+0000 7fdfcb7fe700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdfac0682f0 0x7fdfac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.054+0000 7fdfc3fff700 1 -- 172.21.15.5:0/785239861 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdfbc0876d0 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.055+0000 7fdfcb7fe700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdfac0682f0 0x7fdfac06a7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40045f0 tx=0x7fdfb4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:47.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.059+0000 7fdfc3fff700 1 -- 172.21.15.5:0/785239861 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdfbc053c40 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.114 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:23:47.116 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:23:47.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.300+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/785239861 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdfcc04e6e0 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.301+0000 7fdfc3fff700 1 -- 172.21.15.5:0/785239861 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fdfbc015070 con 0x7fdfcc15a7d0 2023-03-03T06:23:47.303 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-03-03T06:23:47.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.303+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/785239861 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdfac0682f0 msgr2=0x7fdfac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:47.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.303+0000 7fdfd1bc0700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdfac0682f0 0x7fdfac06a7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40045f0 tx=0x7fdfb4008040 comp rx=0 tx=0).stop 2023-03-03T06:23:47.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.303+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/785239861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfcc15a7d0 msgr2=0x7fdfcc0c5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:47.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.303+0000 7fdfd1bc0700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfcc15a7d0 0x7fdfcc0c5980 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc000c00 tx=0x7fdfbc004750 comp rx=0 tx=0).stop 2023-03-03T06:23:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.303+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/785239861 shutdown_connections 2023-03-03T06:23:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.303+0000 7fdfd1bc0700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfcc15ef50 0x7fdfcc0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.303+0000 7fdfd1bc0700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdfac0682f0 0x7fdfac06a7a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.303+0000 7fdfd1bc0700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfcc0cb690 0x7fdfcc150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.303+0000 7fdfd1bc0700 1 --2- 172.21.15.5:0/785239861 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfcc15a7d0 0x7fdfcc0c5980 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:47.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.303+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/785239861 >> 172.21.15.5:0/785239861 conn(0x7fdfcc0cf4b0 msgr2=0x7fdfcc06b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.303+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/785239861 shutdown_connections 2023-03-03T06:23:47.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:47.303+0000 7fdfd1bc0700 1 -- 172.21.15.5:0/785239861 wait complete. 2023-03-03T06:23:47.317 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-03-03T06:23:47.317 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-03T06:23:47.317 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-03-03T06:23:47.318 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-03-03T06:23:47.318 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-03-03T06:23:47.318 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-03-03T06:23:47.318 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-03T06:23:47.319 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-03T06:23:47.319 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-03-03T06:23:47.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:47.319 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-03-03T06:23:47.336 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T06:23:47.336 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T06:23:47.337 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T06:23:47.337 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:23:47.337 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-03-03T06:23:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:23:47.338 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:23:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-03-03T06:23:47.339 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:23:47.339 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-03-03T06:23:47.339 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-03T06:23:47.339 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:23:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-03-03T06:23:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42516sec preferred_lft 42516sec 2023-03-03T06:23:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-03-03T06:23:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:23:47.341 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:23:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:23:47.341 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-03T06:23:47.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:47.342 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:23:47.342 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:23:47.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2023-03-03T06:23:47.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2023-03-03T06:23:47.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2023-03-03T06:23:47.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-03T06:23:47.344 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:23:47.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:47.579 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-03T06:23:47.608 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-03-03T06:23:47.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:47.610 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-03-03T06:23:47.682 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-03-03T06:23:47.682 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-03T06:23:47.682 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-03-03T06:23:47.682 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-03-03T06:23:47.683 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-03T06:23:47.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:47.683 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:23:47.684 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:23:47.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-03-03T06:23:47.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-03-03T06:23:47.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-03-03T06:23:47.685 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:23:47.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:47.937 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-03-03T06:23:47.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:47.956 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-03-03T06:23:48.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:48.013 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:23:48.013 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:23:48.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-03-03T06:23:48.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-03-03T06:23:48.014 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:23:48.107 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-03-03T06:23:48.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:48.108 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:23:48.108 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:23:48.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-03-03T06:23:48.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-03T06:23:48.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-03-03T06:23:48.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-03-03T06:23:48.110 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-03-03T06:23:48.110 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:23:48.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:48.333 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:23:48.333 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:23:48.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-03-03T06:23:48.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2023-03-03T06:23:48.334 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:23:48.440 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-03-03T06:23:48.441 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:23:48.441 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-03-03T06:23:48.463 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-03-03T06:23:48.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:23:48.464 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-03-03T06:23:48.520 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2023-03-03T06:23:48.588 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-03-03T06:23:48.589 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-03-03T06:23:48.656 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-03-03T06:23:48.656 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-03-03T06:23:48.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:48.658 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2023-03-03T06:23:48.714 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-03-03T06:23:48.715 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_mountpoint=/ --client_fs=cephfs) 2023-03-03T06:23:48.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2023-03-03T06:23:48.785 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-03-03T06:23:48.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-03-03T06:23:48.852 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-03-03T06:23:48.853 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-03-03T06:23:48.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:48.854 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2023-03-03T06:23:48.975 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:2023-03-03T06:23:48.973+0000 7efd112315c0 -1 init, newargv = 0x55d405f35070 newargc=15 2023-03-03T06:23:48.975 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[104092]: starting ceph client 2023-03-03T06:23:48.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[104092]: starting fuse 2023-03-03T06:23:50.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2023-03-03T06:23:50.047 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-03-03T06:23:50.047 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-03-03T06:23:50.117 INFO:teuthology.orchestra.run.smithi005.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-03-03T06:23:50.118 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-03-03T06:23:50.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:50.119 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2023-03-03T06:23:50.178 INFO:teuthology.orchestra.run.smithi005.stdout:47 2023-03-03T06:23:50.178 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-03-03T06:23:50.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-03-03T06:23:50.179 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2023-03-03T06:23:50.180 DEBUG:teuthology.orchestra.run.smithi005:> import re 2023-03-03T06:23:50.180 DEBUG:teuthology.orchestra.run.smithi005:> import os 2023-03-03T06:23:50.180 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2023-03-03T06:23:50.180 DEBUG:teuthology.orchestra.run.smithi005:> 2023-03-03T06:23:50.181 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2023-03-03T06:23:50.181 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-03-03T06:23:50.181 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2023-03-03T06:23:50.182 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-03-03T06:23:50.182 DEBUG:teuthology.orchestra.run.smithi005:> 2023-03-03T06:23:50.182 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2023-03-03T06:23:50.182 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2023-03-03T06:23:50.183 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2023-03-03T06:23:50.183 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2023-03-03T06:23:50.183 DEBUG:teuthology.orchestra.run.smithi005:> 2023-03-03T06:23:50.183 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2023-03-03T06:23:50.184 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-03-03T06:23:50.184 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2023-03-03T06:23:50.184 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-03-03T06:23:50.185 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2023-03-03T06:23:50.185 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2023-03-03T06:23:50.185 DEBUG:teuthology.orchestra.run.smithi005:> return f 2023-03-03T06:23:50.185 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-03-03T06:23:50.186 DEBUG:teuthology.orchestra.run.smithi005:> 2023-03-03T06:23:50.186 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.admin")) 2023-03-03T06:23:50.186 DEBUG:teuthology.orchestra.run.smithi005:> ' 2023-03-03T06:23:50.310 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.admin.104092.asok 2023-03-03T06:23:50.492 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.104092.asok 2023-03-03T06:23:50.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:50.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.104092.asok status 2023-03-03T06:23:50.656 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-03-03T06:23:50.656 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2023-03-03T06:23:50.656 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "472aaef4ec3b3a2c29f73ca67854785a910f1f9b", 2023-03-03T06:23:50.656 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.0.0-2739-g472aaef4 (472aaef4ec3b3a2c29f73ca67854785a910f1f9b) reef (dev)", 2023-03-03T06:23:50.656 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "admin", 2023-03-03T06:23:50.657 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2023-03-03T06:23:50.657 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-03-03T06:23:50.657 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "104092", 2023-03-03T06:23:50.657 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2023-03-03T06:23:50.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:23:50.657 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2023-03-03T06:23:50.658 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2023-03-03T06:23:50.658 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4446, 2023-03-03T06:23:50.658 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2023-03-03T06:23:50.658 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2023-03-03T06:23:50.658 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2023-03-03T06:23:50.658 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 4446 2023-03-03T06:23:50.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:23:50.659 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2023-03-03T06:23:50.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2023-03-03T06:23:50.659 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2023-03-03T06:23:50.659 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2613488307 2023-03-03T06:23:50.659 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:23:50.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:23:50.659 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2023-03-03T06:23:50.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2023-03-03T06:23:50.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "192.168.0.1:0", 2023-03-03T06:23:50.660 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2613488307 2023-03-03T06:23:50.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:23:50.660 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.4446 192.168.0.1:0/2613488307", 2023-03-03T06:23:50.660 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "192.168.0.1:0/2613488307", 2023-03-03T06:23:50.660 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2023-03-03T06:23:50.660 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 7, 2023-03-03T06:23:50.661 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 25, 2023-03-03T06:23:50.661 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2023-03-03T06:23:50.661 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2023-03-03T06:23:50.661 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2023-03-03T06:23:50.661 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-03-03T06:23:50.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:50.666 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2023-03-03T06:23:50.667 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-03-03T06:23:50.684 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2023-03-03T06:23:50.684 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-03-03T06:23:50.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:50.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-03-03T06:23:50.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:50.754 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-03-03T06:23:50.852 INFO:teuthology.orchestra.run.smithi005.stdout:# file: . 2023-03-03T06:23:50.852 INFO:teuthology.orchestra.run.smithi005.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-03-03T06:23:50.852 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:50.853 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:50.853 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:23:50.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:23:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.033+0000 7f40f876d700 1 Processor -- start 2023-03-03T06:23:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.033+0000 7f40f876d700 1 -- start start 2023-03-03T06:23:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f876d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40f015cd40 0x7f40f00b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f876d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f40f00cef60 0x7f40f00b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f876d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f015d4e0 con 0x7f40f00cba50 2023-03-03T06:23:51.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f876d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f015d7c0 con 0x7f40f00cef60 2023-03-03T06:23:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f876d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f015daa0 con 0x7f40f015cd40 2023-03-03T06:23:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f6d0a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f40f00cef60 0x7f40f00b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f5d08700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f40f00cba50 0x7f40f0160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59274/0 (socket says 172.21.15.5:59274) 2023-03-03T06:23:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f5d08700 1 -- 172.21.15.5:0/4099013990 learned_addr learned my addr 172.21.15.5:0/4099013990 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f6509700 1 --2- 172.21.15.5:0/4099013990 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40f015cd40 0x7f40f00b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f6d0a700 1 -- 172.21.15.5:0/4099013990 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40f015cd40 msgr2=0x7f40f00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:51.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f6d0a700 1 --2- 172.21.15.5:0/4099013990 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40f015cd40 0x7f40f00b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f6d0a700 1 -- 172.21.15.5:0/4099013990 >> v1:172.21.15.5:6789/0 conn(0x7f40f00cba50 legacy=0x7f40f0160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f5507700 1 -- 172.21.15.5:0/4099013990 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290820287 0 0) 0x7f40f015d4e0 con 0x7f40f00cba50 2023-03-03T06:23:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f6d0a700 1 -- 172.21.15.5:0/4099013990 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f015dd80 con 0x7f40f00cef60 2023-03-03T06:23:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f6d0a700 1 --2- 172.21.15.5:0/4099013990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f00cef60 0x7f40f00b1e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009d90 tx=0x7f40e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde957000cfbdbc3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:51.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f5507700 1 -- 172.21.15.5:0/4099013990 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e800e070 con 0x7f40f00cef60 2023-03-03T06:23:51.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f5507700 1 -- 172.21.15.5:0/4099013990 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e800bbd0 con 0x7f40f00cef60 2023-03-03T06:23:51.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.034+0000 7f40f5507700 1 -- 172.21.15.5:0/4099013990 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8012430 con 0x7f40f00cef60 2023-03-03T06:23:51.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.035+0000 7f40f876d700 1 -- 172.21.15.5:0/4099013990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f00cef60 msgr2=0x7f40f00b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.035+0000 7f40f876d700 1 --2- 172.21.15.5:0/4099013990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f00cef60 0x7f40f00b1e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009d90 tx=0x7f40e800b330 comp rx=0 tx=0).stop 2023-03-03T06:23:51.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.035+0000 7f40f876d700 1 -- 172.21.15.5:0/4099013990 shutdown_connections 2023-03-03T06:23:51.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.035+0000 7f40f876d700 1 --2- 172.21.15.5:0/4099013990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f00cef60 0x7f40f00b1e10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.035+0000 7f40f876d700 1 --2- 172.21.15.5:0/4099013990 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40f015cd40 0x7f40f00b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.035+0000 7f40f876d700 1 -- 172.21.15.5:0/4099013990 >> 172.21.15.5:0/4099013990 conn(0x7f40f00cc8d0 msgr2=0x7f40f00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:51.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.035+0000 7f40f876d700 1 -- 172.21.15.5:0/4099013990 shutdown_connections 2023-03-03T06:23:51.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.035+0000 7f40f876d700 1 -- 172.21.15.5:0/4099013990 wait complete. 2023-03-03T06:23:51.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.036+0000 7f40f876d700 1 Processor -- start 2023-03-03T06:23:51.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.036+0000 7f40f876d700 1 -- start start 2023-03-03T06:23:51.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f876d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40f00cba50 0x7f40f014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f876d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40f00cef60 0x7f40f0150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f876d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f015cd40 0x7f40f006b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f876d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f01501b0 con 0x7f40f015cd40 2023-03-03T06:23:51.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f876d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f00b2c80 con 0x7f40f00cef60 2023-03-03T06:23:51.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f876d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f00b2f20 con 0x7f40f00cba50 2023-03-03T06:23:51.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f6d0a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f015cd40 0x7f40f006b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f6d0a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f015cd40 0x7f40f006b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41210/0 (socket says 172.21.15.5:41210) 2023-03-03T06:23:51.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f6d0a700 1 -- 172.21.15.5:0/1231533384 learned_addr learned my addr 172.21.15.5:0/1231533384 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f6509700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40f00cba50 0x7f40f014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f5d08700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40f00cef60 0x7f40f0150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f6d0a700 1 -- 172.21.15.5:0/1231533384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40f00cba50 msgr2=0x7f40f014fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f6d0a700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40f00cba50 0x7f40f014fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f6d0a700 1 -- 172.21.15.5:0/1231533384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40f00cef60 msgr2=0x7f40f0150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f6d0a700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40f00cef60 0x7f40f0150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.037+0000 7f40f6d0a700 1 -- 172.21.15.5:0/1231533384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e8009a70 con 0x7f40f015cd40 2023-03-03T06:23:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.038+0000 7f40f5d08700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40f00cef60 0x7f40f0150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.038+0000 7f40f6d0a700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f015cd40 0x7f40f006b4d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f40f0071050 tx=0x7f40e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.038+0000 7f40e6ffd700 1 -- 172.21.15.5:0/1231533384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8012430 con 0x7f40f015cd40 2023-03-03T06:23:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.038+0000 7f40e6ffd700 1 -- 172.21.15.5:0/1231533384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e8020070 con 0x7f40f015cd40 2023-03-03T06:23:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.038+0000 7f40f876d700 1 -- 172.21.15.5:0/1231533384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f00ca530 con 0x7f40f015cd40 2023-03-03T06:23:51.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.038+0000 7f40e6ffd700 1 -- 172.21.15.5:0/1231533384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8004280 con 0x7f40f015cd40 2023-03-03T06:23:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.038+0000 7f40f876d700 1 -- 172.21.15.5:0/1231533384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f015e060 con 0x7f40f015cd40 2023-03-03T06:23:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.039+0000 7f40f876d700 1 -- 172.21.15.5:0/1231533384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f015d110 con 0x7f40f015cd40 2023-03-03T06:23:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.039+0000 7f40e6ffd700 1 -- 172.21.15.5:0/1231533384 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f40e80043e0 con 0x7f40f015cd40 2023-03-03T06:23:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.040+0000 7f40e6ffd700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f40d40682f0 0x7f40d406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.040+0000 7f40e6ffd700 1 -- 172.21.15.5:0/1231533384 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f40e8022070 con 0x7f40f015cd40 2023-03-03T06:23:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.040+0000 7f40f6509700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f40d40682f0 0x7f40d406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.040+0000 7f40f6509700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f40d40682f0 0x7f40d406a7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009930 tx=0x7f40ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:51.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.044+0000 7f40e6ffd700 1 -- 172.21.15.5:0/1231533384 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f40e8054ae0 con 0x7f40f015cd40 2023-03-03T06:23:51.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.238+0000 7f40f876d700 1 -- 172.21.15.5:0/1231533384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40f004e6e0 con 0x7f40f015cd40 2023-03-03T06:23:51.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.239+0000 7f40e6ffd700 1 -- 172.21.15.5:0/1231533384 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7f40e8058100 con 0x7f40f015cd40 2023-03-03T06:23:51.241 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:51.242 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:23:51.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.241+0000 7f40f876d700 1 -- 172.21.15.5:0/1231533384 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f40d40682f0 msgr2=0x7f40d406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.241+0000 7f40f876d700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f40d40682f0 0x7f40d406a7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009930 tx=0x7f40ec008040 comp rx=0 tx=0).stop 2023-03-03T06:23:51.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.241+0000 7f40f876d700 1 -- 172.21.15.5:0/1231533384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f015cd40 msgr2=0x7f40f006b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.241+0000 7f40f876d700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f015cd40 0x7f40f006b4d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f40f0071050 tx=0x7f40e8004ad0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.241+0000 7f40f876d700 1 -- 172.21.15.5:0/1231533384 shutdown_connections 2023-03-03T06:23:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.241+0000 7f40f876d700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40f015cd40 0x7f40f006b4d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.241+0000 7f40f876d700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f40d40682f0 0x7f40d406a7a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.241+0000 7f40f876d700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f40f00cba50 0x7f40f014fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.241+0000 7f40f876d700 1 --2- 172.21.15.5:0/1231533384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f40f00cef60 0x7f40f0150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.241+0000 7f40f876d700 1 -- 172.21.15.5:0/1231533384 >> 172.21.15.5:0/1231533384 conn(0x7f40f00cc8d0 msgr2=0x7f40f006c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.241+0000 7f40f876d700 1 -- 172.21.15.5:0/1231533384 shutdown_connections 2023-03-03T06:23:51.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.241+0000 7f40f876d700 1 -- 172.21.15.5:0/1231533384 wait complete. 2023-03-03T06:23:51.255 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:23:38.141777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:23:39.283589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-03T06:23:42.422930+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-03T06:23:51.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:23:51.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.381+0000 7fd75b8d1700 1 Processor -- start 2023-03-03T06:23:51.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.381+0000 7fd75b8d1700 1 -- start start 2023-03-03T06:23:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.382+0000 7fd75b8d1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd75415cd40 0x7fd7540b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.382+0000 7fd75b8d1700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75415e160 con 0x7fd7540cb9d0 2023-03-03T06:23:51.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.382+0000 7fd75b8d1700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd754161540 con 0x7fd7540cd3e0 2023-03-03T06:23:51.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.382+0000 7fd75b8d1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7540cd870 con 0x7fd75415cd40 2023-03-03T06:23:51.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.382+0000 7fd759e6e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd7540cb9d0 0x7fd754160e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59292/0 (socket says 172.21.15.5:59292) 2023-03-03T06:23:51.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.382+0000 7fd759e6e700 1 -- 172.21.15.5:0/3432590985 learned_addr learned my addr 172.21.15.5:0/3432590985 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:51.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.382+0000 7fd75966d700 1 --2- 172.21.15.5:0/3432590985 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd75415cd40 0x7fd7540b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.382+0000 7fd75966d700 1 -- 172.21.15.5:0/3432590985 >> v1:172.21.15.191:6789/0 conn(0x7fd7540cd3e0 legacy=0x7fd754160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.382+0000 7fd75966d700 1 -- 172.21.15.5:0/3432590985 >> v1:172.21.15.5:6789/0 conn(0x7fd7540cb9d0 legacy=0x7fd754160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.382+0000 7fd75966d700 1 -- 172.21.15.5:0/3432590985 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75415d110 con 0x7fd75415cd40 2023-03-03T06:23:51.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.383+0000 7fd75966d700 1 --2- 172.21.15.5:0/3432590985 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd75415cd40 0x7fd7540b18d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd750009870 tx=0x7fd750009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17eb4a2450f6003 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:51.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.384+0000 7fd74bfff700 1 -- 172.21.15.5:0/3432590985 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750011830 con 0x7fd75415cd40 2023-03-03T06:23:51.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.384+0000 7fd74bfff700 1 -- 172.21.15.5:0/3432590985 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd750011990 con 0x7fd75415cd40 2023-03-03T06:23:51.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.384+0000 7fd74bfff700 1 -- 172.21.15.5:0/3432590985 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750011d20 con 0x7fd75415cd40 2023-03-03T06:23:51.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.385+0000 7fd75b8d1700 1 -- 172.21.15.5:0/3432590985 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd75415cd40 msgr2=0x7fd7540b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.385+0000 7fd75b8d1700 1 --2- 172.21.15.5:0/3432590985 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd75415cd40 0x7fd7540b18d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd750009870 tx=0x7fd750009b80 comp rx=0 tx=0).stop 2023-03-03T06:23:51.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.385+0000 7fd75b8d1700 1 -- 172.21.15.5:0/3432590985 shutdown_connections 2023-03-03T06:23:51.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.385+0000 7fd75b8d1700 1 --2- 172.21.15.5:0/3432590985 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd75415cd40 0x7fd7540b18d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.385+0000 7fd75b8d1700 1 -- 172.21.15.5:0/3432590985 >> 172.21.15.5:0/3432590985 conn(0x7fd7540cc8d0 msgr2=0x7fd7540cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:51.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.385+0000 7fd75b8d1700 1 -- 172.21.15.5:0/3432590985 shutdown_connections 2023-03-03T06:23:51.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.385+0000 7fd75b8d1700 1 -- 172.21.15.5:0/3432590985 wait complete. 2023-03-03T06:23:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.386+0000 7fd75b8d1700 1 Processor -- start 2023-03-03T06:23:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.386+0000 7fd75b8d1700 1 -- start start 2023-03-03T06:23:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd75b8d1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd7540cb9d0 0x7fd7540ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd75b8d1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7540cd3e0 0x7fd7540b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd75b8d1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd75415cd40 0x7fd754148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd75b8d1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7540add10 con 0x7fd7540cd3e0 2023-03-03T06:23:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd75b8d1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7540ace60 con 0x7fd75415cd40 2023-03-03T06:23:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd75b8d1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7540ad100 con 0x7fd7540cb9d0 2023-03-03T06:23:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd758e6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7540cd3e0 0x7fd7540b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd758e6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7540cd3e0 0x7fd7540b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41222/0 (socket says 172.21.15.5:41222) 2023-03-03T06:23:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd758e6c700 1 -- 172.21.15.5:0/2390788921 learned_addr learned my addr 172.21.15.5:0/2390788921 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:51.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd75966d700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd7540cb9d0 0x7fd7540ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd759e6e700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd75415cd40 0x7fd754148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd758e6c700 1 -- 172.21.15.5:0/2390788921 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd7540cb9d0 msgr2=0x7fd7540ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd758e6c700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd7540cb9d0 0x7fd7540ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd758e6c700 1 -- 172.21.15.5:0/2390788921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd75415cd40 msgr2=0x7fd754148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd758e6c700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd75415cd40 0x7fd754148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.387+0000 7fd758e6c700 1 -- 172.21.15.5:0/2390788921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7500094a0 con 0x7fd7540cd3e0 2023-03-03T06:23:51.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.388+0000 7fd758e6c700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7540cd3e0 0x7fd7540b5170 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd74400c4e0 tx=0x7fd74400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:51.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.388+0000 7fd749ffb700 1 -- 172.21.15.5:0/2390788921 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7440052d0 con 0x7fd7540cd3e0 2023-03-03T06:23:51.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.388+0000 7fd749ffb700 1 -- 172.21.15.5:0/2390788921 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd744005430 con 0x7fd7540cd3e0 2023-03-03T06:23:51.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.388+0000 7fd749ffb700 1 -- 172.21.15.5:0/2390788921 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7440038c0 con 0x7fd7540cd3e0 2023-03-03T06:23:51.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.388+0000 7fd75b8d1700 1 -- 172.21.15.5:0/2390788921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75415d6a0 con 0x7fd7540cd3e0 2023-03-03T06:23:51.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.388+0000 7fd75b8d1700 1 -- 172.21.15.5:0/2390788921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75415d3c0 con 0x7fd7540cd3e0 2023-03-03T06:23:51.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.389+0000 7fd75b8d1700 1 -- 172.21.15.5:0/2390788921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75415d980 con 0x7fd7540cd3e0 2023-03-03T06:23:51.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.389+0000 7fd749ffb700 1 -- 172.21.15.5:0/2390788921 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd744019030 con 0x7fd7540cd3e0 2023-03-03T06:23:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.389+0000 7fd749ffb700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd7380682f0 0x7fd73806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.390+0000 7fd749ffb700 1 -- 172.21.15.5:0/2390788921 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd744085370 con 0x7fd7540cd3e0 2023-03-03T06:23:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.390+0000 7fd75966d700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd7380682f0 0x7fd73806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.390+0000 7fd75966d700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd7380682f0 0x7fd73806a7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd7500097c0 tx=0x7fd75001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:51.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.394+0000 7fd749ffb700 1 -- 172.21.15.5:0/2390788921 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd744051850 con 0x7fd7540cd3e0 2023-03-03T06:23:51.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.584+0000 7fd75b8d1700 1 -- 172.21.15.5:0/2390788921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd75404e6e0 con 0x7fd7540cd3e0 2023-03-03T06:23:51.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.584+0000 7fd749ffb700 1 -- 172.21.15.5:0/2390788921 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd7440170a0 con 0x7fd7540cd3e0 2023-03-03T06:23:51.587 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:23:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.586+0000 7fd75b8d1700 1 -- 172.21.15.5:0/2390788921 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd7380682f0 msgr2=0x7fd73806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.586+0000 7fd75b8d1700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd7380682f0 0x7fd73806a7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd7500097c0 tx=0x7fd75001c040 comp rx=0 tx=0).stop 2023-03-03T06:23:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.586+0000 7fd75b8d1700 1 -- 172.21.15.5:0/2390788921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7540cd3e0 msgr2=0x7fd7540b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.586+0000 7fd75b8d1700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7540cd3e0 0x7fd7540b5170 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd74400c4e0 tx=0x7fd74400c8a0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.586+0000 7fd75b8d1700 1 -- 172.21.15.5:0/2390788921 shutdown_connections 2023-03-03T06:23:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.586+0000 7fd75b8d1700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd75415cd40 0x7fd754148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.586+0000 7fd75b8d1700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd7380682f0 0x7fd73806a7a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.586+0000 7fd75b8d1700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd7540cb9d0 0x7fd7540ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.586+0000 7fd75b8d1700 1 --2- 172.21.15.5:0/2390788921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd7540cd3e0 0x7fd7540b5170 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.586+0000 7fd75b8d1700 1 -- 172.21.15.5:0/2390788921 >> 172.21.15.5:0/2390788921 conn(0x7fd7540cc8d0 msgr2=0x7fd75406b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.586+0000 7fd75b8d1700 1 -- 172.21.15.5:0/2390788921 shutdown_connections 2023-03-03T06:23:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.586+0000 7fd75b8d1700 1 -- 172.21.15.5:0/2390788921 wait complete. 2023-03-03T06:23:51.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:23:51.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.725+0000 7f202cb91700 1 Processor -- start 2023-03-03T06:23:51.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.725+0000 7f202cb91700 1 -- start start 2023-03-03T06:23:51.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.726+0000 7f202cb91700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20280cd3e0 0x7f20280cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.726+0000 7f202cb91700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f20280b1fe0 0x7f20280ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.726+0000 7f202cb91700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202815e160 con 0x7f202815cd40 2023-03-03T06:23:51.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.726+0000 7f202cb91700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20280cd870 con 0x7f20280cd3e0 2023-03-03T06:23:51.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.726+0000 7f202cb91700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202815d110 con 0x7f20280b1fe0 2023-03-03T06:23:51.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.726+0000 7f2025d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20280cd3e0 0x7f20280cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.726+0000 7f2025d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f20280cd3e0 0x7f20280cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41230/0 (socket says 172.21.15.5:41230) 2023-03-03T06:23:51.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.726+0000 7f2025d9b700 1 -- 172.21.15.5:0/692398826 learned_addr learned my addr 172.21.15.5:0/692398826 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:51.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.726+0000 7f2026d9d700 1 --2- 172.21.15.5:0/692398826 >> v2:172.21.15.191:3300/0 conn(0x7f20280b1fe0 0x7f20280ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.727+0000 7f2025d9b700 1 -- 172.21.15.5:0/692398826 >> v2:172.21.15.191:3300/0 conn(0x7f20280b1fe0 msgr2=0x7f20280ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:51.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.727+0000 7f2025d9b700 1 --2- 172.21.15.5:0/692398826 >> v2:172.21.15.191:3300/0 conn(0x7f20280b1fe0 0x7f20280ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.727+0000 7f2025d9b700 1 -- 172.21.15.5:0/692398826 >> v1:172.21.15.191:6789/0 conn(0x7f202815cd40 legacy=0x7f20280b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.727+0000 7f2025d9b700 1 -- 172.21.15.5:0/692398826 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202815d3c0 con 0x7f20280cd3e0 2023-03-03T06:23:51.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.727+0000 7f2025d9b700 1 --2- 172.21.15.5:0/692398826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20280cd3e0 0x7f20280cdd50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2028068620 tx=0x7f2018009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f371095ab67a1127 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:51.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.727+0000 7f202559a700 1 -- 172.21.15.5:0/692398826 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018011830 con 0x7f20280cd3e0 2023-03-03T06:23:51.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.727+0000 7f202559a700 1 -- 172.21.15.5:0/692398826 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2018011990 con 0x7f20280cd3e0 2023-03-03T06:23:51.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.727+0000 7f202559a700 1 -- 172.21.15.5:0/692398826 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018011d20 con 0x7f20280cd3e0 2023-03-03T06:23:51.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.728+0000 7f202cb91700 1 -- 172.21.15.5:0/692398826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20280cd3e0 msgr2=0x7f20280cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.728+0000 7f202cb91700 1 --2- 172.21.15.5:0/692398826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20280cd3e0 0x7f20280cdd50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2028068620 tx=0x7f2018009bd0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.728+0000 7f202cb91700 1 -- 172.21.15.5:0/692398826 shutdown_connections 2023-03-03T06:23:51.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.728+0000 7f202cb91700 1 --2- 172.21.15.5:0/692398826 >> v2:172.21.15.191:3300/0 conn(0x7f20280b1fe0 0x7f20280ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.728+0000 7f202cb91700 1 --2- 172.21.15.5:0/692398826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20280cd3e0 0x7f20280cdd50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.728+0000 7f202cb91700 1 -- 172.21.15.5:0/692398826 >> 172.21.15.5:0/692398826 conn(0x7f20280cc8d0 msgr2=0x7f20280cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:51.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.728+0000 7f202cb91700 1 -- 172.21.15.5:0/692398826 shutdown_connections 2023-03-03T06:23:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.728+0000 7f202cb91700 1 -- 172.21.15.5:0/692398826 wait complete. 2023-03-03T06:23:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.729+0000 7f202cb91700 1 Processor -- start 2023-03-03T06:23:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.729+0000 7f202cb91700 1 -- start start 2023-03-03T06:23:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f202cb91700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20280b1fe0 0x7f202814e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f202cb91700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20280cd3e0 0x7f20280c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f202cb91700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f202815cd40 0x7f20280af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f202cb91700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202814e7a0 con 0x7f202815cd40 2023-03-03T06:23:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f202cb91700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20280c85f0 con 0x7f20280b1fe0 2023-03-03T06:23:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f202cb91700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20280c79e0 con 0x7f20280cd3e0 2023-03-03T06:23:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f2026d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f202815cd40 0x7f20280af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f2026d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f202815cd40 0x7f20280af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41238/0 (socket says 172.21.15.5:41238) 2023-03-03T06:23:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f2026d9d700 1 -- 172.21.15.5:0/245512712 learned_addr learned my addr 172.21.15.5:0/245512712 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f202659c700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20280b1fe0 0x7f202814e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f2025d9b700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20280cd3e0 0x7f20280c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f2026d9d700 1 -- 172.21.15.5:0/245512712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20280cd3e0 msgr2=0x7f20280c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f2026d9d700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20280cd3e0 0x7f20280c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f2026d9d700 1 -- 172.21.15.5:0/245512712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20280b1fe0 msgr2=0x7f202814e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f2026d9d700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20280b1fe0 0x7f202814e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.730+0000 7f2026d9d700 1 -- 172.21.15.5:0/245512712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2018009550 con 0x7f202815cd40 2023-03-03T06:23:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.731+0000 7f2026d9d700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f202815cd40 0x7f20280af9e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2020009dd0 tx=0x7f202000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:51.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.731+0000 7f201effd700 1 -- 172.21.15.5:0/245512712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020009c40 con 0x7f202815cd40 2023-03-03T06:23:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.731+0000 7f201effd700 1 -- 172.21.15.5:0/245512712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202000f040 con 0x7f202815cd40 2023-03-03T06:23:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.731+0000 7f202cb91700 1 -- 172.21.15.5:0/245512712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202815d980 con 0x7f202815cd40 2023-03-03T06:23:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.731+0000 7f201effd700 1 -- 172.21.15.5:0/245512712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202000ceb0 con 0x7f202815cd40 2023-03-03T06:23:51.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.731+0000 7f202cb91700 1 -- 172.21.15.5:0/245512712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202815d6a0 con 0x7f202815cd40 2023-03-03T06:23:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.732+0000 7f202cb91700 1 -- 172.21.15.5:0/245512712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202815dc60 con 0x7f202815cd40 2023-03-03T06:23:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.732+0000 7f201effd700 1 -- 172.21.15.5:0/245512712 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2020014480 con 0x7f202815cd40 2023-03-03T06:23:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.733+0000 7f201effd700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f20080682f0 0x7f200806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.733+0000 7f201effd700 1 -- 172.21.15.5:0/245512712 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f20200868c0 con 0x7f202815cd40 2023-03-03T06:23:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.733+0000 7f202659c700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f20080682f0 0x7f200806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:51.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.733+0000 7f202659c700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f20080682f0 0x7f200806a7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2010007fd0 tx=0x7f2010009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:51.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.737+0000 7f201effd700 1 -- 172.21.15.5:0/245512712 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2020052dd0 con 0x7f202815cd40 2023-03-03T06:23:51.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.928+0000 7f202cb91700 1 -- 172.21.15.5:0/245512712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f202804e6e0 con 0x7f202815cd40 2023-03-03T06:23:51.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.928+0000 7f201effd700 1 -- 172.21.15.5:0/245512712 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20200563f0 con 0x7f202815cd40 2023-03-03T06:23:51.930 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:23:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.930+0000 7f202cb91700 1 -- 172.21.15.5:0/245512712 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f20080682f0 msgr2=0x7f200806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.930+0000 7f202cb91700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f20080682f0 0x7f200806a7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2010007fd0 tx=0x7f2010009040 comp rx=0 tx=0).stop 2023-03-03T06:23:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.930+0000 7f202cb91700 1 -- 172.21.15.5:0/245512712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f202815cd40 msgr2=0x7f20280af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:51.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.930+0000 7f202cb91700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f202815cd40 0x7f20280af9e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2020009dd0 tx=0x7f202000c3a0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.930+0000 7f202cb91700 1 -- 172.21.15.5:0/245512712 shutdown_connections 2023-03-03T06:23:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.930+0000 7f202cb91700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f202815cd40 0x7f20280af9e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.930+0000 7f202cb91700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20280b1fe0 0x7f202814e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.930+0000 7f202cb91700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f20080682f0 0x7f200806a7a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.930+0000 7f202cb91700 1 --2- 172.21.15.5:0/245512712 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20280cd3e0 0x7f20280c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.930+0000 7f202cb91700 1 -- 172.21.15.5:0/245512712 >> 172.21.15.5:0/245512712 conn(0x7f20280cc8d0 msgr2=0x7f20280b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:51.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.930+0000 7f202cb91700 1 -- 172.21.15.5:0/245512712 shutdown_connections 2023-03-03T06:23:51.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:51.930+0000 7f202cb91700 1 -- 172.21.15.5:0/245512712 wait complete. 2023-03-03T06:23:51.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:23:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.068+0000 7f8752818700 1 Processor -- start 2023-03-03T06:23:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.068+0000 7f8752818700 1 -- start start 2023-03-03T06:23:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.069+0000 7f8752818700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f874c0cd450 0x7f874c0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.069+0000 7f8752818700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0b18d0 0x7f874c0b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.069+0000 7f8752818700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874c0cdef0 con 0x7f874c15a850 2023-03-03T06:23:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.069+0000 7f8752818700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874c06c320 con 0x7f874c0cd450 2023-03-03T06:23:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.069+0000 7f8752818700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0b2290 con 0x7f874c0b18d0 2023-03-03T06:23:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.069+0000 7f874bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f874c15a850 0x7f874c0b5620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59316/0 (socket says 172.21.15.5:59316) 2023-03-03T06:23:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.069+0000 7f874bfff700 1 -- 172.21.15.5:0/963540022 learned_addr learned my addr 172.21.15.5:0/963540022 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.069+0000 7f8750db5700 1 --2- 172.21.15.5:0/963540022 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0b18d0 0x7f874c0b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.069+0000 7f874b7fe700 1 --2- 172.21.15.5:0/963540022 >> v2:172.21.15.191:3300/0 conn(0x7f874c0cd450 0x7f874c0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.070+0000 7f874affd700 1 -- 172.21.15.5:0/963540022 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154566402 0 0) 0x7f874c0cdef0 con 0x7f874c15a850 2023-03-03T06:23:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.070+0000 7f874affd700 1 -- 172.21.15.5:0/963540022 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87380035b0 con 0x7f874c15a850 2023-03-03T06:23:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.070+0000 7f8750db5700 1 -- 172.21.15.5:0/963540022 >> v2:172.21.15.191:3300/0 conn(0x7f874c0cd450 msgr2=0x7f874c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.070+0000 7f8750db5700 1 --2- 172.21.15.5:0/963540022 >> v2:172.21.15.191:3300/0 conn(0x7f874c0cd450 0x7f874c0b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.070+0000 7f8750db5700 1 -- 172.21.15.5:0/963540022 >> v1:172.21.15.5:6789/0 conn(0x7f874c15a850 legacy=0x7f874c0b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.070+0000 7f8750db5700 1 -- 172.21.15.5:0/963540022 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c0ce1d0 con 0x7f874c0b18d0 2023-03-03T06:23:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.070+0000 7f8750db5700 1 --2- 172.21.15.5:0/963540022 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0b18d0 0x7f874c0b1d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8744009d90 tx=0x7f874400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e9adefc98e1d72 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:52.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.070+0000 7f874affd700 1 -- 172.21.15.5:0/963540022 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874400e070 con 0x7f874c0b18d0 2023-03-03T06:23:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.070+0000 7f874affd700 1 -- 172.21.15.5:0/963540022 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874400bb20 con 0x7f874c0b18d0 2023-03-03T06:23:52.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.070+0000 7f874affd700 1 -- 172.21.15.5:0/963540022 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744012430 con 0x7f874c0b18d0 2023-03-03T06:23:52.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.071+0000 7f8752818700 1 -- 172.21.15.5:0/963540022 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0b18d0 msgr2=0x7f874c0b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.071+0000 7f8752818700 1 --2- 172.21.15.5:0/963540022 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0b18d0 0x7f874c0b1d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8744009d90 tx=0x7f874400b330 comp rx=0 tx=0).stop 2023-03-03T06:23:52.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.071+0000 7f8752818700 1 -- 172.21.15.5:0/963540022 shutdown_connections 2023-03-03T06:23:52.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.071+0000 7f8752818700 1 --2- 172.21.15.5:0/963540022 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0b18d0 0x7f874c0b1d50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.071+0000 7f8752818700 1 --2- 172.21.15.5:0/963540022 >> v2:172.21.15.191:3300/0 conn(0x7f874c0cd450 0x7f874c0b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.071+0000 7f8752818700 1 -- 172.21.15.5:0/963540022 >> 172.21.15.5:0/963540022 conn(0x7f874c0cc8d0 msgr2=0x7f874c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.071+0000 7f8752818700 1 -- 172.21.15.5:0/963540022 shutdown_connections 2023-03-03T06:23:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.071+0000 7f8752818700 1 -- 172.21.15.5:0/963540022 wait complete. 2023-03-03T06:23:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.072+0000 7f8752818700 1 Processor -- start 2023-03-03T06:23:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.072+0000 7f8752818700 1 -- start start 2023-03-03T06:23:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f8752818700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0b18d0 0x7f874c0c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f8752818700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0cd450 0x7f874c0c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f8752818700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f874c15a850 0x7f874c153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f8752818700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0c5c90 con 0x7f874c0b18d0 2023-03-03T06:23:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f8752818700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0c4de0 con 0x7f874c15a850 2023-03-03T06:23:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f8752818700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0c5080 con 0x7f874c0cd450 2023-03-03T06:23:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f874bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0b18d0 0x7f874c0c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f874bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0b18d0 0x7f874c0c9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41246/0 (socket says 172.21.15.5:41246) 2023-03-03T06:23:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f874bfff700 1 -- 172.21.15.5:0/2657484118 learned_addr learned my addr 172.21.15.5:0/2657484118 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f874b7fe700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0cd450 0x7f874c0c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f8750db5700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f874c15a850 0x7f874c153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f874bfff700 1 -- 172.21.15.5:0/2657484118 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0cd450 msgr2=0x7f874c0c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f874bfff700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0cd450 0x7f874c0c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f874bfff700 1 -- 172.21.15.5:0/2657484118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f874c15a850 msgr2=0x7f874c153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f874bfff700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f874c15a850 0x7f874c153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.073+0000 7f874bfff700 1 -- 172.21.15.5:0/2657484118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744009a70 con 0x7f874c0b18d0 2023-03-03T06:23:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.074+0000 7f874bfff700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0b18d0 0x7f874c0c9ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f873c001eb0 tx=0x7f873c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.074+0000 7f8748ff9700 1 -- 172.21.15.5:0/2657484118 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c005d70 con 0x7f874c0b18d0 2023-03-03T06:23:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.074+0000 7f8752818700 1 -- 172.21.15.5:0/2657484118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874c0ce790 con 0x7f874c0b18d0 2023-03-03T06:23:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.074+0000 7f8748ff9700 1 -- 172.21.15.5:0/2657484118 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c0070d0 con 0x7f874c0b18d0 2023-03-03T06:23:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.074+0000 7f8748ff9700 1 -- 172.21.15.5:0/2657484118 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c007460 con 0x7f874c0b18d0 2023-03-03T06:23:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.074+0000 7f8752818700 1 -- 172.21.15.5:0/2657484118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874c0ce4b0 con 0x7f874c0b18d0 2023-03-03T06:23:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.075+0000 7f8752818700 1 -- 172.21.15.5:0/2657484118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874c0cea70 con 0x7f874c0b18d0 2023-03-03T06:23:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.075+0000 7f8748ff9700 1 -- 172.21.15.5:0/2657484118 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f873c019030 con 0x7f874c0b18d0 2023-03-03T06:23:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.076+0000 7f8748ff9700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f872c0682f0 0x7f872c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.076+0000 7f874b7fe700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f872c0682f0 0x7f872c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.076+0000 7f8748ff9700 1 -- 172.21.15.5:0/2657484118 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f873c085290 con 0x7f874c0b18d0 2023-03-03T06:23:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.076+0000 7f874b7fe700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f872c0682f0 0x7f872c06a7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f874c159df0 tx=0x7f8734009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:52.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.080+0000 7f8748ff9700 1 -- 172.21.15.5:0/2657484118 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f873c051780 con 0x7f874c0b18d0 2023-03-03T06:23:52.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.273+0000 7f8752818700 1 -- 172.21.15.5:0/2657484118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f874c04e6e0 con 0x7f874c0b18d0 2023-03-03T06:23:52.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.274+0000 7f8748ff9700 1 -- 172.21.15.5:0/2657484118 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f873c054da0 con 0x7f874c0b18d0 2023-03-03T06:23:52.276 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:23:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.276+0000 7f8752818700 1 -- 172.21.15.5:0/2657484118 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f872c0682f0 msgr2=0x7f872c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.276+0000 7f8752818700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f872c0682f0 0x7f872c06a7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f874c159df0 tx=0x7f8734009210 comp rx=0 tx=0).stop 2023-03-03T06:23:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.276+0000 7f8752818700 1 -- 172.21.15.5:0/2657484118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0b18d0 msgr2=0x7f874c0c9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.276+0000 7f8752818700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0b18d0 0x7f874c0c9ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f873c001eb0 tx=0x7f873c00c7b0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.276+0000 7f8752818700 1 -- 172.21.15.5:0/2657484118 shutdown_connections 2023-03-03T06:23:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.276+0000 7f8752818700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f874c15a850 0x7f874c153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.276+0000 7f8752818700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0b18d0 0x7f874c0c9ab0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.276+0000 7f8752818700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f872c0682f0 0x7f872c06a7a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.276+0000 7f8752818700 1 --2- 172.21.15.5:0/2657484118 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0cd450 0x7f874c0c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.276+0000 7f8752818700 1 -- 172.21.15.5:0/2657484118 >> 172.21.15.5:0/2657484118 conn(0x7f874c0cc8d0 msgr2=0x7f874c0b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.276+0000 7f8752818700 1 -- 172.21.15.5:0/2657484118 shutdown_connections 2023-03-03T06:23:52.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.276+0000 7f8752818700 1 -- 172.21.15.5:0/2657484118 wait complete. 2023-03-03T06:23:52.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:23:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.418+0000 7fe5df172700 1 Processor -- start 2023-03-03T06:23:52.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.418+0000 7fe5df172700 1 -- start start 2023-03-03T06:23:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5df172700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe5d80cf7c0 0x7fe5d80cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5df172700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d80cc370 con 0x7fe5d80b18d0 2023-03-03T06:23:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5df172700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d80cb760 con 0x7fe5d80cf3f0 2023-03-03T06:23:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5df172700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d80cba40 con 0x7fe5d80cf7c0 2023-03-03T06:23:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5dd70f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe5d80b18d0 0x7fe5d80cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59332/0 (socket says 172.21.15.5:59332) 2023-03-03T06:23:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5dd70f700 1 -- 172.21.15.5:0/1637486752 learned_addr learned my addr 172.21.15.5:0/1637486752 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d7fff700 1 --2- 172.21.15.5:0/1637486752 >> v2:172.21.15.191:3300/0 conn(0x7fe5d80cf7c0 0x7fe5d80cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734528656 0 0) 0x7fe5d80cc370 con 0x7fe5d80b18d0 2023-03-03T06:23:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c80035b0 con 0x7fe5d80b18d0 2023-03-03T06:23:52.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1373256045 0 0) 0x7fe5c80035b0 con 0x7fe5d80b18d0 2023-03-03T06:23:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 >> v2:172.21.15.191:3300/0 conn(0x7fe5d80cf7c0 msgr2=0x7fe5d80cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 --2- 172.21.15.5:0/1637486752 >> v2:172.21.15.191:3300/0 conn(0x7fe5d80cf7c0 0x7fe5d80cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 >> v1:172.21.15.191:6789/0 conn(0x7fe5d80cf3f0 legacy=0x7fe5d815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d80cbd20 con 0x7fe5d80b18d0 2023-03-03T06:23:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fe5d00019f0 con 0x7fe5d80b18d0 2023-03-03T06:23:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 >> v1:172.21.15.5:6789/0 conn(0x7fe5d80b18d0 legacy=0x7fe5d80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 --2- 172.21.15.5:0/1637486752 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5c8003a00 0x7fe5c8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 --2- 172.21.15.5:0/1637486752 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c8004850 0x7fe5c8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 --2- 172.21.15.5:0/1637486752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8005200 0x7fe5c800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d80cba40 con 0x7fe5c8005200 2023-03-03T06:23:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.419+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c800c080 con 0x7fe5c8004850 2023-03-03T06:23:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c800c240 con 0x7fe5c8003a00 2023-03-03T06:23:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5dd70f700 1 --2- 172.21.15.5:0/1637486752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8005200 0x7fe5c800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5d7fff700 1 --2- 172.21.15.5:0/1637486752 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c8004850 0x7fe5c8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5dcf0e700 1 --2- 172.21.15.5:0/1637486752 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5c8003a00 0x7fe5c8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5dd70f700 1 -- 172.21.15.5:0/1637486752 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5c8003a00 msgr2=0x7fe5c8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5dd70f700 1 --2- 172.21.15.5:0/1637486752 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5c8003a00 0x7fe5c8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5dd70f700 1 -- 172.21.15.5:0/1637486752 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c8004850 msgr2=0x7fe5c8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5dd70f700 1 --2- 172.21.15.5:0/1637486752 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c8004850 0x7fe5c8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5dd70f700 1 -- 172.21.15.5:0/1637486752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c80035b0 con 0x7fe5c8005200 2023-03-03T06:23:52.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5dd70f700 1 -- 172.21.15.5:0/1637486752 reap_dead start 2023-03-03T06:23:52.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5dd70f700 1 --2- 172.21.15.5:0/1637486752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8005200 0x7fe5c800ba10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000a830 tx=0x7fe5c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a918655c5d04ac5 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:52.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d000a2f0 con 0x7fe5c8005200 2023-03-03T06:23:52.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d0012620 con 0x7fe5c8005200 2023-03-03T06:23:52.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.420+0000 7fe5d77fe700 1 -- 172.21.15.5:0/1637486752 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00129d0 con 0x7fe5c8005200 2023-03-03T06:23:52.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.421+0000 7fe5df172700 1 -- 172.21.15.5:0/1637486752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8005200 msgr2=0x7fe5c800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.421+0000 7fe5df172700 1 --2- 172.21.15.5:0/1637486752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8005200 0x7fe5c800ba10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000a830 tx=0x7fe5c8005880 comp rx=0 tx=0).stop 2023-03-03T06:23:52.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.421+0000 7fe5df172700 1 -- 172.21.15.5:0/1637486752 shutdown_connections 2023-03-03T06:23:52.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.421+0000 7fe5df172700 1 --2- 172.21.15.5:0/1637486752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8005200 0x7fe5c800ba10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.421+0000 7fe5df172700 1 -- 172.21.15.5:0/1637486752 >> 172.21.15.5:0/1637486752 conn(0x7fe5d80cc8d0 msgr2=0x7fe5d80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:52.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.421+0000 7fe5df172700 1 -- 172.21.15.5:0/1637486752 shutdown_connections 2023-03-03T06:23:52.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.421+0000 7fe5df172700 1 -- 172.21.15.5:0/1637486752 wait complete. 2023-03-03T06:23:52.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.422+0000 7fe5df172700 1 Processor -- start 2023-03-03T06:23:52.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.422+0000 7fe5df172700 1 -- start start 2023-03-03T06:23:52.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5df172700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8005200 0x7fe5d80b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5df172700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5d80c8ea0 0x7fe5d80ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5df172700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5d814cf20 0x7fe5d814d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5df172700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d814d8d0 con 0x7fe5c8005200 2023-03-03T06:23:52.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5df172700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d80c9eb0 con 0x7fe5d814cf20 2023-03-03T06:23:52.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5df172700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d80c3bb0 con 0x7fe5d80c8ea0 2023-03-03T06:23:52.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5dcf0e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8005200 0x7fe5d80b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5dcf0e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8005200 0x7fe5d80b1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41266/0 (socket says 172.21.15.5:41266) 2023-03-03T06:23:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5dcf0e700 1 -- 172.21.15.5:0/1075843432 learned_addr learned my addr 172.21.15.5:0/1075843432 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5d7fff700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5d80c8ea0 0x7fe5d80ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5dd70f700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5d814cf20 0x7fe5d814d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5dcf0e700 1 -- 172.21.15.5:0/1075843432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5d80c8ea0 msgr2=0x7fe5d80ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5dcf0e700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5d80c8ea0 0x7fe5d80ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5dcf0e700 1 -- 172.21.15.5:0/1075843432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5d814cf20 msgr2=0x7fe5d814d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5dcf0e700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5d814cf20 0x7fe5d814d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5dcf0e700 1 -- 172.21.15.5:0/1075843432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d80cd450 con 0x7fe5c8005200 2023-03-03T06:23:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5dcf0e700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8005200 0x7fe5d80b1270 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00f820 tx=0x7fe5cc00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5d57fa700 1 -- 172.21.15.5:0/1075843432 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc0052e0 con 0x7fe5c8005200 2023-03-03T06:23:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5d57fa700 1 -- 172.21.15.5:0/1075843432 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc005440 con 0x7fe5c8005200 2023-03-03T06:23:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5df172700 1 -- 172.21.15.5:0/1075843432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d80cc000 con 0x7fe5c8005200 2023-03-03T06:23:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5d57fa700 1 -- 172.21.15.5:0/1075843432 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc0038c0 con 0x7fe5c8005200 2023-03-03T06:23:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.424+0000 7fe5df172700 1 -- 172.21.15.5:0/1075843432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d80cd5e0 con 0x7fe5c8005200 2023-03-03T06:23:52.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.425+0000 7fe5df172700 1 -- 172.21.15.5:0/1075843432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d804e6e0 con 0x7fe5c8005200 2023-03-03T06:23:52.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.426+0000 7fe5d57fa700 1 -- 172.21.15.5:0/1075843432 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe5cc003a20 con 0x7fe5c8005200 2023-03-03T06:23:52.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.426+0000 7fe5d57fa700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe5bc068320 0x7fe5bc06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.426+0000 7fe5d7fff700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe5bc068320 0x7fe5bc06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.426+0000 7fe5d57fa700 1 -- 172.21.15.5:0/1075843432 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe5cc085c90 con 0x7fe5c8005200 2023-03-03T06:23:52.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.427+0000 7fe5d7fff700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe5bc068320 0x7fe5bc06a7d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5d806d460 tx=0x7fe5c4009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:52.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.431+0000 7fe5d57fa700 1 -- 172.21.15.5:0/1075843432 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe5cc052200 con 0x7fe5c8005200 2023-03-03T06:23:52.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.624+0000 7fe5df172700 1 -- 172.21.15.5:0/1075843432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5d80c3980 con 0x7fe5c8005200 2023-03-03T06:23:52.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.624+0000 7fe5d57fa700 1 -- 172.21.15.5:0/1075843432 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5cc003cb0 con 0x7fe5c8005200 2023-03-03T06:23:52.626 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:23:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.626+0000 7fe5df172700 1 -- 172.21.15.5:0/1075843432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe5bc068320 msgr2=0x7fe5bc06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.626+0000 7fe5df172700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe5bc068320 0x7fe5bc06a7d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5d806d460 tx=0x7fe5c4009210 comp rx=0 tx=0).stop 2023-03-03T06:23:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.626+0000 7fe5df172700 1 -- 172.21.15.5:0/1075843432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8005200 msgr2=0x7fe5d80b1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.626+0000 7fe5df172700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8005200 0x7fe5d80b1270 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00f820 tx=0x7fe5cc00fb30 comp rx=0 tx=0).stop 2023-03-03T06:23:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.626+0000 7fe5df172700 1 -- 172.21.15.5:0/1075843432 shutdown_connections 2023-03-03T06:23:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.626+0000 7fe5df172700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5d814cf20 0x7fe5d814d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.626+0000 7fe5df172700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5c8005200 0x7fe5d80b1270 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.626+0000 7fe5df172700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe5bc068320 0x7fe5bc06a7d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.626+0000 7fe5df172700 1 --2- 172.21.15.5:0/1075843432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe5d80c8ea0 0x7fe5d80ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.626+0000 7fe5df172700 1 -- 172.21.15.5:0/1075843432 >> 172.21.15.5:0/1075843432 conn(0x7fe5d80cc8d0 msgr2=0x7fe5d815d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.626+0000 7fe5df172700 1 -- 172.21.15.5:0/1075843432 shutdown_connections 2023-03-03T06:23:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.626+0000 7fe5df172700 1 -- 172.21.15.5:0/1075843432 wait complete. 2023-03-03T06:23:52.640 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-03T06:23:52.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.764+0000 7f0cca8e8700 1 Processor -- start 2023-03-03T06:23:52.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.765+0000 7f0cca8e8700 1 -- start start 2023-03-03T06:23:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.765+0000 7f0cca8e8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0cc415a8d0 0x7f0cc40cb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.765+0000 7f0cca8e8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc406d580 0x7f0cc406da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.765+0000 7f0cca8e8700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc40c9f70 con 0x7f0cc415e230 2023-03-03T06:23:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.765+0000 7f0cca8e8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc406df40 con 0x7f0cc415a8d0 2023-03-03T06:23:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.765+0000 7f0cca8e8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc40b2a10 con 0x7f0cc406d580 2023-03-03T06:23:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.765+0000 7f0cc3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0cc415a8d0 0x7f0cc40cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.766+0000 7f0cc3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0cc415a8d0 0x7f0cc40cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41274/0 (socket says 172.21.15.5:41274) 2023-03-03T06:23:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.766+0000 7f0cc3fff700 1 -- 172.21.15.5:0/3872707453 learned_addr learned my addr 172.21.15.5:0/3872707453 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.766+0000 7f0cc8e85700 1 --2- 172.21.15.5:0/3872707453 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc406d580 0x7f0cc406da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.766+0000 7f0cc3fff700 1 -- 172.21.15.5:0/3872707453 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc406d580 msgr2=0x7f0cc406da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.766+0000 7f0cc3fff700 1 --2- 172.21.15.5:0/3872707453 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc406d580 0x7f0cc406da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.766+0000 7f0cc3fff700 1 -- 172.21.15.5:0/3872707453 >> v1:172.21.15.191:6789/0 conn(0x7f0cc415e230 legacy=0x7f0cc40b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.766+0000 7f0cc3fff700 1 -- 172.21.15.5:0/3872707453 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc415e7a0 con 0x7f0cc415a8d0 2023-03-03T06:23:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.766+0000 7f0cc8e85700 1 --2- 172.21.15.5:0/3872707453 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc406d580 0x7f0cc406da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.766+0000 7f0cc3fff700 1 --2- 172.21.15.5:0/3872707453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc415a8d0 0x7f0cc40cb680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40098f0 tx=0x7f0cb4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1d87053ca23d2d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.766+0000 7f0cc2ffd700 1 -- 172.21.15.5:0/3872707453 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb400b8a0 con 0x7f0cc415a8d0 2023-03-03T06:23:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.766+0000 7f0cc2ffd700 1 -- 172.21.15.5:0/3872707453 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb400ba00 con 0x7f0cc415a8d0 2023-03-03T06:23:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.766+0000 7f0cc2ffd700 1 -- 172.21.15.5:0/3872707453 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb400bd90 con 0x7f0cc415a8d0 2023-03-03T06:23:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.767+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3872707453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc415a8d0 msgr2=0x7f0cc40cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.767+0000 7f0cca8e8700 1 --2- 172.21.15.5:0/3872707453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc415a8d0 0x7f0cc40cb680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40098f0 tx=0x7f0cb4009c00 comp rx=0 tx=0).stop 2023-03-03T06:23:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.767+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3872707453 shutdown_connections 2023-03-03T06:23:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.767+0000 7f0cca8e8700 1 --2- 172.21.15.5:0/3872707453 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc406d580 0x7f0cc406da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.767+0000 7f0cca8e8700 1 --2- 172.21.15.5:0/3872707453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc415a8d0 0x7f0cc40cb680 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.767+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3872707453 >> 172.21.15.5:0/3872707453 conn(0x7f0cc40cf4b0 msgr2=0x7f0cc40cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.767+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3872707453 shutdown_connections 2023-03-03T06:23:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.767+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3872707453 wait complete. 2023-03-03T06:23:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.768+0000 7f0cca8e8700 1 Processor -- start 2023-03-03T06:23:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.768+0000 7f0cca8e8700 1 -- start start 2023-03-03T06:23:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cca8e8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406d580 0x7f0cc414eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cca8e8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cc415a8d0 0x7f0cc40b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cca8e8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc415e230 0x7f0cc40b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cca8e8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc415b1a0 con 0x7f0cc406d580 2023-03-03T06:23:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cca8e8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc415b480 con 0x7f0cc415a8d0 2023-03-03T06:23:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cca8e8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc415b760 con 0x7f0cc415e230 2023-03-03T06:23:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cc3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406d580 0x7f0cc414eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cc3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406d580 0x7f0cc414eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41280/0 (socket says 172.21.15.5:41280) 2023-03-03T06:23:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cc3fff700 1 -- 172.21.15.5:0/3798362154 learned_addr learned my addr 172.21.15.5:0/3798362154 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cc3fff700 1 -- 172.21.15.5:0/3798362154 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc415e230 msgr2=0x7f0cc40b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cc3fff700 1 --2- 172.21.15.5:0/3798362154 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc415e230 0x7f0cc40b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cc3fff700 1 -- 172.21.15.5:0/3798362154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cc415a8d0 msgr2=0x7f0cc40b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cc37fe700 1 --2- 172.21.15.5:0/3798362154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cc415a8d0 0x7f0cc40b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cc3fff700 1 --2- 172.21.15.5:0/3798362154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cc415a8d0 0x7f0cc40b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cc3fff700 1 -- 172.21.15.5:0/3798362154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb4009550 con 0x7f0cc406d580 2023-03-03T06:23:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.769+0000 7f0cc3fff700 1 --2- 172.21.15.5:0/3798362154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406d580 0x7f0cc414eb60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4009c40 tx=0x7f0cb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.770+0000 7f0cc0ff9700 1 -- 172.21.15.5:0/3798362154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4004400 con 0x7f0cc406d580 2023-03-03T06:23:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.770+0000 7f0cc0ff9700 1 -- 172.21.15.5:0/3798362154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb401f070 con 0x7f0cc406d580 2023-03-03T06:23:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.770+0000 7f0cc0ff9700 1 -- 172.21.15.5:0/3798362154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb40038e0 con 0x7f0cc406d580 2023-03-03T06:23:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.770+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3798362154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc415ed60 con 0x7f0cc406d580 2023-03-03T06:23:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.770+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3798362154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc415ea80 con 0x7f0cc406d580 2023-03-03T06:23:52.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.771+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3798362154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc415f040 con 0x7f0cc406d580 2023-03-03T06:23:52.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.771+0000 7f0cc0ff9700 1 -- 172.21.15.5:0/3798362154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0cb402a020 con 0x7f0cc406d580 2023-03-03T06:23:52.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.772+0000 7f0cc0ff9700 1 --2- 172.21.15.5:0/3798362154 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0cb00682f0 0x7f0cb006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:52.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.772+0000 7f0cc37fe700 1 --2- 172.21.15.5:0/3798362154 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0cb00682f0 0x7f0cb006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:52.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.772+0000 7f0cc0ff9700 1 -- 172.21.15.5:0/3798362154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0cb40876d0 con 0x7f0cc406d580 2023-03-03T06:23:52.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.772+0000 7f0cc37fe700 1 --2- 172.21.15.5:0/3798362154 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0cb00682f0 0x7f0cb006a7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0cc406bd60 tx=0x7f0cb8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:52.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.776+0000 7f0cc0ff9700 1 -- 172.21.15.5:0/3798362154 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0cb4053c40 con 0x7f0cc406d580 2023-03-03T06:23:52.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.966+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3798362154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0cc404e6e0 con 0x7f0cc406d580 2023-03-03T06:23:52.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.966+0000 7f0cc0ff9700 1 -- 172.21.15.5:0/3798362154 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0cb4057260 con 0x7f0cc406d580 2023-03-03T06:23:52.969 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:23:52.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.968+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3798362154 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0cb00682f0 msgr2=0x7f0cb006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.968+0000 7f0cca8e8700 1 --2- 172.21.15.5:0/3798362154 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0cb00682f0 0x7f0cb006a7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0cc406bd60 tx=0x7f0cb8009040 comp rx=0 tx=0).stop 2023-03-03T06:23:52.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.968+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3798362154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406d580 msgr2=0x7f0cc414eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:52.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.968+0000 7f0cca8e8700 1 --2- 172.21.15.5:0/3798362154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406d580 0x7f0cc414eb60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4009c40 tx=0x7f0cb4004750 comp rx=0 tx=0).stop 2023-03-03T06:23:52.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.968+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3798362154 shutdown_connections 2023-03-03T06:23:52.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.968+0000 7f0cca8e8700 1 --2- 172.21.15.5:0/3798362154 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0cb00682f0 0x7f0cb006a7a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.968+0000 7f0cca8e8700 1 --2- 172.21.15.5:0/3798362154 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cc415e230 0x7f0cc40b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.968+0000 7f0cca8e8700 1 --2- 172.21.15.5:0/3798362154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cc406d580 0x7f0cc414eb60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.968+0000 7f0cca8e8700 1 --2- 172.21.15.5:0/3798362154 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cc415a8d0 0x7f0cc40b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:52.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.968+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3798362154 >> 172.21.15.5:0/3798362154 conn(0x7f0cc40cf4b0 msgr2=0x7f0cc40aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:52.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.968+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3798362154 shutdown_connections 2023-03-03T06:23:52.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:52.968+0000 7f0cca8e8700 1 -- 172.21.15.5:0/3798362154 wait complete. 2023-03-03T06:23:52.983 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-03T06:23:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.106+0000 7f7f0d882700 1 Processor -- start 2023-03-03T06:23:53.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.106+0000 7f7f0d882700 1 -- start start 2023-03-03T06:23:53.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.106+0000 7f7f0d882700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7f0806c830 0x7f7f08160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.106+0000 7f7f0d882700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f080cf2a0 0x7f7f080d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.106+0000 7f7f0d882700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f080d2e10 con 0x7f7f080b8a40 2023-03-03T06:23:53.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.106+0000 7f7f0d882700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f08161490 con 0x7f7f080cf2a0 2023-03-03T06:23:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.106+0000 7f7f0d882700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f080cd8d0 con 0x7f7f0806c830 2023-03-03T06:23:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.107+0000 7f7f077fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f080cf2a0 0x7f7f080d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.107+0000 7f7f077fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f080cf2a0 0x7f7f080d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41292/0 (socket says 172.21.15.5:41292) 2023-03-03T06:23:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.107+0000 7f7f077fe700 1 -- 172.21.15.5:0/902958777 learned_addr learned my addr 172.21.15.5:0/902958777 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.107+0000 7f7f067fc700 1 --2- 172.21.15.5:0/902958777 >> v2:172.21.15.191:3300/0 conn(0x7f7f0806c830 0x7f7f08160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.107+0000 7f7f077fe700 1 -- 172.21.15.5:0/902958777 >> v2:172.21.15.191:3300/0 conn(0x7f7f0806c830 msgr2=0x7f7f08160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:53.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.107+0000 7f7f077fe700 1 --2- 172.21.15.5:0/902958777 >> v2:172.21.15.191:3300/0 conn(0x7f7f0806c830 0x7f7f08160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.107+0000 7f7f077fe700 1 -- 172.21.15.5:0/902958777 >> v1:172.21.15.191:6789/0 conn(0x7f7f080b8a40 legacy=0x7f7f0806c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.107+0000 7f7f077fe700 1 -- 172.21.15.5:0/902958777 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f080d2520 con 0x7f7f080cf2a0 2023-03-03T06:23:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.107+0000 7f7f067fc700 1 --2- 172.21.15.5:0/902958777 >> v2:172.21.15.191:3300/0 conn(0x7f7f0806c830 0x7f7f08160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.107+0000 7f7f077fe700 1 --2- 172.21.15.5:0/902958777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f080cf2a0 0x7f7f080d0c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f081604a0 tx=0x7f7f0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983a6990e4ea1e9b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.107+0000 7f7f05ffb700 1 -- 172.21.15.5:0/902958777 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000e070 con 0x7f7f080cf2a0 2023-03-03T06:23:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.107+0000 7f7f05ffb700 1 -- 172.21.15.5:0/902958777 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0000b9c0 con 0x7f7f080cf2a0 2023-03-03T06:23:53.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.107+0000 7f7f05ffb700 1 -- 172.21.15.5:0/902958777 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000bd70 con 0x7f7f080cf2a0 2023-03-03T06:23:53.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.108+0000 7f7f0d882700 1 -- 172.21.15.5:0/902958777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f080cf2a0 msgr2=0x7f7f080d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.108+0000 7f7f0d882700 1 --2- 172.21.15.5:0/902958777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f080cf2a0 0x7f7f080d0c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f081604a0 tx=0x7f7f0000b330 comp rx=0 tx=0).stop 2023-03-03T06:23:53.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.108+0000 7f7f0d882700 1 -- 172.21.15.5:0/902958777 shutdown_connections 2023-03-03T06:23:53.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.108+0000 7f7f0d882700 1 --2- 172.21.15.5:0/902958777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f080cf2a0 0x7f7f080d0c20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.108+0000 7f7f0d882700 1 --2- 172.21.15.5:0/902958777 >> v2:172.21.15.191:3300/0 conn(0x7f7f0806c830 0x7f7f08160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.108+0000 7f7f0d882700 1 -- 172.21.15.5:0/902958777 >> 172.21.15.5:0/902958777 conn(0x7f7f080d05d0 msgr2=0x7f7f080d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:53.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.108+0000 7f7f0d882700 1 -- 172.21.15.5:0/902958777 shutdown_connections 2023-03-03T06:23:53.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.108+0000 7f7f0d882700 1 -- 172.21.15.5:0/902958777 wait complete. 2023-03-03T06:23:53.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.109+0000 7f7f0d882700 1 Processor -- start 2023-03-03T06:23:53.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.109+0000 7f7f0d882700 1 -- start start 2023-03-03T06:23:53.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f0d882700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f0806c830 0x7f7f0814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f0d882700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f080b8a40 0x7f7f080c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f0d882700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f080cf2a0 0x7f7f0814bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f0d882700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080cd180 con 0x7f7f0806c830 2023-03-03T06:23:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f0d882700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080c9d90 con 0x7f7f080cf2a0 2023-03-03T06:23:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f0d882700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f08150060 con 0x7f7f080b8a40 2023-03-03T06:23:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f06ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f0806c830 0x7f7f0814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f06ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f0806c830 0x7f7f0814fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41294/0 (socket says 172.21.15.5:41294) 2023-03-03T06:23:53.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f06ffd700 1 -- 172.21.15.5:0/3915872577 learned_addr learned my addr 172.21.15.5:0/3915872577 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f077fe700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f080cf2a0 0x7f7f0814bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f067fc700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f080b8a40 0x7f7f080c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f06ffd700 1 -- 172.21.15.5:0/3915872577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f080b8a40 msgr2=0x7f7f080c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f06ffd700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f080b8a40 0x7f7f080c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f06ffd700 1 -- 172.21.15.5:0/3915872577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f080cf2a0 msgr2=0x7f7f0814bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f06ffd700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f080cf2a0 0x7f7f0814bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f06ffd700 1 -- 172.21.15.5:0/3915872577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f00009b30 con 0x7f7f0806c830 2023-03-03T06:23:53.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f077fe700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f080cf2a0 0x7f7f0814bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:53.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.110+0000 7f7f06ffd700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f0806c830 0x7f7f0814fb20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800c4e0 tx=0x7f7ef800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:53.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.111+0000 7f7eeffff700 1 -- 172.21.15.5:0/3915872577 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef80052d0 con 0x7f7f0806c830 2023-03-03T06:23:53.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.111+0000 7f7eeffff700 1 -- 172.21.15.5:0/3915872577 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef8005430 con 0x7f7f0806c830 2023-03-03T06:23:53.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.111+0000 7f7f0d882700 1 -- 172.21.15.5:0/3915872577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f080d2850 con 0x7f7f0806c830 2023-03-03T06:23:53.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.111+0000 7f7eeffff700 1 -- 172.21.15.5:0/3915872577 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef80038c0 con 0x7f7f0806c830 2023-03-03T06:23:53.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.111+0000 7f7f0d882700 1 -- 172.21.15.5:0/3915872577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0815ce30 con 0x7f7f0806c830 2023-03-03T06:23:53.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.112+0000 7f7f0d882700 1 -- 172.21.15.5:0/3915872577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f080d2b30 con 0x7f7f0806c830 2023-03-03T06:23:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.112+0000 7f7eeffff700 1 -- 172.21.15.5:0/3915872577 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7ef8019030 con 0x7f7f0806c830 2023-03-03T06:23:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.112+0000 7f7eeffff700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ef40682f0 0x7f7ef406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.113+0000 7f7f067fc700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ef40682f0 0x7f7ef406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.113+0000 7f7eeffff700 1 -- 172.21.15.5:0/3915872577 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ef8085190 con 0x7f7f0806c830 2023-03-03T06:23:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.113+0000 7f7f067fc700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ef40682f0 0x7f7ef406a7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f080b4aa0 tx=0x7f7efc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:53.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.117+0000 7f7eeffff700 1 -- 172.21.15.5:0/3915872577 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7ef8051700 con 0x7f7f0806c830 2023-03-03T06:23:53.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.327+0000 7f7f0d882700 1 -- 172.21.15.5:0/3915872577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7f080d2e10 con 0x7f7f0806c830 2023-03-03T06:23:53.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.327+0000 7f7eeffff700 1 -- 172.21.15.5:0/3915872577 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7f080d2e10 con 0x7f7f0806c830 2023-03-03T06:23:53.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.329+0000 7f7f0d882700 1 -- 172.21.15.5:0/3915872577 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ef40682f0 msgr2=0x7f7ef406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.329+0000 7f7f0d882700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ef40682f0 0x7f7ef406a7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f080b4aa0 tx=0x7f7efc008040 comp rx=0 tx=0).stop 2023-03-03T06:23:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.329+0000 7f7f0d882700 1 -- 172.21.15.5:0/3915872577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f0806c830 msgr2=0x7f7f0814fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.329+0000 7f7f0d882700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f0806c830 0x7f7f0814fb20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800c4e0 tx=0x7f7ef800c8a0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.329+0000 7f7f0d882700 1 -- 172.21.15.5:0/3915872577 shutdown_connections 2023-03-03T06:23:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.329+0000 7f7f0d882700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f080cf2a0 0x7f7f0814bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.329+0000 7f7f0d882700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f0806c830 0x7f7f0814fb20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.329+0000 7f7f0d882700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ef40682f0 0x7f7ef406a7a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.329+0000 7f7f0d882700 1 --2- 172.21.15.5:0/3915872577 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f080b8a40 0x7f7f080c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.329+0000 7f7f0d882700 1 -- 172.21.15.5:0/3915872577 >> 172.21.15.5:0/3915872577 conn(0x7f7f080d05d0 msgr2=0x7f7f080d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.329+0000 7f7f0d882700 1 -- 172.21.15.5:0/3915872577 shutdown_connections 2023-03-03T06:23:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.330+0000 7f7f0d882700 1 -- 172.21.15.5:0/3915872577 wait complete. 2023-03-03T06:23:53.333 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-03-03T06:23:53.344 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:23:53.344 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:23:53.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:23:53.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.525+0000 7f417e057700 1 Processor -- start 2023-03-03T06:23:53.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.525+0000 7f417e057700 1 -- start start 2023-03-03T06:23:53.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.526+0000 7f417e057700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41780b87b0 0x7f4178160d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.526+0000 7f417e057700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41780b51e0 0x7f41780d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.526+0000 7f417e057700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41780cf2a0 con 0x7f41780d2b60 2023-03-03T06:23:53.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.526+0000 7f417e057700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4178161240 con 0x7f41780b87b0 2023-03-03T06:23:53.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.526+0000 7f417e057700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41780cf520 con 0x7f41780b51e0 2023-03-03T06:23:53.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.526+0000 7f41777fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41780b87b0 0x7f4178160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.526+0000 7f4176ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f41780d2b60 0x7f41780b4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59376/0 (socket says 172.21.15.5:59376) 2023-03-03T06:23:53.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.526+0000 7f41777fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f41780b87b0 0x7f4178160d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41302/0 (socket says 172.21.15.5:41302) 2023-03-03T06:23:53.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.526+0000 7f4176ffd700 1 -- 172.21.15.5:0/2227467816 learned_addr learned my addr 172.21.15.5:0/2227467816 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:53.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.526+0000 7f4177fff700 1 --2- 172.21.15.5:0/2227467816 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41780b51e0 0x7f41780d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.527+0000 7f41777fe700 1 -- 172.21.15.5:0/2227467816 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41780b51e0 msgr2=0x7f41780d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:53.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.527+0000 7f41777fe700 1 --2- 172.21.15.5:0/2227467816 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41780b51e0 0x7f41780d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.527+0000 7f41767fc700 1 -- 172.21.15.5:0/2227467816 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246715036 0 0) 0x7f41780cf2a0 con 0x7f41780d2b60 2023-03-03T06:23:53.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.527+0000 7f41777fe700 1 -- 172.21.15.5:0/2227467816 >> v1:172.21.15.5:6789/0 conn(0x7f41780d2b60 legacy=0x7f41780b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.527+0000 7f41777fe700 1 -- 172.21.15.5:0/2227467816 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41780cf800 con 0x7f41780b87b0 2023-03-03T06:23:53.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.527+0000 7f41777fe700 1 --2- 172.21.15.5:0/2227467816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41780b87b0 0x7f4178160d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4168009840 tx=0x7f4168009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834534c75c0568b7 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:53.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.527+0000 7f41767fc700 1 -- 172.21.15.5:0/2227467816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4168011830 con 0x7f41780b87b0 2023-03-03T06:23:53.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.527+0000 7f41767fc700 1 -- 172.21.15.5:0/2227467816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4168011990 con 0x7f41780b87b0 2023-03-03T06:23:53.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.527+0000 7f41767fc700 1 -- 172.21.15.5:0/2227467816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4168011d20 con 0x7f41780b87b0 2023-03-03T06:23:53.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.528+0000 7f417e057700 1 -- 172.21.15.5:0/2227467816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41780b87b0 msgr2=0x7f4178160d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.528+0000 7f417e057700 1 --2- 172.21.15.5:0/2227467816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41780b87b0 0x7f4178160d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4168009840 tx=0x7f4168009b50 comp rx=0 tx=0).stop 2023-03-03T06:23:53.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.528+0000 7f417e057700 1 -- 172.21.15.5:0/2227467816 shutdown_connections 2023-03-03T06:23:53.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.528+0000 7f417e057700 1 --2- 172.21.15.5:0/2227467816 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41780b51e0 0x7f41780d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.528+0000 7f417e057700 1 --2- 172.21.15.5:0/2227467816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41780b87b0 0x7f4178160d00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.528+0000 7f417e057700 1 -- 172.21.15.5:0/2227467816 >> 172.21.15.5:0/2227467816 conn(0x7f417806d0b0 msgr2=0x7f41780cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:53.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.528+0000 7f417e057700 1 -- 172.21.15.5:0/2227467816 shutdown_connections 2023-03-03T06:23:53.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.528+0000 7f417e057700 1 -- 172.21.15.5:0/2227467816 wait complete. 2023-03-03T06:23:53.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.529+0000 7f417e057700 1 Processor -- start 2023-03-03T06:23:53.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.529+0000 7f417e057700 1 -- start start 2023-03-03T06:23:53.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f417e057700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41780b51e0 0x7f417815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f417e057700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41780b87b0 0x7f41780c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f417e057700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41780d2b60 0x7f4178150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f417e057700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c8410 con 0x7f41780b87b0 2023-03-03T06:23:53.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f417e057700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c9830 con 0x7f41780b51e0 2023-03-03T06:23:53.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f417e057700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c7dc0 con 0x7f41780d2b60 2023-03-03T06:23:53.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f4176ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41780b87b0 0x7f41780c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f4176ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41780b87b0 0x7f41780c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41308/0 (socket says 172.21.15.5:41308) 2023-03-03T06:23:53.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f4176ffd700 1 -- 172.21.15.5:0/1118690860 learned_addr learned my addr 172.21.15.5:0/1118690860 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:53.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f4177fff700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41780d2b60 0x7f4178150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f41777fe700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41780b51e0 0x7f417815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f4176ffd700 1 -- 172.21.15.5:0/1118690860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41780d2b60 msgr2=0x7f4178150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f4176ffd700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41780d2b60 0x7f4178150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f4176ffd700 1 -- 172.21.15.5:0/1118690860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41780b51e0 msgr2=0x7f417815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f4176ffd700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41780b51e0 0x7f417815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f4176ffd700 1 -- 172.21.15.5:0/1118690860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41680094a0 con 0x7f41780b87b0 2023-03-03T06:23:53.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.530+0000 7f4176ffd700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41780b87b0 0x7f41780c88a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f416c0011e0 tx=0x7f416c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:53.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.531+0000 7f415ffff700 1 -- 172.21.15.5:0/1118690860 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c004c80 con 0x7f41780b87b0 2023-03-03T06:23:53.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.531+0000 7f415ffff700 1 -- 172.21.15.5:0/1118690860 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c004e00 con 0x7f41780b87b0 2023-03-03T06:23:53.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.531+0000 7f417e057700 1 -- 172.21.15.5:0/1118690860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41780cda20 con 0x7f41780b87b0 2023-03-03T06:23:53.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.531+0000 7f415ffff700 1 -- 172.21.15.5:0/1118690860 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c007310 con 0x7f41780b87b0 2023-03-03T06:23:53.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.531+0000 7f417e057700 1 -- 172.21.15.5:0/1118690860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41780cd740 con 0x7f41780b87b0 2023-03-03T06:23:53.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.532+0000 7f417e057700 1 -- 172.21.15.5:0/1118690860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41780b8b80 con 0x7f41780b87b0 2023-03-03T06:23:53.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.532+0000 7f415ffff700 1 -- 172.21.15.5:0/1118690860 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f416c01a020 con 0x7f41780b87b0 2023-03-03T06:23:53.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.532+0000 7f415ffff700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4164068320 0x7f416406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.533+0000 7f41777fe700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4164068320 0x7f416406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.533+0000 7f415ffff700 1 -- 172.21.15.5:0/1118690860 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f416c085c70 con 0x7f41780b87b0 2023-03-03T06:23:53.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.533+0000 7f41777fe700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4164068320 0x7f416406a7d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f41680090b0 tx=0x7f4168008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:53.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.537+0000 7f415ffff700 1 -- 172.21.15.5:0/1118690860 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f416c0520f0 con 0x7f41780b87b0 2023-03-03T06:23:53.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.733+0000 7f417e057700 1 -- 172.21.15.5:0/1118690860 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4178067440 con 0x7f41780b87b0 2023-03-03T06:23:53.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.734+0000 7f415ffff700 1 -- 172.21.15.5:0/1118690860 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7f416c055710 con 0x7f41780b87b0 2023-03-03T06:23:53.736 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:53.736 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:23:53.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.737+0000 7f417e057700 1 -- 172.21.15.5:0/1118690860 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4164068320 msgr2=0x7f416406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.737+0000 7f417e057700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4164068320 0x7f416406a7d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f41680090b0 tx=0x7f4168008030 comp rx=0 tx=0).stop 2023-03-03T06:23:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.737+0000 7f417e057700 1 -- 172.21.15.5:0/1118690860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41780b87b0 msgr2=0x7f41780c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.737+0000 7f417e057700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41780b87b0 0x7f41780c88a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f416c0011e0 tx=0x7f416c00cae0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.737+0000 7f417e057700 1 -- 172.21.15.5:0/1118690860 shutdown_connections 2023-03-03T06:23:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.737+0000 7f417e057700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4164068320 0x7f416406a7d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.737+0000 7f417e057700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41780d2b60 0x7f4178150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.737+0000 7f417e057700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41780b51e0 0x7f417815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.737+0000 7f417e057700 1 --2- 172.21.15.5:0/1118690860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f41780b87b0 0x7f41780c88a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.737+0000 7f417e057700 1 -- 172.21.15.5:0/1118690860 >> 172.21.15.5:0/1118690860 conn(0x7f417806d0b0 msgr2=0x7f417815b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:53.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.737+0000 7f417e057700 1 -- 172.21.15.5:0/1118690860 shutdown_connections 2023-03-03T06:23:53.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.737+0000 7f417e057700 1 -- 172.21.15.5:0/1118690860 wait complete. 2023-03-03T06:23:53.751 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:23:38.141777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:23:39.283589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-03T06:23:42.422930+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-03T06:23:53.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:23:53.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c214a0700 1 Processor -- start 2023-03-03T06:23:53.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c214a0700 1 -- start start 2023-03-03T06:23:53.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c214a0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c1c0b8720 0x7f1c1c06bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c214a0700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1c1c0cd850 0x7f1c1c160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c214a0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c0d2d60 con 0x7f1c1c06c120 2023-03-03T06:23:53.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c214a0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c1612d0 con 0x7f1c1c0b8720 2023-03-03T06:23:53.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c214a0700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c0cf400 con 0x7f1c1c0cd850 2023-03-03T06:23:53.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c1affd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1c1c0b8720 0x7f1c1c06bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c1b7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1c1c06c120 0x7f1c1c0d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59394/0 (socket says 172.21.15.5:59394) 2023-03-03T06:23:53.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c1b7fe700 1 -- 172.21.15.5:0/2851704870 learned_addr learned my addr 172.21.15.5:0/2851704870 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:53.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c1a7fc700 1 --2- 172.21.15.5:0/2851704870 >> v2:172.21.15.191:3300/0 conn(0x7f1c1c0cd850 0x7f1c1c160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c1affd700 1 -- 172.21.15.5:0/2851704870 >> v2:172.21.15.191:3300/0 conn(0x7f1c1c0cd850 msgr2=0x7f1c1c160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:53.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c1affd700 1 --2- 172.21.15.5:0/2851704870 >> v2:172.21.15.191:3300/0 conn(0x7f1c1c0cd850 0x7f1c1c160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c1affd700 1 -- 172.21.15.5:0/2851704870 >> v1:172.21.15.5:6789/0 conn(0x7f1c1c06c120 legacy=0x7f1c1c0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c1affd700 1 -- 172.21.15.5:0/2851704870 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c0cf6e0 con 0x7f1c1c0b8720 2023-03-03T06:23:53.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c19ffb700 1 -- 172.21.15.5:0/2851704870 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437073513 0 0) 0x7f1c1c0d2d60 con 0x7f1c1c06c120 2023-03-03T06:23:53.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c1affd700 1 --2- 172.21.15.5:0/2851704870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b8720 0x7f1c1c06bab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c06b860 tx=0x7f1c0c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374c24f772ee1210 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:53.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c19ffb700 1 -- 172.21.15.5:0/2851704870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c011830 con 0x7f1c1c0b8720 2023-03-03T06:23:53.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c19ffb700 1 -- 172.21.15.5:0/2851704870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c011990 con 0x7f1c1c0b8720 2023-03-03T06:23:53.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.878+0000 7f1c19ffb700 1 -- 172.21.15.5:0/2851704870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c011d20 con 0x7f1c1c0b8720 2023-03-03T06:23:53.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.879+0000 7f1c214a0700 1 -- 172.21.15.5:0/2851704870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b8720 msgr2=0x7f1c1c06bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.879+0000 7f1c214a0700 1 --2- 172.21.15.5:0/2851704870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b8720 0x7f1c1c06bab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c06b860 tx=0x7f1c0c009b20 comp rx=0 tx=0).stop 2023-03-03T06:23:53.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.879+0000 7f1c214a0700 1 -- 172.21.15.5:0/2851704870 shutdown_connections 2023-03-03T06:23:53.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.879+0000 7f1c214a0700 1 --2- 172.21.15.5:0/2851704870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b8720 0x7f1c1c06bab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.879+0000 7f1c214a0700 1 --2- 172.21.15.5:0/2851704870 >> v2:172.21.15.191:3300/0 conn(0x7f1c1c0cd850 0x7f1c1c160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.879+0000 7f1c214a0700 1 -- 172.21.15.5:0/2851704870 >> 172.21.15.5:0/2851704870 conn(0x7f1c1c0d0590 msgr2=0x7f1c1c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:53.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.879+0000 7f1c214a0700 1 -- 172.21.15.5:0/2851704870 shutdown_connections 2023-03-03T06:23:53.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.879+0000 7f1c214a0700 1 -- 172.21.15.5:0/2851704870 wait complete. 2023-03-03T06:23:53.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.880+0000 7f1c214a0700 1 Processor -- start 2023-03-03T06:23:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.880+0000 7f1c214a0700 1 -- start start 2023-03-03T06:23:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c214a0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c1c06c120 0x7f1c1c1f61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c214a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b8720 0x7f1c1c160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c214a0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c1c0cd850 0x7f1c1c14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c214a0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c1f66f0 con 0x7f1c1c0b8720 2023-03-03T06:23:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c214a0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c15fc70 con 0x7f1c1c0cd850 2023-03-03T06:23:53.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c214a0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c14b8e0 con 0x7f1c1c06c120 2023-03-03T06:23:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c1a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b8720 0x7f1c1c160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c1a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b8720 0x7f1c1c160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41322/0 (socket says 172.21.15.5:41322) 2023-03-03T06:23:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c1a7fc700 1 -- 172.21.15.5:0/1744310976 learned_addr learned my addr 172.21.15.5:0/1744310976 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c1affd700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c1c06c120 0x7f1c1c1f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c1b7fe700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c1c0cd850 0x7f1c1c14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c1a7fc700 1 -- 172.21.15.5:0/1744310976 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c1c06c120 msgr2=0x7f1c1c1f61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c1a7fc700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c1c06c120 0x7f1c1c1f61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c1a7fc700 1 -- 172.21.15.5:0/1744310976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c1c0cd850 msgr2=0x7f1c1c14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c1a7fc700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c1c0cd850 0x7f1c1c14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c1a7fc700 1 -- 172.21.15.5:0/1744310976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c0094a0 con 0x7f1c1c0b8720 2023-03-03T06:23:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c1b7fe700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c1c0cd850 0x7f1c1c14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.881+0000 7f1c1affd700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c1c06c120 0x7f1c1c1f61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.882+0000 7f1c1a7fc700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b8720 0x7f1c1c160580 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000e7e0 tx=0x7f1c1000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:53.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.882+0000 7f1c037fe700 1 -- 172.21.15.5:0/1744310976 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10013610 con 0x7f1c1c0b8720 2023-03-03T06:23:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.882+0000 7f1c037fe700 1 -- 172.21.15.5:0/1744310976 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c10013770 con 0x7f1c1c0b8720 2023-03-03T06:23:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.882+0000 7f1c214a0700 1 -- 172.21.15.5:0/1744310976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c0cdcc0 con 0x7f1c1c0b8720 2023-03-03T06:23:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.882+0000 7f1c037fe700 1 -- 172.21.15.5:0/1744310976 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10013ae0 con 0x7f1c1c0b8720 2023-03-03T06:23:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.882+0000 7f1c214a0700 1 -- 172.21.15.5:0/1744310976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c0d29f0 con 0x7f1c1c0b8720 2023-03-03T06:23:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.883+0000 7f1c214a0700 1 -- 172.21.15.5:0/1744310976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c0b8af0 con 0x7f1c1c0b8720 2023-03-03T06:23:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.883+0000 7f1c037fe700 1 -- 172.21.15.5:0/1744310976 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1c10023070 con 0x7f1c1c0b8720 2023-03-03T06:23:53.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.884+0000 7f1c037fe700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1c080682f0 0x7f1c0806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.884+0000 7f1c037fe700 1 -- 172.21.15.5:0/1744310976 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1c10085bd0 con 0x7f1c1c0b8720 2023-03-03T06:23:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.884+0000 7f1c1affd700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1c080682f0 0x7f1c0806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.884+0000 7f1c1affd700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1c080682f0 0x7f1c0806a7a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0090b0 tx=0x7f1c0c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:53.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:53.889+0000 7f1c037fe700 1 -- 172.21.15.5:0/1744310976 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1c10052140 con 0x7f1c1c0b8720 2023-03-03T06:23:54.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.078+0000 7f1c214a0700 1 -- 172.21.15.5:0/1744310976 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1c1c04e6e0 con 0x7f1c1c0b8720 2023-03-03T06:23:54.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.078+0000 7f1c037fe700 1 -- 172.21.15.5:0/1744310976 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1c10055760 con 0x7f1c1c0b8720 2023-03-03T06:23:54.081 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:23:54.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.081+0000 7f1c214a0700 1 -- 172.21.15.5:0/1744310976 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1c080682f0 msgr2=0x7f1c0806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.081+0000 7f1c214a0700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1c080682f0 0x7f1c0806a7a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0090b0 tx=0x7f1c0c01c040 comp rx=0 tx=0).stop 2023-03-03T06:23:54.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.081+0000 7f1c214a0700 1 -- 172.21.15.5:0/1744310976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b8720 msgr2=0x7f1c1c160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.081+0000 7f1c214a0700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b8720 0x7f1c1c160580 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000e7e0 tx=0x7f1c1000eba0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.081+0000 7f1c214a0700 1 -- 172.21.15.5:0/1744310976 shutdown_connections 2023-03-03T06:23:54.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.081+0000 7f1c214a0700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c1c0cd850 0x7f1c1c14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.081+0000 7f1c214a0700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1c080682f0 0x7f1c0806a7a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.081+0000 7f1c214a0700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c1c06c120 0x7f1c1c1f61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.081+0000 7f1c214a0700 1 --2- 172.21.15.5:0/1744310976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c0b8720 0x7f1c1c160580 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.081+0000 7f1c214a0700 1 -- 172.21.15.5:0/1744310976 >> 172.21.15.5:0/1744310976 conn(0x7f1c1c0d0590 msgr2=0x7f1c1c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.081+0000 7f1c214a0700 1 -- 172.21.15.5:0/1744310976 shutdown_connections 2023-03-03T06:23:54.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.081+0000 7f1c214a0700 1 -- 172.21.15.5:0/1744310976 wait complete. 2023-03-03T06:23:54.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:23:54.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.220+0000 7f96229ab700 1 Processor -- start 2023-03-03T06:23:54.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.220+0000 7f96229ab700 1 -- start start 2023-03-03T06:23:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.221+0000 7f96229ab700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f961c15a460 0x7f961c0cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.221+0000 7f96229ab700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f961c0cdf70 0x7f961c0cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.221+0000 7f96229ab700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961c0cd650 con 0x7f961c15a830 2023-03-03T06:23:54.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.221+0000 7f96229ab700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961c0cb4a0 con 0x7f961c15a460 2023-03-03T06:23:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.221+0000 7f96229ab700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0d16a0 con 0x7f961c0cdf70 2023-03-03T06:23:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.221+0000 7f961b7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f961c15a830 0x7f961c0cd860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59404/0 (socket says 172.21.15.5:59404) 2023-03-03T06:23:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.221+0000 7f961b7fe700 1 -- 172.21.15.5:0/43676251 learned_addr learned my addr 172.21.15.5:0/43676251 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.222+0000 7f9620f48700 1 --2- 172.21.15.5:0/43676251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f961c0cdf70 0x7f961c0cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.222+0000 7f961bfff700 1 --2- 172.21.15.5:0/43676251 >> v2:172.21.15.191:3300/0 conn(0x7f961c15a460 0x7f961c0cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.222+0000 7f961affd700 1 -- 172.21.15.5:0/43676251 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347449589 0 0) 0x7f961c0cd650 con 0x7f961c15a830 2023-03-03T06:23:54.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.222+0000 7f961affd700 1 -- 172.21.15.5:0/43676251 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96080035b0 con 0x7f961c15a830 2023-03-03T06:23:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.222+0000 7f9620f48700 1 -- 172.21.15.5:0/43676251 >> v2:172.21.15.191:3300/0 conn(0x7f961c15a460 msgr2=0x7f961c0cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.222+0000 7f9620f48700 1 --2- 172.21.15.5:0/43676251 >> v2:172.21.15.191:3300/0 conn(0x7f961c15a460 0x7f961c0cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.222+0000 7f9620f48700 1 -- 172.21.15.5:0/43676251 >> v1:172.21.15.5:6789/0 conn(0x7f961c15a830 legacy=0x7f961c0cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.222+0000 7f9620f48700 1 -- 172.21.15.5:0/43676251 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c0cbc70 con 0x7f961c0cdf70 2023-03-03T06:23:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.222+0000 7f961bfff700 1 --2- 172.21.15.5:0/43676251 >> v2:172.21.15.191:3300/0 conn(0x7f961c15a460 0x7f961c0cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.222+0000 7f9620f48700 1 --2- 172.21.15.5:0/43676251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f961c0cdf70 0x7f961c0cea20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9614009d90 tx=0x7f961400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=310af58648cf81fc server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.222+0000 7f961affd700 1 -- 172.21.15.5:0/43676251 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961400e070 con 0x7f961c0cdf70 2023-03-03T06:23:54.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.222+0000 7f961affd700 1 -- 172.21.15.5:0/43676251 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961400bb20 con 0x7f961c0cdf70 2023-03-03T06:23:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.222+0000 7f961affd700 1 -- 172.21.15.5:0/43676251 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961400be90 con 0x7f961c0cdf70 2023-03-03T06:23:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.223+0000 7f96229ab700 1 -- 172.21.15.5:0/43676251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f961c0cdf70 msgr2=0x7f961c0cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.223+0000 7f96229ab700 1 --2- 172.21.15.5:0/43676251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f961c0cdf70 0x7f961c0cea20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9614009d90 tx=0x7f961400b330 comp rx=0 tx=0).stop 2023-03-03T06:23:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.223+0000 7f96229ab700 1 -- 172.21.15.5:0/43676251 shutdown_connections 2023-03-03T06:23:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.223+0000 7f96229ab700 1 --2- 172.21.15.5:0/43676251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f961c0cdf70 0x7f961c0cea20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.223+0000 7f96229ab700 1 --2- 172.21.15.5:0/43676251 >> v2:172.21.15.191:3300/0 conn(0x7f961c15a460 0x7f961c0cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.223+0000 7f96229ab700 1 -- 172.21.15.5:0/43676251 >> 172.21.15.5:0/43676251 conn(0x7f961c06f3c0 msgr2=0x7f961c06f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:54.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.223+0000 7f96229ab700 1 -- 172.21.15.5:0/43676251 shutdown_connections 2023-03-03T06:23:54.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.223+0000 7f96229ab700 1 -- 172.21.15.5:0/43676251 wait complete. 2023-03-03T06:23:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.224+0000 7f96229ab700 1 Processor -- start 2023-03-03T06:23:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.224+0000 7f96229ab700 1 -- start start 2023-03-03T06:23:54.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f96229ab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c0cdf70 0x7f961c0ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f96229ab700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f961c15a460 0x7f961c1ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f96229ab700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f961c15a830 0x7f961c1f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f96229ab700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0c9f30 con 0x7f961c0cdf70 2023-03-03T06:23:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f96229ab700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0cae80 con 0x7f961c15a460 2023-03-03T06:23:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f96229ab700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0ca4b0 con 0x7f961c15a830 2023-03-03T06:23:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f961bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c0cdf70 0x7f961c0ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f961bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c0cdf70 0x7f961c0ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41336/0 (socket says 172.21.15.5:41336) 2023-03-03T06:23:54.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f961bfff700 1 -- 172.21.15.5:0/4098855321 learned_addr learned my addr 172.21.15.5:0/4098855321 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:54.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f9620f48700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f961c15a830 0x7f961c1f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f961b7fe700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f961c15a460 0x7f961c1ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f961bfff700 1 -- 172.21.15.5:0/4098855321 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f961c15a830 msgr2=0x7f961c1f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f961bfff700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f961c15a830 0x7f961c1f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f961bfff700 1 -- 172.21.15.5:0/4098855321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f961c15a460 msgr2=0x7f961c1ef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.225+0000 7f961bfff700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f961c15a460 0x7f961c1ef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.226+0000 7f961bfff700 1 -- 172.21.15.5:0/4098855321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c0094a0 con 0x7f961c0cdf70 2023-03-03T06:23:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.226+0000 7f961b7fe700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f961c15a460 0x7f961c1ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.226+0000 7f961bfff700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c0cdf70 0x7f961c0ca940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f960c00ec10 tx=0x7f960c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.226+0000 7f9618ff9700 1 -- 172.21.15.5:0/4098855321 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c00c940 con 0x7f961c0cdf70 2023-03-03T06:23:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.226+0000 7f9618ff9700 1 -- 172.21.15.5:0/4098855321 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c00caa0 con 0x7f961c0cdf70 2023-03-03T06:23:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.226+0000 7f96229ab700 1 -- 172.21.15.5:0/4098855321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9614009a70 con 0x7f961c0cdf70 2023-03-03T06:23:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.226+0000 7f9618ff9700 1 -- 172.21.15.5:0/4098855321 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c00ce10 con 0x7f961c0cdf70 2023-03-03T06:23:54.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.226+0000 7f96229ab700 1 -- 172.21.15.5:0/4098855321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961c0cb990 con 0x7f961c0cdf70 2023-03-03T06:23:54.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.227+0000 7f96229ab700 1 -- 172.21.15.5:0/4098855321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961c0cb6b0 con 0x7f961c0cdf70 2023-03-03T06:23:54.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.227+0000 7f9618ff9700 1 -- 172.21.15.5:0/4098855321 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f960c019030 con 0x7f961c0cdf70 2023-03-03T06:23:54.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.228+0000 7f9618ff9700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f95fc0682f0 0x7f95fc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.228+0000 7f9618ff9700 1 -- 172.21.15.5:0/4098855321 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f960c085fb0 con 0x7f961c0cdf70 2023-03-03T06:23:54.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.228+0000 7f961b7fe700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f95fc0682f0 0x7f95fc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.228+0000 7f961b7fe700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f95fc0682f0 0x7f95fc06a7a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f961c159240 tx=0x7f9604009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:54.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.232+0000 7f9618ff9700 1 -- 172.21.15.5:0/4098855321 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f960c052520 con 0x7f961c0cdf70 2023-03-03T06:23:54.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.423+0000 7f96229ab700 1 -- 172.21.15.5:0/4098855321 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f961c0d1940 con 0x7f961c0cdf70 2023-03-03T06:23:54.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.424+0000 7f9618ff9700 1 -- 172.21.15.5:0/4098855321 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f960c0170a0 con 0x7f961c0cdf70 2023-03-03T06:23:54.425 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:23:54.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.425+0000 7f96229ab700 1 -- 172.21.15.5:0/4098855321 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f95fc0682f0 msgr2=0x7f95fc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.425+0000 7f96229ab700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f95fc0682f0 0x7f95fc06a7a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f961c159240 tx=0x7f9604009040 comp rx=0 tx=0).stop 2023-03-03T06:23:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.425+0000 7f96229ab700 1 -- 172.21.15.5:0/4098855321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c0cdf70 msgr2=0x7f961c0ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.425+0000 7f96229ab700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c0cdf70 0x7f961c0ca940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f960c00ec10 tx=0x7f960c009ec0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.425+0000 7f96229ab700 1 -- 172.21.15.5:0/4098855321 shutdown_connections 2023-03-03T06:23:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.426+0000 7f96229ab700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f95fc0682f0 0x7f95fc06a7a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.426+0000 7f96229ab700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f961c15a830 0x7f961c1f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.426+0000 7f96229ab700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f961c0cdf70 0x7f961c0ca940 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.426+0000 7f96229ab700 1 --2- 172.21.15.5:0/4098855321 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f961c15a460 0x7f961c1ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.426+0000 7f96229ab700 1 -- 172.21.15.5:0/4098855321 >> 172.21.15.5:0/4098855321 conn(0x7f961c06f3c0 msgr2=0x7f961c0d0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.426+0000 7f96229ab700 1 -- 172.21.15.5:0/4098855321 shutdown_connections 2023-03-03T06:23:54.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.426+0000 7f96229ab700 1 -- 172.21.15.5:0/4098855321 wait complete. 2023-03-03T06:23:54.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:23:54.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.565+0000 7f4fc47da700 1 Processor -- start 2023-03-03T06:23:54.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.565+0000 7f4fc47da700 1 -- start start 2023-03-03T06:23:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.566+0000 7f4fc47da700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4fbc06d580 0x7f4fbc06da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc47da700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fbc0c9f70 con 0x7f4fbc15e230 2023-03-03T06:23:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc47da700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fbc0b2a10 con 0x7f4fbc15a8d0 2023-03-03T06:23:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc47da700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc06df40 con 0x7f4fbc06d580 2023-03-03T06:23:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc1d75700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4fbc15e230 0x7f4fbc0b2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59420/0 (socket says 172.21.15.5:59420) 2023-03-03T06:23:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc1d75700 1 -- 172.21.15.5:0/1921388032 learned_addr learned my addr 172.21.15.5:0/1921388032 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:54.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc2d77700 1 --2- 172.21.15.5:0/1921388032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4fbc06d580 0x7f4fbc06da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc1574700 1 -- 172.21.15.5:0/1921388032 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012150961 0 0) 0x7f4fbc0c9f70 con 0x7f4fbc15e230 2023-03-03T06:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc1574700 1 -- 172.21.15.5:0/1921388032 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fa80035b0 con 0x7f4fbc15e230 2023-03-03T06:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc1574700 1 -- 172.21.15.5:0/1921388032 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268236091 0 0) 0x7f4fbc0b2a10 con 0x7f4fbc15a8d0 2023-03-03T06:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc1574700 1 -- 172.21.15.5:0/1921388032 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fbc0c9f70 con 0x7f4fbc15a8d0 2023-03-03T06:23:54.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc2d77700 1 -- 172.21.15.5:0/1921388032 >> v1:172.21.15.191:6789/0 conn(0x7f4fbc15a8d0 legacy=0x7f4fbc0cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc2d77700 1 -- 172.21.15.5:0/1921388032 >> v1:172.21.15.5:6789/0 conn(0x7f4fbc15e230 legacy=0x7f4fbc0b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc2d77700 1 -- 172.21.15.5:0/1921388032 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc15e7a0 con 0x7f4fbc06d580 2023-03-03T06:23:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.567+0000 7f4fc2d77700 1 --2- 172.21.15.5:0/1921388032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4fbc06d580 0x7f4fbc06da00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009dc0 tx=0x7f4fb400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5dbc03ba4e75f24 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.568+0000 7f4fc1574700 1 -- 172.21.15.5:0/1921388032 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb400e070 con 0x7f4fbc06d580 2023-03-03T06:23:54.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.568+0000 7f4fc1574700 1 -- 172.21.15.5:0/1921388032 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb400bb20 con 0x7f4fbc06d580 2023-03-03T06:23:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.568+0000 7f4fc1574700 1 -- 172.21.15.5:0/1921388032 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4012430 con 0x7f4fbc06d580 2023-03-03T06:23:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.568+0000 7f4fc47da700 1 -- 172.21.15.5:0/1921388032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4fbc06d580 msgr2=0x7f4fbc06da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.568+0000 7f4fc47da700 1 --2- 172.21.15.5:0/1921388032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4fbc06d580 0x7f4fbc06da00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009dc0 tx=0x7f4fb400b330 comp rx=0 tx=0).stop 2023-03-03T06:23:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.568+0000 7f4fc47da700 1 -- 172.21.15.5:0/1921388032 shutdown_connections 2023-03-03T06:23:54.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.568+0000 7f4fc47da700 1 --2- 172.21.15.5:0/1921388032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4fbc06d580 0x7f4fbc06da00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.568+0000 7f4fc47da700 1 -- 172.21.15.5:0/1921388032 >> 172.21.15.5:0/1921388032 conn(0x7f4fbc0cf4b0 msgr2=0x7f4fbc0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:54.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.568+0000 7f4fc47da700 1 -- 172.21.15.5:0/1921388032 shutdown_connections 2023-03-03T06:23:54.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.568+0000 7f4fc47da700 1 -- 172.21.15.5:0/1921388032 wait complete. 2023-03-03T06:23:54.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.569+0000 7f4fc47da700 1 Processor -- start 2023-03-03T06:23:54.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.569+0000 7f4fc47da700 1 -- start start 2023-03-03T06:23:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.570+0000 7f4fc47da700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4fbc06d580 0x7f4fbc0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.570+0000 7f4fc47da700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4fbc15a8d0 0x7f4fbc14f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.570+0000 7f4fc47da700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fbc15e230 0x7f4fbc0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.570+0000 7f4fc47da700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc0ae460 con 0x7f4fbc15e230 2023-03-03T06:23:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.570+0000 7f4fc47da700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc15db10 con 0x7f4fbc06d580 2023-03-03T06:23:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.570+0000 7f4fc47da700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc15b0f0 con 0x7f4fbc15a8d0 2023-03-03T06:23:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.570+0000 7f4fc2d77700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fbc15e230 0x7f4fbc0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.570+0000 7f4fc2d77700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fbc15e230 0x7f4fbc0af420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41352/0 (socket says 172.21.15.5:41352) 2023-03-03T06:23:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.570+0000 7f4fc2d77700 1 -- 172.21.15.5:0/960803266 learned_addr learned my addr 172.21.15.5:0/960803266 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.570+0000 7f4fc2576700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4fbc06d580 0x7f4fbc0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.570+0000 7f4fc1d75700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4fbc15a8d0 0x7f4fbc14f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.570+0000 7f4fc2d77700 1 -- 172.21.15.5:0/960803266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4fbc15a8d0 msgr2=0x7f4fbc14f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.570+0000 7f4fc2d77700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4fbc15a8d0 0x7f4fbc14f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.571+0000 7f4fc2d77700 1 -- 172.21.15.5:0/960803266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4fbc06d580 msgr2=0x7f4fbc0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.571+0000 7f4fc2d77700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4fbc06d580 0x7f4fbc0adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.571+0000 7f4fc2d77700 1 -- 172.21.15.5:0/960803266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb4009a70 con 0x7f4fbc15e230 2023-03-03T06:23:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.571+0000 7f4fc2d77700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fbc15e230 0x7f4fbc0af420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc06cfe0 tx=0x7f4fb4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.571+0000 7f4faeffd700 1 -- 172.21.15.5:0/960803266 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4012430 con 0x7f4fbc15e230 2023-03-03T06:23:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.571+0000 7f4faeffd700 1 -- 172.21.15.5:0/960803266 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb4020070 con 0x7f4fbc15e230 2023-03-03T06:23:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.571+0000 7f4fc47da700 1 -- 172.21.15.5:0/960803266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc15ed60 con 0x7f4fbc15e230 2023-03-03T06:23:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.571+0000 7f4faeffd700 1 -- 172.21.15.5:0/960803266 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb401ba90 con 0x7f4fbc15e230 2023-03-03T06:23:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.571+0000 7f4fc47da700 1 -- 172.21.15.5:0/960803266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc15ea80 con 0x7f4fbc15e230 2023-03-03T06:23:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.572+0000 7f4fc47da700 1 -- 172.21.15.5:0/960803266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fbc15f040 con 0x7f4fbc15e230 2023-03-03T06:23:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.572+0000 7f4faeffd700 1 -- 172.21.15.5:0/960803266 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4fb402e070 con 0x7f4fbc15e230 2023-03-03T06:23:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.573+0000 7f4faeffd700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4fa00682f0 0x7f4fa006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.573+0000 7f4faeffd700 1 -- 172.21.15.5:0/960803266 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4fb4022070 con 0x7f4fbc15e230 2023-03-03T06:23:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.573+0000 7f4fc2576700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4fa00682f0 0x7f4fa006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.573+0000 7f4fc2576700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4fa00682f0 0x7f4fa006a7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80011e0 tx=0x7f4fb8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:54.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.577+0000 7f4faeffd700 1 -- 172.21.15.5:0/960803266 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4fb4054390 con 0x7f4fbc15e230 2023-03-03T06:23:54.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.770+0000 7f4fc47da700 1 -- 172.21.15.5:0/960803266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4fbc04e6e0 con 0x7f4fbc15e230 2023-03-03T06:23:54.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.770+0000 7f4faeffd700 1 -- 172.21.15.5:0/960803266 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fb402c020 con 0x7f4fbc15e230 2023-03-03T06:23:54.772 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:23:54.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.772+0000 7f4fc47da700 1 -- 172.21.15.5:0/960803266 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4fa00682f0 msgr2=0x7f4fa006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.772+0000 7f4fc47da700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4fa00682f0 0x7f4fa006a7a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80011e0 tx=0x7f4fb8009040 comp rx=0 tx=0).stop 2023-03-03T06:23:54.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.772+0000 7f4fc47da700 1 -- 172.21.15.5:0/960803266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fbc15e230 msgr2=0x7f4fbc0af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.772+0000 7f4fc47da700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fbc15e230 0x7f4fbc0af420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc06cfe0 tx=0x7f4fb4004ad0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.772+0000 7f4fc47da700 1 -- 172.21.15.5:0/960803266 shutdown_connections 2023-03-03T06:23:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.772+0000 7f4fc47da700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fbc15e230 0x7f4fbc0af420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.772+0000 7f4fc47da700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4fbc06d580 0x7f4fbc0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.772+0000 7f4fc47da700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4fa00682f0 0x7f4fa006a7a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.772+0000 7f4fc47da700 1 --2- 172.21.15.5:0/960803266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4fbc15a8d0 0x7f4fbc14f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.772+0000 7f4fc47da700 1 -- 172.21.15.5:0/960803266 >> 172.21.15.5:0/960803266 conn(0x7f4fbc0cf4b0 msgr2=0x7f4fbc0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:54.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.772+0000 7f4fc47da700 1 -- 172.21.15.5:0/960803266 shutdown_connections 2023-03-03T06:23:54.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.772+0000 7f4fc47da700 1 -- 172.21.15.5:0/960803266 wait complete. 2023-03-03T06:23:54.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:23:54.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.911+0000 7f5f59eae700 1 Processor -- start 2023-03-03T06:23:54.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.911+0000 7f5f59eae700 1 -- start start 2023-03-03T06:23:54.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.912+0000 7f5f59eae700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f54158f30 0x7f5f5406a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.912+0000 7f5f59eae700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f540cd080 0x7f5f540cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.912+0000 7f5f59eae700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5415d740 con 0x7f5f5406d580 2023-03-03T06:23:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.912+0000 7f5f59eae700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5415c850 con 0x7f5f540cd080 2023-03-03T06:23:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.912+0000 7f5f59eae700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5415cb30 con 0x7f5f54158f30 2023-03-03T06:23:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.912+0000 7f5f52ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f540cd080 0x7f5f540cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.912+0000 7f5f52ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f540cd080 0x7f5f540cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41358/0 (socket says 172.21.15.5:41358) 2023-03-03T06:23:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.912+0000 7f5f53fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5f5406d580 0x7f5f540714c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59434/0 (socket says 172.21.15.5:59434) 2023-03-03T06:23:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.912+0000 7f5f52ffd700 1 -- 172.21.15.5:0/3989574252 learned_addr learned my addr 172.21.15.5:0/3989574252 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.912+0000 7f5f537fe700 1 --2- 172.21.15.5:0/3989574252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f54158f30 0x7f5f5406a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f52ffd700 1 -- 172.21.15.5:0/3989574252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f54158f30 msgr2=0x7f5f5406a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f52ffd700 1 --2- 172.21.15.5:0/3989574252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f54158f30 0x7f5f5406a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f52ffd700 1 -- 172.21.15.5:0/3989574252 >> v1:172.21.15.5:6789/0 conn(0x7f5f5406d580 legacy=0x7f5f540714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f52ffd700 1 -- 172.21.15.5:0/3989574252 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5415ce10 con 0x7f5f540cd080 2023-03-03T06:23:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f527fc700 1 -- 172.21.15.5:0/3989574252 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066013286 0 0) 0x7f5f5415d740 con 0x7f5f5406d580 2023-03-03T06:23:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f52ffd700 1 --2- 172.21.15.5:0/3989574252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f540cd080 0x7f5f540cd4f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0098f0 tx=0x7f5f3c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb8d04b60033770 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f527fc700 1 -- 172.21.15.5:0/3989574252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c011830 con 0x7f5f540cd080 2023-03-03T06:23:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f527fc700 1 -- 172.21.15.5:0/3989574252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c011990 con 0x7f5f540cd080 2023-03-03T06:23:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f527fc700 1 -- 172.21.15.5:0/3989574252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c011d20 con 0x7f5f540cd080 2023-03-03T06:23:54.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f59eae700 1 -- 172.21.15.5:0/3989574252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f540cd080 msgr2=0x7f5f540cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f59eae700 1 --2- 172.21.15.5:0/3989574252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f540cd080 0x7f5f540cd4f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0098f0 tx=0x7f5f3c009c00 comp rx=0 tx=0).stop 2023-03-03T06:23:54.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f59eae700 1 -- 172.21.15.5:0/3989574252 shutdown_connections 2023-03-03T06:23:54.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f59eae700 1 --2- 172.21.15.5:0/3989574252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f54158f30 0x7f5f5406a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f59eae700 1 --2- 172.21.15.5:0/3989574252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f540cd080 0x7f5f540cd4f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f59eae700 1 -- 172.21.15.5:0/3989574252 >> 172.21.15.5:0/3989574252 conn(0x7f5f540cf4b0 msgr2=0x7f5f540cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:54.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.913+0000 7f5f59eae700 1 -- 172.21.15.5:0/3989574252 shutdown_connections 2023-03-03T06:23:54.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.914+0000 7f5f59eae700 1 -- 172.21.15.5:0/3989574252 wait complete. 2023-03-03T06:23:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.915+0000 7f5f59eae700 1 Processor -- start 2023-03-03T06:23:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.915+0000 7f5f59eae700 1 -- start start 2023-03-03T06:23:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f59eae700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f5406d580 0x7f5f541f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f59eae700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f540cd080 0x7f5f540ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f59eae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f54158f30 0x7f5f541f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f59eae700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f541f6390 con 0x7f5f54158f30 2023-03-03T06:23:54.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f59eae700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f541f6670 con 0x7f5f540cd080 2023-03-03T06:23:54.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f59eae700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f541f6950 con 0x7f5f5406d580 2023-03-03T06:23:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f53fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f54158f30 0x7f5f541f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f53fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f54158f30 0x7f5f541f2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41366/0 (socket says 172.21.15.5:41366) 2023-03-03T06:23:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f53fff700 1 -- 172.21.15.5:0/3799733641 learned_addr learned my addr 172.21.15.5:0/3799733641 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:54.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f537fe700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f5406d580 0x7f5f541f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f52ffd700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f540cd080 0x7f5f540ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f53fff700 1 -- 172.21.15.5:0/3799733641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f5406d580 msgr2=0x7f5f541f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f53fff700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f5406d580 0x7f5f541f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f53fff700 1 -- 172.21.15.5:0/3799733641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f540cd080 msgr2=0x7f5f540ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:54.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f53fff700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f540cd080 0x7f5f540ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f53fff700 1 -- 172.21.15.5:0/3799733641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c009550 con 0x7f5f54158f30 2023-03-03T06:23:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f53fff700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f54158f30 0x7f5f541f2d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c002230 tx=0x7f5f4c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f4bfff700 1 -- 172.21.15.5:0/3799733641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c00ac20 con 0x7f5f54158f30 2023-03-03T06:23:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f4bfff700 1 -- 172.21.15.5:0/3799733641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c00ada0 con 0x7f5f54158f30 2023-03-03T06:23:54.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f59eae700 1 -- 172.21.15.5:0/3799733641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5415d3d0 con 0x7f5f54158f30 2023-03-03T06:23:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.916+0000 7f5f4bfff700 1 -- 172.21.15.5:0/3799733641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c007310 con 0x7f5f54158f30 2023-03-03T06:23:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.917+0000 7f5f59eae700 1 -- 172.21.15.5:0/3799733641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5415d0f0 con 0x7f5f54158f30 2023-03-03T06:23:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.917+0000 7f5f59eae700 1 -- 172.21.15.5:0/3799733641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f5404e6e0 con 0x7f5f54158f30 2023-03-03T06:23:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.918+0000 7f5f4bfff700 1 -- 172.21.15.5:0/3799733641 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5f4c01a030 con 0x7f5f54158f30 2023-03-03T06:23:54.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.918+0000 7f5f4bfff700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f340682f0 0x7f5f3406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.918+0000 7f5f4bfff700 1 -- 172.21.15.5:0/3799733641 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5f4c085d40 con 0x7f5f54158f30 2023-03-03T06:23:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.918+0000 7f5f537fe700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f340682f0 0x7f5f3406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:54.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.919+0000 7f5f537fe700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f340682f0 0x7f5f3406a7a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009ad0 tx=0x7f5f44008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:54.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:54.922+0000 7f5f4bfff700 1 -- 172.21.15.5:0/3799733641 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5f4c0522b0 con 0x7f5f54158f30 2023-03-03T06:23:55.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.114+0000 7f5f59eae700 1 -- 172.21.15.5:0/3799733641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f5406b050 con 0x7f5f54158f30 2023-03-03T06:23:55.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.115+0000 7f5f4bfff700 1 -- 172.21.15.5:0/3799733641 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f4c0180a0 con 0x7f5f54158f30 2023-03-03T06:23:55.116 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:23:55.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.116+0000 7f5f59eae700 1 -- 172.21.15.5:0/3799733641 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f340682f0 msgr2=0x7f5f3406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.116+0000 7f5f59eae700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f340682f0 0x7f5f3406a7a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009ad0 tx=0x7f5f44008040 comp rx=0 tx=0).stop 2023-03-03T06:23:55.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.117+0000 7f5f59eae700 1 -- 172.21.15.5:0/3799733641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f54158f30 msgr2=0x7f5f541f2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.117+0000 7f5f59eae700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f54158f30 0x7f5f541f2d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c002230 tx=0x7f5f4c00a060 comp rx=0 tx=0).stop 2023-03-03T06:23:55.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.117+0000 7f5f59eae700 1 -- 172.21.15.5:0/3799733641 shutdown_connections 2023-03-03T06:23:55.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.117+0000 7f5f59eae700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f54158f30 0x7f5f541f2d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.117+0000 7f5f59eae700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f340682f0 0x7f5f3406a7a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.117+0000 7f5f59eae700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f5406d580 0x7f5f541f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.117+0000 7f5f59eae700 1 --2- 172.21.15.5:0/3799733641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f540cd080 0x7f5f540ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.117+0000 7f5f59eae700 1 -- 172.21.15.5:0/3799733641 >> 172.21.15.5:0/3799733641 conn(0x7f5f540cf4b0 msgr2=0x7f5f540c5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:55.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.117+0000 7f5f59eae700 1 -- 172.21.15.5:0/3799733641 shutdown_connections 2023-03-03T06:23:55.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.117+0000 7f5f59eae700 1 -- 172.21.15.5:0/3799733641 wait complete. 2023-03-03T06:23:55.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-03T06:23:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.256+0000 7f8cbee84700 1 Processor -- start 2023-03-03T06:23:55.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.256+0000 7f8cbee84700 1 -- start start 2023-03-03T06:23:55.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.257+0000 7f8cbee84700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb80cd3e0 0x7f8cb80cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:55.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.257+0000 7f8cbee84700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb815e160 con 0x7f8cb80b1fe0 2023-03-03T06:23:55.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.257+0000 7f8cbee84700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb815d110 con 0x7f8cb815cd40 2023-03-03T06:23:55.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.257+0000 7f8cbee84700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80cd870 con 0x7f8cb80cd3e0 2023-03-03T06:23:55.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.257+0000 7f8cbd421700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8cb80b1fe0 0x7f8cb80ce290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59448/0 (socket says 172.21.15.5:59448) 2023-03-03T06:23:55.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.257+0000 7f8cbd421700 1 -- 172.21.15.5:0/3284775966 learned_addr learned my addr 172.21.15.5:0/3284775966 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:55.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.257+0000 7f8cb7fff700 1 --2- 172.21.15.5:0/3284775966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb80cd3e0 0x7f8cb80cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:55.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.257+0000 7f8cb77fe700 1 -- 172.21.15.5:0/3284775966 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332597695 0 0) 0x7f8cb815e160 con 0x7f8cb80b1fe0 2023-03-03T06:23:55.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.257+0000 7f8cb77fe700 1 -- 172.21.15.5:0/3284775966 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ca80035b0 con 0x7f8cb80b1fe0 2023-03-03T06:23:55.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.257+0000 7f8cb77fe700 1 -- 172.21.15.5:0/3284775966 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982716792 0 0) 0x7f8cb815d110 con 0x7f8cb815cd40 2023-03-03T06:23:55.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.257+0000 7f8cb7fff700 1 -- 172.21.15.5:0/3284775966 >> v1:172.21.15.191:6789/0 conn(0x7f8cb815cd40 legacy=0x7f8cb80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.257+0000 7f8cb7fff700 1 -- 172.21.15.5:0/3284775966 >> v1:172.21.15.5:6789/0 conn(0x7f8cb80b1fe0 legacy=0x7f8cb80ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.257+0000 7f8cb7fff700 1 -- 172.21.15.5:0/3284775966 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb815d3c0 con 0x7f8cb80cd3e0 2023-03-03T06:23:55.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.258+0000 7f8cb7fff700 1 --2- 172.21.15.5:0/3284775966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb80cd3e0 0x7f8cb80cdd50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009870 tx=0x7f8ca4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9e702b6532ca613 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:55.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.258+0000 7f8cb77fe700 1 -- 172.21.15.5:0/3284775966 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4011830 con 0x7f8cb80cd3e0 2023-03-03T06:23:55.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.258+0000 7f8cb77fe700 1 -- 172.21.15.5:0/3284775966 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4011990 con 0x7f8cb80cd3e0 2023-03-03T06:23:55.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.258+0000 7f8cb77fe700 1 -- 172.21.15.5:0/3284775966 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4011d20 con 0x7f8cb80cd3e0 2023-03-03T06:23:55.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.258+0000 7f8cbee84700 1 -- 172.21.15.5:0/3284775966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb80cd3e0 msgr2=0x7f8cb80cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.258+0000 7f8cbee84700 1 --2- 172.21.15.5:0/3284775966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb80cd3e0 0x7f8cb80cdd50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009870 tx=0x7f8ca4009b80 comp rx=0 tx=0).stop 2023-03-03T06:23:55.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.258+0000 7f8cbee84700 1 -- 172.21.15.5:0/3284775966 shutdown_connections 2023-03-03T06:23:55.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.258+0000 7f8cbee84700 1 --2- 172.21.15.5:0/3284775966 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb80cd3e0 0x7f8cb80cdd50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.258+0000 7f8cbee84700 1 -- 172.21.15.5:0/3284775966 >> 172.21.15.5:0/3284775966 conn(0x7f8cb80cc8d0 msgr2=0x7f8cb80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.258+0000 7f8cbee84700 1 -- 172.21.15.5:0/3284775966 shutdown_connections 2023-03-03T06:23:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.258+0000 7f8cbee84700 1 -- 172.21.15.5:0/3284775966 wait complete. 2023-03-03T06:23:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.260+0000 7f8cbee84700 1 Processor -- start 2023-03-03T06:23:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.260+0000 7f8cbee84700 1 -- start start 2023-03-03T06:23:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.260+0000 7f8cbee84700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb80b1fe0 0x7f8cb80c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.260+0000 7f8cbee84700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb80cd3e0 0x7f8cb80cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.260+0000 7f8cbee84700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cb815cd40 0x7f8cb8151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.260+0000 7f8cbee84700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80c8b80 con 0x7f8cb815cd40 2023-03-03T06:23:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.260+0000 7f8cbee84700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80c8e60 con 0x7f8cb80cd3e0 2023-03-03T06:23:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.260+0000 7f8cbee84700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80c9140 con 0x7f8cb80b1fe0 2023-03-03T06:23:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cbd421700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cb815cd40 0x7f8cb8151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cbd421700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cb815cd40 0x7f8cb8151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41380/0 (socket says 172.21.15.5:41380) 2023-03-03T06:23:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cbd421700 1 -- 172.21.15.5:0/226581478 learned_addr learned my addr 172.21.15.5:0/226581478 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cbcc20700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb80b1fe0 0x7f8cb80c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cb7fff700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb80cd3e0 0x7f8cb80cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cbd421700 1 -- 172.21.15.5:0/226581478 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb80b1fe0 msgr2=0x7f8cb80c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cbd421700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb80b1fe0 0x7f8cb80c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cbd421700 1 -- 172.21.15.5:0/226581478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb80cd3e0 msgr2=0x7f8cb80cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cbd421700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb80cd3e0 0x7f8cb80cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cbd421700 1 -- 172.21.15.5:0/226581478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca40094a0 con 0x7f8cb815cd40 2023-03-03T06:23:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cbd421700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cb815cd40 0x7f8cb8151f00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000cbb0 tx=0x7f8cb000cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cb57fa700 1 -- 172.21.15.5:0/226581478 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb000a9e0 con 0x7f8cb815cd40 2023-03-03T06:23:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cb57fa700 1 -- 172.21.15.5:0/226581478 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb000ab40 con 0x7f8cb815cd40 2023-03-03T06:23:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cb57fa700 1 -- 172.21.15.5:0/226581478 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0012400 con 0x7f8cb815cd40 2023-03-03T06:23:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cbee84700 1 -- 172.21.15.5:0/226581478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb815d980 con 0x7f8cb815cd40 2023-03-03T06:23:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.261+0000 7f8cbee84700 1 -- 172.21.15.5:0/226581478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb815d6a0 con 0x7f8cb815cd40 2023-03-03T06:23:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.262+0000 7f8cbee84700 1 -- 172.21.15.5:0/226581478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb815dc60 con 0x7f8cb815cd40 2023-03-03T06:23:55.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.263+0000 7f8cb57fa700 1 -- 172.21.15.5:0/226581478 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8cb0019030 con 0x7f8cb815cd40 2023-03-03T06:23:55.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.263+0000 7f8cb57fa700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c9c068320 0x7f8c9c06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:55.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.263+0000 7f8cb57fa700 1 -- 172.21.15.5:0/226581478 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8cb0085a10 con 0x7f8cb815cd40 2023-03-03T06:23:55.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.263+0000 7f8cbcc20700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c9c068320 0x7f8c9c06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:55.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.263+0000 7f8cbcc20700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c9c068320 0x7f8c9c06a7d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8cac000f60 tx=0x7f8cac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:55.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.267+0000 7f8cb57fa700 1 -- 172.21.15.5:0/226581478 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8cb004b5e0 con 0x7f8cb815cd40 2023-03-03T06:23:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.460+0000 7f8cbee84700 1 -- 172.21.15.5:0/226581478 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8cb804e6e0 con 0x7f8cb815cd40 2023-03-03T06:23:55.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.460+0000 7f8cb57fa700 1 -- 172.21.15.5:0/226581478 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8cb0052030 con 0x7f8cb815cd40 2023-03-03T06:23:55.462 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:23:55.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.462+0000 7f8cbee84700 1 -- 172.21.15.5:0/226581478 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c9c068320 msgr2=0x7f8c9c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.462+0000 7f8cbee84700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c9c068320 0x7f8c9c06a7d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8cac000f60 tx=0x7f8cac009040 comp rx=0 tx=0).stop 2023-03-03T06:23:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.462+0000 7f8cbee84700 1 -- 172.21.15.5:0/226581478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cb815cd40 msgr2=0x7f8cb8151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.462+0000 7f8cbee84700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cb815cd40 0x7f8cb8151f00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000cbb0 tx=0x7f8cb000cec0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.462+0000 7f8cbee84700 1 -- 172.21.15.5:0/226581478 shutdown_connections 2023-03-03T06:23:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.462+0000 7f8cbee84700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cb815cd40 0x7f8cb8151f00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.462+0000 7f8cbee84700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c9c068320 0x7f8c9c06a7d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.462+0000 7f8cbee84700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8cb80b1fe0 0x7f8cb80c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.462+0000 7f8cbee84700 1 --2- 172.21.15.5:0/226581478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8cb80cd3e0 0x7f8cb80cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.462+0000 7f8cbee84700 1 -- 172.21.15.5:0/226581478 >> 172.21.15.5:0/226581478 conn(0x7f8cb80cc8d0 msgr2=0x7f8cb806b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:55.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.462+0000 7f8cbee84700 1 -- 172.21.15.5:0/226581478 shutdown_connections 2023-03-03T06:23:55.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.462+0000 7f8cbee84700 1 -- 172.21.15.5:0/226581478 wait complete. 2023-03-03T06:23:55.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-03T06:23:55.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.600+0000 7fea1e891700 1 Processor -- start 2023-03-03T06:23:55.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.600+0000 7fea1e891700 1 -- start start 2023-03-03T06:23:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.601+0000 7fea1e891700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea1815a480 0x7fea180d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.601+0000 7fea1e891700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fea1815a850 0x7fea180b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.601+0000 7fea1e891700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea180cb4a0 0x7fea180cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:55.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.601+0000 7fea1e891700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180cf2a0 con 0x7fea1815a480 2023-03-03T06:23:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.601+0000 7fea1e891700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180cbcd0 con 0x7fea1815a850 2023-03-03T06:23:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.601+0000 7fea1e891700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea180cb9f0 con 0x7fea180cb4a0 2023-03-03T06:23:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.601+0000 7fea17fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea1815a480 0x7fea180d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.601+0000 7fea17fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea1815a480 0x7fea180d1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41384/0 (socket says 172.21.15.5:41384) 2023-03-03T06:23:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.601+0000 7fea17fff700 1 -- 172.21.15.5:0/2091531018 learned_addr learned my addr 172.21.15.5:0/2091531018 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.601+0000 7fea1ce2e700 1 --2- 172.21.15.5:0/2091531018 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea180cb4a0 0x7fea180cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.602+0000 7fea177fe700 1 --2- 172.21.15.5:0/2091531018 >> v2:172.21.15.191:3300/0 conn(0x7fea1815a850 0x7fea180b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:55.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.602+0000 7fea17fff700 1 -- 172.21.15.5:0/2091531018 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea180cb4a0 msgr2=0x7fea180cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.602+0000 7fea17fff700 1 --2- 172.21.15.5:0/2091531018 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea180cb4a0 0x7fea180cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.602+0000 7fea17fff700 1 -- 172.21.15.5:0/2091531018 >> v2:172.21.15.191:3300/0 conn(0x7fea1815a850 msgr2=0x7fea180b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.602+0000 7fea17fff700 1 --2- 172.21.15.5:0/2091531018 >> v2:172.21.15.191:3300/0 conn(0x7fea1815a850 0x7fea180b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.602+0000 7fea17fff700 1 -- 172.21.15.5:0/2091531018 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180cebe0 con 0x7fea1815a480 2023-03-03T06:23:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.602+0000 7fea17fff700 1 --2- 172.21.15.5:0/2091531018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1815a480 0x7fea180d1600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea080098f0 tx=0x7fea08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47610a094a5b631 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.602+0000 7fea16ffd700 1 -- 172.21.15.5:0/2091531018 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800b860 con 0x7fea1815a480 2023-03-03T06:23:55.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.602+0000 7fea16ffd700 1 -- 172.21.15.5:0/2091531018 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0800b9c0 con 0x7fea1815a480 2023-03-03T06:23:55.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.602+0000 7fea16ffd700 1 -- 172.21.15.5:0/2091531018 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800bd50 con 0x7fea1815a480 2023-03-03T06:23:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.602+0000 7fea1e891700 1 -- 172.21.15.5:0/2091531018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1815a480 msgr2=0x7fea180d1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.602+0000 7fea1e891700 1 --2- 172.21.15.5:0/2091531018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1815a480 0x7fea180d1600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea080098f0 tx=0x7fea08009c00 comp rx=0 tx=0).stop 2023-03-03T06:23:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.603+0000 7fea1e891700 1 -- 172.21.15.5:0/2091531018 shutdown_connections 2023-03-03T06:23:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.603+0000 7fea1e891700 1 --2- 172.21.15.5:0/2091531018 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea180cb4a0 0x7fea180cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.603+0000 7fea1e891700 1 --2- 172.21.15.5:0/2091531018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1815a480 0x7fea180d1600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.603+0000 7fea1e891700 1 --2- 172.21.15.5:0/2091531018 >> v2:172.21.15.191:3300/0 conn(0x7fea1815a850 0x7fea180b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.603+0000 7fea1e891700 1 -- 172.21.15.5:0/2091531018 >> 172.21.15.5:0/2091531018 conn(0x7fea1806f3c0 msgr2=0x7fea1806f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.603+0000 7fea1e891700 1 -- 172.21.15.5:0/2091531018 shutdown_connections 2023-03-03T06:23:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.603+0000 7fea1e891700 1 -- 172.21.15.5:0/2091531018 wait complete. 2023-03-03T06:23:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.604+0000 7fea1e891700 1 Processor -- start 2023-03-03T06:23:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.604+0000 7fea1e891700 1 -- start start 2023-03-03T06:23:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea1e891700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea180cb4a0 0x7fea1806d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:55.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea1e891700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1815a480 0x7fea18153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea1e891700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea1815a850 0x7fea180b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea1e891700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18153b90 con 0x7fea1815a480 2023-03-03T06:23:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea1e891700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18155f70 con 0x7fea1815a850 2023-03-03T06:23:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea1e891700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea18156250 con 0x7fea180cb4a0 2023-03-03T06:23:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1815a480 0x7fea18153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1815a480 0x7fea18153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41392/0 (socket says 172.21.15.5:41392) 2023-03-03T06:23:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea177fe700 1 -- 172.21.15.5:0/484440529 learned_addr learned my addr 172.21.15.5:0/484440529 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:55.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea17fff700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea180cb4a0 0x7fea1806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea1ce2e700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea1815a850 0x7fea180b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea177fe700 1 -- 172.21.15.5:0/484440529 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea180cb4a0 msgr2=0x7fea1806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea177fe700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea180cb4a0 0x7fea1806d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea177fe700 1 -- 172.21.15.5:0/484440529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea1815a850 msgr2=0x7fea180b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea177fe700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea1815a850 0x7fea180b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea177fe700 1 -- 172.21.15.5:0/484440529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea08009550 con 0x7fea1815a480 2023-03-03T06:23:55.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea177fe700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1815a480 0x7fea18153650 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00d800 tx=0x7fea0c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.605+0000 7fea14ff9700 1 -- 172.21.15.5:0/484440529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0125f0 con 0x7fea1815a480 2023-03-03T06:23:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.606+0000 7fea14ff9700 1 -- 172.21.15.5:0/484440529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c012750 con 0x7fea1815a480 2023-03-03T06:23:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.606+0000 7fea1e891700 1 -- 172.21.15.5:0/484440529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea180d1b40 con 0x7fea1815a480 2023-03-03T06:23:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.606+0000 7fea14ff9700 1 -- 172.21.15.5:0/484440529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c012b00 con 0x7fea1815a480 2023-03-03T06:23:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.606+0000 7fea1e891700 1 -- 172.21.15.5:0/484440529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea180ceec0 con 0x7fea1815a480 2023-03-03T06:23:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.607+0000 7fea1e891700 1 -- 172.21.15.5:0/484440529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea180d1cd0 con 0x7fea1815a480 2023-03-03T06:23:55.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.607+0000 7fea14ff9700 1 -- 172.21.15.5:0/484440529 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fea0c012c60 con 0x7fea1815a480 2023-03-03T06:23:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.607+0000 7fea14ff9700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea04068320 0x7fea0406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.608+0000 7fea17fff700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea04068320 0x7fea0406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.608+0000 7fea14ff9700 1 -- 172.21.15.5:0/484440529 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fea0c086150 con 0x7fea1815a480 2023-03-03T06:23:55.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.608+0000 7fea17fff700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea04068320 0x7fea0406a7d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fea08009c40 tx=0x7fea08008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:55.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.612+0000 7fea14ff9700 1 -- 172.21.15.5:0/484440529 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fea0c0526c0 con 0x7fea1815a480 2023-03-03T06:23:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.820+0000 7fea1e891700 1 -- 172.21.15.5:0/484440529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fea1804e6e0 con 0x7fea1815a480 2023-03-03T06:23:55.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.820+0000 7fea14ff9700 1 -- 172.21.15.5:0/484440529 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fea0c055ce0 con 0x7fea1815a480 2023-03-03T06:23:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.822+0000 7fea1e891700 1 -- 172.21.15.5:0/484440529 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea04068320 msgr2=0x7fea0406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.822+0000 7fea1e891700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea04068320 0x7fea0406a7d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fea08009c40 tx=0x7fea08008030 comp rx=0 tx=0).stop 2023-03-03T06:23:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.822+0000 7fea1e891700 1 -- 172.21.15.5:0/484440529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1815a480 msgr2=0x7fea18153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.822+0000 7fea1e891700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1815a480 0x7fea18153650 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00d800 tx=0x7fea0c00db10 comp rx=0 tx=0).stop 2023-03-03T06:23:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.822+0000 7fea1e891700 1 -- 172.21.15.5:0/484440529 shutdown_connections 2023-03-03T06:23:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.822+0000 7fea1e891700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea1815a850 0x7fea180b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.822+0000 7fea1e891700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea04068320 0x7fea0406a7d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.822+0000 7fea1e891700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea180cb4a0 0x7fea1806d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.822+0000 7fea1e891700 1 --2- 172.21.15.5:0/484440529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea1815a480 0x7fea18153650 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.822+0000 7fea1e891700 1 -- 172.21.15.5:0/484440529 >> 172.21.15.5:0/484440529 conn(0x7fea1806f3c0 msgr2=0x7fea18158800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.822+0000 7fea1e891700 1 -- 172.21.15.5:0/484440529 shutdown_connections 2023-03-03T06:23:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:55.822+0000 7fea1e891700 1 -- 172.21.15.5:0/484440529 wait complete. 2023-03-03T06:23:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-03-03T06:23:55.835 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2023-03-03T06:23:55.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:55.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-03-03T06:23:55.870 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[104092]: fuse finished with error 0 and tester_r 0 2023-03-03T06:23:55.871 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:23:55.971 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-03-03T06:23:55.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:23:55.972 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-03-03T06:23:56.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:23:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.142+0000 7fc03a480700 1 Processor -- start 2023-03-03T06:23:56.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.142+0000 7fc03a480700 1 -- start start 2023-03-03T06:23:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.143+0000 7fc03a480700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc03415d460 0x7fc0340ca750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.143+0000 7fc03a480700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc034071590 0x7fc034071a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.143+0000 7fc03a480700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc034159100 con 0x7fc034158d30 2023-03-03T06:23:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.143+0000 7fc03a480700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc034071f50 con 0x7fc03415d460 2023-03-03T06:23:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.143+0000 7fc03a480700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0340cac90 con 0x7fc034071590 2023-03-03T06:23:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.143+0000 7fc033fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc034158d30 0x7fc0340cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59472/0 (socket says 172.21.15.5:59472) 2023-03-03T06:23:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.143+0000 7fc033fff700 1 -- 172.21.15.5:0/2487261776 learned_addr learned my addr 172.21.15.5:0/2487261776 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.143+0000 7fc0337fe700 1 --2- 172.21.15.5:0/2487261776 >> v2:172.21.15.5:3300/0 conn(0x7fc03415d460 0x7fc0340ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.144+0000 7fc038a1d700 1 --2- 172.21.15.5:0/2487261776 >> v2:172.21.15.191:3300/0 conn(0x7fc034071590 0x7fc034071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.144+0000 7fc032ffd700 1 -- 172.21.15.5:0/2487261776 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617575146 0 0) 0x7fc034159100 con 0x7fc034158d30 2023-03-03T06:23:56.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.144+0000 7fc032ffd700 1 -- 172.21.15.5:0/2487261776 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0200035b0 con 0x7fc034158d30 2023-03-03T06:23:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.144+0000 7fc0337fe700 1 -- 172.21.15.5:0/2487261776 >> v2:172.21.15.191:3300/0 conn(0x7fc034071590 msgr2=0x7fc034071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.144+0000 7fc0337fe700 1 --2- 172.21.15.5:0/2487261776 >> v2:172.21.15.191:3300/0 conn(0x7fc034071590 0x7fc034071a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.144+0000 7fc0337fe700 1 -- 172.21.15.5:0/2487261776 >> v1:172.21.15.5:6789/0 conn(0x7fc034158d30 legacy=0x7fc0340cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.144+0000 7fc0337fe700 1 -- 172.21.15.5:0/2487261776 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0340cd930 con 0x7fc03415d460 2023-03-03T06:23:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.144+0000 7fc038a1d700 1 --2- 172.21.15.5:0/2487261776 >> v2:172.21.15.191:3300/0 conn(0x7fc034071590 0x7fc034071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.144+0000 7fc0337fe700 1 --2- 172.21.15.5:0/2487261776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc03415d460 0x7fc0340ca750 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc0340cea60 tx=0x7fc01c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187f61b743d38053 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:56.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.144+0000 7fc032ffd700 1 -- 172.21.15.5:0/2487261776 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c011830 con 0x7fc03415d460 2023-03-03T06:23:56.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.144+0000 7fc032ffd700 1 -- 172.21.15.5:0/2487261776 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c011990 con 0x7fc03415d460 2023-03-03T06:23:56.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.144+0000 7fc032ffd700 1 -- 172.21.15.5:0/2487261776 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c011d20 con 0x7fc03415d460 2023-03-03T06:23:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.145+0000 7fc03a480700 1 -- 172.21.15.5:0/2487261776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc03415d460 msgr2=0x7fc0340ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.145+0000 7fc03a480700 1 --2- 172.21.15.5:0/2487261776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc03415d460 0x7fc0340ca750 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc0340cea60 tx=0x7fc01c009b20 comp rx=0 tx=0).stop 2023-03-03T06:23:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.145+0000 7fc03a480700 1 -- 172.21.15.5:0/2487261776 shutdown_connections 2023-03-03T06:23:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.145+0000 7fc03a480700 1 --2- 172.21.15.5:0/2487261776 >> v2:172.21.15.191:3300/0 conn(0x7fc034071590 0x7fc034071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.145+0000 7fc03a480700 1 --2- 172.21.15.5:0/2487261776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc03415d460 0x7fc0340ca750 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.145+0000 7fc03a480700 1 -- 172.21.15.5:0/2487261776 >> 172.21.15.5:0/2487261776 conn(0x7fc0340cec40 msgr2=0x7fc0340cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.145+0000 7fc03a480700 1 -- 172.21.15.5:0/2487261776 shutdown_connections 2023-03-03T06:23:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.145+0000 7fc03a480700 1 -- 172.21.15.5:0/2487261776 wait complete. 2023-03-03T06:23:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.146+0000 7fc03a480700 1 Processor -- start 2023-03-03T06:23:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.146+0000 7fc03a480700 1 -- start start 2023-03-03T06:23:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc03a480700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc034071590 0x7fc034147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc03a480700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc034158d30 0x7fc034150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc03a480700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc03415d460 0x7fc03415b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc03a480700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0341536e0 con 0x7fc034158d30 2023-03-03T06:23:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc03a480700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0340c7310 con 0x7fc034071590 2023-03-03T06:23:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc03a480700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0340c2610 con 0x7fc03415d460 2023-03-03T06:23:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc0337fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc034158d30 0x7fc034150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc0337fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc034158d30 0x7fc034150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41406/0 (socket says 172.21.15.5:41406) 2023-03-03T06:23:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc0337fe700 1 -- 172.21.15.5:0/3849865421 learned_addr learned my addr 172.21.15.5:0/3849865421 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc033fff700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc034071590 0x7fc034147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc038a1d700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc03415d460 0x7fc03415b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc0337fe700 1 -- 172.21.15.5:0/3849865421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc03415d460 msgr2=0x7fc03415b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc0337fe700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc03415d460 0x7fc03415b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc0337fe700 1 -- 172.21.15.5:0/3849865421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc034071590 msgr2=0x7fc034147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc0337fe700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc034071590 0x7fc034147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc0337fe700 1 -- 172.21.15.5:0/3849865421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c0094a0 con 0x7fc034158d30 2023-03-03T06:23:56.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc0337fe700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc034158d30 0x7fc034150bd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc01c000c00 tx=0x7fc01c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:56.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.147+0000 7fc030ff9700 1 -- 172.21.15.5:0/3849865421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0036a0 con 0x7fc034158d30 2023-03-03T06:23:56.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.148+0000 7fc030ff9700 1 -- 172.21.15.5:0/3849865421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01c01e070 con 0x7fc034158d30 2023-03-03T06:23:56.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.148+0000 7fc03a480700 1 -- 172.21.15.5:0/3849865421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0340c9c70 con 0x7fc034158d30 2023-03-03T06:23:56.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.148+0000 7fc030ff9700 1 -- 172.21.15.5:0/3849865421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01c003a60 con 0x7fc034158d30 2023-03-03T06:23:56.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.148+0000 7fc03a480700 1 -- 172.21.15.5:0/3849865421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0340cdba0 con 0x7fc034158d30 2023-03-03T06:23:56.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.149+0000 7fc03a480700 1 -- 172.21.15.5:0/3849865421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0340c9f50 con 0x7fc034158d30 2023-03-03T06:23:56.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.149+0000 7fc030ff9700 1 -- 172.21.15.5:0/3849865421 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc01c00f050 con 0x7fc034158d30 2023-03-03T06:23:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.149+0000 7fc030ff9700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0140682f0 0x7fc01406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.150+0000 7fc030ff9700 1 -- 172.21.15.5:0/3849865421 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc01c087110 con 0x7fc034158d30 2023-03-03T06:23:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.150+0000 7fc033fff700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0140682f0 0x7fc01406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.150+0000 7fc033fff700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0140682f0 0x7fc01406a7a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc0240011e0 tx=0x7fc024009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.154+0000 7fc030ff9700 1 -- 172.21.15.5:0/3849865421 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc01c053510 con 0x7fc034158d30 2023-03-03T06:23:56.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.349+0000 7fc03a480700 1 -- 172.21.15.5:0/3849865421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc03404e6e0 con 0x7fc034158d30 2023-03-03T06:23:56.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.350+0000 7fc030ff9700 1 -- 172.21.15.5:0/3849865421 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7fc01c020090 con 0x7fc034158d30 2023-03-03T06:23:56.352 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:56.352 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:23:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.352+0000 7fc03a480700 1 -- 172.21.15.5:0/3849865421 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0140682f0 msgr2=0x7fc01406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.352+0000 7fc03a480700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0140682f0 0x7fc01406a7a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc0240011e0 tx=0x7fc024009040 comp rx=0 tx=0).stop 2023-03-03T06:23:56.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.352+0000 7fc03a480700 1 -- 172.21.15.5:0/3849865421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc034158d30 msgr2=0x7fc034150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.352+0000 7fc03a480700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc034158d30 0x7fc034150bd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc01c000c00 tx=0x7fc01c004750 comp rx=0 tx=0).stop 2023-03-03T06:23:56.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.353+0000 7fc03a480700 1 -- 172.21.15.5:0/3849865421 shutdown_connections 2023-03-03T06:23:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.353+0000 7fc03a480700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0140682f0 0x7fc01406a7a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.353+0000 7fc03a480700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc03415d460 0x7fc03415b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.353+0000 7fc03a480700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc034071590 0x7fc034147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.353+0000 7fc03a480700 1 --2- 172.21.15.5:0/3849865421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc034158d30 0x7fc034150bd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.353+0000 7fc03a480700 1 -- 172.21.15.5:0/3849865421 >> 172.21.15.5:0/3849865421 conn(0x7fc0340cec40 msgr2=0x7fc0340b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.353+0000 7fc03a480700 1 -- 172.21.15.5:0/3849865421 shutdown_connections 2023-03-03T06:23:56.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.353+0000 7fc03a480700 1 -- 172.21.15.5:0/3849865421 wait complete. 2023-03-03T06:23:56.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:23:56.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.489+0000 7f8367e59700 1 Processor -- start 2023-03-03T06:23:56.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.489+0000 7f8367e59700 1 -- start start 2023-03-03T06:23:56.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f8367e59700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f83600b5130 0x7f83600cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f8367e59700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8360160dc0 0x7f83600b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f8367e59700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836006b5e0 con 0x7f836015c860 2023-03-03T06:23:56.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f8367e59700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8360161310 con 0x7f8360160dc0 2023-03-03T06:23:56.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f8367e59700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83600cd700 con 0x7f83600b5130 2023-03-03T06:23:56.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f83663f6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8360160dc0 0x7f83600b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f8365bf5700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f836015c860 0x7f83600b4a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59486/0 (socket says 172.21.15.5:59486) 2023-03-03T06:23:56.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f8365bf5700 1 -- 172.21.15.5:0/1946920809 learned_addr learned my addr 172.21.15.5:0/1946920809 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:56.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f8364bf3700 1 -- 172.21.15.5:0/1946920809 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218844490 0 0) 0x7f836006b5e0 con 0x7f836015c860 2023-03-03T06:23:56.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f8364bf3700 1 -- 172.21.15.5:0/1946920809 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f834c0035b0 con 0x7f836015c860 2023-03-03T06:23:56.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f83653f4700 1 --2- 172.21.15.5:0/1946920809 >> v2:172.21.15.191:3300/0 conn(0x7f83600b5130 0x7f83600cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f83663f6700 1 -- 172.21.15.5:0/1946920809 >> v2:172.21.15.191:3300/0 conn(0x7f83600b5130 msgr2=0x7f83600cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:56.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f83663f6700 1 --2- 172.21.15.5:0/1946920809 >> v2:172.21.15.191:3300/0 conn(0x7f83600b5130 0x7f83600cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f83663f6700 1 -- 172.21.15.5:0/1946920809 >> v1:172.21.15.5:6789/0 conn(0x7f836015c860 legacy=0x7f83600b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f83663f6700 1 -- 172.21.15.5:0/1946920809 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83600cd9e0 con 0x7f8360160dc0 2023-03-03T06:23:56.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.490+0000 7f83653f4700 1 --2- 172.21.15.5:0/1946920809 >> v2:172.21.15.191:3300/0 conn(0x7f83600b5130 0x7f83600cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:56.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.491+0000 7f83663f6700 1 --2- 172.21.15.5:0/1946920809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360160dc0 0x7f83600b5df0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8360066b40 tx=0x7f835800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c45c7ea41814c5 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:56.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.491+0000 7f8364bf3700 1 -- 172.21.15.5:0/1946920809 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835800e070 con 0x7f8360160dc0 2023-03-03T06:23:56.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.491+0000 7f8364bf3700 1 -- 172.21.15.5:0/1946920809 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835800bb20 con 0x7f8360160dc0 2023-03-03T06:23:56.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.491+0000 7f8364bf3700 1 -- 172.21.15.5:0/1946920809 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358012430 con 0x7f8360160dc0 2023-03-03T06:23:56.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.491+0000 7f8367e59700 1 -- 172.21.15.5:0/1946920809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360160dc0 msgr2=0x7f83600b5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.491+0000 7f8367e59700 1 --2- 172.21.15.5:0/1946920809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360160dc0 0x7f83600b5df0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8360066b40 tx=0x7f835800b330 comp rx=0 tx=0).stop 2023-03-03T06:23:56.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.491+0000 7f8367e59700 1 -- 172.21.15.5:0/1946920809 shutdown_connections 2023-03-03T06:23:56.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.491+0000 7f8367e59700 1 --2- 172.21.15.5:0/1946920809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8360160dc0 0x7f83600b5df0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.491+0000 7f8367e59700 1 --2- 172.21.15.5:0/1946920809 >> v2:172.21.15.191:3300/0 conn(0x7f83600b5130 0x7f83600cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.491+0000 7f8367e59700 1 -- 172.21.15.5:0/1946920809 >> 172.21.15.5:0/1946920809 conn(0x7f83600d3bf0 msgr2=0x7f83600cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:56.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.492+0000 7f8367e59700 1 -- 172.21.15.5:0/1946920809 shutdown_connections 2023-03-03T06:23:56.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.492+0000 7f8367e59700 1 -- 172.21.15.5:0/1946920809 wait complete. 2023-03-03T06:23:56.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.493+0000 7f8367e59700 1 Processor -- start 2023-03-03T06:23:56.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.493+0000 7f8367e59700 1 -- start start 2023-03-03T06:23:56.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.493+0000 7f8367e59700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83600b5130 0x7f836014b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.493+0000 7f8367e59700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f836015c860 0x7f83600ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.493+0000 7f8367e59700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8360160dc0 0x7f836015d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.493+0000 7f8367e59700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836014b990 con 0x7f836015c860 2023-03-03T06:23:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.493+0000 7f8367e59700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83600cbc50 con 0x7f8360160dc0 2023-03-03T06:23:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.493+0000 7f8367e59700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83600cb3b0 con 0x7f83600b5130 2023-03-03T06:23:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f83653f4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f836015c860 0x7f83600ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f83653f4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f836015c860 0x7f83600ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41418/0 (socket says 172.21.15.5:41418) 2023-03-03T06:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f83653f4700 1 -- 172.21.15.5:0/3948320302 learned_addr learned my addr 172.21.15.5:0/3948320302 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f8365bf5700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83600b5130 0x7f836014b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f83663f6700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8360160dc0 0x7f836015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f83653f4700 1 -- 172.21.15.5:0/3948320302 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83600b5130 msgr2=0x7f836014b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f83653f4700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83600b5130 0x7f836014b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f83653f4700 1 -- 172.21.15.5:0/3948320302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8360160dc0 msgr2=0x7f836015d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f83653f4700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8360160dc0 0x7f836015d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f83653f4700 1 -- 172.21.15.5:0/3948320302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8358009a70 con 0x7f836015c860 2023-03-03T06:23:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f83653f4700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f836015c860 0x7f83600ca9f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f835400c7f0 tx=0x7f835400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f83527fc700 1 -- 172.21.15.5:0/3948320302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354011800 con 0x7f836015c860 2023-03-03T06:23:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f83527fc700 1 -- 172.21.15.5:0/3948320302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8354011960 con 0x7f836015c860 2023-03-03T06:23:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f8367e59700 1 -- 172.21.15.5:0/3948320302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83600cdcc0 con 0x7f836015c860 2023-03-03T06:23:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f83527fc700 1 -- 172.21.15.5:0/3948320302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8354011cf0 con 0x7f836015c860 2023-03-03T06:23:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.494+0000 7f8367e59700 1 -- 172.21.15.5:0/3948320302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836015cc30 con 0x7f836015c860 2023-03-03T06:23:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.495+0000 7f8367e59700 1 -- 172.21.15.5:0/3948320302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83600d1220 con 0x7f836015c860 2023-03-03T06:23:56.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.496+0000 7f83527fc700 1 -- 172.21.15.5:0/3948320302 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8354021070 con 0x7f836015c860 2023-03-03T06:23:56.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.496+0000 7f83527fc700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83440682f0 0x7f834406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.496+0000 7f8365bf5700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83440682f0 0x7f834406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.496+0000 7f83527fc700 1 -- 172.21.15.5:0/3948320302 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8354085e10 con 0x7f836015c860 2023-03-03T06:23:56.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.497+0000 7f8365bf5700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83440682f0 0x7f834406a7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f835c0011e0 tx=0x7f835c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:56.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.501+0000 7f83527fc700 1 -- 172.21.15.5:0/3948320302 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8354052380 con 0x7f836015c860 2023-03-03T06:23:56.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.694+0000 7f8367e59700 1 -- 172.21.15.5:0/3948320302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f836004e6e0 con 0x7f836015c860 2023-03-03T06:23:56.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.695+0000 7f83527fc700 1 -- 172.21.15.5:0/3948320302 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7f835401f090 con 0x7f836015c860 2023-03-03T06:23:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:56.697 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:23:56.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.697+0000 7f8367e59700 1 -- 172.21.15.5:0/3948320302 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83440682f0 msgr2=0x7f834406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.697+0000 7f8367e59700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83440682f0 0x7f834406a7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f835c0011e0 tx=0x7f835c009040 comp rx=0 tx=0).stop 2023-03-03T06:23:56.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.697+0000 7f8367e59700 1 -- 172.21.15.5:0/3948320302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f836015c860 msgr2=0x7f83600ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.697+0000 7f8367e59700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f836015c860 0x7f83600ca9f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f835400c7f0 tx=0x7f835400cbb0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.697+0000 7f8367e59700 1 -- 172.21.15.5:0/3948320302 shutdown_connections 2023-03-03T06:23:56.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.697+0000 7f8367e59700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8360160dc0 0x7f836015d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.697+0000 7f8367e59700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83440682f0 0x7f834406a7a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.697+0000 7f8367e59700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83600b5130 0x7f836014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.697+0000 7f8367e59700 1 --2- 172.21.15.5:0/3948320302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f836015c860 0x7f83600ca9f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.697+0000 7f8367e59700 1 -- 172.21.15.5:0/3948320302 >> 172.21.15.5:0/3948320302 conn(0x7f83600d3bf0 msgr2=0x7f83600c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:56.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.697+0000 7f8367e59700 1 -- 172.21.15.5:0/3948320302 shutdown_connections 2023-03-03T06:23:56.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.697+0000 7f8367e59700 1 -- 172.21.15.5:0/3948320302 wait complete. 2023-03-03T06:23:56.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-03T06:23:56.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.838+0000 7f70f67d7700 1 Processor -- start 2023-03-03T06:23:56.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.838+0000 7f70f67d7700 1 -- start start 2023-03-03T06:23:56.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.838+0000 7f70f67d7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70f015a830 0x7f70f00cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.838+0000 7f70f67d7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f00d16a0 con 0x7f70f015a460 2023-03-03T06:23:56.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.838+0000 7f70f67d7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f00cbc70 con 0x7f70f00b01a0 2023-03-03T06:23:56.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.838+0000 7f70f67d7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f00cb4a0 con 0x7f70f015a830 2023-03-03T06:23:56.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70effff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f70f015a460 0x7f70f00cd110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59498/0 (socket says 172.21.15.5:59498) 2023-03-03T06:23:56.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70effff700 1 -- 172.21.15.5:0/2923951784 learned_addr learned my addr 172.21.15.5:0/2923951784 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:56.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70ef7fe700 1 --2- 172.21.15.5:0/2923951784 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70f015a830 0x7f70f00cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977703002 0 0) 0x7f70f00d16a0 con 0x7f70f015a460 2023-03-03T06:23:56.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d80035b0 con 0x7f70f015a460 2023-03-03T06:23:56.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605398394 0 0) 0x7f70f00cbc70 con 0x7f70f00b01a0 2023-03-03T06:23:56.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f00d16a0 con 0x7f70f00b01a0 2023-03-03T06:23:56.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3016286982 0 0) 0x7f70d80035b0 con 0x7f70f015a460 2023-03-03T06:23:56.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70f015a830 msgr2=0x7f70f00cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 --2- 172.21.15.5:0/2923951784 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70f015a830 0x7f70f00cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 >> v1:172.21.15.191:6789/0 conn(0x7f70f00b01a0 legacy=0x7f70f00cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f00cb6b0 con 0x7f70f015a460 2023-03-03T06:23:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f70e0001670 con 0x7f70f015a460 2023-03-03T06:23:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 >> v1:172.21.15.5:6789/0 conn(0x7f70f015a460 legacy=0x7f70f00cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 --2- 172.21.15.5:0/2923951784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d8003bc0 0x7f70d8003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 --2- 172.21.15.5:0/2923951784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70d8004850 0x7f70d8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 --2- 172.21.15.5:0/2923951784 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70f015a830 0x7f70d8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f00cb4a0 con 0x7f70d8003bc0 2023-03-03T06:23:56.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d800bac0 con 0x7f70d8004850 2023-03-03T06:23:56.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d800bc80 con 0x7f70f015a830 2023-03-03T06:23:56.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70effff700 1 --2- 172.21.15.5:0/2923951784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d8003bc0 0x7f70d8003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70ef7fe700 1 --2- 172.21.15.5:0/2923951784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70d8004850 0x7f70d8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.839+0000 7f70f4d74700 1 --2- 172.21.15.5:0/2923951784 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70f015a830 0x7f70d8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.840+0000 7f70effff700 1 -- 172.21.15.5:0/2923951784 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70f015a830 msgr2=0x7f70d8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:56.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.840+0000 7f70effff700 1 --2- 172.21.15.5:0/2923951784 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70f015a830 0x7f70d8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.840+0000 7f70effff700 1 -- 172.21.15.5:0/2923951784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70d8004850 msgr2=0x7f70d8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:56.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.840+0000 7f70effff700 1 --2- 172.21.15.5:0/2923951784 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70d8004850 0x7f70d8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.840+0000 7f70effff700 1 -- 172.21.15.5:0/2923951784 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d80035b0 con 0x7f70d8003bc0 2023-03-03T06:23:56.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.840+0000 7f70effff700 1 --2- 172.21.15.5:0/2923951784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d8003bc0 0x7f70d8003fb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f70e000c210 tx=0x7f70d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a92de8e966e0de server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:56.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.840+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e000cdb0 con 0x7f70d8003bc0 2023-03-03T06:23:56.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.840+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e0001af0 con 0x7f70d8003bc0 2023-03-03T06:23:56.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.840+0000 7f70eeffd700 1 -- 172.21.15.5:0/2923951784 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0005ba0 con 0x7f70d8003bc0 2023-03-03T06:23:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.840+0000 7f70f67d7700 1 -- 172.21.15.5:0/2923951784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d8003bc0 msgr2=0x7f70d8003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.840+0000 7f70f67d7700 1 --2- 172.21.15.5:0/2923951784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70d8003bc0 0x7f70d8003fb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f70e000c210 tx=0x7f70d8005880 comp rx=0 tx=0).stop 2023-03-03T06:23:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.840+0000 7f70f4d74700 1 -- 172.21.15.5:0/2923951784 reap_dead start 2023-03-03T06:23:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.841+0000 7f70f67d7700 1 -- 172.21.15.5:0/2923951784 shutdown_connections 2023-03-03T06:23:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.841+0000 7f70f67d7700 1 -- 172.21.15.5:0/2923951784 >> 172.21.15.5:0/2923951784 conn(0x7f70f006f3c0 msgr2=0x7f70f006f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.841+0000 7f70f67d7700 1 -- 172.21.15.5:0/2923951784 shutdown_connections 2023-03-03T06:23:56.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.841+0000 7f70f67d7700 1 -- 172.21.15.5:0/2923951784 wait complete. 2023-03-03T06:23:56.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.842+0000 7f70f67d7700 1 Processor -- start 2023-03-03T06:23:56.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.842+0000 7f70f67d7700 1 -- start start 2023-03-03T06:23:56.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f67d7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70d8003bc0 0x7f70f01f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f67d7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70f00b6530 0x7f70f00b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f67d7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f006c3d0 0x7f70f006c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f67d7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f006cd80 con 0x7f70f006c3d0 2023-03-03T06:23:56.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f67d7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f01f5b90 con 0x7f70f00b6530 2023-03-03T06:23:56.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f67d7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f01f5e70 con 0x7f70d8003bc0 2023-03-03T06:23:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f4d74700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f006c3d0 0x7f70f006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f4d74700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f006c3d0 0x7f70f006c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41440/0 (socket says 172.21.15.5:41440) 2023-03-03T06:23:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f4d74700 1 -- 172.21.15.5:0/2484627389 learned_addr learned my addr 172.21.15.5:0/2484627389 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70ef7fe700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70f00b6530 0x7f70f00b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70effff700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70d8003bc0 0x7f70f01f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f4d74700 1 -- 172.21.15.5:0/2484627389 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70d8003bc0 msgr2=0x7f70f01f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f4d74700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70d8003bc0 0x7f70f01f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f4d74700 1 -- 172.21.15.5:0/2484627389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70f00b6530 msgr2=0x7f70f00b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f4d74700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70f00b6530 0x7f70f00b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f4d74700 1 -- 172.21.15.5:0/2484627389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f00d1940 con 0x7f70f006c3d0 2023-03-03T06:23:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70ef7fe700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70f00b6530 0x7f70f00b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70effff700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70d8003bc0 0x7f70f01f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f4d74700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f006c3d0 0x7f70f006c840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f70f006ff90 tx=0x7f70e800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70ecff9700 1 -- 172.21.15.5:0/2484627389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8003c10 con 0x7f70f006c3d0 2023-03-03T06:23:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70ecff9700 1 -- 172.21.15.5:0/2484627389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e8003d70 con 0x7f70f006c3d0 2023-03-03T06:23:56.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f67d7700 1 -- 172.21.15.5:0/2484627389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f00cb990 con 0x7f70f006c3d0 2023-03-03T06:23:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70ecff9700 1 -- 172.21.15.5:0/2484627389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e800dbd0 con 0x7f70f006c3d0 2023-03-03T06:23:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.843+0000 7f70f67d7700 1 -- 172.21.15.5:0/2484627389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f00cd860 con 0x7f70f006c3d0 2023-03-03T06:23:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.845+0000 7f70f67d7700 1 -- 172.21.15.5:0/2484627389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f004e6e0 con 0x7f70f006c3d0 2023-03-03T06:23:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.845+0000 7f70ecff9700 1 -- 172.21.15.5:0/2484627389 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f70e800dd30 con 0x7f70f006c3d0 2023-03-03T06:23:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.845+0000 7f70ecff9700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70dc0682f0 0x7f70dc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.845+0000 7f70ecff9700 1 -- 172.21.15.5:0/2484627389 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f70e8086420 con 0x7f70f006c3d0 2023-03-03T06:23:56.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.845+0000 7f70effff700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70dc0682f0 0x7f70dc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.846+0000 7f70effff700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70dc0682f0 0x7f70dc06a7a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70f00cd780 tx=0x7f70e000a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:56.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:56.849+0000 7f70ecff9700 1 -- 172.21.15.5:0/2484627389 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f70e8052990 con 0x7f70f006c3d0 2023-03-03T06:23:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.089+0000 7f70f67d7700 1 -- 172.21.15.5:0/2484627389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f70f015ddc0 con 0x7f70f006c3d0 2023-03-03T06:23:57.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.534+0000 7f70ecff9700 1 -- 172.21.15.5:0/2484627389 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f70e8055fb0 con 0x7f70f006c3d0 2023-03-03T06:23:57.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.537+0000 7f70f67d7700 1 -- 172.21.15.5:0/2484627389 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70dc0682f0 msgr2=0x7f70dc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:57.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.537+0000 7f70f67d7700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70dc0682f0 0x7f70dc06a7a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70f00cd780 tx=0x7f70e000a000 comp rx=0 tx=0).stop 2023-03-03T06:23:57.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.537+0000 7f70f67d7700 1 -- 172.21.15.5:0/2484627389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f006c3d0 msgr2=0x7f70f006c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:57.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.537+0000 7f70f67d7700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f006c3d0 0x7f70f006c840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f70f006ff90 tx=0x7f70e800d430 comp rx=0 tx=0).stop 2023-03-03T06:23:57.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.537+0000 7f70f67d7700 1 -- 172.21.15.5:0/2484627389 shutdown_connections 2023-03-03T06:23:57.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.537+0000 7f70f67d7700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f006c3d0 0x7f70f006c840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:57.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.537+0000 7f70f67d7700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70dc0682f0 0x7f70dc06a7a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:57.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.537+0000 7f70f67d7700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70d8003bc0 0x7f70f01f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:57.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.537+0000 7f70f67d7700 1 --2- 172.21.15.5:0/2484627389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70f00b6530 0x7f70f00b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:57.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.537+0000 7f70f67d7700 1 -- 172.21.15.5:0/2484627389 >> 172.21.15.5:0/2484627389 conn(0x7f70f006f3c0 msgr2=0x7f70f00cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:57.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.537+0000 7f70f67d7700 1 -- 172.21.15.5:0/2484627389 shutdown_connections 2023-03-03T06:23:57.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.537+0000 7f70f67d7700 1 -- 172.21.15.5:0/2484627389 wait complete. 2023-03-03T06:23:57.553 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-03-03T06:23:57.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-03T06:23:57.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.689+0000 7fcc1bd09700 1 Processor -- start 2023-03-03T06:23:57.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.689+0000 7fcc1bd09700 1 -- start start 2023-03-03T06:23:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.690+0000 7fcc1bd09700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc140b1fe0 0x7fcc1415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.690+0000 7fcc1bd09700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc140cc5d0 con 0x7fcc140b55b0 2023-03-03T06:23:57.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.690+0000 7fcc1bd09700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc14159c30 con 0x7fcc140cd500 2023-03-03T06:23:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.690+0000 7fcc1bd09700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1415e290 con 0x7fcc140b1fe0 2023-03-03T06:23:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.690+0000 7fcc1a2a6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcc140b1fe0 0x7fcc1415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:57.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.690+0000 7fcc19aa5700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcc140b55b0 0x7fcc140b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59518/0 (socket says 172.21.15.5:59518) 2023-03-03T06:23:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.690+0000 7fcc19aa5700 1 -- 172.21.15.5:0/695552839 learned_addr learned my addr 172.21.15.5:0/695552839 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.690+0000 7fcc1a2a6700 1 -- 172.21.15.5:0/695552839 >> v1:172.21.15.191:6789/0 conn(0x7fcc140cd500 legacy=0x7fcc140cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:57.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.690+0000 7fcc1a2a6700 1 -- 172.21.15.5:0/695552839 >> v1:172.21.15.5:6789/0 conn(0x7fcc140b55b0 legacy=0x7fcc140b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.690+0000 7fcc1a2a6700 1 -- 172.21.15.5:0/695552839 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140b5980 con 0x7fcc140b1fe0 2023-03-03T06:23:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.691+0000 7fcc1a2a6700 1 --2- 172.21.15.5:0/695552839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140b1fe0 0x7fcc1415dd50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009d90 tx=0x7fcc0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3c5a1f5795572 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.691+0000 7fcc18aa3700 1 -- 172.21.15.5:0/695552839 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c00e070 con 0x7fcc140b1fe0 2023-03-03T06:23:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.691+0000 7fcc18aa3700 1 -- 172.21.15.5:0/695552839 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0c00bbd0 con 0x7fcc140b1fe0 2023-03-03T06:23:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.691+0000 7fcc18aa3700 1 -- 172.21.15.5:0/695552839 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c012430 con 0x7fcc140b1fe0 2023-03-03T06:23:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.691+0000 7fcc1bd09700 1 -- 172.21.15.5:0/695552839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140b1fe0 msgr2=0x7fcc1415dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.691+0000 7fcc1bd09700 1 --2- 172.21.15.5:0/695552839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140b1fe0 0x7fcc1415dd50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009d90 tx=0x7fcc0c00b330 comp rx=0 tx=0).stop 2023-03-03T06:23:57.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.691+0000 7fcc1bd09700 1 -- 172.21.15.5:0/695552839 shutdown_connections 2023-03-03T06:23:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.691+0000 7fcc1bd09700 1 --2- 172.21.15.5:0/695552839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140b1fe0 0x7fcc1415dd50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.691+0000 7fcc1bd09700 1 -- 172.21.15.5:0/695552839 >> 172.21.15.5:0/695552839 conn(0x7fcc140cc8d0 msgr2=0x7fcc140cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.691+0000 7fcc1bd09700 1 -- 172.21.15.5:0/695552839 shutdown_connections 2023-03-03T06:23:57.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.691+0000 7fcc1bd09700 1 -- 172.21.15.5:0/695552839 wait complete. 2023-03-03T06:23:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.692+0000 7fcc1bd09700 1 Processor -- start 2023-03-03T06:23:57.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.693+0000 7fcc1bd09700 1 -- start start 2023-03-03T06:23:57.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.693+0000 7fcc1bd09700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc140b1fe0 0x7fcc140cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:57.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.693+0000 7fcc1bd09700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140b55b0 0x7fcc141563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:57.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.693+0000 7fcc1bd09700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc140cd500 0x7fcc1415d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.693+0000 7fcc1bd09700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc140c7f10 con 0x7fcc140b55b0 2023-03-03T06:23:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.693+0000 7fcc1bd09700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc140cf4b0 con 0x7fcc140b1fe0 2023-03-03T06:23:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.693+0000 7fcc1bd09700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc14156900 con 0x7fcc140cd500 2023-03-03T06:23:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.693+0000 7fcc192a4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140b55b0 0x7fcc141563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.693+0000 7fcc192a4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140b55b0 0x7fcc141563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41452/0 (socket says 172.21.15.5:41452) 2023-03-03T06:23:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.693+0000 7fcc19aa5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc140b1fe0 0x7fcc140cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:57.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.693+0000 7fcc192a4700 1 -- 172.21.15.5:0/1813303260 learned_addr learned my addr 172.21.15.5:0/1813303260 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:57.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.694+0000 7fcc1a2a6700 1 --2- 172.21.15.5:0/1813303260 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc140cd500 0x7fcc1415d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:57.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.694+0000 7fcc192a4700 1 -- 172.21.15.5:0/1813303260 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc140cd500 msgr2=0x7fcc1415d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:57.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.694+0000 7fcc192a4700 1 --2- 172.21.15.5:0/1813303260 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc140cd500 0x7fcc1415d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:57.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.694+0000 7fcc192a4700 1 -- 172.21.15.5:0/1813303260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc140b1fe0 msgr2=0x7fcc140cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:57.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.694+0000 7fcc192a4700 1 --2- 172.21.15.5:0/1813303260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc140b1fe0 0x7fcc140cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:57.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.694+0000 7fcc192a4700 1 -- 172.21.15.5:0/1813303260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c009a70 con 0x7fcc140b55b0 2023-03-03T06:23:57.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.694+0000 7fcc192a4700 1 --2- 172.21.15.5:0/1813303260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140b55b0 0x7fcc141563c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000c450 tx=0x7fcc1000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:57.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.694+0000 7fcc0a7fc700 1 -- 172.21.15.5:0/1813303260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc100052d0 con 0x7fcc140b55b0 2023-03-03T06:23:57.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.694+0000 7fcc0a7fc700 1 -- 172.21.15.5:0/1813303260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc10005430 con 0x7fcc140b55b0 2023-03-03T06:23:57.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.694+0000 7fcc0a7fc700 1 -- 172.21.15.5:0/1813303260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc100038c0 con 0x7fcc140b55b0 2023-03-03T06:23:57.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.694+0000 7fcc1bd09700 1 -- 172.21.15.5:0/1813303260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc140cbca0 con 0x7fcc140b55b0 2023-03-03T06:23:57.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.694+0000 7fcc1bd09700 1 -- 172.21.15.5:0/1813303260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc140cb9c0 con 0x7fcc140b55b0 2023-03-03T06:23:57.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.695+0000 7fcc1bd09700 1 -- 172.21.15.5:0/1813303260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc140cbf80 con 0x7fcc140b55b0 2023-03-03T06:23:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.695+0000 7fcc0a7fc700 1 -- 172.21.15.5:0/1813303260 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fcc10019030 con 0x7fcc140b55b0 2023-03-03T06:23:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.696+0000 7fcc0a7fc700 1 --2- 172.21.15.5:0/1813303260 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcbf80682f0 0x7fcbf806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.696+0000 7fcc0a7fc700 1 -- 172.21.15.5:0/1813303260 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcc10085190 con 0x7fcc140b55b0 2023-03-03T06:23:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.696+0000 7fcc19aa5700 1 --2- 172.21.15.5:0/1813303260 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcbf80682f0 0x7fcbf806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.696+0000 7fcc19aa5700 1 --2- 172.21.15.5:0/1813303260 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcbf80682f0 0x7fcbf806a7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcc04005910 tx=0x7fcc04009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:57.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.700+0000 7fcc0a7fc700 1 -- 172.21.15.5:0/1813303260 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fcc10051670 con 0x7fcc140b55b0 2023-03-03T06:23:57.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:57.940+0000 7fcc1bd09700 1 -- 172.21.15.5:0/1813303260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcc140caf40 con 0x7fcc140b55b0 2023-03-03T06:23:58.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.536+0000 7fcc0a7fc700 1 -- 172.21.15.5:0/1813303260 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcc100170c0 con 0x7fcc140b55b0 2023-03-03T06:23:58.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.539+0000 7fcc1bd09700 1 -- 172.21.15.5:0/1813303260 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcbf80682f0 msgr2=0x7fcbf806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.539+0000 7fcc1bd09700 1 --2- 172.21.15.5:0/1813303260 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcbf80682f0 0x7fcbf806a7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcc04005910 tx=0x7fcc04009040 comp rx=0 tx=0).stop 2023-03-03T06:23:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.539+0000 7fcc1bd09700 1 -- 172.21.15.5:0/1813303260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140b55b0 msgr2=0x7fcc141563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.539+0000 7fcc1bd09700 1 --2- 172.21.15.5:0/1813303260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140b55b0 0x7fcc141563c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000c450 tx=0x7fcc1000c760 comp rx=0 tx=0).stop 2023-03-03T06:23:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.539+0000 7fcc1bd09700 1 -- 172.21.15.5:0/1813303260 shutdown_connections 2023-03-03T06:23:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.539+0000 7fcc1bd09700 1 --2- 172.21.15.5:0/1813303260 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcbf80682f0 0x7fcbf806a7a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.539+0000 7fcc1bd09700 1 --2- 172.21.15.5:0/1813303260 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcc140cd500 0x7fcc1415d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.539+0000 7fcc1bd09700 1 --2- 172.21.15.5:0/1813303260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcc140b1fe0 0x7fcc140cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.539+0000 7fcc1bd09700 1 --2- 172.21.15.5:0/1813303260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc140b55b0 0x7fcc141563c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.539+0000 7fcc1bd09700 1 -- 172.21.15.5:0/1813303260 >> 172.21.15.5:0/1813303260 conn(0x7fcc140cc8d0 msgr2=0x7fcc14159300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.539+0000 7fcc1bd09700 1 -- 172.21.15.5:0/1813303260 shutdown_connections 2023-03-03T06:23:58.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.539+0000 7fcc1bd09700 1 -- 172.21.15.5:0/1813303260 wait complete. 2023-03-03T06:23:58.557 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-03T06:23:58.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:23:58.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.690+0000 7fc85a37e700 1 Processor -- start 2023-03-03T06:23:58.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.690+0000 7fc85a37e700 1 -- start start 2023-03-03T06:23:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.690+0000 7fc85a37e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc85415cd40 0x7fc8540b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.690+0000 7fc85a37e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc8540cef60 0x7fc8540b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.690+0000 7fc85a37e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85415d4e0 con 0x7fc8540cba50 2023-03-03T06:23:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.690+0000 7fc85a37e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85415d7c0 con 0x7fc85415cd40 2023-03-03T06:23:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.690+0000 7fc85a37e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85415daa0 con 0x7fc8540cef60 2023-03-03T06:23:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.690+0000 7fc853fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc85415cd40 0x7fc8540b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:58.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.690+0000 7fc853fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc85415cd40 0x7fc8540b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41458/0 (socket says 172.21.15.5:41458) 2023-03-03T06:23:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.690+0000 7fc853fff700 1 -- 172.21.15.5:0/2521152385 learned_addr learned my addr 172.21.15.5:0/2521152385 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.690+0000 7fc85891b700 1 --2- 172.21.15.5:0/2521152385 >> v2:172.21.15.191:3300/0 conn(0x7fc8540cef60 0x7fc8540b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.691+0000 7fc853fff700 1 -- 172.21.15.5:0/2521152385 >> v2:172.21.15.191:3300/0 conn(0x7fc8540cef60 msgr2=0x7fc8540b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.691+0000 7fc853fff700 1 --2- 172.21.15.5:0/2521152385 >> v2:172.21.15.191:3300/0 conn(0x7fc8540cef60 0x7fc8540b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.691+0000 7fc853fff700 1 -- 172.21.15.5:0/2521152385 >> v1:172.21.15.191:6789/0 conn(0x7fc8540cba50 legacy=0x7fc854160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.691+0000 7fc853fff700 1 -- 172.21.15.5:0/2521152385 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85415dd80 con 0x7fc85415cd40 2023-03-03T06:23:58.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.691+0000 7fc853fff700 1 --2- 172.21.15.5:0/2521152385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc85415cd40 0x7fc8540b18d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc8541606d0 tx=0x7fc844009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684130597e97798e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.691+0000 7fc852ffd700 1 -- 172.21.15.5:0/2521152385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844011830 con 0x7fc85415cd40 2023-03-03T06:23:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.691+0000 7fc852ffd700 1 -- 172.21.15.5:0/2521152385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc844011990 con 0x7fc85415cd40 2023-03-03T06:23:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.691+0000 7fc852ffd700 1 -- 172.21.15.5:0/2521152385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844011d20 con 0x7fc85415cd40 2023-03-03T06:23:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.692+0000 7fc85a37e700 1 -- 172.21.15.5:0/2521152385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc85415cd40 msgr2=0x7fc8540b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.692+0000 7fc85a37e700 1 --2- 172.21.15.5:0/2521152385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc85415cd40 0x7fc8540b18d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc8541606d0 tx=0x7fc844009bd0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.692+0000 7fc85a37e700 1 -- 172.21.15.5:0/2521152385 shutdown_connections 2023-03-03T06:23:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.692+0000 7fc85a37e700 1 --2- 172.21.15.5:0/2521152385 >> v2:172.21.15.191:3300/0 conn(0x7fc8540cef60 0x7fc8540b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.692+0000 7fc85a37e700 1 --2- 172.21.15.5:0/2521152385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc85415cd40 0x7fc8540b18d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.692+0000 7fc85a37e700 1 -- 172.21.15.5:0/2521152385 >> 172.21.15.5:0/2521152385 conn(0x7fc8540cc8d0 msgr2=0x7fc8540cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:58.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.692+0000 7fc85a37e700 1 -- 172.21.15.5:0/2521152385 shutdown_connections 2023-03-03T06:23:58.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.692+0000 7fc85a37e700 1 -- 172.21.15.5:0/2521152385 wait complete. 2023-03-03T06:23:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.693+0000 7fc85a37e700 1 Processor -- start 2023-03-03T06:23:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.693+0000 7fc85a37e700 1 -- start start 2023-03-03T06:23:58.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc85a37e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8540cba50 0x7fc854156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc85a37e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8540cef60 0x7fc8540b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc85a37e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc85415cd40 0x7fc8540c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc85a37e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540b45d0 con 0x7fc8540cef60 2023-03-03T06:23:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc85a37e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540b3780 con 0x7fc8540cba50 2023-03-03T06:23:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc85a37e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540b3a60 con 0x7fc85415cd40 2023-03-03T06:23:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc8537fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8540cef60 0x7fc8540b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:58.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc8537fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8540cef60 0x7fc8540b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41466/0 (socket says 172.21.15.5:41466) 2023-03-03T06:23:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc8537fe700 1 -- 172.21.15.5:0/3515580036 learned_addr learned my addr 172.21.15.5:0/3515580036 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc85891b700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc85415cd40 0x7fc8540c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc853fff700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8540cba50 0x7fc854156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc8537fe700 1 -- 172.21.15.5:0/3515580036 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc85415cd40 msgr2=0x7fc8540c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc8537fe700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc85415cd40 0x7fc8540c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc8537fe700 1 -- 172.21.15.5:0/3515580036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8540cba50 msgr2=0x7fc854156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc8537fe700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8540cba50 0x7fc854156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc8537fe700 1 -- 172.21.15.5:0/3515580036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc844009550 con 0x7fc8540cef60 2023-03-03T06:23:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc85891b700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc85415cd40 0x7fc8540c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc853fff700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8540cba50 0x7fc854156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.694+0000 7fc8537fe700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8540cef60 0x7fc8540b2c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00c500 tx=0x7fc83c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.695+0000 7fc850ff9700 1 -- 172.21.15.5:0/3515580036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c0052d0 con 0x7fc8540cef60 2023-03-03T06:23:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.695+0000 7fc850ff9700 1 -- 172.21.15.5:0/3515580036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c005450 con 0x7fc8540cef60 2023-03-03T06:23:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.695+0000 7fc85a37e700 1 -- 172.21.15.5:0/3515580036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8540ca530 con 0x7fc8540cef60 2023-03-03T06:23:58.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.695+0000 7fc850ff9700 1 -- 172.21.15.5:0/3515580036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c003910 con 0x7fc8540cef60 2023-03-03T06:23:58.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.695+0000 7fc85a37e700 1 -- 172.21.15.5:0/3515580036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85415e060 con 0x7fc8540cef60 2023-03-03T06:23:58.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.696+0000 7fc85a37e700 1 -- 172.21.15.5:0/3515580036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85415d110 con 0x7fc8540cef60 2023-03-03T06:23:58.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.696+0000 7fc850ff9700 1 -- 172.21.15.5:0/3515580036 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc83c019030 con 0x7fc8540cef60 2023-03-03T06:23:58.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.697+0000 7fc850ff9700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc8340682f0 0x7fc83406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:58.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.697+0000 7fc850ff9700 1 -- 172.21.15.5:0/3515580036 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc83c085700 con 0x7fc8540cef60 2023-03-03T06:23:58.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.697+0000 7fc853fff700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc8340682f0 0x7fc83406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:58.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.697+0000 7fc853fff700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc8340682f0 0x7fc83406a7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc844014040 tx=0x7fc844008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:58.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.700+0000 7fc850ff9700 1 -- 172.21.15.5:0/3515580036 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc83c051d10 con 0x7fc8540cef60 2023-03-03T06:23:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.938+0000 7fc85a37e700 1 -- 172.21.15.5:0/3515580036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc85404e6e0 con 0x7fc8540cef60 2023-03-03T06:23:58.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.938+0000 7fc850ff9700 1 -- 172.21.15.5:0/3515580036 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4638 (secure 0 0 0) 0x7fc83c055330 con 0x7fc8540cef60 2023-03-03T06:23:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:58.941 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/277386051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":277386051},{"type":"v1","addr":"172.21.15.5:6837","nonce":277386051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2875199515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2875199515},{"type":"v1","addr":"172.21.15.191:6835","nonce":2875199515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2122425608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2122425608},{"type":"v1","addr":"172.21.15.191:6833","nonce":2122425608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:23:40.315678+0000","modified":"2023-03-03T06:23:58.532900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/305842942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":305842942},{"type":"v1","addr":"172.21.15.5:6836","nonce":305842942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-03T06:23:58.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.940+0000 7fc85a37e700 1 -- 172.21.15.5:0/3515580036 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc8340682f0 msgr2=0x7fc83406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:58.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.940+0000 7fc85a37e700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc8340682f0 0x7fc83406a7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc844014040 tx=0x7fc844008030 comp rx=0 tx=0).stop 2023-03-03T06:23:58.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.940+0000 7fc85a37e700 1 -- 172.21.15.5:0/3515580036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8540cef60 msgr2=0x7fc8540b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:58.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.940+0000 7fc85a37e700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8540cef60 0x7fc8540b2c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00c500 tx=0x7fc83c00c8c0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.940+0000 7fc85a37e700 1 -- 172.21.15.5:0/3515580036 shutdown_connections 2023-03-03T06:23:58.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.940+0000 7fc85a37e700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc8340682f0 0x7fc83406a7a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.940+0000 7fc85a37e700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc85415cd40 0x7fc8540c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.940+0000 7fc85a37e700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc8540cba50 0x7fc854156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.940+0000 7fc85a37e700 1 --2- 172.21.15.5:0/3515580036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8540cef60 0x7fc8540b2c80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:58.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.940+0000 7fc85a37e700 1 -- 172.21.15.5:0/3515580036 >> 172.21.15.5:0/3515580036 conn(0x7fc8540cc8d0 msgr2=0x7fc85415e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:58.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.940+0000 7fc85a37e700 1 -- 172.21.15.5:0/3515580036 shutdown_connections 2023-03-03T06:23:58.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:58.940+0000 7fc85a37e700 1 -- 172.21.15.5:0/3515580036 wait complete. 2023-03-03T06:23:58.944 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2023-03-03T06:23:58.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:23:59.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.077+0000 7f271bde9700 1 Processor -- start 2023-03-03T06:23:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.078+0000 7f271bde9700 1 -- start start 2023-03-03T06:23:59.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.078+0000 7f271bde9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27140af450 0x7f27140cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.078+0000 7f271bde9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27140b1f80 0x7f27140cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.078+0000 7f271bde9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271406b590 con 0x7f27140af080 2023-03-03T06:23:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.078+0000 7f271bde9700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271406b870 con 0x7f27140af450 2023-03-03T06:23:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.078+0000 7f271bde9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271406bb50 con 0x7f27140b1f80 2023-03-03T06:23:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.079+0000 7f2719384700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27140af450 0x7f27140cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.079+0000 7f2719b85700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f27140af080 0x7f27140b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59546/0 (socket says 172.21.15.5:59546) 2023-03-03T06:23:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.079+0000 7f2719b85700 1 -- 172.21.15.5:0/2943738641 learned_addr learned my addr 172.21.15.5:0/2943738641 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.079+0000 7f271a386700 1 --2- 172.21.15.5:0/2943738641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27140b1f80 0x7f27140cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.079+0000 7f2719384700 1 -- 172.21.15.5:0/2943738641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27140b1f80 msgr2=0x7f27140cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.079+0000 7f2719384700 1 --2- 172.21.15.5:0/2943738641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27140b1f80 0x7f27140cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.079+0000 7f2719384700 1 -- 172.21.15.5:0/2943738641 >> v1:172.21.15.5:6789/0 conn(0x7f27140af080 legacy=0x7f27140b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.079+0000 7f2718b83700 1 -- 172.21.15.5:0/2943738641 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130328927 0 0) 0x7f271406b590 con 0x7f27140af080 2023-03-03T06:23:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.079+0000 7f2719384700 1 -- 172.21.15.5:0/2943738641 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271406be30 con 0x7f27140af450 2023-03-03T06:23:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.079+0000 7f2719384700 1 --2- 172.21.15.5:0/2943738641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27140af450 0x7f27140cd350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2708009840 tx=0x7f2708009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a4af191536c823 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.079+0000 7f2718b83700 1 -- 172.21.15.5:0/2943738641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708011830 con 0x7f27140af450 2023-03-03T06:23:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.079+0000 7f2718b83700 1 -- 172.21.15.5:0/2943738641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2708011990 con 0x7f27140af450 2023-03-03T06:23:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.079+0000 7f2718b83700 1 -- 172.21.15.5:0/2943738641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708011d20 con 0x7f27140af450 2023-03-03T06:23:59.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.080+0000 7f271bde9700 1 -- 172.21.15.5:0/2943738641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27140af450 msgr2=0x7f27140cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.080+0000 7f271bde9700 1 --2- 172.21.15.5:0/2943738641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27140af450 0x7f27140cd350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2708009840 tx=0x7f2708009b50 comp rx=0 tx=0).stop 2023-03-03T06:23:59.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.080+0000 7f271bde9700 1 -- 172.21.15.5:0/2943738641 shutdown_connections 2023-03-03T06:23:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.080+0000 7f271bde9700 1 --2- 172.21.15.5:0/2943738641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27140b1f80 0x7f27140cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.080+0000 7f271bde9700 1 --2- 172.21.15.5:0/2943738641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27140af450 0x7f27140cd350 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.080+0000 7f271bde9700 1 -- 172.21.15.5:0/2943738641 >> 172.21.15.5:0/2943738641 conn(0x7f271406ea70 msgr2=0x7f27140cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.080+0000 7f271bde9700 1 -- 172.21.15.5:0/2943738641 shutdown_connections 2023-03-03T06:23:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.080+0000 7f271bde9700 1 -- 172.21.15.5:0/2943738641 wait complete. 2023-03-03T06:23:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.081+0000 7f271bde9700 1 Processor -- start 2023-03-03T06:23:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.082+0000 7f271bde9700 1 -- start start 2023-03-03T06:23:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.082+0000 7f271bde9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27140af080 0x7f27140c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.082+0000 7f271bde9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27140af450 0x7f27140c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271bde9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27140b1f80 0x7f27140c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271bde9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271414d820 con 0x7f27140b1f80 2023-03-03T06:23:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271bde9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140b3960 con 0x7f27140af080 2023-03-03T06:23:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271bde9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27140b2d50 con 0x7f27140af450 2023-03-03T06:23:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271a386700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27140b1f80 0x7f27140c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271a386700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27140b1f80 0x7f27140c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41482/0 (socket says 172.21.15.5:41482) 2023-03-03T06:23:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271a386700 1 -- 172.21.15.5:0/584728964 learned_addr learned my addr 172.21.15.5:0/584728964 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f2719384700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27140af450 0x7f27140c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f2719b85700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27140af080 0x7f27140c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271a386700 1 -- 172.21.15.5:0/584728964 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27140af450 msgr2=0x7f27140c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271a386700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27140af450 0x7f27140c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271a386700 1 -- 172.21.15.5:0/584728964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27140af080 msgr2=0x7f27140c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271a386700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27140af080 0x7f27140c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271a386700 1 -- 172.21.15.5:0/584728964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080094a0 con 0x7f27140b1f80 2023-03-03T06:23:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f2719384700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27140af450 0x7f27140c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:23:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271a386700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27140b1f80 0x7f27140c7400 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f270c007e60 tx=0x7f270c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f27067fc700 1 -- 172.21.15.5:0/584728964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c00ede0 con 0x7f27140b1f80 2023-03-03T06:23:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f27067fc700 1 -- 172.21.15.5:0/584728964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c014420 con 0x7f27140b1f80 2023-03-03T06:23:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f27067fc700 1 -- 172.21.15.5:0/584728964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0147d0 con 0x7f27140b1f80 2023-03-03T06:23:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271bde9700 1 -- 172.21.15.5:0/584728964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271406d370 con 0x7f27140b1f80 2023-03-03T06:23:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.083+0000 7f271bde9700 1 -- 172.21.15.5:0/584728964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271406c110 con 0x7f27140b1f80 2023-03-03T06:23:59.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.084+0000 7f271bde9700 1 -- 172.21.15.5:0/584728964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271406cb70 con 0x7f27140b1f80 2023-03-03T06:23:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.085+0000 7f27067fc700 1 -- 172.21.15.5:0/584728964 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f270c012050 con 0x7f27140b1f80 2023-03-03T06:23:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.085+0000 7f27067fc700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26f80682f0 0x7f26f806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.085+0000 7f27067fc700 1 -- 172.21.15.5:0/584728964 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f270c086520 con 0x7f27140b1f80 2023-03-03T06:23:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.085+0000 7f2719b85700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26f80682f0 0x7f26f806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.085+0000 7f2719b85700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26f80682f0 0x7f26f806a7a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2710000f60 tx=0x7f2710009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:59.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.089+0000 7f27067fc700 1 -- 172.21.15.5:0/584728964 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f270c052a90 con 0x7f27140b1f80 2023-03-03T06:23:59.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.284+0000 7f271bde9700 1 -- 172.21.15.5:0/584728964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f271404e6e0 con 0x7f27140b1f80 2023-03-03T06:23:59.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.285+0000 7f27067fc700 1 -- 172.21.15.5:0/584728964 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7f270c0560b0 con 0x7f27140b1f80 2023-03-03T06:23:59.288 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:59.288 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:23:59.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.287+0000 7f271bde9700 1 -- 172.21.15.5:0/584728964 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26f80682f0 msgr2=0x7f26f806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.287+0000 7f271bde9700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26f80682f0 0x7f26f806a7a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2710000f60 tx=0x7f2710009040 comp rx=0 tx=0).stop 2023-03-03T06:23:59.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.287+0000 7f271bde9700 1 -- 172.21.15.5:0/584728964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27140b1f80 msgr2=0x7f27140c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.287+0000 7f271bde9700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27140b1f80 0x7f27140c7400 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f270c007e60 tx=0x7f270c00e3c0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.287+0000 7f271bde9700 1 -- 172.21.15.5:0/584728964 shutdown_connections 2023-03-03T06:23:59.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.287+0000 7f271bde9700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27140b1f80 0x7f27140c7400 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.287+0000 7f271bde9700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27140af080 0x7f27140c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.287+0000 7f271bde9700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26f80682f0 0x7f26f806a7a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.287+0000 7f271bde9700 1 --2- 172.21.15.5:0/584728964 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27140af450 0x7f27140c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.287+0000 7f271bde9700 1 -- 172.21.15.5:0/584728964 >> 172.21.15.5:0/584728964 conn(0x7f271406ea70 msgr2=0x7f271415f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:59.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.287+0000 7f271bde9700 1 -- 172.21.15.5:0/584728964 shutdown_connections 2023-03-03T06:23:59.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.287+0000 7f271bde9700 1 -- 172.21.15.5:0/584728964 wait complete. 2023-03-03T06:23:59.302 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-03T06:23:59.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:23:59.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.424+0000 7f89e48ff700 1 Processor -- start 2023-03-03T06:23:59.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.425+0000 7f89e48ff700 1 -- start start 2023-03-03T06:23:59.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.425+0000 7f89e48ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89e015cd40 0x7f89e00b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.425+0000 7f89e48ff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f89e00cba50 0x7f89e00b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.425+0000 7f89e48ff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e015d4e0 con 0x7f89e00cd3e0 2023-03-03T06:23:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.425+0000 7f89e48ff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e015d7c0 con 0x7f89e00cba50 2023-03-03T06:23:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.425+0000 7f89e48ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e015daa0 con 0x7f89e015cd40 2023-03-03T06:23:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.426+0000 7f89ddd9b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f89e00cba50 0x7f89e00b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.426+0000 7f89de59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89e015cd40 0x7f89e00b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.426+0000 7f89de59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89e015cd40 0x7f89e00b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39564/0 (socket says 172.21.15.5:39564) 2023-03-03T06:23:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.426+0000 7f89ddd9b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f89e00cba50 0x7f89e00b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:41846/0 (socket says 172.21.15.5:41846) 2023-03-03T06:23:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.426+0000 7f89de59c700 1 -- 172.21.15.5:0/1509133214 learned_addr learned my addr 172.21.15.5:0/1509133214 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.426+0000 7f89ddd9b700 1 -- 172.21.15.5:0/1509133214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89e015cd40 msgr2=0x7f89e00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.426+0000 7f89ddd9b700 1 --2- 172.21.15.5:0/1509133214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89e015cd40 0x7f89e00b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.426+0000 7f89ddd9b700 1 -- 172.21.15.5:0/1509133214 >> v1:172.21.15.191:6789/0 conn(0x7f89e00cd3e0 legacy=0x7f89e0160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.426+0000 7f89dd59a700 1 -- 172.21.15.5:0/1509133214 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247569296 0 0) 0x7f89e015d4e0 con 0x7f89e00cd3e0 2023-03-03T06:23:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.426+0000 7f89ddd9b700 1 -- 172.21.15.5:0/1509133214 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e015dd80 con 0x7f89e00cba50 2023-03-03T06:23:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.426+0000 7f89de59c700 1 --2- 172.21.15.5:0/1509133214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89e015cd40 0x7f89e00b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:23:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.426+0000 7f89ddd9b700 1 --2- 172.21.15.5:0/1509133214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89e00cba50 0x7f89e00b1e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009820 tx=0x7f89c8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6a01008927bb410 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.427+0000 7f89dd59a700 1 -- 172.21.15.5:0/1509133214 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8005e30 con 0x7f89e00cba50 2023-03-03T06:23:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.427+0000 7f89dd59a700 1 -- 172.21.15.5:0/1509133214 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c8006030 con 0x7f89e00cba50 2023-03-03T06:23:59.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.427+0000 7f89dd59a700 1 -- 172.21.15.5:0/1509133214 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c80063c0 con 0x7f89e00cba50 2023-03-03T06:23:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.427+0000 7f89e48ff700 1 -- 172.21.15.5:0/1509133214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89e00cba50 msgr2=0x7f89e00b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.427+0000 7f89e48ff700 1 --2- 172.21.15.5:0/1509133214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89e00cba50 0x7f89e00b1e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009820 tx=0x7f89c8009b30 comp rx=0 tx=0).stop 2023-03-03T06:23:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.427+0000 7f89e48ff700 1 -- 172.21.15.5:0/1509133214 shutdown_connections 2023-03-03T06:23:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.427+0000 7f89e48ff700 1 --2- 172.21.15.5:0/1509133214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89e015cd40 0x7f89e00b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.427+0000 7f89e48ff700 1 --2- 172.21.15.5:0/1509133214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89e00cba50 0x7f89e00b1e10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.427+0000 7f89e48ff700 1 -- 172.21.15.5:0/1509133214 >> 172.21.15.5:0/1509133214 conn(0x7f89e00cc8d0 msgr2=0x7f89e00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.427+0000 7f89e48ff700 1 -- 172.21.15.5:0/1509133214 shutdown_connections 2023-03-03T06:23:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.427+0000 7f89e48ff700 1 -- 172.21.15.5:0/1509133214 wait complete. 2023-03-03T06:23:59.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.429+0000 7f89e48ff700 1 Processor -- start 2023-03-03T06:23:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.429+0000 7f89e48ff700 1 -- start start 2023-03-03T06:23:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89e48ff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89e00cba50 0x7f89e014f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89e48ff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e00cd3e0 0x7f89e00c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89e48ff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89e015cd40 0x7f89e00c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89e48ff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e01e5a20 con 0x7f89e00cd3e0 2023-03-03T06:23:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89e48ff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00c4e00 con 0x7f89e015cd40 2023-03-03T06:23:59.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89e48ff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00c4840 con 0x7f89e00cba50 2023-03-03T06:23:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89ddd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e00cd3e0 0x7f89e00c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89ddd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e00cd3e0 0x7f89e00c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41494/0 (socket says 172.21.15.5:41494) 2023-03-03T06:23:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89ddd9b700 1 -- 172.21.15.5:0/1827479939 learned_addr learned my addr 172.21.15.5:0/1827479939 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89de59c700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89e00cba50 0x7f89e014f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89ded9d700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89e015cd40 0x7f89e00c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89ddd9b700 1 -- 172.21.15.5:0/1827479939 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89e00cba50 msgr2=0x7f89e014f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89ddd9b700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89e00cba50 0x7f89e014f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89ddd9b700 1 -- 172.21.15.5:0/1827479939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89e015cd40 msgr2=0x7f89e00c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89ddd9b700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89e015cd40 0x7f89e00c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89ddd9b700 1 -- 172.21.15.5:0/1827479939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d0009550 con 0x7f89e00cd3e0 2023-03-03T06:23:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.430+0000 7f89ded9d700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89e015cd40 0x7f89e00c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.431+0000 7f89ddd9b700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e00cd3e0 0x7f89e00c8000 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009b70 tx=0x7f89c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.431+0000 7f89d6ffd700 1 -- 172.21.15.5:0/1827479939 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8003ab0 con 0x7f89e00cd3e0 2023-03-03T06:23:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.431+0000 7f89d6ffd700 1 -- 172.21.15.5:0/1827479939 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c8003c30 con 0x7f89e00cd3e0 2023-03-03T06:23:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.431+0000 7f89e48ff700 1 -- 172.21.15.5:0/1827479939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c8009430 con 0x7f89e00cd3e0 2023-03-03T06:23:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.431+0000 7f89d6ffd700 1 -- 172.21.15.5:0/1827479939 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8004560 con 0x7f89e00cd3e0 2023-03-03T06:23:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.431+0000 7f89e48ff700 1 -- 172.21.15.5:0/1827479939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e00ca530 con 0x7f89e00cd3e0 2023-03-03T06:23:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.432+0000 7f89e48ff700 1 -- 172.21.15.5:0/1827479939 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e015e060 con 0x7f89e00cd3e0 2023-03-03T06:23:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.432+0000 7f89d6ffd700 1 -- 172.21.15.5:0/1827479939 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f89c800f050 con 0x7f89e00cd3e0 2023-03-03T06:23:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.433+0000 7f89d6ffd700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89c00682f0 0x7f89c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.433+0000 7f89d6ffd700 1 -- 172.21.15.5:0/1827479939 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f89c8087a20 con 0x7f89e00cd3e0 2023-03-03T06:23:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.433+0000 7f89de59c700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89c00682f0 0x7f89c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.433+0000 7f89de59c700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89c00682f0 0x7f89c006a7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f89d0006d30 tx=0x7f89d00092c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.437+0000 7f89d6ffd700 1 -- 172.21.15.5:0/1827479939 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f89c8053f90 con 0x7f89e00cd3e0 2023-03-03T06:23:59.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.626+0000 7f89e48ff700 1 -- 172.21.15.5:0/1827479939 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89e015d110 con 0x7f89c00682f0 2023-03-03T06:23:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.637+0000 7f89d6ffd700 1 -- 172.21.15.5:0/1827479939 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367530 (secure 0 0 0) 0x7f89e015d110 con 0x7f89c00682f0 2023-03-03T06:23:59.644 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:23:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.641+0000 7f89e48ff700 1 -- 172.21.15.5:0/1827479939 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89c00682f0 msgr2=0x7f89c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.641+0000 7f89e48ff700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89c00682f0 0x7f89c006a7a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f89d0006d30 tx=0x7f89d00092c0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.641+0000 7f89e48ff700 1 -- 172.21.15.5:0/1827479939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e00cd3e0 msgr2=0x7f89e00c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.641+0000 7f89e48ff700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e00cd3e0 0x7f89e00c8000 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009b70 tx=0x7f89c8004750 comp rx=0 tx=0).stop 2023-03-03T06:23:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.641+0000 7f89e48ff700 1 -- 172.21.15.5:0/1827479939 shutdown_connections 2023-03-03T06:23:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.641+0000 7f89e48ff700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89e015cd40 0x7f89e00c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.641+0000 7f89e48ff700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89c00682f0 0x7f89c006a7a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.641+0000 7f89e48ff700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f89e00cba50 0x7f89e014f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.641+0000 7f89e48ff700 1 --2- 172.21.15.5:0/1827479939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89e00cd3e0 0x7f89e00c8000 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.641+0000 7f89e48ff700 1 -- 172.21.15.5:0/1827479939 >> 172.21.15.5:0/1827479939 conn(0x7f89e00cc8d0 msgr2=0x7f89e00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.641+0000 7f89e48ff700 1 -- 172.21.15.5:0/1827479939 shutdown_connections 2023-03-03T06:23:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.641+0000 7f89e48ff700 1 -- 172.21.15.5:0/1827479939 wait complete. 2023-03-03T06:23:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:23:59.655 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-03-03T06:23:59.464158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594896,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67296,"kb_used_data":3296,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907424,"statfs":{"total":773094113280,"available":773025202176,"internally_reserved":0,"allocated":3375104,"data_stored":2063078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2198,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002935"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394791+0000","last_change":"2023-03-03T06:23:40.340008+0000","last_active":"2023-03-03T06:23:44.394791+0000","last_peered":"2023-03-03T06:23:44.394791+0000","last_clean":"2023-03-03T06:23:44.394791+0000","last_became_active":"2023-03-03T06:23:40.339743+0000","last_became_peered":"2023-03-03T06:23:40.339743+0000","last_unstale":"2023-03-03T06:23:44.394791+0000","last_undegraded":"2023-03-03T06:23:44.394791+0000","last_fullsized":"2023-03-03T06:23:44.394791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:45.077306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400923+0000","last_change":"2023-03-03T06:23:40.328386+0000","last_active":"2023-03-03T06:23:44.400923+0000","last_peered":"2023-03-03T06:23:44.400923+0000","last_clean":"2023-03-03T06:23:44.400923+0000","last_became_active":"2023-03-03T06:23:40.328078+0000","last_became_peered":"2023-03-03T06:23:40.328078+0000","last_unstale":"2023-03-03T06:23:44.400923+0000","last_undegraded":"2023-03-03T06:23:44.400923+0000","last_fullsized":"2023-03-03T06:23:44.400923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:56:24.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396143+0000","last_change":"2023-03-03T06:23:40.351193+0000","last_active":"2023-03-03T06:23:44.396143+0000","last_peered":"2023-03-03T06:23:44.396143+0000","last_clean":"2023-03-03T06:23:44.396143+0000","last_became_active":"2023-03-03T06:23:40.348126+0000","last_became_peered":"2023-03-03T06:23:40.348126+0000","last_unstale":"2023-03-03T06:23:44.396143+0000","last_undegraded":"2023-03-03T06:23:44.396143+0000","last_fullsized":"2023-03-03T06:23:44.396143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:22:34.948853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406192+0000","last_change":"2023-03-03T06:23:40.339457+0000","last_active":"2023-03-03T06:23:44.406192+0000","last_peered":"2023-03-03T06:23:44.406192+0000","last_clean":"2023-03-03T06:23:44.406192+0000","last_became_active":"2023-03-03T06:23:40.339154+0000","last_became_peered":"2023-03-03T06:23:40.339154+0000","last_unstale":"2023-03-03T06:23:44.406192+0000","last_undegraded":"2023-03-03T06:23:44.406192+0000","last_fullsized":"2023-03-03T06:23:44.406192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:41:25.301780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413710+0000","last_change":"2023-03-03T06:23:40.342264+0000","last_active":"2023-03-03T06:23:44.413710+0000","last_peered":"2023-03-03T06:23:44.413710+0000","last_clean":"2023-03-03T06:23:44.413710+0000","last_became_active":"2023-03-03T06:23:40.340178+0000","last_became_peered":"2023-03-03T06:23:40.340178+0000","last_unstale":"2023-03-03T06:23:44.413710+0000","last_undegraded":"2023-03-03T06:23:44.413710+0000","last_fullsized":"2023-03-03T06:23:44.413710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:50.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396834+0000","last_change":"2023-03-03T06:23:40.344569+0000","last_active":"2023-03-03T06:23:44.396834+0000","last_peered":"2023-03-03T06:23:44.396834+0000","last_clean":"2023-03-03T06:23:44.396834+0000","last_became_active":"2023-03-03T06:23:40.344219+0000","last_became_peered":"2023-03-03T06:23:40.344219+0000","last_unstale":"2023-03-03T06:23:44.396834+0000","last_undegraded":"2023-03-03T06:23:44.396834+0000","last_fullsized":"2023-03-03T06:23:44.396834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:54:28.908384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407523+0000","last_change":"2023-03-03T06:23:40.346056+0000","last_active":"2023-03-03T06:23:44.407523+0000","last_peered":"2023-03-03T06:23:44.407523+0000","last_clean":"2023-03-03T06:23:44.407523+0000","last_became_active":"2023-03-03T06:23:40.345549+0000","last_became_peered":"2023-03-03T06:23:40.345549+0000","last_unstale":"2023-03-03T06:23:44.407523+0000","last_undegraded":"2023-03-03T06:23:44.407523+0000","last_fullsized":"2023-03-03T06:23:44.407523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:00.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398934+0000","last_change":"2023-03-03T06:23:40.341498+0000","last_active":"2023-03-03T06:23:44.398934+0000","last_peered":"2023-03-03T06:23:44.398934+0000","last_clean":"2023-03-03T06:23:44.398934+0000","last_became_active":"2023-03-03T06:23:40.341212+0000","last_became_peered":"2023-03-03T06:23:40.341212+0000","last_unstale":"2023-03-03T06:23:44.398934+0000","last_undegraded":"2023-03-03T06:23:44.398934+0000","last_fullsized":"2023-03-03T06:23:44.398934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:42:56.190690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414254+0000","last_change":"2023-03-03T06:23:40.342151+0000","last_active":"2023-03-03T06:23:44.414254+0000","last_peered":"2023-03-03T06:23:44.414254+0000","last_clean":"2023-03-03T06:23:44.414254+0000","last_became_active":"2023-03-03T06:23:40.340195+0000","last_became_peered":"2023-03-03T06:23:40.340195+0000","last_unstale":"2023-03-03T06:23:44.414254+0000","last_undegraded":"2023-03-03T06:23:44.414254+0000","last_fullsized":"2023-03-03T06:23:44.414254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:26.393574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401024+0000","last_change":"2023-03-03T06:23:40.329308+0000","last_active":"2023-03-03T06:23:44.401024+0000","last_peered":"2023-03-03T06:23:44.401024+0000","last_clean":"2023-03-03T06:23:44.401024+0000","last_became_active":"2023-03-03T06:23:40.329047+0000","last_became_peered":"2023-03-03T06:23:40.329047+0000","last_unstale":"2023-03-03T06:23:44.401024+0000","last_undegraded":"2023-03-03T06:23:44.401024+0000","last_fullsized":"2023-03-03T06:23:44.401024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396048+0000","last_change":"2023-03-03T06:23:40.350139+0000","last_active":"2023-03-03T06:23:44.396048+0000","last_peered":"2023-03-03T06:23:44.396048+0000","last_clean":"2023-03-03T06:23:44.396048+0000","last_became_active":"2023-03-03T06:23:40.344315+0000","last_became_peered":"2023-03-03T06:23:40.344315+0000","last_unstale":"2023-03-03T06:23:44.396048+0000","last_undegraded":"2023-03-03T06:23:44.396048+0000","last_fullsized":"2023-03-03T06:23:44.396048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.395100+0000","last_change":"2023-03-03T06:23:40.347207+0000","last_active":"2023-03-03T06:23:44.395100+0000","last_peered":"2023-03-03T06:23:44.395100+0000","last_clean":"2023-03-03T06:23:44.395100+0000","last_became_active":"2023-03-03T06:23:40.346966+0000","last_became_peered":"2023-03-03T06:23:40.346966+0000","last_unstale":"2023-03-03T06:23:44.395100+0000","last_undegraded":"2023-03-03T06:23:44.395100+0000","last_fullsized":"2023-03-03T06:23:44.395100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:50.785469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394027+0000","last_change":"2023-03-03T06:23:40.337391+0000","last_active":"2023-03-03T06:23:44.394027+0000","last_peered":"2023-03-03T06:23:44.394027+0000","last_clean":"2023-03-03T06:23:44.394027+0000","last_became_active":"2023-03-03T06:23:40.337119+0000","last_became_peered":"2023-03-03T06:23:40.337119+0000","last_unstale":"2023-03-03T06:23:44.394027+0000","last_undegraded":"2023-03-03T06:23:44.394027+0000","last_fullsized":"2023-03-03T06:23:44.394027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:21.332075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398880+0000","last_change":"2023-03-03T06:23:40.334786+0000","last_active":"2023-03-03T06:23:44.398880+0000","last_peered":"2023-03-03T06:23:44.398880+0000","last_clean":"2023-03-03T06:23:44.398880+0000","last_became_active":"2023-03-03T06:23:40.334489+0000","last_became_peered":"2023-03-03T06:23:40.334489+0000","last_unstale":"2023-03-03T06:23:44.398880+0000","last_undegraded":"2023-03-03T06:23:44.398880+0000","last_fullsized":"2023-03-03T06:23:44.398880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407409+0000","last_change":"2023-03-03T06:23:40.346226+0000","last_active":"2023-03-03T06:23:44.407409+0000","last_peered":"2023-03-03T06:23:44.407409+0000","last_clean":"2023-03-03T06:23:44.407409+0000","last_became_active":"2023-03-03T06:23:40.345791+0000","last_became_peered":"2023-03-03T06:23:40.345791+0000","last_unstale":"2023-03-03T06:23:44.407409+0000","last_undegraded":"2023-03-03T06:23:44.407409+0000","last_fullsized":"2023-03-03T06:23:44.407409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:17.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398869+0000","last_change":"2023-03-03T06:23:40.344976+0000","last_active":"2023-03-03T06:23:44.398869+0000","last_peered":"2023-03-03T06:23:44.398869+0000","last_clean":"2023-03-03T06:23:44.398869+0000","last_became_active":"2023-03-03T06:23:40.339923+0000","last_became_peered":"2023-03-03T06:23:40.339923+0000","last_unstale":"2023-03-03T06:23:44.398869+0000","last_undegraded":"2023-03-03T06:23:44.398869+0000","last_fullsized":"2023-03-03T06:23:44.398869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:40:38.222408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414475+0000","last_change":"2023-03-03T06:23:40.342480+0000","last_active":"2023-03-03T06:23:44.414475+0000","last_peered":"2023-03-03T06:23:44.414475+0000","last_clean":"2023-03-03T06:23:44.414475+0000","last_became_active":"2023-03-03T06:23:40.339835+0000","last_became_peered":"2023-03-03T06:23:40.339835+0000","last_unstale":"2023-03-03T06:23:44.414475+0000","last_undegraded":"2023-03-03T06:23:44.414475+0000","last_fullsized":"2023-03-03T06:23:44.414475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:57:56.186885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398423+0000","last_change":"2023-03-03T06:23:40.340711+0000","last_active":"2023-03-03T06:23:44.398423+0000","last_peered":"2023-03-03T06:23:44.398423+0000","last_clean":"2023-03-03T06:23:44.398423+0000","last_became_active":"2023-03-03T06:23:40.340400+0000","last_became_peered":"2023-03-03T06:23:40.340400+0000","last_unstale":"2023-03-03T06:23:44.398423+0000","last_undegraded":"2023-03-03T06:23:44.398423+0000","last_fullsized":"2023-03-03T06:23:44.398423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:38:27.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394986+0000","last_change":"2023-03-03T06:23:40.335402+0000","last_active":"2023-03-03T06:23:44.394986+0000","last_peered":"2023-03-03T06:23:44.394986+0000","last_clean":"2023-03-03T06:23:44.394986+0000","last_became_active":"2023-03-03T06:23:40.335101+0000","last_became_peered":"2023-03-03T06:23:40.335101+0000","last_unstale":"2023-03-03T06:23:44.394986+0000","last_undegraded":"2023-03-03T06:23:44.394986+0000","last_fullsized":"2023-03-03T06:23:44.394986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:41.969182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397647+0000","last_change":"2023-03-03T06:23:40.347472+0000","last_active":"2023-03-03T06:23:44.397647+0000","last_peered":"2023-03-03T06:23:44.397647+0000","last_clean":"2023-03-03T06:23:44.397647+0000","last_became_active":"2023-03-03T06:23:40.345241+0000","last_became_peered":"2023-03-03T06:23:40.345241+0000","last_unstale":"2023-03-03T06:23:44.397647+0000","last_undegraded":"2023-03-03T06:23:44.397647+0000","last_fullsized":"2023-03-03T06:23:44.397647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:59:25.244715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407721+0000","last_change":"2023-03-03T06:23:40.352895+0000","last_active":"2023-03-03T06:23:44.407721+0000","last_peered":"2023-03-03T06:23:44.407721+0000","last_clean":"2023-03-03T06:23:44.407721+0000","last_became_active":"2023-03-03T06:23:40.352576+0000","last_became_peered":"2023-03-03T06:23:40.352576+0000","last_unstale":"2023-03-03T06:23:44.407721+0000","last_undegraded":"2023-03-03T06:23:44.407721+0000","last_fullsized":"2023-03-03T06:23:44.407721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407761+0000","last_change":"2023-03-03T06:23:40.329918+0000","last_active":"2023-03-03T06:23:44.407761+0000","last_peered":"2023-03-03T06:23:44.407761+0000","last_clean":"2023-03-03T06:23:44.407761+0000","last_became_active":"2023-03-03T06:23:40.327770+0000","last_became_peered":"2023-03-03T06:23:40.327770+0000","last_unstale":"2023-03-03T06:23:44.407761+0000","last_undegraded":"2023-03-03T06:23:44.407761+0000","last_fullsized":"2023-03-03T06:23:44.407761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396955+0000","last_change":"2023-03-03T06:23:40.341354+0000","last_active":"2023-03-03T06:23:44.396955+0000","last_peered":"2023-03-03T06:23:44.396955+0000","last_clean":"2023-03-03T06:23:44.396955+0000","last_became_active":"2023-03-03T06:23:40.341048+0000","last_became_peered":"2023-03-03T06:23:40.341048+0000","last_unstale":"2023-03-03T06:23:44.396955+0000","last_undegraded":"2023-03-03T06:23:44.396955+0000","last_fullsized":"2023-03-03T06:23:44.396955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:59:25.244715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407568+0000","last_change":"2023-03-03T06:23:40.352581+0000","last_active":"2023-03-03T06:23:44.407568+0000","last_peered":"2023-03-03T06:23:44.407568+0000","last_clean":"2023-03-03T06:23:44.407568+0000","last_became_active":"2023-03-03T06:23:40.352290+0000","last_became_peered":"2023-03-03T06:23:40.352290+0000","last_unstale":"2023-03-03T06:23:44.407568+0000","last_undegraded":"2023-03-03T06:23:44.407568+0000","last_fullsized":"2023-03-03T06:23:44.407568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408648+0000","last_change":"2023-03-03T06:23:40.337724+0000","last_active":"2023-03-03T06:23:44.408648+0000","last_peered":"2023-03-03T06:23:44.408648+0000","last_clean":"2023-03-03T06:23:44.408648+0000","last_became_active":"2023-03-03T06:23:40.337448+0000","last_became_peered":"2023-03-03T06:23:40.337448+0000","last_unstale":"2023-03-03T06:23:44.408648+0000","last_undegraded":"2023-03-03T06:23:44.408648+0000","last_fullsized":"2023-03-03T06:23:44.408648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:37.500862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407962+0000","last_change":"2023-03-03T06:23:40.326813+0000","last_active":"2023-03-03T06:23:44.407962+0000","last_peered":"2023-03-03T06:23:44.407962+0000","last_clean":"2023-03-03T06:23:44.407962+0000","last_became_active":"2023-03-03T06:23:40.326512+0000","last_became_peered":"2023-03-03T06:23:40.326512+0000","last_unstale":"2023-03-03T06:23:44.407962+0000","last_undegraded":"2023-03-03T06:23:44.407962+0000","last_fullsized":"2023-03-03T06:23:44.407962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:40.681483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400716+0000","last_change":"2023-03-03T06:23:40.347745+0000","last_active":"2023-03-03T06:23:44.400716+0000","last_peered":"2023-03-03T06:23:44.400716+0000","last_clean":"2023-03-03T06:23:44.400716+0000","last_became_active":"2023-03-03T06:23:40.347373+0000","last_became_peered":"2023-03-03T06:23:40.347373+0000","last_unstale":"2023-03-03T06:23:44.400716+0000","last_undegraded":"2023-03-03T06:23:44.400716+0000","last_fullsized":"2023-03-03T06:23:44.400716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:00.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823247+0000","last_change":"2023-03-03T06:23:44.411770+0000","last_active":"2023-03-03T06:23:44.823247+0000","last_peered":"2023-03-03T06:23:44.823247+0000","last_clean":"2023-03-03T06:23:44.823247+0000","last_became_active":"2023-03-03T06:23:44.411103+0000","last_became_peered":"2023-03-03T06:23:44.411103+0000","last_unstale":"2023-03-03T06:23:44.823247+0000","last_undegraded":"2023-03-03T06:23:44.823247+0000","last_fullsized":"2023-03-03T06:23:44.823247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:52:34.159164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396733+0000","last_change":"2023-03-03T06:23:39.912910+0000","last_active":"2023-03-03T06:23:44.396733+0000","last_peered":"2023-03-03T06:23:44.396733+0000","last_clean":"2023-03-03T06:23:44.396733+0000","last_became_active":"2023-03-03T06:23:39.912705+0000","last_became_peered":"2023-03-03T06:23:39.912705+0000","last_unstale":"2023-03-03T06:23:44.396733+0000","last_undegraded":"2023-03-03T06:23:44.396733+0000","last_fullsized":"2023-03-03T06:23:44.396733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:37.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397715+0000","last_change":"2023-03-03T06:23:40.340849+0000","last_active":"2023-03-03T06:23:44.397715+0000","last_peered":"2023-03-03T06:23:44.397715+0000","last_clean":"2023-03-03T06:23:44.397715+0000","last_became_active":"2023-03-03T06:23:40.340540+0000","last_became_peered":"2023-03-03T06:23:40.340540+0000","last_unstale":"2023-03-03T06:23:44.397715+0000","last_undegraded":"2023-03-03T06:23:44.397715+0000","last_fullsized":"2023-03-03T06:23:44.397715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:57:56.186885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216333+0000","last_change":"2023-03-03T06:23:44.420347+0000","last_active":"2023-03-03T06:23:45.216333+0000","last_peered":"2023-03-03T06:23:45.216333+0000","last_clean":"2023-03-03T06:23:45.216333+0000","last_became_active":"2023-03-03T06:23:44.419965+0000","last_became_peered":"2023-03-03T06:23:44.419965+0000","last_unstale":"2023-03-03T06:23:45.216333+0000","last_undegraded":"2023-03-03T06:23:45.216333+0000","last_fullsized":"2023-03-03T06:23:45.216333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:59:28.743422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407154+0000","last_change":"2023-03-03T06:23:39.918145+0000","last_active":"2023-03-03T06:23:44.407154+0000","last_peered":"2023-03-03T06:23:44.407154+0000","last_clean":"2023-03-03T06:23:44.407154+0000","last_became_active":"2023-03-03T06:23:39.917834+0000","last_became_peered":"2023-03-03T06:23:39.917834+0000","last_unstale":"2023-03-03T06:23:44.407154+0000","last_undegraded":"2023-03-03T06:23:44.407154+0000","last_fullsized":"2023-03-03T06:23:44.407154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:37.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.412328+0000","last_change":"2023-03-03T06:23:40.345943+0000","last_active":"2023-03-03T06:23:44.412328+0000","last_peered":"2023-03-03T06:23:44.412328+0000","last_clean":"2023-03-03T06:23:44.412328+0000","last_became_active":"2023-03-03T06:23:40.345683+0000","last_became_peered":"2023-03-03T06:23:40.345683+0000","last_unstale":"2023-03-03T06:23:44.412328+0000","last_undegraded":"2023-03-03T06:23:44.412328+0000","last_fullsized":"2023-03-03T06:23:44.412328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011235+0000","last_change":"2023-03-03T06:23:44.419798+0000","last_active":"2023-03-03T06:23:45.011235+0000","last_peered":"2023-03-03T06:23:45.011235+0000","last_clean":"2023-03-03T06:23:45.011235+0000","last_became_active":"2023-03-03T06:23:44.419371+0000","last_became_peered":"2023-03-03T06:23:44.419371+0000","last_unstale":"2023-03-03T06:23:45.011235+0000","last_undegraded":"2023-03-03T06:23:45.011235+0000","last_fullsized":"2023-03-03T06:23:45.011235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:23.008849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400964+0000","last_change":"2023-03-03T06:23:39.914431+0000","last_active":"2023-03-03T06:23:44.400964+0000","last_peered":"2023-03-03T06:23:44.400964+0000","last_clean":"2023-03-03T06:23:44.400964+0000","last_became_active":"2023-03-03T06:23:39.914144+0000","last_became_peered":"2023-03-03T06:23:39.914144+0000","last_unstale":"2023-03-03T06:23:44.400964+0000","last_undegraded":"2023-03-03T06:23:44.400964+0000","last_fullsized":"2023-03-03T06:23:44.400964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406907+0000","last_change":"2023-03-03T06:23:40.335787+0000","last_active":"2023-03-03T06:23:44.406907+0000","last_peered":"2023-03-03T06:23:44.406907+0000","last_clean":"2023-03-03T06:23:44.406907+0000","last_became_active":"2023-03-03T06:23:40.334558+0000","last_became_peered":"2023-03-03T06:23:40.334558+0000","last_unstale":"2023-03-03T06:23:44.406907+0000","last_undegraded":"2023-03-03T06:23:44.406907+0000","last_fullsized":"2023-03-03T06:23:44.406907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:37.500862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215801+0000","last_change":"2023-03-03T06:23:44.418674+0000","last_active":"2023-03-03T06:23:45.215801+0000","last_peered":"2023-03-03T06:23:45.215801+0000","last_clean":"2023-03-03T06:23:45.215801+0000","last_became_active":"2023-03-03T06:23:44.418172+0000","last_became_peered":"2023-03-03T06:23:44.418172+0000","last_unstale":"2023-03-03T06:23:45.215801+0000","last_undegraded":"2023-03-03T06:23:45.215801+0000","last_fullsized":"2023-03-03T06:23:45.215801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:30.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414570+0000","last_change":"2023-03-03T06:23:39.911332+0000","last_active":"2023-03-03T06:23:44.414570+0000","last_peered":"2023-03-03T06:23:44.414570+0000","last_clean":"2023-03-03T06:23:44.414570+0000","last_became_active":"2023-03-03T06:23:39.910856+0000","last_became_peered":"2023-03-03T06:23:39.910856+0000","last_unstale":"2023-03-03T06:23:44.414570+0000","last_undegraded":"2023-03-03T06:23:44.414570+0000","last_fullsized":"2023-03-03T06:23:44.414570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:20.326465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397441+0000","last_change":"2023-03-03T06:23:40.339157+0000","last_active":"2023-03-03T06:23:44.397441+0000","last_peered":"2023-03-03T06:23:44.397441+0000","last_clean":"2023-03-03T06:23:44.397441+0000","last_became_active":"2023-03-03T06:23:40.338695+0000","last_became_peered":"2023-03-03T06:23:40.338695+0000","last_unstale":"2023-03-03T06:23:44.397441+0000","last_undegraded":"2023-03-03T06:23:44.397441+0000","last_fullsized":"2023-03-03T06:23:44.397441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:50.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216248+0000","last_change":"2023-03-03T06:23:44.424307+0000","last_active":"2023-03-03T06:23:45.216248+0000","last_peered":"2023-03-03T06:23:45.216248+0000","last_clean":"2023-03-03T06:23:45.216248+0000","last_became_active":"2023-03-03T06:23:44.423879+0000","last_became_peered":"2023-03-03T06:23:44.423879+0000","last_unstale":"2023-03-03T06:23:45.216248+0000","last_undegraded":"2023-03-03T06:23:45.216248+0000","last_fullsized":"2023-03-03T06:23:45.216248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:38:30.824125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400916+0000","last_change":"2023-03-03T06:23:39.911774+0000","last_active":"2023-03-03T06:23:44.400916+0000","last_peered":"2023-03-03T06:23:44.400916+0000","last_clean":"2023-03-03T06:23:44.400916+0000","last_became_active":"2023-03-03T06:23:39.911466+0000","last_became_peered":"2023-03-03T06:23:39.911466+0000","last_unstale":"2023-03-03T06:23:44.400916+0000","last_undegraded":"2023-03-03T06:23:44.400916+0000","last_fullsized":"2023-03-03T06:23:44.400916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:59:20.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396740+0000","last_change":"2023-03-03T06:23:40.341958+0000","last_active":"2023-03-03T06:23:44.396740+0000","last_peered":"2023-03-03T06:23:44.396740+0000","last_clean":"2023-03-03T06:23:44.396740+0000","last_became_active":"2023-03-03T06:23:40.341680+0000","last_became_peered":"2023-03-03T06:23:40.341680+0000","last_unstale":"2023-03-03T06:23:44.396740+0000","last_undegraded":"2023-03-03T06:23:44.396740+0000","last_fullsized":"2023-03-03T06:23:44.396740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:29:39.720198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822803+0000","last_change":"2023-03-03T06:23:44.424858+0000","last_active":"2023-03-03T06:23:44.822803+0000","last_peered":"2023-03-03T06:23:44.822803+0000","last_clean":"2023-03-03T06:23:44.822803+0000","last_became_active":"2023-03-03T06:23:44.424438+0000","last_became_peered":"2023-03-03T06:23:44.424438+0000","last_unstale":"2023-03-03T06:23:44.822803+0000","last_undegraded":"2023-03-03T06:23:44.822803+0000","last_fullsized":"2023-03-03T06:23:44.822803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:35:59.351177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408603+0000","last_change":"2023-03-03T06:23:39.917383+0000","last_active":"2023-03-03T06:23:44.408603+0000","last_peered":"2023-03-03T06:23:44.408603+0000","last_clean":"2023-03-03T06:23:44.408603+0000","last_became_active":"2023-03-03T06:23:39.917126+0000","last_became_peered":"2023-03-03T06:23:39.917126+0000","last_unstale":"2023-03-03T06:23:44.408603+0000","last_undegraded":"2023-03-03T06:23:44.408603+0000","last_fullsized":"2023-03-03T06:23:44.408603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:05:12.217423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406922+0000","last_change":"2023-03-03T06:23:40.336079+0000","last_active":"2023-03-03T06:23:44.406922+0000","last_peered":"2023-03-03T06:23:44.406922+0000","last_clean":"2023-03-03T06:23:44.406922+0000","last_became_active":"2023-03-03T06:23:40.335809+0000","last_became_peered":"2023-03-03T06:23:40.335809+0000","last_unstale":"2023-03-03T06:23:44.406922+0000","last_undegraded":"2023-03-03T06:23:44.406922+0000","last_fullsized":"2023-03-03T06:23:44.406922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:05:13.223033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823271+0000","last_change":"2023-03-03T06:23:44.417871+0000","last_active":"2023-03-03T06:23:44.823271+0000","last_peered":"2023-03-03T06:23:44.823271+0000","last_clean":"2023-03-03T06:23:44.823271+0000","last_became_active":"2023-03-03T06:23:44.417470+0000","last_became_peered":"2023-03-03T06:23:44.417470+0000","last_unstale":"2023-03-03T06:23:44.823271+0000","last_undegraded":"2023-03-03T06:23:44.823271+0000","last_fullsized":"2023-03-03T06:23:44.823271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:22:48.378893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:55.871487+0000","last_change":"2023-03-03T06:23:39.912856+0000","last_active":"2023-03-03T06:23:55.871487+0000","last_peered":"2023-03-03T06:23:55.871487+0000","last_clean":"2023-03-03T06:23:55.871487+0000","last_became_active":"2023-03-03T06:23:39.912563+0000","last_became_peered":"2023-03-03T06:23:39.912563+0000","last_unstale":"2023-03-03T06:23:55.871487+0000","last_undegraded":"2023-03-03T06:23:55.871487+0000","last_fullsized":"2023-03-03T06:23:55.871487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:40.963572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3746,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396312+0000","last_change":"2023-03-03T06:23:40.350272+0000","last_active":"2023-03-03T06:23:44.396312+0000","last_peered":"2023-03-03T06:23:44.396312+0000","last_clean":"2023-03-03T06:23:44.396312+0000","last_became_active":"2023-03-03T06:23:40.349999+0000","last_became_peered":"2023-03-03T06:23:40.349999+0000","last_unstale":"2023-03-03T06:23:44.396312+0000","last_undegraded":"2023-03-03T06:23:44.396312+0000","last_fullsized":"2023-03-03T06:23:44.396312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:00:23.719558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217132+0000","last_change":"2023-03-03T06:23:44.415132+0000","last_active":"2023-03-03T06:23:45.217132+0000","last_peered":"2023-03-03T06:23:45.217132+0000","last_clean":"2023-03-03T06:23:45.217132+0000","last_became_active":"2023-03-03T06:23:44.414671+0000","last_became_peered":"2023-03-03T06:23:44.414671+0000","last_unstale":"2023-03-03T06:23:45.217132+0000","last_undegraded":"2023-03-03T06:23:45.217132+0000","last_fullsized":"2023-03-03T06:23:45.217132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:03:14.816505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407616+0000","last_change":"2023-03-03T06:23:39.918682+0000","last_active":"2023-03-03T06:23:44.407616+0000","last_peered":"2023-03-03T06:23:44.407616+0000","last_clean":"2023-03-03T06:23:44.407616+0000","last_became_active":"2023-03-03T06:23:39.918360+0000","last_became_peered":"2023-03-03T06:23:39.918360+0000","last_unstale":"2023-03-03T06:23:44.407616+0000","last_undegraded":"2023-03-03T06:23:44.407616+0000","last_fullsized":"2023-03-03T06:23:44.407616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:19:38.164048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399298+0000","last_change":"2023-03-03T06:23:40.341375+0000","last_active":"2023-03-03T06:23:44.399298+0000","last_peered":"2023-03-03T06:23:44.399298+0000","last_clean":"2023-03-03T06:23:44.399298+0000","last_became_active":"2023-03-03T06:23:40.339213+0000","last_became_peered":"2023-03-03T06:23:40.339213+0000","last_unstale":"2023-03-03T06:23:44.399298+0000","last_undegraded":"2023-03-03T06:23:44.399298+0000","last_fullsized":"2023-03-03T06:23:44.399298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:27.072231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823348+0000","last_change":"2023-03-03T06:23:44.414871+0000","last_active":"2023-03-03T06:23:44.823348+0000","last_peered":"2023-03-03T06:23:44.823348+0000","last_clean":"2023-03-03T06:23:44.823348+0000","last_became_active":"2023-03-03T06:23:44.414346+0000","last_became_peered":"2023-03-03T06:23:44.414346+0000","last_unstale":"2023-03-03T06:23:44.823348+0000","last_undegraded":"2023-03-03T06:23:44.823348+0000","last_fullsized":"2023-03-03T06:23:44.823348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:40:15.816562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407908+0000","last_change":"2023-03-03T06:23:39.912556+0000","last_active":"2023-03-03T06:23:44.407908+0000","last_peered":"2023-03-03T06:23:44.407908+0000","last_clean":"2023-03-03T06:23:44.407908+0000","last_became_active":"2023-03-03T06:23:39.912270+0000","last_became_peered":"2023-03-03T06:23:39.912270+0000","last_unstale":"2023-03-03T06:23:44.407908+0000","last_undegraded":"2023-03-03T06:23:44.407908+0000","last_fullsized":"2023-03-03T06:23:44.407908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:59:20.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400650+0000","last_change":"2023-03-03T06:23:40.347443+0000","last_active":"2023-03-03T06:23:44.400650+0000","last_peered":"2023-03-03T06:23:44.400650+0000","last_clean":"2023-03-03T06:23:44.400650+0000","last_became_active":"2023-03-03T06:23:40.347157+0000","last_became_peered":"2023-03-03T06:23:40.347157+0000","last_unstale":"2023-03-03T06:23:44.400650+0000","last_undegraded":"2023-03-03T06:23:44.400650+0000","last_fullsized":"2023-03-03T06:23:44.400650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:17.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823445+0000","last_change":"2023-03-03T06:23:44.424679+0000","last_active":"2023-03-03T06:23:44.823445+0000","last_peered":"2023-03-03T06:23:44.823445+0000","last_clean":"2023-03-03T06:23:44.823445+0000","last_became_active":"2023-03-03T06:23:44.424312+0000","last_became_peered":"2023-03-03T06:23:44.424312+0000","last_unstale":"2023-03-03T06:23:44.823445+0000","last_undegraded":"2023-03-03T06:23:44.823445+0000","last_fullsized":"2023-03-03T06:23:44.823445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:20:21.108272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407408+0000","last_change":"2023-03-03T06:23:39.916648+0000","last_active":"2023-03-03T06:23:44.407408+0000","last_peered":"2023-03-03T06:23:44.407408+0000","last_clean":"2023-03-03T06:23:44.407408+0000","last_became_active":"2023-03-03T06:23:39.916366+0000","last_became_peered":"2023-03-03T06:23:39.916366+0000","last_unstale":"2023-03-03T06:23:44.407408+0000","last_undegraded":"2023-03-03T06:23:44.407408+0000","last_fullsized":"2023-03-03T06:23:44.407408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:18:36.597804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.412508+0000","last_change":"2023-03-03T06:23:40.340155+0000","last_active":"2023-03-03T06:23:44.412508+0000","last_peered":"2023-03-03T06:23:44.412508+0000","last_clean":"2023-03-03T06:23:44.412508+0000","last_became_active":"2023-03-03T06:23:40.339896+0000","last_became_peered":"2023-03-03T06:23:40.339896+0000","last_unstale":"2023-03-03T06:23:44.412508+0000","last_undegraded":"2023-03-03T06:23:44.412508+0000","last_fullsized":"2023-03-03T06:23:44.412508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:29:39.720198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216910+0000","last_change":"2023-03-03T06:23:44.415321+0000","last_active":"2023-03-03T06:23:45.216910+0000","last_peered":"2023-03-03T06:23:45.216910+0000","last_clean":"2023-03-03T06:23:45.216910+0000","last_became_active":"2023-03-03T06:23:44.414916+0000","last_became_peered":"2023-03-03T06:23:44.414916+0000","last_unstale":"2023-03-03T06:23:45.216910+0000","last_undegraded":"2023-03-03T06:23:45.216910+0000","last_fullsized":"2023-03-03T06:23:45.216910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:50:31.688270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406117+0000","last_change":"2023-03-03T06:23:39.908842+0000","last_active":"2023-03-03T06:23:44.406117+0000","last_peered":"2023-03-03T06:23:44.406117+0000","last_clean":"2023-03-03T06:23:44.406117+0000","last_became_active":"2023-03-03T06:23:39.908540+0000","last_became_peered":"2023-03-03T06:23:39.908540+0000","last_unstale":"2023-03-03T06:23:44.406117+0000","last_undegraded":"2023-03-03T06:23:44.406117+0000","last_fullsized":"2023-03-03T06:23:44.406117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.403220+0000","last_change":"2023-03-03T06:23:40.348336+0000","last_active":"2023-03-03T06:23:44.403220+0000","last_peered":"2023-03-03T06:23:44.403220+0000","last_clean":"2023-03-03T06:23:44.403220+0000","last_became_active":"2023-03-03T06:23:40.348074+0000","last_became_peered":"2023-03-03T06:23:40.348074+0000","last_unstale":"2023-03-03T06:23:44.403220+0000","last_undegraded":"2023-03-03T06:23:44.403220+0000","last_fullsized":"2023-03-03T06:23:44.403220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.218118+0000","last_change":"2023-03-03T06:23:44.425304+0000","last_active":"2023-03-03T06:23:45.218118+0000","last_peered":"2023-03-03T06:23:45.218118+0000","last_clean":"2023-03-03T06:23:45.218118+0000","last_became_active":"2023-03-03T06:23:44.424821+0000","last_became_peered":"2023-03-03T06:23:44.424821+0000","last_unstale":"2023-03-03T06:23:45.218118+0000","last_undegraded":"2023-03-03T06:23:45.218118+0000","last_fullsized":"2023-03-03T06:23:45.218118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:45:29.403205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.410402+0000","last_change":"2023-03-03T06:23:39.916608+0000","last_active":"2023-03-03T06:23:44.410402+0000","last_peered":"2023-03-03T06:23:44.410402+0000","last_clean":"2023-03-03T06:23:44.410402+0000","last_became_active":"2023-03-03T06:23:39.916307+0000","last_became_peered":"2023-03-03T06:23:39.916307+0000","last_unstale":"2023-03-03T06:23:44.410402+0000","last_undegraded":"2023-03-03T06:23:44.410402+0000","last_fullsized":"2023-03-03T06:23:44.410402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:36.495252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398185+0000","last_change":"2023-03-03T06:23:40.347737+0000","last_active":"2023-03-03T06:23:44.398185+0000","last_peered":"2023-03-03T06:23:44.398185+0000","last_clean":"2023-03-03T06:23:44.398185+0000","last_became_active":"2023-03-03T06:23:40.347002+0000","last_became_peered":"2023-03-03T06:23:40.347002+0000","last_unstale":"2023-03-03T06:23:44.398185+0000","last_undegraded":"2023-03-03T06:23:44.398185+0000","last_fullsized":"2023-03-03T06:23:44.398185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215709+0000","last_change":"2023-03-03T06:23:44.424830+0000","last_active":"2023-03-03T06:23:45.215709+0000","last_peered":"2023-03-03T06:23:45.215709+0000","last_clean":"2023-03-03T06:23:45.215709+0000","last_became_active":"2023-03-03T06:23:44.424435+0000","last_became_peered":"2023-03-03T06:23:44.424435+0000","last_unstale":"2023-03-03T06:23:45.215709+0000","last_undegraded":"2023-03-03T06:23:45.215709+0000","last_fullsized":"2023-03-03T06:23:45.215709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:29.892281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408855+0000","last_change":"2023-03-03T06:23:39.916989+0000","last_active":"2023-03-03T06:23:44.408855+0000","last_peered":"2023-03-03T06:23:44.408855+0000","last_clean":"2023-03-03T06:23:44.408855+0000","last_became_active":"2023-03-03T06:23:39.916686+0000","last_became_peered":"2023-03-03T06:23:39.916686+0000","last_unstale":"2023-03-03T06:23:44.408855+0000","last_undegraded":"2023-03-03T06:23:44.408855+0000","last_fullsized":"2023-03-03T06:23:44.408855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:04:17.846504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397402+0000","last_change":"2023-03-03T06:23:40.344010+0000","last_active":"2023-03-03T06:23:44.397402+0000","last_peered":"2023-03-03T06:23:44.397402+0000","last_clean":"2023-03-03T06:23:44.397402+0000","last_became_active":"2023-03-03T06:23:40.340204+0000","last_became_peered":"2023-03-03T06:23:40.340204+0000","last_unstale":"2023-03-03T06:23:44.397402+0000","last_undegraded":"2023-03-03T06:23:44.397402+0000","last_fullsized":"2023-03-03T06:23:44.397402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:57:56.186885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215937+0000","last_change":"2023-03-03T06:23:44.413387+0000","last_active":"2023-03-03T06:23:45.215937+0000","last_peered":"2023-03-03T06:23:45.215937+0000","last_clean":"2023-03-03T06:23:45.215937+0000","last_became_active":"2023-03-03T06:23:44.412643+0000","last_became_peered":"2023-03-03T06:23:44.412643+0000","last_unstale":"2023-03-03T06:23:45.215937+0000","last_undegraded":"2023-03-03T06:23:45.215937+0000","last_fullsized":"2023-03-03T06:23:45.215937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:11:57.156702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408463+0000","last_change":"2023-03-03T06:23:39.911757+0000","last_active":"2023-03-03T06:23:44.408463+0000","last_peered":"2023-03-03T06:23:44.408463+0000","last_clean":"2023-03-03T06:23:44.408463+0000","last_became_active":"2023-03-03T06:23:39.911430+0000","last_became_peered":"2023-03-03T06:23:39.911430+0000","last_unstale":"2023-03-03T06:23:44.408463+0000","last_undegraded":"2023-03-03T06:23:44.408463+0000","last_fullsized":"2023-03-03T06:23:44.408463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:30:04.252933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406464+0000","last_change":"2023-03-03T06:23:40.338136+0000","last_active":"2023-03-03T06:23:44.406464+0000","last_peered":"2023-03-03T06:23:44.406464+0000","last_clean":"2023-03-03T06:23:44.406464+0000","last_became_active":"2023-03-03T06:23:40.337828+0000","last_became_peered":"2023-03-03T06:23:40.337828+0000","last_unstale":"2023-03-03T06:23:44.406464+0000","last_undegraded":"2023-03-03T06:23:44.406464+0000","last_fullsized":"2023-03-03T06:23:44.406464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:30:05.258542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215914+0000","last_change":"2023-03-03T06:23:44.413004+0000","last_active":"2023-03-03T06:23:45.215914+0000","last_peered":"2023-03-03T06:23:45.215914+0000","last_clean":"2023-03-03T06:23:45.215914+0000","last_became_active":"2023-03-03T06:23:44.412564+0000","last_became_peered":"2023-03-03T06:23:44.412564+0000","last_unstale":"2023-03-03T06:23:45.215914+0000","last_undegraded":"2023-03-03T06:23:45.215914+0000","last_fullsized":"2023-03-03T06:23:45.215914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:16.090224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399592+0000","last_change":"2023-03-03T06:23:39.916059+0000","last_active":"2023-03-03T06:23:44.399592+0000","last_peered":"2023-03-03T06:23:44.399592+0000","last_clean":"2023-03-03T06:23:44.399592+0000","last_became_active":"2023-03-03T06:23:39.915796+0000","last_became_peered":"2023-03-03T06:23:39.915796+0000","last_unstale":"2023-03-03T06:23:44.399592+0000","last_undegraded":"2023-03-03T06:23:44.399592+0000","last_fullsized":"2023-03-03T06:23:44.399592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413796+0000","last_change":"2023-03-03T06:23:40.331555+0000","last_active":"2023-03-03T06:23:44.413796+0000","last_peered":"2023-03-03T06:23:44.413796+0000","last_clean":"2023-03-03T06:23:44.413796+0000","last_became_active":"2023-03-03T06:23:40.331304+0000","last_became_peered":"2023-03-03T06:23:40.331304+0000","last_unstale":"2023-03-03T06:23:44.413796+0000","last_undegraded":"2023-03-03T06:23:44.413796+0000","last_fullsized":"2023-03-03T06:23:44.413796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215910+0000","last_change":"2023-03-03T06:23:44.413292+0000","last_active":"2023-03-03T06:23:45.215910+0000","last_peered":"2023-03-03T06:23:45.215910+0000","last_clean":"2023-03-03T06:23:45.215910+0000","last_became_active":"2023-03-03T06:23:44.412668+0000","last_became_peered":"2023-03-03T06:23:44.412668+0000","last_unstale":"2023-03-03T06:23:45.215910+0000","last_undegraded":"2023-03-03T06:23:45.215910+0000","last_fullsized":"2023-03-03T06:23:45.215910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:42:28.966046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401269+0000","last_change":"2023-03-03T06:23:39.917500+0000","last_active":"2023-03-03T06:23:44.401269+0000","last_peered":"2023-03-03T06:23:44.401269+0000","last_clean":"2023-03-03T06:23:44.401269+0000","last_became_active":"2023-03-03T06:23:39.917201+0000","last_became_peered":"2023-03-03T06:23:39.917201+0000","last_unstale":"2023-03-03T06:23:44.401269+0000","last_undegraded":"2023-03-03T06:23:44.401269+0000","last_fullsized":"2023-03-03T06:23:44.401269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:44.071696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396883+0000","last_change":"2023-03-03T06:23:40.347773+0000","last_active":"2023-03-03T06:23:44.396883+0000","last_peered":"2023-03-03T06:23:44.396883+0000","last_clean":"2023-03-03T06:23:44.396883+0000","last_became_active":"2023-03-03T06:23:40.346824+0000","last_became_peered":"2023-03-03T06:23:40.346824+0000","last_unstale":"2023-03-03T06:23:44.396883+0000","last_undegraded":"2023-03-03T06:23:44.396883+0000","last_fullsized":"2023-03-03T06:23:44.396883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:50.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.821697+0000","last_change":"2023-03-03T06:23:44.413742+0000","last_active":"2023-03-03T06:23:44.821697+0000","last_peered":"2023-03-03T06:23:44.821697+0000","last_clean":"2023-03-03T06:23:44.821697+0000","last_became_active":"2023-03-03T06:23:44.413323+0000","last_became_peered":"2023-03-03T06:23:44.413323+0000","last_unstale":"2023-03-03T06:23:44.821697+0000","last_undegraded":"2023-03-03T06:23:44.821697+0000","last_fullsized":"2023-03-03T06:23:44.821697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:50:31.688270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406544+0000","last_change":"2023-03-03T06:23:39.916329+0000","last_active":"2023-03-03T06:23:44.406544+0000","last_peered":"2023-03-03T06:23:44.406544+0000","last_clean":"2023-03-03T06:23:44.406544+0000","last_became_active":"2023-03-03T06:23:39.916060+0000","last_became_peered":"2023-03-03T06:23:39.916060+0000","last_unstale":"2023-03-03T06:23:44.406544+0000","last_undegraded":"2023-03-03T06:23:44.406544+0000","last_fullsized":"2023-03-03T06:23:44.406544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:37.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.395753+0000","last_change":"2023-03-03T06:23:40.349832+0000","last_active":"2023-03-03T06:23:44.395753+0000","last_peered":"2023-03-03T06:23:44.395753+0000","last_clean":"2023-03-03T06:23:44.395753+0000","last_became_active":"2023-03-03T06:23:40.343955+0000","last_became_peered":"2023-03-03T06:23:40.343955+0000","last_unstale":"2023-03-03T06:23:44.395753+0000","last_undegraded":"2023-03-03T06:23:44.395753+0000","last_fullsized":"2023-03-03T06:23:44.395753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:55:53.505277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217364+0000","last_change":"2023-03-03T06:23:44.417750+0000","last_active":"2023-03-03T06:23:45.217364+0000","last_peered":"2023-03-03T06:23:45.217364+0000","last_clean":"2023-03-03T06:23:45.217364+0000","last_became_active":"2023-03-03T06:23:44.417295+0000","last_became_peered":"2023-03-03T06:23:44.417295+0000","last_unstale":"2023-03-03T06:23:45.217364+0000","last_undegraded":"2023-03-03T06:23:45.217364+0000","last_fullsized":"2023-03-03T06:23:45.217364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:04:21.713427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397226+0000","last_change":"2023-03-03T06:23:39.913064+0000","last_active":"2023-03-03T06:23:44.397226+0000","last_peered":"2023-03-03T06:23:44.397226+0000","last_clean":"2023-03-03T06:23:44.397226+0000","last_became_active":"2023-03-03T06:23:39.912756+0000","last_became_peered":"2023-03-03T06:23:39.912756+0000","last_unstale":"2023-03-03T06:23:44.397226+0000","last_undegraded":"2023-03-03T06:23:44.397226+0000","last_fullsized":"2023-03-03T06:23:44.397226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398500+0000","last_change":"2023-03-03T06:23:40.345016+0000","last_active":"2023-03-03T06:23:44.398500+0000","last_peered":"2023-03-03T06:23:44.398500+0000","last_clean":"2023-03-03T06:23:44.398500+0000","last_became_active":"2023-03-03T06:23:40.340755+0000","last_became_peered":"2023-03-03T06:23:40.340755+0000","last_unstale":"2023-03-03T06:23:44.398500+0000","last_undegraded":"2023-03-03T06:23:44.398500+0000","last_fullsized":"2023-03-03T06:23:44.398500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:26.393574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822613+0000","last_change":"2023-03-03T06:23:44.412105+0000","last_active":"2023-03-03T06:23:44.822613+0000","last_peered":"2023-03-03T06:23:44.822613+0000","last_clean":"2023-03-03T06:23:44.822613+0000","last_became_active":"2023-03-03T06:23:44.411353+0000","last_became_peered":"2023-03-03T06:23:44.411353+0000","last_unstale":"2023-03-03T06:23:44.822613+0000","last_undegraded":"2023-03-03T06:23:44.822613+0000","last_fullsized":"2023-03-03T06:23:44.822613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:23:56.487480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397316+0000","last_change":"2023-03-03T06:23:39.916313+0000","last_active":"2023-03-03T06:23:44.397316+0000","last_peered":"2023-03-03T06:23:44.397316+0000","last_clean":"2023-03-03T06:23:44.397316+0000","last_became_active":"2023-03-03T06:23:39.916058+0000","last_became_peered":"2023-03-03T06:23:39.916058+0000","last_unstale":"2023-03-03T06:23:44.397316+0000","last_undegraded":"2023-03-03T06:23:44.397316+0000","last_fullsized":"2023-03-03T06:23:44.397316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:59:20.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408755+0000","last_change":"2023-03-03T06:23:40.339541+0000","last_active":"2023-03-03T06:23:44.408755+0000","last_peered":"2023-03-03T06:23:44.408755+0000","last_clean":"2023-03-03T06:23:44.408755+0000","last_became_active":"2023-03-03T06:23:40.339291+0000","last_became_peered":"2023-03-03T06:23:40.339291+0000","last_unstale":"2023-03-03T06:23:44.408755+0000","last_undegraded":"2023-03-03T06:23:44.408755+0000","last_fullsized":"2023-03-03T06:23:44.408755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:17.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822768+0000","last_change":"2023-03-03T06:23:44.413275+0000","last_active":"2023-03-03T06:23:44.822768+0000","last_peered":"2023-03-03T06:23:44.822768+0000","last_clean":"2023-03-03T06:23:44.822768+0000","last_became_active":"2023-03-03T06:23:44.412027+0000","last_became_peered":"2023-03-03T06:23:44.412027+0000","last_unstale":"2023-03-03T06:23:44.822768+0000","last_undegraded":"2023-03-03T06:23:44.822768+0000","last_fullsized":"2023-03-03T06:23:44.822768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:46:08.536113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401273+0000","last_change":"2023-03-03T06:23:39.913990+0000","last_active":"2023-03-03T06:23:44.401273+0000","last_peered":"2023-03-03T06:23:44.401273+0000","last_clean":"2023-03-03T06:23:44.401273+0000","last_became_active":"2023-03-03T06:23:39.913721+0000","last_became_peered":"2023-03-03T06:23:39.913721+0000","last_unstale":"2023-03-03T06:23:44.401273+0000","last_undegraded":"2023-03-03T06:23:44.401273+0000","last_fullsized":"2023-03-03T06:23:44.401273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:19:38.164048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.395934+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:23:44.395934+0000","last_peered":"2023-03-03T06:23:44.395934+0000","last_clean":"2023-03-03T06:23:44.395934+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:23:44.395934+0000","last_undegraded":"2023-03-03T06:23:44.395934+0000","last_fullsized":"2023-03-03T06:23:44.395934+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397197+0000","last_change":"2023-03-03T06:23:40.346219+0000","last_active":"2023-03-03T06:23:44.397197+0000","last_peered":"2023-03-03T06:23:44.397197+0000","last_clean":"2023-03-03T06:23:44.397197+0000","last_became_active":"2023-03-03T06:23:40.345907+0000","last_became_peered":"2023-03-03T06:23:40.345907+0000","last_unstale":"2023-03-03T06:23:44.397197+0000","last_undegraded":"2023-03-03T06:23:44.397197+0000","last_fullsized":"2023-03-03T06:23:44.397197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822264+0000","last_change":"2023-03-03T06:23:44.412472+0000","last_active":"2023-03-03T06:23:44.822264+0000","last_peered":"2023-03-03T06:23:44.822264+0000","last_clean":"2023-03-03T06:23:44.822264+0000","last_became_active":"2023-03-03T06:23:44.412106+0000","last_became_peered":"2023-03-03T06:23:44.412106+0000","last_unstale":"2023-03-03T06:23:44.822264+0000","last_undegraded":"2023-03-03T06:23:44.822264+0000","last_fullsized":"2023-03-03T06:23:44.822264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:03:14.816505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406142+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:23:44.406142+0000","last_peered":"2023-03-03T06:23:44.406142+0000","last_clean":"2023-03-03T06:23:44.406142+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:23:44.406142+0000","last_undegraded":"2023-03-03T06:23:44.406142+0000","last_fullsized":"2023-03-03T06:23:44.406142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011109+0000","last_change":"2023-03-03T06:23:39.907672+0000","last_active":"2023-03-03T06:23:45.011109+0000","last_peered":"2023-03-03T06:23:45.011109+0000","last_clean":"2023-03-03T06:23:45.011109+0000","last_became_active":"2023-03-03T06:23:39.907353+0000","last_became_peered":"2023-03-03T06:23:39.907353+0000","last_unstale":"2023-03-03T06:23:45.011109+0000","last_undegraded":"2023-03-03T06:23:45.011109+0000","last_fullsized":"2023-03-03T06:23:45.011109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:44.071696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397317+0000","last_change":"2023-03-03T06:23:40.347947+0000","last_active":"2023-03-03T06:23:44.397317+0000","last_peered":"2023-03-03T06:23:44.397317+0000","last_clean":"2023-03-03T06:23:44.397317+0000","last_became_active":"2023-03-03T06:23:40.347617+0000","last_became_peered":"2023-03-03T06:23:40.347617+0000","last_unstale":"2023-03-03T06:23:44.397317+0000","last_undegraded":"2023-03-03T06:23:44.397317+0000","last_fullsized":"2023-03-03T06:23:44.397317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:27.072231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216962+0000","last_change":"2023-03-03T06:23:44.412431+0000","last_active":"2023-03-03T06:23:45.216962+0000","last_peered":"2023-03-03T06:23:45.216962+0000","last_clean":"2023-03-03T06:23:45.216962+0000","last_became_active":"2023-03-03T06:23:44.411748+0000","last_became_peered":"2023-03-03T06:23:44.411748+0000","last_unstale":"2023-03-03T06:23:45.216962+0000","last_undegraded":"2023-03-03T06:23:45.216962+0000","last_fullsized":"2023-03-03T06:23:45.216962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:40:15.816562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406632+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:23:44.406632+0000","last_peered":"2023-03-03T06:23:44.406632+0000","last_clean":"2023-03-03T06:23:44.406632+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:23:44.406632+0000","last_undegraded":"2023-03-03T06:23:44.406632+0000","last_fullsized":"2023-03-03T06:23:44.406632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407696+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:23:44.407696+0000","last_peered":"2023-03-03T06:23:44.407696+0000","last_clean":"2023-03-03T06:23:44.407696+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:23:44.407696+0000","last_undegraded":"2023-03-03T06:23:44.407696+0000","last_fullsized":"2023-03-03T06:23:44.407696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408209+0000","last_change":"2023-03-03T06:23:39.911633+0000","last_active":"2023-03-03T06:23:44.408209+0000","last_peered":"2023-03-03T06:23:44.408209+0000","last_clean":"2023-03-03T06:23:44.408209+0000","last_became_active":"2023-03-03T06:23:39.911343+0000","last_became_peered":"2023-03-03T06:23:39.911343+0000","last_unstale":"2023-03-03T06:23:44.408209+0000","last_undegraded":"2023-03-03T06:23:44.408209+0000","last_fullsized":"2023-03-03T06:23:44.408209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.412424+0000","last_change":"2023-03-03T06:23:40.331020+0000","last_active":"2023-03-03T06:23:44.412424+0000","last_peered":"2023-03-03T06:23:44.412424+0000","last_clean":"2023-03-03T06:23:44.412424+0000","last_became_active":"2023-03-03T06:23:40.330714+0000","last_became_peered":"2023-03-03T06:23:40.330714+0000","last_unstale":"2023-03-03T06:23:44.412424+0000","last_undegraded":"2023-03-03T06:23:44.412424+0000","last_fullsized":"2023-03-03T06:23:44.412424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:03:45.180190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216187+0000","last_change":"2023-03-03T06:23:44.410983+0000","last_active":"2023-03-03T06:23:45.216187+0000","last_peered":"2023-03-03T06:23:45.216187+0000","last_clean":"2023-03-03T06:23:45.216187+0000","last_became_active":"2023-03-03T06:23:44.410572+0000","last_became_peered":"2023-03-03T06:23:44.410572+0000","last_unstale":"2023-03-03T06:23:45.216187+0000","last_undegraded":"2023-03-03T06:23:45.216187+0000","last_fullsized":"2023-03-03T06:23:45.216187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:30.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408155+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:23:44.408155+0000","last_peered":"2023-03-03T06:23:44.408155+0000","last_clean":"2023-03-03T06:23:44.408155+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:23:44.408155+0000","last_undegraded":"2023-03-03T06:23:44.408155+0000","last_fullsized":"2023-03-03T06:23:44.408155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408305+0000","last_change":"2023-03-03T06:23:39.911439+0000","last_active":"2023-03-03T06:23:44.408305+0000","last_peered":"2023-03-03T06:23:44.408305+0000","last_clean":"2023-03-03T06:23:44.408305+0000","last_became_active":"2023-03-03T06:23:39.910571+0000","last_became_peered":"2023-03-03T06:23:39.910571+0000","last_unstale":"2023-03-03T06:23:44.408305+0000","last_undegraded":"2023-03-03T06:23:44.408305+0000","last_fullsized":"2023-03-03T06:23:44.408305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:05:05.468654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408707+0000","last_change":"2023-03-03T06:23:40.331506+0000","last_active":"2023-03-03T06:23:44.408707+0000","last_peered":"2023-03-03T06:23:44.408707+0000","last_clean":"2023-03-03T06:23:44.408707+0000","last_became_active":"2023-03-03T06:23:40.331225+0000","last_became_peered":"2023-03-03T06:23:40.331225+0000","last_unstale":"2023-03-03T06:23:44.408707+0000","last_undegraded":"2023-03-03T06:23:44.408707+0000","last_fullsized":"2023-03-03T06:23:44.408707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:42:56.190690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217577+0000","last_change":"2023-03-03T06:23:44.424824+0000","last_active":"2023-03-03T06:23:45.217577+0000","last_peered":"2023-03-03T06:23:45.217577+0000","last_clean":"2023-03-03T06:23:45.217577+0000","last_became_active":"2023-03-03T06:23:44.424408+0000","last_became_peered":"2023-03-03T06:23:44.424408+0000","last_unstale":"2023-03-03T06:23:45.217577+0000","last_undegraded":"2023-03-03T06:23:45.217577+0000","last_fullsized":"2023-03-03T06:23:45.217577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:22:48.378893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407463+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:23:44.407463+0000","last_peered":"2023-03-03T06:23:44.407463+0000","last_clean":"2023-03-03T06:23:44.407463+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:23:44.407463+0000","last_undegraded":"2023-03-03T06:23:44.407463+0000","last_fullsized":"2023-03-03T06:23:44.407463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400330+0000","last_change":"2023-03-03T06:23:39.915098+0000","last_active":"2023-03-03T06:23:44.400330+0000","last_peered":"2023-03-03T06:23:44.400330+0000","last_clean":"2023-03-03T06:23:44.400330+0000","last_became_active":"2023-03-03T06:23:39.914785+0000","last_became_peered":"2023-03-03T06:23:39.914785+0000","last_unstale":"2023-03-03T06:23:44.400330+0000","last_undegraded":"2023-03-03T06:23:44.400330+0000","last_fullsized":"2023-03-03T06:23:44.400330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406226+0000","last_change":"2023-03-03T06:23:40.348600+0000","last_active":"2023-03-03T06:23:44.406226+0000","last_peered":"2023-03-03T06:23:44.406226+0000","last_clean":"2023-03-03T06:23:44.406226+0000","last_became_active":"2023-03-03T06:23:40.348139+0000","last_became_peered":"2023-03-03T06:23:40.348139+0000","last_unstale":"2023-03-03T06:23:44.406226+0000","last_undegraded":"2023-03-03T06:23:44.406226+0000","last_fullsized":"2023-03-03T06:23:44.406226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:18:37.603414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011148+0000","last_change":"2023-03-03T06:23:44.416443+0000","last_active":"2023-03-03T06:23:45.011148+0000","last_peered":"2023-03-03T06:23:45.011148+0000","last_clean":"2023-03-03T06:23:45.011148+0000","last_became_active":"2023-03-03T06:23:44.415629+0000","last_became_peered":"2023-03-03T06:23:44.415629+0000","last_unstale":"2023-03-03T06:23:45.011148+0000","last_undegraded":"2023-03-03T06:23:45.011148+0000","last_fullsized":"2023-03-03T06:23:45.011148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:45:29.403205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398099+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:23:44.398099+0000","last_peered":"2023-03-03T06:23:44.398099+0000","last_clean":"2023-03-03T06:23:44.398099+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:23:44.398099+0000","last_undegraded":"2023-03-03T06:23:44.398099+0000","last_fullsized":"2023-03-03T06:23:44.398099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396227+0000","last_change":"2023-03-03T06:23:39.917152+0000","last_active":"2023-03-03T06:23:44.396227+0000","last_peered":"2023-03-03T06:23:44.396227+0000","last_clean":"2023-03-03T06:23:44.396227+0000","last_became_active":"2023-03-03T06:23:39.916712+0000","last_became_peered":"2023-03-03T06:23:39.916712+0000","last_unstale":"2023-03-03T06:23:44.396227+0000","last_undegraded":"2023-03-03T06:23:44.396227+0000","last_fullsized":"2023-03-03T06:23:44.396227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407594+0000","last_change":"2023-03-03T06:23:40.326857+0000","last_active":"2023-03-03T06:23:44.407594+0000","last_peered":"2023-03-03T06:23:44.407594+0000","last_clean":"2023-03-03T06:23:44.407594+0000","last_became_active":"2023-03-03T06:23:40.326623+0000","last_became_peered":"2023-03-03T06:23:40.326623+0000","last_unstale":"2023-03-03T06:23:44.407594+0000","last_undegraded":"2023-03-03T06:23:44.407594+0000","last_fullsized":"2023-03-03T06:23:44.407594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:56:24.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216598+0000","last_change":"2023-03-03T06:23:44.421895+0000","last_active":"2023-03-03T06:23:45.216598+0000","last_peered":"2023-03-03T06:23:45.216598+0000","last_clean":"2023-03-03T06:23:45.216598+0000","last_became_active":"2023-03-03T06:23:44.421563+0000","last_became_peered":"2023-03-03T06:23:44.421563+0000","last_unstale":"2023-03-03T06:23:45.216598+0000","last_undegraded":"2023-03-03T06:23:45.216598+0000","last_fullsized":"2023-03-03T06:23:45.216598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:42:28.966046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406284+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:23:44.406284+0000","last_peered":"2023-03-03T06:23:44.406284+0000","last_clean":"2023-03-03T06:23:44.406284+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:23:44.406284+0000","last_undegraded":"2023-03-03T06:23:44.406284+0000","last_fullsized":"2023-03-03T06:23:44.406284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407688+0000","last_change":"2023-03-03T06:23:39.912862+0000","last_active":"2023-03-03T06:23:44.407688+0000","last_peered":"2023-03-03T06:23:44.407688+0000","last_clean":"2023-03-03T06:23:44.407688+0000","last_became_active":"2023-03-03T06:23:39.912540+0000","last_became_peered":"2023-03-03T06:23:39.912540+0000","last_unstale":"2023-03-03T06:23:44.407688+0000","last_undegraded":"2023-03-03T06:23:44.407688+0000","last_fullsized":"2023-03-03T06:23:44.407688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:40.963572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413554+0000","last_change":"2023-03-03T06:23:40.330277+0000","last_active":"2023-03-03T06:23:44.413554+0000","last_peered":"2023-03-03T06:23:44.413554+0000","last_clean":"2023-03-03T06:23:44.413554+0000","last_became_active":"2023-03-03T06:23:40.329978+0000","last_became_peered":"2023-03-03T06:23:40.329978+0000","last_unstale":"2023-03-03T06:23:44.413554+0000","last_undegraded":"2023-03-03T06:23:44.413554+0000","last_fullsized":"2023-03-03T06:23:44.413554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:56:24.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011025+0000","last_change":"2023-03-03T06:23:44.414799+0000","last_active":"2023-03-03T06:23:45.011025+0000","last_peered":"2023-03-03T06:23:45.011025+0000","last_clean":"2023-03-03T06:23:45.011025+0000","last_became_active":"2023-03-03T06:23:44.414225+0000","last_became_peered":"2023-03-03T06:23:44.414225+0000","last_unstale":"2023-03-03T06:23:45.011025+0000","last_undegraded":"2023-03-03T06:23:45.011025+0000","last_fullsized":"2023-03-03T06:23:45.011025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:28:15.023557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406901+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:23:44.406901+0000","last_peered":"2023-03-03T06:23:44.406901+0000","last_clean":"2023-03-03T06:23:44.406901+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:23:44.406901+0000","last_undegraded":"2023-03-03T06:23:44.406901+0000","last_fullsized":"2023-03-03T06:23:44.406901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399724+0000","last_change":"2023-03-03T06:23:39.918687+0000","last_active":"2023-03-03T06:23:44.399724+0000","last_peered":"2023-03-03T06:23:44.399724+0000","last_clean":"2023-03-03T06:23:44.399724+0000","last_became_active":"2023-03-03T06:23:39.918213+0000","last_became_peered":"2023-03-03T06:23:39.918213+0000","last_unstale":"2023-03-03T06:23:44.399724+0000","last_undegraded":"2023-03-03T06:23:44.399724+0000","last_fullsized":"2023-03-03T06:23:44.399724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406330+0000","last_change":"2023-03-03T06:23:40.329407+0000","last_active":"2023-03-03T06:23:44.406330+0000","last_peered":"2023-03-03T06:23:44.406330+0000","last_clean":"2023-03-03T06:23:44.406330+0000","last_became_active":"2023-03-03T06:23:40.329131+0000","last_became_peered":"2023-03-03T06:23:40.329131+0000","last_unstale":"2023-03-03T06:23:44.406330+0000","last_undegraded":"2023-03-03T06:23:44.406330+0000","last_fullsized":"2023-03-03T06:23:44.406330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:41:25.301780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.821924+0000","last_change":"2023-03-03T06:23:44.421929+0000","last_active":"2023-03-03T06:23:44.821924+0000","last_peered":"2023-03-03T06:23:44.821924+0000","last_clean":"2023-03-03T06:23:44.821924+0000","last_became_active":"2023-03-03T06:23:44.421457+0000","last_became_peered":"2023-03-03T06:23:44.421457+0000","last_unstale":"2023-03-03T06:23:44.821924+0000","last_undegraded":"2023-03-03T06:23:44.821924+0000","last_fullsized":"2023-03-03T06:23:44.821924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:03:17.411194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413461+0000","last_change":"2023-03-03T06:23:39.916295+0000","last_active":"2023-03-03T06:23:44.413461+0000","last_peered":"2023-03-03T06:23:44.413461+0000","last_clean":"2023-03-03T06:23:44.413461+0000","last_became_active":"2023-03-03T06:23:39.916027+0000","last_became_peered":"2023-03-03T06:23:39.916027+0000","last_unstale":"2023-03-03T06:23:44.413461+0000","last_undegraded":"2023-03-03T06:23:44.413461+0000","last_fullsized":"2023-03-03T06:23:44.413461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:19:38.164048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394183+0000","last_change":"2023-03-03T06:23:40.332708+0000","last_active":"2023-03-03T06:23:44.394183+0000","last_peered":"2023-03-03T06:23:44.394183+0000","last_clean":"2023-03-03T06:23:44.394183+0000","last_became_active":"2023-03-03T06:23:40.332382+0000","last_became_peered":"2023-03-03T06:23:40.332382+0000","last_unstale":"2023-03-03T06:23:44.394183+0000","last_undegraded":"2023-03-03T06:23:44.394183+0000","last_fullsized":"2023-03-03T06:23:44.394183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:39.735760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217389+0000","last_change":"2023-03-03T06:23:44.420467+0000","last_active":"2023-03-03T06:23:45.217389+0000","last_peered":"2023-03-03T06:23:45.217389+0000","last_clean":"2023-03-03T06:23:45.217389+0000","last_became_active":"2023-03-03T06:23:44.420078+0000","last_became_peered":"2023-03-03T06:23:44.420078+0000","last_unstale":"2023-03-03T06:23:45.217389+0000","last_undegraded":"2023-03-03T06:23:45.217389+0000","last_fullsized":"2023-03-03T06:23:45.217389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:03:17.411194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398998+0000","last_change":"2023-03-03T06:23:39.911136+0000","last_active":"2023-03-03T06:23:44.398998+0000","last_peered":"2023-03-03T06:23:44.398998+0000","last_clean":"2023-03-03T06:23:44.398998+0000","last_became_active":"2023-03-03T06:23:39.910722+0000","last_became_peered":"2023-03-03T06:23:39.910722+0000","last_unstale":"2023-03-03T06:23:44.398998+0000","last_undegraded":"2023-03-03T06:23:44.398998+0000","last_fullsized":"2023-03-03T06:23:44.398998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:44.071696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396133+0000","last_change":"2023-03-03T06:23:40.350618+0000","last_active":"2023-03-03T06:23:44.396133+0000","last_peered":"2023-03-03T06:23:44.396133+0000","last_clean":"2023-03-03T06:23:44.396133+0000","last_became_active":"2023-03-03T06:23:40.350186+0000","last_became_peered":"2023-03-03T06:23:40.350186+0000","last_unstale":"2023-03-03T06:23:44.396133+0000","last_undegraded":"2023-03-03T06:23:44.396133+0000","last_fullsized":"2023-03-03T06:23:44.396133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:19.510143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216582+0000","last_change":"2023-03-03T06:23:44.421952+0000","last_active":"2023-03-03T06:23:45.216582+0000","last_peered":"2023-03-03T06:23:45.216582+0000","last_clean":"2023-03-03T06:23:45.216582+0000","last_became_active":"2023-03-03T06:23:44.421492+0000","last_became_peered":"2023-03-03T06:23:44.421492+0000","last_unstale":"2023-03-03T06:23:45.216582+0000","last_undegraded":"2023-03-03T06:23:45.216582+0000","last_fullsized":"2023-03-03T06:23:45.216582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:22:48.378893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399293+0000","last_change":"2023-03-03T06:23:39.918470+0000","last_active":"2023-03-03T06:23:44.399293+0000","last_peered":"2023-03-03T06:23:44.399293+0000","last_clean":"2023-03-03T06:23:44.399293+0000","last_became_active":"2023-03-03T06:23:39.917860+0000","last_became_peered":"2023-03-03T06:23:39.917860+0000","last_unstale":"2023-03-03T06:23:44.399293+0000","last_undegraded":"2023-03-03T06:23:44.399293+0000","last_fullsized":"2023-03-03T06:23:44.399293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:20.326465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396555+0000","last_change":"2023-03-03T06:23:40.347706+0000","last_active":"2023-03-03T06:23:44.396555+0000","last_peered":"2023-03-03T06:23:44.396555+0000","last_clean":"2023-03-03T06:23:44.396555+0000","last_became_active":"2023-03-03T06:23:40.344594+0000","last_became_peered":"2023-03-03T06:23:40.344594+0000","last_unstale":"2023-03-03T06:23:44.396555+0000","last_undegraded":"2023-03-03T06:23:44.396555+0000","last_fullsized":"2023-03-03T06:23:44.396555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822175+0000","last_change":"2023-03-03T06:23:44.412148+0000","last_active":"2023-03-03T06:23:44.822175+0000","last_peered":"2023-03-03T06:23:44.822175+0000","last_clean":"2023-03-03T06:23:44.822175+0000","last_became_active":"2023-03-03T06:23:44.411541+0000","last_became_peered":"2023-03-03T06:23:44.411541+0000","last_unstale":"2023-03-03T06:23:44.822175+0000","last_undegraded":"2023-03-03T06:23:44.822175+0000","last_fullsized":"2023-03-03T06:23:44.822175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:11:52.237707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397307+0000","last_change":"2023-03-03T06:23:39.913487+0000","last_active":"2023-03-03T06:23:44.397307+0000","last_peered":"2023-03-03T06:23:44.397307+0000","last_clean":"2023-03-03T06:23:44.397307+0000","last_became_active":"2023-03-03T06:23:39.913194+0000","last_became_peered":"2023-03-03T06:23:39.913194+0000","last_unstale":"2023-03-03T06:23:44.397307+0000","last_undegraded":"2023-03-03T06:23:44.397307+0000","last_fullsized":"2023-03-03T06:23:44.397307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:20.326465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397158+0000","last_change":"2023-03-03T06:23:40.338004+0000","last_active":"2023-03-03T06:23:44.397158+0000","last_peered":"2023-03-03T06:23:44.397158+0000","last_clean":"2023-03-03T06:23:44.397158+0000","last_became_active":"2023-03-03T06:23:40.337689+0000","last_became_peered":"2023-03-03T06:23:40.337689+0000","last_unstale":"2023-03-03T06:23:44.397158+0000","last_undegraded":"2023-03-03T06:23:44.397158+0000","last_fullsized":"2023-03-03T06:23:44.397158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:00.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.821814+0000","last_change":"2023-03-03T06:23:44.413502+0000","last_active":"2023-03-03T06:23:44.821814+0000","last_peered":"2023-03-03T06:23:44.821814+0000","last_clean":"2023-03-03T06:23:44.821814+0000","last_became_active":"2023-03-03T06:23:44.413099+0000","last_became_peered":"2023-03-03T06:23:44.413099+0000","last_unstale":"2023-03-03T06:23:44.821814+0000","last_undegraded":"2023-03-03T06:23:44.821814+0000","last_fullsized":"2023-03-03T06:23:44.821814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:23.008849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414685+0000","last_change":"2023-03-03T06:23:39.911148+0000","last_active":"2023-03-03T06:23:44.414685+0000","last_peered":"2023-03-03T06:23:44.414685+0000","last_clean":"2023-03-03T06:23:44.414685+0000","last_became_active":"2023-03-03T06:23:39.910465+0000","last_became_peered":"2023-03-03T06:23:39.910465+0000","last_unstale":"2023-03-03T06:23:44.414685+0000","last_undegraded":"2023-03-03T06:23:44.414685+0000","last_fullsized":"2023-03-03T06:23:44.414685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398776+0000","last_change":"2023-03-03T06:23:40.347365+0000","last_active":"2023-03-03T06:23:44.398776+0000","last_peered":"2023-03-03T06:23:44.398776+0000","last_clean":"2023-03-03T06:23:44.398776+0000","last_became_active":"2023-03-03T06:23:40.347102+0000","last_became_peered":"2023-03-03T06:23:40.347102+0000","last_unstale":"2023-03-03T06:23:44.398776+0000","last_undegraded":"2023-03-03T06:23:44.398776+0000","last_fullsized":"2023-03-03T06:23:44.398776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:42:25.467339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406140+0000","last_change":"2023-03-03T06:23:40.337697+0000","last_active":"2023-03-03T06:23:44.406140+0000","last_peered":"2023-03-03T06:23:44.406140+0000","last_clean":"2023-03-03T06:23:44.406140+0000","last_became_active":"2023-03-03T06:23:40.337414+0000","last_became_peered":"2023-03-03T06:23:40.337414+0000","last_unstale":"2023-03-03T06:23:44.406140+0000","last_undegraded":"2023-03-03T06:23:44.406140+0000","last_fullsized":"2023-03-03T06:23:44.406140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:05:13.223033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396852+0000","last_change":"2023-03-03T06:23:40.340779+0000","last_active":"2023-03-03T06:23:44.396852+0000","last_peered":"2023-03-03T06:23:44.396852+0000","last_clean":"2023-03-03T06:23:44.396852+0000","last_became_active":"2023-03-03T06:23:40.338305+0000","last_became_peered":"2023-03-03T06:23:40.338305+0000","last_unstale":"2023-03-03T06:23:44.396852+0000","last_undegraded":"2023-03-03T06:23:44.396852+0000","last_fullsized":"2023-03-03T06:23:44.396852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:26.393574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396806+0000","last_change":"2023-03-03T06:23:40.348094+0000","last_active":"2023-03-03T06:23:44.396806+0000","last_peered":"2023-03-03T06:23:44.396806+0000","last_clean":"2023-03-03T06:23:44.396806+0000","last_became_active":"2023-03-03T06:23:40.347736+0000","last_became_peered":"2023-03-03T06:23:40.347736+0000","last_unstale":"2023-03-03T06:23:44.396806+0000","last_undegraded":"2023-03-03T06:23:44.396806+0000","last_fullsized":"2023-03-03T06:23:44.396806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:11:53.657995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401149+0000","last_change":"2023-03-03T06:23:40.349146+0000","last_active":"2023-03-03T06:23:44.401149+0000","last_peered":"2023-03-03T06:23:44.401149+0000","last_clean":"2023-03-03T06:23:44.401149+0000","last_became_active":"2023-03-03T06:23:40.348873+0000","last_became_peered":"2023-03-03T06:23:40.348873+0000","last_unstale":"2023-03-03T06:23:44.401149+0000","last_undegraded":"2023-03-03T06:23:44.401149+0000","last_fullsized":"2023-03-03T06:23:44.401149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407642+0000","last_change":"2023-03-03T06:23:40.348472+0000","last_active":"2023-03-03T06:23:44.407642+0000","last_peered":"2023-03-03T06:23:44.407642+0000","last_clean":"2023-03-03T06:23:44.407642+0000","last_became_active":"2023-03-03T06:23:40.348181+0000","last_became_peered":"2023-03-03T06:23:40.348181+0000","last_unstale":"2023-03-03T06:23:44.407642+0000","last_undegraded":"2023-03-03T06:23:44.407642+0000","last_fullsized":"2023-03-03T06:23:44.407642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:03:45.180190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4528,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":703731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8076,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363764,"statfs":{"total":96636764160,"available":96628494336,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9232,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362608,"statfs":{"total":96636764160,"available":96627310592,"internally_reserved":0,"allocated":860160,"data_stored":699769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8140,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363700,"statfs":{"total":96636764160,"available":96628428800,"internally_reserved":0,"allocated":266240,"data_stored":109006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8076,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363764,"statfs":{"total":96636764160,"available":96628494336,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":270336,"data_stored":109491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8224,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363616,"statfs":{"total":96636764160,"available":96628342784,"internally_reserved":0,"allocated":286720,"data_stored":113203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":270336,"data_stored":109076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:23:59.666 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:23:59.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.817+0000 7f380cc95700 1 Processor -- start 2023-03-03T06:23:59.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.817+0000 7f380cc95700 1 -- start start 2023-03-03T06:23:59.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.818+0000 7f380cc95700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38081573f0 0x7f380815d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.818+0000 7f380cc95700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38080cc1a0 0x7f38080cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.818+0000 7f380cc95700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38081577c0 con 0x7f38080b18d0 2023-03-03T06:23:59.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.818+0000 7f380cc95700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38080cd790 con 0x7f38081573f0 2023-03-03T06:23:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.818+0000 7f380cc95700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3808159e60 con 0x7f38080cc1a0 2023-03-03T06:23:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.818+0000 7f380659c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38081573f0 0x7f380815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.818+0000 7f3806d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f38080b18d0 0x7f380815a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59576/0 (socket says 172.21.15.5:59576) 2023-03-03T06:23:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.818+0000 7f3806d9d700 1 -- 172.21.15.5:0/3013332961 learned_addr learned my addr 172.21.15.5:0/3013332961 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:23:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.818+0000 7f3805d9b700 1 --2- 172.21.15.5:0/3013332961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38080cc1a0 0x7f38080cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.819+0000 7f380659c700 1 -- 172.21.15.5:0/3013332961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38080cc1a0 msgr2=0x7f38080cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:23:59.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.819+0000 7f380659c700 1 --2- 172.21.15.5:0/3013332961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38080cc1a0 0x7f38080cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.819+0000 7f380659c700 1 -- 172.21.15.5:0/3013332961 >> v1:172.21.15.5:6789/0 conn(0x7f38080b18d0 legacy=0x7f380815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.819+0000 7f380659c700 1 -- 172.21.15.5:0/3013332961 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380815d900 con 0x7f38081573f0 2023-03-03T06:23:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.819+0000 7f380559a700 1 -- 172.21.15.5:0/3013332961 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403151244 0 0) 0x7f38081577c0 con 0x7f38080b18d0 2023-03-03T06:23:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.819+0000 7f380659c700 1 --2- 172.21.15.5:0/3013332961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38081573f0 0x7f380815d320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009840 tx=0x7f37fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870f3e1bd732dfe server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.819+0000 7f380559a700 1 -- 172.21.15.5:0/3013332961 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc011830 con 0x7f38081573f0 2023-03-03T06:23:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.819+0000 7f380559a700 1 -- 172.21.15.5:0/3013332961 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37fc011990 con 0x7f38081573f0 2023-03-03T06:23:59.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.819+0000 7f380559a700 1 -- 172.21.15.5:0/3013332961 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc011d20 con 0x7f38081573f0 2023-03-03T06:23:59.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.819+0000 7f380cc95700 1 -- 172.21.15.5:0/3013332961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38081573f0 msgr2=0x7f380815d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.819+0000 7f380cc95700 1 --2- 172.21.15.5:0/3013332961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38081573f0 0x7f380815d320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009840 tx=0x7f37fc009b50 comp rx=0 tx=0).stop 2023-03-03T06:23:59.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.820+0000 7f380cc95700 1 -- 172.21.15.5:0/3013332961 shutdown_connections 2023-03-03T06:23:59.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.820+0000 7f380cc95700 1 --2- 172.21.15.5:0/3013332961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38081573f0 0x7f380815d320 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.820+0000 7f380cc95700 1 --2- 172.21.15.5:0/3013332961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38080cc1a0 0x7f38080cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.820+0000 7f380cc95700 1 -- 172.21.15.5:0/3013332961 >> 172.21.15.5:0/3013332961 conn(0x7f38080cc8d0 msgr2=0x7f38080cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:23:59.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.820+0000 7f380cc95700 1 -- 172.21.15.5:0/3013332961 shutdown_connections 2023-03-03T06:23:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.820+0000 7f380cc95700 1 -- 172.21.15.5:0/3013332961 wait complete. 2023-03-03T06:23:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.821+0000 7f380cc95700 1 Processor -- start 2023-03-03T06:23:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.821+0000 7f380cc95700 1 -- start start 2023-03-03T06:23:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f380cc95700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38080b18d0 0x7f38081f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f380cc95700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38080cc1a0 0x7f380815b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f380cc95700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38081573f0 0x7f380806abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f380cc95700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38080c70c0 con 0x7f38080cc1a0 2023-03-03T06:23:59.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f380cc95700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380815bea0 con 0x7f38080b18d0 2023-03-03T06:23:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f380cc95700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380815c180 con 0x7f38081573f0 2023-03-03T06:23:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f3805d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38080cc1a0 0x7f380815b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f3805d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38080cc1a0 0x7f380815b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41506/0 (socket says 172.21.15.5:41506) 2023-03-03T06:23:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f3805d9b700 1 -- 172.21.15.5:0/3887062724 learned_addr learned my addr 172.21.15.5:0/3887062724 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:23:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f380659c700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38080b18d0 0x7f38081f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f3806d9d700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38081573f0 0x7f380806abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f3805d9b700 1 -- 172.21.15.5:0/3887062724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38081573f0 msgr2=0x7f380806abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f3805d9b700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38081573f0 0x7f380806abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f3805d9b700 1 -- 172.21.15.5:0/3887062724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38080b18d0 msgr2=0x7f38081f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:23:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f3805d9b700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38080b18d0 0x7f38081f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:23:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f3805d9b700 1 -- 172.21.15.5:0/3887062724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc0094a0 con 0x7f38080cc1a0 2023-03-03T06:23:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.822+0000 7f380659c700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38080b18d0 0x7f38081f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:23:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.823+0000 7f3805d9b700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38080cc1a0 0x7f380815b420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f37f800e730 tx=0x7f37f800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.823+0000 7f37f6ffd700 1 -- 172.21.15.5:0/3887062724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8013610 con 0x7f38080cc1a0 2023-03-03T06:23:59.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.823+0000 7f37f6ffd700 1 -- 172.21.15.5:0/3887062724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f8013770 con 0x7f38080cc1a0 2023-03-03T06:23:59.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.823+0000 7f37f6ffd700 1 -- 172.21.15.5:0/3887062724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8013b20 con 0x7f38080cc1a0 2023-03-03T06:23:59.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.823+0000 7f380cc95700 1 -- 172.21.15.5:0/3887062724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380815dec0 con 0x7f38080cc1a0 2023-03-03T06:23:59.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.823+0000 7f380cc95700 1 -- 172.21.15.5:0/3887062724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380815dbe0 con 0x7f38080cc1a0 2023-03-03T06:23:59.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.824+0000 7f380cc95700 1 -- 172.21.15.5:0/3887062724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38080cc5f0 con 0x7f38080cc1a0 2023-03-03T06:23:59.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.824+0000 7f37f6ffd700 1 -- 172.21.15.5:0/3887062724 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f37f8019030 con 0x7f38080cc1a0 2023-03-03T06:23:59.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.824+0000 7f37f6ffd700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f37e80682f0 0x7f37e806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:23:59.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.825+0000 7f37f6ffd700 1 -- 172.21.15.5:0/3887062724 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f37f8085970 con 0x7f38080cc1a0 2023-03-03T06:23:59.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.825+0000 7f380659c700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f37e80682f0 0x7f37e806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:23:59.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.825+0000 7f380659c700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f37e80682f0 0x7f37e806a7a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0090b0 tx=0x7f37fc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:23:59.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:23:59.829+0000 7f37f6ffd700 1 -- 172.21.15.5:0/3887062724 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f37f8051e50 con 0x7f38080cc1a0 2023-03-03T06:24:00.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.016+0000 7f380cc95700 1 -- 172.21.15.5:0/3887062724 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f380804e6e0 con 0x7f37e80682f0 2023-03-03T06:24:00.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.026+0000 7f37f6ffd700 1 -- 172.21.15.5:0/3887062724 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367530 (secure 0 0 0) 0x7f380804e6e0 con 0x7f37e80682f0 2023-03-03T06:24:00.032 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:00.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.030+0000 7f380cc95700 1 -- 172.21.15.5:0/3887062724 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f37e80682f0 msgr2=0x7f37e806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.030+0000 7f380cc95700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f37e80682f0 0x7f37e806a7a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f37fc0090b0 tx=0x7f37fc008030 comp rx=0 tx=0).stop 2023-03-03T06:24:00.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.030+0000 7f380cc95700 1 -- 172.21.15.5:0/3887062724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38080cc1a0 msgr2=0x7f380815b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.030+0000 7f380cc95700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38080cc1a0 0x7f380815b420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f37f800e730 tx=0x7f37f800eaf0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.030+0000 7f380cc95700 1 -- 172.21.15.5:0/3887062724 shutdown_connections 2023-03-03T06:24:00.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.030+0000 7f380cc95700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f37e80682f0 0x7f37e806a7a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.030+0000 7f380cc95700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38081573f0 0x7f380806abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.030+0000 7f380cc95700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38080b18d0 0x7f38081f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.030+0000 7f380cc95700 1 --2- 172.21.15.5:0/3887062724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38080cc1a0 0x7f380815b420 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.030+0000 7f380cc95700 1 -- 172.21.15.5:0/3887062724 >> 172.21.15.5:0/3887062724 conn(0x7f38080cc8d0 msgr2=0x7f3808158be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:00.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.030+0000 7f380cc95700 1 -- 172.21.15.5:0/3887062724 shutdown_connections 2023-03-03T06:24:00.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.030+0000 7f380cc95700 1 -- 172.21.15.5:0/3887062724 wait complete. 2023-03-03T06:24:00.036 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:24:00.044 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-03-03T06:23:59.464158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594896,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67296,"kb_used_data":3296,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907424,"statfs":{"total":773094113280,"available":773025202176,"internally_reserved":0,"allocated":3375104,"data_stored":2063078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2198,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002935"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394791+0000","last_change":"2023-03-03T06:23:40.340008+0000","last_active":"2023-03-03T06:23:44.394791+0000","last_peered":"2023-03-03T06:23:44.394791+0000","last_clean":"2023-03-03T06:23:44.394791+0000","last_became_active":"2023-03-03T06:23:40.339743+0000","last_became_peered":"2023-03-03T06:23:40.339743+0000","last_unstale":"2023-03-03T06:23:44.394791+0000","last_undegraded":"2023-03-03T06:23:44.394791+0000","last_fullsized":"2023-03-03T06:23:44.394791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:45.077306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400923+0000","last_change":"2023-03-03T06:23:40.328386+0000","last_active":"2023-03-03T06:23:44.400923+0000","last_peered":"2023-03-03T06:23:44.400923+0000","last_clean":"2023-03-03T06:23:44.400923+0000","last_became_active":"2023-03-03T06:23:40.328078+0000","last_became_peered":"2023-03-03T06:23:40.328078+0000","last_unstale":"2023-03-03T06:23:44.400923+0000","last_undegraded":"2023-03-03T06:23:44.400923+0000","last_fullsized":"2023-03-03T06:23:44.400923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:56:24.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396143+0000","last_change":"2023-03-03T06:23:40.351193+0000","last_active":"2023-03-03T06:23:44.396143+0000","last_peered":"2023-03-03T06:23:44.396143+0000","last_clean":"2023-03-03T06:23:44.396143+0000","last_became_active":"2023-03-03T06:23:40.348126+0000","last_became_peered":"2023-03-03T06:23:40.348126+0000","last_unstale":"2023-03-03T06:23:44.396143+0000","last_undegraded":"2023-03-03T06:23:44.396143+0000","last_fullsized":"2023-03-03T06:23:44.396143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:22:34.948853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406192+0000","last_change":"2023-03-03T06:23:40.339457+0000","last_active":"2023-03-03T06:23:44.406192+0000","last_peered":"2023-03-03T06:23:44.406192+0000","last_clean":"2023-03-03T06:23:44.406192+0000","last_became_active":"2023-03-03T06:23:40.339154+0000","last_became_peered":"2023-03-03T06:23:40.339154+0000","last_unstale":"2023-03-03T06:23:44.406192+0000","last_undegraded":"2023-03-03T06:23:44.406192+0000","last_fullsized":"2023-03-03T06:23:44.406192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:41:25.301780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413710+0000","last_change":"2023-03-03T06:23:40.342264+0000","last_active":"2023-03-03T06:23:44.413710+0000","last_peered":"2023-03-03T06:23:44.413710+0000","last_clean":"2023-03-03T06:23:44.413710+0000","last_became_active":"2023-03-03T06:23:40.340178+0000","last_became_peered":"2023-03-03T06:23:40.340178+0000","last_unstale":"2023-03-03T06:23:44.413710+0000","last_undegraded":"2023-03-03T06:23:44.413710+0000","last_fullsized":"2023-03-03T06:23:44.413710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:50.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396834+0000","last_change":"2023-03-03T06:23:40.344569+0000","last_active":"2023-03-03T06:23:44.396834+0000","last_peered":"2023-03-03T06:23:44.396834+0000","last_clean":"2023-03-03T06:23:44.396834+0000","last_became_active":"2023-03-03T06:23:40.344219+0000","last_became_peered":"2023-03-03T06:23:40.344219+0000","last_unstale":"2023-03-03T06:23:44.396834+0000","last_undegraded":"2023-03-03T06:23:44.396834+0000","last_fullsized":"2023-03-03T06:23:44.396834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:54:28.908384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407523+0000","last_change":"2023-03-03T06:23:40.346056+0000","last_active":"2023-03-03T06:23:44.407523+0000","last_peered":"2023-03-03T06:23:44.407523+0000","last_clean":"2023-03-03T06:23:44.407523+0000","last_became_active":"2023-03-03T06:23:40.345549+0000","last_became_peered":"2023-03-03T06:23:40.345549+0000","last_unstale":"2023-03-03T06:23:44.407523+0000","last_undegraded":"2023-03-03T06:23:44.407523+0000","last_fullsized":"2023-03-03T06:23:44.407523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:00.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398934+0000","last_change":"2023-03-03T06:23:40.341498+0000","last_active":"2023-03-03T06:23:44.398934+0000","last_peered":"2023-03-03T06:23:44.398934+0000","last_clean":"2023-03-03T06:23:44.398934+0000","last_became_active":"2023-03-03T06:23:40.341212+0000","last_became_peered":"2023-03-03T06:23:40.341212+0000","last_unstale":"2023-03-03T06:23:44.398934+0000","last_undegraded":"2023-03-03T06:23:44.398934+0000","last_fullsized":"2023-03-03T06:23:44.398934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:42:56.190690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414254+0000","last_change":"2023-03-03T06:23:40.342151+0000","last_active":"2023-03-03T06:23:44.414254+0000","last_peered":"2023-03-03T06:23:44.414254+0000","last_clean":"2023-03-03T06:23:44.414254+0000","last_became_active":"2023-03-03T06:23:40.340195+0000","last_became_peered":"2023-03-03T06:23:40.340195+0000","last_unstale":"2023-03-03T06:23:44.414254+0000","last_undegraded":"2023-03-03T06:23:44.414254+0000","last_fullsized":"2023-03-03T06:23:44.414254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:26.393574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401024+0000","last_change":"2023-03-03T06:23:40.329308+0000","last_active":"2023-03-03T06:23:44.401024+0000","last_peered":"2023-03-03T06:23:44.401024+0000","last_clean":"2023-03-03T06:23:44.401024+0000","last_became_active":"2023-03-03T06:23:40.329047+0000","last_became_peered":"2023-03-03T06:23:40.329047+0000","last_unstale":"2023-03-03T06:23:44.401024+0000","last_undegraded":"2023-03-03T06:23:44.401024+0000","last_fullsized":"2023-03-03T06:23:44.401024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396048+0000","last_change":"2023-03-03T06:23:40.350139+0000","last_active":"2023-03-03T06:23:44.396048+0000","last_peered":"2023-03-03T06:23:44.396048+0000","last_clean":"2023-03-03T06:23:44.396048+0000","last_became_active":"2023-03-03T06:23:40.344315+0000","last_became_peered":"2023-03-03T06:23:40.344315+0000","last_unstale":"2023-03-03T06:23:44.396048+0000","last_undegraded":"2023-03-03T06:23:44.396048+0000","last_fullsized":"2023-03-03T06:23:44.396048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.395100+0000","last_change":"2023-03-03T06:23:40.347207+0000","last_active":"2023-03-03T06:23:44.395100+0000","last_peered":"2023-03-03T06:23:44.395100+0000","last_clean":"2023-03-03T06:23:44.395100+0000","last_became_active":"2023-03-03T06:23:40.346966+0000","last_became_peered":"2023-03-03T06:23:40.346966+0000","last_unstale":"2023-03-03T06:23:44.395100+0000","last_undegraded":"2023-03-03T06:23:44.395100+0000","last_fullsized":"2023-03-03T06:23:44.395100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:50.785469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394027+0000","last_change":"2023-03-03T06:23:40.337391+0000","last_active":"2023-03-03T06:23:44.394027+0000","last_peered":"2023-03-03T06:23:44.394027+0000","last_clean":"2023-03-03T06:23:44.394027+0000","last_became_active":"2023-03-03T06:23:40.337119+0000","last_became_peered":"2023-03-03T06:23:40.337119+0000","last_unstale":"2023-03-03T06:23:44.394027+0000","last_undegraded":"2023-03-03T06:23:44.394027+0000","last_fullsized":"2023-03-03T06:23:44.394027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:21.332075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398880+0000","last_change":"2023-03-03T06:23:40.334786+0000","last_active":"2023-03-03T06:23:44.398880+0000","last_peered":"2023-03-03T06:23:44.398880+0000","last_clean":"2023-03-03T06:23:44.398880+0000","last_became_active":"2023-03-03T06:23:40.334489+0000","last_became_peered":"2023-03-03T06:23:40.334489+0000","last_unstale":"2023-03-03T06:23:44.398880+0000","last_undegraded":"2023-03-03T06:23:44.398880+0000","last_fullsized":"2023-03-03T06:23:44.398880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407409+0000","last_change":"2023-03-03T06:23:40.346226+0000","last_active":"2023-03-03T06:23:44.407409+0000","last_peered":"2023-03-03T06:23:44.407409+0000","last_clean":"2023-03-03T06:23:44.407409+0000","last_became_active":"2023-03-03T06:23:40.345791+0000","last_became_peered":"2023-03-03T06:23:40.345791+0000","last_unstale":"2023-03-03T06:23:44.407409+0000","last_undegraded":"2023-03-03T06:23:44.407409+0000","last_fullsized":"2023-03-03T06:23:44.407409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:17.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398869+0000","last_change":"2023-03-03T06:23:40.344976+0000","last_active":"2023-03-03T06:23:44.398869+0000","last_peered":"2023-03-03T06:23:44.398869+0000","last_clean":"2023-03-03T06:23:44.398869+0000","last_became_active":"2023-03-03T06:23:40.339923+0000","last_became_peered":"2023-03-03T06:23:40.339923+0000","last_unstale":"2023-03-03T06:23:44.398869+0000","last_undegraded":"2023-03-03T06:23:44.398869+0000","last_fullsized":"2023-03-03T06:23:44.398869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:40:38.222408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414475+0000","last_change":"2023-03-03T06:23:40.342480+0000","last_active":"2023-03-03T06:23:44.414475+0000","last_peered":"2023-03-03T06:23:44.414475+0000","last_clean":"2023-03-03T06:23:44.414475+0000","last_became_active":"2023-03-03T06:23:40.339835+0000","last_became_peered":"2023-03-03T06:23:40.339835+0000","last_unstale":"2023-03-03T06:23:44.414475+0000","last_undegraded":"2023-03-03T06:23:44.414475+0000","last_fullsized":"2023-03-03T06:23:44.414475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:57:56.186885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398423+0000","last_change":"2023-03-03T06:23:40.340711+0000","last_active":"2023-03-03T06:23:44.398423+0000","last_peered":"2023-03-03T06:23:44.398423+0000","last_clean":"2023-03-03T06:23:44.398423+0000","last_became_active":"2023-03-03T06:23:40.340400+0000","last_became_peered":"2023-03-03T06:23:40.340400+0000","last_unstale":"2023-03-03T06:23:44.398423+0000","last_undegraded":"2023-03-03T06:23:44.398423+0000","last_fullsized":"2023-03-03T06:23:44.398423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:38:27.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394986+0000","last_change":"2023-03-03T06:23:40.335402+0000","last_active":"2023-03-03T06:23:44.394986+0000","last_peered":"2023-03-03T06:23:44.394986+0000","last_clean":"2023-03-03T06:23:44.394986+0000","last_became_active":"2023-03-03T06:23:40.335101+0000","last_became_peered":"2023-03-03T06:23:40.335101+0000","last_unstale":"2023-03-03T06:23:44.394986+0000","last_undegraded":"2023-03-03T06:23:44.394986+0000","last_fullsized":"2023-03-03T06:23:44.394986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:41.969182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397647+0000","last_change":"2023-03-03T06:23:40.347472+0000","last_active":"2023-03-03T06:23:44.397647+0000","last_peered":"2023-03-03T06:23:44.397647+0000","last_clean":"2023-03-03T06:23:44.397647+0000","last_became_active":"2023-03-03T06:23:40.345241+0000","last_became_peered":"2023-03-03T06:23:40.345241+0000","last_unstale":"2023-03-03T06:23:44.397647+0000","last_undegraded":"2023-03-03T06:23:44.397647+0000","last_fullsized":"2023-03-03T06:23:44.397647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:59:25.244715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407721+0000","last_change":"2023-03-03T06:23:40.352895+0000","last_active":"2023-03-03T06:23:44.407721+0000","last_peered":"2023-03-03T06:23:44.407721+0000","last_clean":"2023-03-03T06:23:44.407721+0000","last_became_active":"2023-03-03T06:23:40.352576+0000","last_became_peered":"2023-03-03T06:23:40.352576+0000","last_unstale":"2023-03-03T06:23:44.407721+0000","last_undegraded":"2023-03-03T06:23:44.407721+0000","last_fullsized":"2023-03-03T06:23:44.407721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407761+0000","last_change":"2023-03-03T06:23:40.329918+0000","last_active":"2023-03-03T06:23:44.407761+0000","last_peered":"2023-03-03T06:23:44.407761+0000","last_clean":"2023-03-03T06:23:44.407761+0000","last_became_active":"2023-03-03T06:23:40.327770+0000","last_became_peered":"2023-03-03T06:23:40.327770+0000","last_unstale":"2023-03-03T06:23:44.407761+0000","last_undegraded":"2023-03-03T06:23:44.407761+0000","last_fullsized":"2023-03-03T06:23:44.407761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396955+0000","last_change":"2023-03-03T06:23:40.341354+0000","last_active":"2023-03-03T06:23:44.396955+0000","last_peered":"2023-03-03T06:23:44.396955+0000","last_clean":"2023-03-03T06:23:44.396955+0000","last_became_active":"2023-03-03T06:23:40.341048+0000","last_became_peered":"2023-03-03T06:23:40.341048+0000","last_unstale":"2023-03-03T06:23:44.396955+0000","last_undegraded":"2023-03-03T06:23:44.396955+0000","last_fullsized":"2023-03-03T06:23:44.396955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:59:25.244715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407568+0000","last_change":"2023-03-03T06:23:40.352581+0000","last_active":"2023-03-03T06:23:44.407568+0000","last_peered":"2023-03-03T06:23:44.407568+0000","last_clean":"2023-03-03T06:23:44.407568+0000","last_became_active":"2023-03-03T06:23:40.352290+0000","last_became_peered":"2023-03-03T06:23:40.352290+0000","last_unstale":"2023-03-03T06:23:44.407568+0000","last_undegraded":"2023-03-03T06:23:44.407568+0000","last_fullsized":"2023-03-03T06:23:44.407568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408648+0000","last_change":"2023-03-03T06:23:40.337724+0000","last_active":"2023-03-03T06:23:44.408648+0000","last_peered":"2023-03-03T06:23:44.408648+0000","last_clean":"2023-03-03T06:23:44.408648+0000","last_became_active":"2023-03-03T06:23:40.337448+0000","last_became_peered":"2023-03-03T06:23:40.337448+0000","last_unstale":"2023-03-03T06:23:44.408648+0000","last_undegraded":"2023-03-03T06:23:44.408648+0000","last_fullsized":"2023-03-03T06:23:44.408648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:37.500862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407962+0000","last_change":"2023-03-03T06:23:40.326813+0000","last_active":"2023-03-03T06:23:44.407962+0000","last_peered":"2023-03-03T06:23:44.407962+0000","last_clean":"2023-03-03T06:23:44.407962+0000","last_became_active":"2023-03-03T06:23:40.326512+0000","last_became_peered":"2023-03-03T06:23:40.326512+0000","last_unstale":"2023-03-03T06:23:44.407962+0000","last_undegraded":"2023-03-03T06:23:44.407962+0000","last_fullsized":"2023-03-03T06:23:44.407962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:40.681483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400716+0000","last_change":"2023-03-03T06:23:40.347745+0000","last_active":"2023-03-03T06:23:44.400716+0000","last_peered":"2023-03-03T06:23:44.400716+0000","last_clean":"2023-03-03T06:23:44.400716+0000","last_became_active":"2023-03-03T06:23:40.347373+0000","last_became_peered":"2023-03-03T06:23:40.347373+0000","last_unstale":"2023-03-03T06:23:44.400716+0000","last_undegraded":"2023-03-03T06:23:44.400716+0000","last_fullsized":"2023-03-03T06:23:44.400716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:00.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823247+0000","last_change":"2023-03-03T06:23:44.411770+0000","last_active":"2023-03-03T06:23:44.823247+0000","last_peered":"2023-03-03T06:23:44.823247+0000","last_clean":"2023-03-03T06:23:44.823247+0000","last_became_active":"2023-03-03T06:23:44.411103+0000","last_became_peered":"2023-03-03T06:23:44.411103+0000","last_unstale":"2023-03-03T06:23:44.823247+0000","last_undegraded":"2023-03-03T06:23:44.823247+0000","last_fullsized":"2023-03-03T06:23:44.823247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:52:34.159164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396733+0000","last_change":"2023-03-03T06:23:39.912910+0000","last_active":"2023-03-03T06:23:44.396733+0000","last_peered":"2023-03-03T06:23:44.396733+0000","last_clean":"2023-03-03T06:23:44.396733+0000","last_became_active":"2023-03-03T06:23:39.912705+0000","last_became_peered":"2023-03-03T06:23:39.912705+0000","last_unstale":"2023-03-03T06:23:44.396733+0000","last_undegraded":"2023-03-03T06:23:44.396733+0000","last_fullsized":"2023-03-03T06:23:44.396733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:37.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397715+0000","last_change":"2023-03-03T06:23:40.340849+0000","last_active":"2023-03-03T06:23:44.397715+0000","last_peered":"2023-03-03T06:23:44.397715+0000","last_clean":"2023-03-03T06:23:44.397715+0000","last_became_active":"2023-03-03T06:23:40.340540+0000","last_became_peered":"2023-03-03T06:23:40.340540+0000","last_unstale":"2023-03-03T06:23:44.397715+0000","last_undegraded":"2023-03-03T06:23:44.397715+0000","last_fullsized":"2023-03-03T06:23:44.397715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:57:56.186885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216333+0000","last_change":"2023-03-03T06:23:44.420347+0000","last_active":"2023-03-03T06:23:45.216333+0000","last_peered":"2023-03-03T06:23:45.216333+0000","last_clean":"2023-03-03T06:23:45.216333+0000","last_became_active":"2023-03-03T06:23:44.419965+0000","last_became_peered":"2023-03-03T06:23:44.419965+0000","last_unstale":"2023-03-03T06:23:45.216333+0000","last_undegraded":"2023-03-03T06:23:45.216333+0000","last_fullsized":"2023-03-03T06:23:45.216333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:59:28.743422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407154+0000","last_change":"2023-03-03T06:23:39.918145+0000","last_active":"2023-03-03T06:23:44.407154+0000","last_peered":"2023-03-03T06:23:44.407154+0000","last_clean":"2023-03-03T06:23:44.407154+0000","last_became_active":"2023-03-03T06:23:39.917834+0000","last_became_peered":"2023-03-03T06:23:39.917834+0000","last_unstale":"2023-03-03T06:23:44.407154+0000","last_undegraded":"2023-03-03T06:23:44.407154+0000","last_fullsized":"2023-03-03T06:23:44.407154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:37.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.412328+0000","last_change":"2023-03-03T06:23:40.345943+0000","last_active":"2023-03-03T06:23:44.412328+0000","last_peered":"2023-03-03T06:23:44.412328+0000","last_clean":"2023-03-03T06:23:44.412328+0000","last_became_active":"2023-03-03T06:23:40.345683+0000","last_became_peered":"2023-03-03T06:23:40.345683+0000","last_unstale":"2023-03-03T06:23:44.412328+0000","last_undegraded":"2023-03-03T06:23:44.412328+0000","last_fullsized":"2023-03-03T06:23:44.412328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011235+0000","last_change":"2023-03-03T06:23:44.419798+0000","last_active":"2023-03-03T06:23:45.011235+0000","last_peered":"2023-03-03T06:23:45.011235+0000","last_clean":"2023-03-03T06:23:45.011235+0000","last_became_active":"2023-03-03T06:23:44.419371+0000","last_became_peered":"2023-03-03T06:23:44.419371+0000","last_unstale":"2023-03-03T06:23:45.011235+0000","last_undegraded":"2023-03-03T06:23:45.011235+0000","last_fullsized":"2023-03-03T06:23:45.011235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:23.008849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400964+0000","last_change":"2023-03-03T06:23:39.914431+0000","last_active":"2023-03-03T06:23:44.400964+0000","last_peered":"2023-03-03T06:23:44.400964+0000","last_clean":"2023-03-03T06:23:44.400964+0000","last_became_active":"2023-03-03T06:23:39.914144+0000","last_became_peered":"2023-03-03T06:23:39.914144+0000","last_unstale":"2023-03-03T06:23:44.400964+0000","last_undegraded":"2023-03-03T06:23:44.400964+0000","last_fullsized":"2023-03-03T06:23:44.400964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406907+0000","last_change":"2023-03-03T06:23:40.335787+0000","last_active":"2023-03-03T06:23:44.406907+0000","last_peered":"2023-03-03T06:23:44.406907+0000","last_clean":"2023-03-03T06:23:44.406907+0000","last_became_active":"2023-03-03T06:23:40.334558+0000","last_became_peered":"2023-03-03T06:23:40.334558+0000","last_unstale":"2023-03-03T06:23:44.406907+0000","last_undegraded":"2023-03-03T06:23:44.406907+0000","last_fullsized":"2023-03-03T06:23:44.406907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:37.500862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215801+0000","last_change":"2023-03-03T06:23:44.418674+0000","last_active":"2023-03-03T06:23:45.215801+0000","last_peered":"2023-03-03T06:23:45.215801+0000","last_clean":"2023-03-03T06:23:45.215801+0000","last_became_active":"2023-03-03T06:23:44.418172+0000","last_became_peered":"2023-03-03T06:23:44.418172+0000","last_unstale":"2023-03-03T06:23:45.215801+0000","last_undegraded":"2023-03-03T06:23:45.215801+0000","last_fullsized":"2023-03-03T06:23:45.215801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:30.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414570+0000","last_change":"2023-03-03T06:23:39.911332+0000","last_active":"2023-03-03T06:23:44.414570+0000","last_peered":"2023-03-03T06:23:44.414570+0000","last_clean":"2023-03-03T06:23:44.414570+0000","last_became_active":"2023-03-03T06:23:39.910856+0000","last_became_peered":"2023-03-03T06:23:39.910856+0000","last_unstale":"2023-03-03T06:23:44.414570+0000","last_undegraded":"2023-03-03T06:23:44.414570+0000","last_fullsized":"2023-03-03T06:23:44.414570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:20.326465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397441+0000","last_change":"2023-03-03T06:23:40.339157+0000","last_active":"2023-03-03T06:23:44.397441+0000","last_peered":"2023-03-03T06:23:44.397441+0000","last_clean":"2023-03-03T06:23:44.397441+0000","last_became_active":"2023-03-03T06:23:40.338695+0000","last_became_peered":"2023-03-03T06:23:40.338695+0000","last_unstale":"2023-03-03T06:23:44.397441+0000","last_undegraded":"2023-03-03T06:23:44.397441+0000","last_fullsized":"2023-03-03T06:23:44.397441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:50.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216248+0000","last_change":"2023-03-03T06:23:44.424307+0000","last_active":"2023-03-03T06:23:45.216248+0000","last_peered":"2023-03-03T06:23:45.216248+0000","last_clean":"2023-03-03T06:23:45.216248+0000","last_became_active":"2023-03-03T06:23:44.423879+0000","last_became_peered":"2023-03-03T06:23:44.423879+0000","last_unstale":"2023-03-03T06:23:45.216248+0000","last_undegraded":"2023-03-03T06:23:45.216248+0000","last_fullsized":"2023-03-03T06:23:45.216248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:38:30.824125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400916+0000","last_change":"2023-03-03T06:23:39.911774+0000","last_active":"2023-03-03T06:23:44.400916+0000","last_peered":"2023-03-03T06:23:44.400916+0000","last_clean":"2023-03-03T06:23:44.400916+0000","last_became_active":"2023-03-03T06:23:39.911466+0000","last_became_peered":"2023-03-03T06:23:39.911466+0000","last_unstale":"2023-03-03T06:23:44.400916+0000","last_undegraded":"2023-03-03T06:23:44.400916+0000","last_fullsized":"2023-03-03T06:23:44.400916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:59:20.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396740+0000","last_change":"2023-03-03T06:23:40.341958+0000","last_active":"2023-03-03T06:23:44.396740+0000","last_peered":"2023-03-03T06:23:44.396740+0000","last_clean":"2023-03-03T06:23:44.396740+0000","last_became_active":"2023-03-03T06:23:40.341680+0000","last_became_peered":"2023-03-03T06:23:40.341680+0000","last_unstale":"2023-03-03T06:23:44.396740+0000","last_undegraded":"2023-03-03T06:23:44.396740+0000","last_fullsized":"2023-03-03T06:23:44.396740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:29:39.720198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822803+0000","last_change":"2023-03-03T06:23:44.424858+0000","last_active":"2023-03-03T06:23:44.822803+0000","last_peered":"2023-03-03T06:23:44.822803+0000","last_clean":"2023-03-03T06:23:44.822803+0000","last_became_active":"2023-03-03T06:23:44.424438+0000","last_became_peered":"2023-03-03T06:23:44.424438+0000","last_unstale":"2023-03-03T06:23:44.822803+0000","last_undegraded":"2023-03-03T06:23:44.822803+0000","last_fullsized":"2023-03-03T06:23:44.822803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:35:59.351177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408603+0000","last_change":"2023-03-03T06:23:39.917383+0000","last_active":"2023-03-03T06:23:44.408603+0000","last_peered":"2023-03-03T06:23:44.408603+0000","last_clean":"2023-03-03T06:23:44.408603+0000","last_became_active":"2023-03-03T06:23:39.917126+0000","last_became_peered":"2023-03-03T06:23:39.917126+0000","last_unstale":"2023-03-03T06:23:44.408603+0000","last_undegraded":"2023-03-03T06:23:44.408603+0000","last_fullsized":"2023-03-03T06:23:44.408603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:05:12.217423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406922+0000","last_change":"2023-03-03T06:23:40.336079+0000","last_active":"2023-03-03T06:23:44.406922+0000","last_peered":"2023-03-03T06:23:44.406922+0000","last_clean":"2023-03-03T06:23:44.406922+0000","last_became_active":"2023-03-03T06:23:40.335809+0000","last_became_peered":"2023-03-03T06:23:40.335809+0000","last_unstale":"2023-03-03T06:23:44.406922+0000","last_undegraded":"2023-03-03T06:23:44.406922+0000","last_fullsized":"2023-03-03T06:23:44.406922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:05:13.223033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823271+0000","last_change":"2023-03-03T06:23:44.417871+0000","last_active":"2023-03-03T06:23:44.823271+0000","last_peered":"2023-03-03T06:23:44.823271+0000","last_clean":"2023-03-03T06:23:44.823271+0000","last_became_active":"2023-03-03T06:23:44.417470+0000","last_became_peered":"2023-03-03T06:23:44.417470+0000","last_unstale":"2023-03-03T06:23:44.823271+0000","last_undegraded":"2023-03-03T06:23:44.823271+0000","last_fullsized":"2023-03-03T06:23:44.823271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:22:48.378893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:55.871487+0000","last_change":"2023-03-03T06:23:39.912856+0000","last_active":"2023-03-03T06:23:55.871487+0000","last_peered":"2023-03-03T06:23:55.871487+0000","last_clean":"2023-03-03T06:23:55.871487+0000","last_became_active":"2023-03-03T06:23:39.912563+0000","last_became_peered":"2023-03-03T06:23:39.912563+0000","last_unstale":"2023-03-03T06:23:55.871487+0000","last_undegraded":"2023-03-03T06:23:55.871487+0000","last_fullsized":"2023-03-03T06:23:55.871487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:40.963572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3746,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396312+0000","last_change":"2023-03-03T06:23:40.350272+0000","last_active":"2023-03-03T06:23:44.396312+0000","last_peered":"2023-03-03T06:23:44.396312+0000","last_clean":"2023-03-03T06:23:44.396312+0000","last_became_active":"2023-03-03T06:23:40.349999+0000","last_became_peered":"2023-03-03T06:23:40.349999+0000","last_unstale":"2023-03-03T06:23:44.396312+0000","last_undegraded":"2023-03-03T06:23:44.396312+0000","last_fullsized":"2023-03-03T06:23:44.396312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:00:23.719558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217132+0000","last_change":"2023-03-03T06:23:44.415132+0000","last_active":"2023-03-03T06:23:45.217132+0000","last_peered":"2023-03-03T06:23:45.217132+0000","last_clean":"2023-03-03T06:23:45.217132+0000","last_became_active":"2023-03-03T06:23:44.414671+0000","last_became_peered":"2023-03-03T06:23:44.414671+0000","last_unstale":"2023-03-03T06:23:45.217132+0000","last_undegraded":"2023-03-03T06:23:45.217132+0000","last_fullsized":"2023-03-03T06:23:45.217132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:03:14.816505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407616+0000","last_change":"2023-03-03T06:23:39.918682+0000","last_active":"2023-03-03T06:23:44.407616+0000","last_peered":"2023-03-03T06:23:44.407616+0000","last_clean":"2023-03-03T06:23:44.407616+0000","last_became_active":"2023-03-03T06:23:39.918360+0000","last_became_peered":"2023-03-03T06:23:39.918360+0000","last_unstale":"2023-03-03T06:23:44.407616+0000","last_undegraded":"2023-03-03T06:23:44.407616+0000","last_fullsized":"2023-03-03T06:23:44.407616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:19:38.164048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399298+0000","last_change":"2023-03-03T06:23:40.341375+0000","last_active":"2023-03-03T06:23:44.399298+0000","last_peered":"2023-03-03T06:23:44.399298+0000","last_clean":"2023-03-03T06:23:44.399298+0000","last_became_active":"2023-03-03T06:23:40.339213+0000","last_became_peered":"2023-03-03T06:23:40.339213+0000","last_unstale":"2023-03-03T06:23:44.399298+0000","last_undegraded":"2023-03-03T06:23:44.399298+0000","last_fullsized":"2023-03-03T06:23:44.399298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:27.072231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823348+0000","last_change":"2023-03-03T06:23:44.414871+0000","last_active":"2023-03-03T06:23:44.823348+0000","last_peered":"2023-03-03T06:23:44.823348+0000","last_clean":"2023-03-03T06:23:44.823348+0000","last_became_active":"2023-03-03T06:23:44.414346+0000","last_became_peered":"2023-03-03T06:23:44.414346+0000","last_unstale":"2023-03-03T06:23:44.823348+0000","last_undegraded":"2023-03-03T06:23:44.823348+0000","last_fullsized":"2023-03-03T06:23:44.823348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:40:15.816562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407908+0000","last_change":"2023-03-03T06:23:39.912556+0000","last_active":"2023-03-03T06:23:44.407908+0000","last_peered":"2023-03-03T06:23:44.407908+0000","last_clean":"2023-03-03T06:23:44.407908+0000","last_became_active":"2023-03-03T06:23:39.912270+0000","last_became_peered":"2023-03-03T06:23:39.912270+0000","last_unstale":"2023-03-03T06:23:44.407908+0000","last_undegraded":"2023-03-03T06:23:44.407908+0000","last_fullsized":"2023-03-03T06:23:44.407908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:59:20.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400650+0000","last_change":"2023-03-03T06:23:40.347443+0000","last_active":"2023-03-03T06:23:44.400650+0000","last_peered":"2023-03-03T06:23:44.400650+0000","last_clean":"2023-03-03T06:23:44.400650+0000","last_became_active":"2023-03-03T06:23:40.347157+0000","last_became_peered":"2023-03-03T06:23:40.347157+0000","last_unstale":"2023-03-03T06:23:44.400650+0000","last_undegraded":"2023-03-03T06:23:44.400650+0000","last_fullsized":"2023-03-03T06:23:44.400650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:17.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823445+0000","last_change":"2023-03-03T06:23:44.424679+0000","last_active":"2023-03-03T06:23:44.823445+0000","last_peered":"2023-03-03T06:23:44.823445+0000","last_clean":"2023-03-03T06:23:44.823445+0000","last_became_active":"2023-03-03T06:23:44.424312+0000","last_became_peered":"2023-03-03T06:23:44.424312+0000","last_unstale":"2023-03-03T06:23:44.823445+0000","last_undegraded":"2023-03-03T06:23:44.823445+0000","last_fullsized":"2023-03-03T06:23:44.823445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:20:21.108272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407408+0000","last_change":"2023-03-03T06:23:39.916648+0000","last_active":"2023-03-03T06:23:44.407408+0000","last_peered":"2023-03-03T06:23:44.407408+0000","last_clean":"2023-03-03T06:23:44.407408+0000","last_became_active":"2023-03-03T06:23:39.916366+0000","last_became_peered":"2023-03-03T06:23:39.916366+0000","last_unstale":"2023-03-03T06:23:44.407408+0000","last_undegraded":"2023-03-03T06:23:44.407408+0000","last_fullsized":"2023-03-03T06:23:44.407408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:18:36.597804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.412508+0000","last_change":"2023-03-03T06:23:40.340155+0000","last_active":"2023-03-03T06:23:44.412508+0000","last_peered":"2023-03-03T06:23:44.412508+0000","last_clean":"2023-03-03T06:23:44.412508+0000","last_became_active":"2023-03-03T06:23:40.339896+0000","last_became_peered":"2023-03-03T06:23:40.339896+0000","last_unstale":"2023-03-03T06:23:44.412508+0000","last_undegraded":"2023-03-03T06:23:44.412508+0000","last_fullsized":"2023-03-03T06:23:44.412508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:29:39.720198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216910+0000","last_change":"2023-03-03T06:23:44.415321+0000","last_active":"2023-03-03T06:23:45.216910+0000","last_peered":"2023-03-03T06:23:45.216910+0000","last_clean":"2023-03-03T06:23:45.216910+0000","last_became_active":"2023-03-03T06:23:44.414916+0000","last_became_peered":"2023-03-03T06:23:44.414916+0000","last_unstale":"2023-03-03T06:23:45.216910+0000","last_undegraded":"2023-03-03T06:23:45.216910+0000","last_fullsized":"2023-03-03T06:23:45.216910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:50:31.688270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406117+0000","last_change":"2023-03-03T06:23:39.908842+0000","last_active":"2023-03-03T06:23:44.406117+0000","last_peered":"2023-03-03T06:23:44.406117+0000","last_clean":"2023-03-03T06:23:44.406117+0000","last_became_active":"2023-03-03T06:23:39.908540+0000","last_became_peered":"2023-03-03T06:23:39.908540+0000","last_unstale":"2023-03-03T06:23:44.406117+0000","last_undegraded":"2023-03-03T06:23:44.406117+0000","last_fullsized":"2023-03-03T06:23:44.406117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.403220+0000","last_change":"2023-03-03T06:23:40.348336+0000","last_active":"2023-03-03T06:23:44.403220+0000","last_peered":"2023-03-03T06:23:44.403220+0000","last_clean":"2023-03-03T06:23:44.403220+0000","last_became_active":"2023-03-03T06:23:40.348074+0000","last_became_peered":"2023-03-03T06:23:40.348074+0000","last_unstale":"2023-03-03T06:23:44.403220+0000","last_undegraded":"2023-03-03T06:23:44.403220+0000","last_fullsized":"2023-03-03T06:23:44.403220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.218118+0000","last_change":"2023-03-03T06:23:44.425304+0000","last_active":"2023-03-03T06:23:45.218118+0000","last_peered":"2023-03-03T06:23:45.218118+0000","last_clean":"2023-03-03T06:23:45.218118+0000","last_became_active":"2023-03-03T06:23:44.424821+0000","last_became_peered":"2023-03-03T06:23:44.424821+0000","last_unstale":"2023-03-03T06:23:45.218118+0000","last_undegraded":"2023-03-03T06:23:45.218118+0000","last_fullsized":"2023-03-03T06:23:45.218118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:45:29.403205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.410402+0000","last_change":"2023-03-03T06:23:39.916608+0000","last_active":"2023-03-03T06:23:44.410402+0000","last_peered":"2023-03-03T06:23:44.410402+0000","last_clean":"2023-03-03T06:23:44.410402+0000","last_became_active":"2023-03-03T06:23:39.916307+0000","last_became_peered":"2023-03-03T06:23:39.916307+0000","last_unstale":"2023-03-03T06:23:44.410402+0000","last_undegraded":"2023-03-03T06:23:44.410402+0000","last_fullsized":"2023-03-03T06:23:44.410402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:36.495252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398185+0000","last_change":"2023-03-03T06:23:40.347737+0000","last_active":"2023-03-03T06:23:44.398185+0000","last_peered":"2023-03-03T06:23:44.398185+0000","last_clean":"2023-03-03T06:23:44.398185+0000","last_became_active":"2023-03-03T06:23:40.347002+0000","last_became_peered":"2023-03-03T06:23:40.347002+0000","last_unstale":"2023-03-03T06:23:44.398185+0000","last_undegraded":"2023-03-03T06:23:44.398185+0000","last_fullsized":"2023-03-03T06:23:44.398185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215709+0000","last_change":"2023-03-03T06:23:44.424830+0000","last_active":"2023-03-03T06:23:45.215709+0000","last_peered":"2023-03-03T06:23:45.215709+0000","last_clean":"2023-03-03T06:23:45.215709+0000","last_became_active":"2023-03-03T06:23:44.424435+0000","last_became_peered":"2023-03-03T06:23:44.424435+0000","last_unstale":"2023-03-03T06:23:45.215709+0000","last_undegraded":"2023-03-03T06:23:45.215709+0000","last_fullsized":"2023-03-03T06:23:45.215709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:29.892281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408855+0000","last_change":"2023-03-03T06:23:39.916989+0000","last_active":"2023-03-03T06:23:44.408855+0000","last_peered":"2023-03-03T06:23:44.408855+0000","last_clean":"2023-03-03T06:23:44.408855+0000","last_became_active":"2023-03-03T06:23:39.916686+0000","last_became_peered":"2023-03-03T06:23:39.916686+0000","last_unstale":"2023-03-03T06:23:44.408855+0000","last_undegraded":"2023-03-03T06:23:44.408855+0000","last_fullsized":"2023-03-03T06:23:44.408855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:04:17.846504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397402+0000","last_change":"2023-03-03T06:23:40.344010+0000","last_active":"2023-03-03T06:23:44.397402+0000","last_peered":"2023-03-03T06:23:44.397402+0000","last_clean":"2023-03-03T06:23:44.397402+0000","last_became_active":"2023-03-03T06:23:40.340204+0000","last_became_peered":"2023-03-03T06:23:40.340204+0000","last_unstale":"2023-03-03T06:23:44.397402+0000","last_undegraded":"2023-03-03T06:23:44.397402+0000","last_fullsized":"2023-03-03T06:23:44.397402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:57:56.186885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215937+0000","last_change":"2023-03-03T06:23:44.413387+0000","last_active":"2023-03-03T06:23:45.215937+0000","last_peered":"2023-03-03T06:23:45.215937+0000","last_clean":"2023-03-03T06:23:45.215937+0000","last_became_active":"2023-03-03T06:23:44.412643+0000","last_became_peered":"2023-03-03T06:23:44.412643+0000","last_unstale":"2023-03-03T06:23:45.215937+0000","last_undegraded":"2023-03-03T06:23:45.215937+0000","last_fullsized":"2023-03-03T06:23:45.215937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:11:57.156702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408463+0000","last_change":"2023-03-03T06:23:39.911757+0000","last_active":"2023-03-03T06:23:44.408463+0000","last_peered":"2023-03-03T06:23:44.408463+0000","last_clean":"2023-03-03T06:23:44.408463+0000","last_became_active":"2023-03-03T06:23:39.911430+0000","last_became_peered":"2023-03-03T06:23:39.911430+0000","last_unstale":"2023-03-03T06:23:44.408463+0000","last_undegraded":"2023-03-03T06:23:44.408463+0000","last_fullsized":"2023-03-03T06:23:44.408463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:30:04.252933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406464+0000","last_change":"2023-03-03T06:23:40.338136+0000","last_active":"2023-03-03T06:23:44.406464+0000","last_peered":"2023-03-03T06:23:44.406464+0000","last_clean":"2023-03-03T06:23:44.406464+0000","last_became_active":"2023-03-03T06:23:40.337828+0000","last_became_peered":"2023-03-03T06:23:40.337828+0000","last_unstale":"2023-03-03T06:23:44.406464+0000","last_undegraded":"2023-03-03T06:23:44.406464+0000","last_fullsized":"2023-03-03T06:23:44.406464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:30:05.258542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215914+0000","last_change":"2023-03-03T06:23:44.413004+0000","last_active":"2023-03-03T06:23:45.215914+0000","last_peered":"2023-03-03T06:23:45.215914+0000","last_clean":"2023-03-03T06:23:45.215914+0000","last_became_active":"2023-03-03T06:23:44.412564+0000","last_became_peered":"2023-03-03T06:23:44.412564+0000","last_unstale":"2023-03-03T06:23:45.215914+0000","last_undegraded":"2023-03-03T06:23:45.215914+0000","last_fullsized":"2023-03-03T06:23:45.215914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:16.090224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399592+0000","last_change":"2023-03-03T06:23:39.916059+0000","last_active":"2023-03-03T06:23:44.399592+0000","last_peered":"2023-03-03T06:23:44.399592+0000","last_clean":"2023-03-03T06:23:44.399592+0000","last_became_active":"2023-03-03T06:23:39.915796+0000","last_became_peered":"2023-03-03T06:23:39.915796+0000","last_unstale":"2023-03-03T06:23:44.399592+0000","last_undegraded":"2023-03-03T06:23:44.399592+0000","last_fullsized":"2023-03-03T06:23:44.399592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413796+0000","last_change":"2023-03-03T06:23:40.331555+0000","last_active":"2023-03-03T06:23:44.413796+0000","last_peered":"2023-03-03T06:23:44.413796+0000","last_clean":"2023-03-03T06:23:44.413796+0000","last_became_active":"2023-03-03T06:23:40.331304+0000","last_became_peered":"2023-03-03T06:23:40.331304+0000","last_unstale":"2023-03-03T06:23:44.413796+0000","last_undegraded":"2023-03-03T06:23:44.413796+0000","last_fullsized":"2023-03-03T06:23:44.413796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215910+0000","last_change":"2023-03-03T06:23:44.413292+0000","last_active":"2023-03-03T06:23:45.215910+0000","last_peered":"2023-03-03T06:23:45.215910+0000","last_clean":"2023-03-03T06:23:45.215910+0000","last_became_active":"2023-03-03T06:23:44.412668+0000","last_became_peered":"2023-03-03T06:23:44.412668+0000","last_unstale":"2023-03-03T06:23:45.215910+0000","last_undegraded":"2023-03-03T06:23:45.215910+0000","last_fullsized":"2023-03-03T06:23:45.215910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:42:28.966046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401269+0000","last_change":"2023-03-03T06:23:39.917500+0000","last_active":"2023-03-03T06:23:44.401269+0000","last_peered":"2023-03-03T06:23:44.401269+0000","last_clean":"2023-03-03T06:23:44.401269+0000","last_became_active":"2023-03-03T06:23:39.917201+0000","last_became_peered":"2023-03-03T06:23:39.917201+0000","last_unstale":"2023-03-03T06:23:44.401269+0000","last_undegraded":"2023-03-03T06:23:44.401269+0000","last_fullsized":"2023-03-03T06:23:44.401269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:44.071696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396883+0000","last_change":"2023-03-03T06:23:40.347773+0000","last_active":"2023-03-03T06:23:44.396883+0000","last_peered":"2023-03-03T06:23:44.396883+0000","last_clean":"2023-03-03T06:23:44.396883+0000","last_became_active":"2023-03-03T06:23:40.346824+0000","last_became_peered":"2023-03-03T06:23:40.346824+0000","last_unstale":"2023-03-03T06:23:44.396883+0000","last_undegraded":"2023-03-03T06:23:44.396883+0000","last_fullsized":"2023-03-03T06:23:44.396883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:50.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.821697+0000","last_change":"2023-03-03T06:23:44.413742+0000","last_active":"2023-03-03T06:23:44.821697+0000","last_peered":"2023-03-03T06:23:44.821697+0000","last_clean":"2023-03-03T06:23:44.821697+0000","last_became_active":"2023-03-03T06:23:44.413323+0000","last_became_peered":"2023-03-03T06:23:44.413323+0000","last_unstale":"2023-03-03T06:23:44.821697+0000","last_undegraded":"2023-03-03T06:23:44.821697+0000","last_fullsized":"2023-03-03T06:23:44.821697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:50:31.688270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406544+0000","last_change":"2023-03-03T06:23:39.916329+0000","last_active":"2023-03-03T06:23:44.406544+0000","last_peered":"2023-03-03T06:23:44.406544+0000","last_clean":"2023-03-03T06:23:44.406544+0000","last_became_active":"2023-03-03T06:23:39.916060+0000","last_became_peered":"2023-03-03T06:23:39.916060+0000","last_unstale":"2023-03-03T06:23:44.406544+0000","last_undegraded":"2023-03-03T06:23:44.406544+0000","last_fullsized":"2023-03-03T06:23:44.406544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:37.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.395753+0000","last_change":"2023-03-03T06:23:40.349832+0000","last_active":"2023-03-03T06:23:44.395753+0000","last_peered":"2023-03-03T06:23:44.395753+0000","last_clean":"2023-03-03T06:23:44.395753+0000","last_became_active":"2023-03-03T06:23:40.343955+0000","last_became_peered":"2023-03-03T06:23:40.343955+0000","last_unstale":"2023-03-03T06:23:44.395753+0000","last_undegraded":"2023-03-03T06:23:44.395753+0000","last_fullsized":"2023-03-03T06:23:44.395753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:55:53.505277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217364+0000","last_change":"2023-03-03T06:23:44.417750+0000","last_active":"2023-03-03T06:23:45.217364+0000","last_peered":"2023-03-03T06:23:45.217364+0000","last_clean":"2023-03-03T06:23:45.217364+0000","last_became_active":"2023-03-03T06:23:44.417295+0000","last_became_peered":"2023-03-03T06:23:44.417295+0000","last_unstale":"2023-03-03T06:23:45.217364+0000","last_undegraded":"2023-03-03T06:23:45.217364+0000","last_fullsized":"2023-03-03T06:23:45.217364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:04:21.713427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397226+0000","last_change":"2023-03-03T06:23:39.913064+0000","last_active":"2023-03-03T06:23:44.397226+0000","last_peered":"2023-03-03T06:23:44.397226+0000","last_clean":"2023-03-03T06:23:44.397226+0000","last_became_active":"2023-03-03T06:23:39.912756+0000","last_became_peered":"2023-03-03T06:23:39.912756+0000","last_unstale":"2023-03-03T06:23:44.397226+0000","last_undegraded":"2023-03-03T06:23:44.397226+0000","last_fullsized":"2023-03-03T06:23:44.397226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398500+0000","last_change":"2023-03-03T06:23:40.345016+0000","last_active":"2023-03-03T06:23:44.398500+0000","last_peered":"2023-03-03T06:23:44.398500+0000","last_clean":"2023-03-03T06:23:44.398500+0000","last_became_active":"2023-03-03T06:23:40.340755+0000","last_became_peered":"2023-03-03T06:23:40.340755+0000","last_unstale":"2023-03-03T06:23:44.398500+0000","last_undegraded":"2023-03-03T06:23:44.398500+0000","last_fullsized":"2023-03-03T06:23:44.398500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:26.393574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822613+0000","last_change":"2023-03-03T06:23:44.412105+0000","last_active":"2023-03-03T06:23:44.822613+0000","last_peered":"2023-03-03T06:23:44.822613+0000","last_clean":"2023-03-03T06:23:44.822613+0000","last_became_active":"2023-03-03T06:23:44.411353+0000","last_became_peered":"2023-03-03T06:23:44.411353+0000","last_unstale":"2023-03-03T06:23:44.822613+0000","last_undegraded":"2023-03-03T06:23:44.822613+0000","last_fullsized":"2023-03-03T06:23:44.822613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:23:56.487480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397316+0000","last_change":"2023-03-03T06:23:39.916313+0000","last_active":"2023-03-03T06:23:44.397316+0000","last_peered":"2023-03-03T06:23:44.397316+0000","last_clean":"2023-03-03T06:23:44.397316+0000","last_became_active":"2023-03-03T06:23:39.916058+0000","last_became_peered":"2023-03-03T06:23:39.916058+0000","last_unstale":"2023-03-03T06:23:44.397316+0000","last_undegraded":"2023-03-03T06:23:44.397316+0000","last_fullsized":"2023-03-03T06:23:44.397316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:59:20.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408755+0000","last_change":"2023-03-03T06:23:40.339541+0000","last_active":"2023-03-03T06:23:44.408755+0000","last_peered":"2023-03-03T06:23:44.408755+0000","last_clean":"2023-03-03T06:23:44.408755+0000","last_became_active":"2023-03-03T06:23:40.339291+0000","last_became_peered":"2023-03-03T06:23:40.339291+0000","last_unstale":"2023-03-03T06:23:44.408755+0000","last_undegraded":"2023-03-03T06:23:44.408755+0000","last_fullsized":"2023-03-03T06:23:44.408755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:17.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822768+0000","last_change":"2023-03-03T06:23:44.413275+0000","last_active":"2023-03-03T06:23:44.822768+0000","last_peered":"2023-03-03T06:23:44.822768+0000","last_clean":"2023-03-03T06:23:44.822768+0000","last_became_active":"2023-03-03T06:23:44.412027+0000","last_became_peered":"2023-03-03T06:23:44.412027+0000","last_unstale":"2023-03-03T06:23:44.822768+0000","last_undegraded":"2023-03-03T06:23:44.822768+0000","last_fullsized":"2023-03-03T06:23:44.822768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:46:08.536113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401273+0000","last_change":"2023-03-03T06:23:39.913990+0000","last_active":"2023-03-03T06:23:44.401273+0000","last_peered":"2023-03-03T06:23:44.401273+0000","last_clean":"2023-03-03T06:23:44.401273+0000","last_became_active":"2023-03-03T06:23:39.913721+0000","last_became_peered":"2023-03-03T06:23:39.913721+0000","last_unstale":"2023-03-03T06:23:44.401273+0000","last_undegraded":"2023-03-03T06:23:44.401273+0000","last_fullsized":"2023-03-03T06:23:44.401273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:19:38.164048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.395934+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:23:44.395934+0000","last_peered":"2023-03-03T06:23:44.395934+0000","last_clean":"2023-03-03T06:23:44.395934+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:23:44.395934+0000","last_undegraded":"2023-03-03T06:23:44.395934+0000","last_fullsized":"2023-03-03T06:23:44.395934+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397197+0000","last_change":"2023-03-03T06:23:40.346219+0000","last_active":"2023-03-03T06:23:44.397197+0000","last_peered":"2023-03-03T06:23:44.397197+0000","last_clean":"2023-03-03T06:23:44.397197+0000","last_became_active":"2023-03-03T06:23:40.345907+0000","last_became_peered":"2023-03-03T06:23:40.345907+0000","last_unstale":"2023-03-03T06:23:44.397197+0000","last_undegraded":"2023-03-03T06:23:44.397197+0000","last_fullsized":"2023-03-03T06:23:44.397197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822264+0000","last_change":"2023-03-03T06:23:44.412472+0000","last_active":"2023-03-03T06:23:44.822264+0000","last_peered":"2023-03-03T06:23:44.822264+0000","last_clean":"2023-03-03T06:23:44.822264+0000","last_became_active":"2023-03-03T06:23:44.412106+0000","last_became_peered":"2023-03-03T06:23:44.412106+0000","last_unstale":"2023-03-03T06:23:44.822264+0000","last_undegraded":"2023-03-03T06:23:44.822264+0000","last_fullsized":"2023-03-03T06:23:44.822264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:03:14.816505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406142+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:23:44.406142+0000","last_peered":"2023-03-03T06:23:44.406142+0000","last_clean":"2023-03-03T06:23:44.406142+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:23:44.406142+0000","last_undegraded":"2023-03-03T06:23:44.406142+0000","last_fullsized":"2023-03-03T06:23:44.406142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011109+0000","last_change":"2023-03-03T06:23:39.907672+0000","last_active":"2023-03-03T06:23:45.011109+0000","last_peered":"2023-03-03T06:23:45.011109+0000","last_clean":"2023-03-03T06:23:45.011109+0000","last_became_active":"2023-03-03T06:23:39.907353+0000","last_became_peered":"2023-03-03T06:23:39.907353+0000","last_unstale":"2023-03-03T06:23:45.011109+0000","last_undegraded":"2023-03-03T06:23:45.011109+0000","last_fullsized":"2023-03-03T06:23:45.011109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:44.071696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397317+0000","last_change":"2023-03-03T06:23:40.347947+0000","last_active":"2023-03-03T06:23:44.397317+0000","last_peered":"2023-03-03T06:23:44.397317+0000","last_clean":"2023-03-03T06:23:44.397317+0000","last_became_active":"2023-03-03T06:23:40.347617+0000","last_became_peered":"2023-03-03T06:23:40.347617+0000","last_unstale":"2023-03-03T06:23:44.397317+0000","last_undegraded":"2023-03-03T06:23:44.397317+0000","last_fullsized":"2023-03-03T06:23:44.397317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:27.072231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216962+0000","last_change":"2023-03-03T06:23:44.412431+0000","last_active":"2023-03-03T06:23:45.216962+0000","last_peered":"2023-03-03T06:23:45.216962+0000","last_clean":"2023-03-03T06:23:45.216962+0000","last_became_active":"2023-03-03T06:23:44.411748+0000","last_became_peered":"2023-03-03T06:23:44.411748+0000","last_unstale":"2023-03-03T06:23:45.216962+0000","last_undegraded":"2023-03-03T06:23:45.216962+0000","last_fullsized":"2023-03-03T06:23:45.216962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:40:15.816562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406632+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:23:44.406632+0000","last_peered":"2023-03-03T06:23:44.406632+0000","last_clean":"2023-03-03T06:23:44.406632+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:23:44.406632+0000","last_undegraded":"2023-03-03T06:23:44.406632+0000","last_fullsized":"2023-03-03T06:23:44.406632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407696+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:23:44.407696+0000","last_peered":"2023-03-03T06:23:44.407696+0000","last_clean":"2023-03-03T06:23:44.407696+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:23:44.407696+0000","last_undegraded":"2023-03-03T06:23:44.407696+0000","last_fullsized":"2023-03-03T06:23:44.407696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408209+0000","last_change":"2023-03-03T06:23:39.911633+0000","last_active":"2023-03-03T06:23:44.408209+0000","last_peered":"2023-03-03T06:23:44.408209+0000","last_clean":"2023-03-03T06:23:44.408209+0000","last_became_active":"2023-03-03T06:23:39.911343+0000","last_became_peered":"2023-03-03T06:23:39.911343+0000","last_unstale":"2023-03-03T06:23:44.408209+0000","last_undegraded":"2023-03-03T06:23:44.408209+0000","last_fullsized":"2023-03-03T06:23:44.408209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.412424+0000","last_change":"2023-03-03T06:23:40.331020+0000","last_active":"2023-03-03T06:23:44.412424+0000","last_peered":"2023-03-03T06:23:44.412424+0000","last_clean":"2023-03-03T06:23:44.412424+0000","last_became_active":"2023-03-03T06:23:40.330714+0000","last_became_peered":"2023-03-03T06:23:40.330714+0000","last_unstale":"2023-03-03T06:23:44.412424+0000","last_undegraded":"2023-03-03T06:23:44.412424+0000","last_fullsized":"2023-03-03T06:23:44.412424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:03:45.180190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216187+0000","last_change":"2023-03-03T06:23:44.410983+0000","last_active":"2023-03-03T06:23:45.216187+0000","last_peered":"2023-03-03T06:23:45.216187+0000","last_clean":"2023-03-03T06:23:45.216187+0000","last_became_active":"2023-03-03T06:23:44.410572+0000","last_became_peered":"2023-03-03T06:23:44.410572+0000","last_unstale":"2023-03-03T06:23:45.216187+0000","last_undegraded":"2023-03-03T06:23:45.216187+0000","last_fullsized":"2023-03-03T06:23:45.216187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:30.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408155+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:23:44.408155+0000","last_peered":"2023-03-03T06:23:44.408155+0000","last_clean":"2023-03-03T06:23:44.408155+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:23:44.408155+0000","last_undegraded":"2023-03-03T06:23:44.408155+0000","last_fullsized":"2023-03-03T06:23:44.408155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408305+0000","last_change":"2023-03-03T06:23:39.911439+0000","last_active":"2023-03-03T06:23:44.408305+0000","last_peered":"2023-03-03T06:23:44.408305+0000","last_clean":"2023-03-03T06:23:44.408305+0000","last_became_active":"2023-03-03T06:23:39.910571+0000","last_became_peered":"2023-03-03T06:23:39.910571+0000","last_unstale":"2023-03-03T06:23:44.408305+0000","last_undegraded":"2023-03-03T06:23:44.408305+0000","last_fullsized":"2023-03-03T06:23:44.408305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:05:05.468654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408707+0000","last_change":"2023-03-03T06:23:40.331506+0000","last_active":"2023-03-03T06:23:44.408707+0000","last_peered":"2023-03-03T06:23:44.408707+0000","last_clean":"2023-03-03T06:23:44.408707+0000","last_became_active":"2023-03-03T06:23:40.331225+0000","last_became_peered":"2023-03-03T06:23:40.331225+0000","last_unstale":"2023-03-03T06:23:44.408707+0000","last_undegraded":"2023-03-03T06:23:44.408707+0000","last_fullsized":"2023-03-03T06:23:44.408707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:42:56.190690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217577+0000","last_change":"2023-03-03T06:23:44.424824+0000","last_active":"2023-03-03T06:23:45.217577+0000","last_peered":"2023-03-03T06:23:45.217577+0000","last_clean":"2023-03-03T06:23:45.217577+0000","last_became_active":"2023-03-03T06:23:44.424408+0000","last_became_peered":"2023-03-03T06:23:44.424408+0000","last_unstale":"2023-03-03T06:23:45.217577+0000","last_undegraded":"2023-03-03T06:23:45.217577+0000","last_fullsized":"2023-03-03T06:23:45.217577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:22:48.378893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407463+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:23:44.407463+0000","last_peered":"2023-03-03T06:23:44.407463+0000","last_clean":"2023-03-03T06:23:44.407463+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:23:44.407463+0000","last_undegraded":"2023-03-03T06:23:44.407463+0000","last_fullsized":"2023-03-03T06:23:44.407463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400330+0000","last_change":"2023-03-03T06:23:39.915098+0000","last_active":"2023-03-03T06:23:44.400330+0000","last_peered":"2023-03-03T06:23:44.400330+0000","last_clean":"2023-03-03T06:23:44.400330+0000","last_became_active":"2023-03-03T06:23:39.914785+0000","last_became_peered":"2023-03-03T06:23:39.914785+0000","last_unstale":"2023-03-03T06:23:44.400330+0000","last_undegraded":"2023-03-03T06:23:44.400330+0000","last_fullsized":"2023-03-03T06:23:44.400330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406226+0000","last_change":"2023-03-03T06:23:40.348600+0000","last_active":"2023-03-03T06:23:44.406226+0000","last_peered":"2023-03-03T06:23:44.406226+0000","last_clean":"2023-03-03T06:23:44.406226+0000","last_became_active":"2023-03-03T06:23:40.348139+0000","last_became_peered":"2023-03-03T06:23:40.348139+0000","last_unstale":"2023-03-03T06:23:44.406226+0000","last_undegraded":"2023-03-03T06:23:44.406226+0000","last_fullsized":"2023-03-03T06:23:44.406226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:18:37.603414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011148+0000","last_change":"2023-03-03T06:23:44.416443+0000","last_active":"2023-03-03T06:23:45.011148+0000","last_peered":"2023-03-03T06:23:45.011148+0000","last_clean":"2023-03-03T06:23:45.011148+0000","last_became_active":"2023-03-03T06:23:44.415629+0000","last_became_peered":"2023-03-03T06:23:44.415629+0000","last_unstale":"2023-03-03T06:23:45.011148+0000","last_undegraded":"2023-03-03T06:23:45.011148+0000","last_fullsized":"2023-03-03T06:23:45.011148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:45:29.403205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398099+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:23:44.398099+0000","last_peered":"2023-03-03T06:23:44.398099+0000","last_clean":"2023-03-03T06:23:44.398099+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:23:44.398099+0000","last_undegraded":"2023-03-03T06:23:44.398099+0000","last_fullsized":"2023-03-03T06:23:44.398099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396227+0000","last_change":"2023-03-03T06:23:39.917152+0000","last_active":"2023-03-03T06:23:44.396227+0000","last_peered":"2023-03-03T06:23:44.396227+0000","last_clean":"2023-03-03T06:23:44.396227+0000","last_became_active":"2023-03-03T06:23:39.916712+0000","last_became_peered":"2023-03-03T06:23:39.916712+0000","last_unstale":"2023-03-03T06:23:44.396227+0000","last_undegraded":"2023-03-03T06:23:44.396227+0000","last_fullsized":"2023-03-03T06:23:44.396227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407594+0000","last_change":"2023-03-03T06:23:40.326857+0000","last_active":"2023-03-03T06:23:44.407594+0000","last_peered":"2023-03-03T06:23:44.407594+0000","last_clean":"2023-03-03T06:23:44.407594+0000","last_became_active":"2023-03-03T06:23:40.326623+0000","last_became_peered":"2023-03-03T06:23:40.326623+0000","last_unstale":"2023-03-03T06:23:44.407594+0000","last_undegraded":"2023-03-03T06:23:44.407594+0000","last_fullsized":"2023-03-03T06:23:44.407594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:56:24.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216598+0000","last_change":"2023-03-03T06:23:44.421895+0000","last_active":"2023-03-03T06:23:45.216598+0000","last_peered":"2023-03-03T06:23:45.216598+0000","last_clean":"2023-03-03T06:23:45.216598+0000","last_became_active":"2023-03-03T06:23:44.421563+0000","last_became_peered":"2023-03-03T06:23:44.421563+0000","last_unstale":"2023-03-03T06:23:45.216598+0000","last_undegraded":"2023-03-03T06:23:45.216598+0000","last_fullsized":"2023-03-03T06:23:45.216598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:42:28.966046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406284+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:23:44.406284+0000","last_peered":"2023-03-03T06:23:44.406284+0000","last_clean":"2023-03-03T06:23:44.406284+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:23:44.406284+0000","last_undegraded":"2023-03-03T06:23:44.406284+0000","last_fullsized":"2023-03-03T06:23:44.406284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407688+0000","last_change":"2023-03-03T06:23:39.912862+0000","last_active":"2023-03-03T06:23:44.407688+0000","last_peered":"2023-03-03T06:23:44.407688+0000","last_clean":"2023-03-03T06:23:44.407688+0000","last_became_active":"2023-03-03T06:23:39.912540+0000","last_became_peered":"2023-03-03T06:23:39.912540+0000","last_unstale":"2023-03-03T06:23:44.407688+0000","last_undegraded":"2023-03-03T06:23:44.407688+0000","last_fullsized":"2023-03-03T06:23:44.407688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:40.963572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413554+0000","last_change":"2023-03-03T06:23:40.330277+0000","last_active":"2023-03-03T06:23:44.413554+0000","last_peered":"2023-03-03T06:23:44.413554+0000","last_clean":"2023-03-03T06:23:44.413554+0000","last_became_active":"2023-03-03T06:23:40.329978+0000","last_became_peered":"2023-03-03T06:23:40.329978+0000","last_unstale":"2023-03-03T06:23:44.413554+0000","last_undegraded":"2023-03-03T06:23:44.413554+0000","last_fullsized":"2023-03-03T06:23:44.413554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:56:24.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011025+0000","last_change":"2023-03-03T06:23:44.414799+0000","last_active":"2023-03-03T06:23:45.011025+0000","last_peered":"2023-03-03T06:23:45.011025+0000","last_clean":"2023-03-03T06:23:45.011025+0000","last_became_active":"2023-03-03T06:23:44.414225+0000","last_became_peered":"2023-03-03T06:23:44.414225+0000","last_unstale":"2023-03-03T06:23:45.011025+0000","last_undegraded":"2023-03-03T06:23:45.011025+0000","last_fullsized":"2023-03-03T06:23:45.011025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:28:15.023557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406901+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:23:44.406901+0000","last_peered":"2023-03-03T06:23:44.406901+0000","last_clean":"2023-03-03T06:23:44.406901+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:23:44.406901+0000","last_undegraded":"2023-03-03T06:23:44.406901+0000","last_fullsized":"2023-03-03T06:23:44.406901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399724+0000","last_change":"2023-03-03T06:23:39.918687+0000","last_active":"2023-03-03T06:23:44.399724+0000","last_peered":"2023-03-03T06:23:44.399724+0000","last_clean":"2023-03-03T06:23:44.399724+0000","last_became_active":"2023-03-03T06:23:39.918213+0000","last_became_peered":"2023-03-03T06:23:39.918213+0000","last_unstale":"2023-03-03T06:23:44.399724+0000","last_undegraded":"2023-03-03T06:23:44.399724+0000","last_fullsized":"2023-03-03T06:23:44.399724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406330+0000","last_change":"2023-03-03T06:23:40.329407+0000","last_active":"2023-03-03T06:23:44.406330+0000","last_peered":"2023-03-03T06:23:44.406330+0000","last_clean":"2023-03-03T06:23:44.406330+0000","last_became_active":"2023-03-03T06:23:40.329131+0000","last_became_peered":"2023-03-03T06:23:40.329131+0000","last_unstale":"2023-03-03T06:23:44.406330+0000","last_undegraded":"2023-03-03T06:23:44.406330+0000","last_fullsized":"2023-03-03T06:23:44.406330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:41:25.301780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.821924+0000","last_change":"2023-03-03T06:23:44.421929+0000","last_active":"2023-03-03T06:23:44.821924+0000","last_peered":"2023-03-03T06:23:44.821924+0000","last_clean":"2023-03-03T06:23:44.821924+0000","last_became_active":"2023-03-03T06:23:44.421457+0000","last_became_peered":"2023-03-03T06:23:44.421457+0000","last_unstale":"2023-03-03T06:23:44.821924+0000","last_undegraded":"2023-03-03T06:23:44.821924+0000","last_fullsized":"2023-03-03T06:23:44.821924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:03:17.411194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413461+0000","last_change":"2023-03-03T06:23:39.916295+0000","last_active":"2023-03-03T06:23:44.413461+0000","last_peered":"2023-03-03T06:23:44.413461+0000","last_clean":"2023-03-03T06:23:44.413461+0000","last_became_active":"2023-03-03T06:23:39.916027+0000","last_became_peered":"2023-03-03T06:23:39.916027+0000","last_unstale":"2023-03-03T06:23:44.413461+0000","last_undegraded":"2023-03-03T06:23:44.413461+0000","last_fullsized":"2023-03-03T06:23:44.413461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:19:38.164048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394183+0000","last_change":"2023-03-03T06:23:40.332708+0000","last_active":"2023-03-03T06:23:44.394183+0000","last_peered":"2023-03-03T06:23:44.394183+0000","last_clean":"2023-03-03T06:23:44.394183+0000","last_became_active":"2023-03-03T06:23:40.332382+0000","last_became_peered":"2023-03-03T06:23:40.332382+0000","last_unstale":"2023-03-03T06:23:44.394183+0000","last_undegraded":"2023-03-03T06:23:44.394183+0000","last_fullsized":"2023-03-03T06:23:44.394183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:39.735760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217389+0000","last_change":"2023-03-03T06:23:44.420467+0000","last_active":"2023-03-03T06:23:45.217389+0000","last_peered":"2023-03-03T06:23:45.217389+0000","last_clean":"2023-03-03T06:23:45.217389+0000","last_became_active":"2023-03-03T06:23:44.420078+0000","last_became_peered":"2023-03-03T06:23:44.420078+0000","last_unstale":"2023-03-03T06:23:45.217389+0000","last_undegraded":"2023-03-03T06:23:45.217389+0000","last_fullsized":"2023-03-03T06:23:45.217389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:03:17.411194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398998+0000","last_change":"2023-03-03T06:23:39.911136+0000","last_active":"2023-03-03T06:23:44.398998+0000","last_peered":"2023-03-03T06:23:44.398998+0000","last_clean":"2023-03-03T06:23:44.398998+0000","last_became_active":"2023-03-03T06:23:39.910722+0000","last_became_peered":"2023-03-03T06:23:39.910722+0000","last_unstale":"2023-03-03T06:23:44.398998+0000","last_undegraded":"2023-03-03T06:23:44.398998+0000","last_fullsized":"2023-03-03T06:23:44.398998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:44.071696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396133+0000","last_change":"2023-03-03T06:23:40.350618+0000","last_active":"2023-03-03T06:23:44.396133+0000","last_peered":"2023-03-03T06:23:44.396133+0000","last_clean":"2023-03-03T06:23:44.396133+0000","last_became_active":"2023-03-03T06:23:40.350186+0000","last_became_peered":"2023-03-03T06:23:40.350186+0000","last_unstale":"2023-03-03T06:23:44.396133+0000","last_undegraded":"2023-03-03T06:23:44.396133+0000","last_fullsized":"2023-03-03T06:23:44.396133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:19.510143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216582+0000","last_change":"2023-03-03T06:23:44.421952+0000","last_active":"2023-03-03T06:23:45.216582+0000","last_peered":"2023-03-03T06:23:45.216582+0000","last_clean":"2023-03-03T06:23:45.216582+0000","last_became_active":"2023-03-03T06:23:44.421492+0000","last_became_peered":"2023-03-03T06:23:44.421492+0000","last_unstale":"2023-03-03T06:23:45.216582+0000","last_undegraded":"2023-03-03T06:23:45.216582+0000","last_fullsized":"2023-03-03T06:23:45.216582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:22:48.378893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399293+0000","last_change":"2023-03-03T06:23:39.918470+0000","last_active":"2023-03-03T06:23:44.399293+0000","last_peered":"2023-03-03T06:23:44.399293+0000","last_clean":"2023-03-03T06:23:44.399293+0000","last_became_active":"2023-03-03T06:23:39.917860+0000","last_became_peered":"2023-03-03T06:23:39.917860+0000","last_unstale":"2023-03-03T06:23:44.399293+0000","last_undegraded":"2023-03-03T06:23:44.399293+0000","last_fullsized":"2023-03-03T06:23:44.399293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:20.326465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396555+0000","last_change":"2023-03-03T06:23:40.347706+0000","last_active":"2023-03-03T06:23:44.396555+0000","last_peered":"2023-03-03T06:23:44.396555+0000","last_clean":"2023-03-03T06:23:44.396555+0000","last_became_active":"2023-03-03T06:23:40.344594+0000","last_became_peered":"2023-03-03T06:23:40.344594+0000","last_unstale":"2023-03-03T06:23:44.396555+0000","last_undegraded":"2023-03-03T06:23:44.396555+0000","last_fullsized":"2023-03-03T06:23:44.396555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822175+0000","last_change":"2023-03-03T06:23:44.412148+0000","last_active":"2023-03-03T06:23:44.822175+0000","last_peered":"2023-03-03T06:23:44.822175+0000","last_clean":"2023-03-03T06:23:44.822175+0000","last_became_active":"2023-03-03T06:23:44.411541+0000","last_became_peered":"2023-03-03T06:23:44.411541+0000","last_unstale":"2023-03-03T06:23:44.822175+0000","last_undegraded":"2023-03-03T06:23:44.822175+0000","last_fullsized":"2023-03-03T06:23:44.822175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:11:52.237707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397307+0000","last_change":"2023-03-03T06:23:39.913487+0000","last_active":"2023-03-03T06:23:44.397307+0000","last_peered":"2023-03-03T06:23:44.397307+0000","last_clean":"2023-03-03T06:23:44.397307+0000","last_became_active":"2023-03-03T06:23:39.913194+0000","last_became_peered":"2023-03-03T06:23:39.913194+0000","last_unstale":"2023-03-03T06:23:44.397307+0000","last_undegraded":"2023-03-03T06:23:44.397307+0000","last_fullsized":"2023-03-03T06:23:44.397307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:20.326465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397158+0000","last_change":"2023-03-03T06:23:40.338004+0000","last_active":"2023-03-03T06:23:44.397158+0000","last_peered":"2023-03-03T06:23:44.397158+0000","last_clean":"2023-03-03T06:23:44.397158+0000","last_became_active":"2023-03-03T06:23:40.337689+0000","last_became_peered":"2023-03-03T06:23:40.337689+0000","last_unstale":"2023-03-03T06:23:44.397158+0000","last_undegraded":"2023-03-03T06:23:44.397158+0000","last_fullsized":"2023-03-03T06:23:44.397158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:00.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.821814+0000","last_change":"2023-03-03T06:23:44.413502+0000","last_active":"2023-03-03T06:23:44.821814+0000","last_peered":"2023-03-03T06:23:44.821814+0000","last_clean":"2023-03-03T06:23:44.821814+0000","last_became_active":"2023-03-03T06:23:44.413099+0000","last_became_peered":"2023-03-03T06:23:44.413099+0000","last_unstale":"2023-03-03T06:23:44.821814+0000","last_undegraded":"2023-03-03T06:23:44.821814+0000","last_fullsized":"2023-03-03T06:23:44.821814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:23.008849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414685+0000","last_change":"2023-03-03T06:23:39.911148+0000","last_active":"2023-03-03T06:23:44.414685+0000","last_peered":"2023-03-03T06:23:44.414685+0000","last_clean":"2023-03-03T06:23:44.414685+0000","last_became_active":"2023-03-03T06:23:39.910465+0000","last_became_peered":"2023-03-03T06:23:39.910465+0000","last_unstale":"2023-03-03T06:23:44.414685+0000","last_undegraded":"2023-03-03T06:23:44.414685+0000","last_fullsized":"2023-03-03T06:23:44.414685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398776+0000","last_change":"2023-03-03T06:23:40.347365+0000","last_active":"2023-03-03T06:23:44.398776+0000","last_peered":"2023-03-03T06:23:44.398776+0000","last_clean":"2023-03-03T06:23:44.398776+0000","last_became_active":"2023-03-03T06:23:40.347102+0000","last_became_peered":"2023-03-03T06:23:40.347102+0000","last_unstale":"2023-03-03T06:23:44.398776+0000","last_undegraded":"2023-03-03T06:23:44.398776+0000","last_fullsized":"2023-03-03T06:23:44.398776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:42:25.467339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406140+0000","last_change":"2023-03-03T06:23:40.337697+0000","last_active":"2023-03-03T06:23:44.406140+0000","last_peered":"2023-03-03T06:23:44.406140+0000","last_clean":"2023-03-03T06:23:44.406140+0000","last_became_active":"2023-03-03T06:23:40.337414+0000","last_became_peered":"2023-03-03T06:23:40.337414+0000","last_unstale":"2023-03-03T06:23:44.406140+0000","last_undegraded":"2023-03-03T06:23:44.406140+0000","last_fullsized":"2023-03-03T06:23:44.406140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:05:13.223033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396852+0000","last_change":"2023-03-03T06:23:40.340779+0000","last_active":"2023-03-03T06:23:44.396852+0000","last_peered":"2023-03-03T06:23:44.396852+0000","last_clean":"2023-03-03T06:23:44.396852+0000","last_became_active":"2023-03-03T06:23:40.338305+0000","last_became_peered":"2023-03-03T06:23:40.338305+0000","last_unstale":"2023-03-03T06:23:44.396852+0000","last_undegraded":"2023-03-03T06:23:44.396852+0000","last_fullsized":"2023-03-03T06:23:44.396852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:26.393574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396806+0000","last_change":"2023-03-03T06:23:40.348094+0000","last_active":"2023-03-03T06:23:44.396806+0000","last_peered":"2023-03-03T06:23:44.396806+0000","last_clean":"2023-03-03T06:23:44.396806+0000","last_became_active":"2023-03-03T06:23:40.347736+0000","last_became_peered":"2023-03-03T06:23:40.347736+0000","last_unstale":"2023-03-03T06:23:44.396806+0000","last_undegraded":"2023-03-03T06:23:44.396806+0000","last_fullsized":"2023-03-03T06:23:44.396806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:11:53.657995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401149+0000","last_change":"2023-03-03T06:23:40.349146+0000","last_active":"2023-03-03T06:23:44.401149+0000","last_peered":"2023-03-03T06:23:44.401149+0000","last_clean":"2023-03-03T06:23:44.401149+0000","last_became_active":"2023-03-03T06:23:40.348873+0000","last_became_peered":"2023-03-03T06:23:40.348873+0000","last_unstale":"2023-03-03T06:23:44.401149+0000","last_undegraded":"2023-03-03T06:23:44.401149+0000","last_fullsized":"2023-03-03T06:23:44.401149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407642+0000","last_change":"2023-03-03T06:23:40.348472+0000","last_active":"2023-03-03T06:23:44.407642+0000","last_peered":"2023-03-03T06:23:44.407642+0000","last_clean":"2023-03-03T06:23:44.407642+0000","last_became_active":"2023-03-03T06:23:40.348181+0000","last_became_peered":"2023-03-03T06:23:40.348181+0000","last_unstale":"2023-03-03T06:23:44.407642+0000","last_undegraded":"2023-03-03T06:23:44.407642+0000","last_fullsized":"2023-03-03T06:23:44.407642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:03:45.180190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4528,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":703731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8076,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363764,"statfs":{"total":96636764160,"available":96628494336,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9232,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362608,"statfs":{"total":96636764160,"available":96627310592,"internally_reserved":0,"allocated":860160,"data_stored":699769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8140,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363700,"statfs":{"total":96636764160,"available":96628428800,"internally_reserved":0,"allocated":266240,"data_stored":109006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8076,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363764,"statfs":{"total":96636764160,"available":96628494336,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":270336,"data_stored":109491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8224,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363616,"statfs":{"total":96636764160,"available":96628342784,"internally_reserved":0,"allocated":286720,"data_stored":113203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":270336,"data_stored":109076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:24:00.052 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-03T06:24:00.053 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-03-03T06:24:00.053 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-03-03T06:24:00.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-03-03T06:24:00.054 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-03-03T06:24:00.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.207+0000 7ffbe5103700 1 Processor -- start 2023-03-03T06:24:00.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.207+0000 7ffbe5103700 1 -- start start 2023-03-03T06:24:00.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbe5103700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ffbe015cd30 0x7ffbe006c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbe5103700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffbe0160670 0x7ffbe00cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbe5103700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffbe006d8b0 0x7ffbe00cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbe5103700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe015d200 con 0x7ffbe006d8b0 2023-03-03T06:24:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbe5103700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe0160be0 con 0x7ffbe015cd30 2023-03-03T06:24:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbe5103700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe0160ec0 con 0x7ffbe0160670 2023-03-03T06:24:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbdf59e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffbe006d8b0 0x7ffbe00cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbdf59e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffbe006d8b0 0x7ffbe00cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41516/0 (socket says 172.21.15.5:41516) 2023-03-03T06:24:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbdf59e700 1 -- 172.21.15.5:0/2949221489 learned_addr learned my addr 172.21.15.5:0/2949221489 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:00.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbdf59e700 1 -- 172.21.15.5:0/2949221489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffbe0160670 msgr2=0x7ffbe00cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbdf59e700 1 --2- 172.21.15.5:0/2949221489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffbe0160670 0x7ffbe00cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbdf59e700 1 -- 172.21.15.5:0/2949221489 >> v2:172.21.15.191:3300/0 conn(0x7ffbe015cd30 msgr2=0x7ffbe006c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbded9d700 1 --2- 172.21.15.5:0/2949221489 >> v2:172.21.15.191:3300/0 conn(0x7ffbe015cd30 0x7ffbe006c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbdf59e700 1 --2- 172.21.15.5:0/2949221489 >> v2:172.21.15.191:3300/0 conn(0x7ffbe015cd30 0x7ffbe006c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbdf59e700 1 -- 172.21.15.5:0/2949221489 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe01611a0 con 0x7ffbe006d8b0 2023-03-03T06:24:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.208+0000 7ffbded9d700 1 --2- 172.21.15.5:0/2949221489 >> v2:172.21.15.191:3300/0 conn(0x7ffbe015cd30 0x7ffbe006c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:00.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.209+0000 7ffbdf59e700 1 --2- 172.21.15.5:0/2949221489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbe006d8b0 0x7ffbe00cdda0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffbe006ee70 tx=0x7ffbd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6669a7ebaba6e00 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:00.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.209+0000 7ffbddd9b700 1 -- 172.21.15.5:0/2949221489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd800e070 con 0x7ffbe006d8b0 2023-03-03T06:24:00.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.209+0000 7ffbddd9b700 1 -- 172.21.15.5:0/2949221489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd800b9c0 con 0x7ffbe006d8b0 2023-03-03T06:24:00.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.209+0000 7ffbddd9b700 1 -- 172.21.15.5:0/2949221489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd800bd70 con 0x7ffbe006d8b0 2023-03-03T06:24:00.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.209+0000 7ffbe5103700 1 -- 172.21.15.5:0/2949221489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbe006d8b0 msgr2=0x7ffbe00cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.209+0000 7ffbe5103700 1 --2- 172.21.15.5:0/2949221489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbe006d8b0 0x7ffbe00cdda0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffbe006ee70 tx=0x7ffbd800b330 comp rx=0 tx=0).stop 2023-03-03T06:24:00.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.209+0000 7ffbe5103700 1 -- 172.21.15.5:0/2949221489 shutdown_connections 2023-03-03T06:24:00.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.209+0000 7ffbe5103700 1 --2- 172.21.15.5:0/2949221489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbe006d8b0 0x7ffbe00cdda0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.209+0000 7ffbe5103700 1 --2- 172.21.15.5:0/2949221489 >> v2:172.21.15.191:3300/0 conn(0x7ffbe015cd30 0x7ffbe006c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.209+0000 7ffbe5103700 1 --2- 172.21.15.5:0/2949221489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffbe0160670 0x7ffbe00cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.209+0000 7ffbe5103700 1 -- 172.21.15.5:0/2949221489 >> 172.21.15.5:0/2949221489 conn(0x7ffbe0070050 msgr2=0x7ffbe0070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:00.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.209+0000 7ffbe5103700 1 -- 172.21.15.5:0/2949221489 shutdown_connections 2023-03-03T06:24:00.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.209+0000 7ffbe5103700 1 -- 172.21.15.5:0/2949221489 wait complete. 2023-03-03T06:24:00.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.211+0000 7ffbe5103700 1 Processor -- start 2023-03-03T06:24:00.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.211+0000 7ffbe5103700 1 -- start start 2023-03-03T06:24:00.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbe5103700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbe006d8b0 0x7ffbe01557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbe5103700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffbe015cd30 0x7ffbe0156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbe5103700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbe0160670 0x7ffbe015f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbe5103700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe0156db0 con 0x7ffbe0160670 2023-03-03T06:24:00.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbe5103700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe0157090 con 0x7ffbe006d8b0 2023-03-03T06:24:00.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbe5103700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe0157370 con 0x7ffbe015cd30 2023-03-03T06:24:00.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbdf59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbe0160670 0x7ffbe015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbdf59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbe0160670 0x7ffbe015f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41522/0 (socket says 172.21.15.5:41522) 2023-03-03T06:24:00.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbdf59e700 1 -- 172.21.15.5:0/2380919628 learned_addr learned my addr 172.21.15.5:0/2380919628 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:00.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbde59c700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffbe015cd30 0x7ffbe0156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbded9d700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbe006d8b0 0x7ffbe01557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbdf59e700 1 -- 172.21.15.5:0/2380919628 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffbe015cd30 msgr2=0x7ffbe0156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbdf59e700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffbe015cd30 0x7ffbe0156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbdf59e700 1 -- 172.21.15.5:0/2380919628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbe006d8b0 msgr2=0x7ffbe01557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbdf59e700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbe006d8b0 0x7ffbe01557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbdf59e700 1 -- 172.21.15.5:0/2380919628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd8009b30 con 0x7ffbe0160670 2023-03-03T06:24:00.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.212+0000 7ffbdf59e700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbe0160670 0x7ffbe015f570 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800b370 tx=0x7ffbd8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:00.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.213+0000 7ffbc77fe700 1 -- 172.21.15.5:0/2380919628 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80099b0 con 0x7ffbe0160670 2023-03-03T06:24:00.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.213+0000 7ffbc77fe700 1 -- 172.21.15.5:0/2380919628 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd80092e0 con 0x7ffbe0160670 2023-03-03T06:24:00.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.213+0000 7ffbe5103700 1 -- 172.21.15.5:0/2380919628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe0071730 con 0x7ffbe0160670 2023-03-03T06:24:00.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.213+0000 7ffbc77fe700 1 -- 172.21.15.5:0/2380919628 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd801c640 con 0x7ffbe0160670 2023-03-03T06:24:00.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.213+0000 7ffbe5103700 1 -- 172.21.15.5:0/2380919628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe0161480 con 0x7ffbe0160670 2023-03-03T06:24:00.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.214+0000 7ffbe5103700 1 -- 172.21.15.5:0/2380919628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe00718c0 con 0x7ffbe0160670 2023-03-03T06:24:00.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.214+0000 7ffbc77fe700 1 -- 172.21.15.5:0/2380919628 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ffbd802c070 con 0x7ffbe0160670 2023-03-03T06:24:00.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.214+0000 7ffbc77fe700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffbcc0682f0 0x7ffbcc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.215+0000 7ffbc77fe700 1 -- 172.21.15.5:0/2380919628 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffbd8087bc0 con 0x7ffbe0160670 2023-03-03T06:24:00.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.215+0000 7ffbded9d700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffbcc0682f0 0x7ffbcc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.215+0000 7ffbded9d700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffbcc0682f0 0x7ffbcc06a7a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4006fd0 tx=0x7ffbd4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:00.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.219+0000 7ffbc77fe700 1 -- 172.21.15.5:0/2380919628 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ffbd8054190 con 0x7ffbe0160670 2023-03-03T06:24:00.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.469+0000 7ffbe5103700 1 -- 172.21.15.5:0/2380919628 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ffbe004e6e0 con 0x7ffbe0160670 2023-03-03T06:24:00.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.472+0000 7ffbc77fe700 1 -- 172.21.15.5:0/2380919628 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+166369 (secure 0 0 0) 0x7ffbd80577b0 con 0x7ffbe0160670 2023-03-03T06:24:00.476 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:00.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.474+0000 7ffbe5103700 1 -- 172.21.15.5:0/2380919628 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffbcc0682f0 msgr2=0x7ffbcc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.475+0000 7ffbe5103700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffbcc0682f0 0x7ffbcc06a7a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4006fd0 tx=0x7ffbd4008040 comp rx=0 tx=0).stop 2023-03-03T06:24:00.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.475+0000 7ffbe5103700 1 -- 172.21.15.5:0/2380919628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbe0160670 msgr2=0x7ffbe015f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.475+0000 7ffbe5103700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbe0160670 0x7ffbe015f570 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800b370 tx=0x7ffbd8004ad0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.475+0000 7ffbe5103700 1 -- 172.21.15.5:0/2380919628 shutdown_connections 2023-03-03T06:24:00.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.475+0000 7ffbe5103700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbe0160670 0x7ffbe015f570 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.475+0000 7ffbe5103700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffbe006d8b0 0x7ffbe01557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.475+0000 7ffbe5103700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffbcc0682f0 0x7ffbcc06a7a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.475+0000 7ffbe5103700 1 --2- 172.21.15.5:0/2380919628 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffbe015cd30 0x7ffbe0156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.475+0000 7ffbe5103700 1 -- 172.21.15.5:0/2380919628 >> 172.21.15.5:0/2380919628 conn(0x7ffbe0070050 msgr2=0x7ffbe00b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.475+0000 7ffbe5103700 1 -- 172.21.15.5:0/2380919628 shutdown_connections 2023-03-03T06:24:00.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.475+0000 7ffbe5103700 1 -- 172.21.15.5:0/2380919628 wait complete. 2023-03-03T06:24:00.489 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"active_gid":4099,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":96507},{"type":"v1","addr":"172.21.15.5:6833","nonce":96507}]},"active_addr":"172.21.15.5:6833/96507","active_change":"2023-03-03T06:23:27.452703+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3541705007}]},{"addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2783658881}]},{"addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":4170080220}]},{"addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":1042631120}]}]} 2023-03-03T06:24:00.494 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-03-03T06:24:00.495 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-03-03T06:24:00.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.618+0000 7f4a779c2700 1 Processor -- start 2023-03-03T06:24:00.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.618+0000 7f4a779c2700 1 -- start start 2023-03-03T06:24:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a779c2700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4a700b1f80 0x7f4a700cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a779c2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a70159bd0 con 0x7f4a700cf7a0 2023-03-03T06:24:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a779c2700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7015d650 con 0x7f4a700cf3d0 2023-03-03T06:24:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a779c2700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7015e1d0 con 0x7f4a700b1f80 2023-03-03T06:24:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a74f5d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4a700cf7a0 0x7f4a700b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59602/0 (socket says 172.21.15.5:59602) 2023-03-03T06:24:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a74f5d700 1 -- 172.21.15.5:0/772173613 learned_addr learned my addr 172.21.15.5:0/772173613 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a75f5f700 1 --2- 172.21.15.5:0/772173613 >> v2:172.21.15.191:3300/0 conn(0x7f4a700b1f80 0x7f4a700cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579496282 0 0) 0x7f4a60001110 con 0x7f4a700cf7a0 2023-03-03T06:24:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a5c0035b0 con 0x7f4a700cf7a0 2023-03-03T06:24:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2352192025 0 0) 0x7f4a5c0035b0 con 0x7f4a700cf7a0 2023-03-03T06:24:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 >> v2:172.21.15.191:3300/0 conn(0x7f4a700b1f80 msgr2=0x7f4a700cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 --2- 172.21.15.5:0/772173613 >> v2:172.21.15.191:3300/0 conn(0x7f4a700b1f80 0x7f4a700cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 >> v1:172.21.15.191:6789/0 conn(0x7f4a700cf3d0 legacy=0x7f4a700cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7015d930 con 0x7f4a700cf7a0 2023-03-03T06:24:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f4a60001800 con 0x7f4a700cf7a0 2023-03-03T06:24:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 >> v1:172.21.15.5:6789/0 conn(0x7f4a700cf7a0 legacy=0x7f4a700b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 --2- 172.21.15.5:0/772173613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c003a70 0x7f4a5c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 --2- 172.21.15.5:0/772173613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a5c004850 0x7f4a5c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 --2- 172.21.15.5:0/772173613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a5c005250 0x7f4a5c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7015e1d0 con 0x7f4a5c003a70 2023-03-03T06:24:00.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c00c190 con 0x7f4a5c004850 2023-03-03T06:24:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c00c350 con 0x7f4a5c005250 2023-03-03T06:24:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a7575e700 1 --2- 172.21.15.5:0/772173613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c003a70 0x7f4a5c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a75f5f700 1 --2- 172.21.15.5:0/772173613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a5c005250 0x7f4a5c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.619+0000 7f4a74f5d700 1 --2- 172.21.15.5:0/772173613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a5c004850 0x7f4a5c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.620+0000 7f4a7575e700 1 -- 172.21.15.5:0/772173613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a5c005250 msgr2=0x7f4a5c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.620+0000 7f4a7575e700 1 --2- 172.21.15.5:0/772173613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a5c005250 0x7f4a5c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.620+0000 7f4a7575e700 1 -- 172.21.15.5:0/772173613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a5c004850 msgr2=0x7f4a5c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.620+0000 7f4a7575e700 1 --2- 172.21.15.5:0/772173613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a5c004850 0x7f4a5c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.620+0000 7f4a7575e700 1 -- 172.21.15.5:0/772173613 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c0035b0 con 0x7f4a5c003a70 2023-03-03T06:24:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.620+0000 7f4a74f5d700 1 --2- 172.21.15.5:0/772173613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a5c004850 0x7f4a5c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.620+0000 7f4a75f5f700 1 -- 172.21.15.5:0/772173613 reap_dead start 2023-03-03T06:24:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.620+0000 7f4a7575e700 1 --2- 172.21.15.5:0/772173613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c003a70 0x7f4a5c003e80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c007fd0 tx=0x7f4a5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea0ff977d573905 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.620+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0052d0 con 0x7f4a5c003a70 2023-03-03T06:24:00.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.620+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c005430 con 0x7f4a5c003a70 2023-03-03T06:24:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.620+0000 7f4a67fff700 1 -- 172.21.15.5:0/772173613 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0038c0 con 0x7f4a5c003a70 2023-03-03T06:24:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.620+0000 7f4a779c2700 1 -- 172.21.15.5:0/772173613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c003a70 msgr2=0x7f4a5c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.620+0000 7f4a779c2700 1 --2- 172.21.15.5:0/772173613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c003a70 0x7f4a5c003e80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c007fd0 tx=0x7f4a5c005880 comp rx=0 tx=0).stop 2023-03-03T06:24:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.621+0000 7f4a779c2700 1 -- 172.21.15.5:0/772173613 shutdown_connections 2023-03-03T06:24:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.621+0000 7f4a779c2700 1 --2- 172.21.15.5:0/772173613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c003a70 0x7f4a5c003e80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.621+0000 7f4a779c2700 1 -- 172.21.15.5:0/772173613 >> 172.21.15.5:0/772173613 conn(0x7f4a7006ea70 msgr2=0x7f4a700cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:00.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.621+0000 7f4a779c2700 1 -- 172.21.15.5:0/772173613 shutdown_connections 2023-03-03T06:24:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.621+0000 7f4a779c2700 1 -- 172.21.15.5:0/772173613 wait complete. 2023-03-03T06:24:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.622+0000 7f4a779c2700 1 Processor -- start 2023-03-03T06:24:00.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.622+0000 7f4a779c2700 1 -- start start 2023-03-03T06:24:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a779c2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a5c003a70 0x7f4a7014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a779c2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a7014e790 0x7f4a70150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a779c2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a70156fb0 0x7f4a70157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a779c2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a70157990 con 0x7f4a70156fb0 2023-03-03T06:24:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a779c2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a70150e80 con 0x7f4a7014e790 2023-03-03T06:24:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a779c2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7015b130 con 0x7f4a5c003a70 2023-03-03T06:24:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a75f5f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a70156fb0 0x7f4a70157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a75f5f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a70156fb0 0x7f4a70157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41542/0 (socket says 172.21.15.5:41542) 2023-03-03T06:24:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a75f5f700 1 -- 172.21.15.5:0/1902160660 learned_addr learned my addr 172.21.15.5:0/1902160660 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:00.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a7575e700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a5c003a70 0x7f4a7014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a74f5d700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a7014e790 0x7f4a70150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a75f5f700 1 -- 172.21.15.5:0/1902160660 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a5c003a70 msgr2=0x7f4a7014cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a75f5f700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a5c003a70 0x7f4a7014cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a75f5f700 1 -- 172.21.15.5:0/1902160660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a7014e790 msgr2=0x7f4a70150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a75f5f700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a7014e790 0x7f4a70150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a75f5f700 1 -- 172.21.15.5:0/1902160660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7015def0 con 0x7f4a70156fb0 2023-03-03T06:24:00.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a7575e700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a5c003a70 0x7f4a7014cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a74f5d700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a7014e790 0x7f4a70150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a75f5f700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a70156fb0 0x7f4a70157450 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009f20 tx=0x7f4a680116a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a65ffb700 1 -- 172.21.15.5:0/1902160660 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68003a20 con 0x7f4a70156fb0 2023-03-03T06:24:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a65ffb700 1 -- 172.21.15.5:0/1902160660 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a68003ba0 con 0x7f4a70156fb0 2023-03-03T06:24:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a779c2700 1 -- 172.21.15.5:0/1902160660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7015dc10 con 0x7f4a70156fb0 2023-03-03T06:24:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.623+0000 7f4a65ffb700 1 -- 172.21.15.5:0/1902160660 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68004030 con 0x7f4a70156fb0 2023-03-03T06:24:00.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.624+0000 7f4a779c2700 1 -- 172.21.15.5:0/1902160660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7015d270 con 0x7f4a70156fb0 2023-03-03T06:24:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.624+0000 7f4a779c2700 1 -- 172.21.15.5:0/1902160660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7004e6e0 con 0x7f4a70156fb0 2023-03-03T06:24:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.625+0000 7f4a65ffb700 1 -- 172.21.15.5:0/1902160660 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4a68022030 con 0x7f4a70156fb0 2023-03-03T06:24:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.626+0000 7f4a65ffb700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a540682f0 0x7f4a5406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.626+0000 7f4a65ffb700 1 -- 172.21.15.5:0/1902160660 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4a68088920 con 0x7f4a70156fb0 2023-03-03T06:24:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.626+0000 7f4a7575e700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a540682f0 0x7f4a5406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.626+0000 7f4a7575e700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a540682f0 0x7f4a5406a7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c000c00 tx=0x7f4a6c009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:00.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.630+0000 7f4a65ffb700 1 -- 172.21.15.5:0/1902160660 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4a68054f30 con 0x7f4a70156fb0 2023-03-03T06:24:00.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.823+0000 7f4a779c2700 1 -- 172.21.15.5:0/1902160660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a700cd130 con 0x7f4a70156fb0 2023-03-03T06:24:00.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.824+0000 7f4a65ffb700 1 -- 172.21.15.5:0/1902160660 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7f4a68058550 con 0x7f4a70156fb0 2023-03-03T06:24:00.826 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:00.827 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:00.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.826+0000 7f4a779c2700 1 -- 172.21.15.5:0/1902160660 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a540682f0 msgr2=0x7f4a5406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.826+0000 7f4a779c2700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a540682f0 0x7f4a5406a7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c000c00 tx=0x7f4a6c009030 comp rx=0 tx=0).stop 2023-03-03T06:24:00.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.826+0000 7f4a779c2700 1 -- 172.21.15.5:0/1902160660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a70156fb0 msgr2=0x7f4a70157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.826+0000 7f4a779c2700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a70156fb0 0x7f4a70157450 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009f20 tx=0x7f4a680116a0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.826+0000 7f4a779c2700 1 -- 172.21.15.5:0/1902160660 shutdown_connections 2023-03-03T06:24:00.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.826+0000 7f4a779c2700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a70156fb0 0x7f4a70157450 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.826+0000 7f4a779c2700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a540682f0 0x7f4a5406a7a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.826+0000 7f4a779c2700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a5c003a70 0x7f4a7014cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.826+0000 7f4a779c2700 1 --2- 172.21.15.5:0/1902160660 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a7014e790 0x7f4a70150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.826+0000 7f4a779c2700 1 -- 172.21.15.5:0/1902160660 >> 172.21.15.5:0/1902160660 conn(0x7f4a7006ea70 msgr2=0x7f4a700b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:00.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.826+0000 7f4a779c2700 1 -- 172.21.15.5:0/1902160660 shutdown_connections 2023-03-03T06:24:00.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.826+0000 7f4a779c2700 1 -- 172.21.15.5:0/1902160660 wait complete. 2023-03-03T06:24:00.841 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-03-03T06:24:00.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.964+0000 7fde5418f700 1 Processor -- start 2023-03-03T06:24:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.964+0000 7fde5418f700 1 -- start start 2023-03-03T06:24:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde5418f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde4c15cd40 0x7fde4c0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde5418f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde4c0cef60 0x7fde4c0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde5418f700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4c15d4e0 con 0x7fde4c0cba50 2023-03-03T06:24:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde5418f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4c15d7c0 con 0x7fde4c0cef60 2023-03-03T06:24:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde5418f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c15daa0 con 0x7fde4c15cd40 2023-03-03T06:24:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde5272c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde4c0cef60 0x7fde4c0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde5272c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde4c0cef60 0x7fde4c0b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41550/0 (socket says 172.21.15.5:41550) 2023-03-03T06:24:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde5272c700 1 -- 172.21.15.5:0/812512683 learned_addr learned my addr 172.21.15.5:0/812512683 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde51f2b700 1 --2- 172.21.15.5:0/812512683 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde4c15cd40 0x7fde4c0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde5272c700 1 -- 172.21.15.5:0/812512683 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde4c15cd40 msgr2=0x7fde4c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde5272c700 1 --2- 172.21.15.5:0/812512683 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde4c15cd40 0x7fde4c0b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde5272c700 1 -- 172.21.15.5:0/812512683 >> v1:172.21.15.191:6789/0 conn(0x7fde4c0cba50 legacy=0x7fde4c160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde5272c700 1 -- 172.21.15.5:0/812512683 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c15dd80 con 0x7fde4c0cef60 2023-03-03T06:24:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde51f2b700 1 --2- 172.21.15.5:0/812512683 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde4c15cd40 0x7fde4c0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.965+0000 7fde5272c700 1 --2- 172.21.15.5:0/812512683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cef60 0x7fde4c0b1e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fde44009e50 tx=0x7fde4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd80a60c1c2c3b48 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.966+0000 7fde50f29700 1 -- 172.21.15.5:0/812512683 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4400e070 con 0x7fde4c0cef60 2023-03-03T06:24:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.966+0000 7fde50f29700 1 -- 172.21.15.5:0/812512683 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4400b9c0 con 0x7fde4c0cef60 2023-03-03T06:24:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.966+0000 7fde50f29700 1 -- 172.21.15.5:0/812512683 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4400bd70 con 0x7fde4c0cef60 2023-03-03T06:24:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.966+0000 7fde5418f700 1 -- 172.21.15.5:0/812512683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cef60 msgr2=0x7fde4c0b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.966+0000 7fde5418f700 1 --2- 172.21.15.5:0/812512683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cef60 0x7fde4c0b1e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fde44009e50 tx=0x7fde4400b330 comp rx=0 tx=0).stop 2023-03-03T06:24:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.966+0000 7fde5418f700 1 -- 172.21.15.5:0/812512683 shutdown_connections 2023-03-03T06:24:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.966+0000 7fde5418f700 1 --2- 172.21.15.5:0/812512683 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cef60 0x7fde4c0b1e10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.966+0000 7fde5418f700 1 --2- 172.21.15.5:0/812512683 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde4c15cd40 0x7fde4c0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.966+0000 7fde5418f700 1 -- 172.21.15.5:0/812512683 >> 172.21.15.5:0/812512683 conn(0x7fde4c0cc8d0 msgr2=0x7fde4c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.966+0000 7fde5418f700 1 -- 172.21.15.5:0/812512683 shutdown_connections 2023-03-03T06:24:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.966+0000 7fde5418f700 1 -- 172.21.15.5:0/812512683 wait complete. 2023-03-03T06:24:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.967+0000 7fde5418f700 1 Processor -- start 2023-03-03T06:24:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.967+0000 7fde5418f700 1 -- start start 2023-03-03T06:24:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.968+0000 7fde5418f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde4c0cba50 0x7fde4c0c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.968+0000 7fde5418f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cef60 0x7fde4c152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.968+0000 7fde5418f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde4c15cd40 0x7fde4c0c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.968+0000 7fde5418f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0c4090 con 0x7fde4c0cef60 2023-03-03T06:24:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.968+0000 7fde5418f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0c4370 con 0x7fde4c15cd40 2023-03-03T06:24:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.968+0000 7fde5418f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0c4650 con 0x7fde4c0cba50 2023-03-03T06:24:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.968+0000 7fde5172a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cef60 0x7fde4c152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.968+0000 7fde5172a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cef60 0x7fde4c152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41554/0 (socket says 172.21.15.5:41554) 2023-03-03T06:24:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.968+0000 7fde5172a700 1 -- 172.21.15.5:0/2393489184 learned_addr learned my addr 172.21.15.5:0/2393489184 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.968+0000 7fde51f2b700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde4c0cba50 0x7fde4c0c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.968+0000 7fde5272c700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde4c15cd40 0x7fde4c0c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.969+0000 7fde5172a700 1 -- 172.21.15.5:0/2393489184 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde4c0cba50 msgr2=0x7fde4c0c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.969+0000 7fde5172a700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde4c0cba50 0x7fde4c0c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.969+0000 7fde5172a700 1 -- 172.21.15.5:0/2393489184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde4c15cd40 msgr2=0x7fde4c0c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.969+0000 7fde5172a700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde4c15cd40 0x7fde4c0c3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.969+0000 7fde5172a700 1 -- 172.21.15.5:0/2393489184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde44009b30 con 0x7fde4c0cef60 2023-03-03T06:24:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.969+0000 7fde5172a700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cef60 0x7fde4c152630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c500 tx=0x7fde3c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.969+0000 7fde427fc700 1 -- 172.21.15.5:0/2393489184 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0052d0 con 0x7fde4c0cef60 2023-03-03T06:24:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.969+0000 7fde427fc700 1 -- 172.21.15.5:0/2393489184 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c005430 con 0x7fde4c0cef60 2023-03-03T06:24:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.969+0000 7fde5418f700 1 -- 172.21.15.5:0/2393489184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4c0ca530 con 0x7fde4c0cef60 2023-03-03T06:24:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.969+0000 7fde427fc700 1 -- 172.21.15.5:0/2393489184 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0038f0 con 0x7fde4c0cef60 2023-03-03T06:24:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.969+0000 7fde5418f700 1 -- 172.21.15.5:0/2393489184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4c15e060 con 0x7fde4c0cef60 2023-03-03T06:24:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.970+0000 7fde5418f700 1 -- 172.21.15.5:0/2393489184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4c15d110 con 0x7fde4c0cef60 2023-03-03T06:24:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.970+0000 7fde427fc700 1 -- 172.21.15.5:0/2393489184 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fde3c019030 con 0x7fde4c0cef60 2023-03-03T06:24:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.971+0000 7fde427fc700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fde300682f0 0x7fde3006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.971+0000 7fde427fc700 1 -- 172.21.15.5:0/2393489184 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde3c085270 con 0x7fde4c0cef60 2023-03-03T06:24:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.971+0000 7fde51f2b700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fde300682f0 0x7fde3006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:00.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.971+0000 7fde51f2b700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fde300682f0 0x7fde3006a7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fde480099d0 tx=0x7fde48008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:00.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:00.975+0000 7fde427fc700 1 -- 172.21.15.5:0/2393489184 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fde3c0516f0 con 0x7fde4c0cef60 2023-03-03T06:24:01.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.172+0000 7fde5418f700 1 -- 172.21.15.5:0/2393489184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde4c04e6e0 con 0x7fde4c0cef60 2023-03-03T06:24:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.173+0000 7fde427fc700 1 -- 172.21.15.5:0/2393489184 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7fde3c054d10 con 0x7fde4c0cef60 2023-03-03T06:24:01.175 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:01.176 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.175+0000 7fde5418f700 1 -- 172.21.15.5:0/2393489184 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fde300682f0 msgr2=0x7fde3006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.175+0000 7fde5418f700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fde300682f0 0x7fde3006a7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fde480099d0 tx=0x7fde48008040 comp rx=0 tx=0).stop 2023-03-03T06:24:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.175+0000 7fde5418f700 1 -- 172.21.15.5:0/2393489184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cef60 msgr2=0x7fde4c152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.175+0000 7fde5418f700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cef60 0x7fde4c152630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c500 tx=0x7fde3c00c810 comp rx=0 tx=0).stop 2023-03-03T06:24:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.175+0000 7fde5418f700 1 -- 172.21.15.5:0/2393489184 shutdown_connections 2023-03-03T06:24:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.175+0000 7fde5418f700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde4c15cd40 0x7fde4c0c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.175+0000 7fde5418f700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fde300682f0 0x7fde3006a7a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.175+0000 7fde5418f700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde4c0cba50 0x7fde4c0c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.175+0000 7fde5418f700 1 --2- 172.21.15.5:0/2393489184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde4c0cef60 0x7fde4c152630 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.175+0000 7fde5418f700 1 -- 172.21.15.5:0/2393489184 >> 172.21.15.5:0/2393489184 conn(0x7fde4c0cc8d0 msgr2=0x7fde4c15c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.175+0000 7fde5418f700 1 -- 172.21.15.5:0/2393489184 shutdown_connections 2023-03-03T06:24:01.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.175+0000 7fde5418f700 1 -- 172.21.15.5:0/2393489184 wait complete. 2023-03-03T06:24:01.190 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-03-03T06:24:01.190 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-03-03T06:24:01.191 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-03-03T06:24:01.191 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-03-03T06:24:01.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-03-03T06:24:01.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-03-03T06:24:01.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-03-03T06:24:01.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-03-03T06:24:01.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.410+0000 7f1fed883700 1 Processor -- start 2023-03-03T06:24:01.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.411+0000 7f1fed883700 1 -- start start 2023-03-03T06:24:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.413+0000 7f5ba6e84700 1 Processor -- start 2023-03-03T06:24:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.413+0000 7f5ba6e84700 1 -- start start 2023-03-03T06:24:01.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.414+0000 7f5ba6e84700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ba00ce380 0x7f5ba0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.414+0000 7f5ba6e84700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ba00cdeb0 0x7f5ba00c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.414+0000 7f5ba6e84700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba006e6b0 con 0x7f5ba0071d10 2023-03-03T06:24:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.414+0000 7f5ba6e84700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba006eb40 con 0x7f5ba00ce380 2023-03-03T06:24:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.414+0000 7f5ba6e84700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba0159e40 con 0x7f5ba00cdeb0 2023-03-03T06:24:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f5b9ffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5ba0071d10 0x7f5ba00cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59644/0 (socket says 172.21.15.5:59644) 2023-03-03T06:24:01.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f5b9ffff700 1 -- 172.21.15.5:0/376884465 learned_addr learned my addr 172.21.15.5:0/376884465 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f5ba5421700 1 --2- 172.21.15.5:0/376884465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ba00cdeb0 0x7f5ba00c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f5ba5421700 1 -- 172.21.15.5:0/376884465 >> v2:172.21.15.5:3300/0 conn(0x7f5ba00ce380 msgr2=0x7f5ba0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f5ba5421700 1 --2- 172.21.15.5:0/376884465 >> v2:172.21.15.5:3300/0 conn(0x7f5ba00ce380 0x7f5ba0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f5ba5421700 1 -- 172.21.15.5:0/376884465 >> v1:172.21.15.5:6789/0 conn(0x7f5ba0071d10 legacy=0x7f5ba00cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f5ba5421700 1 -- 172.21.15.5:0/376884465 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba006bc30 con 0x7f5ba00cdeb0 2023-03-03T06:24:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f5ba5421700 1 --2- 172.21.15.5:0/376884465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ba00cdeb0 0x7f5ba00c9290 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009840 tx=0x7f5b94009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9abcf52dec17d390 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f5b9f7fe700 1 -- 172.21.15.5:0/376884465 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94004230 con 0x7f5ba00cdeb0 2023-03-03T06:24:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f5b9f7fe700 1 -- 172.21.15.5:0/376884465 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b94004390 con 0x7f5ba00cdeb0 2023-03-03T06:24:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f5b9f7fe700 1 -- 172.21.15.5:0/376884465 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940036a0 con 0x7f5ba00cdeb0 2023-03-03T06:24:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7f5ba6e84700 1 -- 172.21.15.5:0/376884465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ba00cdeb0 msgr2=0x7f5ba00c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7f5ba6e84700 1 --2- 172.21.15.5:0/376884465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ba00cdeb0 0x7f5ba00c9290 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009840 tx=0x7f5b94009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7f5ba6e84700 1 -- 172.21.15.5:0/376884465 shutdown_connections 2023-03-03T06:24:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7f5ba6e84700 1 --2- 172.21.15.5:0/376884465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ba00cdeb0 0x7f5ba00c9290 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7f5ba6e84700 1 --2- 172.21.15.5:0/376884465 >> v2:172.21.15.5:3300/0 conn(0x7f5ba00ce380 0x7f5ba0159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7f5ba6e84700 1 -- 172.21.15.5:0/376884465 >> 172.21.15.5:0/376884465 conn(0x7f5ba00cf890 msgr2=0x7f5ba00cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7f5ba6e84700 1 -- 172.21.15.5:0/376884465 shutdown_connections 2023-03-03T06:24:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7f5ba6e84700 1 -- 172.21.15.5:0/376884465 wait complete. 2023-03-03T06:24:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.413+0000 7f04bf4ce700 1 Processor -- start 2023-03-03T06:24:01.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.413+0000 7f04bf4ce700 1 -- start start 2023-03-03T06:24:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f04bf4ce700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04b815cb40 0x7f04b806d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f04bf4ce700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b806f490 con 0x7f04b806b450 2023-03-03T06:24:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f04bf4ce700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b80ae5c0 con 0x7f04b80c9af0 2023-03-03T06:24:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f04bf4ce700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b806b950 con 0x7f04b815cb40 2023-03-03T06:24:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f04bca69700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f04b80c9af0 0x7f04b806ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:45948/0 (socket says 172.21.15.5:45948) 2023-03-03T06:24:01.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f04bca69700 1 -- 172.21.15.5:0/222995611 learned_addr learned my addr 172.21.15.5:0/222995611 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f04bd26a700 1 --2- 172.21.15.5:0/222995611 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04b815cb40 0x7f04b806d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f04affff700 1 -- 172.21.15.5:0/222995611 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633369024 0 0) 0x7f04b4001040 con 0x7f04b806b450 2023-03-03T06:24:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f04affff700 1 -- 172.21.15.5:0/222995611 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04a40035b0 con 0x7f04b806b450 2023-03-03T06:24:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f04affff700 1 -- 172.21.15.5:0/222995611 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137059308 0 0) 0x7f04b80ae5c0 con 0x7f04b80c9af0 2023-03-03T06:24:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f04affff700 1 -- 172.21.15.5:0/222995611 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04b4001040 con 0x7f04b80c9af0 2023-03-03T06:24:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f04bd26a700 1 -- 172.21.15.5:0/222995611 >> v1:172.21.15.191:6789/0 conn(0x7f04b80c9af0 legacy=0x7f04b806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f04bd26a700 1 -- 172.21.15.5:0/222995611 >> v1:172.21.15.5:6789/0 conn(0x7f04b806b450 legacy=0x7f04b80cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f04bd26a700 1 -- 172.21.15.5:0/222995611 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b806bc30 con 0x7f04b815cb40 2023-03-03T06:24:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f04bd26a700 1 --2- 172.21.15.5:0/222995611 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04b815cb40 0x7f04b806d370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009870 tx=0x7f04a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70066730a8a960ac server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7f04affff700 1 -- 172.21.15.5:0/222995611 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8011830 con 0x7f04b815cb40 2023-03-03T06:24:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7f04affff700 1 -- 172.21.15.5:0/222995611 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a8011990 con 0x7f04b815cb40 2023-03-03T06:24:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7f04affff700 1 -- 172.21.15.5:0/222995611 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8011d00 con 0x7f04b815cb40 2023-03-03T06:24:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f04bf4ce700 1 -- 172.21.15.5:0/222995611 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04b815cb40 msgr2=0x7f04b806d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f04bf4ce700 1 --2- 172.21.15.5:0/222995611 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04b815cb40 0x7f04b806d370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009870 tx=0x7f04a8009b80 comp rx=0 tx=0).stop 2023-03-03T06:24:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f04bf4ce700 1 -- 172.21.15.5:0/222995611 shutdown_connections 2023-03-03T06:24:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f04bf4ce700 1 --2- 172.21.15.5:0/222995611 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04b815cb40 0x7f04b806d370 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f04bf4ce700 1 -- 172.21.15.5:0/222995611 >> 172.21.15.5:0/222995611 conn(0x7f04b80cf890 msgr2=0x7f04b80cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.413+0000 7f0e668a0700 1 Processor -- start 2023-03-03T06:24:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.413+0000 7f0e668a0700 1 -- start start 2023-03-03T06:24:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.414+0000 7f0e668a0700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0e60070d00 0x7f0e60071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.414+0000 7f0e668a0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e6006d620 0x7f0e6006da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.414+0000 7f0e668a0700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e60159e20 con 0x7f0e601562e0 2023-03-03T06:24:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.414+0000 7f0e668a0700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e600716b0 con 0x7f0e60070d00 2023-03-03T06:24:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.414+0000 7f0e668a0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600cd930 con 0x7f0e6006d620 2023-03-03T06:24:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f0e64e3d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e6006d620 0x7f0e6006da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f0e5f7fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0e60070d00 0x7f0e60071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f0e64e3d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e6006d620 0x7f0e6006da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39652/0 (socket says 172.21.15.5:39652) 2023-03-03T06:24:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f0e64e3d700 1 -- 172.21.15.5:0/2876797350 learned_addr learned my addr 172.21.15.5:0/2876797350 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f0e64e3d700 1 -- 172.21.15.5:0/2876797350 >> v2:172.21.15.191:3300/0 conn(0x7f0e60070d00 msgr2=0x7f0e60071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f0e64e3d700 1 --2- 172.21.15.5:0/2876797350 >> v2:172.21.15.191:3300/0 conn(0x7f0e60070d00 0x7f0e60071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f0e64e3d700 1 -- 172.21.15.5:0/2876797350 >> v1:172.21.15.191:6789/0 conn(0x7f0e601562e0 legacy=0x7f0e600cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f0e64e3d700 1 -- 172.21.15.5:0/2876797350 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6015c7b0 con 0x7f0e6006d620 2023-03-03T06:24:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f0e64e3d700 1 --2- 172.21.15.5:0/2876797350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e6006d620 0x7f0e6006da80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000bb90 tx=0x7f0e5000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=791736c361bda377 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f0e5effd700 1 -- 172.21.15.5:0/2876797350 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000dd30 con 0x7f0e6006d620 2023-03-03T06:24:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f0e5effd700 1 -- 172.21.15.5:0/2876797350 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5000de90 con 0x7f0e6006d620 2023-03-03T06:24:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f0e5effd700 1 -- 172.21.15.5:0/2876797350 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50010690 con 0x7f0e6006d620 2023-03-03T06:24:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7f0e668a0700 1 -- 172.21.15.5:0/2876797350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e6006d620 msgr2=0x7f0e6006da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7f0e668a0700 1 --2- 172.21.15.5:0/2876797350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e6006d620 0x7f0e6006da80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000bb90 tx=0x7f0e5000bea0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f0e668a0700 1 -- 172.21.15.5:0/2876797350 shutdown_connections 2023-03-03T06:24:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f0e668a0700 1 --2- 172.21.15.5:0/2876797350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e6006d620 0x7f0e6006da80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f0e668a0700 1 --2- 172.21.15.5:0/2876797350 >> v2:172.21.15.191:3300/0 conn(0x7f0e60070d00 0x7f0e60071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f0e668a0700 1 -- 172.21.15.5:0/2876797350 >> 172.21.15.5:0/2876797350 conn(0x7f0e600cec40 msgr2=0x7f0e600cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f0e668a0700 1 -- 172.21.15.5:0/2876797350 shutdown_connections 2023-03-03T06:24:01.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f0e668a0700 1 -- 172.21.15.5:0/2876797350 wait complete. 2023-03-03T06:24:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.412+0000 7f1fed883700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fe80ce380 0x7f1fe8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.412+0000 7f1fed883700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1fe80cdeb0 0x7f1fe80c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.412+0000 7f1fed883700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe806e6b0 con 0x7f1fe8071d10 2023-03-03T06:24:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.412+0000 7f1fed883700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe8159e40 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.412+0000 7f1fed883700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe806daa0 con 0x7f1fe80ce380 2023-03-03T06:24:01.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.412+0000 7f1fe77fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1fe80cdeb0 0x7f1fe80c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.412+0000 7f1fe77fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1fe80cdeb0 0x7f1fe80c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41562/0 (socket says 172.21.15.5:41562) 2023-03-03T06:24:01.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.412+0000 7f1fe77fe700 1 -- 172.21.15.5:0/4092518140 learned_addr learned my addr 172.21.15.5:0/4092518140 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.413+0000 7f1fe77fe700 1 -- 172.21.15.5:0/4092518140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fe80ce380 msgr2=0x7f1fe8159900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-03T06:24:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.413+0000 7f1fe77fe700 1 --2- 172.21.15.5:0/4092518140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fe80ce380 0x7f1fe8159900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.413+0000 7f1fe77fe700 1 -- 172.21.15.5:0/4092518140 >> v1:172.21.15.191:6789/0 conn(0x7f1fe8071d10 legacy=0x7f1fe80cd7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-03T06:24:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.413+0000 7f1fe77fe700 1 -- 172.21.15.5:0/4092518140 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe806dd80 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.413+0000 7f1fe77fe700 1 --2- 172.21.15.5:0/4092518140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fe80cdeb0 0x7f1fe80c9290 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009e50 tx=0x7f1fd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf9fe8a4385345b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f1fe5ffb700 1 -- 172.21.15.5:0/4092518140 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd80092d0 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f1fe5ffb700 1 -- 172.21.15.5:0/4092518140 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd801f070 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.415+0000 7f1fe5ffb700 1 -- 172.21.15.5:0/4092518140 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8003c60 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7efeab155700 1 Processor -- start 2023-03-03T06:24:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7efeab155700 1 -- start start 2023-03-03T06:24:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7efeab155700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7efea4160b60 0x7efea40c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7efeab155700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efea40c2330 0x7efea40cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7efeab155700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea406bca0 con 0x7efea4160f30 2023-03-03T06:24:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7efeab155700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea406b120 con 0x7efea40c2330 2023-03-03T06:24:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7efeab155700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea406b400 con 0x7efea4160b60 2023-03-03T06:24:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7efea8ef1700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7efea4160b60 0x7efea40c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7efea96f2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efea40c2330 0x7efea40cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7efea8ef1700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7efea4160b60 0x7efea40c9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:41944/0 (socket says 172.21.15.5:41944) 2023-03-03T06:24:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.417+0000 7efea8ef1700 1 -- 172.21.15.5:0/3027385538 learned_addr learned my addr 172.21.15.5:0/3027385538 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7efea8ef1700 1 -- 172.21.15.5:0/3027385538 >> v2:172.21.15.5:3300/0 conn(0x7efea40c2330 msgr2=0x7efea40cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7efea8ef1700 1 --2- 172.21.15.5:0/3027385538 >> v2:172.21.15.5:3300/0 conn(0x7efea40c2330 0x7efea40cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7efea8ef1700 1 -- 172.21.15.5:0/3027385538 >> v1:172.21.15.191:6789/0 conn(0x7efea4160f30 legacy=0x7efea40c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7efea8ef1700 1 -- 172.21.15.5:0/3027385538 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea406b6e0 con 0x7efea4160b60 2023-03-03T06:24:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f1fed883700 1 -- 172.21.15.5:0/4092518140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fe80cdeb0 msgr2=0x7f1fe80c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f1fed883700 1 --2- 172.21.15.5:0/4092518140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fe80cdeb0 0x7f1fe80c9290 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009e50 tx=0x7f1fd800b330 comp rx=0 tx=0).stop 2023-03-03T06:24:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f1fed883700 1 -- 172.21.15.5:0/4092518140 shutdown_connections 2023-03-03T06:24:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f1fed883700 1 --2- 172.21.15.5:0/4092518140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fe80cdeb0 0x7f1fe80c9290 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f1fed883700 1 --2- 172.21.15.5:0/4092518140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fe80ce380 0x7f1fe8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.416+0000 7f1fed883700 1 -- 172.21.15.5:0/4092518140 >> 172.21.15.5:0/4092518140 conn(0x7f1fe80cf890 msgr2=0x7f1fe80cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f04bf4ce700 1 -- 172.21.15.5:0/222995611 shutdown_connections 2023-03-03T06:24:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f1fed883700 1 -- 172.21.15.5:0/4092518140 shutdown_connections 2023-03-03T06:24:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.418+0000 7f1fed883700 1 -- 172.21.15.5:0/4092518140 wait complete. 2023-03-03T06:24:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.419+0000 7f5ba6e84700 1 Processor -- start 2023-03-03T06:24:01.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7f0e668a0700 1 Processor -- start 2023-03-03T06:24:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.419+0000 7f5ba6e84700 1 -- start start 2023-03-03T06:24:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f5ba6e84700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ba0071d10 0x7f5ba00c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f5ba6e84700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ba00cdeb0 0x7f5ba0148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f5ba6e84700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba00ce380 0x7f5ba014ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f5ba6e84700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba014e5d0 con 0x7f5ba00ce380 2023-03-03T06:24:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f5ba6e84700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00c2770 con 0x7f5ba0071d10 2023-03-03T06:24:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f5ba6e84700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00c7150 con 0x7f5ba00cdeb0 2023-03-03T06:24:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.419+0000 7f04bf4ce700 1 -- 172.21.15.5:0/222995611 wait complete. 2023-03-03T06:24:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7f04bf4ce700 1 Processor -- start 2023-03-03T06:24:01.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7f0e668a0700 1 -- start start 2023-03-03T06:24:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f0e668a0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e6006d620 0x7f0e601fb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f0e668a0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e60070d00 0x7f0e600b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f0e668a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e601562e0 0x7f0e600afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f0e668a0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600b35d0 con 0x7f0e601562e0 2023-03-03T06:24:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f0e668a0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600b2050 con 0x7f0e60070d00 2023-03-03T06:24:01.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f0e668a0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600b22f0 con 0x7f0e6006d620 2023-03-03T06:24:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7f1fed883700 1 Processor -- start 2023-03-03T06:24:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f0e5ffff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e6006d620 0x7f0e601fb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f0e5ffff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e6006d620 0x7f0e601fb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39672/0 (socket says 172.21.15.5:39672) 2023-03-03T06:24:01.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.421+0000 7f0e5ffff700 1 -- 172.21.15.5:0/3626272665 learned_addr learned my addr 172.21.15.5:0/3626272665 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.419+0000 7efea8ef1700 1 --2- 172.21.15.5:0/3027385538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efea4160b60 0x7efea40c9de0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efea40b4dd0 tx=0x7efe98009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0166a4dbee41ae5 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.419+0000 7efea37fe700 1 -- 172.21.15.5:0/3027385538 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98011830 con 0x7efea4160b60 2023-03-03T06:24:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.419+0000 7efea37fe700 1 -- 172.21.15.5:0/3027385538 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe98011990 con 0x7efea4160b60 2023-03-03T06:24:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.419+0000 7efea37fe700 1 -- 172.21.15.5:0/3027385538 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98011d20 con 0x7efea4160b60 2023-03-03T06:24:01.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7efeab155700 1 -- 172.21.15.5:0/3027385538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efea4160b60 msgr2=0x7efea40c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7efeab155700 1 --2- 172.21.15.5:0/3027385538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efea4160b60 0x7efea40c9de0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efea40b4dd0 tx=0x7efe98009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7efeab155700 1 -- 172.21.15.5:0/3027385538 shutdown_connections 2023-03-03T06:24:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7efeab155700 1 --2- 172.21.15.5:0/3027385538 >> v2:172.21.15.5:3300/0 conn(0x7efea40c2330 0x7efea40cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7efeab155700 1 --2- 172.21.15.5:0/3027385538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efea4160b60 0x7efea40c9de0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7efeab155700 1 -- 172.21.15.5:0/3027385538 >> 172.21.15.5:0/3027385538 conn(0x7efea40cf890 msgr2=0x7efea40cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7efeab155700 1 -- 172.21.15.5:0/3027385538 shutdown_connections 2023-03-03T06:24:01.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7efeab155700 1 -- 172.21.15.5:0/3027385538 wait complete. 2023-03-03T06:24:01.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7f1fed883700 1 -- start start 2023-03-03T06:24:01.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f1fed883700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fe80cdeb0 0x7f1fe814b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f1fed883700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1fe81ee860 0x7f1fe80b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f1fed883700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fe80c6400 0x7f1fe80c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f1fed883700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80c3fb0 con 0x7f1fe80c6400 2023-03-03T06:24:01.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f1fed883700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe81553e0 con 0x7f1fe81ee860 2023-03-03T06:24:01.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f1fed883700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80c6db0 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.420+0000 7f04bf4ce700 1 -- start start 2023-03-03T06:24:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f04bf4ce700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04b806b450 0x7f04b80c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f04bf4ce700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04b80c9af0 0x7f04b8159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f04bf4ce700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04b815cb40 0x7f04b81596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f04bf4ce700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b80c2570 con 0x7f04b80c9af0 2023-03-03T06:24:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f04bf4ce700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b81585c0 con 0x7f04b815cb40 2023-03-03T06:24:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f04bf4ce700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b80b24c0 con 0x7f04b806b450 2023-03-03T06:24:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f04bda6b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04b815cb40 0x7f04b81596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f04bda6b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04b815cb40 0x7f04b81596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:41972/0 (socket says 172.21.15.5:41972) 2023-03-03T06:24:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f04bda6b700 1 -- 172.21.15.5:0/1911185773 learned_addr learned my addr 172.21.15.5:0/1911185773 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f0e64e3d700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e601562e0 0x7f0e600afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f5ba5421700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba00ce380 0x7f5ba014ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f5ba5421700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba00ce380 0x7f5ba014ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41590/0 (socket says 172.21.15.5:41590) 2023-03-03T06:24:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f1fe6ffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fe80cdeb0 0x7f1fe814b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f5ba5421700 1 -- 172.21.15.5:0/1681204955 learned_addr learned my addr 172.21.15.5:0/1681204955 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f1fe6ffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fe80cdeb0 0x7f1fe814b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39686/0 (socket says 172.21.15.5:39686) 2023-03-03T06:24:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f1fe6ffd700 1 -- 172.21.15.5:0/3166423517 learned_addr learned my addr 172.21.15.5:0/3166423517 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f5ba4c20700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ba0071d10 0x7f5ba00c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f5b9ffff700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ba00cdeb0 0x7f5ba0148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f5ba5421700 1 -- 172.21.15.5:0/1681204955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ba00cdeb0 msgr2=0x7f5ba0148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f5ba5421700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ba00cdeb0 0x7f5ba0148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f5ba5421700 1 -- 172.21.15.5:0/1681204955 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ba0071d10 msgr2=0x7f5ba00c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f5ba5421700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ba0071d10 0x7f5ba00c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f5ba5421700 1 -- 172.21.15.5:0/1681204955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b940094a0 con 0x7f5ba00ce380 2023-03-03T06:24:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f0e5f7fe700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e60070d00 0x7f0e600b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f0e64e3d700 1 -- 172.21.15.5:0/3626272665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e6006d620 msgr2=0x7f0e601fb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f0e64e3d700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e6006d620 0x7f0e601fb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f0e64e3d700 1 -- 172.21.15.5:0/3626272665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e60070d00 msgr2=0x7f0e600b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f0e64e3d700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e60070d00 0x7f0e600b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f0e64e3d700 1 -- 172.21.15.5:0/3626272665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5000b7f0 con 0x7f0e601562e0 2023-03-03T06:24:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f0e64e3d700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e601562e0 0x7f0e600afa80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0e50018000 tx=0x7f0e50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f1fe77fe700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fe80c6400 0x7f1fe80c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7f1fe67fc700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1fe81ee860 0x7f1fe80b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f1fe6ffd700 1 -- 172.21.15.5:0/3166423517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1fe81ee860 msgr2=0x7f1fe80b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f1fe6ffd700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1fe81ee860 0x7f1fe80b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f1fe6ffd700 1 -- 172.21.15.5:0/3166423517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fe80c6400 msgr2=0x7f1fe80c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f1fe6ffd700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fe80c6400 0x7f1fe80c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f1fe6ffd700 1 -- 172.21.15.5:0/3166423517 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd8009b30 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f04bda6b700 1 -- 172.21.15.5:0/1911185773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04b806b450 msgr2=0x7f04b80c2030 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-03T06:24:01.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f04bda6b700 1 --2- 172.21.15.5:0/1911185773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04b806b450 0x7f04b80c2030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f04bda6b700 1 -- 172.21.15.5:0/1911185773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04b80c9af0 msgr2=0x7f04b8159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f04bda6b700 1 --2- 172.21.15.5:0/1911185773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04b80c9af0 0x7f04b8159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f04bda6b700 1 -- 172.21.15.5:0/1911185773 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a80094a0 con 0x7f04b815cb40 2023-03-03T06:24:01.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f5ba5421700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba00ce380 0x7f5ba014ea90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5b94004000 tx=0x7f5b94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f5b9d7fa700 1 -- 172.21.15.5:0/1681204955 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94011630 con 0x7f5ba00ce380 2023-03-03T06:24:01.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f5b9d7fa700 1 -- 172.21.15.5:0/1681204955 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9401f070 con 0x7f5ba00ce380 2023-03-03T06:24:01.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f5b9d7fa700 1 -- 172.21.15.5:0/1681204955 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940119f0 con 0x7f5ba00ce380 2023-03-03T06:24:01.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.425+0000 7f5ba6e84700 1 -- 172.21.15.5:0/1681204955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba006dd80 con 0x7f5ba00ce380 2023-03-03T06:24:01.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.425+0000 7f5ba6e84700 1 -- 172.21.15.5:0/1681204955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba006daa0 con 0x7f5ba00ce380 2023-03-03T06:24:01.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f04bda6b700 1 --2- 172.21.15.5:0/1911185773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04b815cb40 0x7f04b81596a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c730 tx=0x7f04b400caf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f04adffb700 1 -- 172.21.15.5:0/1911185773 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40052d0 con 0x7f04b815cb40 2023-03-03T06:24:01.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f04adffb700 1 -- 172.21.15.5:0/1911185773 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b4005430 con 0x7f04b815cb40 2023-03-03T06:24:01.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f04adffb700 1 -- 172.21.15.5:0/1911185773 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40038c0 con 0x7f04b815cb40 2023-03-03T06:24:01.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.425+0000 7f04bf4ce700 1 -- 172.21.15.5:0/1911185773 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b80cd1c0 con 0x7f04b815cb40 2023-03-03T06:24:01.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.425+0000 7f04bf4ce700 1 -- 172.21.15.5:0/1911185773 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b80ccee0 con 0x7f04b815cb40 2023-03-03T06:24:01.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f0e5cff9700 1 -- 172.21.15.5:0/3626272665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50003ab0 con 0x7f0e601562e0 2023-03-03T06:24:01.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f0e5cff9700 1 -- 172.21.15.5:0/3626272665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5001e040 con 0x7f0e601562e0 2023-03-03T06:24:01.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f0e5cff9700 1 -- 172.21.15.5:0/3626272665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50003e90 con 0x7f0e601562e0 2023-03-03T06:24:01.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f0e668a0700 1 -- 172.21.15.5:0/3626272665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6015cd70 con 0x7f0e601562e0 2023-03-03T06:24:01.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f0e668a0700 1 -- 172.21.15.5:0/3626272665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6015ca90 con 0x7f0e601562e0 2023-03-03T06:24:01.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7f1fe6ffd700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fe80cdeb0 0x7f1fe814b1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000b530 tx=0x7f1fe000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f1fcffff700 1 -- 172.21.15.5:0/3166423517 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0011830 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f1fcffff700 1 -- 172.21.15.5:0/3166423517 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe00119b0 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7f1fcffff700 1 -- 172.21.15.5:0/3166423517 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0011d60 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.422+0000 7efeab155700 1 Processor -- start 2023-03-03T06:24:01.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.423+0000 7efeab155700 1 -- start start 2023-03-03T06:24:01.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7efeab155700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efea40c2330 0x7efea40c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7efeab155700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea4160b60 0x7efea415fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7efeab155700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efea4160f30 0x7efea415d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7efeab155700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea40c6a50 con 0x7efea4160b60 2023-03-03T06:24:01.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7efeab155700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea40c5e40 con 0x7efea40c2330 2023-03-03T06:24:01.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7efeab155700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea40c6120 con 0x7efea4160f30 2023-03-03T06:24:01.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.424+0000 7efea8ef1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efea40c2330 0x7efea40c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.425+0000 7efea8ef1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efea40c2330 0x7efea40c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:41974/0 (socket says 172.21.15.5:41974) 2023-03-03T06:24:01.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.425+0000 7efea8ef1700 1 -- 172.21.15.5:0/2283874488 learned_addr learned my addr 172.21.15.5:0/2283874488 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.425+0000 7efea3fff700 1 --2- 172.21.15.5:0/2283874488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea4160b60 0x7efea415fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.426+0000 7f04bf4ce700 1 -- 172.21.15.5:0/1911185773 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f04b80cd4a0 con 0x7f04b815cb40 2023-03-03T06:24:01.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.426+0000 7f1fed883700 1 -- 172.21.15.5:0/3166423517 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe806e340 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.426+0000 7f1fed883700 1 -- 172.21.15.5:0/3166423517 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe806e060 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.425+0000 7f8c42af9700 1 Processor -- start 2023-03-03T06:24:01.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.426+0000 7f8c42af9700 1 -- start start 2023-03-03T06:24:01.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.426+0000 7fcd3ba64700 1 Processor -- start 2023-03-03T06:24:01.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7efea3fff700 1 -- 172.21.15.5:0/2283874488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efea4160f30 msgr2=0x7efea415d8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-03T06:24:01.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7efea3fff700 1 --2- 172.21.15.5:0/2283874488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efea4160f30 0x7efea415d8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7efea3fff700 1 -- 172.21.15.5:0/2283874488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efea40c2330 msgr2=0x7efea40c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7efea3fff700 1 --2- 172.21.15.5:0/2283874488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efea40c2330 0x7efea40c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7efea3fff700 1 -- 172.21.15.5:0/2283874488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe98009550 con 0x7efea4160b60 2023-03-03T06:24:01.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7f0e668a0700 1 -- 172.21.15.5:0/3626272665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e40000fb0 con 0x7f0e601562e0 2023-03-03T06:24:01.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7efea3fff700 1 --2- 172.21.15.5:0/2283874488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea4160b60 0x7efea415fba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efe9000c410 tx=0x7efe9000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7efea17fa700 1 -- 172.21.15.5:0/2283874488 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900052d0 con 0x7efea4160b60 2023-03-03T06:24:01.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7efea17fa700 1 -- 172.21.15.5:0/2283874488 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe90005430 con 0x7efea4160b60 2023-03-03T06:24:01.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7efea17fa700 1 -- 172.21.15.5:0/2283874488 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90006a80 con 0x7efea4160b60 2023-03-03T06:24:01.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7efeab155700 1 -- 172.21.15.5:0/2283874488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea406ad40 con 0x7efea4160b60 2023-03-03T06:24:01.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7f5b9d7fa700 1 -- 172.21.15.5:0/1681204955 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5b94017020 con 0x7f5ba00ce380 2023-03-03T06:24:01.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7f5b9d7fa700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5b8c068340 0x7f5b8c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7f5b9d7fa700 1 -- 172.21.15.5:0/1681204955 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5b94021070 con 0x7f5ba00ce380 2023-03-03T06:24:01.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7f0e5cff9700 1 -- 172.21.15.5:0/3626272665 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0e500223f0 con 0x7f0e601562e0 2023-03-03T06:24:01.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7f5ba4c20700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5b8c068340 0x7f5b8c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7efeab155700 1 -- 172.21.15.5:0/2283874488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea406b9c0 con 0x7efea4160b60 2023-03-03T06:24:01.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f0e5cff9700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0e4c0683c0 0x7f0e4c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f0e5cff9700 1 -- 172.21.15.5:0/3626272665 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0e500870c0 con 0x7f0e601562e0 2023-03-03T06:24:01.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f0e5ffff700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0e4c0683c0 0x7f0e4c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f0e5cff9700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.191:6800/97067,v1:172.21.15.191:6801/97067] conn(0x7f0e4c071f20 0x7f0e4c074350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f0e5cff9700 1 -- 172.21.15.5:0/3626272665 --> [v2:172.21.15.191:6800/97067,v1:172.21.15.191:6801/97067] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e4c074a20 con 0x7f0e4c071f20 2023-03-03T06:24:01.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f0e5cff9700 1 -- 172.21.15.5:0/3626272665 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e50087470 con 0x7f0e601562e0 2023-03-03T06:24:01.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f1fcffff700 1 -- 172.21.15.5:0/3166423517 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1fe0021070 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f1fcffff700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1fd0068570 0x7f1fd006aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f1fcffff700 1 -- 172.21.15.5:0/3166423517 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1fe0085d50 con 0x7f1fe80cdeb0 2023-03-03T06:24:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f5ba4c20700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5b8c068340 0x7f5b8c06a7f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800a400 tx=0x7f5b9800d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f0e5f7fe700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.191:6800/97067,v1:172.21.15.191:6801/97067] conn(0x7f0e4c071f20 0x7f0e4c074350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f04adffb700 1 -- 172.21.15.5:0/1911185773 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f04b4019030 con 0x7f04b815cb40 2023-03-03T06:24:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f04adffb700 1 --2- 172.21.15.5:0/1911185773 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f049c0683c0 0x7f049c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f04adffb700 1 -- 172.21.15.5:0/1911185773 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f04b4085620 con 0x7f04b815cb40 2023-03-03T06:24:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f04adffb700 1 --2- 172.21.15.5:0/1911185773 >> [v2:172.21.15.191:6808/97069,v1:172.21.15.191:6810/97069] conn(0x7f049c072090 0x7f049c0744c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f04adffb700 1 -- 172.21.15.5:0/1911185773 --> [v2:172.21.15.191:6808/97069,v1:172.21.15.191:6810/97069] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f049c074b90 con 0x7f049c072090 2023-03-03T06:24:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f04adffb700 1 -- 172.21.15.5:0/1911185773 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04b40859d0 con 0x7f04b815cb40 2023-03-03T06:24:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f04bd26a700 1 --2- 172.21.15.5:0/1911185773 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f049c0683c0 0x7f049c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7f8c42af9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c3c160b60 0x7f8c3c0c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7f8c42af9700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8c3c0c2330 0x7f8c3c0cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7f8c42af9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c06bca0 con 0x7f8c3c160f30 2023-03-03T06:24:01.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7f8c42af9700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c06b120 con 0x7f8c3c0c2330 2023-03-03T06:24:01.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.427+0000 7f8c42af9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c06b400 con 0x7f8c3c160b60 2023-03-03T06:24:01.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7f8c40895700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c3c160b60 0x7f8c3c0c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f8c3bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8c3c160f30 0x7f8c3c0c1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59696/0 (socket says 172.21.15.5:59696) 2023-03-03T06:24:01.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.429+0000 7f8c3bfff700 1 -- 172.21.15.5:0/3173668451 learned_addr learned my addr 172.21.15.5:0/3173668451 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:01.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f8c3b7fe700 1 -- 172.21.15.5:0/3173668451 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877374358 0 0) 0x7f8c3c06bca0 con 0x7f8c3c160f30 2023-03-03T06:24:01.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.426+0000 7fcd3ba64700 1 -- start start 2023-03-03T06:24:01.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7fcd3ba64700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcd340cd7a0 0x7fcd34159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7fcd3ba64700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcd340c9290 0x7fcd340c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7fcd3ba64700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3406e6b0 con 0x7fcd340ce380 2023-03-03T06:24:01.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7fcd3ba64700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3406eb40 con 0x7fcd340cd7a0 2023-03-03T06:24:01.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.428+0000 7fcd3ba64700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd34159e40 con 0x7fcd340c9290 2023-03-03T06:24:01.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f8c3b7fe700 1 -- 172.21.15.5:0/3173668451 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c240035b0 con 0x7f8c3c160f30 2023-03-03T06:24:01.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f1fe67fc700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1fd0068570 0x7f1fd006aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7fcd38fff700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fcd340ce380 0x7fcd340cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:46004/0 (socket says 172.21.15.5:46004) 2023-03-03T06:24:01.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7fcd38fff700 1 -- 172.21.15.5:0/536560929 learned_addr learned my addr 172.21.15.5:0/536560929 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:01.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7fcd39800700 1 --2- 172.21.15.5:0/536560929 >> v2:172.21.15.5:3300/0 conn(0x7fcd340cd7a0 0x7fcd34159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f0e5ffff700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0e4c0683c0 0x7f0e4c06a870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e540018d0 tx=0x7f0e54009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f0e5f7fe700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.191:6800/97067,v1:172.21.15.191:6801/97067] conn(0x7f0e4c071f20 0x7f0e4c074350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7f5ba6e84700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.5:6808/96772,v1:172.21.15.5:6809/96772] conn(0x7f5b800015d0 0x7f5b80003a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7f5ba6e84700 1 -- 172.21.15.5:0/1681204955 --> [v2:172.21.15.5:6808/96772,v1:172.21.15.5:6809/96772] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b80006bb0 con 0x7f5b800015d0 2023-03-03T06:24:01.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7f1fe67fc700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1fd0068570 0x7f1fd006aa20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8155910 tx=0x7f1fdc009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f8c41096700 1 --2- 172.21.15.5:0/3173668451 >> v2:172.21.15.191:3300/0 conn(0x7f8c3c0c2330 0x7f8c3c0cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f8c40895700 1 -- 172.21.15.5:0/3173668451 >> v2:172.21.15.191:3300/0 conn(0x7f8c3c0c2330 msgr2=0x7f8c3c0cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f8c40895700 1 --2- 172.21.15.5:0/3173668451 >> v2:172.21.15.191:3300/0 conn(0x7f8c3c0c2330 0x7f8c3c0cd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f8c40895700 1 -- 172.21.15.5:0/3173668451 >> v1:172.21.15.5:6789/0 conn(0x7f8c3c160f30 legacy=0x7f8c3c0c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.430+0000 7f8c40895700 1 -- 172.21.15.5:0/3173668451 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c06b6e0 con 0x7f8c3c160b60 2023-03-03T06:24:01.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7f8c40895700 1 --2- 172.21.15.5:0/3173668451 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c3c160b60 0x7f8c3c0c9de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009840 tx=0x7f8c2c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fa9b7335fcfa7b3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7fcd39800700 1 -- 172.21.15.5:0/536560929 >> v2:172.21.15.191:3300/0 conn(0x7fcd340c9290 msgr2=0x7fcd340c96f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-03T06:24:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7fcd39800700 1 --2- 172.21.15.5:0/536560929 >> v2:172.21.15.191:3300/0 conn(0x7fcd340c9290 0x7fcd340c96f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7fcd39800700 1 -- 172.21.15.5:0/536560929 >> v1:172.21.15.191:6789/0 conn(0x7fcd340ce380 legacy=0x7fcd340cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7fcd39800700 1 -- 172.21.15.5:0/536560929 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3406bc30 con 0x7fcd340cd7a0 2023-03-03T06:24:01.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7f1fed883700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.191:6824/97078,v1:172.21.15.191:6825/97078] conn(0x7f1fe80c9170 0x7f1fe80c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7f1fed883700 1 -- 172.21.15.5:0/3166423517 --> [v2:172.21.15.191:6824/97078,v1:172.21.15.191:6825/97078] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fe80c3d60 con 0x7f1fe80c9170 2023-03-03T06:24:01.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7fcd39800700 1 --2- 172.21.15.5:0/536560929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd340cd7a0 0x7fcd34159900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcd3406f810 tx=0x7fcd3000abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc92cbd5e0c0e09a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7f5b9ffff700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.5:6808/96772,v1:172.21.15.5:6809/96772] conn(0x7f5b800015d0 0x7f5b80003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7f1fe77fe700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.191:6824/97078,v1:172.21.15.191:6825/97078] conn(0x7f1fe80c9170 0x7f1fe80c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7efeab155700 1 -- 172.21.15.5:0/2283874488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe84000fb0 con 0x7efea4160b60 2023-03-03T06:24:01.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7f8c3b7fe700 1 -- 172.21.15.5:0/3173668451 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c011830 con 0x7f8c3c160b60 2023-03-03T06:24:01.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7f8c3b7fe700 1 -- 172.21.15.5:0/3173668451 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c011990 con 0x7f8c3c160b60 2023-03-03T06:24:01.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7f8c3b7fe700 1 -- 172.21.15.5:0/3173668451 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c011d20 con 0x7f8c3c160b60 2023-03-03T06:24:01.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7fcd2bfff700 1 -- 172.21.15.5:0/536560929 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000b9a0 con 0x7fcd340cd7a0 2023-03-03T06:24:01.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7fcd2bfff700 1 -- 172.21.15.5:0/536560929 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3000bb00 con 0x7fcd340cd7a0 2023-03-03T06:24:01.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7fcd2bfff700 1 -- 172.21.15.5:0/536560929 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000be70 con 0x7fcd340cd7a0 2023-03-03T06:24:01.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7f0e5cff9700 1 -- 172.21.15.5:0/3626272665 <== osd.5 v2:172.21.15.191:6800/97067 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0e4c074a20 con 0x7f0e4c071f20 2023-03-03T06:24:01.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7f1fe77fe700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.191:6824/97078,v1:172.21.15.191:6825/97078] conn(0x7f1fe80c9170 0x7f1fe80c42d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.431+0000 7efea17fa700 1 -- 172.21.15.5:0/2283874488 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7efe90010050 con 0x7efea4160b60 2023-03-03T06:24:01.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7f5b9ffff700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.5:6808/96772,v1:172.21.15.5:6809/96772] conn(0x7f5b800015d0 0x7f5b80003a80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7efea17fa700 1 --2- 172.21.15.5:0/2283874488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe880682f0 0x7efe8806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7f04bca69700 1 --2- 172.21.15.5:0/1911185773 >> [v2:172.21.15.191:6808/97069,v1:172.21.15.191:6810/97069] conn(0x7f049c072090 0x7f049c0744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7f04bd26a700 1 --2- 172.21.15.5:0/1911185773 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f049c0683c0 0x7f049c06a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f04a80090b0 tx=0x7f04a8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7efea17fa700 1 -- 172.21.15.5:0/2283874488 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efe90084e70 con 0x7efea4160b60 2023-03-03T06:24:01.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7fcd3ba64700 1 -- 172.21.15.5:0/536560929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd340cd7a0 msgr2=0x7fcd34159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7fcd3ba64700 1 --2- 172.21.15.5:0/536560929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd340cd7a0 0x7fcd34159900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcd3406f810 tx=0x7fcd3000abc0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7efea8ef1700 1 --2- 172.21.15.5:0/2283874488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe880682f0 0x7efe8806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7efea17fa700 1 --2- 172.21.15.5:0/2283874488 >> [v2:172.21.15.191:6809/97068,v1:172.21.15.191:6811/97068] conn(0x7efe88071ec0 0x7efe880742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7efea17fa700 1 -- 172.21.15.5:0/2283874488 --> [v2:172.21.15.191:6809/97068,v1:172.21.15.191:6811/97068] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe880749c0 con 0x7efe88071ec0 2023-03-03T06:24:01.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7efea17fa700 1 -- 172.21.15.5:0/2283874488 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe9000ce70 con 0x7efea4160b60 2023-03-03T06:24:01.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7efea96f2700 1 --2- 172.21.15.5:0/2283874488 >> [v2:172.21.15.191:6809/97068,v1:172.21.15.191:6811/97068] conn(0x7efe88071ec0 0x7efe880742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7efea8ef1700 1 --2- 172.21.15.5:0/2283874488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe880682f0 0x7efe8806a7a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efe98009fd0 tx=0x7efe9801d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7f8c42af9700 1 -- 172.21.15.5:0/3173668451 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c3c160b60 msgr2=0x7f8c3c0c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7f8c42af9700 1 --2- 172.21.15.5:0/3173668451 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c3c160b60 0x7f8c3c0c9de0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009840 tx=0x7f8c2c009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:01.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7f8c42af9700 1 -- 172.21.15.5:0/3173668451 shutdown_connections 2023-03-03T06:24:01.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7f8c42af9700 1 --2- 172.21.15.5:0/3173668451 >> v2:172.21.15.191:3300/0 conn(0x7f8c3c0c2330 0x7f8c3c0cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7f8c42af9700 1 --2- 172.21.15.5:0/3173668451 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c3c160b60 0x7f8c3c0c9de0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.432+0000 7f8c42af9700 1 -- 172.21.15.5:0/3173668451 >> 172.21.15.5:0/3173668451 conn(0x7f8c3c0cf890 msgr2=0x7f8c3c0cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7f04bca69700 1 --2- 172.21.15.5:0/1911185773 >> [v2:172.21.15.191:6808/97069,v1:172.21.15.191:6810/97069] conn(0x7f049c072090 0x7f049c0744c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7f8c42af9700 1 -- 172.21.15.5:0/3173668451 shutdown_connections 2023-03-03T06:24:01.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7f8c42af9700 1 -- 172.21.15.5:0/3173668451 wait complete. 2023-03-03T06:24:01.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7fcd3ba64700 1 -- 172.21.15.5:0/536560929 shutdown_connections 2023-03-03T06:24:01.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7fcd3ba64700 1 --2- 172.21.15.5:0/536560929 >> v2:172.21.15.191:3300/0 conn(0x7fcd340c9290 0x7fcd340c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7fcd3ba64700 1 --2- 172.21.15.5:0/536560929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd340cd7a0 0x7fcd34159900 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7fcd3ba64700 1 -- 172.21.15.5:0/536560929 >> 172.21.15.5:0/536560929 conn(0x7fcd340cf890 msgr2=0x7fcd340cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7f1fcffff700 1 -- 172.21.15.5:0/3166423517 <== osd.6 v2:172.21.15.191:6824/97078 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1fe80c3d60 con 0x7f1fe80c9170 2023-03-03T06:24:01.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7fcd3ba64700 1 -- 172.21.15.5:0/536560929 shutdown_connections 2023-03-03T06:24:01.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7fcd3ba64700 1 -- 172.21.15.5:0/536560929 wait complete. 2023-03-03T06:24:01.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.435+0000 7fcd3ba64700 1 Processor -- start 2023-03-03T06:24:01.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.435+0000 7fcd3ba64700 1 -- start start 2023-03-03T06:24:01.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fcd3ba64700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd340c9290 0x7fcd340c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fcd3ba64700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd340cd7a0 0x7fcd341ff060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fcd3ba64700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd340ce380 0x7fcd340af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fcd3ba64700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340c2880 con 0x7fcd340ce380 2023-03-03T06:24:01.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fcd3ba64700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340c7af0 con 0x7fcd340c9290 2023-03-03T06:24:01.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fcd3ba64700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340c7dc0 con 0x7fcd340cd7a0 2023-03-03T06:24:01.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7f5b9d7fa700 1 -- 172.21.15.5:0/1681204955 <== osd.1 v2:172.21.15.5:6808/96772 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5b80006bb0 con 0x7f5b800015d0 2023-03-03T06:24:01.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.435+0000 7f8c42af9700 1 Processor -- start 2023-03-03T06:24:01.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.435+0000 7f8c42af9700 1 -- start start 2023-03-03T06:24:01.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7f8c42af9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c3c0c2330 0x7f8c3c151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7f8c42af9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c3c160b60 0x7f8c3c0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7f8c42af9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c3c160f30 0x7f8c3c0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7f8c42af9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0b2a20 con 0x7f8c3c160f30 2023-03-03T06:24:01.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7f8c42af9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0b2d00 con 0x7f8c3c0c2330 2023-03-03T06:24:01.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7f8c42af9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c0c7e80 con 0x7f8c3c160b60 2023-03-03T06:24:01.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.434+0000 7fd193c53700 1 Processor -- start 2023-03-03T06:24:01.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.434+0000 7fd193c53700 1 -- start start 2023-03-03T06:24:01.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.435+0000 7fd193c53700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd18c164100 0x7fd18c0cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.435+0000 7fd193c53700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd18c0ca770 0x7fd18c1651a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.435+0000 7fd193c53700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd18c070d00 0x7fd18c071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.435+0000 7fd193c53700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18c164d80 con 0x7fd18c070d00 2023-03-03T06:24:01.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.435+0000 7fd193c53700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18c0716c0 con 0x7fd18c0ca770 2023-03-03T06:24:01.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.435+0000 7fd193c53700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0cd590 con 0x7fd18c164100 2023-03-03T06:24:01.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.435+0000 7fd1919ef700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd18c164100 0x7fd18c0cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.435+0000 7fd1919ef700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd18c164100 0x7fd18c0cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39730/0 (socket says 172.21.15.5:39730) 2023-03-03T06:24:01.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.435+0000 7fd1919ef700 1 -- 172.21.15.5:0/800192959 learned_addr learned my addr 172.21.15.5:0/800192959 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fd1919ef700 1 -- 172.21.15.5:0/800192959 >> v2:172.21.15.191:3300/0 conn(0x7fd18c0ca770 msgr2=0x7fd18c1651a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-03T06:24:01.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fd1919ef700 1 --2- 172.21.15.5:0/800192959 >> v2:172.21.15.191:3300/0 conn(0x7fd18c0ca770 0x7fd18c1651a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fd1919ef700 1 -- 172.21.15.5:0/800192959 >> v2:172.21.15.5:3300/0 conn(0x7fd18c070d00 msgr2=0x7fd18c071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fd1919ef700 1 --2- 172.21.15.5:0/800192959 >> v2:172.21.15.5:3300/0 conn(0x7fd18c070d00 0x7fd18c071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fd1919ef700 1 -- 172.21.15.5:0/800192959 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0ccd50 con 0x7fd18c164100 2023-03-03T06:24:01.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fd1919ef700 1 --2- 172.21.15.5:0/800192959 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd18c164100 0x7fd18c0cc810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0cf970 tx=0x7fd188009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b48add233f66afe server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fd1909ed700 1 -- 172.21.15.5:0/800192959 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18800b870 con 0x7fd18c164100 2023-03-03T06:24:01.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fd1909ed700 1 -- 172.21.15.5:0/800192959 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18800b9d0 con 0x7fd18c164100 2023-03-03T06:24:01.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.436+0000 7fd1909ed700 1 -- 172.21.15.5:0/800192959 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18800bd60 con 0x7fd18c164100 2023-03-03T06:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.433+0000 7f04adffb700 1 -- 172.21.15.5:0/1911185773 <== osd.4 v2:172.21.15.191:6808/97069 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f049c074b90 con 0x7f049c072090 2023-03-03T06:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.437+0000 7fcd39800700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd340c9290 0x7fcd340c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.437+0000 7fcd39800700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd340c9290 0x7fcd340c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42020/0 (socket says 172.21.15.5:42020) 2023-03-03T06:24:01.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.437+0000 7fcd39800700 1 -- 172.21.15.5:0/3343828744 learned_addr learned my addr 172.21.15.5:0/3343828744 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.437+0000 7fd193c53700 1 -- 172.21.15.5:0/800192959 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd18c164100 msgr2=0x7fd18c0cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.437+0000 7fd193c53700 1 --2- 172.21.15.5:0/800192959 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd18c164100 0x7fd18c0cc810 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0cf970 tx=0x7fd188009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.437+0000 7fcd39800700 1 -- 172.21.15.5:0/3343828744 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd340cd7a0 msgr2=0x7fcd341ff060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.437+0000 7fcd39800700 1 --2- 172.21.15.5:0/3343828744 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcd340cd7a0 0x7fcd341ff060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.437+0000 7fcd39800700 1 -- 172.21.15.5:0/3343828744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd340ce380 msgr2=0x7fcd340af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.437+0000 7fcd39800700 1 --2- 172.21.15.5:0/3343828744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd340ce380 0x7fcd340af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.437+0000 7fcd39800700 1 -- 172.21.15.5:0/3343828744 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3000a550 con 0x7fcd340c9290 2023-03-03T06:24:01.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.438+0000 7fcd39800700 1 --2- 172.21.15.5:0/3343828744 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd340c9290 0x7fcd340c75b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcd3406cba0 tx=0x7fcd300047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.438+0000 7efea96f2700 1 --2- 172.21.15.5:0/2283874488 >> [v2:172.21.15.191:6809/97068,v1:172.21.15.191:6811/97068] conn(0x7efe88071ec0 0x7efe880742f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.438+0000 7efea17fa700 1 -- 172.21.15.5:0/2283874488 <== osd.7 v2:172.21.15.191:6809/97068 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efe880749c0 con 0x7efe88071ec0 2023-03-03T06:24:01.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.444+0000 7f8c41096700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c3c160f30 0x7f8c3c0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.444+0000 7f8c41096700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c3c160f30 0x7f8c3c0b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41656/0 (socket says 172.21.15.5:41656) 2023-03-03T06:24:01.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.444+0000 7f8c41096700 1 -- 172.21.15.5:0/2321728768 learned_addr learned my addr 172.21.15.5:0/2321728768 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.444+0000 7f8c40895700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c3c0c2330 0x7f8c3c151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.444+0000 7f8c41096700 1 -- 172.21.15.5:0/2321728768 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c3c160b60 msgr2=0x7f8c3c0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.444+0000 7f8c41096700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c3c160b60 0x7f8c3c0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.444+0000 7f8c41096700 1 -- 172.21.15.5:0/2321728768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c3c0c2330 msgr2=0x7f8c3c151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.444+0000 7f8c41096700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c3c0c2330 0x7f8c3c151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.444+0000 7f8c41096700 1 -- 172.21.15.5:0/2321728768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0094a0 con 0x7f8c3c160f30 2023-03-03T06:24:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.444+0000 7f8c40895700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c3c0c2330 0x7f8c3c151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:01.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.444+0000 7f8c41096700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c3c160f30 0x7f8c3c0b1b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400cd40 tx=0x7f8c3400a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.445+0000 7f8c397fa700 1 -- 172.21.15.5:0/2321728768 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34003a20 con 0x7f8c3c160f30 2023-03-03T06:24:01.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.445+0000 7f8c42af9700 1 -- 172.21.15.5:0/2321728768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c06ad40 con 0x7f8c3c160f30 2023-03-03T06:24:01.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.445+0000 7f8c42af9700 1 -- 172.21.15.5:0/2321728768 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c06b9c0 con 0x7f8c3c160f30 2023-03-03T06:24:01.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.445+0000 7f8c397fa700 1 -- 172.21.15.5:0/2321728768 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c34003b80 con 0x7f8c3c160f30 2023-03-03T06:24:01.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.446+0000 7f8c397fa700 1 -- 172.21.15.5:0/2321728768 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34004020 con 0x7f8c3c160f30 2023-03-03T06:24:01.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.447+0000 7f8c397fa700 1 -- 172.21.15.5:0/2321728768 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8c3401c020 con 0x7f8c3c160f30 2023-03-03T06:24:01.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.447+0000 7f8c397fa700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c28068340 0x7f8c2806a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.447+0000 7f8c397fa700 1 -- 172.21.15.5:0/2321728768 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c34012070 con 0x7f8c3c160f30 2023-03-03T06:24:01.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.451+0000 7fd193c53700 1 -- 172.21.15.5:0/800192959 shutdown_connections 2023-03-03T06:24:01.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.451+0000 7fd193c53700 1 --2- 172.21.15.5:0/800192959 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd18c164100 0x7fd18c0cc810 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.451+0000 7fd193c53700 1 --2- 172.21.15.5:0/800192959 >> v2:172.21.15.5:3300/0 conn(0x7fd18c070d00 0x7fd18c071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.451+0000 7fd193c53700 1 --2- 172.21.15.5:0/800192959 >> v2:172.21.15.191:3300/0 conn(0x7fd18c0ca770 0x7fd18c1651a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.451+0000 7fd193c53700 1 -- 172.21.15.5:0/800192959 >> 172.21.15.5:0/800192959 conn(0x7fd18c0cec40 msgr2=0x7fd18c0cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.451+0000 7fcd29ffb700 1 -- 172.21.15.5:0/3343828744 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30012770 con 0x7fcd340c9290 2023-03-03T06:24:01.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.451+0000 7fcd29ffb700 1 -- 172.21.15.5:0/3343828744 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd300128d0 con 0x7fcd340c9290 2023-03-03T06:24:01.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.451+0000 7fcd29ffb700 1 -- 172.21.15.5:0/3343828744 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30012c80 con 0x7fcd340c9290 2023-03-03T06:24:01.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.451+0000 7fd193c53700 1 -- 172.21.15.5:0/800192959 shutdown_connections 2023-03-03T06:24:01.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.451+0000 7fcd3ba64700 1 -- 172.21.15.5:0/3343828744 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3406dd80 con 0x7fcd340c9290 2023-03-03T06:24:01.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.452+0000 7fcd3ba64700 1 -- 172.21.15.5:0/3343828744 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3406daa0 con 0x7fcd340c9290 2023-03-03T06:24:01.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.452+0000 7fd193c53700 1 -- 172.21.15.5:0/800192959 wait complete. 2023-03-03T06:24:01.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.453+0000 7fcd1f7fe700 1 -- 172.21.15.5:0/3343828744 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd14000fb0 con 0x7fcd340c9290 2023-03-03T06:24:01.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.453+0000 7f8c40895700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c28068340 0x7f8c2806a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.453+0000 7f8c40895700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c28068340 0x7f8c2806a7f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0090b0 tx=0x7f8c2c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.454+0000 7fd193c53700 1 Processor -- start 2023-03-03T06:24:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.454+0000 7fd193c53700 1 -- start start 2023-03-03T06:24:01.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.454+0000 7fd193c53700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd18c070d00 0x7fd18c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.454+0000 7fd193c53700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd18c0ca770 0x7fd18c0c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.454+0000 7fd193c53700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd18c164100 0x7fd18c0c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.454+0000 7fd193c53700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c157420 con 0x7fd18c164100 2023-03-03T06:24:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.454+0000 7fd193c53700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c156af0 con 0x7fd18c070d00 2023-03-03T06:24:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.454+0000 7fd193c53700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c156dd0 con 0x7fd18c0ca770 2023-03-03T06:24:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.455+0000 7fd1919ef700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd18c070d00 0x7fd18c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.455+0000 7fd1919ef700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd18c070d00 0x7fd18c1578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42030/0 (socket says 172.21.15.5:42030) 2023-03-03T06:24:01.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.455+0000 7fd1919ef700 1 -- 172.21.15.5:0/2249142933 learned_addr learned my addr 172.21.15.5:0/2249142933 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.455+0000 7fcd29ffb700 1 -- 172.21.15.5:0/3343828744 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fcd30021070 con 0x7fcd340c9290 2023-03-03T06:24:01.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.455+0000 7fd1919ef700 1 -- 172.21.15.5:0/2249142933 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd18c0ca770 msgr2=0x7fd18c0c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.455+0000 7fd1919ef700 1 --2- 172.21.15.5:0/2249142933 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd18c0ca770 0x7fd18c0c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.455+0000 7fd1919ef700 1 -- 172.21.15.5:0/2249142933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd18c164100 msgr2=0x7fd18c0c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.455+0000 7fd1919ef700 1 --2- 172.21.15.5:0/2249142933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd18c164100 0x7fd18c0c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.455+0000 7fd1919ef700 1 -- 172.21.15.5:0/2249142933 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd188009550 con 0x7fd18c070d00 2023-03-03T06:24:01.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.455+0000 7fd1919ef700 1 --2- 172.21.15.5:0/2249142933 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd18c070d00 0x7fd18c1578b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd188000c00 tx=0x7fd188004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.456+0000 7fd1827fc700 1 -- 172.21.15.5:0/2249142933 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188004500 con 0x7fd18c070d00 2023-03-03T06:24:01.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.456+0000 7fd1827fc700 1 -- 172.21.15.5:0/2249142933 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1880036a0 con 0x7fd18c070d00 2023-03-03T06:24:01.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.456+0000 7fd1827fc700 1 -- 172.21.15.5:0/2249142933 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188003a50 con 0x7fd18c070d00 2023-03-03T06:24:01.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.456+0000 7fd193c53700 1 -- 172.21.15.5:0/2249142933 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18c0cd2b0 con 0x7fd18c070d00 2023-03-03T06:24:01.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.456+0000 7fd193c53700 1 -- 172.21.15.5:0/2249142933 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18c0ccfd0 con 0x7fd18c070d00 2023-03-03T06:24:01.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.455+0000 7fcd29ffb700 1 --2- 172.21.15.5:0/3343828744 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcd180683c0 0x7fcd1806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.456+0000 7fcd29ffb700 1 -- 172.21.15.5:0/3343828744 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcd300880f0 con 0x7fcd340c9290 2023-03-03T06:24:01.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.456+0000 7fcd29ffb700 1 --2- 172.21.15.5:0/3343828744 >> [v2:172.21.15.5:6816/96775,v1:172.21.15.5:6818/96775] conn(0x7fcd18072090 0x7fcd180744c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.456+0000 7fcd29ffb700 1 -- 172.21.15.5:0/3343828744 --> [v2:172.21.15.5:6816/96775,v1:172.21.15.5:6818/96775] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd18074b90 con 0x7fcd18072090 2023-03-03T06:24:01.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.456+0000 7fcd29ffb700 1 -- 172.21.15.5:0/3343828744 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd300884a0 con 0x7fcd340c9290 2023-03-03T06:24:01.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.456+0000 7fcd38fff700 1 --2- 172.21.15.5:0/3343828744 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcd180683c0 0x7fcd1806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.457+0000 7fcd38fff700 1 --2- 172.21.15.5:0/3343828744 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcd180683c0 0x7fcd1806a870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcd340c5a40 tx=0x7fcd2c0060b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.457+0000 7fd193c53700 1 -- 172.21.15.5:0/2249142933 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd170000fb0 con 0x7fd18c070d00 2023-03-03T06:24:01.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.457+0000 7fcd3a001700 1 --2- 172.21.15.5:0/3343828744 >> [v2:172.21.15.5:6816/96775,v1:172.21.15.5:6818/96775] conn(0x7fcd18072090 0x7fcd180744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.458+0000 7fcd3a001700 1 --2- 172.21.15.5:0/3343828744 >> [v2:172.21.15.5:6816/96775,v1:172.21.15.5:6818/96775] conn(0x7fcd18072090 0x7fcd180744c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.458+0000 7fd1827fc700 1 -- 172.21.15.5:0/2249142933 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd188023070 con 0x7fd18c070d00 2023-03-03T06:24:01.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.458+0000 7f8c42af9700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.5:6817/96787,v1:172.21.15.5:6819/96787] conn(0x7f8c1c0015d0 0x7f8c1c003a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.458+0000 7f8c42af9700 1 -- 172.21.15.5:0/2321728768 --> [v2:172.21.15.5:6817/96787,v1:172.21.15.5:6819/96787] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c1c006bb0 con 0x7f8c1c0015d0 2023-03-03T06:24:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.459+0000 7f8c3bfff700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.5:6817/96787,v1:172.21.15.5:6819/96787] conn(0x7f8c1c0015d0 0x7f8c1c003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.459+0000 7fd1827fc700 1 --2- 172.21.15.5:0/2249142933 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd178068490 0x7fd17806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.459+0000 7fd1827fc700 1 -- 172.21.15.5:0/2249142933 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd188087730 con 0x7fd18c070d00 2023-03-03T06:24:01.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.459+0000 7fd1827fc700 1 --2- 172.21.15.5:0/2249142933 >> [v2:172.21.15.5:6800/96773,v1:172.21.15.5:6801/96773] conn(0x7fd1780720e0 0x7fd178074510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.459+0000 7fd1827fc700 1 -- 172.21.15.5:0/2249142933 --> [v2:172.21.15.5:6800/96773,v1:172.21.15.5:6801/96773] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd178074be0 con 0x7fd1780720e0 2023-03-03T06:24:01.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.459+0000 7fd1827fc700 1 -- 172.21.15.5:0/2249142933 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd188053c60 con 0x7fd18c070d00 2023-03-03T06:24:01.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.459+0000 7f8c3bfff700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.5:6817/96787,v1:172.21.15.5:6819/96787] conn(0x7f8c1c0015d0 0x7f8c1c003a80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.459+0000 7fd1921f0700 1 --2- 172.21.15.5:0/2249142933 >> [v2:172.21.15.5:6800/96773,v1:172.21.15.5:6801/96773] conn(0x7fd1780720e0 0x7fd178074510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.459+0000 7fd1911ee700 1 --2- 172.21.15.5:0/2249142933 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd178068490 0x7fd17806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.460+0000 7fd1921f0700 1 --2- 172.21.15.5:0/2249142933 >> [v2:172.21.15.5:6800/96773,v1:172.21.15.5:6801/96773] conn(0x7fd1780720e0 0x7fd178074510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.460+0000 7fd1911ee700 1 --2- 172.21.15.5:0/2249142933 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd178068490 0x7fd17806a940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd18c157fb0 tx=0x7fd184009230 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.460+0000 7efeab155700 1 -- 172.21.15.5:0/2283874488 --> [v2:172.21.15.191:6809/97068,v1:172.21.15.191:6811/97068] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe84002d30 con 0x7efe88071ec0 2023-03-03T06:24:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.460+0000 7f8c397fa700 1 -- 172.21.15.5:0/2321728768 <== osd.2 v2:172.21.15.5:6817/96787 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8c1c006bb0 con 0x7f8c1c0015d0 2023-03-03T06:24:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.461+0000 7efea17fa700 1 -- 172.21.15.5:0/2283874488 <== osd.7 v2:172.21.15.191:6809/97068 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efe84002d30 con 0x7efe88071ec0 2023-03-03T06:24:01.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.461+0000 7fd1827fc700 1 -- 172.21.15.5:0/2249142933 <== osd.3 v2:172.21.15.5:6800/96773 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd178074be0 con 0x7fd1780720e0 2023-03-03T06:24:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.465+0000 7efeab155700 1 -- 172.21.15.5:0/2283874488 >> [v2:172.21.15.191:6809/97068,v1:172.21.15.191:6811/97068] conn(0x7efe88071ec0 msgr2=0x7efe880742f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.465+0000 7efeab155700 1 --2- 172.21.15.5:0/2283874488 >> [v2:172.21.15.191:6809/97068,v1:172.21.15.191:6811/97068] conn(0x7efe88071ec0 0x7efe880742f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7efeab155700 1 -- 172.21.15.5:0/2283874488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe880682f0 msgr2=0x7efe8806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7efeab155700 1 --2- 172.21.15.5:0/2283874488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe880682f0 0x7efe8806a7a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efe98009fd0 tx=0x7efe9801d040 comp rx=0 tx=0).stop 2023-03-03T06:24:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7efeab155700 1 -- 172.21.15.5:0/2283874488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea4160b60 msgr2=0x7efea415fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7efeab155700 1 --2- 172.21.15.5:0/2283874488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efea4160b60 0x7efea415fba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efe9000c410 tx=0x7efe9000c720 comp rx=0 tx=0).stop 2023-03-03T06:24:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7f1fed883700 1 -- 172.21.15.5:0/3166423517 --> [v2:172.21.15.191:6824/97078,v1:172.21.15.191:6825/97078] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1fe804e6e0 con 0x7f1fe80c9170 2023-03-03T06:24:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7f0e668a0700 1 -- 172.21.15.5:0/3626272665 --> [v2:172.21.15.191:6800/97067,v1:172.21.15.191:6801/97067] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0e40002d30 con 0x7f0e4c071f20 2023-03-03T06:24:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7efea96f2700 1 -- 172.21.15.5:0/2283874488 reap_dead start 2023-03-03T06:24:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7efeab155700 1 -- 172.21.15.5:0/2283874488 shutdown_connections 2023-03-03T06:24:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7efeab155700 1 -- 172.21.15.5:0/2283874488 >> 172.21.15.5:0/2283874488 conn(0x7efea40cf890 msgr2=0x7efea40cdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7f5ba6e84700 1 -- 172.21.15.5:0/1681204955 --> [v2:172.21.15.5:6808/96772,v1:172.21.15.5:6809/96772] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5b80005c90 con 0x7f5b800015d0 2023-03-03T06:24:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7f1fcffff700 1 -- 172.21.15.5:0/3166423517 <== osd.6 v2:172.21.15.191:6824/97078 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1fe804e6e0 con 0x7f1fe80c9170 2023-03-03T06:24:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7efeab155700 1 -- 172.21.15.5:0/2283874488 shutdown_connections 2023-03-03T06:24:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7efeab155700 1 -- 172.21.15.5:0/2283874488 wait complete. 2023-03-03T06:24:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7f04bf4ce700 1 -- 172.21.15.5:0/1911185773 --> [v2:172.21.15.191:6808/97069,v1:172.21.15.191:6810/97069] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f04b806f490 con 0x7f049c072090 2023-03-03T06:24:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.467+0000 7f0e5cff9700 1 -- 172.21.15.5:0/3626272665 <== osd.5 v2:172.21.15.191:6800/97067 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0e40002d30 con 0x7f0e4c071f20 2023-03-03T06:24:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.467+0000 7f5b9d7fa700 1 -- 172.21.15.5:0/1681204955 <== osd.1 v2:172.21.15.5:6808/96772 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5b80005c90 con 0x7f5b800015d0 2023-03-03T06:24:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.467+0000 7f0e668a0700 1 -- 172.21.15.5:0/3626272665 >> [v2:172.21.15.191:6800/97067,v1:172.21.15.191:6801/97067] conn(0x7f0e4c071f20 msgr2=0x7f0e4c074350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.467+0000 7f0e668a0700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.191:6800/97067,v1:172.21.15.191:6801/97067] conn(0x7f0e4c071f20 0x7f0e4c074350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f0e668a0700 1 -- 172.21.15.5:0/3626272665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0e4c0683c0 msgr2=0x7f0e4c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f0e668a0700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0e4c0683c0 0x7f0e4c06a870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e540018d0 tx=0x7f0e54009040 comp rx=0 tx=0).stop 2023-03-03T06:24:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f0e668a0700 1 -- 172.21.15.5:0/3626272665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e601562e0 msgr2=0x7f0e600afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f0e668a0700 1 --2- 172.21.15.5:0/3626272665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e601562e0 0x7f0e600afa80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0e50018000 tx=0x7f0e50004750 comp rx=0 tx=0).stop 2023-03-03T06:24:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f0e64e3d700 1 -- 172.21.15.5:0/3626272665 reap_dead start 2023-03-03T06:24:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f0e668a0700 1 -- 172.21.15.5:0/3626272665 shutdown_connections 2023-03-03T06:24:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f0e668a0700 1 -- 172.21.15.5:0/3626272665 >> 172.21.15.5:0/3626272665 conn(0x7f0e600cec40 msgr2=0x7f0e6015bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f0e668a0700 1 -- 172.21.15.5:0/3626272665 shutdown_connections 2023-03-03T06:24:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f0e668a0700 1 -- 172.21.15.5:0/3626272665 wait complete. 2023-03-03T06:24:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f5ba6e84700 1 -- 172.21.15.5:0/1681204955 >> [v2:172.21.15.5:6808/96772,v1:172.21.15.5:6809/96772] conn(0x7f5b800015d0 msgr2=0x7f5b80003a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f5ba6e84700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.5:6808/96772,v1:172.21.15.5:6809/96772] conn(0x7f5b800015d0 0x7f5b80003a80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f5ba6e84700 1 -- 172.21.15.5:0/1681204955 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5b8c068340 msgr2=0x7f5b8c06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f5ba6e84700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5b8c068340 0x7f5b8c06a7f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5b9800a400 tx=0x7f5b9800d040 comp rx=0 tx=0).stop 2023-03-03T06:24:01.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f5ba6e84700 1 -- 172.21.15.5:0/1681204955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba00ce380 msgr2=0x7f5ba014ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f5ba6e84700 1 --2- 172.21.15.5:0/1681204955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ba00ce380 0x7f5ba014ea90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5b94004000 tx=0x7f5b94004750 comp rx=0 tx=0).stop 2023-03-03T06:24:01.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f5ba5421700 1 -- 172.21.15.5:0/1681204955 reap_dead start 2023-03-03T06:24:01.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f5ba6e84700 1 -- 172.21.15.5:0/1681204955 shutdown_connections 2023-03-03T06:24:01.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f5ba6e84700 1 -- 172.21.15.5:0/1681204955 >> 172.21.15.5:0/1681204955 conn(0x7f5ba00cf890 msgr2=0x7f5ba0159480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.466+0000 7fcd29ffb700 1 -- 172.21.15.5:0/3343828744 <== osd.0 v2:172.21.15.5:6816/96775 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcd18074b90 con 0x7fcd18072090 2023-03-03T06:24:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f5ba6e84700 1 -- 172.21.15.5:0/1681204955 shutdown_connections 2023-03-03T06:24:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.468+0000 7f5ba6e84700 1 -- 172.21.15.5:0/1681204955 wait complete. 2023-03-03T06:24:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.469+0000 7f04adffb700 1 -- 172.21.15.5:0/1911185773 <== osd.4 v2:172.21.15.191:6808/97069 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f04b806f490 con 0x7f049c072090 2023-03-03T06:24:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.478+0000 7f1fed883700 1 -- 172.21.15.5:0/3166423517 >> [v2:172.21.15.191:6824/97078,v1:172.21.15.191:6825/97078] conn(0x7f1fe80c9170 msgr2=0x7f1fe80c42d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.478+0000 7f1fed883700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.191:6824/97078,v1:172.21.15.191:6825/97078] conn(0x7f1fe80c9170 0x7f1fe80c42d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.478+0000 7f1fed883700 1 -- 172.21.15.5:0/3166423517 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1fd0068570 msgr2=0x7f1fd006aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.478+0000 7f1fed883700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1fd0068570 0x7f1fd006aa20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8155910 tx=0x7f1fdc009190 comp rx=0 tx=0).stop 2023-03-03T06:24:01.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.478+0000 7f1fed883700 1 -- 172.21.15.5:0/3166423517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fe80cdeb0 msgr2=0x7f1fe814b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.478+0000 7f1fed883700 1 --2- 172.21.15.5:0/3166423517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1fe80cdeb0 0x7f1fe814b1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000b530 tx=0x7f1fe000b840 comp rx=0 tx=0).stop 2023-03-03T06:24:01.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.478+0000 7f1fe77fe700 1 -- 172.21.15.5:0/3166423517 reap_dead start 2023-03-03T06:24:01.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.482+0000 7fd193c53700 1 -- 172.21.15.5:0/2249142933 --> [v2:172.21.15.5:6800/96773,v1:172.21.15.5:6801/96773] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd170002d30 con 0x7fd1780720e0 2023-03-03T06:24:01.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.482+0000 7f04bf4ce700 1 -- 172.21.15.5:0/1911185773 >> [v2:172.21.15.191:6808/97069,v1:172.21.15.191:6810/97069] conn(0x7f049c072090 msgr2=0x7f049c0744c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.482+0000 7f04bf4ce700 1 --2- 172.21.15.5:0/1911185773 >> [v2:172.21.15.191:6808/97069,v1:172.21.15.191:6810/97069] conn(0x7f049c072090 0x7f049c0744c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.482+0000 7f04bf4ce700 1 -- 172.21.15.5:0/1911185773 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f049c0683c0 msgr2=0x7f049c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.483+0000 7f04bf4ce700 1 --2- 172.21.15.5:0/1911185773 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f049c0683c0 0x7f049c06a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f04a80090b0 tx=0x7f04a8008030 comp rx=0 tx=0).stop 2023-03-03T06:24:01.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.483+0000 7f04bf4ce700 1 -- 172.21.15.5:0/1911185773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04b815cb40 msgr2=0x7f04b81596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.483+0000 7f04bf4ce700 1 --2- 172.21.15.5:0/1911185773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04b815cb40 0x7f04b81596a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c730 tx=0x7f04b400caf0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.483+0000 7f04bda6b700 1 -- 172.21.15.5:0/1911185773 reap_dead start 2023-03-03T06:24:01.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.483+0000 7f04bf4ce700 1 -- 172.21.15.5:0/1911185773 shutdown_connections 2023-03-03T06:24:01.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.483+0000 7f04bf4ce700 1 -- 172.21.15.5:0/1911185773 >> 172.21.15.5:0/1911185773 conn(0x7f04b80cf890 msgr2=0x7f04b80cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.483+0000 7f1fed883700 1 -- 172.21.15.5:0/3166423517 shutdown_connections 2023-03-03T06:24:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.483+0000 7f1fed883700 1 -- 172.21.15.5:0/3166423517 >> 172.21.15.5:0/3166423517 conn(0x7f1fe80cf890 msgr2=0x7f1fe80c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.483+0000 7fd1827fc700 1 -- 172.21.15.5:0/2249142933 <== osd.3 v2:172.21.15.5:6800/96773 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd170002d30 con 0x7fd1780720e0 2023-03-03T06:24:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.483+0000 7f04bf4ce700 1 -- 172.21.15.5:0/1911185773 shutdown_connections 2023-03-03T06:24:01.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.483+0000 7f04bf4ce700 1 -- 172.21.15.5:0/1911185773 wait complete. 2023-03-03T06:24:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.483+0000 7f1fed883700 1 -- 172.21.15.5:0/3166423517 shutdown_connections 2023-03-03T06:24:01.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.483+0000 7f1fed883700 1 -- 172.21.15.5:0/3166423517 wait complete. 2023-03-03T06:24:01.536 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2023-03-03T06:24:01.536 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-03-03T06:24:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.487+0000 7fd193c53700 1 -- 172.21.15.5:0/2249142933 >> [v2:172.21.15.5:6800/96773,v1:172.21.15.5:6801/96773] conn(0x7fd1780720e0 msgr2=0x7fd178074510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.487+0000 7fd193c53700 1 --2- 172.21.15.5:0/2249142933 >> [v2:172.21.15.5:6800/96773,v1:172.21.15.5:6801/96773] conn(0x7fd1780720e0 0x7fd178074510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.487+0000 7fd193c53700 1 -- 172.21.15.5:0/2249142933 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd178068490 msgr2=0x7fd17806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.487+0000 7fd193c53700 1 --2- 172.21.15.5:0/2249142933 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd178068490 0x7fd17806a940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd18c157fb0 tx=0x7fd184009230 comp rx=0 tx=0).stop 2023-03-03T06:24:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.487+0000 7fd193c53700 1 -- 172.21.15.5:0/2249142933 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd18c070d00 msgr2=0x7fd18c1578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.487+0000 7fd193c53700 1 --2- 172.21.15.5:0/2249142933 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd18c070d00 0x7fd18c1578b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd188000c00 tx=0x7fd188004750 comp rx=0 tx=0).stop 2023-03-03T06:24:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.488+0000 7fd1921f0700 1 -- 172.21.15.5:0/2249142933 reap_dead start 2023-03-03T06:24:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.488+0000 7fd193c53700 1 -- 172.21.15.5:0/2249142933 shutdown_connections 2023-03-03T06:24:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.488+0000 7fd193c53700 1 -- 172.21.15.5:0/2249142933 >> 172.21.15.5:0/2249142933 conn(0x7fd18c0cec40 msgr2=0x7fd18c06d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.488+0000 7fd193c53700 1 -- 172.21.15.5:0/2249142933 shutdown_connections 2023-03-03T06:24:01.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.488+0000 7fd193c53700 1 -- 172.21.15.5:0/2249142933 wait complete. 2023-03-03T06:24:01.539 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-03-03T06:24:01.539 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-03-03T06:24:01.540 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2023-03-03T06:24:01.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-03-03T06:24:01.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.489+0000 7f8c42af9700 1 -- 172.21.15.5:0/2321728768 --> [v2:172.21.15.5:6817/96787,v1:172.21.15.5:6819/96787] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c1c005c90 con 0x7f8c1c0015d0 2023-03-03T06:24:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.489+0000 7f8c397fa700 1 -- 172.21.15.5:0/2321728768 <== osd.2 v2:172.21.15.5:6817/96787 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8c1c005c90 con 0x7f8c1c0015d0 2023-03-03T06:24:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.490+0000 7f8c42af9700 1 -- 172.21.15.5:0/2321728768 >> [v2:172.21.15.5:6817/96787,v1:172.21.15.5:6819/96787] conn(0x7f8c1c0015d0 msgr2=0x7f8c1c003a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.490+0000 7f8c42af9700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.5:6817/96787,v1:172.21.15.5:6819/96787] conn(0x7f8c1c0015d0 0x7f8c1c003a80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.490+0000 7f8c42af9700 1 -- 172.21.15.5:0/2321728768 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c28068340 msgr2=0x7f8c2806a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.490+0000 7f8c42af9700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c28068340 0x7f8c2806a7f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0090b0 tx=0x7f8c2c008030 comp rx=0 tx=0).stop 2023-03-03T06:24:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.490+0000 7f8c42af9700 1 -- 172.21.15.5:0/2321728768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c3c160f30 msgr2=0x7f8c3c0b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.490+0000 7f8c42af9700 1 --2- 172.21.15.5:0/2321728768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c3c160f30 0x7f8c3c0b1b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400cd40 tx=0x7f8c3400a570 comp rx=0 tx=0).stop 2023-03-03T06:24:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.490+0000 7f8c41096700 1 -- 172.21.15.5:0/2321728768 reap_dead start 2023-03-03T06:24:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.490+0000 7f8c42af9700 1 -- 172.21.15.5:0/2321728768 shutdown_connections 2023-03-03T06:24:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.490+0000 7f8c42af9700 1 -- 172.21.15.5:0/2321728768 >> 172.21.15.5:0/2321728768 conn(0x7f8c3c0cf890 msgr2=0x7f8c3c06e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.494+0000 7fcd1f7fe700 1 -- 172.21.15.5:0/3343828744 --> [v2:172.21.15.5:6816/96775,v1:172.21.15.5:6818/96775] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcd14002d30 con 0x7fcd18072090 2023-03-03T06:24:01.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.494+0000 7f8c42af9700 1 -- 172.21.15.5:0/2321728768 shutdown_connections 2023-03-03T06:24:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.494+0000 7f8c42af9700 1 -- 172.21.15.5:0/2321728768 wait complete. 2023-03-03T06:24:01.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.494+0000 7fcd29ffb700 1 -- 172.21.15.5:0/3343828744 <== osd.0 v2:172.21.15.5:6816/96775 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcd14002d30 con 0x7fcd18072090 2023-03-03T06:24:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.495+0000 7fcd1f7fe700 1 -- 172.21.15.5:0/3343828744 >> [v2:172.21.15.5:6816/96775,v1:172.21.15.5:6818/96775] conn(0x7fcd18072090 msgr2=0x7fcd180744c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.495+0000 7fcd1f7fe700 1 --2- 172.21.15.5:0/3343828744 >> [v2:172.21.15.5:6816/96775,v1:172.21.15.5:6818/96775] conn(0x7fcd18072090 0x7fcd180744c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.495+0000 7fcd1f7fe700 1 -- 172.21.15.5:0/3343828744 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcd180683c0 msgr2=0x7fcd1806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.495+0000 7fcd1f7fe700 1 --2- 172.21.15.5:0/3343828744 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcd180683c0 0x7fcd1806a870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcd340c5a40 tx=0x7fcd2c0060b0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.495+0000 7fcd1f7fe700 1 -- 172.21.15.5:0/3343828744 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd340c9290 msgr2=0x7fcd340c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.495+0000 7fcd1f7fe700 1 --2- 172.21.15.5:0/3343828744 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd340c9290 0x7fcd340c75b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcd3406cba0 tx=0x7fcd300047c0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.495+0000 7fcd3a001700 1 -- 172.21.15.5:0/3343828744 reap_dead start 2023-03-03T06:24:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.495+0000 7fcd1f7fe700 1 -- 172.21.15.5:0/3343828744 shutdown_connections 2023-03-03T06:24:01.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.495+0000 7fcd1f7fe700 1 -- 172.21.15.5:0/3343828744 >> 172.21.15.5:0/3343828744 conn(0x7fcd340cf890 msgr2=0x7fcd34155ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.547 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2023-03-03T06:24:01.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-03-03T06:24:01.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.501+0000 7fcd1f7fe700 1 -- 172.21.15.5:0/3343828744 shutdown_connections 2023-03-03T06:24:01.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.501+0000 7fcd1f7fe700 1 -- 172.21.15.5:0/3343828744 wait complete. 2023-03-03T06:24:01.549 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2023-03-03T06:24:01.549 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-03-03T06:24:01.550 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2023-03-03T06:24:01.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-03-03T06:24:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2023-03-03T06:24:01.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-03-03T06:24:01.552 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2023-03-03T06:24:01.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-03T06:24:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.793+0000 7fd911619700 1 Processor -- start 2023-03-03T06:24:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.793+0000 7fd911619700 1 -- start start 2023-03-03T06:24:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.794+0000 7fd911619700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90c0cd7a0 0x7fd90c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.794+0000 7fd911619700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd90c0c9290 0x7fd90c0c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.794+0000 7fd911619700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90c06e6b0 con 0x7fd90c0ce380 2023-03-03T06:24:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.794+0000 7fd911619700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90c06eb40 con 0x7fd90c0c9290 2023-03-03T06:24:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.794+0000 7fd911619700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c159e40 con 0x7fd90c0cd7a0 2023-03-03T06:24:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.795+0000 7fd90b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd90c0c9290 0x7fd90c0c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.795+0000 7fd90b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd90c0c9290 0x7fd90c0c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41688/0 (socket says 172.21.15.5:41688) 2023-03-03T06:24:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.795+0000 7fd90b7fe700 1 -- 172.21.15.5:0/3944172870 learned_addr learned my addr 172.21.15.5:0/3944172870 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.795+0000 7fd90b7fe700 1 -- 172.21.15.5:0/3944172870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90c0cd7a0 msgr2=0x7fd90c159900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-03-03T06:24:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.795+0000 7fd90b7fe700 1 --2- 172.21.15.5:0/3944172870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90c0cd7a0 0x7fd90c159900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.795+0000 7fd90b7fe700 1 -- 172.21.15.5:0/3944172870 >> v1:172.21.15.5:6789/0 conn(0x7fd90c0ce380 legacy=0x7fd90c0cdb70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-03T06:24:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.795+0000 7fd90b7fe700 1 -- 172.21.15.5:0/3944172870 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c06bc30 con 0x7fd90c0c9290 2023-03-03T06:24:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.793+0000 7fc0eff2a700 1 Processor -- start 2023-03-03T06:24:01.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.793+0000 7fc0eff2a700 1 -- start start 2023-03-03T06:24:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.794+0000 7fc0eff2a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc0e8160f30 0x7fc0e80c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.794+0000 7fc0eff2a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e80c2160 0x7fc0e80cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.794+0000 7fc0eff2a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e80c25b0 con 0x7fc0e8160b60 2023-03-03T06:24:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.794+0000 7fc0eff2a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e806bca0 con 0x7fc0e8160f30 2023-03-03T06:24:01.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.794+0000 7fc0eff2a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e806b120 con 0x7fc0e80c2160 2023-03-03T06:24:01.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.796+0000 7fd90b7fe700 1 --2- 172.21.15.5:0/3944172870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd90c0c9290 0x7fd90c0c9710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0088f0 tx=0x7fd8fc00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d863fd5bb7b62fc server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.796+0000 7fc0edcc6700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc0e8160b60 0x7fc0e80c9de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59768/0 (socket says 172.21.15.5:59768) 2023-03-03T06:24:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.796+0000 7fc0edcc6700 1 -- 172.21.15.5:0/1204073757 learned_addr learned my addr 172.21.15.5:0/1204073757 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.796+0000 7fc0ee4c7700 1 --2- 172.21.15.5:0/1204073757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e80c2160 0x7fc0e80cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.796+0000 7fc0ed4c5700 1 --2- 172.21.15.5:0/1204073757 >> v2:172.21.15.191:3300/0 conn(0x7fc0e8160f30 0x7fc0e80c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.797+0000 7fc0ee4c7700 1 -- 172.21.15.5:0/1204073757 >> v2:172.21.15.191:3300/0 conn(0x7fc0e8160f30 msgr2=0x7fc0e80c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.797+0000 7fc0ee4c7700 1 --2- 172.21.15.5:0/1204073757 >> v2:172.21.15.191:3300/0 conn(0x7fc0e8160f30 0x7fc0e80c1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.797+0000 7fc0ee4c7700 1 -- 172.21.15.5:0/1204073757 >> v1:172.21.15.5:6789/0 conn(0x7fc0e8160b60 legacy=0x7fc0e80c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.797+0000 7fc0ee4c7700 1 -- 172.21.15.5:0/1204073757 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e806b400 con 0x7fc0e80c2160 2023-03-03T06:24:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.797+0000 7fc0ee4c7700 1 --2- 172.21.15.5:0/1204073757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e80c2160 0x7fc0e80cd190 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009840 tx=0x7fc0e4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8215fcecdb06f7e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.799+0000 7fc0eccc4700 1 -- 172.21.15.5:0/1204073757 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4004230 con 0x7fc0e80c2160 2023-03-03T06:24:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.799+0000 7fc0eccc4700 1 -- 172.21.15.5:0/1204073757 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e4004390 con 0x7fc0e80c2160 2023-03-03T06:24:01.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.799+0000 7fc0eccc4700 1 -- 172.21.15.5:0/1204073757 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e40036a0 con 0x7fc0e80c2160 2023-03-03T06:24:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.800+0000 7fc0eff2a700 1 -- 172.21.15.5:0/1204073757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e80c2160 msgr2=0x7fc0e80cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.800+0000 7fc0eff2a700 1 --2- 172.21.15.5:0/1204073757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e80c2160 0x7fc0e80cd190 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009840 tx=0x7fc0e4009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.800+0000 7fd909ffb700 1 -- 172.21.15.5:0/3944172870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc010070 con 0x7fd90c0c9290 2023-03-03T06:24:01.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.800+0000 7fd909ffb700 1 -- 172.21.15.5:0/3944172870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc00da40 con 0x7fd90c0c9290 2023-03-03T06:24:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.800+0000 7fd909ffb700 1 -- 172.21.15.5:0/3944172870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc00ddd0 con 0x7fd90c0c9290 2023-03-03T06:24:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.801+0000 7fd911619700 1 -- 172.21.15.5:0/3944172870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd90c0c9290 msgr2=0x7fd90c0c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.801+0000 7fd911619700 1 --2- 172.21.15.5:0/3944172870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd90c0c9290 0x7fd90c0c9710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0088f0 tx=0x7fd8fc00d330 comp rx=0 tx=0).stop 2023-03-03T06:24:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.802+0000 7fd911619700 1 -- 172.21.15.5:0/3944172870 shutdown_connections 2023-03-03T06:24:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.802+0000 7fd911619700 1 --2- 172.21.15.5:0/3944172870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd90c0c9290 0x7fd90c0c9710 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.802+0000 7fd911619700 1 --2- 172.21.15.5:0/3944172870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90c0cd7a0 0x7fd90c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.802+0000 7fd911619700 1 -- 172.21.15.5:0/3944172870 >> 172.21.15.5:0/3944172870 conn(0x7fd90c0cf890 msgr2=0x7fd90c0cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.802+0000 7f02053bc700 1 Processor -- start 2023-03-03T06:24:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.802+0000 7fc0eff2a700 1 -- 172.21.15.5:0/1204073757 shutdown_connections 2023-03-03T06:24:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.802+0000 7fc0eff2a700 1 --2- 172.21.15.5:0/1204073757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e80c2160 0x7fc0e80cd190 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.802+0000 7fc0eff2a700 1 --2- 172.21.15.5:0/1204073757 >> v2:172.21.15.191:3300/0 conn(0x7fc0e8160f30 0x7fc0e80c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.802+0000 7fc0eff2a700 1 -- 172.21.15.5:0/1204073757 >> 172.21.15.5:0/1204073757 conn(0x7fc0e80cf890 msgr2=0x7fc0e80cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.802+0000 7fd911619700 1 -- 172.21.15.5:0/3944172870 shutdown_connections 2023-03-03T06:24:01.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.802+0000 7fd911619700 1 -- 172.21.15.5:0/3944172870 wait complete. 2023-03-03T06:24:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.803+0000 7fe114484700 1 Processor -- start 2023-03-03T06:24:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.803+0000 7fe114484700 1 -- start start 2023-03-03T06:24:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7fd911619700 1 Processor -- start 2023-03-03T06:24:01.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.803+0000 7fc0eff2a700 1 -- 172.21.15.5:0/1204073757 shutdown_connections 2023-03-03T06:24:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.803+0000 7fc0eff2a700 1 -- 172.21.15.5:0/1204073757 wait complete. 2023-03-03T06:24:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7fc0eff2a700 1 Processor -- start 2023-03-03T06:24:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.804+0000 7fe114484700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe10c0ce220 0x7fe10c158d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.804+0000 7fe114484700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe10c0ca050 0x7fe10c15d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.804+0000 7fe114484700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c15d730 con 0x7fe10c06a330 2023-03-03T06:24:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.804+0000 7fe114484700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe10c0ca680 con 0x7fe10c0ca050 2023-03-03T06:24:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.804+0000 7fe114484700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c0ca960 con 0x7fe10c0ce220 2023-03-03T06:24:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.804+0000 7fe112a21700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe10c06a330 0x7fe10c06d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59772/0 (socket says 172.21.15.5:59772) 2023-03-03T06:24:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.804+0000 7fe112a21700 1 -- 172.21.15.5:0/1127115250 learned_addr learned my addr 172.21.15.5:0/1127115250 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.803+0000 7f02053bc700 1 -- start start 2023-03-03T06:24:01.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.804+0000 7f02053bc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02000ce220 0x7f0200158d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.804+0000 7f02053bc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02000ca050 0x7f020015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.804+0000 7f02053bc700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020015d730 con 0x7f020006a330 2023-03-03T06:24:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.804+0000 7f02053bc700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02000ca680 con 0x7f02000ce220 2023-03-03T06:24:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.804+0000 7f02053bc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02000ca960 con 0x7f02000ca050 2023-03-03T06:24:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7f01feffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02000ce220 0x7f0200158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7f01feffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02000ce220 0x7f0200158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41704/0 (socket says 172.21.15.5:41704) 2023-03-03T06:24:01.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7fd911619700 1 -- start start 2023-03-03T06:24:01.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7f01feffd700 1 -- 172.21.15.5:0/3701237210 learned_addr learned my addr 172.21.15.5:0/3701237210 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7f01fe7fc700 1 --2- 172.21.15.5:0/3701237210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02000ca050 0x7f020015d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567901990 0 0) 0x7fe10c15d730 con 0x7fe10c06a330 2023-03-03T06:24:01.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0f80035b0 con 0x7fe10c06a330 2023-03-03T06:24:01.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7f01feffd700 1 -- 172.21.15.5:0/3701237210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02000ca050 msgr2=0x7f020015d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7f01feffd700 1 --2- 172.21.15.5:0/3701237210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02000ca050 0x7f020015d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7f01feffd700 1 -- 172.21.15.5:0/3701237210 >> v1:172.21.15.191:6789/0 conn(0x7f020006a330 legacy=0x7f020006d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7f01feffd700 1 -- 172.21.15.5:0/3701237210 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02000cac40 con 0x7f02000ce220 2023-03-03T06:24:01.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 17338944 0 0) 0x7fe0f80035b0 con 0x7fe10c06a330 2023-03-03T06:24:01.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe10c0ce220 msgr2=0x7fe10c158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7fe11121e700 1 --2- 172.21.15.5:0/1127115250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe10c0ce220 0x7fe10c158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 >> v2:172.21.15.5:3300/0 conn(0x7fe10c0ca050 msgr2=0x7fe10c15d1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-03T06:24:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7fe11121e700 1 --2- 172.21.15.5:0/1127115250 >> v2:172.21.15.5:3300/0 conn(0x7fe10c0ca050 0x7fe10c15d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c0cac40 con 0x7fe10c06a330 2023-03-03T06:24:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fe1040019f0 con 0x7fe10c06a330 2023-03-03T06:24:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 >> v1:172.21.15.5:6789/0 conn(0x7fe10c06a330 legacy=0x7fe10c06d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe11121e700 1 --2- 172.21.15.5:0/1127115250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0f8003a70 0x7fe0f8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe11121e700 1 --2- 172.21.15.5:0/1127115250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0f8004850 0x7fe0f8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe11121e700 1 --2- 172.21.15.5:0/1127115250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0f8005320 0x7fe0f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c0ca680 con 0x7fe0f8005320 2023-03-03T06:24:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c0ca960 con 0x7fe0f8004850 2023-03-03T06:24:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f800c280 con 0x7fe0f8003a70 2023-03-03T06:24:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fd911619700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90c0c9290 0x7fd90c0c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fd911619700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd90c0cd7a0 0x7fd90c0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fd911619700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd90c0ce380 0x7fd90c0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fd911619700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c0c2770 con 0x7fd90c0ce380 2023-03-03T06:24:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fd911619700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c0c5eb0 con 0x7fd90c0cd7a0 2023-03-03T06:24:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fd911619700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c0c6150 con 0x7fd90c0c9290 2023-03-03T06:24:01.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe112a21700 1 --2- 172.21.15.5:0/1127115250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0f8005320 0x7fe0f800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7f01feffd700 1 --2- 172.21.15.5:0/3701237210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02000ce220 0x7f0200158d90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f01f80098f0 tx=0x7f01f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ca93c3d42e6aed server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe112220700 1 --2- 172.21.15.5:0/1127115250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0f8003a70 0x7fe0f8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fd90a7fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd90c0cd7a0 0x7fd90c0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fd90affd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90c0c9290 0x7fd90c0c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fd90a7fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd90c0cd7a0 0x7fd90c0af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42072/0 (socket says 172.21.15.5:42072) 2023-03-03T06:24:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fd90a7fc700 1 -- 172.21.15.5:0/2066830470 learned_addr learned my addr 172.21.15.5:0/2066830470 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fd90affd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90c0c9290 0x7fd90c0c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39786/0 (socket says 172.21.15.5:39786) 2023-03-03T06:24:01.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fd90b7fe700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd90c0ce380 0x7fd90c0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.805+0000 7fc0eff2a700 1 -- start start 2023-03-03T06:24:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fc0eff2a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e80c2160 0x7fc0e815ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fc0eff2a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0e8160b60 0x7fc0e81464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe112220700 1 -- 172.21.15.5:0/1127115250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0f8004850 msgr2=0x7fe0f8004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-03T06:24:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fc0eff2a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e8160f30 0x7fc0e80b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fc0eff2a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e815bdf0 con 0x7fc0e80c2160 2023-03-03T06:24:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fc0eff2a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e81469f0 con 0x7fc0e8160b60 2023-03-03T06:24:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fc0eff2a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e815b5e0 con 0x7fc0e8160f30 2023-03-03T06:24:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fc0edcc6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e80c2160 0x7fc0e815ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fc0ed4c5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0e8160b60 0x7fc0e81464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fc0edcc6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e80c2160 0x7fc0e815ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41718/0 (socket says 172.21.15.5:41718) 2023-03-03T06:24:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe112220700 1 --2- 172.21.15.5:0/1127115250 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe0f8004850 0x7fe0f8004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe112220700 1 -- 172.21.15.5:0/1127115250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0f8005320 msgr2=0x7fe0f800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe112220700 1 --2- 172.21.15.5:0/1127115250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0f8005320 0x7fe0f800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fe112220700 1 -- 172.21.15.5:0/1127115250 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f80035b0 con 0x7fe0f8003a70 2023-03-03T06:24:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.806+0000 7fc0edcc6700 1 -- 172.21.15.5:0/3946544905 learned_addr learned my addr 172.21.15.5:0/3946544905 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fd90b7fe700 1 -- 172.21.15.5:0/2066830470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90c0c9290 msgr2=0x7fd90c0c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fc0ee4c7700 1 --2- 172.21.15.5:0/3946544905 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e8160f30 0x7fc0e80b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fd90b7fe700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90c0c9290 0x7fd90c0c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fd90b7fe700 1 -- 172.21.15.5:0/2066830470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd90c0cd7a0 msgr2=0x7fd90c0af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fd90b7fe700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd90c0cd7a0 0x7fd90c0af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fd90b7fe700 1 -- 172.21.15.5:0/2066830470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc0085d0 con 0x7fd90c0ce380 2023-03-03T06:24:01.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fd90affd700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90c0c9290 0x7fd90c0c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7f771197d700 1 Processor -- start 2023-03-03T06:24:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fd90b7fe700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd90c0ce380 0x7fd90c0afbe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc018000 tx=0x7fd8fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7f771197d700 1 -- start start 2023-03-03T06:24:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fe112220700 1 --2- 172.21.15.5:0/1127115250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0f8003a70 0x7fe0f8003e80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0b2070 tx=0x7fe0f8005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aef16d4e1cbb432f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fd8f37fe700 1 -- 172.21.15.5:0/2066830470 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc008a00 con 0x7fd90c0ce380 2023-03-03T06:24:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fd8f37fe700 1 -- 172.21.15.5:0/2066830470 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc008b60 con 0x7fd90c0ce380 2023-03-03T06:24:01.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fd8f37fe700 1 -- 172.21.15.5:0/2066830470 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0036a0 con 0x7fd90c0ce380 2023-03-03T06:24:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc011620 con 0x7fe0f8003a70 2023-03-03T06:24:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7f01fdffb700 1 -- 172.21.15.5:0/3701237210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8004230 con 0x7f02000ce220 2023-03-03T06:24:01.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7fd911619700 1 -- 172.21.15.5:0/2066830470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90c06dd80 con 0x7fd90c0ce380 2023-03-03T06:24:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7f771197d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f770c0afd10 0x7f770c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7f771197d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c15abd0 con 0x7f770c06b2d0 2023-03-03T06:24:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7f771197d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c0aca80 con 0x7f770c15a800 2023-03-03T06:24:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7f771197d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c0acd60 con 0x7f770c0afd10 2023-03-03T06:24:01.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7f770a7fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f770c06b2d0 0x7f770c0af600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59798/0 (socket says 172.21.15.5:59798) 2023-03-03T06:24:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7f770a7fc700 1 -- 172.21.15.5:0/17736498 learned_addr learned my addr 172.21.15.5:0/17736498 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fc0edcc6700 1 -- 172.21.15.5:0/3946544905 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e8160f30 msgr2=0x7fc0e80b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fc0edcc6700 1 --2- 172.21.15.5:0/3946544905 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e8160f30 0x7fc0e80b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fc0edcc6700 1 -- 172.21.15.5:0/3946544905 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0e8160b60 msgr2=0x7fc0e81464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fc0edcc6700 1 --2- 172.21.15.5:0/3946544905 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0e8160b60 0x7fc0e81464b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.807+0000 7fc0edcc6700 1 -- 172.21.15.5:0/3946544905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e40094a0 con 0x7fc0e80c2160 2023-03-03T06:24:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7fc0edcc6700 1 --2- 172.21.15.5:0/3946544905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e80c2160 0x7fc0e815ca10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0002210 tx=0x7fc0e000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7fd911619700 1 -- 172.21.15.5:0/2066830470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90c06daa0 con 0x7fd90c0ce380 2023-03-03T06:24:01.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc011780 con 0x7fe0f8003a70 2023-03-03T06:24:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7fe11121e700 1 -- 172.21.15.5:0/1127115250 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc011b30 con 0x7fe0f8003a70 2023-03-03T06:24:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7f01fdffb700 1 -- 172.21.15.5:0/3701237210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f8004390 con 0x7f02000ce220 2023-03-03T06:24:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7f01fdffb700 1 -- 172.21.15.5:0/3701237210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80036a0 con 0x7f02000ce220 2023-03-03T06:24:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7f02053bc700 1 -- 172.21.15.5:0/3701237210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02000ce220 msgr2=0x7f0200158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.808+0000 7f02053bc700 1 --2- 172.21.15.5:0/3701237210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02000ce220 0x7f0200158d90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f01f80098f0 tx=0x7f01f8009c00 comp rx=0 tx=0).stop 2023-03-03T06:24:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7f02053bc700 1 -- 172.21.15.5:0/3701237210 shutdown_connections 2023-03-03T06:24:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7f02053bc700 1 --2- 172.21.15.5:0/3701237210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02000ce220 0x7f0200158d90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7f02053bc700 1 --2- 172.21.15.5:0/3701237210 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02000ca050 0x7f020015d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7f02053bc700 1 -- 172.21.15.5:0/3701237210 >> 172.21.15.5:0/3701237210 conn(0x7f02000b1c60 msgr2=0x7f02000cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7f02053bc700 1 -- 172.21.15.5:0/3701237210 shutdown_connections 2023-03-03T06:24:01.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.810+0000 7f770b7fe700 1 --2- 172.21.15.5:0/17736498 >> v2:172.21.15.5:3300/0 conn(0x7f770c0afd10 0x7f770c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.810+0000 7fd911619700 1 -- 172.21.15.5:0/2066830470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90c06e060 con 0x7fd90c0ce380 2023-03-03T06:24:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7fc0de7fc700 1 -- 172.21.15.5:0/3946544905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e000adb0 con 0x7fc0e80c2160 2023-03-03T06:24:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7fc0de7fc700 1 -- 172.21.15.5:0/3946544905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e00070d0 con 0x7fc0e80c2160 2023-03-03T06:24:01.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7fc0de7fc700 1 -- 172.21.15.5:0/3946544905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0007480 con 0x7fc0e80c2160 2023-03-03T06:24:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7fc0eff2a700 1 -- 172.21.15.5:0/3946544905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e806b9c0 con 0x7fc0e80c2160 2023-03-03T06:24:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7fc0eff2a700 1 -- 172.21.15.5:0/3946544905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e806b6e0 con 0x7fc0e80c2160 2023-03-03T06:24:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.810+0000 7fa177be9700 1 Processor -- start 2023-03-03T06:24:01.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.810+0000 7f7709ffb700 1 -- 172.21.15.5:0/17736498 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655540197 0 0) 0x7f770c0aca80 con 0x7f770c15a800 2023-03-03T06:24:01.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.810+0000 7f7709ffb700 1 -- 172.21.15.5:0/17736498 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76f40035b0 con 0x7f770c15a800 2023-03-03T06:24:01.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.810+0000 7f770b7fe700 1 -- 172.21.15.5:0/17736498 >> v1:172.21.15.191:6789/0 conn(0x7f770c15a800 legacy=0x7f770c06abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.810+0000 7f770b7fe700 1 -- 172.21.15.5:0/17736498 >> v1:172.21.15.5:6789/0 conn(0x7f770c06b2d0 legacy=0x7f770c0af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.810+0000 7f770b7fe700 1 -- 172.21.15.5:0/17736498 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c0ad040 con 0x7f770c0afd10 2023-03-03T06:24:01.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.810+0000 7fa177be9700 1 -- start start 2023-03-03T06:24:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.810+0000 7f770b7fe700 1 --2- 172.21.15.5:0/17736498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f770c0afd10 0x7f770c0cb0b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7704009d90 tx=0x7f770400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76845404f9409a42 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7fe114484700 1 -- 172.21.15.5:0/1127115250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0f8003a70 msgr2=0x7fe0f8003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7fe114484700 1 --2- 172.21.15.5:0/1127115250 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe0f8003a70 0x7fe0f8003e80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0b2070 tx=0x7fe0f8005880 comp rx=0 tx=0).stop 2023-03-03T06:24:01.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.810+0000 7fe112a21700 1 -- 172.21.15.5:0/1127115250 reap_dead start 2023-03-03T06:24:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.810+0000 7fe114484700 1 -- 172.21.15.5:0/1127115250 shutdown_connections 2023-03-03T06:24:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.810+0000 7fe114484700 1 -- 172.21.15.5:0/1127115250 >> 172.21.15.5:0/1127115250 conn(0x7fe10c0b1c60 msgr2=0x7fe10c0cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.811+0000 7fe114484700 1 -- 172.21.15.5:0/1127115250 shutdown_connections 2023-03-03T06:24:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.811+0000 7fe114484700 1 -- 172.21.15.5:0/1127115250 wait complete. 2023-03-03T06:24:01.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.809+0000 7f02053bc700 1 -- 172.21.15.5:0/3701237210 wait complete. 2023-03-03T06:24:01.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.811+0000 7f02053bc700 1 Processor -- start 2023-03-03T06:24:01.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.811+0000 7f02053bc700 1 -- start start 2023-03-03T06:24:01.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.811+0000 7fc0eff2a700 1 -- 172.21.15.5:0/3946544905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e80ca4f0 con 0x7fc0e80c2160 2023-03-03T06:24:01.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.811+0000 7f0f40c89700 1 Processor -- start 2023-03-03T06:24:01.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7f0f40c89700 1 -- start start 2023-03-03T06:24:01.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.811+0000 7fa177be9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1700cab30 0x7fa17006aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.811+0000 7fa177be9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17015f060 con 0x7fa170155010 2023-03-03T06:24:01.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.811+0000 7fa177be9700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17015e450 con 0x7fa17006dc70 2023-03-03T06:24:01.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.811+0000 7fa177be9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17015e730 con 0x7fa1700cab30 2023-03-03T06:24:01.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7f7ee8df0700 1 Processor -- start 2023-03-03T06:24:01.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7fe114484700 1 Processor -- start 2023-03-03T06:24:01.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7fa175184700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fa17006dc70 0x7fa17006a330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:46100/0 (socket says 172.21.15.5:46100) 2023-03-03T06:24:01.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7fa175184700 1 -- 172.21.15.5:0/4167467500 learned_addr learned my addr 172.21.15.5:0/4167467500 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:01.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7f02053bc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020006a330 0x7f0200159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7f02053bc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02000ca050 0x7f0200151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7f02053bc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02000ce220 0x7f0200151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7f02053bc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0200200100 con 0x7f020006a330 2023-03-03T06:24:01.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7f02053bc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02001ff280 con 0x7f02000ce220 2023-03-03T06:24:01.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7f02053bc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0200151bc0 con 0x7f02000ca050 2023-03-03T06:24:01.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7f01ff7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02000ce220 0x7f0200151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7f01ff7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02000ce220 0x7f0200151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42096/0 (socket says 172.21.15.5:42096) 2023-03-03T06:24:01.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7f01ff7fe700 1 -- 172.21.15.5:0/2680523511 learned_addr learned my addr 172.21.15.5:0/2680523511 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f01ff7fe700 1 -- 172.21.15.5:0/2680523511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02000ca050 msgr2=0x7f0200151140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-03-03T06:24:01.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f01ff7fe700 1 --2- 172.21.15.5:0/2680523511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02000ca050 0x7f0200151140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f01ff7fe700 1 -- 172.21.15.5:0/2680523511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020006a330 msgr2=0x7f0200159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f01ff7fe700 1 --2- 172.21.15.5:0/2680523511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020006a330 0x7f0200159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f01ff7fe700 1 -- 172.21.15.5:0/2680523511 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f8009550 con 0x7f02000ce220 2023-03-03T06:24:01.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f0f40c89700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0f3c156f40 0x7f0f3c06d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f0f40c89700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0f3c160d60 0x7f0f3c15cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f0f40c89700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c1611a0 con 0x7f0f3c06d5d0 2023-03-03T06:24:01.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f0f40c89700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c06da70 con 0x7f0f3c160d60 2023-03-03T06:24:01.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f0f40c89700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c161410 con 0x7f0f3c156f40 2023-03-03T06:24:01.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7fa176186700 1 --2- 172.21.15.5:0/4167467500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1700cab30 0x7fa17006aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7f7ee8df0700 1 -- start start 2023-03-03T06:24:01.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f7ee8df0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ee4164100 0x7f7ee40cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f7ee8df0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ee40ca770 0x7f7ee41651a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f7ee8df0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee40cd590 con 0x7f7ee4070d00 2023-03-03T06:24:01.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f7ee8df0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee4164d80 con 0x7f7ee40ca770 2023-03-03T06:24:01.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f7ee8df0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40ccd50 con 0x7f7ee4164100 2023-03-03T06:24:01.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f7ee259c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ee4164100 0x7f7ee40cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f7ee259c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ee4164100 0x7f7ee40cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39822/0 (socket says 172.21.15.5:39822) 2023-03-03T06:24:01.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.813+0000 7f7ee259c700 1 -- 172.21.15.5:0/519191525 learned_addr learned my addr 172.21.15.5:0/519191525 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7fc0de7fc700 1 -- 172.21.15.5:0/3946544905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc0e001a030 con 0x7fc0e80c2160 2023-03-03T06:24:01.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f01ff7fe700 1 --2- 172.21.15.5:0/2680523511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02000ce220 0x7f0200151680 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f01f000c7a0 tx=0x7f01f000cb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f0f3a59c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0f3c156f40 0x7f0f3c06d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f0f3a59c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0f3c156f40 0x7f0f3c06d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42098/0 (socket says 172.21.15.5:42098) 2023-03-03T06:24:01.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f0f3a59c700 1 -- 172.21.15.5:0/71883202 learned_addr learned my addr 172.21.15.5:0/71883202 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f01e77fe700 1 -- 172.21.15.5:0/2680523511 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0003e10 con 0x7f02000ce220 2023-03-03T06:24:01.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7fa176186700 1 -- 172.21.15.5:0/4167467500 >> v1:172.21.15.191:6789/0 conn(0x7fa17006dc70 legacy=0x7fa17006a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7fa176186700 1 -- 172.21.15.5:0/4167467500 >> v1:172.21.15.5:6789/0 conn(0x7fa170155010 legacy=0x7fa17006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f01e77fe700 1 -- 172.21.15.5:0/2680523511 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f0005070 con 0x7f02000ce220 2023-03-03T06:24:01.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7fc0de7fc700 1 --2- 172.21.15.5:0/3946544905 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0cc068340 0x7fc0cc06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7fa176186700 1 -- 172.21.15.5:0/4167467500 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17015ea10 con 0x7fa1700cab30 2023-03-03T06:24:01.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f0f3a59c700 1 -- 172.21.15.5:0/71883202 >> v2:172.21.15.5:3300/0 conn(0x7f0f3c160d60 msgr2=0x7f0f3c15cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f0f3ad9d700 1 --2- 172.21.15.5:0/71883202 >> v2:172.21.15.5:3300/0 conn(0x7f0f3c160d60 0x7f0f3c15cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f01e77fe700 1 -- 172.21.15.5:0/2680523511 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0005420 con 0x7f02000ce220 2023-03-03T06:24:01.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f02053bc700 1 -- 172.21.15.5:0/2680523511 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02000cb200 con 0x7f02000ce220 2023-03-03T06:24:01.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f7ee259c700 1 -- 172.21.15.5:0/519191525 >> v2:172.21.15.5:3300/0 conn(0x7f7ee40ca770 msgr2=0x7f7ee41651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f7ee259c700 1 --2- 172.21.15.5:0/519191525 >> v2:172.21.15.5:3300/0 conn(0x7f7ee40ca770 0x7f7ee41651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f7ee259c700 1 -- 172.21.15.5:0/519191525 >> v1:172.21.15.5:6789/0 conn(0x7f7ee4070d00 legacy=0x7f7ee40c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:01.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f7ee259c700 1 -- 172.21.15.5:0/519191525 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee40ccfd0 con 0x7f7ee4164100 2023-03-03T06:24:01.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f7ee259c700 1 --2- 172.21.15.5:0/519191525 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ee4164100 0x7f7ee40cc810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009e50 tx=0x7f7ed400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94f5e37ee280240d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.853 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7fc0ed4c5700 1 --2- 172.21.15.5:0/3946544905 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0cc068340 0x7fc0cc06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.812+0000 7fe114484700 1 -- start start 2023-03-03T06:24:01.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7fe114484700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10c0c5b60 0x7fe10c15ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7fe114484700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe10c0cdad0 0x7fe10c1496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7fe114484700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe10c149c20 0x7fe10c0afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7fe114484700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c14a0a0 con 0x7fe10c0c5b60 2023-03-03T06:24:01.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7fe114484700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c15b5b0 con 0x7fe10c0cdad0 2023-03-03T06:24:01.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7fe114484700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c15b890 con 0x7fe10c149c20 2023-03-03T06:24:01.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fa176186700 1 --2- 172.21.15.5:0/4167467500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1700cab30 0x7fa17006aa40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa160009870 tx=0x7fa160009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cf5db1cce32e565 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7f0f3a59c700 1 --2- 172.21.15.5:0/71883202 >> v2:172.21.15.5:3300/0 conn(0x7f0f3c160d60 0x7f0f3c15cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7f0f3a59c700 1 -- 172.21.15.5:0/71883202 >> v1:172.21.15.191:6789/0 conn(0x7f0f3c06d5d0 legacy=0x7f0f3c160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7f0f3a59c700 1 -- 172.21.15.5:0/71883202 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c06a330 con 0x7f0f3c156f40 2023-03-03T06:24:01.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7f7ee1d9b700 1 -- 172.21.15.5:0/519191525 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400e070 con 0x7f7ee4164100 2023-03-03T06:24:01.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7f7ee1d9b700 1 -- 172.21.15.5:0/519191525 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed4003a20 con 0x7f7ee4164100 2023-03-03T06:24:01.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7f7ee1d9b700 1 -- 172.21.15.5:0/519191525 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4003db0 con 0x7f7ee4164100 2023-03-03T06:24:01.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7f0f3ad9d700 1 --2- 172.21.15.5:0/71883202 >> v2:172.21.15.5:3300/0 conn(0x7f0f3c160d60 0x7f0f3c15cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:01.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fe112220700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10c0c5b60 0x7fe10c15ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fe112a21700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe10c149c20 0x7fe10c0afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fe112220700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10c0c5b60 0x7fe10c15ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41754/0 (socket says 172.21.15.5:41754) 2023-03-03T06:24:01.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fe112220700 1 -- 172.21.15.5:0/1384031431 learned_addr learned my addr 172.21.15.5:0/1384031431 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fd8f37fe700 1 -- 172.21.15.5:0/2066830470 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd8fc014070 con 0x7fd90c0ce380 2023-03-03T06:24:01.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.814+0000 7f02053bc700 1 -- 172.21.15.5:0/2680523511 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02000caf20 con 0x7f02000ce220 2023-03-03T06:24:01.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fe111a1f700 1 --2- 172.21.15.5:0/1384031431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe10c0cdad0 0x7fe10c1496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fc0ed4c5700 1 --2- 172.21.15.5:0/3946544905 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0cc068340 0x7fc0cc06a7f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80c2130 tx=0x7fc0d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fd8f37fe700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd8f80682f0 0x7fd8f806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fe112220700 1 -- 172.21.15.5:0/1384031431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe10c149c20 msgr2=0x7fe10c0afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fe112220700 1 --2- 172.21.15.5:0/1384031431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe10c149c20 0x7fe10c0afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fe112220700 1 -- 172.21.15.5:0/1384031431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe10c0cdad0 msgr2=0x7fe10c1496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fe112220700 1 --2- 172.21.15.5:0/1384031431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe10c0cdad0 0x7fe10c1496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fe112220700 1 -- 172.21.15.5:0/1384031431 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c0cb200 con 0x7fe10c0c5b60 2023-03-03T06:24:01.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.816+0000 7fe112220700 1 --2- 172.21.15.5:0/1384031431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10c0c5b60 0x7fe10c15ac60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009db0 tx=0x7fe0fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.816+0000 7f7ee8df0700 1 -- 172.21.15.5:0/519191525 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ee4164100 msgr2=0x7f7ee40cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.816+0000 7f7ee8df0700 1 --2- 172.21.15.5:0/519191525 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ee4164100 0x7f7ee40cc810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009e50 tx=0x7f7ed400b330 comp rx=0 tx=0).stop 2023-03-03T06:24:01.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fa174983700 1 -- 172.21.15.5:0/4167467500 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160004230 con 0x7fa1700cab30 2023-03-03T06:24:01.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fa174983700 1 -- 172.21.15.5:0/4167467500 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa160004390 con 0x7fa1700cab30 2023-03-03T06:24:01.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.815+0000 7fa174983700 1 -- 172.21.15.5:0/4167467500 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1600036a0 con 0x7fa1700cab30 2023-03-03T06:24:01.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.816+0000 7fd8f37fe700 1 -- 172.21.15.5:0/2066830470 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd8fc0868d0 con 0x7fd90c0ce380 2023-03-03T06:24:01.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.816+0000 7f0f3a59c700 1 --2- 172.21.15.5:0/71883202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f3c156f40 0x7f0f3c06d090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0ccb90 tx=0x7f0f2c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ee8d97196969f80 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.816+0000 7fa177be9700 1 -- 172.21.15.5:0/4167467500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1700cab30 msgr2=0x7fa17006aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.816+0000 7fa177be9700 1 --2- 172.21.15.5:0/4167467500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1700cab30 0x7fa17006aa40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa160009870 tx=0x7fa160009b80 comp rx=0 tx=0).stop 2023-03-03T06:24:01.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.816+0000 7fa177be9700 1 -- 172.21.15.5:0/4167467500 shutdown_connections 2023-03-03T06:24:01.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.816+0000 7fa177be9700 1 --2- 172.21.15.5:0/4167467500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1700cab30 0x7fa17006aa40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.816+0000 7fa177be9700 1 -- 172.21.15.5:0/4167467500 >> 172.21.15.5:0/4167467500 conn(0x7fa1700cf4d0 msgr2=0x7fa1700cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.816+0000 7fd90affd700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd8f80682f0 0x7fd8f806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.816+0000 7fa177be9700 1 -- 172.21.15.5:0/4167467500 shutdown_connections 2023-03-03T06:24:01.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.816+0000 7fa177be9700 1 -- 172.21.15.5:0/4167467500 wait complete. 2023-03-03T06:24:01.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.817+0000 7fd90affd700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd8f80682f0 0x7fd8f806a7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd90400a7f0 tx=0x7fd90400d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.817+0000 7f01e77fe700 1 -- 172.21.15.5:0/2680523511 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f01f0010070 con 0x7f02000ce220 2023-03-03T06:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.817+0000 7f7ee8df0700 1 -- 172.21.15.5:0/519191525 shutdown_connections 2023-03-03T06:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.817+0000 7f7ee8df0700 1 --2- 172.21.15.5:0/519191525 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ee4164100 0x7f7ee40cc810 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.817+0000 7f7ee8df0700 1 --2- 172.21.15.5:0/519191525 >> v2:172.21.15.5:3300/0 conn(0x7f7ee40ca770 0x7f7ee41651a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.817+0000 7f7ee8df0700 1 -- 172.21.15.5:0/519191525 >> 172.21.15.5:0/519191525 conn(0x7f7ee40cec40 msgr2=0x7f7ee40cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.817+0000 7f02053bc700 1 -- 172.21.15.5:0/2680523511 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020006a7b0 con 0x7f02000ce220 2023-03-03T06:24:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.817+0000 7f0f39d9b700 1 -- 172.21.15.5:0/71883202 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00b870 con 0x7f0f3c156f40 2023-03-03T06:24:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.817+0000 7f0f39d9b700 1 -- 172.21.15.5:0/71883202 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c00b9d0 con 0x7f0f3c156f40 2023-03-03T06:24:01.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.817+0000 7f0f39d9b700 1 -- 172.21.15.5:0/71883202 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00bd60 con 0x7f0f3c156f40 2023-03-03T06:24:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.817+0000 7f01e77fe700 1 --2- 172.21.15.5:0/2680523511 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01ec0682f0 0x7f01ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.817+0000 7f01e77fe700 1 -- 172.21.15.5:0/2680523511 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f01f00851b0 con 0x7f02000ce220 2023-03-03T06:24:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.817+0000 7f01feffd700 1 --2- 172.21.15.5:0/2680523511 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01ec0682f0 0x7f01ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.818+0000 7f01feffd700 1 --2- 172.21.15.5:0/2680523511 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01ec0682f0 0x7f01ec06a7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009c40 tx=0x7f01f8010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.818+0000 7f0f40c89700 1 -- 172.21.15.5:0/71883202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f3c156f40 msgr2=0x7f0f3c06d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.818+0000 7f0f40c89700 1 --2- 172.21.15.5:0/71883202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f3c156f40 0x7f0f3c06d090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0ccb90 tx=0x7f0f2c009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.818+0000 7fa177be9700 1 Processor -- start 2023-03-03T06:24:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.818+0000 7f7ee8df0700 1 -- 172.21.15.5:0/519191525 shutdown_connections 2023-03-03T06:24:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.818+0000 7f0f40c89700 1 -- 172.21.15.5:0/71883202 shutdown_connections 2023-03-03T06:24:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.818+0000 7f0f40c89700 1 --2- 172.21.15.5:0/71883202 >> v2:172.21.15.5:3300/0 conn(0x7f0f3c160d60 0x7f0f3c15cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.818+0000 7f0f40c89700 1 --2- 172.21.15.5:0/71883202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f3c156f40 0x7f0f3c06d090 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.818+0000 7f7ee8df0700 1 -- 172.21.15.5:0/519191525 wait complete. 2023-03-03T06:24:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.818+0000 7f0f40c89700 1 -- 172.21.15.5:0/71883202 >> 172.21.15.5:0/71883202 conn(0x7f0f3c0cf0a0 msgr2=0x7f0f3c0cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.818+0000 7f0f40c89700 1 -- 172.21.15.5:0/71883202 shutdown_connections 2023-03-03T06:24:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.818+0000 7fa177be9700 1 -- start start 2023-03-03T06:24:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.818+0000 7f0f40c89700 1 -- 172.21.15.5:0/71883202 wait complete. 2023-03-03T06:24:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.819+0000 7fd8f37fe700 1 -- 172.21.15.5:0/2066830470 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd8fc052e20 con 0x7fd90c0ce380 2023-03-03T06:24:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.819+0000 7fa177be9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa17006dc70 0x7fa170143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.819+0000 7fa177be9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1700cab30 0x7fa1700b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.819+0000 7fa177be9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa170155010 0x7fa1700b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.819+0000 7fa177be9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa170144390 con 0x7fa170155010 2023-03-03T06:24:01.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7fa177be9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17006b1b0 con 0x7fa17006dc70 2023-03-03T06:24:01.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7fa177be9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1700b3ee0 con 0x7fa1700cab30 2023-03-03T06:24:01.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7fa175985700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa17006dc70 0x7fa170143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7fa175184700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1700cab30 0x7fa1700b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7fa175985700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa17006dc70 0x7fa170143e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42122/0 (socket says 172.21.15.5:42122) 2023-03-03T06:24:01.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7fa175985700 1 -- 172.21.15.5:0/1590748094 learned_addr learned my addr 172.21.15.5:0/1590748094 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7f0f40c89700 1 Processor -- start 2023-03-03T06:24:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.819+0000 7f7709ffb700 1 -- 172.21.15.5:0/17736498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770400e070 con 0x7f770c0afd10 2023-03-03T06:24:01.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7f0f40c89700 1 -- start start 2023-03-03T06:24:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7fa175184700 1 -- 172.21.15.5:0/1590748094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa17006dc70 msgr2=0x7fa170143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7fa175184700 1 --2- 172.21.15.5:0/1590748094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa17006dc70 0x7fa170143e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7fa175184700 1 -- 172.21.15.5:0/1590748094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa170155010 msgr2=0x7fa1700b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7fa175184700 1 --2- 172.21.15.5:0/1590748094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa170155010 0x7fa1700b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7fa175184700 1 -- 172.21.15.5:0/1590748094 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1600094a0 con 0x7fa1700cab30 2023-03-03T06:24:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7f7ee8df0700 1 Processor -- start 2023-03-03T06:24:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.820+0000 7f7ee8df0700 1 -- start start 2023-03-03T06:24:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7fa175184700 1 --2- 172.21.15.5:0/1590748094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1700cab30 0x7fa1700b2300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00c430 tx=0x7fa16c00c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7fc0de7fc700 1 -- 172.21.15.5:0/3946544905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc0e005e570 con 0x7fc0e80c2160 2023-03-03T06:24:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7fa1667fc700 1 -- 172.21.15.5:0/1590748094 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c005d70 con 0x7fa1700cab30 2023-03-03T06:24:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7fa1667fc700 1 -- 172.21.15.5:0/1590748094 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16c0070d0 con 0x7fa1700cab30 2023-03-03T06:24:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7fa1667fc700 1 -- 172.21.15.5:0/1590748094 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c007480 con 0x7fa1700cab30 2023-03-03T06:24:01.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7fe102ffd700 1 -- 172.21.15.5:0/1384031431 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc01a830 con 0x7fe10c0c5b60 2023-03-03T06:24:01.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7fe114484700 1 -- 172.21.15.5:0/1384031431 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10c0caf20 con 0x7fe10c0c5b60 2023-03-03T06:24:01.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7fe114484700 1 -- 172.21.15.5:0/1384031431 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10c06ddb0 con 0x7fe10c0c5b60 2023-03-03T06:24:01.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7f0f40c89700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f3c06d5d0 0x7f0f3c15a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7f0f40c89700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c156f40 0x7f0f3c0c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7f0f40c89700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f3c160d60 0x7f0f3c15ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7f0f40c89700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c15bc90 con 0x7f0f3c156f40 2023-03-03T06:24:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7f0f40c89700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c15b010 con 0x7f0f3c160d60 2023-03-03T06:24:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.821+0000 7f0f40c89700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c15b2f0 con 0x7f0f3c06d5d0 2023-03-03T06:24:01.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7fa177be9700 1 -- 172.21.15.5:0/1590748094 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa170165740 con 0x7fa1700cab30 2023-03-03T06:24:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f7ee8df0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ee4070d00 0x7f7ee40c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f7ee8df0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee40ca770 0x7f7ee40c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f7ee8df0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ee4164100 0x7f7ee40b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f7ee8df0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4150850 con 0x7f7ee40ca770 2023-03-03T06:24:01.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f7ee8df0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40c3840 con 0x7f7ee4164100 2023-03-03T06:24:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f7ee8df0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee40c2fa0 con 0x7f7ee4070d00 2023-03-03T06:24:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f0f3a59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f3c06d5d0 0x7f0f3c15a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f0f3a59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f3c06d5d0 0x7f0f3c15a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39846/0 (socket says 172.21.15.5:39846) 2023-03-03T06:24:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f0f3a59c700 1 -- 172.21.15.5:0/2592383762 learned_addr learned my addr 172.21.15.5:0/2592383762 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7fa177be9700 1 -- 172.21.15.5:0/1590748094 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17015ecf0 con 0x7fa1700cab30 2023-03-03T06:24:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f0f3ad9d700 1 --2- 172.21.15.5:0/2592383762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f3c160d60 0x7f0f3c15ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f0f3a59c700 1 -- 172.21.15.5:0/2592383762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f3c160d60 msgr2=0x7f0f3c15ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f0f3a59c700 1 --2- 172.21.15.5:0/2592383762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f3c160d60 0x7f0f3c15ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f0f3a59c700 1 -- 172.21.15.5:0/2592383762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c156f40 msgr2=0x7f0f3c0c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f0f3a59c700 1 --2- 172.21.15.5:0/2592383762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c156f40 0x7f0f3c0c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.822+0000 7f0f3a59c700 1 -- 172.21.15.5:0/2592383762 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2c009550 con 0x7f0f3c06d5d0 2023-03-03T06:24:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f0f3a59c700 1 --2- 172.21.15.5:0/2592383762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f3c06d5d0 0x7f0f3c15a9e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c161550 tx=0x7f0f2c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f7ed9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee40ca770 0x7f7ee40c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f7ed9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee40ca770 0x7f7ee40c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41772/0 (socket says 172.21.15.5:41772) 2023-03-03T06:24:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f7ed9d9b700 1 -- 172.21.15.5:0/4235916716 learned_addr learned my addr 172.21.15.5:0/4235916716 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f7ee2d9d700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ee4164100 0x7f7ee40b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f7ee259c700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ee4070d00 0x7f7ee40c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f0f32ffd700 1 -- 172.21.15.5:0/2592383762 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c004220 con 0x7f0f3c06d5d0 2023-03-03T06:24:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f0f32ffd700 1 -- 172.21.15.5:0/2592383762 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c004380 con 0x7f0f3c06d5d0 2023-03-03T06:24:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f0f32ffd700 1 -- 172.21.15.5:0/2592383762 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0036a0 con 0x7f0f3c06d5d0 2023-03-03T06:24:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f0f40c89700 1 -- 172.21.15.5:0/2592383762 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c06a8f0 con 0x7f0f3c06d5d0 2023-03-03T06:24:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f0f40c89700 1 -- 172.21.15.5:0/2592383762 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c06a610 con 0x7f0f3c06d5d0 2023-03-03T06:24:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7fe114484700 1 -- 172.21.15.5:0/1384031431 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10c04e6e0 con 0x7fe10c0c5b60 2023-03-03T06:24:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f01e77fe700 1 -- 172.21.15.5:0/2680523511 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f01f0051720 con 0x7f02000ce220 2023-03-03T06:24:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f7ed9d9b700 1 -- 172.21.15.5:0/4235916716 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ee4070d00 msgr2=0x7f7ee40c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f7ed9d9b700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ee4070d00 0x7f7ee40c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f7ed9d9b700 1 -- 172.21.15.5:0/4235916716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ee4164100 msgr2=0x7f7ee40b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f7ed9d9b700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ee4164100 0x7f7ee40b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.823+0000 7f7ed9d9b700 1 -- 172.21.15.5:0/4235916716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4009b30 con 0x7f7ee40ca770 2023-03-03T06:24:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.824+0000 7f7ed9d9b700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee40ca770 0x7f7ee40c2750 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00b560 tx=0x7f7ecc00b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.824+0000 7fa177be9700 1 -- 172.21.15.5:0/1590748094 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1701658d0 con 0x7fa1700cab30 2023-03-03T06:24:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.824+0000 7fa1667fc700 1 -- 172.21.15.5:0/1590748094 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa16c019030 con 0x7fa1700cab30 2023-03-03T06:24:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.824+0000 7fa1667fc700 1 --2- 172.21.15.5:0/1590748094 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa154068340 0x7fa15406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.825+0000 7fa1667fc700 1 -- 172.21.15.5:0/1590748094 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa16c085260 con 0x7fa1700cab30 2023-03-03T06:24:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.825+0000 7f0f40c89700 1 -- 172.21.15.5:0/2592383762 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c06abd0 con 0x7f0f3c06d5d0 2023-03-03T06:24:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.825+0000 7fa175985700 1 --2- 172.21.15.5:0/1590748094 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa154068340 0x7fa15406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.825+0000 7fa175985700 1 --2- 172.21.15.5:0/1590748094 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa154068340 0x7fa15406a7f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa16800f370 tx=0x7fa168009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.826+0000 7f0f32ffd700 1 -- 172.21.15.5:0/2592383762 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0f2c00f050 con 0x7f0f3c06d5d0 2023-03-03T06:24:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.826+0000 7f0f32ffd700 1 --2- 172.21.15.5:0/2592383762 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0f1c068340 0x7f0f1c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.826+0000 7f0f33fff700 1 --2- 172.21.15.5:0/2592383762 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0f1c068340 0x7f0f1c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.826+0000 7f0f32ffd700 1 -- 172.21.15.5:0/2592383762 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f2c087730 con 0x7f0f3c06d5d0 2023-03-03T06:24:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.826+0000 7f0f33fff700 1 --2- 172.21.15.5:0/2592383762 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0f1c068340 0x7f0f1c06a7f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f24000f60 tx=0x7f0f24007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.827+0000 7f7709ffb700 1 -- 172.21.15.5:0/17736498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770400bb20 con 0x7f770c0afd10 2023-03-03T06:24:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.827+0000 7f7709ffb700 1 -- 172.21.15.5:0/17736498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770400be90 con 0x7f770c0afd10 2023-03-03T06:24:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.828+0000 7fc0de7fc700 1 -- 172.21.15.5:0/3946544905 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc0e0052820 con 0x7fc0e80c2160 2023-03-03T06:24:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.828+0000 7fe102ffd700 1 -- 172.21.15.5:0/1384031431 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc009260 con 0x7fe10c0c5b60 2023-03-03T06:24:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.828+0000 7fe102ffd700 1 -- 172.21.15.5:0/1384031431 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc01ab90 con 0x7fe10c0c5b60 2023-03-03T06:24:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.828+0000 7f771197d700 1 -- 172.21.15.5:0/17736498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f770c0afd10 msgr2=0x7f770c0cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.828+0000 7f771197d700 1 --2- 172.21.15.5:0/17736498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f770c0afd10 0x7f770c0cb0b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7704009d90 tx=0x7f770400b330 comp rx=0 tx=0).stop 2023-03-03T06:24:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.828+0000 7f7edb7fe700 1 -- 172.21.15.5:0/4235916716 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc011830 con 0x7f7ee40ca770 2023-03-03T06:24:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.828+0000 7f7edb7fe700 1 -- 172.21.15.5:0/4235916716 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc011990 con 0x7f7ee40ca770 2023-03-03T06:24:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.828+0000 7f7ee8df0700 1 -- 172.21.15.5:0/4235916716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee41649a0 con 0x7f7ee40ca770 2023-03-03T06:24:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.829+0000 7f7ee8df0700 1 -- 172.21.15.5:0/4235916716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee40cd2b0 con 0x7f7ee40ca770 2023-03-03T06:24:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.829+0000 7f7edb7fe700 1 -- 172.21.15.5:0/4235916716 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc011d20 con 0x7f7ee40ca770 2023-03-03T06:24:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.829+0000 7f771197d700 1 -- 172.21.15.5:0/17736498 shutdown_connections 2023-03-03T06:24:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.829+0000 7f771197d700 1 --2- 172.21.15.5:0/17736498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f770c0afd10 0x7f770c0cb0b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.829+0000 7f771197d700 1 -- 172.21.15.5:0/17736498 >> 172.21.15.5:0/17736498 conn(0x7f770c098a50 msgr2=0x7f770c098e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.829+0000 7f771197d700 1 -- 172.21.15.5:0/17736498 shutdown_connections 2023-03-03T06:24:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.829+0000 7fe102ffd700 1 -- 172.21.15.5:0/1384031431 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe0fc023070 con 0x7fe10c0c5b60 2023-03-03T06:24:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.830+0000 7fa1667fc700 1 -- 172.21.15.5:0/1590748094 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa16c051760 con 0x7fa1700cab30 2023-03-03T06:24:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.830+0000 7fe102ffd700 1 --2- 172.21.15.5:0/1384031431 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe0f00682f0 0x7fe0f006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.830+0000 7fe102ffd700 1 -- 172.21.15.5:0/1384031431 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe0fc087190 con 0x7fe10c0c5b60 2023-03-03T06:24:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.830+0000 7f7ee8df0700 1 -- 172.21.15.5:0/4235916716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec80052e0 con 0x7f7ee40ca770 2023-03-03T06:24:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.831+0000 7fe111a1f700 1 --2- 172.21.15.5:0/1384031431 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe0f00682f0 0x7fe0f006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.831+0000 7fe111a1f700 1 --2- 172.21.15.5:0/1384031431 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe0f00682f0 0x7fe0f006a7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe108009890 tx=0x7fe108008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.834+0000 7f0f32ffd700 1 -- 172.21.15.5:0/2592383762 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0f2c053d40 con 0x7f0f3c06d5d0 2023-03-03T06:24:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.837+0000 7f771197d700 1 -- 172.21.15.5:0/17736498 wait complete. 2023-03-03T06:24:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.839+0000 7f771197d700 1 Processor -- start 2023-03-03T06:24:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.839+0000 7f771197d700 1 -- start start 2023-03-03T06:24:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.840+0000 7f771197d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f770c06b2d0 0x7f770c157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.840+0000 7f771197d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770c0afd10 0x7f770c0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.840+0000 7f771197d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f770c15a800 0x7f770c06a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.840+0000 7f771197d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c157160 con 0x7f770c15a800 2023-03-03T06:24:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.840+0000 7f771197d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c1576e0 con 0x7f770c0afd10 2023-03-03T06:24:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.840+0000 7f771197d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0ccf90 con 0x7f770c06b2d0 2023-03-03T06:24:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.841+0000 7f770a7fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770c0afd10 0x7f770c0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.841+0000 7f770a7fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770c0afd10 0x7f770c0cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42148/0 (socket says 172.21.15.5:42148) 2023-03-03T06:24:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.841+0000 7f770a7fc700 1 -- 172.21.15.5:0/3666671687 learned_addr learned my addr 172.21.15.5:0/3666671687 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:01.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.841+0000 7f770b7fe700 1 --2- 172.21.15.5:0/3666671687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f770c15a800 0x7f770c06a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.841+0000 7f770a7fc700 1 -- 172.21.15.5:0/3666671687 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f770c06b2d0 msgr2=0x7f770c157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.841+0000 7f770a7fc700 1 --2- 172.21.15.5:0/3666671687 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f770c06b2d0 0x7f770c157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.841+0000 7f770a7fc700 1 -- 172.21.15.5:0/3666671687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f770c15a800 msgr2=0x7f770c06a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:01.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.841+0000 7f770a7fc700 1 --2- 172.21.15.5:0/3666671687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f770c15a800 0x7f770c06a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:01.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.841+0000 7f770a7fc700 1 -- 172.21.15.5:0/3666671687 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7704009a70 con 0x7f770c0afd10 2023-03-03T06:24:01.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.841+0000 7f770a7fc700 1 --2- 172.21.15.5:0/3666671687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770c0afd10 0x7f770c0cc640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f770000c500 tx=0x7f770000c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.841+0000 7fe102ffd700 1 -- 172.21.15.5:0/1384031431 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe0fc053690 con 0x7fe10c0c5b60 2023-03-03T06:24:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.842+0000 7f76f3fff700 1 -- 172.21.15.5:0/3666671687 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7700005d70 con 0x7f770c0afd10 2023-03-03T06:24:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.842+0000 7f76f3fff700 1 -- 172.21.15.5:0/3666671687 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77000070d0 con 0x7f770c0afd10 2023-03-03T06:24:01.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.842+0000 7f76f3fff700 1 -- 172.21.15.5:0/3666671687 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7700007460 con 0x7f770c0afd10 2023-03-03T06:24:01.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.842+0000 7f771197d700 1 -- 172.21.15.5:0/3666671687 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770c0ad600 con 0x7f770c0afd10 2023-03-03T06:24:01.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.842+0000 7f771197d700 1 -- 172.21.15.5:0/3666671687 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c0ad320 con 0x7f770c0afd10 2023-03-03T06:24:01.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.845+0000 7f7edb7fe700 1 -- 172.21.15.5:0/4235916716 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7ecc021070 con 0x7f7ee40ca770 2023-03-03T06:24:01.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.846+0000 7f7edb7fe700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ec40682f0 0x7f7ec406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.846+0000 7f7edb7fe700 1 -- 172.21.15.5:0/4235916716 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ecc086510 con 0x7f7ee40ca770 2023-03-03T06:24:01.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.846+0000 7f7ee259c700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ec40682f0 0x7f7ec406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.847+0000 7f7edb7fe700 1 -- 172.21.15.5:0/4235916716 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7ecc0529b0 con 0x7f7ee40ca770 2023-03-03T06:24:01.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.847+0000 7f7ee259c700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ec40682f0 0x7f7ec406a7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4000f80 tx=0x7f7ed4009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.845+0000 7f76f3fff700 1 -- 172.21.15.5:0/3666671687 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7700019030 con 0x7f770c0afd10 2023-03-03T06:24:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.846+0000 7f76f3fff700 1 --2- 172.21.15.5:0/3666671687 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76f8068340 0x7f76f806a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.846+0000 7f76f3fff700 1 -- 172.21.15.5:0/3666671687 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f77000852a0 con 0x7f770c0afd10 2023-03-03T06:24:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.848+0000 7f771197d700 1 -- 172.21.15.5:0/3666671687 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ec0052e0 con 0x7f770c0afd10 2023-03-03T06:24:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.848+0000 7f770affd700 1 --2- 172.21.15.5:0/3666671687 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76f8068340 0x7f76f806a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.849+0000 7f770affd700 1 --2- 172.21.15.5:0/3666671687 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76f8068340 0x7f76f806a7f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f76fc001160 tx=0x7f76fc007a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:01.853+0000 7f76f3fff700 1 -- 172.21.15.5:0/3666671687 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f77000517a0 con 0x7f770c0afd10 2023-03-03T06:24:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.212+0000 7f02053bc700 1 -- 172.21.15.5:0/2680523511 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0200200240 con 0x7f02000ce220 2023-03-03T06:24:02.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.213+0000 7f01e77fe700 1 -- 172.21.15.5:0/2680523511 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01f0017020 con 0x7f02000ce220 2023-03-03T06:24:02.218 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-03-03T06:24:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.216+0000 7f02053bc700 1 -- 172.21.15.5:0/2680523511 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01ec0682f0 msgr2=0x7f01ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.216+0000 7f02053bc700 1 --2- 172.21.15.5:0/2680523511 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01ec0682f0 0x7f01ec06a7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009c40 tx=0x7f01f8010000 comp rx=0 tx=0).stop 2023-03-03T06:24:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.216+0000 7f02053bc700 1 -- 172.21.15.5:0/2680523511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02000ce220 msgr2=0x7f0200151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.216+0000 7f02053bc700 1 --2- 172.21.15.5:0/2680523511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02000ce220 0x7f0200151680 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f01f000c7a0 tx=0x7f01f000cb60 comp rx=0 tx=0).stop 2023-03-03T06:24:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.216+0000 7f02053bc700 1 -- 172.21.15.5:0/2680523511 shutdown_connections 2023-03-03T06:24:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.216+0000 7f02053bc700 1 --2- 172.21.15.5:0/2680523511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02000ce220 0x7f0200151680 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.216+0000 7f02053bc700 1 --2- 172.21.15.5:0/2680523511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020006a330 0x7f0200159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.216+0000 7f02053bc700 1 --2- 172.21.15.5:0/2680523511 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01ec0682f0 0x7f01ec06a7a0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009c40 tx=0x7f01f8010000 comp rx=0 tx=0).stop 2023-03-03T06:24:02.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.216+0000 7f02053bc700 1 --2- 172.21.15.5:0/2680523511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02000ca050 0x7f0200151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.216+0000 7f02053bc700 1 -- 172.21.15.5:0/2680523511 >> 172.21.15.5:0/2680523511 conn(0x7f02000b1c60 msgr2=0x7f02000aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.217+0000 7f02053bc700 1 -- 172.21.15.5:0/2680523511 shutdown_connections 2023-03-03T06:24:02.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.218+0000 7f02053bc700 1 -- 172.21.15.5:0/2680523511 wait complete. 2023-03-03T06:24:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.230+0000 7fa177be9700 1 -- 172.21.15.5:0/1590748094 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa17004e6e0 con 0x7fa1700cab30 2023-03-03T06:24:02.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.230+0000 7fd911619700 1 -- 172.21.15.5:0/2066830470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd90c04e6e0 con 0x7fd90c0ce380 2023-03-03T06:24:02.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.231+0000 7fd8f37fe700 1 -- 172.21.15.5:0/2066830470 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8fc056440 con 0x7fd90c0ce380 2023-03-03T06:24:02.233 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2023-03-03T06:24:02.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.233+0000 7fc0eff2a700 1 -- 172.21.15.5:0/3946544905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc0e80c25b0 con 0x7fc0e80c2160 2023-03-03T06:24:02.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.234+0000 7fd911619700 1 -- 172.21.15.5:0/2066830470 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd8f80682f0 msgr2=0x7fd8f806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.234+0000 7fd911619700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd8f80682f0 0x7fd8f806a7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd90400a7f0 tx=0x7fd90400d040 comp rx=0 tx=0).stop 2023-03-03T06:24:02.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.234+0000 7fd911619700 1 -- 172.21.15.5:0/2066830470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd90c0ce380 msgr2=0x7fd90c0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.234+0000 7fd911619700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd90c0ce380 0x7fd90c0afbe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc018000 tx=0x7fd8fc004750 comp rx=0 tx=0).stop 2023-03-03T06:24:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.234+0000 7fa1667fc700 1 -- 172.21.15.5:0/1590748094 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa16c017020 con 0x7fa1700cab30 2023-03-03T06:24:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.234+0000 7fd911619700 1 -- 172.21.15.5:0/2066830470 shutdown_connections 2023-03-03T06:24:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.234+0000 7fd911619700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd90c0ce380 0x7fd90c0afbe0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.234+0000 7fd911619700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd8f80682f0 0x7fd8f806a7a0 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd90400a7f0 tx=0x7fd90400d040 comp rx=0 tx=0).stop 2023-03-03T06:24:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.234+0000 7fd911619700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90c0c9290 0x7fd90c0c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.234+0000 7fd911619700 1 --2- 172.21.15.5:0/2066830470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd90c0cd7a0 0x7fd90c0af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.234+0000 7fd911619700 1 -- 172.21.15.5:0/2066830470 >> 172.21.15.5:0/2066830470 conn(0x7fd90c0cf890 msgr2=0x7fd90c06acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:02.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.234+0000 7fc0de7fc700 1 -- 172.21.15.5:0/3946544905 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0e80c25b0 con 0x7fc0e80c2160 2023-03-03T06:24:02.238 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-03-03T06:24:02.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-03-03T06:24:02.239 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2023-03-03T06:24:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.237+0000 7fa177be9700 1 -- 172.21.15.5:0/1590748094 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa154068340 msgr2=0x7fa15406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.237+0000 7fa177be9700 1 --2- 172.21.15.5:0/1590748094 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa154068340 0x7fa15406a7f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa16800f370 tx=0x7fa168009040 comp rx=0 tx=0).stop 2023-03-03T06:24:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.237+0000 7fa177be9700 1 -- 172.21.15.5:0/1590748094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1700cab30 msgr2=0x7fa1700b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.237+0000 7fa177be9700 1 --2- 172.21.15.5:0/1590748094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1700cab30 0x7fa1700b2300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00c430 tx=0x7fa16c00c740 comp rx=0 tx=0).stop 2023-03-03T06:24:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.237+0000 7f0f40c89700 1 -- 172.21.15.5:0/2592383762 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0f3c04e6e0 con 0x7f0f3c06d5d0 2023-03-03T06:24:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.238+0000 7f0f32ffd700 1 -- 172.21.15.5:0/2592383762 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f2c015020 con 0x7f0f3c06d5d0 2023-03-03T06:24:02.241 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2023-03-03T06:24:02.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.239+0000 7fd911619700 1 -- 172.21.15.5:0/2066830470 shutdown_connections 2023-03-03T06:24:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.239+0000 7fc0eff2a700 1 -- 172.21.15.5:0/3946544905 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0cc068340 msgr2=0x7fc0cc06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.239+0000 7fc0eff2a700 1 --2- 172.21.15.5:0/3946544905 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0cc068340 0x7fc0cc06a7f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80c2130 tx=0x7fc0d8008040 comp rx=0 tx=0).stop 2023-03-03T06:24:02.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.239+0000 7fc0eff2a700 1 -- 172.21.15.5:0/3946544905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e80c2160 msgr2=0x7fc0e815ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.239+0000 7fc0eff2a700 1 --2- 172.21.15.5:0/3946544905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e80c2160 0x7fc0e815ca10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0002210 tx=0x7fc0e000a340 comp rx=0 tx=0).stop 2023-03-03T06:24:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.239+0000 7fc0eff2a700 1 -- 172.21.15.5:0/3946544905 shutdown_connections 2023-03-03T06:24:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.239+0000 7fc0eff2a700 1 --2- 172.21.15.5:0/3946544905 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0cc068340 0x7fc0cc06a7f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.239+0000 7fc0eff2a700 1 --2- 172.21.15.5:0/3946544905 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc0e8160f30 0x7fc0e80b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.239+0000 7fc0eff2a700 1 --2- 172.21.15.5:0/3946544905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e80c2160 0x7fc0e815ca10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.239+0000 7fc0eff2a700 1 --2- 172.21.15.5:0/3946544905 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0e8160b60 0x7fc0e81464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.239+0000 7fc0eff2a700 1 -- 172.21.15.5:0/3946544905 >> 172.21.15.5:0/3946544905 conn(0x7fc0e80cf890 msgr2=0x7fc0e80cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.239+0000 7fc0eff2a700 1 -- 172.21.15.5:0/3946544905 shutdown_connections 2023-03-03T06:24:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.239+0000 7fc0eff2a700 1 -- 172.21.15.5:0/3946544905 wait complete. 2023-03-03T06:24:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.241+0000 7f0f40c89700 1 -- 172.21.15.5:0/2592383762 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0f1c068340 msgr2=0x7f0f1c06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.241+0000 7f0f40c89700 1 --2- 172.21.15.5:0/2592383762 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0f1c068340 0x7f0f1c06a7f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f24000f60 tx=0x7f0f24007a40 comp rx=0 tx=0).stop 2023-03-03T06:24:02.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.241+0000 7f0f40c89700 1 -- 172.21.15.5:0/2592383762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f3c06d5d0 msgr2=0x7f0f3c15a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.241+0000 7f0f40c89700 1 --2- 172.21.15.5:0/2592383762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f3c06d5d0 0x7f0f3c15a9e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c161550 tx=0x7f0f2c004750 comp rx=0 tx=0).stop 2023-03-03T06:24:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.241+0000 7f7ee8df0700 1 -- 172.21.15.5:0/4235916716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7ec8005860 con 0x7f7ee40ca770 2023-03-03T06:24:02.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.241+0000 7f7edb7fe700 1 -- 172.21.15.5:0/4235916716 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ecc055fd0 con 0x7f7ee40ca770 2023-03-03T06:24:02.245 INFO:teuthology.orchestra.run.smithi005.stdout:55834574855 2023-03-03T06:24:02.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.242+0000 7fd911619700 1 -- 172.21.15.5:0/2066830470 wait complete. 2023-03-03T06:24:02.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.242+0000 7fa177be9700 1 -- 172.21.15.5:0/1590748094 shutdown_connections 2023-03-03T06:24:02.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.242+0000 7fa177be9700 1 --2- 172.21.15.5:0/1590748094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa170155010 0x7fa1700b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.242+0000 7fa177be9700 1 --2- 172.21.15.5:0/1590748094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa17006dc70 0x7fa170143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.242+0000 7fa177be9700 1 --2- 172.21.15.5:0/1590748094 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa154068340 0x7fa15406a7f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.242+0000 7fa177be9700 1 --2- 172.21.15.5:0/1590748094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1700cab30 0x7fa1700b2300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.242+0000 7fa177be9700 1 -- 172.21.15.5:0/1590748094 >> 172.21.15.5:0/1590748094 conn(0x7fa1700cf4d0 msgr2=0x7fa170165cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.242+0000 7fa177be9700 1 -- 172.21.15.5:0/1590748094 shutdown_connections 2023-03-03T06:24:02.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.242+0000 7fa177be9700 1 -- 172.21.15.5:0/1590748094 wait complete. 2023-03-03T06:24:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.244+0000 7fe114484700 1 -- 172.21.15.5:0/1384031431 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe10c0d0260 con 0x7fe10c0c5b60 2023-03-03T06:24:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.244+0000 7f0f40c89700 1 -- 172.21.15.5:0/2592383762 shutdown_connections 2023-03-03T06:24:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.244+0000 7f0f40c89700 1 --2- 172.21.15.5:0/2592383762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0f3c160d60 0x7f0f3c15ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.244+0000 7f0f40c89700 1 --2- 172.21.15.5:0/2592383762 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0f1c068340 0x7f0f1c06a7f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.244+0000 7f0f40c89700 1 --2- 172.21.15.5:0/2592383762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0f3c06d5d0 0x7f0f3c15a9e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.244+0000 7f0f40c89700 1 --2- 172.21.15.5:0/2592383762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f3c156f40 0x7f0f3c0c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.244+0000 7f0f40c89700 1 -- 172.21.15.5:0/2592383762 >> 172.21.15.5:0/2592383762 conn(0x7f0f3c0cf0a0 msgr2=0x7f0f3c0cf470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.244+0000 7f771197d700 1 -- 172.21.15.5:0/3666671687 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f76ec005590 con 0x7f770c0afd10 2023-03-03T06:24:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.244+0000 7f0f40c89700 1 -- 172.21.15.5:0/2592383762 shutdown_connections 2023-03-03T06:24:02.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.244+0000 7f0f40c89700 1 -- 172.21.15.5:0/2592383762 wait complete. 2023-03-03T06:24:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.244+0000 7fe102ffd700 1 -- 172.21.15.5:0/1384031431 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe0fc056cb0 con 0x7fe10c0c5b60 2023-03-03T06:24:02.250 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2023-03-03T06:24:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.244+0000 7f76f3fff700 1 -- 172.21.15.5:0/3666671687 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7700017030 con 0x7f770c0afd10 2023-03-03T06:24:02.251 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2023-03-03T06:24:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.245+0000 7f7ee8df0700 1 -- 172.21.15.5:0/4235916716 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ec40682f0 msgr2=0x7f7ec406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.245+0000 7f7ee8df0700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ec40682f0 0x7f7ec406a7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4000f80 tx=0x7f7ed4009000 comp rx=0 tx=0).stop 2023-03-03T06:24:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.245+0000 7f7ee8df0700 1 -- 172.21.15.5:0/4235916716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee40ca770 msgr2=0x7f7ee40c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.245+0000 7f7ee8df0700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee40ca770 0x7f7ee40c2750 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc00b560 tx=0x7f7ecc00b920 comp rx=0 tx=0).stop 2023-03-03T06:24:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.245+0000 7f7ee8df0700 1 -- 172.21.15.5:0/4235916716 shutdown_connections 2023-03-03T06:24:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.245+0000 7f7ee8df0700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ee4164100 0x7f7ee40b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.245+0000 7f7ee8df0700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ec40682f0 0x7f7ec406a7a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.245+0000 7f7ee8df0700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ee4070d00 0x7f7ee40c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.245+0000 7f7ee8df0700 1 --2- 172.21.15.5:0/4235916716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ee40ca770 0x7f7ee40c2750 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.245+0000 7f7ee8df0700 1 -- 172.21.15.5:0/4235916716 >> 172.21.15.5:0/4235916716 conn(0x7f7ee40cec40 msgr2=0x7f7ee40b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.245+0000 7f7ee8df0700 1 -- 172.21.15.5:0/4235916716 shutdown_connections 2023-03-03T06:24:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.245+0000 7f7ee8df0700 1 -- 172.21.15.5:0/4235916716 wait complete. 2023-03-03T06:24:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.247+0000 7fe114484700 1 -- 172.21.15.5:0/1384031431 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe0f00682f0 msgr2=0x7fe0f006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.247+0000 7fe114484700 1 --2- 172.21.15.5:0/1384031431 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe0f00682f0 0x7fe0f006a7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe108009890 tx=0x7fe108008040 comp rx=0 tx=0).stop 2023-03-03T06:24:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.247+0000 7fe114484700 1 -- 172.21.15.5:0/1384031431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10c0c5b60 msgr2=0x7fe10c15ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.247+0000 7fe114484700 1 --2- 172.21.15.5:0/1384031431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10c0c5b60 0x7fe10c15ac60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009db0 tx=0x7fe0fc004750 comp rx=0 tx=0).stop 2023-03-03T06:24:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7fe114484700 1 -- 172.21.15.5:0/1384031431 shutdown_connections 2023-03-03T06:24:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7fe114484700 1 --2- 172.21.15.5:0/1384031431 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe0f00682f0 0x7fe0f006a7a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7fe114484700 1 --2- 172.21.15.5:0/1384031431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe10c149c20 0x7fe10c0afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7fe114484700 1 --2- 172.21.15.5:0/1384031431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe10c0c5b60 0x7fe10c15ac60 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009db0 tx=0x7fe0fc004750 comp rx=0 tx=0).stop 2023-03-03T06:24:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7fe114484700 1 --2- 172.21.15.5:0/1384031431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe10c0cdad0 0x7fe10c1496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7fe114484700 1 -- 172.21.15.5:0/1384031431 >> 172.21.15.5:0/1384031431 conn(0x7fe10c0b1c60 msgr2=0x7fe10c0719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7fe114484700 1 -- 172.21.15.5:0/1384031431 shutdown_connections 2023-03-03T06:24:02.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7fe114484700 1 -- 172.21.15.5:0/1384031431 wait complete. 2023-03-03T06:24:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7f771197d700 1 -- 172.21.15.5:0/3666671687 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76f8068340 msgr2=0x7f76f806a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7f771197d700 1 --2- 172.21.15.5:0/3666671687 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76f8068340 0x7f76f806a7f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f76fc001160 tx=0x7f76fc007a30 comp rx=0 tx=0).stop 2023-03-03T06:24:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7f771197d700 1 -- 172.21.15.5:0/3666671687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770c0afd10 msgr2=0x7f770c0cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7f771197d700 1 --2- 172.21.15.5:0/3666671687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770c0afd10 0x7f770c0cc640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f770000c500 tx=0x7f770000c810 comp rx=0 tx=0).stop 2023-03-03T06:24:02.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7f771197d700 1 -- 172.21.15.5:0/3666671687 shutdown_connections 2023-03-03T06:24:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7f771197d700 1 --2- 172.21.15.5:0/3666671687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f770c15a800 0x7f770c06a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7f771197d700 1 --2- 172.21.15.5:0/3666671687 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76f8068340 0x7f76f806a7f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7f771197d700 1 --2- 172.21.15.5:0/3666671687 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f770c06b2d0 0x7f770c157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7f771197d700 1 --2- 172.21.15.5:0/3666671687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f770c0afd10 0x7f770c0cc640 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.248+0000 7f771197d700 1 -- 172.21.15.5:0/3666671687 >> 172.21.15.5:0/3666671687 conn(0x7f770c098a50 msgr2=0x7f770c06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:02.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.251+0000 7f771197d700 1 -- 172.21.15.5:0/3666671687 shutdown_connections 2023-03-03T06:24:02.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:02.251+0000 7f771197d700 1 -- 172.21.15.5:0/3666671687 wait complete. 2023-03-03T06:24:02.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-03-03T06:24:02.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-03-03T06:24:02.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-03-03T06:24:02.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-03-03T06:24:02.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2023-03-03T06:24:02.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2023-03-03T06:24:02.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2023-03-03T06:24:03.240 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-03-03T06:24:03.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-03-03T06:24:03.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-03-03T06:24:03.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-03-03T06:24:03.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-03-03T06:24:03.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-03-03T06:24:03.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-03-03T06:24:03.279 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-03-03T06:24:03.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.450+0000 7f5d43a38700 1 Processor -- start 2023-03-03T06:24:03.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.451+0000 7f5d43a38700 1 -- start start 2023-03-03T06:24:03.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.452+0000 7f5d43a38700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c0ce380 0x7f5d3c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.452+0000 7f5d43a38700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5d3c0cdeb0 0x7f5d3c0c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.452+0000 7f5d43a38700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3c06e6b0 con 0x7f5d3c071d10 2023-03-03T06:24:03.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.452+0000 7f5d43a38700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3c06eb40 con 0x7f5d3c0cdeb0 2023-03-03T06:24:03.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.452+0000 7f5d43a38700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c159e40 con 0x7f5d3c0ce380 2023-03-03T06:24:03.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.453+0000 7f5d417d4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c0ce380 0x7f5d3c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.453+0000 7f5d417d4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c0ce380 0x7f5d3c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39878/0 (socket says 172.21.15.5:39878) 2023-03-03T06:24:03.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.453+0000 7f5d417d4700 1 -- 172.21.15.5:0/1775099849 learned_addr learned my addr 172.21.15.5:0/1775099849 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:03.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.454+0000 7f5d41fd5700 1 --2- 172.21.15.5:0/1775099849 >> v2:172.21.15.5:3300/0 conn(0x7f5d3c0cdeb0 0x7f5d3c0c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.454+0000 7f5d41fd5700 1 -- 172.21.15.5:0/1775099849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c0ce380 msgr2=0x7f5d3c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:03.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.454+0000 7f5d41fd5700 1 --2- 172.21.15.5:0/1775099849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c0ce380 0x7f5d3c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.454+0000 7f5d41fd5700 1 -- 172.21.15.5:0/1775099849 >> v1:172.21.15.5:6789/0 conn(0x7f5d3c071d10 legacy=0x7f5d3c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:03.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.454+0000 7f5d41fd5700 1 -- 172.21.15.5:0/1775099849 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c06daa0 con 0x7f5d3c0cdeb0 2023-03-03T06:24:03.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.455+0000 7f5d41fd5700 1 --2- 172.21.15.5:0/1775099849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c0cdeb0 0x7f5d3c0c9290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009d90 tx=0x7f5d3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bade7467d9e4bec server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.456+0000 7f5d33fff700 1 -- 172.21.15.5:0/1775099849 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400e070 con 0x7f5d3c0cdeb0 2023-03-03T06:24:03.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.456+0000 7f5d33fff700 1 -- 172.21.15.5:0/1775099849 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3400bae0 con 0x7f5d3c0cdeb0 2023-03-03T06:24:03.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.456+0000 7f5d33fff700 1 -- 172.21.15.5:0/1775099849 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400be90 con 0x7f5d3c0cdeb0 2023-03-03T06:24:03.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.457+0000 7f5d43a38700 1 -- 172.21.15.5:0/1775099849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c0cdeb0 msgr2=0x7f5d3c0c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.457+0000 7f5d43a38700 1 --2- 172.21.15.5:0/1775099849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c0cdeb0 0x7f5d3c0c9290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009d90 tx=0x7f5d3400b330 comp rx=0 tx=0).stop 2023-03-03T06:24:03.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.457+0000 7f5d43a38700 1 -- 172.21.15.5:0/1775099849 shutdown_connections 2023-03-03T06:24:03.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.457+0000 7f5d43a38700 1 --2- 172.21.15.5:0/1775099849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c0cdeb0 0x7f5d3c0c9290 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.457+0000 7f5d43a38700 1 --2- 172.21.15.5:0/1775099849 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c0ce380 0x7f5d3c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.457+0000 7f5d43a38700 1 -- 172.21.15.5:0/1775099849 >> 172.21.15.5:0/1775099849 conn(0x7f5d3c0cf890 msgr2=0x7f5d3c0cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.458+0000 7f5d43a38700 1 -- 172.21.15.5:0/1775099849 shutdown_connections 2023-03-03T06:24:03.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.458+0000 7f5d43a38700 1 -- 172.21.15.5:0/1775099849 wait complete. 2023-03-03T06:24:03.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.460+0000 7f5d43a38700 1 Processor -- start 2023-03-03T06:24:03.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.460+0000 7f5d43a38700 1 -- start start 2023-03-03T06:24:03.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.461+0000 7f5d43a38700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c071d10 0x7f5d3c0afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.462+0000 7f5d43a38700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c0cdeb0 0x7f5d3c0c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.462+0000 7f5d43a38700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d3c0ce380 0x7f5d3c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.462+0000 7f5d43a38700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0c38d0 con 0x7f5d3c071d10 2023-03-03T06:24:03.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.462+0000 7f5d43a38700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0c2c50 con 0x7f5d3c0ce380 2023-03-03T06:24:03.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.462+0000 7f5d43a38700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0c2f30 con 0x7f5d3c0cdeb0 2023-03-03T06:24:03.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.462+0000 7f5d417d4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c071d10 0x7f5d3c0afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.462+0000 7f5d417d4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c071d10 0x7f5d3c0afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41802/0 (socket says 172.21.15.5:41802) 2023-03-03T06:24:03.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.462+0000 7f5d417d4700 1 -- 172.21.15.5:0/1237797786 learned_addr learned my addr 172.21.15.5:0/1237797786 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:03.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.463+0000 7f5d417d4700 1 -- 172.21.15.5:0/1237797786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c0cdeb0 msgr2=0x7f5d3c0c5f30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-03T06:24:03.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.463+0000 7f5d417d4700 1 --2- 172.21.15.5:0/1237797786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c0cdeb0 0x7f5d3c0c5f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.463+0000 7f5d417d4700 1 -- 172.21.15.5:0/1237797786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d3c0ce380 msgr2=0x7f5d3c0c3cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-03T06:24:03.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.463+0000 7f5d417d4700 1 --2- 172.21.15.5:0/1237797786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d3c0ce380 0x7f5d3c0c3cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.463+0000 7f5d417d4700 1 -- 172.21.15.5:0/1237797786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d34009a70 con 0x7f5d3c071d10 2023-03-03T06:24:03.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.464+0000 7f5d417d4700 1 --2- 172.21.15.5:0/1237797786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c071d10 0x7f5d3c0afa40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00e910 tx=0x7f5d2c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.466+0000 7f5d31ffb700 1 -- 172.21.15.5:0/1237797786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c00c850 con 0x7f5d3c071d10 2023-03-03T06:24:03.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.466+0000 7f5d31ffb700 1 -- 172.21.15.5:0/1237797786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2c00c9b0 con 0x7f5d3c071d10 2023-03-03T06:24:03.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.466+0000 7f5d31ffb700 1 -- 172.21.15.5:0/1237797786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c00cd40 con 0x7f5d3c071d10 2023-03-03T06:24:03.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.467+0000 7f5d43a38700 1 -- 172.21.15.5:0/1237797786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3c06e060 con 0x7f5d3c071d10 2023-03-03T06:24:03.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.467+0000 7f5d43a38700 1 -- 172.21.15.5:0/1237797786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3c06dd80 con 0x7f5d3c071d10 2023-03-03T06:24:03.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.470+0000 7f5d31ffb700 1 -- 172.21.15.5:0/1237797786 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5d2c019030 con 0x7f5d3c071d10 2023-03-03T06:24:03.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.471+0000 7f5d43a38700 1 -- 172.21.15.5:0/1237797786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1c0052e0 con 0x7f5d3c071d10 2023-03-03T06:24:03.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.471+0000 7f5d31ffb700 1 --2- 172.21.15.5:0/1237797786 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d20068340 0x7f5d2006a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.471+0000 7f5d31ffb700 1 -- 172.21.15.5:0/1237797786 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5d2c085d70 con 0x7f5d3c071d10 2023-03-03T06:24:03.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.475+0000 7f5d40fd3700 1 --2- 172.21.15.5:0/1237797786 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d20068340 0x7f5d2006a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.475+0000 7f5d40fd3700 1 --2- 172.21.15.5:0/1237797786 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d20068340 0x7f5d2006a7f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5d38006fd0 tx=0x7f5d38006bc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.477+0000 7f5d31ffb700 1 -- 172.21.15.5:0/1237797786 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5d2c052750 con 0x7f5d3c071d10 2023-03-03T06:24:03.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.506+0000 7f57a692e700 1 Processor -- start 2023-03-03T06:24:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.507+0000 7f57a692e700 1 -- start start 2023-03-03T06:24:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.508+0000 7f57a692e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57a0164100 0x7f57a00cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.508+0000 7f57a692e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f57a00ca770 0x7f57a01651a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.508+0000 7f57a692e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f57a0070d00 0x7f57a0071180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.508+0000 7f57a692e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a0164d80 con 0x7f57a00ca770 2023-03-03T06:24:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.508+0000 7f57a692e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a00716c0 con 0x7f57a0070d00 2023-03-03T06:24:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.508+0000 7f57a692e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00cd590 con 0x7f57a0164100 2023-03-03T06:24:03.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.508+0000 7f579ffff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57a0164100 0x7f57a00cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.508+0000 7f579ffff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57a0164100 0x7f57a00cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39888/0 (socket says 172.21.15.5:39888) 2023-03-03T06:24:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.508+0000 7f579ffff700 1 -- 172.21.15.5:0/1725550742 learned_addr learned my addr 172.21.15.5:0/1725550742 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.509+0000 7f57a4ecb700 1 --2- 172.21.15.5:0/1725550742 >> v2:172.21.15.191:3300/0 conn(0x7f57a0070d00 0x7f57a0071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.509+0000 7f579ffff700 1 -- 172.21.15.5:0/1725550742 >> v2:172.21.15.191:3300/0 conn(0x7f57a0070d00 msgr2=0x7f57a0071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.509+0000 7f579ffff700 1 --2- 172.21.15.5:0/1725550742 >> v2:172.21.15.191:3300/0 conn(0x7f57a0070d00 0x7f57a0071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.509+0000 7f579ffff700 1 -- 172.21.15.5:0/1725550742 >> v2:172.21.15.5:3300/0 conn(0x7f57a00ca770 msgr2=0x7f57a01651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.509+0000 7f579ffff700 1 --2- 172.21.15.5:0/1725550742 >> v2:172.21.15.5:3300/0 conn(0x7f57a00ca770 0x7f57a01651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.509+0000 7f579ffff700 1 -- 172.21.15.5:0/1725550742 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a00ccd50 con 0x7f57a0164100 2023-03-03T06:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.509+0000 7f579ffff700 1 --2- 172.21.15.5:0/1725550742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57a0164100 0x7f57a00cc810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57a00cfb50 tx=0x7f5790009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8e3e808f1a16ea0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.511+0000 7ffba98ab700 1 Processor -- start 2023-03-03T06:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.511+0000 7ffba98ab700 1 -- start start 2023-03-03T06:24:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba98ab700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba415c880 0x7ffba4160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba98ab700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ffba40cdc30 0x7ffba406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba98ab700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba40ce4a0 con 0x7ffba406d6a0 2023-03-03T06:24:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba98ab700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba4160ba0 con 0x7ffba40cdc30 2023-03-03T06:24:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba98ab700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba406e050 con 0x7ffba415c880 2023-03-03T06:24:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba2ffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba415c880 0x7ffba4160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba27fc700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7ffba406d6a0 0x7ffba40cd520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:46188/0 (socket says 172.21.15.5:46188) 2023-03-03T06:24:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba2ffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba415c880 0x7ffba4160fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39894/0 (socket says 172.21.15.5:39894) 2023-03-03T06:24:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba27fc700 1 -- 172.21.15.5:0/1463066104 learned_addr learned my addr 172.21.15.5:0/1463066104 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba37fe700 1 --2- 172.21.15.5:0/1463066104 >> v2:172.21.15.191:3300/0 conn(0x7ffba40cdc30 0x7ffba406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba2ffd700 1 -- 172.21.15.5:0/1463066104 >> v2:172.21.15.191:3300/0 conn(0x7ffba40cdc30 msgr2=0x7ffba406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba1ffb700 1 -- 172.21.15.5:0/1463066104 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938369759 0 0) 0x7ffba40ce4a0 con 0x7ffba406d6a0 2023-03-03T06:24:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba2ffd700 1 --2- 172.21.15.5:0/1463066104 >> v2:172.21.15.191:3300/0 conn(0x7ffba40cdc30 0x7ffba406db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba2ffd700 1 -- 172.21.15.5:0/1463066104 >> v1:172.21.15.191:6789/0 conn(0x7ffba406d6a0 legacy=0x7ffba40cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.512+0000 7ffba2ffd700 1 -- 172.21.15.5:0/1463066104 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba415cc50 con 0x7ffba415c880 2023-03-03T06:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.513+0000 7ffba2ffd700 1 --2- 172.21.15.5:0/1463066104 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba415c880 0x7ffba4160fc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb94014450 tx=0x7ffb94014760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8d1afb15987baa4 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.513+0000 7ffba1ffb700 1 -- 172.21.15.5:0/1463066104 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94005e30 con 0x7ffba415c880 2023-03-03T06:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.513+0000 7ffba1ffb700 1 -- 172.21.15.5:0/1463066104 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9400f0d0 con 0x7ffba415c880 2023-03-03T06:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.513+0000 7ffba1ffb700 1 -- 172.21.15.5:0/1463066104 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94015640 con 0x7ffba415c880 2023-03-03T06:24:03.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.513+0000 7ffba98ab700 1 -- 172.21.15.5:0/1463066104 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba415c880 msgr2=0x7ffba4160fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.513+0000 7ffba98ab700 1 --2- 172.21.15.5:0/1463066104 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba415c880 0x7ffba4160fc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb94014450 tx=0x7ffb94014760 comp rx=0 tx=0).stop 2023-03-03T06:24:03.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.514+0000 7ffba98ab700 1 -- 172.21.15.5:0/1463066104 shutdown_connections 2023-03-03T06:24:03.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.514+0000 7ffba98ab700 1 --2- 172.21.15.5:0/1463066104 >> v2:172.21.15.191:3300/0 conn(0x7ffba40cdc30 0x7ffba406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.514+0000 7ffba98ab700 1 --2- 172.21.15.5:0/1463066104 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba415c880 0x7ffba4160fc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.514+0000 7ffba98ab700 1 -- 172.21.15.5:0/1463066104 >> 172.21.15.5:0/1463066104 conn(0x7ffba40b1c60 msgr2=0x7ffba40cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.514+0000 7f579effd700 1 -- 172.21.15.5:0/1725550742 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790011830 con 0x7f57a0164100 2023-03-03T06:24:03.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.514+0000 7f579effd700 1 -- 172.21.15.5:0/1725550742 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5790011990 con 0x7f57a0164100 2023-03-03T06:24:03.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.514+0000 7f579effd700 1 -- 172.21.15.5:0/1725550742 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790011d20 con 0x7f57a0164100 2023-03-03T06:24:03.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.514+0000 7ffba98ab700 1 -- 172.21.15.5:0/1463066104 shutdown_connections 2023-03-03T06:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.514+0000 7ffba98ab700 1 -- 172.21.15.5:0/1463066104 wait complete. 2023-03-03T06:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.515+0000 7f57a692e700 1 -- 172.21.15.5:0/1725550742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57a0164100 msgr2=0x7f57a00cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.515+0000 7f57a692e700 1 --2- 172.21.15.5:0/1725550742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57a0164100 0x7f57a00cc810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57a00cfb50 tx=0x7f5790009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.515+0000 7ffba98ab700 1 Processor -- start 2023-03-03T06:24:03.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.516+0000 7f57a692e700 1 -- 172.21.15.5:0/1725550742 shutdown_connections 2023-03-03T06:24:03.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.516+0000 7f57a692e700 1 --2- 172.21.15.5:0/1725550742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57a0164100 0x7f57a00cc810 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7f57a692e700 1 --2- 172.21.15.5:0/1725550742 >> v2:172.21.15.191:3300/0 conn(0x7f57a0070d00 0x7f57a0071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7f57a692e700 1 --2- 172.21.15.5:0/1725550742 >> v2:172.21.15.5:3300/0 conn(0x7f57a00ca770 0x7f57a01651a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7f57a692e700 1 -- 172.21.15.5:0/1725550742 >> 172.21.15.5:0/1725550742 conn(0x7f57a00cec40 msgr2=0x7f57a00cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.515+0000 7ffba98ab700 1 -- start start 2023-03-03T06:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7ffba98ab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffba406d6a0 0x7ffba40c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7ffba98ab700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba40cdc30 0x7ffba40aa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7ffba98ab700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffba415c880 0x7ffba40b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7ffba98ab700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba40a8910 con 0x7ffba406d6a0 2023-03-03T06:24:03.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7ffba98ab700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba40a83e0 con 0x7ffba415c880 2023-03-03T06:24:03.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7ffba98ab700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba40a8630 con 0x7ffba40cdc30 2023-03-03T06:24:03.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7f57a692e700 1 -- 172.21.15.5:0/1725550742 shutdown_connections 2023-03-03T06:24:03.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7f57a692e700 1 -- 172.21.15.5:0/1725550742 wait complete. 2023-03-03T06:24:03.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7ffba27fc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba40cdc30 0x7ffba40aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7ffba27fc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba40cdc30 0x7ffba40aa060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39902/0 (socket says 172.21.15.5:39902) 2023-03-03T06:24:03.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7ffba27fc700 1 -- 172.21.15.5:0/2849877195 learned_addr learned my addr 172.21.15.5:0/2849877195 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:03.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7ffba37fe700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffba415c880 0x7ffba40b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.517+0000 7ffba2ffd700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffba406d6a0 0x7ffba40c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.518+0000 7ffba37fe700 1 -- 172.21.15.5:0/2849877195 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba40cdc30 msgr2=0x7ffba40aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.518+0000 7ffba37fe700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba40cdc30 0x7ffba40aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.518+0000 7ffba37fe700 1 -- 172.21.15.5:0/2849877195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffba406d6a0 msgr2=0x7ffba40c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.518+0000 7ffba37fe700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffba406d6a0 0x7ffba40c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.518+0000 7ffba37fe700 1 -- 172.21.15.5:0/2849877195 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9400fcd0 con 0x7ffba415c880 2023-03-03T06:24:03.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.519+0000 7ffba37fe700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffba415c880 0x7ffba40b22d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c01fbc0 tx=0x7ffb9c01fed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.519+0000 7f57a692e700 1 Processor -- start 2023-03-03T06:24:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.519+0000 7f57a692e700 1 -- start start 2023-03-03T06:24:03.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.520+0000 7f57a692e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a0070d00 0x7f57a0154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.520+0000 7f57a692e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57a00ca770 0x7f57a00c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.520+0000 7f57a692e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57a0164100 0x7f57a00b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.520+0000 7f57a692e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00c6d30 con 0x7f57a0070d00 2023-03-03T06:24:03.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.520+0000 7f57a692e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00c7010 con 0x7f57a00ca770 2023-03-03T06:24:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.520+0000 7f57a692e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00c8a40 con 0x7f57a0164100 2023-03-03T06:24:03.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.519+0000 7ffb8bfff700 1 -- 172.21.15.5:0/2849877195 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c01da10 con 0x7ffba415c880 2023-03-03T06:24:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.519+0000 7ffb8bfff700 1 -- 172.21.15.5:0/2849877195 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9c01db70 con 0x7ffba415c880 2023-03-03T06:24:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.519+0000 7ffb8bfff700 1 -- 172.21.15.5:0/2849877195 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c0243f0 con 0x7ffba415c880 2023-03-03T06:24:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.519+0000 7ffba98ab700 1 -- 172.21.15.5:0/2849877195 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba41604e0 con 0x7ffba415c880 2023-03-03T06:24:03.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.519+0000 7ffba98ab700 1 -- 172.21.15.5:0/2849877195 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba40ce1c0 con 0x7ffba415c880 2023-03-03T06:24:03.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.520+0000 7f579f7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57a00ca770 0x7f57a00c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.520+0000 7f57a4ecb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57a0164100 0x7f57a00b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.520+0000 7f579f7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57a00ca770 0x7f57a00c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42190/0 (socket says 172.21.15.5:42190) 2023-03-03T06:24:03.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.520+0000 7f579f7fe700 1 -- 172.21.15.5:0/3328426722 learned_addr learned my addr 172.21.15.5:0/3328426722 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:03.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.520+0000 7ffba98ab700 1 -- 172.21.15.5:0/2849877195 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba41607c0 con 0x7ffba415c880 2023-03-03T06:24:03.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.521+0000 7fc106900700 1 Processor -- start 2023-03-03T06:24:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.521+0000 7f57a4ecb700 1 -- 172.21.15.5:0/3328426722 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57a00ca770 msgr2=0x7f57a00c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.521+0000 7f57a4ecb700 1 --2- 172.21.15.5:0/3328426722 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57a00ca770 0x7f57a00c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.521+0000 7f57a4ecb700 1 -- 172.21.15.5:0/3328426722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a0070d00 msgr2=0x7f57a0154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.521+0000 7f57a4ecb700 1 --2- 172.21.15.5:0/3328426722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a0070d00 0x7f57a0154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.521+0000 7f57a4ecb700 1 -- 172.21.15.5:0/3328426722 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790009550 con 0x7f57a0164100 2023-03-03T06:24:03.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.521+0000 7fc106900700 1 -- start start 2023-03-03T06:24:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.521+0000 7f57a4ecb700 1 --2- 172.21.15.5:0/3328426722 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57a0164100 0x7f57a00b3390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f579800efc0 tx=0x7f579800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.521+0000 7f579cff9700 1 -- 172.21.15.5:0/3328426722 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579800cd40 con 0x7f57a0164100 2023-03-03T06:24:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.521+0000 7f579cff9700 1 -- 172.21.15.5:0/3328426722 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579800f040 con 0x7f57a0164100 2023-03-03T06:24:03.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.521+0000 7f579cff9700 1 -- 172.21.15.5:0/3328426722 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980146c0 con 0x7f57a0164100 2023-03-03T06:24:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.521+0000 7f57a692e700 1 -- 172.21.15.5:0/3328426722 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a00cd2b0 con 0x7f57a0164100 2023-03-03T06:24:03.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.521+0000 7f57a692e700 1 -- 172.21.15.5:0/3328426722 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a00ccfd0 con 0x7f57a0164100 2023-03-03T06:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.522+0000 7fc106900700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc10015ab80 0x7fc100165500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.522+0000 7fc106900700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1000cf7e0 con 0x7fc10015a7b0 2023-03-03T06:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.522+0000 7fc106900700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1000cfac0 con 0x7fc10006bc50 2023-03-03T06:24:03.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.522+0000 7fc106900700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1000b3290 con 0x7fc10015ab80 2023-03-03T06:24:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.522+0000 7f14189ea700 1 Processor -- start 2023-03-03T06:24:03.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.522+0000 7fc0ff7fe700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fc10006bc50 0x7fc1000cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:46206/0 (socket says 172.21.15.5:46206) 2023-03-03T06:24:03.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.522+0000 7fc0ff7fe700 1 -- 172.21.15.5:0/3552740554 learned_addr learned my addr 172.21.15.5:0/3552740554 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:03.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.523+0000 7ffb8bfff700 1 -- 172.21.15.5:0/2849877195 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ffb9c02a030 con 0x7ffba415c880 2023-03-03T06:24:03.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.522+0000 7f14189ea700 1 -- start start 2023-03-03T06:24:03.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.524+0000 7f14189ea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14140ce380 0x7f14140cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.524+0000 7f14189ea700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f14140c9290 0x7f14140c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.524+0000 7f14189ea700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141406e6b0 con 0x7f14140cd7a0 2023-03-03T06:24:03.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.524+0000 7f14189ea700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141406eb40 con 0x7f14140c9290 2023-03-03T06:24:03.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.524+0000 7f14189ea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14140ce0b0 con 0x7f14140ce380 2023-03-03T06:24:03.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.524+0000 7ffb8bfff700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffb900682f0 0x7ffb9006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.524+0000 7ffb8bfff700 1 -- 172.21.15.5:0/2849877195 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffb9c097820 con 0x7ffba415c880 2023-03-03T06:24:03.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.524+0000 7fc104e9d700 1 --2- 172.21.15.5:0/3552740554 >> v2:172.21.15.5:3300/0 conn(0x7fc10015ab80 0x7fc100165500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.524+0000 7fc0feffd700 1 -- 172.21.15.5:0/3552740554 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479369848 0 0) 0x7fc1000cf7e0 con 0x7fc10015a7b0 2023-03-03T06:24:03.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.524+0000 7fc0feffd700 1 -- 172.21.15.5:0/3552740554 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e80035b0 con 0x7fc10015a7b0 2023-03-03T06:24:03.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.524+0000 7f141259c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f14140cd7a0 0x7f1414159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59914/0 (socket says 172.21.15.5:59914) 2023-03-03T06:24:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.524+0000 7f141259c700 1 -- 172.21.15.5:0/1655204911 learned_addr learned my addr 172.21.15.5:0/1655204911 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.524+0000 7f1412d9d700 1 --2- 172.21.15.5:0/1655204911 >> v2:172.21.15.5:3300/0 conn(0x7f14140c9290 0x7f14140c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7fc104e9d700 1 -- 172.21.15.5:0/3552740554 >> v1:172.21.15.191:6789/0 conn(0x7fc10006bc50 legacy=0x7fc1000cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7fc104e9d700 1 -- 172.21.15.5:0/3552740554 >> v1:172.21.15.5:6789/0 conn(0x7fc10015a7b0 legacy=0x7fc10006b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7fc104e9d700 1 -- 172.21.15.5:0/3552740554 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1000b2eb0 con 0x7fc10015ab80 2023-03-03T06:24:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7f579cff9700 1 -- 172.21.15.5:0/3328426722 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5798014820 con 0x7f57a0164100 2023-03-03T06:24:03.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7f1412d9d700 1 -- 172.21.15.5:0/1655204911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14140ce380 msgr2=0x7f14140cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7f1412d9d700 1 --2- 172.21.15.5:0/1655204911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14140ce380 0x7f14140cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7f1412d9d700 1 -- 172.21.15.5:0/1655204911 >> v1:172.21.15.5:6789/0 conn(0x7f14140cd7a0 legacy=0x7f1414159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7fc104e9d700 1 --2- 172.21.15.5:0/3552740554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc10015ab80 0x7fc100165500 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009840 tx=0x7fc0f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d131dd02fcdd04 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7f1412d9d700 1 -- 172.21.15.5:0/1655204911 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141406bc30 con 0x7f14140c9290 2023-03-03T06:24:03.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7f1412d9d700 1 --2- 172.21.15.5:0/1655204911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14140c9290 0x7f14140c9710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f140800bad0 tx=0x7f140800bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d10aa290de9387 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7fc0feffd700 1 -- 172.21.15.5:0/3552740554 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0004230 con 0x7fc10015ab80 2023-03-03T06:24:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7fc0feffd700 1 -- 172.21.15.5:0/3552740554 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f0004390 con 0x7fc10015ab80 2023-03-03T06:24:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7fc0feffd700 1 -- 172.21.15.5:0/3552740554 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0010830 con 0x7fc10015ab80 2023-03-03T06:24:03.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7f579cff9700 1 --2- 172.21.15.5:0/3328426722 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f578c0682f0 0x7f578c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7f579cff9700 1 -- 172.21.15.5:0/3328426722 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5798086d10 con 0x7f57a0164100 2023-03-03T06:24:03.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.525+0000 7f141159a700 1 -- 172.21.15.5:0/1655204911 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140800dd20 con 0x7f14140c9290 2023-03-03T06:24:03.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.526+0000 7f141159a700 1 -- 172.21.15.5:0/1655204911 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140800de80 con 0x7f14140c9290 2023-03-03T06:24:03.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.526+0000 7f141159a700 1 -- 172.21.15.5:0/1655204911 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408006d30 con 0x7f14140c9290 2023-03-03T06:24:03.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.526+0000 7ffb8bfff700 1 -- 172.21.15.5:0/2849877195 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ffb9c063cc0 con 0x7ffba415c880 2023-03-03T06:24:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.526+0000 7fc106900700 1 -- 172.21.15.5:0/3552740554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc10015ab80 msgr2=0x7fc100165500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.526+0000 7fc106900700 1 --2- 172.21.15.5:0/3552740554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc10015ab80 0x7fc100165500 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009840 tx=0x7fc0f0009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:03.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.526+0000 7f579ffff700 1 --2- 172.21.15.5:0/3328426722 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f578c0682f0 0x7f578c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.526+0000 7f14189ea700 1 -- 172.21.15.5:0/1655204911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14140c9290 msgr2=0x7f14140c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.526+0000 7f14189ea700 1 --2- 172.21.15.5:0/1655204911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14140c9290 0x7f14140c9710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f140800bad0 tx=0x7f140800bde0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.526+0000 7f14189ea700 1 -- 172.21.15.5:0/1655204911 shutdown_connections 2023-03-03T06:24:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.526+0000 7f14189ea700 1 --2- 172.21.15.5:0/1655204911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14140c9290 0x7f14140c9710 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.526+0000 7f14189ea700 1 --2- 172.21.15.5:0/1655204911 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14140ce380 0x7f14140cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.526+0000 7f14189ea700 1 -- 172.21.15.5:0/1655204911 >> 172.21.15.5:0/1655204911 conn(0x7f14140cf890 msgr2=0x7f14140cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.527+0000 7fc106900700 1 -- 172.21.15.5:0/3552740554 shutdown_connections 2023-03-03T06:24:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.527+0000 7fc106900700 1 --2- 172.21.15.5:0/3552740554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc10015ab80 0x7fc100165500 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.527+0000 7fc106900700 1 -- 172.21.15.5:0/3552740554 >> 172.21.15.5:0/3552740554 conn(0x7fc1000cc8d0 msgr2=0x7fc1000cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.527+0000 7f579ffff700 1 --2- 172.21.15.5:0/3328426722 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f578c0682f0 0x7f578c06a7a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5790000c00 tx=0x7f5790010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.528+0000 7ffba2ffd700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffb900682f0 0x7ffb9006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.528+0000 7fc106900700 1 -- 172.21.15.5:0/3552740554 shutdown_connections 2023-03-03T06:24:03.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.528+0000 7fc106900700 1 -- 172.21.15.5:0/3552740554 wait complete. 2023-03-03T06:24:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.528+0000 7f57a692e700 1 -- 172.21.15.5:0/3328426722 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57800052e0 con 0x7f57a0164100 2023-03-03T06:24:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.528+0000 7ffba2ffd700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffb900682f0 0x7ffb9006a7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400f040 tx=0x7ffb94009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.529+0000 7fc106900700 1 Processor -- start 2023-03-03T06:24:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.530+0000 7fc106900700 1 -- start start 2023-03-03T06:24:03.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.530+0000 7f14189ea700 1 -- 172.21.15.5:0/1655204911 shutdown_connections 2023-03-03T06:24:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc106900700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc10006bc50 0x7fc1000cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc106900700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc10015a7b0 0x7fc1000c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc106900700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc10015ab80 0x7fc1000c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc106900700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000b50f0 con 0x7fc10015ab80 2023-03-03T06:24:03.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc106900700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10015b8e0 con 0x7fc10006bc50 2023-03-03T06:24:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc106900700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000cbdc0 con 0x7fc10015a7b0 2023-03-03T06:24:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc104e9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc10015ab80 0x7fc1000c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc104e9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc10015ab80 0x7fc1000c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41854/0 (socket says 172.21.15.5:41854) 2023-03-03T06:24:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc104e9d700 1 -- 172.21.15.5:0/1913076550 learned_addr learned my addr 172.21.15.5:0/1913076550 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc0ff7fe700 1 --2- 172.21.15.5:0/1913076550 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc10015a7b0 0x7fc1000c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc104e9d700 1 -- 172.21.15.5:0/1913076550 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc10015a7b0 msgr2=0x7fc1000c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc104e9d700 1 --2- 172.21.15.5:0/1913076550 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc10015a7b0 0x7fc1000c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc104e9d700 1 -- 172.21.15.5:0/1913076550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc10006bc50 msgr2=0x7fc1000cb880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-03T06:24:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.531+0000 7fc104e9d700 1 --2- 172.21.15.5:0/1913076550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc10006bc50 0x7fc1000cb880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.532+0000 7fc104e9d700 1 -- 172.21.15.5:0/1913076550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f00094a0 con 0x7fc10015ab80 2023-03-03T06:24:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.532+0000 7fc104e9d700 1 --2- 172.21.15.5:0/1913076550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc10015ab80 0x7fc1000c75b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc100068890 tx=0x7fc0f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.533+0000 7fc0fcff9700 1 -- 172.21.15.5:0/1913076550 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f00036a0 con 0x7fc10015ab80 2023-03-03T06:24:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.533+0000 7fc0fcff9700 1 -- 172.21.15.5:0/1913076550 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f0003820 con 0x7fc10015ab80 2023-03-03T06:24:03.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.533+0000 7fc0fcff9700 1 -- 172.21.15.5:0/1913076550 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0003bd0 con 0x7fc10015ab80 2023-03-03T06:24:03.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.530+0000 7f14189ea700 1 -- 172.21.15.5:0/1655204911 wait complete. 2023-03-03T06:24:03.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.533+0000 7f14189ea700 1 Processor -- start 2023-03-03T06:24:03.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.534+0000 7f579cff9700 1 -- 172.21.15.5:0/3328426722 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5798053280 con 0x7f57a0164100 2023-03-03T06:24:03.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.534+0000 7fc106900700 1 -- 172.21.15.5:0/1913076550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1000cd5b0 con 0x7fc10015ab80 2023-03-03T06:24:03.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.534+0000 7fc106900700 1 -- 172.21.15.5:0/1913076550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1000cf470 con 0x7fc10015ab80 2023-03-03T06:24:03.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.533+0000 7f14189ea700 1 -- start start 2023-03-03T06:24:03.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.534+0000 7f02ab13d700 1 Processor -- start 2023-03-03T06:24:03.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.534+0000 7f14189ea700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14140c9290 0x7f14140c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.534+0000 7f14189ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14140cd7a0 0x7f141415af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.534+0000 7f14189ea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14140ce380 0x7f1414154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.534+0000 7f14189ea700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14140c3600 con 0x7f14140cd7a0 2023-03-03T06:24:03.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.534+0000 7f14189ea700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14140c2770 con 0x7f14140c9290 2023-03-03T06:24:03.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.534+0000 7f14189ea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14140c4b90 con 0x7f14140ce380 2023-03-03T06:24:03.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.535+0000 7f141259c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14140c9290 0x7f14140c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.535+0000 7f141259c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14140c9290 0x7f14140c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42216/0 (socket says 172.21.15.5:42216) 2023-03-03T06:24:03.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.535+0000 7f141259c700 1 -- 172.21.15.5:0/3358118220 learned_addr learned my addr 172.21.15.5:0/3358118220 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:03.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.535+0000 7f1411d9b700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14140cd7a0 0x7f141415af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.535+0000 7f1412d9d700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14140ce380 0x7f1414154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.535+0000 7f141259c700 1 -- 172.21.15.5:0/3358118220 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14140ce380 msgr2=0x7f1414154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.535+0000 7f141259c700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14140ce380 0x7f1414154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.535+0000 7f141259c700 1 -- 172.21.15.5:0/3358118220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14140cd7a0 msgr2=0x7f141415af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.535+0000 7f141259c700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14140cd7a0 0x7f141415af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.535+0000 7f141259c700 1 -- 172.21.15.5:0/3358118220 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140800b730 con 0x7f14140c9290 2023-03-03T06:24:03.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.535+0000 7fc106900700 1 -- 172.21.15.5:0/1913076550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1000cd740 con 0x7fc10015ab80 2023-03-03T06:24:03.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.534+0000 7f02ab13d700 1 -- start start 2023-03-03T06:24:03.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.536+0000 7f02ab13d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02a40cd7a0 0x7f02a4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.536+0000 7f02ab13d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f02a40c9290 0x7f02a40c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.536+0000 7f02ab13d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a406e6b0 con 0x7f02a40ce380 2023-03-03T06:24:03.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.536+0000 7f02ab13d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a406eb40 con 0x7f02a40c9290 2023-03-03T06:24:03.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.536+0000 7f02ab13d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4159e40 con 0x7f02a40cd7a0 2023-03-03T06:24:03.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.536+0000 7f02a8ed9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02a40cd7a0 0x7f02a4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.536+0000 7f02a8ed9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02a40cd7a0 0x7f02a4159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:39940/0 (socket says 172.21.15.5:39940) 2023-03-03T06:24:03.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.536+0000 7f02a8ed9700 1 -- 172.21.15.5:0/3714486929 learned_addr learned my addr 172.21.15.5:0/3714486929 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:03.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.536+0000 7fc0fcff9700 1 -- 172.21.15.5:0/1913076550 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc0f0027030 con 0x7fc10015ab80 2023-03-03T06:24:03.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.536+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346597441 0 0) 0x7f02a406e6b0 con 0x7f02a40ce380 2023-03-03T06:24:03.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02900035b0 con 0x7f02a40ce380 2023-03-03T06:24:03.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a96da700 1 --2- 172.21.15.5:0/3714486929 >> v2:172.21.15.191:3300/0 conn(0x7f02a40c9290 0x7f02a40c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 <== mon.1 v1:172.21.15.191:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1059731471 0 0) 0x7f02900035b0 con 0x7f02a40ce380 2023-03-03T06:24:03.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02a40cd7a0 msgr2=0x7f02a4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:03.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 --2- 172.21.15.5:0/3714486929 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02a40cd7a0 0x7f02a4159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 >> v2:172.21.15.191:3300/0 conn(0x7f02a40c9290 msgr2=0x7f02a40c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:03.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 --2- 172.21.15.5:0/3714486929 >> v2:172.21.15.191:3300/0 conn(0x7f02a40c9290 0x7f02a40c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 --> v1:172.21.15.191:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a406bc30 con 0x7f02a40ce380 2023-03-03T06:24:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 <== mon.1 v1:172.21.15.191:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f029c0019f0 con 0x7f02a40ce380 2023-03-03T06:24:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 >> v1:172.21.15.191:6789/0 conn(0x7f02a40ce380 legacy=0x7f02a40cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 --2- 172.21.15.5:0/3714486929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0290003a70 0x7f0290003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 --2- 172.21.15.5:0/3714486929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0290004850 0x7f0290004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 --2- 172.21.15.5:0/3714486929 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0290005200 0x7f029000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a406eb40 con 0x7f0290003a70 2023-03-03T06:24:03.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4159e40 con 0x7f0290004850 2023-03-03T06:24:03.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029000bfd0 con 0x7f0290005200 2023-03-03T06:24:03.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7fc0fcff9700 1 --2- 172.21.15.5:0/1913076550 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0ec068340 0x7fc0ec06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7fc0fffff700 1 --2- 172.21.15.5:0/1913076550 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0ec068340 0x7fc0ec06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a96da700 1 --2- 172.21.15.5:0/3714486929 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0290005200 0x7f029000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a96da700 1 -- 172.21.15.5:0/3714486929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0290004850 msgr2=0x7f0290004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a96da700 1 --2- 172.21.15.5:0/3714486929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0290004850 0x7f0290004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a96da700 1 -- 172.21.15.5:0/3714486929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0290003a70 msgr2=0x7f0290003e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-03-03T06:24:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.537+0000 7f02a96da700 1 --2- 172.21.15.5:0/3714486929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0290003a70 0x7f0290003e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.538+0000 7f02a96da700 1 -- 172.21.15.5:0/3714486929 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a406bc30 con 0x7f0290005200 2023-03-03T06:24:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.538+0000 7fc0fffff700 1 --2- 172.21.15.5:0/1913076550 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0ec068340 0x7fc0ec06a7f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc10015e130 tx=0x7fc0f80016b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.538+0000 7f02a96da700 1 --2- 172.21.15.5:0/3714486929 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0290005200 0x7f029000ba10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0294009b60 tx=0x7f0290005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1748c685f8a04e45 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.538+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029400e6c0 con 0x7f0290005200 2023-03-03T06:24:03.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.538+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029400e820 con 0x7f0290005200 2023-03-03T06:24:03.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.538+0000 7f02a37fe700 1 -- 172.21.15.5:0/3714486929 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029400eb90 con 0x7f0290005200 2023-03-03T06:24:03.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.539+0000 7fc0fcff9700 1 -- 172.21.15.5:0/1913076550 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc0f005ed30 con 0x7fc10015ab80 2023-03-03T06:24:03.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.539+0000 7f02ab13d700 1 -- 172.21.15.5:0/3714486929 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0290005200 msgr2=0x7f029000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.539+0000 7f02ab13d700 1 --2- 172.21.15.5:0/3714486929 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0290005200 0x7f029000ba10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0294009b60 tx=0x7f0290005880 comp rx=0 tx=0).stop 2023-03-03T06:24:03.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.539+0000 7f02a96da700 1 -- 172.21.15.5:0/3714486929 reap_dead start 2023-03-03T06:24:03.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.539+0000 7f02ab13d700 1 -- 172.21.15.5:0/3714486929 shutdown_connections 2023-03-03T06:24:03.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.539+0000 7f02ab13d700 1 -- 172.21.15.5:0/3714486929 >> 172.21.15.5:0/3714486929 conn(0x7f02a40cf890 msgr2=0x7f02a40cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.536+0000 7f141259c700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14140c9290 0x7f14140c4650 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f140c00c890 tx=0x7f140c00cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.540+0000 7f838abcc700 1 Processor -- start 2023-03-03T06:24:03.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.541+0000 7f838abcc700 1 -- start start 2023-03-03T06:24:03.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.541+0000 7f979b6f8700 1 Processor -- start 2023-03-03T06:24:03.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.542+0000 7f838abcc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f838415a480 0x7f83840d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.542+0000 7f838abcc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f838415a850 0x7f83840b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.542+0000 7f838abcc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83840cb4a0 0x7f83840cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.542+0000 7f838abcc700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83840cf2a0 con 0x7f838415a850 2023-03-03T06:24:03.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.542+0000 7f838abcc700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83840cbcd0 con 0x7f838415a480 2023-03-03T06:24:03.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.542+0000 7f838abcc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83840cb9f0 con 0x7f83840cb4a0 2023-03-03T06:24:03.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.542+0000 7f8388968700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f838415a480 0x7f83840d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.542+0000 7f8388968700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f838415a480 0x7f83840d1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42234/0 (socket says 172.21.15.5:42234) 2023-03-03T06:24:03.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.542+0000 7f8388968700 1 -- 172.21.15.5:0/3099781853 learned_addr learned my addr 172.21.15.5:0/3099781853 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:03.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.541+0000 7f979b6f8700 1 -- start start 2023-03-03T06:24:03.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.542+0000 7f979b6f8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9794161e60 0x7f9794165310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.542+0000 7f979b6f8700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97940ca210 con 0x7f979415b390 2023-03-03T06:24:03.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.542+0000 7f979b6f8700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97940ca450 con 0x7f979406d580 2023-03-03T06:24:03.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.542+0000 7f979b6f8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97940ca730 con 0x7f9794161e60 2023-03-03T06:24:03.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7f9799494700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f979415b390 0x7f97940c9b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59954/0 (socket says 172.21.15.5:59954) 2023-03-03T06:24:03.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7f9799494700 1 -- 172.21.15.5:0/1362859163 learned_addr learned my addr 172.21.15.5:0/1362859163 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:03.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7f9798c93700 1 --2- 172.21.15.5:0/1362859163 >> v2:172.21.15.5:3300/0 conn(0x7f9794161e60 0x7f9794165310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7f8389169700 1 --2- 172.21.15.5:0/3099781853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83840cb4a0 0x7f83840cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7fc0fcff9700 1 -- 172.21.15.5:0/1913076550 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc0f0052fe0 con 0x7fc10015ab80 2023-03-03T06:24:03.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7f9798c93700 1 -- 172.21.15.5:0/1362859163 >> v1:172.21.15.191:6789/0 conn(0x7f979406d580 legacy=0x7f97940cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7f9798c93700 1 -- 172.21.15.5:0/1362859163 >> v1:172.21.15.5:6789/0 conn(0x7f979415b390 legacy=0x7f97940c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7f9798c93700 1 -- 172.21.15.5:0/1362859163 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9794161380 con 0x7f9794161e60 2023-03-03T06:24:03.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7f8389169700 1 -- 172.21.15.5:0/3099781853 >> v2:172.21.15.191:3300/0 conn(0x7f838415a480 msgr2=0x7f83840d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:03.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7f8389169700 1 --2- 172.21.15.5:0/3099781853 >> v2:172.21.15.191:3300/0 conn(0x7f838415a480 0x7f83840d1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7f8389169700 1 -- 172.21.15.5:0/3099781853 >> v2:172.21.15.5:3300/0 conn(0x7f838415a850 msgr2=0x7f83840b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:03.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7f8389169700 1 --2- 172.21.15.5:0/3099781853 >> v2:172.21.15.5:3300/0 conn(0x7f838415a850 0x7f83840b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7f8389169700 1 -- 172.21.15.5:0/3099781853 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83840cebe0 con 0x7f83840cb4a0 2023-03-03T06:24:03.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.543+0000 7f9798c93700 1 --2- 172.21.15.5:0/1362859163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9794161e60 0x7f9794165310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9784009840 tx=0x7f9784009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a13411ca3e36841 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.544+0000 7f8389169700 1 --2- 172.21.15.5:0/3099781853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83840cb4a0 0x7f83840cf6c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f837c009d90 tx=0x7f837c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24db4b40dee66b3f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.544+0000 7f978bfff700 1 -- 172.21.15.5:0/1362859163 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784011830 con 0x7f9794161e60 2023-03-03T06:24:03.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.544+0000 7f978bfff700 1 -- 172.21.15.5:0/1362859163 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9784011990 con 0x7f9794161e60 2023-03-03T06:24:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.544+0000 7f978bfff700 1 -- 172.21.15.5:0/1362859163 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784011d20 con 0x7f9794161e60 2023-03-03T06:24:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.544+0000 7f83837fe700 1 -- 172.21.15.5:0/3099781853 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00e070 con 0x7f83840cb4a0 2023-03-03T06:24:03.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.544+0000 7f83837fe700 1 -- 172.21.15.5:0/3099781853 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c00bae0 con 0x7f83840cb4a0 2023-03-03T06:24:03.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.544+0000 7f83837fe700 1 -- 172.21.15.5:0/3099781853 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00be90 con 0x7f83840cb4a0 2023-03-03T06:24:03.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.544+0000 7f838abcc700 1 -- 172.21.15.5:0/3099781853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83840cb4a0 msgr2=0x7f83840cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.544+0000 7f838abcc700 1 --2- 172.21.15.5:0/3099781853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83840cb4a0 0x7f83840cf6c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f837c009d90 tx=0x7f837c00b330 comp rx=0 tx=0).stop 2023-03-03T06:24:03.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.545+0000 7f979b6f8700 1 -- 172.21.15.5:0/1362859163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9794161e60 msgr2=0x7f9794165310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.545+0000 7f979b6f8700 1 --2- 172.21.15.5:0/1362859163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9794161e60 0x7f9794165310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9784009840 tx=0x7f9784009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:03.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.545+0000 7f979b6f8700 1 -- 172.21.15.5:0/1362859163 shutdown_connections 2023-03-03T06:24:03.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.545+0000 7f979b6f8700 1 --2- 172.21.15.5:0/1362859163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9794161e60 0x7f9794165310 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.545+0000 7f979b6f8700 1 -- 172.21.15.5:0/1362859163 >> 172.21.15.5:0/1362859163 conn(0x7f97940cf4b0 msgr2=0x7f97940cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.545+0000 7f838abcc700 1 -- 172.21.15.5:0/3099781853 shutdown_connections 2023-03-03T06:24:03.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.545+0000 7f838abcc700 1 --2- 172.21.15.5:0/3099781853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83840cb4a0 0x7f83840cf6c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.545+0000 7f838abcc700 1 --2- 172.21.15.5:0/3099781853 >> v2:172.21.15.191:3300/0 conn(0x7f838415a480 0x7f83840d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.545+0000 7f838abcc700 1 --2- 172.21.15.5:0/3099781853 >> v2:172.21.15.5:3300/0 conn(0x7f838415a850 0x7f83840b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.545+0000 7f838abcc700 1 -- 172.21.15.5:0/3099781853 >> 172.21.15.5:0/3099781853 conn(0x7f838406f3c0 msgr2=0x7f838406f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.545+0000 7f979b6f8700 1 -- 172.21.15.5:0/1362859163 shutdown_connections 2023-03-03T06:24:03.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.545+0000 7f979b6f8700 1 -- 172.21.15.5:0/1362859163 wait complete. 2023-03-03T06:24:03.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.546+0000 7f979b6f8700 1 Processor -- start 2023-03-03T06:24:03.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.546+0000 7f979b6f8700 1 -- start start 2023-03-03T06:24:03.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.547+0000 7f979b6f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f979406d580 0x7f97940c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.547+0000 7f979b6f8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979415b390 0x7f97940c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.547+0000 7f979b6f8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9794161e60 0x7f97940cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.547+0000 7f979b6f8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97940c5bc0 con 0x7f979406d580 2023-03-03T06:24:03.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.547+0000 7f979b6f8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97940c7dc0 con 0x7f979415b390 2023-03-03T06:24:03.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.547+0000 7f979b6f8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97941f7dc0 con 0x7f9794161e60 2023-03-03T06:24:03.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.547+0000 7f9798c93700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979415b390 0x7f97940c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.547+0000 7f9798c93700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979415b390 0x7f97940c5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42248/0 (socket says 172.21.15.5:42248) 2023-03-03T06:24:03.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.547+0000 7f9799c95700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9794161e60 0x7f97940cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.547+0000 7f9798c93700 1 -- 172.21.15.5:0/3025836869 learned_addr learned my addr 172.21.15.5:0/3025836869 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:03.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f02ab13d700 1 -- 172.21.15.5:0/3714486929 shutdown_connections 2023-03-03T06:24:03.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f1402ffd700 1 -- 172.21.15.5:0/3358118220 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c007230 con 0x7f14140c9290 2023-03-03T06:24:03.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f1402ffd700 1 -- 172.21.15.5:0/3358118220 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c00ce90 con 0x7f14140c9290 2023-03-03T06:24:03.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f1402ffd700 1 -- 172.21.15.5:0/3358118220 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00aa00 con 0x7f14140c9290 2023-03-03T06:24:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f9798c93700 1 -- 172.21.15.5:0/3025836869 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9794161e60 msgr2=0x7f97940cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f9798c93700 1 --2- 172.21.15.5:0/3025836869 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9794161e60 0x7f97940cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f9798c93700 1 -- 172.21.15.5:0/3025836869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f979406d580 msgr2=0x7f97940c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f9798c93700 1 --2- 172.21.15.5:0/3025836869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f979406d580 0x7f97940c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f9798c93700 1 -- 172.21.15.5:0/3025836869 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97840094a0 con 0x7f979415b390 2023-03-03T06:24:03.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f9798c93700 1 --2- 172.21.15.5:0/3025836869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979415b390 0x7f97940c5680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9784014040 tx=0x7f9784004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f9789ffb700 1 -- 172.21.15.5:0/3025836869 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840036a0 con 0x7f979415b390 2023-03-03T06:24:03.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f9789ffb700 1 -- 172.21.15.5:0/3025836869 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978401f070 con 0x7f979415b390 2023-03-03T06:24:03.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f9789ffb700 1 -- 172.21.15.5:0/3025836869 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784003a60 con 0x7f979415b390 2023-03-03T06:24:03.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.549+0000 7f9799c95700 1 --2- 172.21.15.5:0/3025836869 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9794161e60 0x7f97940cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:03.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.549+0000 7f979b6f8700 1 -- 172.21.15.5:0/3025836869 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9794161940 con 0x7f979415b390 2023-03-03T06:24:03.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.549+0000 7f979b6f8700 1 -- 172.21.15.5:0/3025836869 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9794161660 con 0x7f979415b390 2023-03-03T06:24:03.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.548+0000 7f02ab13d700 1 -- 172.21.15.5:0/3714486929 wait complete. 2023-03-03T06:24:03.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.550+0000 7f02ab13d700 1 Processor -- start 2023-03-03T06:24:03.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.550+0000 7f979b6f8700 1 -- 172.21.15.5:0/3025836869 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979406d9c0 con 0x7f979415b390 2023-03-03T06:24:03.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.551+0000 7f838abcc700 1 -- 172.21.15.5:0/3099781853 shutdown_connections 2023-03-03T06:24:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.551+0000 7f9789ffb700 1 -- 172.21.15.5:0/3025836869 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f978400f050 con 0x7f979415b390 2023-03-03T06:24:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f14189ea700 1 -- 172.21.15.5:0/3358118220 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141406dd80 con 0x7f14140c9290 2023-03-03T06:24:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f14189ea700 1 -- 172.21.15.5:0/3358118220 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141406daa0 con 0x7f14140c9290 2023-03-03T06:24:03.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.550+0000 7f02ab13d700 1 -- start start 2023-03-03T06:24:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.551+0000 7f02ab13d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0290005200 0x7f02a41e23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.551+0000 7f02ab13d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02a40c8d20 0x7f02a4155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.551+0000 7f02ab13d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02a40b3100 0x7f02a40b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.551+0000 7f02ab13d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40b3ae0 con 0x7f02a40c8d20 2023-03-03T06:24:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.551+0000 7f02ab13d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a41e3910 con 0x7f0290005200 2023-03-03T06:24:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.551+0000 7f02ab13d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a41e2d00 con 0x7f02a40b3100 2023-03-03T06:24:03.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f02a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02a40c8d20 0x7f02a4155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f02a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02a40c8d20 0x7f02a4155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41894/0 (socket says 172.21.15.5:41894) 2023-03-03T06:24:03.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f02a3fff700 1 -- 172.21.15.5:0/1618908949 learned_addr learned my addr 172.21.15.5:0/1618908949 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:03.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f02a8ed9700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0290005200 0x7f02a41e23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.551+0000 7f9789ffb700 1 --2- 172.21.15.5:0/3025836869 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f97780682f0 0x7f977806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f9789ffb700 1 -- 172.21.15.5:0/3025836869 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9784021070 con 0x7f979415b390 2023-03-03T06:24:03.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f02a96da700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02a40b3100 0x7f02a40b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f02a3fff700 1 -- 172.21.15.5:0/1618908949 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02a40b3100 msgr2=0x7f02a40b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f02a3fff700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02a40b3100 0x7f02a40b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f02a3fff700 1 -- 172.21.15.5:0/1618908949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0290005200 msgr2=0x7f02a41e23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f02a3fff700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0290005200 0x7f02a41e23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f02a3fff700 1 -- 172.21.15.5:0/1618908949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a406dd80 con 0x7f02a40c8d20 2023-03-03T06:24:03.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.553+0000 7f02a3fff700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02a40c8d20 0x7f02a4155fc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f029c007fd0 tx=0x7f029c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.553+0000 7f02a17fa700 1 -- 172.21.15.5:0/1618908949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c003e10 con 0x7f02a40c8d20 2023-03-03T06:24:03.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f9799494700 1 --2- 172.21.15.5:0/3025836869 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f97780682f0 0x7f977806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.552+0000 7f9799494700 1 --2- 172.21.15.5:0/3025836869 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f97780682f0 0x7f977806a7a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f97941610c0 tx=0x7f9790007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.553+0000 7f02a17fa700 1 -- 172.21.15.5:0/1618908949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c005070 con 0x7f02a40c8d20 2023-03-03T06:24:03.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.553+0000 7f02a17fa700 1 -- 172.21.15.5:0/1618908949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c005420 con 0x7f02a40c8d20 2023-03-03T06:24:03.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.554+0000 7f02ab13d700 1 -- 172.21.15.5:0/1618908949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a406daa0 con 0x7f02a40c8d20 2023-03-03T06:24:03.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.554+0000 7f02ab13d700 1 -- 172.21.15.5:0/1618908949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a406e060 con 0x7f02a40c8d20 2023-03-03T06:24:03.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.555+0000 7f02ab13d700 1 -- 172.21.15.5:0/1618908949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02880052e0 con 0x7f02a40c8d20 2023-03-03T06:24:03.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.556+0000 7f02a17fa700 1 -- 172.21.15.5:0/1618908949 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f029c019030 con 0x7f02a40c8d20 2023-03-03T06:24:03.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.556+0000 7f02a17fa700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02840682f0 0x7f028406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.556+0000 7f02a17fa700 1 -- 172.21.15.5:0/1618908949 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f029c0856c0 con 0x7f02a40c8d20 2023-03-03T06:24:03.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.557+0000 7f02a8ed9700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02840682f0 0x7f028406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.556+0000 7f9789ffb700 1 -- 172.21.15.5:0/3025836869 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9784053ec0 con 0x7f979415b390 2023-03-03T06:24:03.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.558+0000 7f838abcc700 1 -- 172.21.15.5:0/3099781853 wait complete. 2023-03-03T06:24:03.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.558+0000 7f02a8ed9700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02840682f0 0x7f028406a7a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f02a406ca30 tx=0x7f028c0082b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.560+0000 7f838abcc700 1 Processor -- start 2023-03-03T06:24:03.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.560+0000 7f838abcc700 1 -- start start 2023-03-03T06:24:03.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.561+0000 7f838abcc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83840cb4a0 0x7f83841504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.561+0000 7f838abcc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838415a850 0x7f83840cff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.561+0000 7f838abcc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83840d0490 0x7f83841544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.561+0000 7f838abcc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83840d0930 con 0x7f83840cb4a0 2023-03-03T06:24:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.561+0000 7f838abcc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8384155150 con 0x7f838415a850 2023-03-03T06:24:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.561+0000 7f838abcc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8384155430 con 0x7f83840d0490 2023-03-03T06:24:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.561+0000 7f8383fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838415a850 0x7f83840cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.561+0000 7f8383fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838415a850 0x7f83840cff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42262/0 (socket says 172.21.15.5:42262) 2023-03-03T06:24:03.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.561+0000 7f8383fff700 1 -- 172.21.15.5:0/3132585037 learned_addr learned my addr 172.21.15.5:0/3132585037 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:03.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.562+0000 7f8383fff700 1 -- 172.21.15.5:0/3132585037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83840d0490 msgr2=0x7f83841544d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-03-03T06:24:03.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.562+0000 7f8383fff700 1 --2- 172.21.15.5:0/3132585037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83840d0490 0x7f83841544d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.562+0000 7f8383fff700 1 -- 172.21.15.5:0/3132585037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83840cb4a0 msgr2=0x7f83841504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.562+0000 7f8383fff700 1 --2- 172.21.15.5:0/3132585037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83840cb4a0 0x7f83841504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.562+0000 7f8383fff700 1 -- 172.21.15.5:0/3132585037 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c009a70 con 0x7f838415a850 2023-03-03T06:24:03.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.562+0000 7f8383fff700 1 --2- 172.21.15.5:0/3132585037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838415a850 0x7f83840cff50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f837800b4d0 tx=0x7f837800b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.553+0000 7f14189ea700 1 -- 172.21.15.5:0/3358118220 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141406e060 con 0x7f14140c9290 2023-03-03T06:24:03.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.564+0000 7f1402ffd700 1 -- 172.21.15.5:0/3358118220 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f140c018020 con 0x7f14140c9290 2023-03-03T06:24:03.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.564+0000 7f1402ffd700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13f4068370 0x7f13f406a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.564+0000 7f1402ffd700 1 -- 172.21.15.5:0/3358118220 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f140c0869a0 con 0x7f14140c9290 2023-03-03T06:24:03.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.564+0000 7f1411d9b700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13f4068370 0x7f13f406a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.565+0000 7f1402ffd700 1 -- 172.21.15.5:0/3358118220 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f140c052fb0 con 0x7f14140c9290 2023-03-03T06:24:03.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.565+0000 7f1411d9b700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13f4068370 0x7f13f406a820 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1404006fd0 tx=0x7f1404008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.567+0000 7f02a17fa700 1 -- 172.21.15.5:0/1618908949 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f029c051bd0 con 0x7f02a40c8d20 2023-03-03T06:24:03.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.573+0000 7f83817fa700 1 -- 172.21.15.5:0/3132585037 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378011830 con 0x7f838415a850 2023-03-03T06:24:03.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.573+0000 7f83817fa700 1 -- 172.21.15.5:0/3132585037 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378011990 con 0x7f838415a850 2023-03-03T06:24:03.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.573+0000 7f83817fa700 1 -- 172.21.15.5:0/3132585037 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378011d20 con 0x7f838415a850 2023-03-03T06:24:03.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.576+0000 7f838abcc700 1 -- 172.21.15.5:0/3132585037 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83840d1b40 con 0x7f838415a850 2023-03-03T06:24:03.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.576+0000 7f838abcc700 1 -- 172.21.15.5:0/3132585037 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83840ceec0 con 0x7f838415a850 2023-03-03T06:24:03.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.579+0000 7f83817fa700 1 -- 172.21.15.5:0/3132585037 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8378021070 con 0x7f838415a850 2023-03-03T06:24:03.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.579+0000 7f83817fa700 1 --2- 172.21.15.5:0/3132585037 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f836806c7d0 0x7f836806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:03.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.579+0000 7f83817fa700 1 -- 172.21.15.5:0/3132585037 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8378085ed0 con 0x7f838415a850 2023-03-03T06:24:03.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.580+0000 7f838abcc700 1 -- 172.21.15.5:0/3132585037 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83840d1cd0 con 0x7f838415a850 2023-03-03T06:24:03.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.581+0000 7f8388968700 1 --2- 172.21.15.5:0/3132585037 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f836806c7d0 0x7f836806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:03.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.581+0000 7f8388968700 1 --2- 172.21.15.5:0/3132585037 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f836806c7d0 0x7f836806ec80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8370009520 tx=0x7f8370009470 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:03.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.585+0000 7f83817fa700 1 -- 172.21.15.5:0/3132585037 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8378052350 con 0x7f838415a850 2023-03-03T06:24:03.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.880+0000 7f5d43a38700 1 -- 172.21.15.5:0/1237797786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5d1c005590 con 0x7f5d3c071d10 2023-03-03T06:24:03.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.881+0000 7f5d31ffb700 1 -- 172.21.15.5:0/1237797786 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d2c00cea0 con 0x7f5d3c071d10 2023-03-03T06:24:03.886 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2023-03-03T06:24:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.884+0000 7f5d43a38700 1 -- 172.21.15.5:0/1237797786 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d20068340 msgr2=0x7f5d2006a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.884+0000 7f5d43a38700 1 --2- 172.21.15.5:0/1237797786 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d20068340 0x7f5d2006a7f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5d38006fd0 tx=0x7f5d38006bc0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.884+0000 7f5d43a38700 1 -- 172.21.15.5:0/1237797786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c071d10 msgr2=0x7f5d3c0afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.885+0000 7f5d43a38700 1 --2- 172.21.15.5:0/1237797786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c071d10 0x7f5d3c0afa40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00e910 tx=0x7f5d2c00ecd0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.885+0000 7f5d43a38700 1 -- 172.21.15.5:0/1237797786 shutdown_connections 2023-03-03T06:24:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.885+0000 7f5d43a38700 1 --2- 172.21.15.5:0/1237797786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d3c0ce380 0x7f5d3c0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.885+0000 7f5d43a38700 1 --2- 172.21.15.5:0/1237797786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c071d10 0x7f5d3c0afa40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.885+0000 7f5d43a38700 1 --2- 172.21.15.5:0/1237797786 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d20068340 0x7f5d2006a7f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.885+0000 7f5d43a38700 1 --2- 172.21.15.5:0/1237797786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c0cdeb0 0x7f5d3c0c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.885+0000 7f5d43a38700 1 -- 172.21.15.5:0/1237797786 >> 172.21.15.5:0/1237797786 conn(0x7f5d3c0cf890 msgr2=0x7f5d3c15c270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.885+0000 7f5d43a38700 1 -- 172.21.15.5:0/1237797786 shutdown_connections 2023-03-03T06:24:03.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.885+0000 7f5d43a38700 1 -- 172.21.15.5:0/1237797786 wait complete. 2023-03-03T06:24:03.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.2 2023-03-03T06:24:03.906 DEBUG:teuthology.parallel:result is None 2023-03-03T06:24:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.924+0000 7ffba98ab700 1 -- 172.21.15.5:0/2849877195 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffba40a93e0 con 0x7ffba415c880 2023-03-03T06:24:03.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.925+0000 7ffb8bfff700 1 -- 172.21.15.5:0/2849877195 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffba40a93e0 con 0x7ffba415c880 2023-03-03T06:24:03.927 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2023-03-03T06:24:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.929+0000 7ffba98ab700 1 -- 172.21.15.5:0/2849877195 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffb900682f0 msgr2=0x7ffb9006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.929+0000 7ffba98ab700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffb900682f0 0x7ffb9006a7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400f040 tx=0x7ffb94009000 comp rx=0 tx=0).stop 2023-03-03T06:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.929+0000 7ffba98ab700 1 -- 172.21.15.5:0/2849877195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffba415c880 msgr2=0x7ffba40b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.929+0000 7ffba98ab700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffba415c880 0x7ffba40b22d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c01fbc0 tx=0x7ffb9c01fed0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.929+0000 7fc106900700 1 -- 172.21.15.5:0/1913076550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc1000cd740 con 0x7fc10015ab80 2023-03-03T06:24:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.930+0000 7ffba98ab700 1 -- 172.21.15.5:0/2849877195 shutdown_connections 2023-03-03T06:24:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.930+0000 7ffba98ab700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffba415c880 0x7ffba40b22d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.930+0000 7fc0fcff9700 1 -- 172.21.15.5:0/1913076550 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0f0025090 con 0x7fc10015ab80 2023-03-03T06:24:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.930+0000 7ffba98ab700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffba406d6a0 0x7ffba40c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.930+0000 7ffba98ab700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffb900682f0 0x7ffb9006a7a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.930+0000 7ffba98ab700 1 --2- 172.21.15.5:0/2849877195 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffba40cdc30 0x7ffba40aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.930+0000 7ffba98ab700 1 -- 172.21.15.5:0/2849877195 >> 172.21.15.5:0/2849877195 conn(0x7ffba40b1c60 msgr2=0x7ffba40b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.933 INFO:teuthology.orchestra.run.smithi005.stdout:55834574856 2023-03-03T06:24:03.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.934+0000 7ffba98ab700 1 -- 172.21.15.5:0/2849877195 shutdown_connections 2023-03-03T06:24:03.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.934+0000 7ffba98ab700 1 -- 172.21.15.5:0/2849877195 wait complete. 2023-03-03T06:24:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.935+0000 7fc106900700 1 -- 172.21.15.5:0/1913076550 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0ec068340 msgr2=0x7fc0ec06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.935+0000 7fc106900700 1 --2- 172.21.15.5:0/1913076550 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0ec068340 0x7fc0ec06a7f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc10015e130 tx=0x7fc0f80016b0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.935+0000 7fc106900700 1 -- 172.21.15.5:0/1913076550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc10015ab80 msgr2=0x7fc1000c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.935+0000 7fc106900700 1 --2- 172.21.15.5:0/1913076550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc10015ab80 0x7fc1000c75b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc100068890 tx=0x7fc0f0004750 comp rx=0 tx=0).stop 2023-03-03T06:24:03.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.935+0000 7f57a692e700 1 -- 172.21.15.5:0/3328426722 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5780005590 con 0x7f57a0164100 2023-03-03T06:24:03.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.936+0000 7fc106900700 1 -- 172.21.15.5:0/1913076550 shutdown_connections 2023-03-03T06:24:03.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.936+0000 7fc106900700 1 --2- 172.21.15.5:0/1913076550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc10015ab80 0x7fc1000c75b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.936+0000 7fc106900700 1 --2- 172.21.15.5:0/1913076550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc10006bc50 0x7fc1000cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.936+0000 7fc106900700 1 --2- 172.21.15.5:0/1913076550 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc0ec068340 0x7fc0ec06a7f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.936+0000 7fc106900700 1 --2- 172.21.15.5:0/1913076550 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc10015a7b0 0x7fc1000c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.936+0000 7fc106900700 1 -- 172.21.15.5:0/1913076550 >> 172.21.15.5:0/1913076550 conn(0x7fc1000cc8d0 msgr2=0x7fc1000b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.936+0000 7f579cff9700 1 -- 172.21.15.5:0/3328426722 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5798018020 con 0x7f57a0164100 2023-03-03T06:24:03.939 INFO:teuthology.orchestra.run.smithi005.stdout:55834574858 2023-03-03T06:24:03.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.939+0000 7f57a692e700 1 -- 172.21.15.5:0/3328426722 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f578c0682f0 msgr2=0x7f578c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.939+0000 7f57a692e700 1 --2- 172.21.15.5:0/3328426722 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f578c0682f0 0x7f578c06a7a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5790000c00 tx=0x7f5790010000 comp rx=0 tx=0).stop 2023-03-03T06:24:03.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.939+0000 7f57a692e700 1 -- 172.21.15.5:0/3328426722 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57a0164100 msgr2=0x7f57a00b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.939+0000 7f57a692e700 1 --2- 172.21.15.5:0/3328426722 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57a0164100 0x7f57a00b3390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f579800efc0 tx=0x7f579800c3a0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.939+0000 7f57a692e700 1 -- 172.21.15.5:0/3328426722 shutdown_connections 2023-03-03T06:24:03.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.939+0000 7f57a692e700 1 --2- 172.21.15.5:0/3328426722 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f578c0682f0 0x7f578c06a7a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.939+0000 7f57a692e700 1 --2- 172.21.15.5:0/3328426722 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f57a0164100 0x7f57a00b3390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.939+0000 7f57a692e700 1 --2- 172.21.15.5:0/3328426722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a0070d00 0x7f57a0154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.939+0000 7f57a692e700 1 --2- 172.21.15.5:0/3328426722 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f57a00ca770 0x7f57a00c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.939+0000 7f57a692e700 1 -- 172.21.15.5:0/3328426722 >> 172.21.15.5:0/3328426722 conn(0x7f57a00cec40 msgr2=0x7f57a006d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.940+0000 7f57a692e700 1 -- 172.21.15.5:0/3328426722 shutdown_connections 2023-03-03T06:24:03.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.940+0000 7f57a692e700 1 -- 172.21.15.5:0/3328426722 wait complete. 2023-03-03T06:24:03.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.942+0000 7fc106900700 1 -- 172.21.15.5:0/1913076550 shutdown_connections 2023-03-03T06:24:03.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.942+0000 7fc106900700 1 -- 172.21.15.5:0/1913076550 wait complete. 2023-03-03T06:24:03.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.945+0000 7f979b6f8700 1 -- 172.21.15.5:0/3025836869 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f97940c75d0 con 0x7f979415b390 2023-03-03T06:24:03.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.947+0000 7f9789ffb700 1 -- 172.21.15.5:0/3025836869 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97940c75d0 con 0x7f979415b390 2023-03-03T06:24:03.949 INFO:teuthology.orchestra.run.smithi005.stdout:55834574858 2023-03-03T06:24:03.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.0 2023-03-03T06:24:03.955 DEBUG:teuthology.parallel:result is None 2023-03-03T06:24:03.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.958+0000 7f979b6f8700 1 -- 172.21.15.5:0/3025836869 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f97780682f0 msgr2=0x7f977806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.958+0000 7f979b6f8700 1 --2- 172.21.15.5:0/3025836869 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f97780682f0 0x7f977806a7a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f97941610c0 tx=0x7f9790007ad0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.958+0000 7f979b6f8700 1 -- 172.21.15.5:0/3025836869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979415b390 msgr2=0x7f97940c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.958+0000 7f979b6f8700 1 --2- 172.21.15.5:0/3025836869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979415b390 0x7f97940c5680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9784014040 tx=0x7f9784004750 comp rx=0 tx=0).stop 2023-03-03T06:24:03.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.958+0000 7f979b6f8700 1 -- 172.21.15.5:0/3025836869 shutdown_connections 2023-03-03T06:24:03.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.958+0000 7f979b6f8700 1 --2- 172.21.15.5:0/3025836869 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f97780682f0 0x7f977806a7a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.958+0000 7f979b6f8700 1 --2- 172.21.15.5:0/3025836869 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9794161e60 0x7f97940cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.958+0000 7f979b6f8700 1 --2- 172.21.15.5:0/3025836869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f979406d580 0x7f97940c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.958+0000 7f979b6f8700 1 --2- 172.21.15.5:0/3025836869 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f979415b390 0x7f97940c5680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.958+0000 7f979b6f8700 1 -- 172.21.15.5:0/3025836869 >> 172.21.15.5:0/3025836869 conn(0x7f97940cf4b0 msgr2=0x7f979406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.958+0000 7f979b6f8700 1 -- 172.21.15.5:0/3025836869 shutdown_connections 2023-03-03T06:24:03.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.958+0000 7f979b6f8700 1 -- 172.21.15.5:0/3025836869 wait complete. 2023-03-03T06:24:03.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.7 2023-03-03T06:24:03.964 DEBUG:teuthology.parallel:result is None 2023-03-03T06:24:03.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.3 2023-03-03T06:24:03.965 DEBUG:teuthology.parallel:result is None 2023-03-03T06:24:03.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.968+0000 7f14189ea700 1 -- 172.21.15.5:0/3358118220 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f141404e6e0 con 0x7f14140c9290 2023-03-03T06:24:03.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.969+0000 7f1402ffd700 1 -- 172.21.15.5:0/3358118220 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f140c0565d0 con 0x7f14140c9290 2023-03-03T06:24:03.971 INFO:teuthology.orchestra.run.smithi005.stdout:55834574858 2023-03-03T06:24:03.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.970+0000 7f02ab13d700 1 -- 172.21.15.5:0/1618908949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0288005590 con 0x7f02a40c8d20 2023-03-03T06:24:03.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.970+0000 7f02a17fa700 1 -- 172.21.15.5:0/1618908949 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f029c0551f0 con 0x7f02a40c8d20 2023-03-03T06:24:03.972 INFO:teuthology.orchestra.run.smithi005.stdout:55834574857 2023-03-03T06:24:03.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.4 2023-03-03T06:24:03.975 DEBUG:teuthology.parallel:result is None 2023-03-03T06:24:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.972+0000 7f14189ea700 1 -- 172.21.15.5:0/3358118220 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13f4068370 msgr2=0x7f13f406a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.972+0000 7f14189ea700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13f4068370 0x7f13f406a820 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1404006fd0 tx=0x7f1404008040 comp rx=0 tx=0).stop 2023-03-03T06:24:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.972+0000 7f14189ea700 1 -- 172.21.15.5:0/3358118220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14140c9290 msgr2=0x7f14140c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.972+0000 7f14189ea700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14140c9290 0x7f14140c4650 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f140c00c890 tx=0x7f140c00cc50 comp rx=0 tx=0).stop 2023-03-03T06:24:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.972+0000 7f14189ea700 1 -- 172.21.15.5:0/3358118220 shutdown_connections 2023-03-03T06:24:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.972+0000 7f14189ea700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13f4068370 0x7f13f406a820 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.972+0000 7f14189ea700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14140ce380 0x7f1414154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.972+0000 7f14189ea700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14140c9290 0x7f14140c4650 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.972+0000 7f14189ea700 1 --2- 172.21.15.5:0/3358118220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f14140cd7a0 0x7f141415af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.972+0000 7f14189ea700 1 -- 172.21.15.5:0/3358118220 >> 172.21.15.5:0/3358118220 conn(0x7f14140cf890 msgr2=0x7f1414155cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.972+0000 7f14189ea700 1 -- 172.21.15.5:0/3358118220 shutdown_connections 2023-03-03T06:24:03.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.972+0000 7f14189ea700 1 -- 172.21.15.5:0/3358118220 wait complete. 2023-03-03T06:24:03.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.973+0000 7f02ab13d700 1 -- 172.21.15.5:0/1618908949 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02840682f0 msgr2=0x7f028406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.973+0000 7f02ab13d700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02840682f0 0x7f028406a7a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f02a406ca30 tx=0x7f028c0082b0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.973+0000 7f02ab13d700 1 -- 172.21.15.5:0/1618908949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02a40c8d20 msgr2=0x7f02a4155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.973+0000 7f02ab13d700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02a40c8d20 0x7f02a4155fc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f029c007fd0 tx=0x7f029c00cde0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.973+0000 7f02ab13d700 1 -- 172.21.15.5:0/1618908949 shutdown_connections 2023-03-03T06:24:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.973+0000 7f02ab13d700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02840682f0 0x7f028406a7a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.973+0000 7f02ab13d700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02a40b3100 0x7f02a40b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.973+0000 7f02ab13d700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0290005200 0x7f02a41e23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.973+0000 7f02ab13d700 1 --2- 172.21.15.5:0/1618908949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02a40c8d20 0x7f02a4155fc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.973+0000 7f02ab13d700 1 -- 172.21.15.5:0/1618908949 >> 172.21.15.5:0/1618908949 conn(0x7f02a40cf890 msgr2=0x7f02a41592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.973+0000 7f02ab13d700 1 -- 172.21.15.5:0/1618908949 shutdown_connections 2023-03-03T06:24:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.973+0000 7f02ab13d700 1 -- 172.21.15.5:0/1618908949 wait complete. 2023-03-03T06:24:03.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.975+0000 7f838abcc700 1 -- 172.21.15.5:0/3132585037 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f838404e6e0 con 0x7f838415a850 2023-03-03T06:24:03.981 INFO:teuthology.orchestra.run.smithi005.stdout:55834574858 2023-03-03T06:24:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.976+0000 7f83817fa700 1 -- 172.21.15.5:0/3132585037 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8378055970 con 0x7f838415a850 2023-03-03T06:24:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.978+0000 7f838abcc700 1 -- 172.21.15.5:0/3132585037 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f836806c7d0 msgr2=0x7f836806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.978+0000 7f838abcc700 1 --2- 172.21.15.5:0/3132585037 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f836806c7d0 0x7f836806ec80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8370009520 tx=0x7f8370009470 comp rx=0 tx=0).stop 2023-03-03T06:24:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.978+0000 7f838abcc700 1 -- 172.21.15.5:0/3132585037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838415a850 msgr2=0x7f83840cff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.978+0000 7f838abcc700 1 --2- 172.21.15.5:0/3132585037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838415a850 0x7f83840cff50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f837800b4d0 tx=0x7f837800b890 comp rx=0 tx=0).stop 2023-03-03T06:24:03.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.978+0000 7f838abcc700 1 -- 172.21.15.5:0/3132585037 shutdown_connections 2023-03-03T06:24:03.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.978+0000 7f838abcc700 1 --2- 172.21.15.5:0/3132585037 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f836806c7d0 0x7f836806ec80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.978+0000 7f838abcc700 1 --2- 172.21.15.5:0/3132585037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83840d0490 0x7f83841544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.978+0000 7f838abcc700 1 --2- 172.21.15.5:0/3132585037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83840cb4a0 0x7f83841504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.978+0000 7f838abcc700 1 --2- 172.21.15.5:0/3132585037 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838415a850 0x7f83840cff50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:03.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.978+0000 7f838abcc700 1 -- 172.21.15.5:0/3132585037 >> 172.21.15.5:0/3132585037 conn(0x7f838406f3c0 msgr2=0x7f838415cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:03.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.978+0000 7f838abcc700 1 -- 172.21.15.5:0/3132585037 shutdown_connections 2023-03-03T06:24:03.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:03.978+0000 7f838abcc700 1 -- 172.21.15.5:0/3132585037 wait complete. 2023-03-03T06:24:03.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.5 2023-03-03T06:24:03.990 DEBUG:teuthology.parallel:result is None 2023-03-03T06:24:03.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.1 2023-03-03T06:24:03.991 DEBUG:teuthology.parallel:result is None 2023-03-03T06:24:03.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.6 2023-03-03T06:24:03.994 DEBUG:teuthology.parallel:result is None 2023-03-03T06:24:03.994 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-03-03T06:24:03.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:24:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.157+0000 7f81df296700 1 Processor -- start 2023-03-03T06:24:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.157+0000 7f81df296700 1 -- start start 2023-03-03T06:24:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.157+0000 7f81df296700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f81d81573f0 0x7f81d815d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.158+0000 7f81df296700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d81577c0 con 0x7f81d80b18d0 2023-03-03T06:24:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.158+0000 7f81df296700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d8159e60 con 0x7f81d80cc1a0 2023-03-03T06:24:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.158+0000 7f81df296700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d80cd790 con 0x7f81d81573f0 2023-03-03T06:24:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.158+0000 7f81dd833700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f81d80b18d0 0x7f81d80b1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:59990/0 (socket says 172.21.15.5:59990) 2023-03-03T06:24:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.158+0000 7f81dd833700 1 -- 172.21.15.5:0/3874070054 learned_addr learned my addr 172.21.15.5:0/3874070054 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.158+0000 7f81dd032700 1 --2- 172.21.15.5:0/3874070054 >> v2:172.21.15.191:3300/0 conn(0x7f81d81573f0 0x7f81d815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.158+0000 7f81cbfff700 1 -- 172.21.15.5:0/3874070054 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243536959 0 0) 0x7f81d81577c0 con 0x7f81d80b18d0 2023-03-03T06:24:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.158+0000 7f81cbfff700 1 -- 172.21.15.5:0/3874070054 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c40035b0 con 0x7f81d80b18d0 2023-03-03T06:24:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.158+0000 7f81dd032700 1 -- 172.21.15.5:0/3874070054 >> v1:172.21.15.191:6789/0 conn(0x7f81d80cc1a0 legacy=0x7f81d80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.158+0000 7f81cbfff700 1 -- 172.21.15.5:0/3874070054 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554635879 0 0) 0x7f81d8159e60 con 0x7f81d80cc1a0 2023-03-03T06:24:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.158+0000 7f81dd032700 1 -- 172.21.15.5:0/3874070054 >> v1:172.21.15.5:6789/0 conn(0x7f81d80b18d0 legacy=0x7f81d80b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.158+0000 7f81dd032700 1 -- 172.21.15.5:0/3874070054 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d80ce460 con 0x7f81d81573f0 2023-03-03T06:24:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.158+0000 7f81dd032700 1 --2- 172.21.15.5:0/3874070054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81d81573f0 0x7f81d815d320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009840 tx=0x7f81d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4770d36b62cfb7c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.159+0000 7f81cbfff700 1 -- 172.21.15.5:0/3874070054 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4011830 con 0x7f81d81573f0 2023-03-03T06:24:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.159+0000 7f81cbfff700 1 -- 172.21.15.5:0/3874070054 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d4011990 con 0x7f81d81573f0 2023-03-03T06:24:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.159+0000 7f81cbfff700 1 -- 172.21.15.5:0/3874070054 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4011d20 con 0x7f81d81573f0 2023-03-03T06:24:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.159+0000 7f81df296700 1 -- 172.21.15.5:0/3874070054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81d81573f0 msgr2=0x7f81d815d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.159+0000 7f81df296700 1 --2- 172.21.15.5:0/3874070054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81d81573f0 0x7f81d815d320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009840 tx=0x7f81d4009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.159+0000 7f81df296700 1 -- 172.21.15.5:0/3874070054 shutdown_connections 2023-03-03T06:24:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.159+0000 7f81df296700 1 --2- 172.21.15.5:0/3874070054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81d81573f0 0x7f81d815d320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.159+0000 7f81df296700 1 -- 172.21.15.5:0/3874070054 >> 172.21.15.5:0/3874070054 conn(0x7f81d80cc8d0 msgr2=0x7f81d80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.159+0000 7f81df296700 1 -- 172.21.15.5:0/3874070054 shutdown_connections 2023-03-03T06:24:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.159+0000 7f81df296700 1 -- 172.21.15.5:0/3874070054 wait complete. 2023-03-03T06:24:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.160+0000 7f81df296700 1 Processor -- start 2023-03-03T06:24:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.161+0000 7f81df296700 1 -- start start 2023-03-03T06:24:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.161+0000 7f81df296700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81d80b18d0 0x7f81d80c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.161+0000 7f81df296700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81d80cc1a0 0x7f81d81544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.161+0000 7f81df296700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81573f0 0x7f81d806b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.161+0000 7f81df296700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80c4fa0 con 0x7f81d81573f0 2023-03-03T06:24:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.161+0000 7f81df296700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d80c5280 con 0x7f81d80b18d0 2023-03-03T06:24:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.161+0000 7f81df296700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d806ad60 con 0x7f81d80cc1a0 2023-03-03T06:24:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.161+0000 7f81dd833700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81573f0 0x7f81d806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.161+0000 7f81dd833700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81573f0 0x7f81d806b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41922/0 (socket says 172.21.15.5:41922) 2023-03-03T06:24:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.161+0000 7f81dd833700 1 -- 172.21.15.5:0/2821701597 learned_addr learned my addr 172.21.15.5:0/2821701597 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.161+0000 7f81dd032700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81d80b18d0 0x7f81d80c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.161+0000 7f81dc831700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81d80cc1a0 0x7f81d81544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.162+0000 7f81dd833700 1 -- 172.21.15.5:0/2821701597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81d80cc1a0 msgr2=0x7f81d81544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.162+0000 7f81dd833700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81d80cc1a0 0x7f81d81544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.162+0000 7f81dd833700 1 -- 172.21.15.5:0/2821701597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81d80b18d0 msgr2=0x7f81d80c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.162+0000 7f81dd833700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81d80b18d0 0x7f81d80c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.162+0000 7f81dd833700 1 -- 172.21.15.5:0/2821701597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d40094a0 con 0x7f81d81573f0 2023-03-03T06:24:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.162+0000 7f81dd833700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81573f0 0x7f81d806b560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f81d000cb40 tx=0x7f81d000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.162+0000 7f81c9ffb700 1 -- 172.21.15.5:0/2821701597 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d000a9e0 con 0x7f81d81573f0 2023-03-03T06:24:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.162+0000 7f81c9ffb700 1 -- 172.21.15.5:0/2821701597 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d000ab40 con 0x7f81d81573f0 2023-03-03T06:24:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.162+0000 7f81df296700 1 -- 172.21.15.5:0/2821701597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d815dbe0 con 0x7f81d81573f0 2023-03-03T06:24:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.162+0000 7f81c9ffb700 1 -- 172.21.15.5:0/2821701597 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0012400 con 0x7f81d81573f0 2023-03-03T06:24:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.162+0000 7f81df296700 1 -- 172.21.15.5:0/2821701597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d815d900 con 0x7f81d81573f0 2023-03-03T06:24:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.163+0000 7f81df296700 1 -- 172.21.15.5:0/2821701597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d815dec0 con 0x7f81d81573f0 2023-03-03T06:24:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.163+0000 7f81c9ffb700 1 -- 172.21.15.5:0/2821701597 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f81d0019030 con 0x7f81d81573f0 2023-03-03T06:24:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.164+0000 7f81c9ffb700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f81bc0682f0 0x7f81bc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.164+0000 7f81c9ffb700 1 -- 172.21.15.5:0/2821701597 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f81d00859a0 con 0x7f81d81573f0 2023-03-03T06:24:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.164+0000 7f81dd032700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f81bc0682f0 0x7f81bc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.164+0000 7f81dd032700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f81bc0682f0 0x7f81bc06a7a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009fd0 tx=0x7f81d401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.168+0000 7f81c9ffb700 1 -- 172.21.15.5:0/2821701597 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f81d004b5e0 con 0x7f81d81573f0 2023-03-03T06:24:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.359+0000 7f81df296700 1 -- 172.21.15.5:0/2821701597 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81d806baa0 con 0x7f81bc0682f0 2023-03-03T06:24:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.369+0000 7f81c9ffb700 1 -- 172.21.15.5:0/2821701597 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367586 (secure 0 0 0) 0x7f81d806baa0 con 0x7f81bc0682f0 2023-03-03T06:24:04.375 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.373+0000 7f81df296700 1 -- 172.21.15.5:0/2821701597 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f81bc0682f0 msgr2=0x7f81bc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.373+0000 7f81df296700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f81bc0682f0 0x7f81bc06a7a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009fd0 tx=0x7f81d401c040 comp rx=0 tx=0).stop 2023-03-03T06:24:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.373+0000 7f81df296700 1 -- 172.21.15.5:0/2821701597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81573f0 msgr2=0x7f81d806b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.373+0000 7f81df296700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81573f0 0x7f81d806b560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f81d000cb40 tx=0x7f81d000ce50 comp rx=0 tx=0).stop 2023-03-03T06:24:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.373+0000 7f81df296700 1 -- 172.21.15.5:0/2821701597 shutdown_connections 2023-03-03T06:24:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.373+0000 7f81df296700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d81573f0 0x7f81d806b560 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.373+0000 7f81df296700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81d80b18d0 0x7f81d80c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.373+0000 7f81df296700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f81bc0682f0 0x7f81bc06a7a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.373+0000 7f81df296700 1 --2- 172.21.15.5:0/2821701597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81d80cc1a0 0x7f81d81544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.373+0000 7f81df296700 1 -- 172.21.15.5:0/2821701597 >> 172.21.15.5:0/2821701597 conn(0x7f81d80cc8d0 msgr2=0x7f81d815c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.373+0000 7f81df296700 1 -- 172.21.15.5:0/2821701597 shutdown_connections 2023-03-03T06:24:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.373+0000 7f81df296700 1 -- 172.21.15.5:0/2821701597 wait complete. 2023-03-03T06:24:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:24:04.387 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-03-03T06:24:03.467268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594896,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67296,"kb_used_data":3296,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907424,"statfs":{"total":773094113280,"available":773025202176,"internally_reserved":0,"allocated":3375104,"data_stored":2063078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2198,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004871"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394791+0000","last_change":"2023-03-03T06:23:40.340008+0000","last_active":"2023-03-03T06:23:44.394791+0000","last_peered":"2023-03-03T06:23:44.394791+0000","last_clean":"2023-03-03T06:23:44.394791+0000","last_became_active":"2023-03-03T06:23:40.339743+0000","last_became_peered":"2023-03-03T06:23:40.339743+0000","last_unstale":"2023-03-03T06:23:44.394791+0000","last_undegraded":"2023-03-03T06:23:44.394791+0000","last_fullsized":"2023-03-03T06:23:44.394791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:45.077306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400923+0000","last_change":"2023-03-03T06:23:40.328386+0000","last_active":"2023-03-03T06:23:44.400923+0000","last_peered":"2023-03-03T06:23:44.400923+0000","last_clean":"2023-03-03T06:23:44.400923+0000","last_became_active":"2023-03-03T06:23:40.328078+0000","last_became_peered":"2023-03-03T06:23:40.328078+0000","last_unstale":"2023-03-03T06:23:44.400923+0000","last_undegraded":"2023-03-03T06:23:44.400923+0000","last_fullsized":"2023-03-03T06:23:44.400923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:56:24.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396143+0000","last_change":"2023-03-03T06:23:40.351193+0000","last_active":"2023-03-03T06:23:44.396143+0000","last_peered":"2023-03-03T06:23:44.396143+0000","last_clean":"2023-03-03T06:23:44.396143+0000","last_became_active":"2023-03-03T06:23:40.348126+0000","last_became_peered":"2023-03-03T06:23:40.348126+0000","last_unstale":"2023-03-03T06:23:44.396143+0000","last_undegraded":"2023-03-03T06:23:44.396143+0000","last_fullsized":"2023-03-03T06:23:44.396143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:22:34.948853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406192+0000","last_change":"2023-03-03T06:23:40.339457+0000","last_active":"2023-03-03T06:23:44.406192+0000","last_peered":"2023-03-03T06:23:44.406192+0000","last_clean":"2023-03-03T06:23:44.406192+0000","last_became_active":"2023-03-03T06:23:40.339154+0000","last_became_peered":"2023-03-03T06:23:40.339154+0000","last_unstale":"2023-03-03T06:23:44.406192+0000","last_undegraded":"2023-03-03T06:23:44.406192+0000","last_fullsized":"2023-03-03T06:23:44.406192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:41:25.301780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413710+0000","last_change":"2023-03-03T06:23:40.342264+0000","last_active":"2023-03-03T06:23:44.413710+0000","last_peered":"2023-03-03T06:23:44.413710+0000","last_clean":"2023-03-03T06:23:44.413710+0000","last_became_active":"2023-03-03T06:23:40.340178+0000","last_became_peered":"2023-03-03T06:23:40.340178+0000","last_unstale":"2023-03-03T06:23:44.413710+0000","last_undegraded":"2023-03-03T06:23:44.413710+0000","last_fullsized":"2023-03-03T06:23:44.413710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:50.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396834+0000","last_change":"2023-03-03T06:23:40.344569+0000","last_active":"2023-03-03T06:23:44.396834+0000","last_peered":"2023-03-03T06:23:44.396834+0000","last_clean":"2023-03-03T06:23:44.396834+0000","last_became_active":"2023-03-03T06:23:40.344219+0000","last_became_peered":"2023-03-03T06:23:40.344219+0000","last_unstale":"2023-03-03T06:23:44.396834+0000","last_undegraded":"2023-03-03T06:23:44.396834+0000","last_fullsized":"2023-03-03T06:23:44.396834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:54:28.908384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407523+0000","last_change":"2023-03-03T06:23:40.346056+0000","last_active":"2023-03-03T06:23:44.407523+0000","last_peered":"2023-03-03T06:23:44.407523+0000","last_clean":"2023-03-03T06:23:44.407523+0000","last_became_active":"2023-03-03T06:23:40.345549+0000","last_became_peered":"2023-03-03T06:23:40.345549+0000","last_unstale":"2023-03-03T06:23:44.407523+0000","last_undegraded":"2023-03-03T06:23:44.407523+0000","last_fullsized":"2023-03-03T06:23:44.407523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:00.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398934+0000","last_change":"2023-03-03T06:23:40.341498+0000","last_active":"2023-03-03T06:23:44.398934+0000","last_peered":"2023-03-03T06:23:44.398934+0000","last_clean":"2023-03-03T06:23:44.398934+0000","last_became_active":"2023-03-03T06:23:40.341212+0000","last_became_peered":"2023-03-03T06:23:40.341212+0000","last_unstale":"2023-03-03T06:23:44.398934+0000","last_undegraded":"2023-03-03T06:23:44.398934+0000","last_fullsized":"2023-03-03T06:23:44.398934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:42:56.190690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414254+0000","last_change":"2023-03-03T06:23:40.342151+0000","last_active":"2023-03-03T06:23:44.414254+0000","last_peered":"2023-03-03T06:23:44.414254+0000","last_clean":"2023-03-03T06:23:44.414254+0000","last_became_active":"2023-03-03T06:23:40.340195+0000","last_became_peered":"2023-03-03T06:23:40.340195+0000","last_unstale":"2023-03-03T06:23:44.414254+0000","last_undegraded":"2023-03-03T06:23:44.414254+0000","last_fullsized":"2023-03-03T06:23:44.414254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:26.393574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401024+0000","last_change":"2023-03-03T06:23:40.329308+0000","last_active":"2023-03-03T06:23:44.401024+0000","last_peered":"2023-03-03T06:23:44.401024+0000","last_clean":"2023-03-03T06:23:44.401024+0000","last_became_active":"2023-03-03T06:23:40.329047+0000","last_became_peered":"2023-03-03T06:23:40.329047+0000","last_unstale":"2023-03-03T06:23:44.401024+0000","last_undegraded":"2023-03-03T06:23:44.401024+0000","last_fullsized":"2023-03-03T06:23:44.401024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396048+0000","last_change":"2023-03-03T06:23:40.350139+0000","last_active":"2023-03-03T06:23:44.396048+0000","last_peered":"2023-03-03T06:23:44.396048+0000","last_clean":"2023-03-03T06:23:44.396048+0000","last_became_active":"2023-03-03T06:23:40.344315+0000","last_became_peered":"2023-03-03T06:23:40.344315+0000","last_unstale":"2023-03-03T06:23:44.396048+0000","last_undegraded":"2023-03-03T06:23:44.396048+0000","last_fullsized":"2023-03-03T06:23:44.396048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.395100+0000","last_change":"2023-03-03T06:23:40.347207+0000","last_active":"2023-03-03T06:23:44.395100+0000","last_peered":"2023-03-03T06:23:44.395100+0000","last_clean":"2023-03-03T06:23:44.395100+0000","last_became_active":"2023-03-03T06:23:40.346966+0000","last_became_peered":"2023-03-03T06:23:40.346966+0000","last_unstale":"2023-03-03T06:23:44.395100+0000","last_undegraded":"2023-03-03T06:23:44.395100+0000","last_fullsized":"2023-03-03T06:23:44.395100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:50.785469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394027+0000","last_change":"2023-03-03T06:23:40.337391+0000","last_active":"2023-03-03T06:23:44.394027+0000","last_peered":"2023-03-03T06:23:44.394027+0000","last_clean":"2023-03-03T06:23:44.394027+0000","last_became_active":"2023-03-03T06:23:40.337119+0000","last_became_peered":"2023-03-03T06:23:40.337119+0000","last_unstale":"2023-03-03T06:23:44.394027+0000","last_undegraded":"2023-03-03T06:23:44.394027+0000","last_fullsized":"2023-03-03T06:23:44.394027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:21.332075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398880+0000","last_change":"2023-03-03T06:23:40.334786+0000","last_active":"2023-03-03T06:23:44.398880+0000","last_peered":"2023-03-03T06:23:44.398880+0000","last_clean":"2023-03-03T06:23:44.398880+0000","last_became_active":"2023-03-03T06:23:40.334489+0000","last_became_peered":"2023-03-03T06:23:40.334489+0000","last_unstale":"2023-03-03T06:23:44.398880+0000","last_undegraded":"2023-03-03T06:23:44.398880+0000","last_fullsized":"2023-03-03T06:23:44.398880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407409+0000","last_change":"2023-03-03T06:23:40.346226+0000","last_active":"2023-03-03T06:23:44.407409+0000","last_peered":"2023-03-03T06:23:44.407409+0000","last_clean":"2023-03-03T06:23:44.407409+0000","last_became_active":"2023-03-03T06:23:40.345791+0000","last_became_peered":"2023-03-03T06:23:40.345791+0000","last_unstale":"2023-03-03T06:23:44.407409+0000","last_undegraded":"2023-03-03T06:23:44.407409+0000","last_fullsized":"2023-03-03T06:23:44.407409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:17.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398869+0000","last_change":"2023-03-03T06:23:40.344976+0000","last_active":"2023-03-03T06:23:44.398869+0000","last_peered":"2023-03-03T06:23:44.398869+0000","last_clean":"2023-03-03T06:23:44.398869+0000","last_became_active":"2023-03-03T06:23:40.339923+0000","last_became_peered":"2023-03-03T06:23:40.339923+0000","last_unstale":"2023-03-03T06:23:44.398869+0000","last_undegraded":"2023-03-03T06:23:44.398869+0000","last_fullsized":"2023-03-03T06:23:44.398869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:40:38.222408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414475+0000","last_change":"2023-03-03T06:23:40.342480+0000","last_active":"2023-03-03T06:23:44.414475+0000","last_peered":"2023-03-03T06:23:44.414475+0000","last_clean":"2023-03-03T06:23:44.414475+0000","last_became_active":"2023-03-03T06:23:40.339835+0000","last_became_peered":"2023-03-03T06:23:40.339835+0000","last_unstale":"2023-03-03T06:23:44.414475+0000","last_undegraded":"2023-03-03T06:23:44.414475+0000","last_fullsized":"2023-03-03T06:23:44.414475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:57:56.186885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398423+0000","last_change":"2023-03-03T06:23:40.340711+0000","last_active":"2023-03-03T06:23:44.398423+0000","last_peered":"2023-03-03T06:23:44.398423+0000","last_clean":"2023-03-03T06:23:44.398423+0000","last_became_active":"2023-03-03T06:23:40.340400+0000","last_became_peered":"2023-03-03T06:23:40.340400+0000","last_unstale":"2023-03-03T06:23:44.398423+0000","last_undegraded":"2023-03-03T06:23:44.398423+0000","last_fullsized":"2023-03-03T06:23:44.398423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:38:27.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394986+0000","last_change":"2023-03-03T06:23:40.335402+0000","last_active":"2023-03-03T06:23:44.394986+0000","last_peered":"2023-03-03T06:23:44.394986+0000","last_clean":"2023-03-03T06:23:44.394986+0000","last_became_active":"2023-03-03T06:23:40.335101+0000","last_became_peered":"2023-03-03T06:23:40.335101+0000","last_unstale":"2023-03-03T06:23:44.394986+0000","last_undegraded":"2023-03-03T06:23:44.394986+0000","last_fullsized":"2023-03-03T06:23:44.394986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:41.969182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397647+0000","last_change":"2023-03-03T06:23:40.347472+0000","last_active":"2023-03-03T06:23:44.397647+0000","last_peered":"2023-03-03T06:23:44.397647+0000","last_clean":"2023-03-03T06:23:44.397647+0000","last_became_active":"2023-03-03T06:23:40.345241+0000","last_became_peered":"2023-03-03T06:23:40.345241+0000","last_unstale":"2023-03-03T06:23:44.397647+0000","last_undegraded":"2023-03-03T06:23:44.397647+0000","last_fullsized":"2023-03-03T06:23:44.397647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:59:25.244715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407721+0000","last_change":"2023-03-03T06:23:40.352895+0000","last_active":"2023-03-03T06:23:44.407721+0000","last_peered":"2023-03-03T06:23:44.407721+0000","last_clean":"2023-03-03T06:23:44.407721+0000","last_became_active":"2023-03-03T06:23:40.352576+0000","last_became_peered":"2023-03-03T06:23:40.352576+0000","last_unstale":"2023-03-03T06:23:44.407721+0000","last_undegraded":"2023-03-03T06:23:44.407721+0000","last_fullsized":"2023-03-03T06:23:44.407721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407761+0000","last_change":"2023-03-03T06:23:40.329918+0000","last_active":"2023-03-03T06:23:44.407761+0000","last_peered":"2023-03-03T06:23:44.407761+0000","last_clean":"2023-03-03T06:23:44.407761+0000","last_became_active":"2023-03-03T06:23:40.327770+0000","last_became_peered":"2023-03-03T06:23:40.327770+0000","last_unstale":"2023-03-03T06:23:44.407761+0000","last_undegraded":"2023-03-03T06:23:44.407761+0000","last_fullsized":"2023-03-03T06:23:44.407761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396955+0000","last_change":"2023-03-03T06:23:40.341354+0000","last_active":"2023-03-03T06:23:44.396955+0000","last_peered":"2023-03-03T06:23:44.396955+0000","last_clean":"2023-03-03T06:23:44.396955+0000","last_became_active":"2023-03-03T06:23:40.341048+0000","last_became_peered":"2023-03-03T06:23:40.341048+0000","last_unstale":"2023-03-03T06:23:44.396955+0000","last_undegraded":"2023-03-03T06:23:44.396955+0000","last_fullsized":"2023-03-03T06:23:44.396955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:59:25.244715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407568+0000","last_change":"2023-03-03T06:23:40.352581+0000","last_active":"2023-03-03T06:23:44.407568+0000","last_peered":"2023-03-03T06:23:44.407568+0000","last_clean":"2023-03-03T06:23:44.407568+0000","last_became_active":"2023-03-03T06:23:40.352290+0000","last_became_peered":"2023-03-03T06:23:40.352290+0000","last_unstale":"2023-03-03T06:23:44.407568+0000","last_undegraded":"2023-03-03T06:23:44.407568+0000","last_fullsized":"2023-03-03T06:23:44.407568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408648+0000","last_change":"2023-03-03T06:23:40.337724+0000","last_active":"2023-03-03T06:23:44.408648+0000","last_peered":"2023-03-03T06:23:44.408648+0000","last_clean":"2023-03-03T06:23:44.408648+0000","last_became_active":"2023-03-03T06:23:40.337448+0000","last_became_peered":"2023-03-03T06:23:40.337448+0000","last_unstale":"2023-03-03T06:23:44.408648+0000","last_undegraded":"2023-03-03T06:23:44.408648+0000","last_fullsized":"2023-03-03T06:23:44.408648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:37.500862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407962+0000","last_change":"2023-03-03T06:23:40.326813+0000","last_active":"2023-03-03T06:23:44.407962+0000","last_peered":"2023-03-03T06:23:44.407962+0000","last_clean":"2023-03-03T06:23:44.407962+0000","last_became_active":"2023-03-03T06:23:40.326512+0000","last_became_peered":"2023-03-03T06:23:40.326512+0000","last_unstale":"2023-03-03T06:23:44.407962+0000","last_undegraded":"2023-03-03T06:23:44.407962+0000","last_fullsized":"2023-03-03T06:23:44.407962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:40.681483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400716+0000","last_change":"2023-03-03T06:23:40.347745+0000","last_active":"2023-03-03T06:23:44.400716+0000","last_peered":"2023-03-03T06:23:44.400716+0000","last_clean":"2023-03-03T06:23:44.400716+0000","last_became_active":"2023-03-03T06:23:40.347373+0000","last_became_peered":"2023-03-03T06:23:40.347373+0000","last_unstale":"2023-03-03T06:23:44.400716+0000","last_undegraded":"2023-03-03T06:23:44.400716+0000","last_fullsized":"2023-03-03T06:23:44.400716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:00.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823247+0000","last_change":"2023-03-03T06:23:44.411770+0000","last_active":"2023-03-03T06:23:44.823247+0000","last_peered":"2023-03-03T06:23:44.823247+0000","last_clean":"2023-03-03T06:23:44.823247+0000","last_became_active":"2023-03-03T06:23:44.411103+0000","last_became_peered":"2023-03-03T06:23:44.411103+0000","last_unstale":"2023-03-03T06:23:44.823247+0000","last_undegraded":"2023-03-03T06:23:44.823247+0000","last_fullsized":"2023-03-03T06:23:44.823247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:52:34.159164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396733+0000","last_change":"2023-03-03T06:23:39.912910+0000","last_active":"2023-03-03T06:23:44.396733+0000","last_peered":"2023-03-03T06:23:44.396733+0000","last_clean":"2023-03-03T06:23:44.396733+0000","last_became_active":"2023-03-03T06:23:39.912705+0000","last_became_peered":"2023-03-03T06:23:39.912705+0000","last_unstale":"2023-03-03T06:23:44.396733+0000","last_undegraded":"2023-03-03T06:23:44.396733+0000","last_fullsized":"2023-03-03T06:23:44.396733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:37.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397715+0000","last_change":"2023-03-03T06:23:40.340849+0000","last_active":"2023-03-03T06:23:44.397715+0000","last_peered":"2023-03-03T06:23:44.397715+0000","last_clean":"2023-03-03T06:23:44.397715+0000","last_became_active":"2023-03-03T06:23:40.340540+0000","last_became_peered":"2023-03-03T06:23:40.340540+0000","last_unstale":"2023-03-03T06:23:44.397715+0000","last_undegraded":"2023-03-03T06:23:44.397715+0000","last_fullsized":"2023-03-03T06:23:44.397715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:57:56.186885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216333+0000","last_change":"2023-03-03T06:23:44.420347+0000","last_active":"2023-03-03T06:23:45.216333+0000","last_peered":"2023-03-03T06:23:45.216333+0000","last_clean":"2023-03-03T06:23:45.216333+0000","last_became_active":"2023-03-03T06:23:44.419965+0000","last_became_peered":"2023-03-03T06:23:44.419965+0000","last_unstale":"2023-03-03T06:23:45.216333+0000","last_undegraded":"2023-03-03T06:23:45.216333+0000","last_fullsized":"2023-03-03T06:23:45.216333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:59:28.743422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407154+0000","last_change":"2023-03-03T06:23:39.918145+0000","last_active":"2023-03-03T06:23:44.407154+0000","last_peered":"2023-03-03T06:23:44.407154+0000","last_clean":"2023-03-03T06:23:44.407154+0000","last_became_active":"2023-03-03T06:23:39.917834+0000","last_became_peered":"2023-03-03T06:23:39.917834+0000","last_unstale":"2023-03-03T06:23:44.407154+0000","last_undegraded":"2023-03-03T06:23:44.407154+0000","last_fullsized":"2023-03-03T06:23:44.407154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:37.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.412328+0000","last_change":"2023-03-03T06:23:40.345943+0000","last_active":"2023-03-03T06:23:44.412328+0000","last_peered":"2023-03-03T06:23:44.412328+0000","last_clean":"2023-03-03T06:23:44.412328+0000","last_became_active":"2023-03-03T06:23:40.345683+0000","last_became_peered":"2023-03-03T06:23:40.345683+0000","last_unstale":"2023-03-03T06:23:44.412328+0000","last_undegraded":"2023-03-03T06:23:44.412328+0000","last_fullsized":"2023-03-03T06:23:44.412328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011235+0000","last_change":"2023-03-03T06:23:44.419798+0000","last_active":"2023-03-03T06:23:45.011235+0000","last_peered":"2023-03-03T06:23:45.011235+0000","last_clean":"2023-03-03T06:23:45.011235+0000","last_became_active":"2023-03-03T06:23:44.419371+0000","last_became_peered":"2023-03-03T06:23:44.419371+0000","last_unstale":"2023-03-03T06:23:45.011235+0000","last_undegraded":"2023-03-03T06:23:45.011235+0000","last_fullsized":"2023-03-03T06:23:45.011235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:23.008849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400964+0000","last_change":"2023-03-03T06:23:39.914431+0000","last_active":"2023-03-03T06:23:44.400964+0000","last_peered":"2023-03-03T06:23:44.400964+0000","last_clean":"2023-03-03T06:23:44.400964+0000","last_became_active":"2023-03-03T06:23:39.914144+0000","last_became_peered":"2023-03-03T06:23:39.914144+0000","last_unstale":"2023-03-03T06:23:44.400964+0000","last_undegraded":"2023-03-03T06:23:44.400964+0000","last_fullsized":"2023-03-03T06:23:44.400964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406907+0000","last_change":"2023-03-03T06:23:40.335787+0000","last_active":"2023-03-03T06:23:44.406907+0000","last_peered":"2023-03-03T06:23:44.406907+0000","last_clean":"2023-03-03T06:23:44.406907+0000","last_became_active":"2023-03-03T06:23:40.334558+0000","last_became_peered":"2023-03-03T06:23:40.334558+0000","last_unstale":"2023-03-03T06:23:44.406907+0000","last_undegraded":"2023-03-03T06:23:44.406907+0000","last_fullsized":"2023-03-03T06:23:44.406907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:37.500862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215801+0000","last_change":"2023-03-03T06:23:44.418674+0000","last_active":"2023-03-03T06:23:45.215801+0000","last_peered":"2023-03-03T06:23:45.215801+0000","last_clean":"2023-03-03T06:23:45.215801+0000","last_became_active":"2023-03-03T06:23:44.418172+0000","last_became_peered":"2023-03-03T06:23:44.418172+0000","last_unstale":"2023-03-03T06:23:45.215801+0000","last_undegraded":"2023-03-03T06:23:45.215801+0000","last_fullsized":"2023-03-03T06:23:45.215801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:30.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414570+0000","last_change":"2023-03-03T06:23:39.911332+0000","last_active":"2023-03-03T06:23:44.414570+0000","last_peered":"2023-03-03T06:23:44.414570+0000","last_clean":"2023-03-03T06:23:44.414570+0000","last_became_active":"2023-03-03T06:23:39.910856+0000","last_became_peered":"2023-03-03T06:23:39.910856+0000","last_unstale":"2023-03-03T06:23:44.414570+0000","last_undegraded":"2023-03-03T06:23:44.414570+0000","last_fullsized":"2023-03-03T06:23:44.414570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:20.326465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397441+0000","last_change":"2023-03-03T06:23:40.339157+0000","last_active":"2023-03-03T06:23:44.397441+0000","last_peered":"2023-03-03T06:23:44.397441+0000","last_clean":"2023-03-03T06:23:44.397441+0000","last_became_active":"2023-03-03T06:23:40.338695+0000","last_became_peered":"2023-03-03T06:23:40.338695+0000","last_unstale":"2023-03-03T06:23:44.397441+0000","last_undegraded":"2023-03-03T06:23:44.397441+0000","last_fullsized":"2023-03-03T06:23:44.397441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:50.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216248+0000","last_change":"2023-03-03T06:23:44.424307+0000","last_active":"2023-03-03T06:23:45.216248+0000","last_peered":"2023-03-03T06:23:45.216248+0000","last_clean":"2023-03-03T06:23:45.216248+0000","last_became_active":"2023-03-03T06:23:44.423879+0000","last_became_peered":"2023-03-03T06:23:44.423879+0000","last_unstale":"2023-03-03T06:23:45.216248+0000","last_undegraded":"2023-03-03T06:23:45.216248+0000","last_fullsized":"2023-03-03T06:23:45.216248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:38:30.824125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400916+0000","last_change":"2023-03-03T06:23:39.911774+0000","last_active":"2023-03-03T06:23:44.400916+0000","last_peered":"2023-03-03T06:23:44.400916+0000","last_clean":"2023-03-03T06:23:44.400916+0000","last_became_active":"2023-03-03T06:23:39.911466+0000","last_became_peered":"2023-03-03T06:23:39.911466+0000","last_unstale":"2023-03-03T06:23:44.400916+0000","last_undegraded":"2023-03-03T06:23:44.400916+0000","last_fullsized":"2023-03-03T06:23:44.400916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:59:20.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396740+0000","last_change":"2023-03-03T06:23:40.341958+0000","last_active":"2023-03-03T06:23:44.396740+0000","last_peered":"2023-03-03T06:23:44.396740+0000","last_clean":"2023-03-03T06:23:44.396740+0000","last_became_active":"2023-03-03T06:23:40.341680+0000","last_became_peered":"2023-03-03T06:23:40.341680+0000","last_unstale":"2023-03-03T06:23:44.396740+0000","last_undegraded":"2023-03-03T06:23:44.396740+0000","last_fullsized":"2023-03-03T06:23:44.396740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:29:39.720198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822803+0000","last_change":"2023-03-03T06:23:44.424858+0000","last_active":"2023-03-03T06:23:44.822803+0000","last_peered":"2023-03-03T06:23:44.822803+0000","last_clean":"2023-03-03T06:23:44.822803+0000","last_became_active":"2023-03-03T06:23:44.424438+0000","last_became_peered":"2023-03-03T06:23:44.424438+0000","last_unstale":"2023-03-03T06:23:44.822803+0000","last_undegraded":"2023-03-03T06:23:44.822803+0000","last_fullsized":"2023-03-03T06:23:44.822803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:35:59.351177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408603+0000","last_change":"2023-03-03T06:23:39.917383+0000","last_active":"2023-03-03T06:23:44.408603+0000","last_peered":"2023-03-03T06:23:44.408603+0000","last_clean":"2023-03-03T06:23:44.408603+0000","last_became_active":"2023-03-03T06:23:39.917126+0000","last_became_peered":"2023-03-03T06:23:39.917126+0000","last_unstale":"2023-03-03T06:23:44.408603+0000","last_undegraded":"2023-03-03T06:23:44.408603+0000","last_fullsized":"2023-03-03T06:23:44.408603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:05:12.217423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406922+0000","last_change":"2023-03-03T06:23:40.336079+0000","last_active":"2023-03-03T06:23:44.406922+0000","last_peered":"2023-03-03T06:23:44.406922+0000","last_clean":"2023-03-03T06:23:44.406922+0000","last_became_active":"2023-03-03T06:23:40.335809+0000","last_became_peered":"2023-03-03T06:23:40.335809+0000","last_unstale":"2023-03-03T06:23:44.406922+0000","last_undegraded":"2023-03-03T06:23:44.406922+0000","last_fullsized":"2023-03-03T06:23:44.406922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:05:13.223033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823271+0000","last_change":"2023-03-03T06:23:44.417871+0000","last_active":"2023-03-03T06:23:44.823271+0000","last_peered":"2023-03-03T06:23:44.823271+0000","last_clean":"2023-03-03T06:23:44.823271+0000","last_became_active":"2023-03-03T06:23:44.417470+0000","last_became_peered":"2023-03-03T06:23:44.417470+0000","last_unstale":"2023-03-03T06:23:44.823271+0000","last_undegraded":"2023-03-03T06:23:44.823271+0000","last_fullsized":"2023-03-03T06:23:44.823271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:22:48.378893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:55.871487+0000","last_change":"2023-03-03T06:23:39.912856+0000","last_active":"2023-03-03T06:23:55.871487+0000","last_peered":"2023-03-03T06:23:55.871487+0000","last_clean":"2023-03-03T06:23:55.871487+0000","last_became_active":"2023-03-03T06:23:39.912563+0000","last_became_peered":"2023-03-03T06:23:39.912563+0000","last_unstale":"2023-03-03T06:23:55.871487+0000","last_undegraded":"2023-03-03T06:23:55.871487+0000","last_fullsized":"2023-03-03T06:23:55.871487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:40.963572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3746,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396312+0000","last_change":"2023-03-03T06:23:40.350272+0000","last_active":"2023-03-03T06:23:44.396312+0000","last_peered":"2023-03-03T06:23:44.396312+0000","last_clean":"2023-03-03T06:23:44.396312+0000","last_became_active":"2023-03-03T06:23:40.349999+0000","last_became_peered":"2023-03-03T06:23:40.349999+0000","last_unstale":"2023-03-03T06:23:44.396312+0000","last_undegraded":"2023-03-03T06:23:44.396312+0000","last_fullsized":"2023-03-03T06:23:44.396312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:00:23.719558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217132+0000","last_change":"2023-03-03T06:23:44.415132+0000","last_active":"2023-03-03T06:23:45.217132+0000","last_peered":"2023-03-03T06:23:45.217132+0000","last_clean":"2023-03-03T06:23:45.217132+0000","last_became_active":"2023-03-03T06:23:44.414671+0000","last_became_peered":"2023-03-03T06:23:44.414671+0000","last_unstale":"2023-03-03T06:23:45.217132+0000","last_undegraded":"2023-03-03T06:23:45.217132+0000","last_fullsized":"2023-03-03T06:23:45.217132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:03:14.816505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407616+0000","last_change":"2023-03-03T06:23:39.918682+0000","last_active":"2023-03-03T06:23:44.407616+0000","last_peered":"2023-03-03T06:23:44.407616+0000","last_clean":"2023-03-03T06:23:44.407616+0000","last_became_active":"2023-03-03T06:23:39.918360+0000","last_became_peered":"2023-03-03T06:23:39.918360+0000","last_unstale":"2023-03-03T06:23:44.407616+0000","last_undegraded":"2023-03-03T06:23:44.407616+0000","last_fullsized":"2023-03-03T06:23:44.407616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:19:38.164048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399298+0000","last_change":"2023-03-03T06:23:40.341375+0000","last_active":"2023-03-03T06:23:44.399298+0000","last_peered":"2023-03-03T06:23:44.399298+0000","last_clean":"2023-03-03T06:23:44.399298+0000","last_became_active":"2023-03-03T06:23:40.339213+0000","last_became_peered":"2023-03-03T06:23:40.339213+0000","last_unstale":"2023-03-03T06:23:44.399298+0000","last_undegraded":"2023-03-03T06:23:44.399298+0000","last_fullsized":"2023-03-03T06:23:44.399298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:27.072231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823348+0000","last_change":"2023-03-03T06:23:44.414871+0000","last_active":"2023-03-03T06:23:44.823348+0000","last_peered":"2023-03-03T06:23:44.823348+0000","last_clean":"2023-03-03T06:23:44.823348+0000","last_became_active":"2023-03-03T06:23:44.414346+0000","last_became_peered":"2023-03-03T06:23:44.414346+0000","last_unstale":"2023-03-03T06:23:44.823348+0000","last_undegraded":"2023-03-03T06:23:44.823348+0000","last_fullsized":"2023-03-03T06:23:44.823348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:40:15.816562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407908+0000","last_change":"2023-03-03T06:23:39.912556+0000","last_active":"2023-03-03T06:23:44.407908+0000","last_peered":"2023-03-03T06:23:44.407908+0000","last_clean":"2023-03-03T06:23:44.407908+0000","last_became_active":"2023-03-03T06:23:39.912270+0000","last_became_peered":"2023-03-03T06:23:39.912270+0000","last_unstale":"2023-03-03T06:23:44.407908+0000","last_undegraded":"2023-03-03T06:23:44.407908+0000","last_fullsized":"2023-03-03T06:23:44.407908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:59:20.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400650+0000","last_change":"2023-03-03T06:23:40.347443+0000","last_active":"2023-03-03T06:23:44.400650+0000","last_peered":"2023-03-03T06:23:44.400650+0000","last_clean":"2023-03-03T06:23:44.400650+0000","last_became_active":"2023-03-03T06:23:40.347157+0000","last_became_peered":"2023-03-03T06:23:40.347157+0000","last_unstale":"2023-03-03T06:23:44.400650+0000","last_undegraded":"2023-03-03T06:23:44.400650+0000","last_fullsized":"2023-03-03T06:23:44.400650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:17.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823445+0000","last_change":"2023-03-03T06:23:44.424679+0000","last_active":"2023-03-03T06:23:44.823445+0000","last_peered":"2023-03-03T06:23:44.823445+0000","last_clean":"2023-03-03T06:23:44.823445+0000","last_became_active":"2023-03-03T06:23:44.424312+0000","last_became_peered":"2023-03-03T06:23:44.424312+0000","last_unstale":"2023-03-03T06:23:44.823445+0000","last_undegraded":"2023-03-03T06:23:44.823445+0000","last_fullsized":"2023-03-03T06:23:44.823445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:20:21.108272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407408+0000","last_change":"2023-03-03T06:23:39.916648+0000","last_active":"2023-03-03T06:23:44.407408+0000","last_peered":"2023-03-03T06:23:44.407408+0000","last_clean":"2023-03-03T06:23:44.407408+0000","last_became_active":"2023-03-03T06:23:39.916366+0000","last_became_peered":"2023-03-03T06:23:39.916366+0000","last_unstale":"2023-03-03T06:23:44.407408+0000","last_undegraded":"2023-03-03T06:23:44.407408+0000","last_fullsized":"2023-03-03T06:23:44.407408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:18:36.597804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.412508+0000","last_change":"2023-03-03T06:23:40.340155+0000","last_active":"2023-03-03T06:23:44.412508+0000","last_peered":"2023-03-03T06:23:44.412508+0000","last_clean":"2023-03-03T06:23:44.412508+0000","last_became_active":"2023-03-03T06:23:40.339896+0000","last_became_peered":"2023-03-03T06:23:40.339896+0000","last_unstale":"2023-03-03T06:23:44.412508+0000","last_undegraded":"2023-03-03T06:23:44.412508+0000","last_fullsized":"2023-03-03T06:23:44.412508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:29:39.720198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216910+0000","last_change":"2023-03-03T06:23:44.415321+0000","last_active":"2023-03-03T06:23:45.216910+0000","last_peered":"2023-03-03T06:23:45.216910+0000","last_clean":"2023-03-03T06:23:45.216910+0000","last_became_active":"2023-03-03T06:23:44.414916+0000","last_became_peered":"2023-03-03T06:23:44.414916+0000","last_unstale":"2023-03-03T06:23:45.216910+0000","last_undegraded":"2023-03-03T06:23:45.216910+0000","last_fullsized":"2023-03-03T06:23:45.216910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:50:31.688270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406117+0000","last_change":"2023-03-03T06:23:39.908842+0000","last_active":"2023-03-03T06:23:44.406117+0000","last_peered":"2023-03-03T06:23:44.406117+0000","last_clean":"2023-03-03T06:23:44.406117+0000","last_became_active":"2023-03-03T06:23:39.908540+0000","last_became_peered":"2023-03-03T06:23:39.908540+0000","last_unstale":"2023-03-03T06:23:44.406117+0000","last_undegraded":"2023-03-03T06:23:44.406117+0000","last_fullsized":"2023-03-03T06:23:44.406117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.403220+0000","last_change":"2023-03-03T06:23:40.348336+0000","last_active":"2023-03-03T06:23:44.403220+0000","last_peered":"2023-03-03T06:23:44.403220+0000","last_clean":"2023-03-03T06:23:44.403220+0000","last_became_active":"2023-03-03T06:23:40.348074+0000","last_became_peered":"2023-03-03T06:23:40.348074+0000","last_unstale":"2023-03-03T06:23:44.403220+0000","last_undegraded":"2023-03-03T06:23:44.403220+0000","last_fullsized":"2023-03-03T06:23:44.403220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.218118+0000","last_change":"2023-03-03T06:23:44.425304+0000","last_active":"2023-03-03T06:23:45.218118+0000","last_peered":"2023-03-03T06:23:45.218118+0000","last_clean":"2023-03-03T06:23:45.218118+0000","last_became_active":"2023-03-03T06:23:44.424821+0000","last_became_peered":"2023-03-03T06:23:44.424821+0000","last_unstale":"2023-03-03T06:23:45.218118+0000","last_undegraded":"2023-03-03T06:23:45.218118+0000","last_fullsized":"2023-03-03T06:23:45.218118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:45:29.403205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.410402+0000","last_change":"2023-03-03T06:23:39.916608+0000","last_active":"2023-03-03T06:23:44.410402+0000","last_peered":"2023-03-03T06:23:44.410402+0000","last_clean":"2023-03-03T06:23:44.410402+0000","last_became_active":"2023-03-03T06:23:39.916307+0000","last_became_peered":"2023-03-03T06:23:39.916307+0000","last_unstale":"2023-03-03T06:23:44.410402+0000","last_undegraded":"2023-03-03T06:23:44.410402+0000","last_fullsized":"2023-03-03T06:23:44.410402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:36.495252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398185+0000","last_change":"2023-03-03T06:23:40.347737+0000","last_active":"2023-03-03T06:23:44.398185+0000","last_peered":"2023-03-03T06:23:44.398185+0000","last_clean":"2023-03-03T06:23:44.398185+0000","last_became_active":"2023-03-03T06:23:40.347002+0000","last_became_peered":"2023-03-03T06:23:40.347002+0000","last_unstale":"2023-03-03T06:23:44.398185+0000","last_undegraded":"2023-03-03T06:23:44.398185+0000","last_fullsized":"2023-03-03T06:23:44.398185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215709+0000","last_change":"2023-03-03T06:23:44.424830+0000","last_active":"2023-03-03T06:23:45.215709+0000","last_peered":"2023-03-03T06:23:45.215709+0000","last_clean":"2023-03-03T06:23:45.215709+0000","last_became_active":"2023-03-03T06:23:44.424435+0000","last_became_peered":"2023-03-03T06:23:44.424435+0000","last_unstale":"2023-03-03T06:23:45.215709+0000","last_undegraded":"2023-03-03T06:23:45.215709+0000","last_fullsized":"2023-03-03T06:23:45.215709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:29.892281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408855+0000","last_change":"2023-03-03T06:23:39.916989+0000","last_active":"2023-03-03T06:23:44.408855+0000","last_peered":"2023-03-03T06:23:44.408855+0000","last_clean":"2023-03-03T06:23:44.408855+0000","last_became_active":"2023-03-03T06:23:39.916686+0000","last_became_peered":"2023-03-03T06:23:39.916686+0000","last_unstale":"2023-03-03T06:23:44.408855+0000","last_undegraded":"2023-03-03T06:23:44.408855+0000","last_fullsized":"2023-03-03T06:23:44.408855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:04:17.846504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397402+0000","last_change":"2023-03-03T06:23:40.344010+0000","last_active":"2023-03-03T06:23:44.397402+0000","last_peered":"2023-03-03T06:23:44.397402+0000","last_clean":"2023-03-03T06:23:44.397402+0000","last_became_active":"2023-03-03T06:23:40.340204+0000","last_became_peered":"2023-03-03T06:23:40.340204+0000","last_unstale":"2023-03-03T06:23:44.397402+0000","last_undegraded":"2023-03-03T06:23:44.397402+0000","last_fullsized":"2023-03-03T06:23:44.397402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:57:56.186885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215937+0000","last_change":"2023-03-03T06:23:44.413387+0000","last_active":"2023-03-03T06:23:45.215937+0000","last_peered":"2023-03-03T06:23:45.215937+0000","last_clean":"2023-03-03T06:23:45.215937+0000","last_became_active":"2023-03-03T06:23:44.412643+0000","last_became_peered":"2023-03-03T06:23:44.412643+0000","last_unstale":"2023-03-03T06:23:45.215937+0000","last_undegraded":"2023-03-03T06:23:45.215937+0000","last_fullsized":"2023-03-03T06:23:45.215937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:11:57.156702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408463+0000","last_change":"2023-03-03T06:23:39.911757+0000","last_active":"2023-03-03T06:23:44.408463+0000","last_peered":"2023-03-03T06:23:44.408463+0000","last_clean":"2023-03-03T06:23:44.408463+0000","last_became_active":"2023-03-03T06:23:39.911430+0000","last_became_peered":"2023-03-03T06:23:39.911430+0000","last_unstale":"2023-03-03T06:23:44.408463+0000","last_undegraded":"2023-03-03T06:23:44.408463+0000","last_fullsized":"2023-03-03T06:23:44.408463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:30:04.252933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406464+0000","last_change":"2023-03-03T06:23:40.338136+0000","last_active":"2023-03-03T06:23:44.406464+0000","last_peered":"2023-03-03T06:23:44.406464+0000","last_clean":"2023-03-03T06:23:44.406464+0000","last_became_active":"2023-03-03T06:23:40.337828+0000","last_became_peered":"2023-03-03T06:23:40.337828+0000","last_unstale":"2023-03-03T06:23:44.406464+0000","last_undegraded":"2023-03-03T06:23:44.406464+0000","last_fullsized":"2023-03-03T06:23:44.406464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:30:05.258542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215914+0000","last_change":"2023-03-03T06:23:44.413004+0000","last_active":"2023-03-03T06:23:45.215914+0000","last_peered":"2023-03-03T06:23:45.215914+0000","last_clean":"2023-03-03T06:23:45.215914+0000","last_became_active":"2023-03-03T06:23:44.412564+0000","last_became_peered":"2023-03-03T06:23:44.412564+0000","last_unstale":"2023-03-03T06:23:45.215914+0000","last_undegraded":"2023-03-03T06:23:45.215914+0000","last_fullsized":"2023-03-03T06:23:45.215914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:16.090224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399592+0000","last_change":"2023-03-03T06:23:39.916059+0000","last_active":"2023-03-03T06:23:44.399592+0000","last_peered":"2023-03-03T06:23:44.399592+0000","last_clean":"2023-03-03T06:23:44.399592+0000","last_became_active":"2023-03-03T06:23:39.915796+0000","last_became_peered":"2023-03-03T06:23:39.915796+0000","last_unstale":"2023-03-03T06:23:44.399592+0000","last_undegraded":"2023-03-03T06:23:44.399592+0000","last_fullsized":"2023-03-03T06:23:44.399592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413796+0000","last_change":"2023-03-03T06:23:40.331555+0000","last_active":"2023-03-03T06:23:44.413796+0000","last_peered":"2023-03-03T06:23:44.413796+0000","last_clean":"2023-03-03T06:23:44.413796+0000","last_became_active":"2023-03-03T06:23:40.331304+0000","last_became_peered":"2023-03-03T06:23:40.331304+0000","last_unstale":"2023-03-03T06:23:44.413796+0000","last_undegraded":"2023-03-03T06:23:44.413796+0000","last_fullsized":"2023-03-03T06:23:44.413796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215910+0000","last_change":"2023-03-03T06:23:44.413292+0000","last_active":"2023-03-03T06:23:45.215910+0000","last_peered":"2023-03-03T06:23:45.215910+0000","last_clean":"2023-03-03T06:23:45.215910+0000","last_became_active":"2023-03-03T06:23:44.412668+0000","last_became_peered":"2023-03-03T06:23:44.412668+0000","last_unstale":"2023-03-03T06:23:45.215910+0000","last_undegraded":"2023-03-03T06:23:45.215910+0000","last_fullsized":"2023-03-03T06:23:45.215910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:42:28.966046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401269+0000","last_change":"2023-03-03T06:23:39.917500+0000","last_active":"2023-03-03T06:23:44.401269+0000","last_peered":"2023-03-03T06:23:44.401269+0000","last_clean":"2023-03-03T06:23:44.401269+0000","last_became_active":"2023-03-03T06:23:39.917201+0000","last_became_peered":"2023-03-03T06:23:39.917201+0000","last_unstale":"2023-03-03T06:23:44.401269+0000","last_undegraded":"2023-03-03T06:23:44.401269+0000","last_fullsized":"2023-03-03T06:23:44.401269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:44.071696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396883+0000","last_change":"2023-03-03T06:23:40.347773+0000","last_active":"2023-03-03T06:23:44.396883+0000","last_peered":"2023-03-03T06:23:44.396883+0000","last_clean":"2023-03-03T06:23:44.396883+0000","last_became_active":"2023-03-03T06:23:40.346824+0000","last_became_peered":"2023-03-03T06:23:40.346824+0000","last_unstale":"2023-03-03T06:23:44.396883+0000","last_undegraded":"2023-03-03T06:23:44.396883+0000","last_fullsized":"2023-03-03T06:23:44.396883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:50.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.821697+0000","last_change":"2023-03-03T06:23:44.413742+0000","last_active":"2023-03-03T06:23:44.821697+0000","last_peered":"2023-03-03T06:23:44.821697+0000","last_clean":"2023-03-03T06:23:44.821697+0000","last_became_active":"2023-03-03T06:23:44.413323+0000","last_became_peered":"2023-03-03T06:23:44.413323+0000","last_unstale":"2023-03-03T06:23:44.821697+0000","last_undegraded":"2023-03-03T06:23:44.821697+0000","last_fullsized":"2023-03-03T06:23:44.821697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:50:31.688270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406544+0000","last_change":"2023-03-03T06:23:39.916329+0000","last_active":"2023-03-03T06:23:44.406544+0000","last_peered":"2023-03-03T06:23:44.406544+0000","last_clean":"2023-03-03T06:23:44.406544+0000","last_became_active":"2023-03-03T06:23:39.916060+0000","last_became_peered":"2023-03-03T06:23:39.916060+0000","last_unstale":"2023-03-03T06:23:44.406544+0000","last_undegraded":"2023-03-03T06:23:44.406544+0000","last_fullsized":"2023-03-03T06:23:44.406544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:37.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.395753+0000","last_change":"2023-03-03T06:23:40.349832+0000","last_active":"2023-03-03T06:23:44.395753+0000","last_peered":"2023-03-03T06:23:44.395753+0000","last_clean":"2023-03-03T06:23:44.395753+0000","last_became_active":"2023-03-03T06:23:40.343955+0000","last_became_peered":"2023-03-03T06:23:40.343955+0000","last_unstale":"2023-03-03T06:23:44.395753+0000","last_undegraded":"2023-03-03T06:23:44.395753+0000","last_fullsized":"2023-03-03T06:23:44.395753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:55:53.505277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217364+0000","last_change":"2023-03-03T06:23:44.417750+0000","last_active":"2023-03-03T06:23:45.217364+0000","last_peered":"2023-03-03T06:23:45.217364+0000","last_clean":"2023-03-03T06:23:45.217364+0000","last_became_active":"2023-03-03T06:23:44.417295+0000","last_became_peered":"2023-03-03T06:23:44.417295+0000","last_unstale":"2023-03-03T06:23:45.217364+0000","last_undegraded":"2023-03-03T06:23:45.217364+0000","last_fullsized":"2023-03-03T06:23:45.217364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:04:21.713427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397226+0000","last_change":"2023-03-03T06:23:39.913064+0000","last_active":"2023-03-03T06:23:44.397226+0000","last_peered":"2023-03-03T06:23:44.397226+0000","last_clean":"2023-03-03T06:23:44.397226+0000","last_became_active":"2023-03-03T06:23:39.912756+0000","last_became_peered":"2023-03-03T06:23:39.912756+0000","last_unstale":"2023-03-03T06:23:44.397226+0000","last_undegraded":"2023-03-03T06:23:44.397226+0000","last_fullsized":"2023-03-03T06:23:44.397226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398500+0000","last_change":"2023-03-03T06:23:40.345016+0000","last_active":"2023-03-03T06:23:44.398500+0000","last_peered":"2023-03-03T06:23:44.398500+0000","last_clean":"2023-03-03T06:23:44.398500+0000","last_became_active":"2023-03-03T06:23:40.340755+0000","last_became_peered":"2023-03-03T06:23:40.340755+0000","last_unstale":"2023-03-03T06:23:44.398500+0000","last_undegraded":"2023-03-03T06:23:44.398500+0000","last_fullsized":"2023-03-03T06:23:44.398500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:26.393574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822613+0000","last_change":"2023-03-03T06:23:44.412105+0000","last_active":"2023-03-03T06:23:44.822613+0000","last_peered":"2023-03-03T06:23:44.822613+0000","last_clean":"2023-03-03T06:23:44.822613+0000","last_became_active":"2023-03-03T06:23:44.411353+0000","last_became_peered":"2023-03-03T06:23:44.411353+0000","last_unstale":"2023-03-03T06:23:44.822613+0000","last_undegraded":"2023-03-03T06:23:44.822613+0000","last_fullsized":"2023-03-03T06:23:44.822613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:23:56.487480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397316+0000","last_change":"2023-03-03T06:23:39.916313+0000","last_active":"2023-03-03T06:23:44.397316+0000","last_peered":"2023-03-03T06:23:44.397316+0000","last_clean":"2023-03-03T06:23:44.397316+0000","last_became_active":"2023-03-03T06:23:39.916058+0000","last_became_peered":"2023-03-03T06:23:39.916058+0000","last_unstale":"2023-03-03T06:23:44.397316+0000","last_undegraded":"2023-03-03T06:23:44.397316+0000","last_fullsized":"2023-03-03T06:23:44.397316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:59:20.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408755+0000","last_change":"2023-03-03T06:23:40.339541+0000","last_active":"2023-03-03T06:23:44.408755+0000","last_peered":"2023-03-03T06:23:44.408755+0000","last_clean":"2023-03-03T06:23:44.408755+0000","last_became_active":"2023-03-03T06:23:40.339291+0000","last_became_peered":"2023-03-03T06:23:40.339291+0000","last_unstale":"2023-03-03T06:23:44.408755+0000","last_undegraded":"2023-03-03T06:23:44.408755+0000","last_fullsized":"2023-03-03T06:23:44.408755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:17.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822768+0000","last_change":"2023-03-03T06:23:44.413275+0000","last_active":"2023-03-03T06:23:44.822768+0000","last_peered":"2023-03-03T06:23:44.822768+0000","last_clean":"2023-03-03T06:23:44.822768+0000","last_became_active":"2023-03-03T06:23:44.412027+0000","last_became_peered":"2023-03-03T06:23:44.412027+0000","last_unstale":"2023-03-03T06:23:44.822768+0000","last_undegraded":"2023-03-03T06:23:44.822768+0000","last_fullsized":"2023-03-03T06:23:44.822768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:46:08.536113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401273+0000","last_change":"2023-03-03T06:23:39.913990+0000","last_active":"2023-03-03T06:23:44.401273+0000","last_peered":"2023-03-03T06:23:44.401273+0000","last_clean":"2023-03-03T06:23:44.401273+0000","last_became_active":"2023-03-03T06:23:39.913721+0000","last_became_peered":"2023-03-03T06:23:39.913721+0000","last_unstale":"2023-03-03T06:23:44.401273+0000","last_undegraded":"2023-03-03T06:23:44.401273+0000","last_fullsized":"2023-03-03T06:23:44.401273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:19:38.164048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.395934+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:23:44.395934+0000","last_peered":"2023-03-03T06:23:44.395934+0000","last_clean":"2023-03-03T06:23:44.395934+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:23:44.395934+0000","last_undegraded":"2023-03-03T06:23:44.395934+0000","last_fullsized":"2023-03-03T06:23:44.395934+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397197+0000","last_change":"2023-03-03T06:23:40.346219+0000","last_active":"2023-03-03T06:23:44.397197+0000","last_peered":"2023-03-03T06:23:44.397197+0000","last_clean":"2023-03-03T06:23:44.397197+0000","last_became_active":"2023-03-03T06:23:40.345907+0000","last_became_peered":"2023-03-03T06:23:40.345907+0000","last_unstale":"2023-03-03T06:23:44.397197+0000","last_undegraded":"2023-03-03T06:23:44.397197+0000","last_fullsized":"2023-03-03T06:23:44.397197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822264+0000","last_change":"2023-03-03T06:23:44.412472+0000","last_active":"2023-03-03T06:23:44.822264+0000","last_peered":"2023-03-03T06:23:44.822264+0000","last_clean":"2023-03-03T06:23:44.822264+0000","last_became_active":"2023-03-03T06:23:44.412106+0000","last_became_peered":"2023-03-03T06:23:44.412106+0000","last_unstale":"2023-03-03T06:23:44.822264+0000","last_undegraded":"2023-03-03T06:23:44.822264+0000","last_fullsized":"2023-03-03T06:23:44.822264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:03:14.816505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406142+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:23:44.406142+0000","last_peered":"2023-03-03T06:23:44.406142+0000","last_clean":"2023-03-03T06:23:44.406142+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:23:44.406142+0000","last_undegraded":"2023-03-03T06:23:44.406142+0000","last_fullsized":"2023-03-03T06:23:44.406142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011109+0000","last_change":"2023-03-03T06:23:39.907672+0000","last_active":"2023-03-03T06:23:45.011109+0000","last_peered":"2023-03-03T06:23:45.011109+0000","last_clean":"2023-03-03T06:23:45.011109+0000","last_became_active":"2023-03-03T06:23:39.907353+0000","last_became_peered":"2023-03-03T06:23:39.907353+0000","last_unstale":"2023-03-03T06:23:45.011109+0000","last_undegraded":"2023-03-03T06:23:45.011109+0000","last_fullsized":"2023-03-03T06:23:45.011109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:44.071696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397317+0000","last_change":"2023-03-03T06:23:40.347947+0000","last_active":"2023-03-03T06:23:44.397317+0000","last_peered":"2023-03-03T06:23:44.397317+0000","last_clean":"2023-03-03T06:23:44.397317+0000","last_became_active":"2023-03-03T06:23:40.347617+0000","last_became_peered":"2023-03-03T06:23:40.347617+0000","last_unstale":"2023-03-03T06:23:44.397317+0000","last_undegraded":"2023-03-03T06:23:44.397317+0000","last_fullsized":"2023-03-03T06:23:44.397317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:27.072231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216962+0000","last_change":"2023-03-03T06:23:44.412431+0000","last_active":"2023-03-03T06:23:45.216962+0000","last_peered":"2023-03-03T06:23:45.216962+0000","last_clean":"2023-03-03T06:23:45.216962+0000","last_became_active":"2023-03-03T06:23:44.411748+0000","last_became_peered":"2023-03-03T06:23:44.411748+0000","last_unstale":"2023-03-03T06:23:45.216962+0000","last_undegraded":"2023-03-03T06:23:45.216962+0000","last_fullsized":"2023-03-03T06:23:45.216962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:40:15.816562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406632+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:23:44.406632+0000","last_peered":"2023-03-03T06:23:44.406632+0000","last_clean":"2023-03-03T06:23:44.406632+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:23:44.406632+0000","last_undegraded":"2023-03-03T06:23:44.406632+0000","last_fullsized":"2023-03-03T06:23:44.406632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407696+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:23:44.407696+0000","last_peered":"2023-03-03T06:23:44.407696+0000","last_clean":"2023-03-03T06:23:44.407696+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:23:44.407696+0000","last_undegraded":"2023-03-03T06:23:44.407696+0000","last_fullsized":"2023-03-03T06:23:44.407696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408209+0000","last_change":"2023-03-03T06:23:39.911633+0000","last_active":"2023-03-03T06:23:44.408209+0000","last_peered":"2023-03-03T06:23:44.408209+0000","last_clean":"2023-03-03T06:23:44.408209+0000","last_became_active":"2023-03-03T06:23:39.911343+0000","last_became_peered":"2023-03-03T06:23:39.911343+0000","last_unstale":"2023-03-03T06:23:44.408209+0000","last_undegraded":"2023-03-03T06:23:44.408209+0000","last_fullsized":"2023-03-03T06:23:44.408209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.412424+0000","last_change":"2023-03-03T06:23:40.331020+0000","last_active":"2023-03-03T06:23:44.412424+0000","last_peered":"2023-03-03T06:23:44.412424+0000","last_clean":"2023-03-03T06:23:44.412424+0000","last_became_active":"2023-03-03T06:23:40.330714+0000","last_became_peered":"2023-03-03T06:23:40.330714+0000","last_unstale":"2023-03-03T06:23:44.412424+0000","last_undegraded":"2023-03-03T06:23:44.412424+0000","last_fullsized":"2023-03-03T06:23:44.412424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:03:45.180190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216187+0000","last_change":"2023-03-03T06:23:44.410983+0000","last_active":"2023-03-03T06:23:45.216187+0000","last_peered":"2023-03-03T06:23:45.216187+0000","last_clean":"2023-03-03T06:23:45.216187+0000","last_became_active":"2023-03-03T06:23:44.410572+0000","last_became_peered":"2023-03-03T06:23:44.410572+0000","last_unstale":"2023-03-03T06:23:45.216187+0000","last_undegraded":"2023-03-03T06:23:45.216187+0000","last_fullsized":"2023-03-03T06:23:45.216187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:30.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408155+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:23:44.408155+0000","last_peered":"2023-03-03T06:23:44.408155+0000","last_clean":"2023-03-03T06:23:44.408155+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:23:44.408155+0000","last_undegraded":"2023-03-03T06:23:44.408155+0000","last_fullsized":"2023-03-03T06:23:44.408155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408305+0000","last_change":"2023-03-03T06:23:39.911439+0000","last_active":"2023-03-03T06:23:44.408305+0000","last_peered":"2023-03-03T06:23:44.408305+0000","last_clean":"2023-03-03T06:23:44.408305+0000","last_became_active":"2023-03-03T06:23:39.910571+0000","last_became_peered":"2023-03-03T06:23:39.910571+0000","last_unstale":"2023-03-03T06:23:44.408305+0000","last_undegraded":"2023-03-03T06:23:44.408305+0000","last_fullsized":"2023-03-03T06:23:44.408305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:05:05.468654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408707+0000","last_change":"2023-03-03T06:23:40.331506+0000","last_active":"2023-03-03T06:23:44.408707+0000","last_peered":"2023-03-03T06:23:44.408707+0000","last_clean":"2023-03-03T06:23:44.408707+0000","last_became_active":"2023-03-03T06:23:40.331225+0000","last_became_peered":"2023-03-03T06:23:40.331225+0000","last_unstale":"2023-03-03T06:23:44.408707+0000","last_undegraded":"2023-03-03T06:23:44.408707+0000","last_fullsized":"2023-03-03T06:23:44.408707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:42:56.190690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217577+0000","last_change":"2023-03-03T06:23:44.424824+0000","last_active":"2023-03-03T06:23:45.217577+0000","last_peered":"2023-03-03T06:23:45.217577+0000","last_clean":"2023-03-03T06:23:45.217577+0000","last_became_active":"2023-03-03T06:23:44.424408+0000","last_became_peered":"2023-03-03T06:23:44.424408+0000","last_unstale":"2023-03-03T06:23:45.217577+0000","last_undegraded":"2023-03-03T06:23:45.217577+0000","last_fullsized":"2023-03-03T06:23:45.217577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:22:48.378893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407463+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:23:44.407463+0000","last_peered":"2023-03-03T06:23:44.407463+0000","last_clean":"2023-03-03T06:23:44.407463+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:23:44.407463+0000","last_undegraded":"2023-03-03T06:23:44.407463+0000","last_fullsized":"2023-03-03T06:23:44.407463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400330+0000","last_change":"2023-03-03T06:23:39.915098+0000","last_active":"2023-03-03T06:23:44.400330+0000","last_peered":"2023-03-03T06:23:44.400330+0000","last_clean":"2023-03-03T06:23:44.400330+0000","last_became_active":"2023-03-03T06:23:39.914785+0000","last_became_peered":"2023-03-03T06:23:39.914785+0000","last_unstale":"2023-03-03T06:23:44.400330+0000","last_undegraded":"2023-03-03T06:23:44.400330+0000","last_fullsized":"2023-03-03T06:23:44.400330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406226+0000","last_change":"2023-03-03T06:23:40.348600+0000","last_active":"2023-03-03T06:23:44.406226+0000","last_peered":"2023-03-03T06:23:44.406226+0000","last_clean":"2023-03-03T06:23:44.406226+0000","last_became_active":"2023-03-03T06:23:40.348139+0000","last_became_peered":"2023-03-03T06:23:40.348139+0000","last_unstale":"2023-03-03T06:23:44.406226+0000","last_undegraded":"2023-03-03T06:23:44.406226+0000","last_fullsized":"2023-03-03T06:23:44.406226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:18:37.603414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011148+0000","last_change":"2023-03-03T06:23:44.416443+0000","last_active":"2023-03-03T06:23:45.011148+0000","last_peered":"2023-03-03T06:23:45.011148+0000","last_clean":"2023-03-03T06:23:45.011148+0000","last_became_active":"2023-03-03T06:23:44.415629+0000","last_became_peered":"2023-03-03T06:23:44.415629+0000","last_unstale":"2023-03-03T06:23:45.011148+0000","last_undegraded":"2023-03-03T06:23:45.011148+0000","last_fullsized":"2023-03-03T06:23:45.011148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:45:29.403205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398099+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:23:44.398099+0000","last_peered":"2023-03-03T06:23:44.398099+0000","last_clean":"2023-03-03T06:23:44.398099+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:23:44.398099+0000","last_undegraded":"2023-03-03T06:23:44.398099+0000","last_fullsized":"2023-03-03T06:23:44.398099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396227+0000","last_change":"2023-03-03T06:23:39.917152+0000","last_active":"2023-03-03T06:23:44.396227+0000","last_peered":"2023-03-03T06:23:44.396227+0000","last_clean":"2023-03-03T06:23:44.396227+0000","last_became_active":"2023-03-03T06:23:39.916712+0000","last_became_peered":"2023-03-03T06:23:39.916712+0000","last_unstale":"2023-03-03T06:23:44.396227+0000","last_undegraded":"2023-03-03T06:23:44.396227+0000","last_fullsized":"2023-03-03T06:23:44.396227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407594+0000","last_change":"2023-03-03T06:23:40.326857+0000","last_active":"2023-03-03T06:23:44.407594+0000","last_peered":"2023-03-03T06:23:44.407594+0000","last_clean":"2023-03-03T06:23:44.407594+0000","last_became_active":"2023-03-03T06:23:40.326623+0000","last_became_peered":"2023-03-03T06:23:40.326623+0000","last_unstale":"2023-03-03T06:23:44.407594+0000","last_undegraded":"2023-03-03T06:23:44.407594+0000","last_fullsized":"2023-03-03T06:23:44.407594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:56:24.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216598+0000","last_change":"2023-03-03T06:23:44.421895+0000","last_active":"2023-03-03T06:23:45.216598+0000","last_peered":"2023-03-03T06:23:45.216598+0000","last_clean":"2023-03-03T06:23:45.216598+0000","last_became_active":"2023-03-03T06:23:44.421563+0000","last_became_peered":"2023-03-03T06:23:44.421563+0000","last_unstale":"2023-03-03T06:23:45.216598+0000","last_undegraded":"2023-03-03T06:23:45.216598+0000","last_fullsized":"2023-03-03T06:23:45.216598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:42:28.966046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406284+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:23:44.406284+0000","last_peered":"2023-03-03T06:23:44.406284+0000","last_clean":"2023-03-03T06:23:44.406284+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:23:44.406284+0000","last_undegraded":"2023-03-03T06:23:44.406284+0000","last_fullsized":"2023-03-03T06:23:44.406284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407688+0000","last_change":"2023-03-03T06:23:39.912862+0000","last_active":"2023-03-03T06:23:44.407688+0000","last_peered":"2023-03-03T06:23:44.407688+0000","last_clean":"2023-03-03T06:23:44.407688+0000","last_became_active":"2023-03-03T06:23:39.912540+0000","last_became_peered":"2023-03-03T06:23:39.912540+0000","last_unstale":"2023-03-03T06:23:44.407688+0000","last_undegraded":"2023-03-03T06:23:44.407688+0000","last_fullsized":"2023-03-03T06:23:44.407688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:40.963572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413554+0000","last_change":"2023-03-03T06:23:40.330277+0000","last_active":"2023-03-03T06:23:44.413554+0000","last_peered":"2023-03-03T06:23:44.413554+0000","last_clean":"2023-03-03T06:23:44.413554+0000","last_became_active":"2023-03-03T06:23:40.329978+0000","last_became_peered":"2023-03-03T06:23:40.329978+0000","last_unstale":"2023-03-03T06:23:44.413554+0000","last_undegraded":"2023-03-03T06:23:44.413554+0000","last_fullsized":"2023-03-03T06:23:44.413554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:56:24.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011025+0000","last_change":"2023-03-03T06:23:44.414799+0000","last_active":"2023-03-03T06:23:45.011025+0000","last_peered":"2023-03-03T06:23:45.011025+0000","last_clean":"2023-03-03T06:23:45.011025+0000","last_became_active":"2023-03-03T06:23:44.414225+0000","last_became_peered":"2023-03-03T06:23:44.414225+0000","last_unstale":"2023-03-03T06:23:45.011025+0000","last_undegraded":"2023-03-03T06:23:45.011025+0000","last_fullsized":"2023-03-03T06:23:45.011025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:28:15.023557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406901+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:23:44.406901+0000","last_peered":"2023-03-03T06:23:44.406901+0000","last_clean":"2023-03-03T06:23:44.406901+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:23:44.406901+0000","last_undegraded":"2023-03-03T06:23:44.406901+0000","last_fullsized":"2023-03-03T06:23:44.406901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399724+0000","last_change":"2023-03-03T06:23:39.918687+0000","last_active":"2023-03-03T06:23:44.399724+0000","last_peered":"2023-03-03T06:23:44.399724+0000","last_clean":"2023-03-03T06:23:44.399724+0000","last_became_active":"2023-03-03T06:23:39.918213+0000","last_became_peered":"2023-03-03T06:23:39.918213+0000","last_unstale":"2023-03-03T06:23:44.399724+0000","last_undegraded":"2023-03-03T06:23:44.399724+0000","last_fullsized":"2023-03-03T06:23:44.399724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406330+0000","last_change":"2023-03-03T06:23:40.329407+0000","last_active":"2023-03-03T06:23:44.406330+0000","last_peered":"2023-03-03T06:23:44.406330+0000","last_clean":"2023-03-03T06:23:44.406330+0000","last_became_active":"2023-03-03T06:23:40.329131+0000","last_became_peered":"2023-03-03T06:23:40.329131+0000","last_unstale":"2023-03-03T06:23:44.406330+0000","last_undegraded":"2023-03-03T06:23:44.406330+0000","last_fullsized":"2023-03-03T06:23:44.406330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:41:25.301780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.821924+0000","last_change":"2023-03-03T06:23:44.421929+0000","last_active":"2023-03-03T06:23:44.821924+0000","last_peered":"2023-03-03T06:23:44.821924+0000","last_clean":"2023-03-03T06:23:44.821924+0000","last_became_active":"2023-03-03T06:23:44.421457+0000","last_became_peered":"2023-03-03T06:23:44.421457+0000","last_unstale":"2023-03-03T06:23:44.821924+0000","last_undegraded":"2023-03-03T06:23:44.821924+0000","last_fullsized":"2023-03-03T06:23:44.821924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:03:17.411194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413461+0000","last_change":"2023-03-03T06:23:39.916295+0000","last_active":"2023-03-03T06:23:44.413461+0000","last_peered":"2023-03-03T06:23:44.413461+0000","last_clean":"2023-03-03T06:23:44.413461+0000","last_became_active":"2023-03-03T06:23:39.916027+0000","last_became_peered":"2023-03-03T06:23:39.916027+0000","last_unstale":"2023-03-03T06:23:44.413461+0000","last_undegraded":"2023-03-03T06:23:44.413461+0000","last_fullsized":"2023-03-03T06:23:44.413461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:19:38.164048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394183+0000","last_change":"2023-03-03T06:23:40.332708+0000","last_active":"2023-03-03T06:23:44.394183+0000","last_peered":"2023-03-03T06:23:44.394183+0000","last_clean":"2023-03-03T06:23:44.394183+0000","last_became_active":"2023-03-03T06:23:40.332382+0000","last_became_peered":"2023-03-03T06:23:40.332382+0000","last_unstale":"2023-03-03T06:23:44.394183+0000","last_undegraded":"2023-03-03T06:23:44.394183+0000","last_fullsized":"2023-03-03T06:23:44.394183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:39.735760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217389+0000","last_change":"2023-03-03T06:23:44.420467+0000","last_active":"2023-03-03T06:23:45.217389+0000","last_peered":"2023-03-03T06:23:45.217389+0000","last_clean":"2023-03-03T06:23:45.217389+0000","last_became_active":"2023-03-03T06:23:44.420078+0000","last_became_peered":"2023-03-03T06:23:44.420078+0000","last_unstale":"2023-03-03T06:23:45.217389+0000","last_undegraded":"2023-03-03T06:23:45.217389+0000","last_fullsized":"2023-03-03T06:23:45.217389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:03:17.411194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398998+0000","last_change":"2023-03-03T06:23:39.911136+0000","last_active":"2023-03-03T06:23:44.398998+0000","last_peered":"2023-03-03T06:23:44.398998+0000","last_clean":"2023-03-03T06:23:44.398998+0000","last_became_active":"2023-03-03T06:23:39.910722+0000","last_became_peered":"2023-03-03T06:23:39.910722+0000","last_unstale":"2023-03-03T06:23:44.398998+0000","last_undegraded":"2023-03-03T06:23:44.398998+0000","last_fullsized":"2023-03-03T06:23:44.398998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:44.071696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396133+0000","last_change":"2023-03-03T06:23:40.350618+0000","last_active":"2023-03-03T06:23:44.396133+0000","last_peered":"2023-03-03T06:23:44.396133+0000","last_clean":"2023-03-03T06:23:44.396133+0000","last_became_active":"2023-03-03T06:23:40.350186+0000","last_became_peered":"2023-03-03T06:23:40.350186+0000","last_unstale":"2023-03-03T06:23:44.396133+0000","last_undegraded":"2023-03-03T06:23:44.396133+0000","last_fullsized":"2023-03-03T06:23:44.396133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:19.510143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216582+0000","last_change":"2023-03-03T06:23:44.421952+0000","last_active":"2023-03-03T06:23:45.216582+0000","last_peered":"2023-03-03T06:23:45.216582+0000","last_clean":"2023-03-03T06:23:45.216582+0000","last_became_active":"2023-03-03T06:23:44.421492+0000","last_became_peered":"2023-03-03T06:23:44.421492+0000","last_unstale":"2023-03-03T06:23:45.216582+0000","last_undegraded":"2023-03-03T06:23:45.216582+0000","last_fullsized":"2023-03-03T06:23:45.216582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:22:48.378893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399293+0000","last_change":"2023-03-03T06:23:39.918470+0000","last_active":"2023-03-03T06:23:44.399293+0000","last_peered":"2023-03-03T06:23:44.399293+0000","last_clean":"2023-03-03T06:23:44.399293+0000","last_became_active":"2023-03-03T06:23:39.917860+0000","last_became_peered":"2023-03-03T06:23:39.917860+0000","last_unstale":"2023-03-03T06:23:44.399293+0000","last_undegraded":"2023-03-03T06:23:44.399293+0000","last_fullsized":"2023-03-03T06:23:44.399293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:20.326465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396555+0000","last_change":"2023-03-03T06:23:40.347706+0000","last_active":"2023-03-03T06:23:44.396555+0000","last_peered":"2023-03-03T06:23:44.396555+0000","last_clean":"2023-03-03T06:23:44.396555+0000","last_became_active":"2023-03-03T06:23:40.344594+0000","last_became_peered":"2023-03-03T06:23:40.344594+0000","last_unstale":"2023-03-03T06:23:44.396555+0000","last_undegraded":"2023-03-03T06:23:44.396555+0000","last_fullsized":"2023-03-03T06:23:44.396555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822175+0000","last_change":"2023-03-03T06:23:44.412148+0000","last_active":"2023-03-03T06:23:44.822175+0000","last_peered":"2023-03-03T06:23:44.822175+0000","last_clean":"2023-03-03T06:23:44.822175+0000","last_became_active":"2023-03-03T06:23:44.411541+0000","last_became_peered":"2023-03-03T06:23:44.411541+0000","last_unstale":"2023-03-03T06:23:44.822175+0000","last_undegraded":"2023-03-03T06:23:44.822175+0000","last_fullsized":"2023-03-03T06:23:44.822175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:11:52.237707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397307+0000","last_change":"2023-03-03T06:23:39.913487+0000","last_active":"2023-03-03T06:23:44.397307+0000","last_peered":"2023-03-03T06:23:44.397307+0000","last_clean":"2023-03-03T06:23:44.397307+0000","last_became_active":"2023-03-03T06:23:39.913194+0000","last_became_peered":"2023-03-03T06:23:39.913194+0000","last_unstale":"2023-03-03T06:23:44.397307+0000","last_undegraded":"2023-03-03T06:23:44.397307+0000","last_fullsized":"2023-03-03T06:23:44.397307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:20.326465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397158+0000","last_change":"2023-03-03T06:23:40.338004+0000","last_active":"2023-03-03T06:23:44.397158+0000","last_peered":"2023-03-03T06:23:44.397158+0000","last_clean":"2023-03-03T06:23:44.397158+0000","last_became_active":"2023-03-03T06:23:40.337689+0000","last_became_peered":"2023-03-03T06:23:40.337689+0000","last_unstale":"2023-03-03T06:23:44.397158+0000","last_undegraded":"2023-03-03T06:23:44.397158+0000","last_fullsized":"2023-03-03T06:23:44.397158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:00.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.821814+0000","last_change":"2023-03-03T06:23:44.413502+0000","last_active":"2023-03-03T06:23:44.821814+0000","last_peered":"2023-03-03T06:23:44.821814+0000","last_clean":"2023-03-03T06:23:44.821814+0000","last_became_active":"2023-03-03T06:23:44.413099+0000","last_became_peered":"2023-03-03T06:23:44.413099+0000","last_unstale":"2023-03-03T06:23:44.821814+0000","last_undegraded":"2023-03-03T06:23:44.821814+0000","last_fullsized":"2023-03-03T06:23:44.821814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:23.008849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414685+0000","last_change":"2023-03-03T06:23:39.911148+0000","last_active":"2023-03-03T06:23:44.414685+0000","last_peered":"2023-03-03T06:23:44.414685+0000","last_clean":"2023-03-03T06:23:44.414685+0000","last_became_active":"2023-03-03T06:23:39.910465+0000","last_became_peered":"2023-03-03T06:23:39.910465+0000","last_unstale":"2023-03-03T06:23:44.414685+0000","last_undegraded":"2023-03-03T06:23:44.414685+0000","last_fullsized":"2023-03-03T06:23:44.414685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398776+0000","last_change":"2023-03-03T06:23:40.347365+0000","last_active":"2023-03-03T06:23:44.398776+0000","last_peered":"2023-03-03T06:23:44.398776+0000","last_clean":"2023-03-03T06:23:44.398776+0000","last_became_active":"2023-03-03T06:23:40.347102+0000","last_became_peered":"2023-03-03T06:23:40.347102+0000","last_unstale":"2023-03-03T06:23:44.398776+0000","last_undegraded":"2023-03-03T06:23:44.398776+0000","last_fullsized":"2023-03-03T06:23:44.398776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:42:25.467339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406140+0000","last_change":"2023-03-03T06:23:40.337697+0000","last_active":"2023-03-03T06:23:44.406140+0000","last_peered":"2023-03-03T06:23:44.406140+0000","last_clean":"2023-03-03T06:23:44.406140+0000","last_became_active":"2023-03-03T06:23:40.337414+0000","last_became_peered":"2023-03-03T06:23:40.337414+0000","last_unstale":"2023-03-03T06:23:44.406140+0000","last_undegraded":"2023-03-03T06:23:44.406140+0000","last_fullsized":"2023-03-03T06:23:44.406140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:05:13.223033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396852+0000","last_change":"2023-03-03T06:23:40.340779+0000","last_active":"2023-03-03T06:23:44.396852+0000","last_peered":"2023-03-03T06:23:44.396852+0000","last_clean":"2023-03-03T06:23:44.396852+0000","last_became_active":"2023-03-03T06:23:40.338305+0000","last_became_peered":"2023-03-03T06:23:40.338305+0000","last_unstale":"2023-03-03T06:23:44.396852+0000","last_undegraded":"2023-03-03T06:23:44.396852+0000","last_fullsized":"2023-03-03T06:23:44.396852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:26.393574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396806+0000","last_change":"2023-03-03T06:23:40.348094+0000","last_active":"2023-03-03T06:23:44.396806+0000","last_peered":"2023-03-03T06:23:44.396806+0000","last_clean":"2023-03-03T06:23:44.396806+0000","last_became_active":"2023-03-03T06:23:40.347736+0000","last_became_peered":"2023-03-03T06:23:40.347736+0000","last_unstale":"2023-03-03T06:23:44.396806+0000","last_undegraded":"2023-03-03T06:23:44.396806+0000","last_fullsized":"2023-03-03T06:23:44.396806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:11:53.657995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401149+0000","last_change":"2023-03-03T06:23:40.349146+0000","last_active":"2023-03-03T06:23:44.401149+0000","last_peered":"2023-03-03T06:23:44.401149+0000","last_clean":"2023-03-03T06:23:44.401149+0000","last_became_active":"2023-03-03T06:23:40.348873+0000","last_became_peered":"2023-03-03T06:23:40.348873+0000","last_unstale":"2023-03-03T06:23:44.401149+0000","last_undegraded":"2023-03-03T06:23:44.401149+0000","last_fullsized":"2023-03-03T06:23:44.401149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407642+0000","last_change":"2023-03-03T06:23:40.348472+0000","last_active":"2023-03-03T06:23:44.407642+0000","last_peered":"2023-03-03T06:23:44.407642+0000","last_clean":"2023-03-03T06:23:44.407642+0000","last_became_active":"2023-03-03T06:23:40.348181+0000","last_became_peered":"2023-03-03T06:23:40.348181+0000","last_unstale":"2023-03-03T06:23:44.407642+0000","last_undegraded":"2023-03-03T06:23:44.407642+0000","last_fullsized":"2023-03-03T06:23:44.407642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:03:45.180190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4528,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":703731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8076,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363764,"statfs":{"total":96636764160,"available":96628494336,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9232,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362608,"statfs":{"total":96636764160,"available":96627310592,"internally_reserved":0,"allocated":860160,"data_stored":699769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8140,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363700,"statfs":{"total":96636764160,"available":96628428800,"internally_reserved":0,"allocated":266240,"data_stored":109006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8076,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363764,"statfs":{"total":96636764160,"available":96628494336,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":270336,"data_stored":109491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8224,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363616,"statfs":{"total":96636764160,"available":96628342784,"internally_reserved":0,"allocated":286720,"data_stored":113203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":270336,"data_stored":109076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:24:04.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:24:04.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.549+0000 7f010cbbe700 1 Processor -- start 2023-03-03T06:24:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.549+0000 7f010cbbe700 1 -- start start 2023-03-03T06:24:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.550+0000 7f010cbbe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f010815a7d0 0x7f01080c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.550+0000 7f010cbbe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f01080cb690 0x7f010815ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.550+0000 7f010cbbe700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010815e580 con 0x7f010815ef50 2023-03-03T06:24:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.550+0000 7f010cbbe700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01080ca710 con 0x7f010815a7d0 2023-03-03T06:24:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.550+0000 7f010cbbe700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01080ca9f0 con 0x7f01080cb690 2023-03-03T06:24:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f010659c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f010815a7d0 0x7f01080c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f0106d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f010815ef50 0x7f010806a330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60004/0 (socket says 172.21.15.5:60004) 2023-03-03T06:24:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f0106d9d700 1 -- 172.21.15.5:0/3671899773 learned_addr learned my addr 172.21.15.5:0/3671899773 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f0105d9b700 1 --2- 172.21.15.5:0/3671899773 >> v2:172.21.15.191:3300/0 conn(0x7f01080cb690 0x7f010815ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f010659c700 1 -- 172.21.15.5:0/3671899773 >> v2:172.21.15.191:3300/0 conn(0x7f01080cb690 msgr2=0x7f010815ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f010659c700 1 --2- 172.21.15.5:0/3671899773 >> v2:172.21.15.191:3300/0 conn(0x7f01080cb690 0x7f010815ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f010659c700 1 -- 172.21.15.5:0/3671899773 >> v1:172.21.15.5:6789/0 conn(0x7f010815ef50 legacy=0x7f010806a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f010659c700 1 -- 172.21.15.5:0/3671899773 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01080cacd0 con 0x7f010815a7d0 2023-03-03T06:24:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f010559a700 1 -- 172.21.15.5:0/3671899773 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594099103 0 0) 0x7f010815e580 con 0x7f010815ef50 2023-03-03T06:24:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f0105d9b700 1 --2- 172.21.15.5:0/3671899773 >> v2:172.21.15.191:3300/0 conn(0x7f01080cb690 0x7f010815ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f010659c700 1 --2- 172.21.15.5:0/3671899773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815a7d0 0x7f01080c9ec0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0108066dc0 tx=0x7f00f0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bf559ada1e7276 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f010559a700 1 -- 172.21.15.5:0/3671899773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0011830 con 0x7f010815a7d0 2023-03-03T06:24:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f010559a700 1 -- 172.21.15.5:0/3671899773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f0011990 con 0x7f010815a7d0 2023-03-03T06:24:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.551+0000 7f010559a700 1 -- 172.21.15.5:0/3671899773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0011d20 con 0x7f010815a7d0 2023-03-03T06:24:04.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.552+0000 7f010cbbe700 1 -- 172.21.15.5:0/3671899773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815a7d0 msgr2=0x7f01080c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.552+0000 7f010cbbe700 1 --2- 172.21.15.5:0/3671899773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815a7d0 0x7f01080c9ec0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0108066dc0 tx=0x7f00f0009b20 comp rx=0 tx=0).stop 2023-03-03T06:24:04.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.552+0000 7f010cbbe700 1 -- 172.21.15.5:0/3671899773 shutdown_connections 2023-03-03T06:24:04.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.552+0000 7f010cbbe700 1 --2- 172.21.15.5:0/3671899773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815a7d0 0x7f01080c9ec0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.552+0000 7f010cbbe700 1 --2- 172.21.15.5:0/3671899773 >> v2:172.21.15.191:3300/0 conn(0x7f01080cb690 0x7f010815ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.552+0000 7f010cbbe700 1 -- 172.21.15.5:0/3671899773 >> 172.21.15.5:0/3671899773 conn(0x7f01080cf4b0 msgr2=0x7f01080cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.552+0000 7f010cbbe700 1 -- 172.21.15.5:0/3671899773 shutdown_connections 2023-03-03T06:24:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.552+0000 7f010cbbe700 1 -- 172.21.15.5:0/3671899773 wait complete. 2023-03-03T06:24:04.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.553+0000 7f010cbbe700 1 Processor -- start 2023-03-03T06:24:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.553+0000 7f010cbbe700 1 -- start start 2023-03-03T06:24:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f010cbbe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01080cb690 0x7f01080ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f010cbbe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815a7d0 0x7f010815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f010cbbe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f010815ef50 0x7f010815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f010cbbe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010815b960 con 0x7f010815a7d0 2023-03-03T06:24:04.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f010cbbe700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0108153230 con 0x7f01080cb690 2023-03-03T06:24:04.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f010cbbe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010815db20 con 0x7f010815ef50 2023-03-03T06:24:04.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f0105d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815a7d0 0x7f010815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f0105d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815a7d0 0x7f010815d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41934/0 (socket says 172.21.15.5:41934) 2023-03-03T06:24:04.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f0105d9b700 1 -- 172.21.15.5:0/3150487060 learned_addr learned my addr 172.21.15.5:0/3150487060 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f0106d9d700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f010815ef50 0x7f010815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f010659c700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01080cb690 0x7f01080ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f0105d9b700 1 -- 172.21.15.5:0/3150487060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f010815ef50 msgr2=0x7f010815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f0105d9b700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f010815ef50 0x7f010815d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f0105d9b700 1 -- 172.21.15.5:0/3150487060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01080cb690 msgr2=0x7f01080ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f0105d9b700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01080cb690 0x7f01080ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f0105d9b700 1 -- 172.21.15.5:0/3150487060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f00094a0 con 0x7f010815a7d0 2023-03-03T06:24:04.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.554+0000 7f010659c700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01080cb690 0x7f01080ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:04.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.555+0000 7f0105d9b700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815a7d0 0x7f010815d0a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c750 tx=0x7f00f800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:04.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.555+0000 7f00feffd700 1 -- 172.21.15.5:0/3150487060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8011800 con 0x7f010815a7d0 2023-03-03T06:24:04.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.555+0000 7f010cbbe700 1 -- 172.21.15.5:0/3150487060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01080ca400 con 0x7f010815a7d0 2023-03-03T06:24:04.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.555+0000 7f00feffd700 1 -- 172.21.15.5:0/3150487060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f8011960 con 0x7f010815a7d0 2023-03-03T06:24:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.555+0000 7f00feffd700 1 -- 172.21.15.5:0/3150487060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8011cd0 con 0x7f010815a7d0 2023-03-03T06:24:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.555+0000 7f010cbbe700 1 -- 172.21.15.5:0/3150487060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010815e210 con 0x7f010815a7d0 2023-03-03T06:24:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.556+0000 7f010cbbe700 1 -- 172.21.15.5:0/3150487060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010806aa40 con 0x7f010815a7d0 2023-03-03T06:24:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.556+0000 7f00feffd700 1 -- 172.21.15.5:0/3150487060 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f00f8020070 con 0x7f010815a7d0 2023-03-03T06:24:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.557+0000 7f00feffd700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f00e80682f0 0x7f00e806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.557+0000 7f00feffd700 1 -- 172.21.15.5:0/3150487060 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f00f8085e80 con 0x7f010815a7d0 2023-03-03T06:24:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.557+0000 7f010659c700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f00e80682f0 0x7f00e806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.557+0000 7f010659c700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f00e80682f0 0x7f00e806a7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009b60 tx=0x7f00f0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:04.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.563+0000 7f00feffd700 1 -- 172.21.15.5:0/3150487060 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f00f8052370 con 0x7f010815a7d0 2023-03-03T06:24:04.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.752+0000 7f010cbbe700 1 -- 172.21.15.5:0/3150487060 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f010804e6e0 con 0x7f00e80682f0 2023-03-03T06:24:04.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.761+0000 7f00feffd700 1 -- 172.21.15.5:0/3150487060 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367586 (secure 0 0 0) 0x7f010804e6e0 con 0x7f00e80682f0 2023-03-03T06:24:04.767 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.765+0000 7f010cbbe700 1 -- 172.21.15.5:0/3150487060 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f00e80682f0 msgr2=0x7f00e806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.765+0000 7f010cbbe700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f00e80682f0 0x7f00e806a7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009b60 tx=0x7f00f0008030 comp rx=0 tx=0).stop 2023-03-03T06:24:04.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.765+0000 7f010cbbe700 1 -- 172.21.15.5:0/3150487060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815a7d0 msgr2=0x7f010815d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.765+0000 7f010cbbe700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815a7d0 0x7f010815d0a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c750 tx=0x7f00f800cb10 comp rx=0 tx=0).stop 2023-03-03T06:24:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.765+0000 7f010cbbe700 1 -- 172.21.15.5:0/3150487060 shutdown_connections 2023-03-03T06:24:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.765+0000 7f010cbbe700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f00e80682f0 0x7f00e806a7a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.765+0000 7f010cbbe700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f010815ef50 0x7f010815d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.765+0000 7f010cbbe700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f01080cb690 0x7f01080ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.765+0000 7f010cbbe700 1 --2- 172.21.15.5:0/3150487060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f010815a7d0 0x7f010815d0a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.765+0000 7f010cbbe700 1 -- 172.21.15.5:0/3150487060 >> 172.21.15.5:0/3150487060 conn(0x7f01080cf4b0 msgr2=0x7f010806dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.766+0000 7f010cbbe700 1 -- 172.21.15.5:0/3150487060 shutdown_connections 2023-03-03T06:24:04.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.766+0000 7f010cbbe700 1 -- 172.21.15.5:0/3150487060 wait complete. 2023-03-03T06:24:04.773 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:24:04.780 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-03-03T06:24:03.467268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594896,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67296,"kb_used_data":3296,"kb_used_omap":0,"kb_used_meta":63936,"kb_avail":754907424,"statfs":{"total":773094113280,"available":773025202176,"internally_reserved":0,"allocated":3375104,"data_stored":2063078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65470464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2198,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004871"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394791+0000","last_change":"2023-03-03T06:23:40.340008+0000","last_active":"2023-03-03T06:23:44.394791+0000","last_peered":"2023-03-03T06:23:44.394791+0000","last_clean":"2023-03-03T06:23:44.394791+0000","last_became_active":"2023-03-03T06:23:40.339743+0000","last_became_peered":"2023-03-03T06:23:40.339743+0000","last_unstale":"2023-03-03T06:23:44.394791+0000","last_undegraded":"2023-03-03T06:23:44.394791+0000","last_fullsized":"2023-03-03T06:23:44.394791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:45.077306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400923+0000","last_change":"2023-03-03T06:23:40.328386+0000","last_active":"2023-03-03T06:23:44.400923+0000","last_peered":"2023-03-03T06:23:44.400923+0000","last_clean":"2023-03-03T06:23:44.400923+0000","last_became_active":"2023-03-03T06:23:40.328078+0000","last_became_peered":"2023-03-03T06:23:40.328078+0000","last_unstale":"2023-03-03T06:23:44.400923+0000","last_undegraded":"2023-03-03T06:23:44.400923+0000","last_fullsized":"2023-03-03T06:23:44.400923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:56:24.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396143+0000","last_change":"2023-03-03T06:23:40.351193+0000","last_active":"2023-03-03T06:23:44.396143+0000","last_peered":"2023-03-03T06:23:44.396143+0000","last_clean":"2023-03-03T06:23:44.396143+0000","last_became_active":"2023-03-03T06:23:40.348126+0000","last_became_peered":"2023-03-03T06:23:40.348126+0000","last_unstale":"2023-03-03T06:23:44.396143+0000","last_undegraded":"2023-03-03T06:23:44.396143+0000","last_fullsized":"2023-03-03T06:23:44.396143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:22:34.948853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406192+0000","last_change":"2023-03-03T06:23:40.339457+0000","last_active":"2023-03-03T06:23:44.406192+0000","last_peered":"2023-03-03T06:23:44.406192+0000","last_clean":"2023-03-03T06:23:44.406192+0000","last_became_active":"2023-03-03T06:23:40.339154+0000","last_became_peered":"2023-03-03T06:23:40.339154+0000","last_unstale":"2023-03-03T06:23:44.406192+0000","last_undegraded":"2023-03-03T06:23:44.406192+0000","last_fullsized":"2023-03-03T06:23:44.406192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:41:25.301780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413710+0000","last_change":"2023-03-03T06:23:40.342264+0000","last_active":"2023-03-03T06:23:44.413710+0000","last_peered":"2023-03-03T06:23:44.413710+0000","last_clean":"2023-03-03T06:23:44.413710+0000","last_became_active":"2023-03-03T06:23:40.340178+0000","last_became_peered":"2023-03-03T06:23:40.340178+0000","last_unstale":"2023-03-03T06:23:44.413710+0000","last_undegraded":"2023-03-03T06:23:44.413710+0000","last_fullsized":"2023-03-03T06:23:44.413710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:50.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396834+0000","last_change":"2023-03-03T06:23:40.344569+0000","last_active":"2023-03-03T06:23:44.396834+0000","last_peered":"2023-03-03T06:23:44.396834+0000","last_clean":"2023-03-03T06:23:44.396834+0000","last_became_active":"2023-03-03T06:23:40.344219+0000","last_became_peered":"2023-03-03T06:23:40.344219+0000","last_unstale":"2023-03-03T06:23:44.396834+0000","last_undegraded":"2023-03-03T06:23:44.396834+0000","last_fullsized":"2023-03-03T06:23:44.396834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:54:28.908384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407523+0000","last_change":"2023-03-03T06:23:40.346056+0000","last_active":"2023-03-03T06:23:44.407523+0000","last_peered":"2023-03-03T06:23:44.407523+0000","last_clean":"2023-03-03T06:23:44.407523+0000","last_became_active":"2023-03-03T06:23:40.345549+0000","last_became_peered":"2023-03-03T06:23:40.345549+0000","last_unstale":"2023-03-03T06:23:44.407523+0000","last_undegraded":"2023-03-03T06:23:44.407523+0000","last_fullsized":"2023-03-03T06:23:44.407523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:00.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398934+0000","last_change":"2023-03-03T06:23:40.341498+0000","last_active":"2023-03-03T06:23:44.398934+0000","last_peered":"2023-03-03T06:23:44.398934+0000","last_clean":"2023-03-03T06:23:44.398934+0000","last_became_active":"2023-03-03T06:23:40.341212+0000","last_became_peered":"2023-03-03T06:23:40.341212+0000","last_unstale":"2023-03-03T06:23:44.398934+0000","last_undegraded":"2023-03-03T06:23:44.398934+0000","last_fullsized":"2023-03-03T06:23:44.398934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:42:56.190690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414254+0000","last_change":"2023-03-03T06:23:40.342151+0000","last_active":"2023-03-03T06:23:44.414254+0000","last_peered":"2023-03-03T06:23:44.414254+0000","last_clean":"2023-03-03T06:23:44.414254+0000","last_became_active":"2023-03-03T06:23:40.340195+0000","last_became_peered":"2023-03-03T06:23:40.340195+0000","last_unstale":"2023-03-03T06:23:44.414254+0000","last_undegraded":"2023-03-03T06:23:44.414254+0000","last_fullsized":"2023-03-03T06:23:44.414254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:26.393574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401024+0000","last_change":"2023-03-03T06:23:40.329308+0000","last_active":"2023-03-03T06:23:44.401024+0000","last_peered":"2023-03-03T06:23:44.401024+0000","last_clean":"2023-03-03T06:23:44.401024+0000","last_became_active":"2023-03-03T06:23:40.329047+0000","last_became_peered":"2023-03-03T06:23:40.329047+0000","last_unstale":"2023-03-03T06:23:44.401024+0000","last_undegraded":"2023-03-03T06:23:44.401024+0000","last_fullsized":"2023-03-03T06:23:44.401024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396048+0000","last_change":"2023-03-03T06:23:40.350139+0000","last_active":"2023-03-03T06:23:44.396048+0000","last_peered":"2023-03-03T06:23:44.396048+0000","last_clean":"2023-03-03T06:23:44.396048+0000","last_became_active":"2023-03-03T06:23:40.344315+0000","last_became_peered":"2023-03-03T06:23:40.344315+0000","last_unstale":"2023-03-03T06:23:44.396048+0000","last_undegraded":"2023-03-03T06:23:44.396048+0000","last_fullsized":"2023-03-03T06:23:44.396048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.395100+0000","last_change":"2023-03-03T06:23:40.347207+0000","last_active":"2023-03-03T06:23:44.395100+0000","last_peered":"2023-03-03T06:23:44.395100+0000","last_clean":"2023-03-03T06:23:44.395100+0000","last_became_active":"2023-03-03T06:23:40.346966+0000","last_became_peered":"2023-03-03T06:23:40.346966+0000","last_unstale":"2023-03-03T06:23:44.395100+0000","last_undegraded":"2023-03-03T06:23:44.395100+0000","last_fullsized":"2023-03-03T06:23:44.395100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:50.785469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394027+0000","last_change":"2023-03-03T06:23:40.337391+0000","last_active":"2023-03-03T06:23:44.394027+0000","last_peered":"2023-03-03T06:23:44.394027+0000","last_clean":"2023-03-03T06:23:44.394027+0000","last_became_active":"2023-03-03T06:23:40.337119+0000","last_became_peered":"2023-03-03T06:23:40.337119+0000","last_unstale":"2023-03-03T06:23:44.394027+0000","last_undegraded":"2023-03-03T06:23:44.394027+0000","last_fullsized":"2023-03-03T06:23:44.394027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:21.332075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398880+0000","last_change":"2023-03-03T06:23:40.334786+0000","last_active":"2023-03-03T06:23:44.398880+0000","last_peered":"2023-03-03T06:23:44.398880+0000","last_clean":"2023-03-03T06:23:44.398880+0000","last_became_active":"2023-03-03T06:23:40.334489+0000","last_became_peered":"2023-03-03T06:23:40.334489+0000","last_unstale":"2023-03-03T06:23:44.398880+0000","last_undegraded":"2023-03-03T06:23:44.398880+0000","last_fullsized":"2023-03-03T06:23:44.398880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407409+0000","last_change":"2023-03-03T06:23:40.346226+0000","last_active":"2023-03-03T06:23:44.407409+0000","last_peered":"2023-03-03T06:23:44.407409+0000","last_clean":"2023-03-03T06:23:44.407409+0000","last_became_active":"2023-03-03T06:23:40.345791+0000","last_became_peered":"2023-03-03T06:23:40.345791+0000","last_unstale":"2023-03-03T06:23:44.407409+0000","last_undegraded":"2023-03-03T06:23:44.407409+0000","last_fullsized":"2023-03-03T06:23:44.407409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:17.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398869+0000","last_change":"2023-03-03T06:23:40.344976+0000","last_active":"2023-03-03T06:23:44.398869+0000","last_peered":"2023-03-03T06:23:44.398869+0000","last_clean":"2023-03-03T06:23:44.398869+0000","last_became_active":"2023-03-03T06:23:40.339923+0000","last_became_peered":"2023-03-03T06:23:40.339923+0000","last_unstale":"2023-03-03T06:23:44.398869+0000","last_undegraded":"2023-03-03T06:23:44.398869+0000","last_fullsized":"2023-03-03T06:23:44.398869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:40:38.222408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414475+0000","last_change":"2023-03-03T06:23:40.342480+0000","last_active":"2023-03-03T06:23:44.414475+0000","last_peered":"2023-03-03T06:23:44.414475+0000","last_clean":"2023-03-03T06:23:44.414475+0000","last_became_active":"2023-03-03T06:23:40.339835+0000","last_became_peered":"2023-03-03T06:23:40.339835+0000","last_unstale":"2023-03-03T06:23:44.414475+0000","last_undegraded":"2023-03-03T06:23:44.414475+0000","last_fullsized":"2023-03-03T06:23:44.414475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:57:56.186885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398423+0000","last_change":"2023-03-03T06:23:40.340711+0000","last_active":"2023-03-03T06:23:44.398423+0000","last_peered":"2023-03-03T06:23:44.398423+0000","last_clean":"2023-03-03T06:23:44.398423+0000","last_became_active":"2023-03-03T06:23:40.340400+0000","last_became_peered":"2023-03-03T06:23:40.340400+0000","last_unstale":"2023-03-03T06:23:44.398423+0000","last_undegraded":"2023-03-03T06:23:44.398423+0000","last_fullsized":"2023-03-03T06:23:44.398423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:38:27.325418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394986+0000","last_change":"2023-03-03T06:23:40.335402+0000","last_active":"2023-03-03T06:23:44.394986+0000","last_peered":"2023-03-03T06:23:44.394986+0000","last_clean":"2023-03-03T06:23:44.394986+0000","last_became_active":"2023-03-03T06:23:40.335101+0000","last_became_peered":"2023-03-03T06:23:40.335101+0000","last_unstale":"2023-03-03T06:23:44.394986+0000","last_undegraded":"2023-03-03T06:23:44.394986+0000","last_fullsized":"2023-03-03T06:23:44.394986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:41.969182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397647+0000","last_change":"2023-03-03T06:23:40.347472+0000","last_active":"2023-03-03T06:23:44.397647+0000","last_peered":"2023-03-03T06:23:44.397647+0000","last_clean":"2023-03-03T06:23:44.397647+0000","last_became_active":"2023-03-03T06:23:40.345241+0000","last_became_peered":"2023-03-03T06:23:40.345241+0000","last_unstale":"2023-03-03T06:23:44.397647+0000","last_undegraded":"2023-03-03T06:23:44.397647+0000","last_fullsized":"2023-03-03T06:23:44.397647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:59:25.244715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407721+0000","last_change":"2023-03-03T06:23:40.352895+0000","last_active":"2023-03-03T06:23:44.407721+0000","last_peered":"2023-03-03T06:23:44.407721+0000","last_clean":"2023-03-03T06:23:44.407721+0000","last_became_active":"2023-03-03T06:23:40.352576+0000","last_became_peered":"2023-03-03T06:23:40.352576+0000","last_unstale":"2023-03-03T06:23:44.407721+0000","last_undegraded":"2023-03-03T06:23:44.407721+0000","last_fullsized":"2023-03-03T06:23:44.407721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407761+0000","last_change":"2023-03-03T06:23:40.329918+0000","last_active":"2023-03-03T06:23:44.407761+0000","last_peered":"2023-03-03T06:23:44.407761+0000","last_clean":"2023-03-03T06:23:44.407761+0000","last_became_active":"2023-03-03T06:23:40.327770+0000","last_became_peered":"2023-03-03T06:23:40.327770+0000","last_unstale":"2023-03-03T06:23:44.407761+0000","last_undegraded":"2023-03-03T06:23:44.407761+0000","last_fullsized":"2023-03-03T06:23:44.407761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396955+0000","last_change":"2023-03-03T06:23:40.341354+0000","last_active":"2023-03-03T06:23:44.396955+0000","last_peered":"2023-03-03T06:23:44.396955+0000","last_clean":"2023-03-03T06:23:44.396955+0000","last_became_active":"2023-03-03T06:23:40.341048+0000","last_became_peered":"2023-03-03T06:23:40.341048+0000","last_unstale":"2023-03-03T06:23:44.396955+0000","last_undegraded":"2023-03-03T06:23:44.396955+0000","last_fullsized":"2023-03-03T06:23:44.396955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:59:25.244715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407568+0000","last_change":"2023-03-03T06:23:40.352581+0000","last_active":"2023-03-03T06:23:44.407568+0000","last_peered":"2023-03-03T06:23:44.407568+0000","last_clean":"2023-03-03T06:23:44.407568+0000","last_became_active":"2023-03-03T06:23:40.352290+0000","last_became_peered":"2023-03-03T06:23:40.352290+0000","last_unstale":"2023-03-03T06:23:44.407568+0000","last_undegraded":"2023-03-03T06:23:44.407568+0000","last_fullsized":"2023-03-03T06:23:44.407568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408648+0000","last_change":"2023-03-03T06:23:40.337724+0000","last_active":"2023-03-03T06:23:44.408648+0000","last_peered":"2023-03-03T06:23:44.408648+0000","last_clean":"2023-03-03T06:23:44.408648+0000","last_became_active":"2023-03-03T06:23:40.337448+0000","last_became_peered":"2023-03-03T06:23:40.337448+0000","last_unstale":"2023-03-03T06:23:44.408648+0000","last_undegraded":"2023-03-03T06:23:44.408648+0000","last_fullsized":"2023-03-03T06:23:44.408648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:37.500862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407962+0000","last_change":"2023-03-03T06:23:40.326813+0000","last_active":"2023-03-03T06:23:44.407962+0000","last_peered":"2023-03-03T06:23:44.407962+0000","last_clean":"2023-03-03T06:23:44.407962+0000","last_became_active":"2023-03-03T06:23:40.326512+0000","last_became_peered":"2023-03-03T06:23:40.326512+0000","last_unstale":"2023-03-03T06:23:44.407962+0000","last_undegraded":"2023-03-03T06:23:44.407962+0000","last_fullsized":"2023-03-03T06:23:44.407962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:40.681483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400716+0000","last_change":"2023-03-03T06:23:40.347745+0000","last_active":"2023-03-03T06:23:44.400716+0000","last_peered":"2023-03-03T06:23:44.400716+0000","last_clean":"2023-03-03T06:23:44.400716+0000","last_became_active":"2023-03-03T06:23:40.347373+0000","last_became_peered":"2023-03-03T06:23:40.347373+0000","last_unstale":"2023-03-03T06:23:44.400716+0000","last_undegraded":"2023-03-03T06:23:44.400716+0000","last_fullsized":"2023-03-03T06:23:44.400716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:00.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823247+0000","last_change":"2023-03-03T06:23:44.411770+0000","last_active":"2023-03-03T06:23:44.823247+0000","last_peered":"2023-03-03T06:23:44.823247+0000","last_clean":"2023-03-03T06:23:44.823247+0000","last_became_active":"2023-03-03T06:23:44.411103+0000","last_became_peered":"2023-03-03T06:23:44.411103+0000","last_unstale":"2023-03-03T06:23:44.823247+0000","last_undegraded":"2023-03-03T06:23:44.823247+0000","last_fullsized":"2023-03-03T06:23:44.823247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:52:34.159164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396733+0000","last_change":"2023-03-03T06:23:39.912910+0000","last_active":"2023-03-03T06:23:44.396733+0000","last_peered":"2023-03-03T06:23:44.396733+0000","last_clean":"2023-03-03T06:23:44.396733+0000","last_became_active":"2023-03-03T06:23:39.912705+0000","last_became_peered":"2023-03-03T06:23:39.912705+0000","last_unstale":"2023-03-03T06:23:44.396733+0000","last_undegraded":"2023-03-03T06:23:44.396733+0000","last_fullsized":"2023-03-03T06:23:44.396733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:37.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397715+0000","last_change":"2023-03-03T06:23:40.340849+0000","last_active":"2023-03-03T06:23:44.397715+0000","last_peered":"2023-03-03T06:23:44.397715+0000","last_clean":"2023-03-03T06:23:44.397715+0000","last_became_active":"2023-03-03T06:23:40.340540+0000","last_became_peered":"2023-03-03T06:23:40.340540+0000","last_unstale":"2023-03-03T06:23:44.397715+0000","last_undegraded":"2023-03-03T06:23:44.397715+0000","last_fullsized":"2023-03-03T06:23:44.397715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:57:56.186885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216333+0000","last_change":"2023-03-03T06:23:44.420347+0000","last_active":"2023-03-03T06:23:45.216333+0000","last_peered":"2023-03-03T06:23:45.216333+0000","last_clean":"2023-03-03T06:23:45.216333+0000","last_became_active":"2023-03-03T06:23:44.419965+0000","last_became_peered":"2023-03-03T06:23:44.419965+0000","last_unstale":"2023-03-03T06:23:45.216333+0000","last_undegraded":"2023-03-03T06:23:45.216333+0000","last_fullsized":"2023-03-03T06:23:45.216333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:59:28.743422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407154+0000","last_change":"2023-03-03T06:23:39.918145+0000","last_active":"2023-03-03T06:23:44.407154+0000","last_peered":"2023-03-03T06:23:44.407154+0000","last_clean":"2023-03-03T06:23:44.407154+0000","last_became_active":"2023-03-03T06:23:39.917834+0000","last_became_peered":"2023-03-03T06:23:39.917834+0000","last_unstale":"2023-03-03T06:23:44.407154+0000","last_undegraded":"2023-03-03T06:23:44.407154+0000","last_fullsized":"2023-03-03T06:23:44.407154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:37.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.412328+0000","last_change":"2023-03-03T06:23:40.345943+0000","last_active":"2023-03-03T06:23:44.412328+0000","last_peered":"2023-03-03T06:23:44.412328+0000","last_clean":"2023-03-03T06:23:44.412328+0000","last_became_active":"2023-03-03T06:23:40.345683+0000","last_became_peered":"2023-03-03T06:23:40.345683+0000","last_unstale":"2023-03-03T06:23:44.412328+0000","last_undegraded":"2023-03-03T06:23:44.412328+0000","last_fullsized":"2023-03-03T06:23:44.412328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011235+0000","last_change":"2023-03-03T06:23:44.419798+0000","last_active":"2023-03-03T06:23:45.011235+0000","last_peered":"2023-03-03T06:23:45.011235+0000","last_clean":"2023-03-03T06:23:45.011235+0000","last_became_active":"2023-03-03T06:23:44.419371+0000","last_became_peered":"2023-03-03T06:23:44.419371+0000","last_unstale":"2023-03-03T06:23:45.011235+0000","last_undegraded":"2023-03-03T06:23:45.011235+0000","last_fullsized":"2023-03-03T06:23:45.011235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:23.008849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400964+0000","last_change":"2023-03-03T06:23:39.914431+0000","last_active":"2023-03-03T06:23:44.400964+0000","last_peered":"2023-03-03T06:23:44.400964+0000","last_clean":"2023-03-03T06:23:44.400964+0000","last_became_active":"2023-03-03T06:23:39.914144+0000","last_became_peered":"2023-03-03T06:23:39.914144+0000","last_unstale":"2023-03-03T06:23:44.400964+0000","last_undegraded":"2023-03-03T06:23:44.400964+0000","last_fullsized":"2023-03-03T06:23:44.400964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406907+0000","last_change":"2023-03-03T06:23:40.335787+0000","last_active":"2023-03-03T06:23:44.406907+0000","last_peered":"2023-03-03T06:23:44.406907+0000","last_clean":"2023-03-03T06:23:44.406907+0000","last_became_active":"2023-03-03T06:23:40.334558+0000","last_became_peered":"2023-03-03T06:23:40.334558+0000","last_unstale":"2023-03-03T06:23:44.406907+0000","last_undegraded":"2023-03-03T06:23:44.406907+0000","last_fullsized":"2023-03-03T06:23:44.406907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:37.500862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215801+0000","last_change":"2023-03-03T06:23:44.418674+0000","last_active":"2023-03-03T06:23:45.215801+0000","last_peered":"2023-03-03T06:23:45.215801+0000","last_clean":"2023-03-03T06:23:45.215801+0000","last_became_active":"2023-03-03T06:23:44.418172+0000","last_became_peered":"2023-03-03T06:23:44.418172+0000","last_unstale":"2023-03-03T06:23:45.215801+0000","last_undegraded":"2023-03-03T06:23:45.215801+0000","last_fullsized":"2023-03-03T06:23:45.215801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:30.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414570+0000","last_change":"2023-03-03T06:23:39.911332+0000","last_active":"2023-03-03T06:23:44.414570+0000","last_peered":"2023-03-03T06:23:44.414570+0000","last_clean":"2023-03-03T06:23:44.414570+0000","last_became_active":"2023-03-03T06:23:39.910856+0000","last_became_peered":"2023-03-03T06:23:39.910856+0000","last_unstale":"2023-03-03T06:23:44.414570+0000","last_undegraded":"2023-03-03T06:23:44.414570+0000","last_fullsized":"2023-03-03T06:23:44.414570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:20.326465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397441+0000","last_change":"2023-03-03T06:23:40.339157+0000","last_active":"2023-03-03T06:23:44.397441+0000","last_peered":"2023-03-03T06:23:44.397441+0000","last_clean":"2023-03-03T06:23:44.397441+0000","last_became_active":"2023-03-03T06:23:40.338695+0000","last_became_peered":"2023-03-03T06:23:40.338695+0000","last_unstale":"2023-03-03T06:23:44.397441+0000","last_undegraded":"2023-03-03T06:23:44.397441+0000","last_fullsized":"2023-03-03T06:23:44.397441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:50.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216248+0000","last_change":"2023-03-03T06:23:44.424307+0000","last_active":"2023-03-03T06:23:45.216248+0000","last_peered":"2023-03-03T06:23:45.216248+0000","last_clean":"2023-03-03T06:23:45.216248+0000","last_became_active":"2023-03-03T06:23:44.423879+0000","last_became_peered":"2023-03-03T06:23:44.423879+0000","last_unstale":"2023-03-03T06:23:45.216248+0000","last_undegraded":"2023-03-03T06:23:45.216248+0000","last_fullsized":"2023-03-03T06:23:45.216248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:38:30.824125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400916+0000","last_change":"2023-03-03T06:23:39.911774+0000","last_active":"2023-03-03T06:23:44.400916+0000","last_peered":"2023-03-03T06:23:44.400916+0000","last_clean":"2023-03-03T06:23:44.400916+0000","last_became_active":"2023-03-03T06:23:39.911466+0000","last_became_peered":"2023-03-03T06:23:39.911466+0000","last_unstale":"2023-03-03T06:23:44.400916+0000","last_undegraded":"2023-03-03T06:23:44.400916+0000","last_fullsized":"2023-03-03T06:23:44.400916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:59:20.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396740+0000","last_change":"2023-03-03T06:23:40.341958+0000","last_active":"2023-03-03T06:23:44.396740+0000","last_peered":"2023-03-03T06:23:44.396740+0000","last_clean":"2023-03-03T06:23:44.396740+0000","last_became_active":"2023-03-03T06:23:40.341680+0000","last_became_peered":"2023-03-03T06:23:40.341680+0000","last_unstale":"2023-03-03T06:23:44.396740+0000","last_undegraded":"2023-03-03T06:23:44.396740+0000","last_fullsized":"2023-03-03T06:23:44.396740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:29:39.720198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822803+0000","last_change":"2023-03-03T06:23:44.424858+0000","last_active":"2023-03-03T06:23:44.822803+0000","last_peered":"2023-03-03T06:23:44.822803+0000","last_clean":"2023-03-03T06:23:44.822803+0000","last_became_active":"2023-03-03T06:23:44.424438+0000","last_became_peered":"2023-03-03T06:23:44.424438+0000","last_unstale":"2023-03-03T06:23:44.822803+0000","last_undegraded":"2023-03-03T06:23:44.822803+0000","last_fullsized":"2023-03-03T06:23:44.822803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:35:59.351177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408603+0000","last_change":"2023-03-03T06:23:39.917383+0000","last_active":"2023-03-03T06:23:44.408603+0000","last_peered":"2023-03-03T06:23:44.408603+0000","last_clean":"2023-03-03T06:23:44.408603+0000","last_became_active":"2023-03-03T06:23:39.917126+0000","last_became_peered":"2023-03-03T06:23:39.917126+0000","last_unstale":"2023-03-03T06:23:44.408603+0000","last_undegraded":"2023-03-03T06:23:44.408603+0000","last_fullsized":"2023-03-03T06:23:44.408603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:05:12.217423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406922+0000","last_change":"2023-03-03T06:23:40.336079+0000","last_active":"2023-03-03T06:23:44.406922+0000","last_peered":"2023-03-03T06:23:44.406922+0000","last_clean":"2023-03-03T06:23:44.406922+0000","last_became_active":"2023-03-03T06:23:40.335809+0000","last_became_peered":"2023-03-03T06:23:40.335809+0000","last_unstale":"2023-03-03T06:23:44.406922+0000","last_undegraded":"2023-03-03T06:23:44.406922+0000","last_fullsized":"2023-03-03T06:23:44.406922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:05:13.223033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823271+0000","last_change":"2023-03-03T06:23:44.417871+0000","last_active":"2023-03-03T06:23:44.823271+0000","last_peered":"2023-03-03T06:23:44.823271+0000","last_clean":"2023-03-03T06:23:44.823271+0000","last_became_active":"2023-03-03T06:23:44.417470+0000","last_became_peered":"2023-03-03T06:23:44.417470+0000","last_unstale":"2023-03-03T06:23:44.823271+0000","last_undegraded":"2023-03-03T06:23:44.823271+0000","last_fullsized":"2023-03-03T06:23:44.823271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:22:48.378893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:55.871487+0000","last_change":"2023-03-03T06:23:39.912856+0000","last_active":"2023-03-03T06:23:55.871487+0000","last_peered":"2023-03-03T06:23:55.871487+0000","last_clean":"2023-03-03T06:23:55.871487+0000","last_became_active":"2023-03-03T06:23:39.912563+0000","last_became_peered":"2023-03-03T06:23:39.912563+0000","last_unstale":"2023-03-03T06:23:55.871487+0000","last_undegraded":"2023-03-03T06:23:55.871487+0000","last_fullsized":"2023-03-03T06:23:55.871487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:40.963572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3746,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396312+0000","last_change":"2023-03-03T06:23:40.350272+0000","last_active":"2023-03-03T06:23:44.396312+0000","last_peered":"2023-03-03T06:23:44.396312+0000","last_clean":"2023-03-03T06:23:44.396312+0000","last_became_active":"2023-03-03T06:23:40.349999+0000","last_became_peered":"2023-03-03T06:23:40.349999+0000","last_unstale":"2023-03-03T06:23:44.396312+0000","last_undegraded":"2023-03-03T06:23:44.396312+0000","last_fullsized":"2023-03-03T06:23:44.396312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:00:23.719558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217132+0000","last_change":"2023-03-03T06:23:44.415132+0000","last_active":"2023-03-03T06:23:45.217132+0000","last_peered":"2023-03-03T06:23:45.217132+0000","last_clean":"2023-03-03T06:23:45.217132+0000","last_became_active":"2023-03-03T06:23:44.414671+0000","last_became_peered":"2023-03-03T06:23:44.414671+0000","last_unstale":"2023-03-03T06:23:45.217132+0000","last_undegraded":"2023-03-03T06:23:45.217132+0000","last_fullsized":"2023-03-03T06:23:45.217132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:03:14.816505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407616+0000","last_change":"2023-03-03T06:23:39.918682+0000","last_active":"2023-03-03T06:23:44.407616+0000","last_peered":"2023-03-03T06:23:44.407616+0000","last_clean":"2023-03-03T06:23:44.407616+0000","last_became_active":"2023-03-03T06:23:39.918360+0000","last_became_peered":"2023-03-03T06:23:39.918360+0000","last_unstale":"2023-03-03T06:23:44.407616+0000","last_undegraded":"2023-03-03T06:23:44.407616+0000","last_fullsized":"2023-03-03T06:23:44.407616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:19:38.164048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399298+0000","last_change":"2023-03-03T06:23:40.341375+0000","last_active":"2023-03-03T06:23:44.399298+0000","last_peered":"2023-03-03T06:23:44.399298+0000","last_clean":"2023-03-03T06:23:44.399298+0000","last_became_active":"2023-03-03T06:23:40.339213+0000","last_became_peered":"2023-03-03T06:23:40.339213+0000","last_unstale":"2023-03-03T06:23:44.399298+0000","last_undegraded":"2023-03-03T06:23:44.399298+0000","last_fullsized":"2023-03-03T06:23:44.399298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:27.072231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823348+0000","last_change":"2023-03-03T06:23:44.414871+0000","last_active":"2023-03-03T06:23:44.823348+0000","last_peered":"2023-03-03T06:23:44.823348+0000","last_clean":"2023-03-03T06:23:44.823348+0000","last_became_active":"2023-03-03T06:23:44.414346+0000","last_became_peered":"2023-03-03T06:23:44.414346+0000","last_unstale":"2023-03-03T06:23:44.823348+0000","last_undegraded":"2023-03-03T06:23:44.823348+0000","last_fullsized":"2023-03-03T06:23:44.823348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:40:15.816562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407908+0000","last_change":"2023-03-03T06:23:39.912556+0000","last_active":"2023-03-03T06:23:44.407908+0000","last_peered":"2023-03-03T06:23:44.407908+0000","last_clean":"2023-03-03T06:23:44.407908+0000","last_became_active":"2023-03-03T06:23:39.912270+0000","last_became_peered":"2023-03-03T06:23:39.912270+0000","last_unstale":"2023-03-03T06:23:44.407908+0000","last_undegraded":"2023-03-03T06:23:44.407908+0000","last_fullsized":"2023-03-03T06:23:44.407908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:59:20.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400650+0000","last_change":"2023-03-03T06:23:40.347443+0000","last_active":"2023-03-03T06:23:44.400650+0000","last_peered":"2023-03-03T06:23:44.400650+0000","last_clean":"2023-03-03T06:23:44.400650+0000","last_became_active":"2023-03-03T06:23:40.347157+0000","last_became_peered":"2023-03-03T06:23:40.347157+0000","last_unstale":"2023-03-03T06:23:44.400650+0000","last_undegraded":"2023-03-03T06:23:44.400650+0000","last_fullsized":"2023-03-03T06:23:44.400650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:17.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.823445+0000","last_change":"2023-03-03T06:23:44.424679+0000","last_active":"2023-03-03T06:23:44.823445+0000","last_peered":"2023-03-03T06:23:44.823445+0000","last_clean":"2023-03-03T06:23:44.823445+0000","last_became_active":"2023-03-03T06:23:44.424312+0000","last_became_peered":"2023-03-03T06:23:44.424312+0000","last_unstale":"2023-03-03T06:23:44.823445+0000","last_undegraded":"2023-03-03T06:23:44.823445+0000","last_fullsized":"2023-03-03T06:23:44.823445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:20:21.108272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407408+0000","last_change":"2023-03-03T06:23:39.916648+0000","last_active":"2023-03-03T06:23:44.407408+0000","last_peered":"2023-03-03T06:23:44.407408+0000","last_clean":"2023-03-03T06:23:44.407408+0000","last_became_active":"2023-03-03T06:23:39.916366+0000","last_became_peered":"2023-03-03T06:23:39.916366+0000","last_unstale":"2023-03-03T06:23:44.407408+0000","last_undegraded":"2023-03-03T06:23:44.407408+0000","last_fullsized":"2023-03-03T06:23:44.407408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:18:36.597804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.412508+0000","last_change":"2023-03-03T06:23:40.340155+0000","last_active":"2023-03-03T06:23:44.412508+0000","last_peered":"2023-03-03T06:23:44.412508+0000","last_clean":"2023-03-03T06:23:44.412508+0000","last_became_active":"2023-03-03T06:23:40.339896+0000","last_became_peered":"2023-03-03T06:23:40.339896+0000","last_unstale":"2023-03-03T06:23:44.412508+0000","last_undegraded":"2023-03-03T06:23:44.412508+0000","last_fullsized":"2023-03-03T06:23:44.412508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:29:39.720198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216910+0000","last_change":"2023-03-03T06:23:44.415321+0000","last_active":"2023-03-03T06:23:45.216910+0000","last_peered":"2023-03-03T06:23:45.216910+0000","last_clean":"2023-03-03T06:23:45.216910+0000","last_became_active":"2023-03-03T06:23:44.414916+0000","last_became_peered":"2023-03-03T06:23:44.414916+0000","last_unstale":"2023-03-03T06:23:45.216910+0000","last_undegraded":"2023-03-03T06:23:45.216910+0000","last_fullsized":"2023-03-03T06:23:45.216910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:50:31.688270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406117+0000","last_change":"2023-03-03T06:23:39.908842+0000","last_active":"2023-03-03T06:23:44.406117+0000","last_peered":"2023-03-03T06:23:44.406117+0000","last_clean":"2023-03-03T06:23:44.406117+0000","last_became_active":"2023-03-03T06:23:39.908540+0000","last_became_peered":"2023-03-03T06:23:39.908540+0000","last_unstale":"2023-03-03T06:23:44.406117+0000","last_undegraded":"2023-03-03T06:23:44.406117+0000","last_fullsized":"2023-03-03T06:23:44.406117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.403220+0000","last_change":"2023-03-03T06:23:40.348336+0000","last_active":"2023-03-03T06:23:44.403220+0000","last_peered":"2023-03-03T06:23:44.403220+0000","last_clean":"2023-03-03T06:23:44.403220+0000","last_became_active":"2023-03-03T06:23:40.348074+0000","last_became_peered":"2023-03-03T06:23:40.348074+0000","last_unstale":"2023-03-03T06:23:44.403220+0000","last_undegraded":"2023-03-03T06:23:44.403220+0000","last_fullsized":"2023-03-03T06:23:44.403220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.218118+0000","last_change":"2023-03-03T06:23:44.425304+0000","last_active":"2023-03-03T06:23:45.218118+0000","last_peered":"2023-03-03T06:23:45.218118+0000","last_clean":"2023-03-03T06:23:45.218118+0000","last_became_active":"2023-03-03T06:23:44.424821+0000","last_became_peered":"2023-03-03T06:23:44.424821+0000","last_unstale":"2023-03-03T06:23:45.218118+0000","last_undegraded":"2023-03-03T06:23:45.218118+0000","last_fullsized":"2023-03-03T06:23:45.218118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:45:29.403205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.410402+0000","last_change":"2023-03-03T06:23:39.916608+0000","last_active":"2023-03-03T06:23:44.410402+0000","last_peered":"2023-03-03T06:23:44.410402+0000","last_clean":"2023-03-03T06:23:44.410402+0000","last_became_active":"2023-03-03T06:23:39.916307+0000","last_became_peered":"2023-03-03T06:23:39.916307+0000","last_unstale":"2023-03-03T06:23:44.410402+0000","last_undegraded":"2023-03-03T06:23:44.410402+0000","last_fullsized":"2023-03-03T06:23:44.410402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:48:36.495252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398185+0000","last_change":"2023-03-03T06:23:40.347737+0000","last_active":"2023-03-03T06:23:44.398185+0000","last_peered":"2023-03-03T06:23:44.398185+0000","last_clean":"2023-03-03T06:23:44.398185+0000","last_became_active":"2023-03-03T06:23:40.347002+0000","last_became_peered":"2023-03-03T06:23:40.347002+0000","last_unstale":"2023-03-03T06:23:44.398185+0000","last_undegraded":"2023-03-03T06:23:44.398185+0000","last_fullsized":"2023-03-03T06:23:44.398185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215709+0000","last_change":"2023-03-03T06:23:44.424830+0000","last_active":"2023-03-03T06:23:45.215709+0000","last_peered":"2023-03-03T06:23:45.215709+0000","last_clean":"2023-03-03T06:23:45.215709+0000","last_became_active":"2023-03-03T06:23:44.424435+0000","last_became_peered":"2023-03-03T06:23:44.424435+0000","last_unstale":"2023-03-03T06:23:45.215709+0000","last_undegraded":"2023-03-03T06:23:45.215709+0000","last_fullsized":"2023-03-03T06:23:45.215709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:29.892281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408855+0000","last_change":"2023-03-03T06:23:39.916989+0000","last_active":"2023-03-03T06:23:44.408855+0000","last_peered":"2023-03-03T06:23:44.408855+0000","last_clean":"2023-03-03T06:23:44.408855+0000","last_became_active":"2023-03-03T06:23:39.916686+0000","last_became_peered":"2023-03-03T06:23:39.916686+0000","last_unstale":"2023-03-03T06:23:44.408855+0000","last_undegraded":"2023-03-03T06:23:44.408855+0000","last_fullsized":"2023-03-03T06:23:44.408855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:04:17.846504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397402+0000","last_change":"2023-03-03T06:23:40.344010+0000","last_active":"2023-03-03T06:23:44.397402+0000","last_peered":"2023-03-03T06:23:44.397402+0000","last_clean":"2023-03-03T06:23:44.397402+0000","last_became_active":"2023-03-03T06:23:40.340204+0000","last_became_peered":"2023-03-03T06:23:40.340204+0000","last_unstale":"2023-03-03T06:23:44.397402+0000","last_undegraded":"2023-03-03T06:23:44.397402+0000","last_fullsized":"2023-03-03T06:23:44.397402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:57:56.186885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215937+0000","last_change":"2023-03-03T06:23:44.413387+0000","last_active":"2023-03-03T06:23:45.215937+0000","last_peered":"2023-03-03T06:23:45.215937+0000","last_clean":"2023-03-03T06:23:45.215937+0000","last_became_active":"2023-03-03T06:23:44.412643+0000","last_became_peered":"2023-03-03T06:23:44.412643+0000","last_unstale":"2023-03-03T06:23:45.215937+0000","last_undegraded":"2023-03-03T06:23:45.215937+0000","last_fullsized":"2023-03-03T06:23:45.215937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:11:57.156702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408463+0000","last_change":"2023-03-03T06:23:39.911757+0000","last_active":"2023-03-03T06:23:44.408463+0000","last_peered":"2023-03-03T06:23:44.408463+0000","last_clean":"2023-03-03T06:23:44.408463+0000","last_became_active":"2023-03-03T06:23:39.911430+0000","last_became_peered":"2023-03-03T06:23:39.911430+0000","last_unstale":"2023-03-03T06:23:44.408463+0000","last_undegraded":"2023-03-03T06:23:44.408463+0000","last_fullsized":"2023-03-03T06:23:44.408463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:30:04.252933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406464+0000","last_change":"2023-03-03T06:23:40.338136+0000","last_active":"2023-03-03T06:23:44.406464+0000","last_peered":"2023-03-03T06:23:44.406464+0000","last_clean":"2023-03-03T06:23:44.406464+0000","last_became_active":"2023-03-03T06:23:40.337828+0000","last_became_peered":"2023-03-03T06:23:40.337828+0000","last_unstale":"2023-03-03T06:23:44.406464+0000","last_undegraded":"2023-03-03T06:23:44.406464+0000","last_fullsized":"2023-03-03T06:23:44.406464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:30:05.258542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215914+0000","last_change":"2023-03-03T06:23:44.413004+0000","last_active":"2023-03-03T06:23:45.215914+0000","last_peered":"2023-03-03T06:23:45.215914+0000","last_clean":"2023-03-03T06:23:45.215914+0000","last_became_active":"2023-03-03T06:23:44.412564+0000","last_became_peered":"2023-03-03T06:23:44.412564+0000","last_unstale":"2023-03-03T06:23:45.215914+0000","last_undegraded":"2023-03-03T06:23:45.215914+0000","last_fullsized":"2023-03-03T06:23:45.215914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:16.090224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399592+0000","last_change":"2023-03-03T06:23:39.916059+0000","last_active":"2023-03-03T06:23:44.399592+0000","last_peered":"2023-03-03T06:23:44.399592+0000","last_clean":"2023-03-03T06:23:44.399592+0000","last_became_active":"2023-03-03T06:23:39.915796+0000","last_became_peered":"2023-03-03T06:23:39.915796+0000","last_unstale":"2023-03-03T06:23:44.399592+0000","last_undegraded":"2023-03-03T06:23:44.399592+0000","last_fullsized":"2023-03-03T06:23:44.399592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413796+0000","last_change":"2023-03-03T06:23:40.331555+0000","last_active":"2023-03-03T06:23:44.413796+0000","last_peered":"2023-03-03T06:23:44.413796+0000","last_clean":"2023-03-03T06:23:44.413796+0000","last_became_active":"2023-03-03T06:23:40.331304+0000","last_became_peered":"2023-03-03T06:23:40.331304+0000","last_unstale":"2023-03-03T06:23:44.413796+0000","last_undegraded":"2023-03-03T06:23:44.413796+0000","last_fullsized":"2023-03-03T06:23:44.413796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:52:28.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.215910+0000","last_change":"2023-03-03T06:23:44.413292+0000","last_active":"2023-03-03T06:23:45.215910+0000","last_peered":"2023-03-03T06:23:45.215910+0000","last_clean":"2023-03-03T06:23:45.215910+0000","last_became_active":"2023-03-03T06:23:44.412668+0000","last_became_peered":"2023-03-03T06:23:44.412668+0000","last_unstale":"2023-03-03T06:23:45.215910+0000","last_undegraded":"2023-03-03T06:23:45.215910+0000","last_fullsized":"2023-03-03T06:23:45.215910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:42:28.966046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401269+0000","last_change":"2023-03-03T06:23:39.917500+0000","last_active":"2023-03-03T06:23:44.401269+0000","last_peered":"2023-03-03T06:23:44.401269+0000","last_clean":"2023-03-03T06:23:44.401269+0000","last_became_active":"2023-03-03T06:23:39.917201+0000","last_became_peered":"2023-03-03T06:23:39.917201+0000","last_unstale":"2023-03-03T06:23:44.401269+0000","last_undegraded":"2023-03-03T06:23:44.401269+0000","last_fullsized":"2023-03-03T06:23:44.401269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:44.071696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396883+0000","last_change":"2023-03-03T06:23:40.347773+0000","last_active":"2023-03-03T06:23:44.396883+0000","last_peered":"2023-03-03T06:23:44.396883+0000","last_clean":"2023-03-03T06:23:44.396883+0000","last_became_active":"2023-03-03T06:23:40.346824+0000","last_became_peered":"2023-03-03T06:23:40.346824+0000","last_unstale":"2023-03-03T06:23:44.396883+0000","last_undegraded":"2023-03-03T06:23:44.396883+0000","last_fullsized":"2023-03-03T06:23:44.396883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:50.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.821697+0000","last_change":"2023-03-03T06:23:44.413742+0000","last_active":"2023-03-03T06:23:44.821697+0000","last_peered":"2023-03-03T06:23:44.821697+0000","last_clean":"2023-03-03T06:23:44.821697+0000","last_became_active":"2023-03-03T06:23:44.413323+0000","last_became_peered":"2023-03-03T06:23:44.413323+0000","last_unstale":"2023-03-03T06:23:44.821697+0000","last_undegraded":"2023-03-03T06:23:44.821697+0000","last_fullsized":"2023-03-03T06:23:44.821697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:50:31.688270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406544+0000","last_change":"2023-03-03T06:23:39.916329+0000","last_active":"2023-03-03T06:23:44.406544+0000","last_peered":"2023-03-03T06:23:44.406544+0000","last_clean":"2023-03-03T06:23:44.406544+0000","last_became_active":"2023-03-03T06:23:39.916060+0000","last_became_peered":"2023-03-03T06:23:39.916060+0000","last_unstale":"2023-03-03T06:23:44.406544+0000","last_undegraded":"2023-03-03T06:23:44.406544+0000","last_fullsized":"2023-03-03T06:23:44.406544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:37.135108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.395753+0000","last_change":"2023-03-03T06:23:40.349832+0000","last_active":"2023-03-03T06:23:44.395753+0000","last_peered":"2023-03-03T06:23:44.395753+0000","last_clean":"2023-03-03T06:23:44.395753+0000","last_became_active":"2023-03-03T06:23:40.343955+0000","last_became_peered":"2023-03-03T06:23:40.343955+0000","last_unstale":"2023-03-03T06:23:44.395753+0000","last_undegraded":"2023-03-03T06:23:44.395753+0000","last_fullsized":"2023-03-03T06:23:44.395753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:55:53.505277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217364+0000","last_change":"2023-03-03T06:23:44.417750+0000","last_active":"2023-03-03T06:23:45.217364+0000","last_peered":"2023-03-03T06:23:45.217364+0000","last_clean":"2023-03-03T06:23:45.217364+0000","last_became_active":"2023-03-03T06:23:44.417295+0000","last_became_peered":"2023-03-03T06:23:44.417295+0000","last_unstale":"2023-03-03T06:23:45.217364+0000","last_undegraded":"2023-03-03T06:23:45.217364+0000","last_fullsized":"2023-03-03T06:23:45.217364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:04:21.713427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397226+0000","last_change":"2023-03-03T06:23:39.913064+0000","last_active":"2023-03-03T06:23:44.397226+0000","last_peered":"2023-03-03T06:23:44.397226+0000","last_clean":"2023-03-03T06:23:44.397226+0000","last_became_active":"2023-03-03T06:23:39.912756+0000","last_became_peered":"2023-03-03T06:23:39.912756+0000","last_unstale":"2023-03-03T06:23:44.397226+0000","last_undegraded":"2023-03-03T06:23:44.397226+0000","last_fullsized":"2023-03-03T06:23:44.397226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398500+0000","last_change":"2023-03-03T06:23:40.345016+0000","last_active":"2023-03-03T06:23:44.398500+0000","last_peered":"2023-03-03T06:23:44.398500+0000","last_clean":"2023-03-03T06:23:44.398500+0000","last_became_active":"2023-03-03T06:23:40.340755+0000","last_became_peered":"2023-03-03T06:23:40.340755+0000","last_unstale":"2023-03-03T06:23:44.398500+0000","last_undegraded":"2023-03-03T06:23:44.398500+0000","last_fullsized":"2023-03-03T06:23:44.398500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:26.393574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822613+0000","last_change":"2023-03-03T06:23:44.412105+0000","last_active":"2023-03-03T06:23:44.822613+0000","last_peered":"2023-03-03T06:23:44.822613+0000","last_clean":"2023-03-03T06:23:44.822613+0000","last_became_active":"2023-03-03T06:23:44.411353+0000","last_became_peered":"2023-03-03T06:23:44.411353+0000","last_unstale":"2023-03-03T06:23:44.822613+0000","last_undegraded":"2023-03-03T06:23:44.822613+0000","last_fullsized":"2023-03-03T06:23:44.822613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:23:56.487480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397316+0000","last_change":"2023-03-03T06:23:39.916313+0000","last_active":"2023-03-03T06:23:44.397316+0000","last_peered":"2023-03-03T06:23:44.397316+0000","last_clean":"2023-03-03T06:23:44.397316+0000","last_became_active":"2023-03-03T06:23:39.916058+0000","last_became_peered":"2023-03-03T06:23:39.916058+0000","last_unstale":"2023-03-03T06:23:44.397316+0000","last_undegraded":"2023-03-03T06:23:44.397316+0000","last_fullsized":"2023-03-03T06:23:44.397316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:59:20.170604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408755+0000","last_change":"2023-03-03T06:23:40.339541+0000","last_active":"2023-03-03T06:23:44.408755+0000","last_peered":"2023-03-03T06:23:44.408755+0000","last_clean":"2023-03-03T06:23:44.408755+0000","last_became_active":"2023-03-03T06:23:40.339291+0000","last_became_peered":"2023-03-03T06:23:40.339291+0000","last_unstale":"2023-03-03T06:23:44.408755+0000","last_undegraded":"2023-03-03T06:23:44.408755+0000","last_fullsized":"2023-03-03T06:23:44.408755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:17.750893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822768+0000","last_change":"2023-03-03T06:23:44.413275+0000","last_active":"2023-03-03T06:23:44.822768+0000","last_peered":"2023-03-03T06:23:44.822768+0000","last_clean":"2023-03-03T06:23:44.822768+0000","last_became_active":"2023-03-03T06:23:44.412027+0000","last_became_peered":"2023-03-03T06:23:44.412027+0000","last_unstale":"2023-03-03T06:23:44.822768+0000","last_undegraded":"2023-03-03T06:23:44.822768+0000","last_fullsized":"2023-03-03T06:23:44.822768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:46:08.536113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401273+0000","last_change":"2023-03-03T06:23:39.913990+0000","last_active":"2023-03-03T06:23:44.401273+0000","last_peered":"2023-03-03T06:23:44.401273+0000","last_clean":"2023-03-03T06:23:44.401273+0000","last_became_active":"2023-03-03T06:23:39.913721+0000","last_became_peered":"2023-03-03T06:23:39.913721+0000","last_unstale":"2023-03-03T06:23:44.401273+0000","last_undegraded":"2023-03-03T06:23:44.401273+0000","last_fullsized":"2023-03-03T06:23:44.401273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:19:38.164048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.395934+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:23:44.395934+0000","last_peered":"2023-03-03T06:23:44.395934+0000","last_clean":"2023-03-03T06:23:44.395934+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:23:44.395934+0000","last_undegraded":"2023-03-03T06:23:44.395934+0000","last_fullsized":"2023-03-03T06:23:44.395934+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397197+0000","last_change":"2023-03-03T06:23:40.346219+0000","last_active":"2023-03-03T06:23:44.397197+0000","last_peered":"2023-03-03T06:23:44.397197+0000","last_clean":"2023-03-03T06:23:44.397197+0000","last_became_active":"2023-03-03T06:23:40.345907+0000","last_became_peered":"2023-03-03T06:23:40.345907+0000","last_unstale":"2023-03-03T06:23:44.397197+0000","last_undegraded":"2023-03-03T06:23:44.397197+0000","last_fullsized":"2023-03-03T06:23:44.397197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:02:47.502797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822264+0000","last_change":"2023-03-03T06:23:44.412472+0000","last_active":"2023-03-03T06:23:44.822264+0000","last_peered":"2023-03-03T06:23:44.822264+0000","last_clean":"2023-03-03T06:23:44.822264+0000","last_became_active":"2023-03-03T06:23:44.412106+0000","last_became_peered":"2023-03-03T06:23:44.412106+0000","last_unstale":"2023-03-03T06:23:44.822264+0000","last_undegraded":"2023-03-03T06:23:44.822264+0000","last_fullsized":"2023-03-03T06:23:44.822264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:03:14.816505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406142+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:23:44.406142+0000","last_peered":"2023-03-03T06:23:44.406142+0000","last_clean":"2023-03-03T06:23:44.406142+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:23:44.406142+0000","last_undegraded":"2023-03-03T06:23:44.406142+0000","last_fullsized":"2023-03-03T06:23:44.406142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011109+0000","last_change":"2023-03-03T06:23:39.907672+0000","last_active":"2023-03-03T06:23:45.011109+0000","last_peered":"2023-03-03T06:23:45.011109+0000","last_clean":"2023-03-03T06:23:45.011109+0000","last_became_active":"2023-03-03T06:23:39.907353+0000","last_became_peered":"2023-03-03T06:23:39.907353+0000","last_unstale":"2023-03-03T06:23:45.011109+0000","last_undegraded":"2023-03-03T06:23:45.011109+0000","last_fullsized":"2023-03-03T06:23:45.011109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:44.071696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397317+0000","last_change":"2023-03-03T06:23:40.347947+0000","last_active":"2023-03-03T06:23:44.397317+0000","last_peered":"2023-03-03T06:23:44.397317+0000","last_clean":"2023-03-03T06:23:44.397317+0000","last_became_active":"2023-03-03T06:23:40.347617+0000","last_became_peered":"2023-03-03T06:23:40.347617+0000","last_unstale":"2023-03-03T06:23:44.397317+0000","last_undegraded":"2023-03-03T06:23:44.397317+0000","last_fullsized":"2023-03-03T06:23:44.397317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:27.072231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216962+0000","last_change":"2023-03-03T06:23:44.412431+0000","last_active":"2023-03-03T06:23:45.216962+0000","last_peered":"2023-03-03T06:23:45.216962+0000","last_clean":"2023-03-03T06:23:45.216962+0000","last_became_active":"2023-03-03T06:23:44.411748+0000","last_became_peered":"2023-03-03T06:23:44.411748+0000","last_unstale":"2023-03-03T06:23:45.216962+0000","last_undegraded":"2023-03-03T06:23:45.216962+0000","last_fullsized":"2023-03-03T06:23:45.216962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:40:15.816562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406632+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:23:44.406632+0000","last_peered":"2023-03-03T06:23:44.406632+0000","last_clean":"2023-03-03T06:23:44.406632+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:23:44.406632+0000","last_undegraded":"2023-03-03T06:23:44.406632+0000","last_fullsized":"2023-03-03T06:23:44.406632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407696+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:23:44.407696+0000","last_peered":"2023-03-03T06:23:44.407696+0000","last_clean":"2023-03-03T06:23:44.407696+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:23:44.407696+0000","last_undegraded":"2023-03-03T06:23:44.407696+0000","last_fullsized":"2023-03-03T06:23:44.407696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408209+0000","last_change":"2023-03-03T06:23:39.911633+0000","last_active":"2023-03-03T06:23:44.408209+0000","last_peered":"2023-03-03T06:23:44.408209+0000","last_clean":"2023-03-03T06:23:44.408209+0000","last_became_active":"2023-03-03T06:23:39.911343+0000","last_became_peered":"2023-03-03T06:23:39.911343+0000","last_unstale":"2023-03-03T06:23:44.408209+0000","last_undegraded":"2023-03-03T06:23:44.408209+0000","last_fullsized":"2023-03-03T06:23:44.408209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.412424+0000","last_change":"2023-03-03T06:23:40.331020+0000","last_active":"2023-03-03T06:23:44.412424+0000","last_peered":"2023-03-03T06:23:44.412424+0000","last_clean":"2023-03-03T06:23:44.412424+0000","last_became_active":"2023-03-03T06:23:40.330714+0000","last_became_peered":"2023-03-03T06:23:40.330714+0000","last_unstale":"2023-03-03T06:23:44.412424+0000","last_undegraded":"2023-03-03T06:23:44.412424+0000","last_fullsized":"2023-03-03T06:23:44.412424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:03:45.180190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216187+0000","last_change":"2023-03-03T06:23:44.410983+0000","last_active":"2023-03-03T06:23:45.216187+0000","last_peered":"2023-03-03T06:23:45.216187+0000","last_clean":"2023-03-03T06:23:45.216187+0000","last_became_active":"2023-03-03T06:23:44.410572+0000","last_became_peered":"2023-03-03T06:23:44.410572+0000","last_unstale":"2023-03-03T06:23:45.216187+0000","last_undegraded":"2023-03-03T06:23:45.216187+0000","last_fullsized":"2023-03-03T06:23:45.216187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:30.570938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408155+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:23:44.408155+0000","last_peered":"2023-03-03T06:23:44.408155+0000","last_clean":"2023-03-03T06:23:44.408155+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:23:44.408155+0000","last_undegraded":"2023-03-03T06:23:44.408155+0000","last_fullsized":"2023-03-03T06:23:44.408155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408305+0000","last_change":"2023-03-03T06:23:39.911439+0000","last_active":"2023-03-03T06:23:44.408305+0000","last_peered":"2023-03-03T06:23:44.408305+0000","last_clean":"2023-03-03T06:23:44.408305+0000","last_became_active":"2023-03-03T06:23:39.910571+0000","last_became_peered":"2023-03-03T06:23:39.910571+0000","last_unstale":"2023-03-03T06:23:44.408305+0000","last_undegraded":"2023-03-03T06:23:44.408305+0000","last_fullsized":"2023-03-03T06:23:44.408305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:05:05.468654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.408707+0000","last_change":"2023-03-03T06:23:40.331506+0000","last_active":"2023-03-03T06:23:44.408707+0000","last_peered":"2023-03-03T06:23:44.408707+0000","last_clean":"2023-03-03T06:23:44.408707+0000","last_became_active":"2023-03-03T06:23:40.331225+0000","last_became_peered":"2023-03-03T06:23:40.331225+0000","last_unstale":"2023-03-03T06:23:44.408707+0000","last_undegraded":"2023-03-03T06:23:44.408707+0000","last_fullsized":"2023-03-03T06:23:44.408707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:42:56.190690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217577+0000","last_change":"2023-03-03T06:23:44.424824+0000","last_active":"2023-03-03T06:23:45.217577+0000","last_peered":"2023-03-03T06:23:45.217577+0000","last_clean":"2023-03-03T06:23:45.217577+0000","last_became_active":"2023-03-03T06:23:44.424408+0000","last_became_peered":"2023-03-03T06:23:44.424408+0000","last_unstale":"2023-03-03T06:23:45.217577+0000","last_undegraded":"2023-03-03T06:23:45.217577+0000","last_fullsized":"2023-03-03T06:23:45.217577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:22:48.378893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407463+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:23:44.407463+0000","last_peered":"2023-03-03T06:23:44.407463+0000","last_clean":"2023-03-03T06:23:44.407463+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:23:44.407463+0000","last_undegraded":"2023-03-03T06:23:44.407463+0000","last_fullsized":"2023-03-03T06:23:44.407463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.400330+0000","last_change":"2023-03-03T06:23:39.915098+0000","last_active":"2023-03-03T06:23:44.400330+0000","last_peered":"2023-03-03T06:23:44.400330+0000","last_clean":"2023-03-03T06:23:44.400330+0000","last_became_active":"2023-03-03T06:23:39.914785+0000","last_became_peered":"2023-03-03T06:23:39.914785+0000","last_unstale":"2023-03-03T06:23:44.400330+0000","last_undegraded":"2023-03-03T06:23:44.400330+0000","last_fullsized":"2023-03-03T06:23:44.400330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:38.730151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406226+0000","last_change":"2023-03-03T06:23:40.348600+0000","last_active":"2023-03-03T06:23:44.406226+0000","last_peered":"2023-03-03T06:23:44.406226+0000","last_clean":"2023-03-03T06:23:44.406226+0000","last_became_active":"2023-03-03T06:23:40.348139+0000","last_became_peered":"2023-03-03T06:23:40.348139+0000","last_unstale":"2023-03-03T06:23:44.406226+0000","last_undegraded":"2023-03-03T06:23:44.406226+0000","last_fullsized":"2023-03-03T06:23:44.406226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:18:37.603414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011148+0000","last_change":"2023-03-03T06:23:44.416443+0000","last_active":"2023-03-03T06:23:45.011148+0000","last_peered":"2023-03-03T06:23:45.011148+0000","last_clean":"2023-03-03T06:23:45.011148+0000","last_became_active":"2023-03-03T06:23:44.415629+0000","last_became_peered":"2023-03-03T06:23:44.415629+0000","last_unstale":"2023-03-03T06:23:45.011148+0000","last_undegraded":"2023-03-03T06:23:45.011148+0000","last_fullsized":"2023-03-03T06:23:45.011148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:45:29.403205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398099+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:23:44.398099+0000","last_peered":"2023-03-03T06:23:44.398099+0000","last_clean":"2023-03-03T06:23:44.398099+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:23:44.398099+0000","last_undegraded":"2023-03-03T06:23:44.398099+0000","last_fullsized":"2023-03-03T06:23:44.398099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396227+0000","last_change":"2023-03-03T06:23:39.917152+0000","last_active":"2023-03-03T06:23:44.396227+0000","last_peered":"2023-03-03T06:23:44.396227+0000","last_clean":"2023-03-03T06:23:44.396227+0000","last_became_active":"2023-03-03T06:23:39.916712+0000","last_became_peered":"2023-03-03T06:23:39.916712+0000","last_unstale":"2023-03-03T06:23:44.396227+0000","last_undegraded":"2023-03-03T06:23:44.396227+0000","last_fullsized":"2023-03-03T06:23:44.396227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407594+0000","last_change":"2023-03-03T06:23:40.326857+0000","last_active":"2023-03-03T06:23:44.407594+0000","last_peered":"2023-03-03T06:23:44.407594+0000","last_clean":"2023-03-03T06:23:44.407594+0000","last_became_active":"2023-03-03T06:23:40.326623+0000","last_became_peered":"2023-03-03T06:23:40.326623+0000","last_unstale":"2023-03-03T06:23:44.407594+0000","last_undegraded":"2023-03-03T06:23:44.407594+0000","last_fullsized":"2023-03-03T06:23:44.407594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:56:24.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216598+0000","last_change":"2023-03-03T06:23:44.421895+0000","last_active":"2023-03-03T06:23:45.216598+0000","last_peered":"2023-03-03T06:23:45.216598+0000","last_clean":"2023-03-03T06:23:45.216598+0000","last_became_active":"2023-03-03T06:23:44.421563+0000","last_became_peered":"2023-03-03T06:23:44.421563+0000","last_unstale":"2023-03-03T06:23:45.216598+0000","last_undegraded":"2023-03-03T06:23:45.216598+0000","last_fullsized":"2023-03-03T06:23:45.216598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:42:28.966046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406284+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:23:44.406284+0000","last_peered":"2023-03-03T06:23:44.406284+0000","last_clean":"2023-03-03T06:23:44.406284+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:23:44.406284+0000","last_undegraded":"2023-03-03T06:23:44.406284+0000","last_fullsized":"2023-03-03T06:23:44.406284+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407688+0000","last_change":"2023-03-03T06:23:39.912862+0000","last_active":"2023-03-03T06:23:44.407688+0000","last_peered":"2023-03-03T06:23:44.407688+0000","last_clean":"2023-03-03T06:23:44.407688+0000","last_became_active":"2023-03-03T06:23:39.912540+0000","last_became_peered":"2023-03-03T06:23:39.912540+0000","last_unstale":"2023-03-03T06:23:44.407688+0000","last_undegraded":"2023-03-03T06:23:44.407688+0000","last_fullsized":"2023-03-03T06:23:44.407688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:40.963572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413554+0000","last_change":"2023-03-03T06:23:40.330277+0000","last_active":"2023-03-03T06:23:44.413554+0000","last_peered":"2023-03-03T06:23:44.413554+0000","last_clean":"2023-03-03T06:23:44.413554+0000","last_became_active":"2023-03-03T06:23:40.329978+0000","last_became_peered":"2023-03-03T06:23:40.329978+0000","last_unstale":"2023-03-03T06:23:44.413554+0000","last_undegraded":"2023-03-03T06:23:44.413554+0000","last_fullsized":"2023-03-03T06:23:44.413554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:56:24.423150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.011025+0000","last_change":"2023-03-03T06:23:44.414799+0000","last_active":"2023-03-03T06:23:45.011025+0000","last_peered":"2023-03-03T06:23:45.011025+0000","last_clean":"2023-03-03T06:23:45.011025+0000","last_became_active":"2023-03-03T06:23:44.414225+0000","last_became_peered":"2023-03-03T06:23:44.414225+0000","last_unstale":"2023-03-03T06:23:45.011025+0000","last_undegraded":"2023-03-03T06:23:45.011025+0000","last_fullsized":"2023-03-03T06:23:45.011025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:28:15.023557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406901+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:23:44.406901+0000","last_peered":"2023-03-03T06:23:44.406901+0000","last_clean":"2023-03-03T06:23:44.406901+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:23:44.406901+0000","last_undegraded":"2023-03-03T06:23:44.406901+0000","last_fullsized":"2023-03-03T06:23:44.406901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399724+0000","last_change":"2023-03-03T06:23:39.918687+0000","last_active":"2023-03-03T06:23:44.399724+0000","last_peered":"2023-03-03T06:23:44.399724+0000","last_clean":"2023-03-03T06:23:44.399724+0000","last_became_active":"2023-03-03T06:23:39.918213+0000","last_became_peered":"2023-03-03T06:23:39.918213+0000","last_unstale":"2023-03-03T06:23:44.399724+0000","last_undegraded":"2023-03-03T06:23:44.399724+0000","last_fullsized":"2023-03-03T06:23:44.399724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406330+0000","last_change":"2023-03-03T06:23:40.329407+0000","last_active":"2023-03-03T06:23:44.406330+0000","last_peered":"2023-03-03T06:23:44.406330+0000","last_clean":"2023-03-03T06:23:44.406330+0000","last_became_active":"2023-03-03T06:23:40.329131+0000","last_became_peered":"2023-03-03T06:23:40.329131+0000","last_unstale":"2023-03-03T06:23:44.406330+0000","last_undegraded":"2023-03-03T06:23:44.406330+0000","last_fullsized":"2023-03-03T06:23:44.406330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:41:25.301780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.821924+0000","last_change":"2023-03-03T06:23:44.421929+0000","last_active":"2023-03-03T06:23:44.821924+0000","last_peered":"2023-03-03T06:23:44.821924+0000","last_clean":"2023-03-03T06:23:44.821924+0000","last_became_active":"2023-03-03T06:23:44.421457+0000","last_became_peered":"2023-03-03T06:23:44.421457+0000","last_unstale":"2023-03-03T06:23:44.821924+0000","last_undegraded":"2023-03-03T06:23:44.821924+0000","last_fullsized":"2023-03-03T06:23:44.821924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:03:17.411194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.413461+0000","last_change":"2023-03-03T06:23:39.916295+0000","last_active":"2023-03-03T06:23:44.413461+0000","last_peered":"2023-03-03T06:23:44.413461+0000","last_clean":"2023-03-03T06:23:44.413461+0000","last_became_active":"2023-03-03T06:23:39.916027+0000","last_became_peered":"2023-03-03T06:23:39.916027+0000","last_unstale":"2023-03-03T06:23:44.413461+0000","last_undegraded":"2023-03-03T06:23:44.413461+0000","last_fullsized":"2023-03-03T06:23:44.413461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:19:38.164048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.394183+0000","last_change":"2023-03-03T06:23:40.332708+0000","last_active":"2023-03-03T06:23:44.394183+0000","last_peered":"2023-03-03T06:23:44.394183+0000","last_clean":"2023-03-03T06:23:44.394183+0000","last_became_active":"2023-03-03T06:23:40.332382+0000","last_became_peered":"2023-03-03T06:23:40.332382+0000","last_unstale":"2023-03-03T06:23:44.394183+0000","last_undegraded":"2023-03-03T06:23:44.394183+0000","last_fullsized":"2023-03-03T06:23:44.394183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:07:39.735760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.217389+0000","last_change":"2023-03-03T06:23:44.420467+0000","last_active":"2023-03-03T06:23:45.217389+0000","last_peered":"2023-03-03T06:23:45.217389+0000","last_clean":"2023-03-03T06:23:45.217389+0000","last_became_active":"2023-03-03T06:23:44.420078+0000","last_became_peered":"2023-03-03T06:23:44.420078+0000","last_unstale":"2023-03-03T06:23:45.217389+0000","last_undegraded":"2023-03-03T06:23:45.217389+0000","last_fullsized":"2023-03-03T06:23:45.217389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:03:17.411194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398998+0000","last_change":"2023-03-03T06:23:39.911136+0000","last_active":"2023-03-03T06:23:44.398998+0000","last_peered":"2023-03-03T06:23:44.398998+0000","last_clean":"2023-03-03T06:23:44.398998+0000","last_became_active":"2023-03-03T06:23:39.910722+0000","last_became_peered":"2023-03-03T06:23:39.910722+0000","last_unstale":"2023-03-03T06:23:44.398998+0000","last_undegraded":"2023-03-03T06:23:44.398998+0000","last_fullsized":"2023-03-03T06:23:44.398998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:17:44.071696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396133+0000","last_change":"2023-03-03T06:23:40.350618+0000","last_active":"2023-03-03T06:23:44.396133+0000","last_peered":"2023-03-03T06:23:44.396133+0000","last_clean":"2023-03-03T06:23:44.396133+0000","last_became_active":"2023-03-03T06:23:40.350186+0000","last_became_peered":"2023-03-03T06:23:40.350186+0000","last_unstale":"2023-03-03T06:23:44.396133+0000","last_undegraded":"2023-03-03T06:23:44.396133+0000","last_fullsized":"2023-03-03T06:23:44.396133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:19.510143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:45.216582+0000","last_change":"2023-03-03T06:23:44.421952+0000","last_active":"2023-03-03T06:23:45.216582+0000","last_peered":"2023-03-03T06:23:45.216582+0000","last_clean":"2023-03-03T06:23:45.216582+0000","last_became_active":"2023-03-03T06:23:44.421492+0000","last_became_peered":"2023-03-03T06:23:44.421492+0000","last_unstale":"2023-03-03T06:23:45.216582+0000","last_undegraded":"2023-03-03T06:23:45.216582+0000","last_fullsized":"2023-03-03T06:23:45.216582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:22:48.378893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.399293+0000","last_change":"2023-03-03T06:23:39.918470+0000","last_active":"2023-03-03T06:23:44.399293+0000","last_peered":"2023-03-03T06:23:44.399293+0000","last_clean":"2023-03-03T06:23:44.399293+0000","last_became_active":"2023-03-03T06:23:39.917860+0000","last_became_peered":"2023-03-03T06:23:39.917860+0000","last_unstale":"2023-03-03T06:23:44.399293+0000","last_undegraded":"2023-03-03T06:23:44.399293+0000","last_fullsized":"2023-03-03T06:23:44.399293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:20.326465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396555+0000","last_change":"2023-03-03T06:23:40.347706+0000","last_active":"2023-03-03T06:23:44.396555+0000","last_peered":"2023-03-03T06:23:44.396555+0000","last_clean":"2023-03-03T06:23:44.396555+0000","last_became_active":"2023-03-03T06:23:40.344594+0000","last_became_peered":"2023-03-03T06:23:40.344594+0000","last_unstale":"2023-03-03T06:23:44.396555+0000","last_undegraded":"2023-03-03T06:23:44.396555+0000","last_fullsized":"2023-03-03T06:23:44.396555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.822175+0000","last_change":"2023-03-03T06:23:44.412148+0000","last_active":"2023-03-03T06:23:44.822175+0000","last_peered":"2023-03-03T06:23:44.822175+0000","last_clean":"2023-03-03T06:23:44.822175+0000","last_became_active":"2023-03-03T06:23:44.411541+0000","last_became_peered":"2023-03-03T06:23:44.411541+0000","last_unstale":"2023-03-03T06:23:44.822175+0000","last_undegraded":"2023-03-03T06:23:44.822175+0000","last_fullsized":"2023-03-03T06:23:44.822175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:11:52.237707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397307+0000","last_change":"2023-03-03T06:23:39.913487+0000","last_active":"2023-03-03T06:23:44.397307+0000","last_peered":"2023-03-03T06:23:44.397307+0000","last_clean":"2023-03-03T06:23:44.397307+0000","last_became_active":"2023-03-03T06:23:39.913194+0000","last_became_peered":"2023-03-03T06:23:39.913194+0000","last_unstale":"2023-03-03T06:23:44.397307+0000","last_undegraded":"2023-03-03T06:23:44.397307+0000","last_fullsized":"2023-03-03T06:23:44.397307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:50:20.326465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.397158+0000","last_change":"2023-03-03T06:23:40.338004+0000","last_active":"2023-03-03T06:23:44.397158+0000","last_peered":"2023-03-03T06:23:44.397158+0000","last_clean":"2023-03-03T06:23:44.397158+0000","last_became_active":"2023-03-03T06:23:40.337689+0000","last_became_peered":"2023-03-03T06:23:40.337689+0000","last_unstale":"2023-03-03T06:23:44.397158+0000","last_undegraded":"2023-03-03T06:23:44.397158+0000","last_fullsized":"2023-03-03T06:23:44.397158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:00.071990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.821814+0000","last_change":"2023-03-03T06:23:44.413502+0000","last_active":"2023-03-03T06:23:44.821814+0000","last_peered":"2023-03-03T06:23:44.821814+0000","last_clean":"2023-03-03T06:23:44.821814+0000","last_became_active":"2023-03-03T06:23:44.413099+0000","last_became_peered":"2023-03-03T06:23:44.413099+0000","last_unstale":"2023-03-03T06:23:44.821814+0000","last_undegraded":"2023-03-03T06:23:44.821814+0000","last_fullsized":"2023-03-03T06:23:44.821814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:43.387186+0000","last_clean_scrub_stamp":"2023-03-03T06:23:43.387186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:16:23.008849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.414685+0000","last_change":"2023-03-03T06:23:39.911148+0000","last_active":"2023-03-03T06:23:44.414685+0000","last_peered":"2023-03-03T06:23:44.414685+0000","last_clean":"2023-03-03T06:23:44.414685+0000","last_became_active":"2023-03-03T06:23:39.910465+0000","last_became_peered":"2023-03-03T06:23:39.910465+0000","last_unstale":"2023-03-03T06:23:44.414685+0000","last_undegraded":"2023-03-03T06:23:44.414685+0000","last_fullsized":"2023-03-03T06:23:44.414685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:38.882869+0000","last_clean_scrub_stamp":"2023-03-03T06:23:38.882869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:25:49.779859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.398776+0000","last_change":"2023-03-03T06:23:40.347365+0000","last_active":"2023-03-03T06:23:44.398776+0000","last_peered":"2023-03-03T06:23:44.398776+0000","last_clean":"2023-03-03T06:23:44.398776+0000","last_became_active":"2023-03-03T06:23:40.347102+0000","last_became_peered":"2023-03-03T06:23:40.347102+0000","last_unstale":"2023-03-03T06:23:44.398776+0000","last_undegraded":"2023-03-03T06:23:44.398776+0000","last_fullsized":"2023-03-03T06:23:44.398776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:42:25.467339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.406140+0000","last_change":"2023-03-03T06:23:40.337697+0000","last_active":"2023-03-03T06:23:44.406140+0000","last_peered":"2023-03-03T06:23:44.406140+0000","last_clean":"2023-03-03T06:23:44.406140+0000","last_became_active":"2023-03-03T06:23:40.337414+0000","last_became_peered":"2023-03-03T06:23:40.337414+0000","last_unstale":"2023-03-03T06:23:44.406140+0000","last_undegraded":"2023-03-03T06:23:44.406140+0000","last_fullsized":"2023-03-03T06:23:44.406140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:05:13.223033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396852+0000","last_change":"2023-03-03T06:23:40.340779+0000","last_active":"2023-03-03T06:23:44.396852+0000","last_peered":"2023-03-03T06:23:44.396852+0000","last_clean":"2023-03-03T06:23:44.396852+0000","last_became_active":"2023-03-03T06:23:40.338305+0000","last_became_peered":"2023-03-03T06:23:40.338305+0000","last_unstale":"2023-03-03T06:23:44.396852+0000","last_undegraded":"2023-03-03T06:23:44.396852+0000","last_fullsized":"2023-03-03T06:23:44.396852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:52:26.393574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.396806+0000","last_change":"2023-03-03T06:23:40.348094+0000","last_active":"2023-03-03T06:23:44.396806+0000","last_peered":"2023-03-03T06:23:44.396806+0000","last_clean":"2023-03-03T06:23:44.396806+0000","last_became_active":"2023-03-03T06:23:40.347736+0000","last_became_peered":"2023-03-03T06:23:40.347736+0000","last_unstale":"2023-03-03T06:23:44.396806+0000","last_undegraded":"2023-03-03T06:23:44.396806+0000","last_fullsized":"2023-03-03T06:23:44.396806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:11:53.657995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.401149+0000","last_change":"2023-03-03T06:23:40.349146+0000","last_active":"2023-03-03T06:23:44.401149+0000","last_peered":"2023-03-03T06:23:44.401149+0000","last_clean":"2023-03-03T06:23:44.401149+0000","last_became_active":"2023-03-03T06:23:40.348873+0000","last_became_peered":"2023-03-03T06:23:40.348873+0000","last_unstale":"2023-03-03T06:23:44.401149+0000","last_undegraded":"2023-03-03T06:23:44.401149+0000","last_fullsized":"2023-03-03T06:23:44.401149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:12:12.591518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-03-03T06:23:44.407642+0000","last_change":"2023-03-03T06:23:40.348472+0000","last_active":"2023-03-03T06:23:44.407642+0000","last_peered":"2023-03-03T06:23:44.407642+0000","last_clean":"2023-03-03T06:23:44.407642+0000","last_became_active":"2023-03-03T06:23:40.348181+0000","last_became_peered":"2023-03-03T06:23:40.348181+0000","last_unstale":"2023-03-03T06:23:44.407642+0000","last_undegraded":"2023-03-03T06:23:44.407642+0000","last_fullsized":"2023-03-03T06:23:44.407642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:39.888479+0000","last_clean_scrub_stamp":"2023-03-03T06:23:39.888479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:03:45.180190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4528,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9260,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362580,"statfs":{"total":96636764160,"available":96627281920,"internally_reserved":0,"allocated":888832,"data_stored":703731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8076,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363764,"statfs":{"total":96636764160,"available":96628494336,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9232,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362608,"statfs":{"total":96636764160,"available":96627310592,"internally_reserved":0,"allocated":860160,"data_stored":699769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8140,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363700,"statfs":{"total":96636764160,"available":96628428800,"internally_reserved":0,"allocated":266240,"data_stored":109006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8076,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363764,"statfs":{"total":96636764160,"available":96628494336,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":270336,"data_stored":109491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8224,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363616,"statfs":{"total":96636764160,"available":96628342784,"internally_reserved":0,"allocated":286720,"data_stored":113203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8144,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363696,"statfs":{"total":96636764160,"available":96628424704,"internally_reserved":0,"allocated":270336,"data_stored":109076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:24:04.789 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-03-03T06:24:04.789 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-03-03T06:24:04.790 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-03-03T06:24:04.790 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-03-03T06:24:04.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.941+0000 7fb462728700 1 Processor -- start 2023-03-03T06:24:04.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.941+0000 7fb462728700 1 -- start start 2023-03-03T06:24:04.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.942+0000 7fb462728700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb45c15cc50 0x7fb45c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.942+0000 7fb462728700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c0cb2a0 0x7fb45c06c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.942+0000 7fb462728700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c0b0690 con 0x7fb45c06cef0 2023-03-03T06:24:04.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.942+0000 7fb462728700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c0cb7d0 con 0x7fb45c15cc50 2023-03-03T06:24:04.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.942+0000 7fb462728700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0cbab0 con 0x7fb45c0cb2a0 2023-03-03T06:24:04.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.942+0000 7fb45b7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb45c06cef0 0x7fb45c0cc740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60014/0 (socket says 172.21.15.5:60014) 2023-03-03T06:24:04.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.942+0000 7fb45b7fe700 1 -- 172.21.15.5:0/882888814 learned_addr learned my addr 172.21.15.5:0/882888814 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb460cc5700 1 --2- 172.21.15.5:0/882888814 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c0cb2a0 0x7fb45c06c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45bfff700 1 --2- 172.21.15.5:0/882888814 >> v2:172.21.15.191:3300/0 conn(0x7fb45c15cc50 0x7fb45c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220585052 0 0) 0x7fb45c0b0690 con 0x7fb45c06cef0 2023-03-03T06:24:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4480035b0 con 0x7fb45c06cef0 2023-03-03T06:24:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1634097818 0 0) 0x7fb4480035b0 con 0x7fb45c06cef0 2023-03-03T06:24:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c0cb2a0 msgr2=0x7fb45c06c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 --2- 172.21.15.5:0/882888814 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c0cb2a0 0x7fb45c06c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 >> v2:172.21.15.191:3300/0 conn(0x7fb45c15cc50 msgr2=0x7fb45c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:04.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 --2- 172.21.15.5:0/882888814 >> v2:172.21.15.191:3300/0 conn(0x7fb45c15cc50 0x7fb45c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c0cbd90 con 0x7fb45c06cef0 2023-03-03T06:24:04.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fb444001670 con 0x7fb45c06cef0 2023-03-03T06:24:04.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45bfff700 1 --2- 172.21.15.5:0/882888814 >> v2:172.21.15.191:3300/0 conn(0x7fb45c15cc50 0x7fb45c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:04.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 >> v1:172.21.15.5:6789/0 conn(0x7fb45c06cef0 legacy=0x7fb45c0cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 --2- 172.21.15.5:0/882888814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb448003a70 0x7fb448003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 --2- 172.21.15.5:0/882888814 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c0cb2a0 0x7fb448004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 --2- 172.21.15.5:0/882888814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb448004d90 0x7fb448005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0cb7d0 con 0x7fb448004d90 2023-03-03T06:24:04.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0cbab0 con 0x7fb448003a70 2023-03-03T06:24:04.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44800ba60 con 0x7fb45c0cb2a0 2023-03-03T06:24:04.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb460cc5700 1 --2- 172.21.15.5:0/882888814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb448004d90 0x7fb448005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45bfff700 1 --2- 172.21.15.5:0/882888814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb448003a70 0x7fb448003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb45b7fe700 1 --2- 172.21.15.5:0/882888814 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c0cb2a0 0x7fb448004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb460cc5700 1 -- 172.21.15.5:0/882888814 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c0cb2a0 msgr2=0x7fb448004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb460cc5700 1 --2- 172.21.15.5:0/882888814 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c0cb2a0 0x7fb448004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb460cc5700 1 -- 172.21.15.5:0/882888814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb448003a70 msgr2=0x7fb448003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb460cc5700 1 --2- 172.21.15.5:0/882888814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb448003a70 0x7fb448003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.943+0000 7fb460cc5700 1 -- 172.21.15.5:0/882888814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4480035b0 con 0x7fb448004d90 2023-03-03T06:24:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.944+0000 7fb45bfff700 1 --2- 172.21.15.5:0/882888814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb448003a70 0x7fb448003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.944+0000 7fb460cc5700 1 --2- 172.21.15.5:0/882888814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb448004d90 0x7fb448005200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb454009f90 tx=0x7fb448005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10991e8aa6e40636 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.944+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400ebd0 con 0x7fb448004d90 2023-03-03T06:24:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.944+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45400f040 con 0x7fb448004d90 2023-03-03T06:24:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.944+0000 7fb45affd700 1 -- 172.21.15.5:0/882888814 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454014480 con 0x7fb448004d90 2023-03-03T06:24:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.944+0000 7fb462728700 1 -- 172.21.15.5:0/882888814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb448004d90 msgr2=0x7fb448005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.944+0000 7fb462728700 1 --2- 172.21.15.5:0/882888814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb448004d90 0x7fb448005200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb454009f90 tx=0x7fb448005880 comp rx=0 tx=0).stop 2023-03-03T06:24:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.944+0000 7fb460cc5700 1 -- 172.21.15.5:0/882888814 reap_dead start 2023-03-03T06:24:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.944+0000 7fb462728700 1 -- 172.21.15.5:0/882888814 shutdown_connections 2023-03-03T06:24:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.944+0000 7fb462728700 1 -- 172.21.15.5:0/882888814 >> 172.21.15.5:0/882888814 conn(0x7fb45c0b2cb0 msgr2=0x7fb45c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.944+0000 7fb462728700 1 -- 172.21.15.5:0/882888814 shutdown_connections 2023-03-03T06:24:04.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.944+0000 7fb462728700 1 -- 172.21.15.5:0/882888814 wait complete. 2023-03-03T06:24:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.946+0000 7fb462728700 1 Processor -- start 2023-03-03T06:24:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.946+0000 7fb462728700 1 -- start start 2023-03-03T06:24:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb462728700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb448004d90 0x7fb45c0c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb462728700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c159a40 0x7fb45c14ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb462728700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c159eb0 0x7fb45c14d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb462728700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0cdc60 con 0x7fb45c159eb0 2023-03-03T06:24:04.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb462728700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c14d740 con 0x7fb448004d90 2023-03-03T06:24:04.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb462728700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0cdeb0 con 0x7fb45c159a40 2023-03-03T06:24:04.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb460cc5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c159eb0 0x7fb45c14d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb460cc5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c159eb0 0x7fb45c14d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41954/0 (socket says 172.21.15.5:41954) 2023-03-03T06:24:04.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb460cc5700 1 -- 172.21.15.5:0/1812732350 learned_addr learned my addr 172.21.15.5:0/1812732350 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:04.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb45b7fe700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c159a40 0x7fb45c14ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb45bfff700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb448004d90 0x7fb45c0c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb460cc5700 1 -- 172.21.15.5:0/1812732350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c159a40 msgr2=0x7fb45c14ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb460cc5700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c159a40 0x7fb45c14ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb460cc5700 1 -- 172.21.15.5:0/1812732350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb448004d90 msgr2=0x7fb45c0c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb460cc5700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb448004d90 0x7fb45c0c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb460cc5700 1 -- 172.21.15.5:0/1812732350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c0b1b50 con 0x7fb45c159eb0 2023-03-03T06:24:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb45b7fe700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c159a40 0x7fb45c14ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb45bfff700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb448004d90 0x7fb45c0c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb460cc5700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c159eb0 0x7fb45c14d200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb448004790 tx=0x7fb454009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb458ff9700 1 -- 172.21.15.5:0/1812732350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454007000 con 0x7fb45c159eb0 2023-03-03T06:24:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb458ff9700 1 -- 172.21.15.5:0/1812732350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45401fc70 con 0x7fb45c159eb0 2023-03-03T06:24:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb462728700 1 -- 172.21.15.5:0/1812732350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c0cc070 con 0x7fb45c159eb0 2023-03-03T06:24:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb458ff9700 1 -- 172.21.15.5:0/1812732350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540146c0 con 0x7fb45c159eb0 2023-03-03T06:24:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.947+0000 7fb462728700 1 -- 172.21.15.5:0/1812732350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c0b1ce0 con 0x7fb45c159eb0 2023-03-03T06:24:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.948+0000 7fb462728700 1 -- 172.21.15.5:0/1812732350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45c0cec70 con 0x7fb45c159eb0 2023-03-03T06:24:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.949+0000 7fb458ff9700 1 -- 172.21.15.5:0/1812732350 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb454014820 con 0x7fb45c159eb0 2023-03-03T06:24:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.949+0000 7fb458ff9700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb43c0682f0 0x7fb43c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.949+0000 7fb458ff9700 1 -- 172.21.15.5:0/1812732350 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb4540896d0 con 0x7fb45c159eb0 2023-03-03T06:24:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.949+0000 7fb45bfff700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb43c0682f0 0x7fb43c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.950+0000 7fb45bfff700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb43c0682f0 0x7fb43c06a7a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009ce0 tx=0x7fb44c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:04.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:04.953+0000 7fb458ff9700 1 -- 172.21.15.5:0/1812732350 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb454055c40 con 0x7fb45c159eb0 2023-03-03T06:24:05.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.190+0000 7fb462728700 1 -- 172.21.15.5:0/1812732350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb45c04e6e0 con 0x7fb45c159eb0 2023-03-03T06:24:05.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.190+0000 7fb458ff9700 1 -- 172.21.15.5:0/1812732350 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb454059260 con 0x7fb45c159eb0 2023-03-03T06:24:05.192 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:05.193 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-03-03T06:24:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.192+0000 7fb462728700 1 -- 172.21.15.5:0/1812732350 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb43c0682f0 msgr2=0x7fb43c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.192+0000 7fb462728700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb43c0682f0 0x7fb43c06a7a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009ce0 tx=0x7fb44c008040 comp rx=0 tx=0).stop 2023-03-03T06:24:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.192+0000 7fb462728700 1 -- 172.21.15.5:0/1812732350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c159eb0 msgr2=0x7fb45c14d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.192+0000 7fb462728700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c159eb0 0x7fb45c14d200 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb448004790 tx=0x7fb454009750 comp rx=0 tx=0).stop 2023-03-03T06:24:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.192+0000 7fb462728700 1 -- 172.21.15.5:0/1812732350 shutdown_connections 2023-03-03T06:24:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.192+0000 7fb462728700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb45c159eb0 0x7fb45c14d200 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.192+0000 7fb462728700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb448004d90 0x7fb45c0c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.192+0000 7fb462728700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb43c0682f0 0x7fb43c06a7a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.192+0000 7fb462728700 1 --2- 172.21.15.5:0/1812732350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb45c159a40 0x7fb45c14ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.192+0000 7fb462728700 1 -- 172.21.15.5:0/1812732350 >> 172.21.15.5:0/1812732350 conn(0x7fb45c0b2cb0 msgr2=0x7fb45c06c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.192+0000 7fb462728700 1 -- 172.21.15.5:0/1812732350 shutdown_connections 2023-03-03T06:24:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.192+0000 7fb462728700 1 -- 172.21.15.5:0/1812732350 wait complete. 2023-03-03T06:24:05.207 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-03-03T06:24:05.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:05.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.329+0000 7fdfbd913700 1 Processor -- start 2023-03-03T06:24:05.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.330+0000 7fdfbd913700 1 -- start start 2023-03-03T06:24:05.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.330+0000 7fdfbd913700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfb815cd40 0x7fdfb80b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.330+0000 7fdfbd913700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdfb80cba50 0x7fdfb80b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.330+0000 7fdfbd913700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb815d4e0 con 0x7fdfb80cd3e0 2023-03-03T06:24:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.330+0000 7fdfbd913700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb815d7c0 con 0x7fdfb80cba50 2023-03-03T06:24:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.330+0000 7fdfbd913700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb815daa0 con 0x7fdfb815cd40 2023-03-03T06:24:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.330+0000 7fdfb67fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdfb80cba50 0x7fdfb80b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:05.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.331+0000 7fdfb67fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdfb80cba50 0x7fdfb80b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41960/0 (socket says 172.21.15.5:41960) 2023-03-03T06:24:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.331+0000 7fdfb67fc700 1 -- 172.21.15.5:0/2668061812 learned_addr learned my addr 172.21.15.5:0/2668061812 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.331+0000 7fdfb6ffd700 1 --2- 172.21.15.5:0/2668061812 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfb815cd40 0x7fdfb80b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.331+0000 7fdfb67fc700 1 -- 172.21.15.5:0/2668061812 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfb815cd40 msgr2=0x7fdfb80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.331+0000 7fdfb67fc700 1 --2- 172.21.15.5:0/2668061812 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfb815cd40 0x7fdfb80b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.331+0000 7fdfb67fc700 1 -- 172.21.15.5:0/2668061812 >> v1:172.21.15.191:6789/0 conn(0x7fdfb80cd3e0 legacy=0x7fdfb8160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.331+0000 7fdfb67fc700 1 -- 172.21.15.5:0/2668061812 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb815dd80 con 0x7fdfb80cba50 2023-03-03T06:24:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.331+0000 7fdfb6ffd700 1 --2- 172.21.15.5:0/2668061812 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfb815cd40 0x7fdfb80b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.331+0000 7fdfb67fc700 1 --2- 172.21.15.5:0/2668061812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb80cba50 0x7fdfb80b1e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0006fd0 tx=0x7fdfa0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d2ce6b8293776 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.331+0000 7fdfb5ffb700 1 -- 172.21.15.5:0/2668061812 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0005e30 con 0x7fdfb80cba50 2023-03-03T06:24:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.331+0000 7fdfb5ffb700 1 -- 172.21.15.5:0/2668061812 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa0004030 con 0x7fdfb80cba50 2023-03-03T06:24:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.331+0000 7fdfb5ffb700 1 -- 172.21.15.5:0/2668061812 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00043e0 con 0x7fdfb80cba50 2023-03-03T06:24:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.332+0000 7fdfbd913700 1 -- 172.21.15.5:0/2668061812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb80cba50 msgr2=0x7fdfb80b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.332+0000 7fdfbd913700 1 --2- 172.21.15.5:0/2668061812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb80cba50 0x7fdfb80b1e10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0006fd0 tx=0x7fdfa0009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.332+0000 7fdfbd913700 1 -- 172.21.15.5:0/2668061812 shutdown_connections 2023-03-03T06:24:05.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.332+0000 7fdfbd913700 1 --2- 172.21.15.5:0/2668061812 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfb815cd40 0x7fdfb80b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.332+0000 7fdfbd913700 1 --2- 172.21.15.5:0/2668061812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb80cba50 0x7fdfb80b1e10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.332+0000 7fdfbd913700 1 -- 172.21.15.5:0/2668061812 >> 172.21.15.5:0/2668061812 conn(0x7fdfb80cc8d0 msgr2=0x7fdfb80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:05.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.332+0000 7fdfbd913700 1 -- 172.21.15.5:0/2668061812 shutdown_connections 2023-03-03T06:24:05.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.332+0000 7fdfbd913700 1 -- 172.21.15.5:0/2668061812 wait complete. 2023-03-03T06:24:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.333+0000 7fdfbd913700 1 Processor -- start 2023-03-03T06:24:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.333+0000 7fdfbd913700 1 -- start start 2023-03-03T06:24:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfbd913700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfb80cba50 0x7fdfb806c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:05.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfbd913700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfb80cd3e0 0x7fdfb80b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfbd913700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb815cd40 0x7fdfb80c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfbd913700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80b5ba0 con 0x7fdfb815cd40 2023-03-03T06:24:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfbd913700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80b5020 con 0x7fdfb80cba50 2023-03-03T06:24:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfbd913700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb80b5300 con 0x7fdfb80cd3e0 2023-03-03T06:24:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfb77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb815cd40 0x7fdfb80c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:05.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfb77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb815cd40 0x7fdfb80c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41968/0 (socket says 172.21.15.5:41968) 2023-03-03T06:24:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfb77fe700 1 -- 172.21.15.5:0/1773194872 learned_addr learned my addr 172.21.15.5:0/1773194872 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfb67fc700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfb80cd3e0 0x7fdfb80b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfb6ffd700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfb80cba50 0x7fdfb806c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfb77fe700 1 -- 172.21.15.5:0/1773194872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfb80cd3e0 msgr2=0x7fdfb80b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfb77fe700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfb80cd3e0 0x7fdfb80b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfb77fe700 1 -- 172.21.15.5:0/1773194872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfb80cba50 msgr2=0x7fdfb806c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfb77fe700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfb80cba50 0x7fdfb806c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfb77fe700 1 -- 172.21.15.5:0/1773194872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa0009500 con 0x7fdfb815cd40 2023-03-03T06:24:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.334+0000 7fdfb77fe700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb815cd40 0x7fdfb80c98e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000cc50 tx=0x7fdfb000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.335+0000 7fdfaffff700 1 -- 172.21.15.5:0/1773194872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0003c00 con 0x7fdfb815cd40 2023-03-03T06:24:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.335+0000 7fdfaffff700 1 -- 172.21.15.5:0/1773194872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb0003d60 con 0x7fdfb815cd40 2023-03-03T06:24:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.335+0000 7fdfbd913700 1 -- 172.21.15.5:0/1773194872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb80ca530 con 0x7fdfb815cd40 2023-03-03T06:24:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.335+0000 7fdfaffff700 1 -- 172.21.15.5:0/1773194872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000aab0 con 0x7fdfb815cd40 2023-03-03T06:24:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.335+0000 7fdfbd913700 1 -- 172.21.15.5:0/1773194872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb815e060 con 0x7fdfb815cd40 2023-03-03T06:24:05.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.336+0000 7fdfbd913700 1 -- 172.21.15.5:0/1773194872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb815d110 con 0x7fdfb815cd40 2023-03-03T06:24:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.336+0000 7fdfaffff700 1 -- 172.21.15.5:0/1773194872 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdfb0010050 con 0x7fdfb815cd40 2023-03-03T06:24:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.336+0000 7fdfaffff700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdf980682f0 0x7fdf9806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.337+0000 7fdfaffff700 1 -- 172.21.15.5:0/1773194872 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdfb0085e80 con 0x7fdfb815cd40 2023-03-03T06:24:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.337+0000 7fdfb6ffd700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdf980682f0 0x7fdf9806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.337+0000 7fdfb6ffd700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdf980682f0 0x7fdf9806a7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80aea80 tx=0x7fdfa8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:05.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.341+0000 7fdfaffff700 1 -- 172.21.15.5:0/1773194872 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdfb0052310 con 0x7fdfb815cd40 2023-03-03T06:24:05.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.534+0000 7fdfbd913700 1 -- 172.21.15.5:0/1773194872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfb804e6e0 con 0x7fdfb815cd40 2023-03-03T06:24:05.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.536+0000 7fdfaffff700 1 -- 172.21.15.5:0/1773194872 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7fdfb0055930 con 0x7fdfb815cd40 2023-03-03T06:24:05.538 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:05.538 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.538+0000 7fdfbd913700 1 -- 172.21.15.5:0/1773194872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdf980682f0 msgr2=0x7fdf9806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.538+0000 7fdfbd913700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdf980682f0 0x7fdf9806a7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80aea80 tx=0x7fdfa8008040 comp rx=0 tx=0).stop 2023-03-03T06:24:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.538+0000 7fdfbd913700 1 -- 172.21.15.5:0/1773194872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb815cd40 msgr2=0x7fdfb80c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.538+0000 7fdfbd913700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb815cd40 0x7fdfb80c98e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000cc50 tx=0x7fdfb000cf60 comp rx=0 tx=0).stop 2023-03-03T06:24:05.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.538+0000 7fdfbd913700 1 -- 172.21.15.5:0/1773194872 shutdown_connections 2023-03-03T06:24:05.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.538+0000 7fdfbd913700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfb815cd40 0x7fdfb80c98e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.538+0000 7fdfbd913700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdfb80cba50 0x7fdfb806c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.538+0000 7fdfbd913700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdf980682f0 0x7fdf9806a7a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.538+0000 7fdfbd913700 1 --2- 172.21.15.5:0/1773194872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdfb80cd3e0 0x7fdfb80b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.538+0000 7fdfbd913700 1 -- 172.21.15.5:0/1773194872 >> 172.21.15.5:0/1773194872 conn(0x7fdfb80cc8d0 msgr2=0x7fdfb806b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:05.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.538+0000 7fdfbd913700 1 -- 172.21.15.5:0/1773194872 shutdown_connections 2023-03-03T06:24:05.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.538+0000 7fdfbd913700 1 -- 172.21.15.5:0/1773194872 wait complete. 2023-03-03T06:24:05.552 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:23:38.141777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:23:39.283589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-03T06:23:42.422930+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-03T06:24:05.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:24:05.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.678+0000 7f2710082700 1 Processor -- start 2023-03-03T06:24:05.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.679+0000 7f2710082700 1 -- start start 2023-03-03T06:24:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.679+0000 7f2710082700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f270815c630 0x7f27080b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:05.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.679+0000 7f2710082700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27080cf0b0 0x7f270806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.679+0000 7f2710082700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270806bcd0 con 0x7f270815ca00 2023-03-03T06:24:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.679+0000 7f2710082700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27080b3260 con 0x7f270815c630 2023-03-03T06:24:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.680+0000 7f2710082700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270806bf20 con 0x7f27080cf0b0 2023-03-03T06:24:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.680+0000 7f270de1e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f270815c630 0x7f27080b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.680+0000 7f270de1e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f270815c630 0x7f27080b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41972/0 (socket says 172.21.15.5:41972) 2023-03-03T06:24:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.680+0000 7f270de1e700 1 -- 172.21.15.5:0/3945019569 learned_addr learned my addr 172.21.15.5:0/3945019569 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:05.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.680+0000 7f270e61f700 1 --2- 172.21.15.5:0/3945019569 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27080cf0b0 0x7f270806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:05.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.680+0000 7f270de1e700 1 -- 172.21.15.5:0/3945019569 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27080cf0b0 msgr2=0x7f270806ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:05.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.680+0000 7f270de1e700 1 --2- 172.21.15.5:0/3945019569 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27080cf0b0 0x7f270806ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.680+0000 7f270de1e700 1 -- 172.21.15.5:0/3945019569 >> v1:172.21.15.191:6789/0 conn(0x7f270815ca00 legacy=0x7f27080ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.680+0000 7f270de1e700 1 -- 172.21.15.5:0/3945019569 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270806c200 con 0x7f270815c630 2023-03-03T06:24:05.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.680+0000 7f270de1e700 1 --2- 172.21.15.5:0/3945019569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815c630 0x7f27080b2850 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27040098f0 tx=0x7f2704009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9250948f877d534 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:05.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.680+0000 7f270ce1c700 1 -- 172.21.15.5:0/3945019569 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704011830 con 0x7f270815c630 2023-03-03T06:24:05.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.680+0000 7f270ce1c700 1 -- 172.21.15.5:0/3945019569 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2704011990 con 0x7f270815c630 2023-03-03T06:24:05.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.680+0000 7f270ce1c700 1 -- 172.21.15.5:0/3945019569 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704011d20 con 0x7f270815c630 2023-03-03T06:24:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.681+0000 7f2710082700 1 -- 172.21.15.5:0/3945019569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815c630 msgr2=0x7f27080b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.681+0000 7f2710082700 1 --2- 172.21.15.5:0/3945019569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815c630 0x7f27080b2850 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27040098f0 tx=0x7f2704009c00 comp rx=0 tx=0).stop 2023-03-03T06:24:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.681+0000 7f2710082700 1 -- 172.21.15.5:0/3945019569 shutdown_connections 2023-03-03T06:24:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.681+0000 7f2710082700 1 --2- 172.21.15.5:0/3945019569 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27080cf0b0 0x7f270806ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.681+0000 7f2710082700 1 --2- 172.21.15.5:0/3945019569 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815c630 0x7f27080b2850 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.681+0000 7f2710082700 1 -- 172.21.15.5:0/3945019569 >> 172.21.15.5:0/3945019569 conn(0x7f2708070010 msgr2=0x7f27080cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.681+0000 7f2710082700 1 -- 172.21.15.5:0/3945019569 shutdown_connections 2023-03-03T06:24:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.681+0000 7f2710082700 1 -- 172.21.15.5:0/3945019569 wait complete. 2023-03-03T06:24:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.682+0000 7f2710082700 1 Processor -- start 2023-03-03T06:24:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.682+0000 7f2710082700 1 -- start start 2023-03-03T06:24:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f2710082700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27080cf0b0 0x7f270815fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f2710082700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f270815c630 0x7f2708151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:05.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f2710082700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815ca00 0x7f27080ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f2710082700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270815d510 con 0x7f270815ca00 2023-03-03T06:24:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f2710082700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270815cf50 con 0x7f27080cf0b0 2023-03-03T06:24:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f2710082700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270815d230 con 0x7f270815c630 2023-03-03T06:24:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f270e61f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815ca00 0x7f27080ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f270e61f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815ca00 0x7f27080ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41982/0 (socket says 172.21.15.5:41982) 2023-03-03T06:24:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f270e61f700 1 -- 172.21.15.5:0/500664664 learned_addr learned my addr 172.21.15.5:0/500664664 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f270d61d700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f270815c630 0x7f2708151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:05.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f270de1e700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27080cf0b0 0x7f270815fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f270e61f700 1 -- 172.21.15.5:0/500664664 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f270815c630 msgr2=0x7f2708151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f270e61f700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f270815c630 0x7f2708151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f270e61f700 1 -- 172.21.15.5:0/500664664 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27080cf0b0 msgr2=0x7f270815fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f270e61f700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27080cf0b0 0x7f270815fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.683+0000 7f270e61f700 1 -- 172.21.15.5:0/500664664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2704009550 con 0x7f270815ca00 2023-03-03T06:24:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.684+0000 7f270e61f700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815ca00 0x7f27080ccca0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f270000efc0 tx=0x7f270000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:05.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.684+0000 7f26fa7fc700 1 -- 172.21.15.5:0/500664664 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270000cc90 con 0x7f270815ca00 2023-03-03T06:24:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.684+0000 7f26fa7fc700 1 -- 172.21.15.5:0/500664664 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270000f040 con 0x7f270815ca00 2023-03-03T06:24:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.684+0000 7f2710082700 1 -- 172.21.15.5:0/500664664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2708161160 con 0x7f270815ca00 2023-03-03T06:24:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.684+0000 7f26fa7fc700 1 -- 172.21.15.5:0/500664664 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000146c0 con 0x7f270815ca00 2023-03-03T06:24:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.684+0000 7f2710082700 1 -- 172.21.15.5:0/500664664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270806c4e0 con 0x7f270815ca00 2023-03-03T06:24:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.685+0000 7f2710082700 1 -- 172.21.15.5:0/500664664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27081612f0 con 0x7f270815ca00 2023-03-03T06:24:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.685+0000 7f26fa7fc700 1 -- 172.21.15.5:0/500664664 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2700014820 con 0x7f270815ca00 2023-03-03T06:24:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.685+0000 7f26fa7fc700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26ec0682f0 0x7f26ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:05.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.685+0000 7f26fa7fc700 1 -- 172.21.15.5:0/500664664 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2700086c70 con 0x7f270815ca00 2023-03-03T06:24:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.686+0000 7f270de1e700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26ec0682f0 0x7f26ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.686+0000 7f270de1e700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26ec0682f0 0x7f26ec06a7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2704009c40 tx=0x7f2704008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:05.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.690+0000 7f26fa7fc700 1 -- 172.21.15.5:0/500664664 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f27000531e0 con 0x7f270815ca00 2023-03-03T06:24:05.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.879+0000 7f2710082700 1 -- 172.21.15.5:0/500664664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f27080cc2d0 con 0x7f270815ca00 2023-03-03T06:24:05.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.880+0000 7f26fa7fc700 1 -- 172.21.15.5:0/500664664 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f27000180a0 con 0x7f270815ca00 2023-03-03T06:24:05.882 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:24:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.881+0000 7f2710082700 1 -- 172.21.15.5:0/500664664 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26ec0682f0 msgr2=0x7f26ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.881+0000 7f2710082700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26ec0682f0 0x7f26ec06a7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2704009c40 tx=0x7f2704008030 comp rx=0 tx=0).stop 2023-03-03T06:24:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.881+0000 7f2710082700 1 -- 172.21.15.5:0/500664664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815ca00 msgr2=0x7f27080ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.881+0000 7f2710082700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815ca00 0x7f27080ccca0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f270000efc0 tx=0x7f270000c3a0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.882+0000 7f2710082700 1 -- 172.21.15.5:0/500664664 shutdown_connections 2023-03-03T06:24:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.882+0000 7f2710082700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815ca00 0x7f27080ccca0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.882+0000 7f2710082700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27080cf0b0 0x7f270815fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.882+0000 7f2710082700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26ec0682f0 0x7f26ec06a7a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.882+0000 7f2710082700 1 --2- 172.21.15.5:0/500664664 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f270815c630 0x7f2708151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.882+0000 7f2710082700 1 -- 172.21.15.5:0/500664664 >> 172.21.15.5:0/500664664 conn(0x7f2708070010 msgr2=0x7f27080ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.882+0000 7f2710082700 1 -- 172.21.15.5:0/500664664 shutdown_connections 2023-03-03T06:24:05.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:05.882+0000 7f2710082700 1 -- 172.21.15.5:0/500664664 wait complete. 2023-03-03T06:24:05.896 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:24:06.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.021+0000 7fd095677700 1 Processor -- start 2023-03-03T06:24:06.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.021+0000 7fd095677700 1 -- start start 2023-03-03T06:24:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.021+0000 7fd095677700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0900cdbe0 0x7fd09006ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.021+0000 7fd095677700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd09015cec0 0x7fd09015d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.021+0000 7fd095677700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09006a8b0 con 0x7fd0900b4ae0 2023-03-03T06:24:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.021+0000 7fd095677700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09006a330 con 0x7fd09015cec0 2023-03-03T06:24:06.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.021+0000 7fd095677700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900cdfb0 con 0x7fd0900cdbe0 2023-03-03T06:24:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.022+0000 7fd08e7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd09015cec0 0x7fd09015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.022+0000 7fd08f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd0900b4ae0 0x7fd0900d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60064/0 (socket says 172.21.15.5:60064) 2023-03-03T06:24:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.022+0000 7fd08f7fe700 1 -- 172.21.15.5:0/2955909915 learned_addr learned my addr 172.21.15.5:0/2955909915 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.022+0000 7fd08effd700 1 --2- 172.21.15.5:0/2955909915 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0900cdbe0 0x7fd09006ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.022+0000 7fd08e7fc700 1 -- 172.21.15.5:0/2955909915 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0900cdbe0 msgr2=0x7fd09006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.022+0000 7fd08e7fc700 1 --2- 172.21.15.5:0/2955909915 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0900cdbe0 0x7fd09006ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.022+0000 7fd08e7fc700 1 -- 172.21.15.5:0/2955909915 >> v1:172.21.15.5:6789/0 conn(0x7fd0900b4ae0 legacy=0x7fd0900d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.022+0000 7fd08dffb700 1 -- 172.21.15.5:0/2955909915 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2978997305 0 0) 0x7fd09006a8b0 con 0x7fd0900b4ae0 2023-03-03T06:24:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.022+0000 7fd08e7fc700 1 -- 172.21.15.5:0/2955909915 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09006b280 con 0x7fd09015cec0 2023-03-03T06:24:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.022+0000 7fd08e7fc700 1 --2- 172.21.15.5:0/2955909915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09015cec0 0x7fd09015d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd084009840 tx=0x7fd084009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39c5e5e4f811cc7 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.022+0000 7fd08dffb700 1 -- 172.21.15.5:0/2955909915 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084011830 con 0x7fd09015cec0 2023-03-03T06:24:06.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.022+0000 7fd08dffb700 1 -- 172.21.15.5:0/2955909915 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd084011990 con 0x7fd09015cec0 2023-03-03T06:24:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.022+0000 7fd08dffb700 1 -- 172.21.15.5:0/2955909915 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084011d20 con 0x7fd09015cec0 2023-03-03T06:24:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.023+0000 7fd095677700 1 -- 172.21.15.5:0/2955909915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09015cec0 msgr2=0x7fd09015d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.023+0000 7fd095677700 1 --2- 172.21.15.5:0/2955909915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09015cec0 0x7fd09015d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd084009840 tx=0x7fd084009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.023+0000 7fd095677700 1 -- 172.21.15.5:0/2955909915 shutdown_connections 2023-03-03T06:24:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.023+0000 7fd095677700 1 --2- 172.21.15.5:0/2955909915 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0900cdbe0 0x7fd09006ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.023+0000 7fd095677700 1 --2- 172.21.15.5:0/2955909915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd09015cec0 0x7fd09015d330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.023+0000 7fd095677700 1 -- 172.21.15.5:0/2955909915 >> 172.21.15.5:0/2955909915 conn(0x7fd0900cfae0 msgr2=0x7fd0900cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.023+0000 7fd095677700 1 -- 172.21.15.5:0/2955909915 shutdown_connections 2023-03-03T06:24:06.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.023+0000 7fd095677700 1 -- 172.21.15.5:0/2955909915 wait complete. 2023-03-03T06:24:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.024+0000 7fd095677700 1 Processor -- start 2023-03-03T06:24:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.024+0000 7fd095677700 1 -- start start 2023-03-03T06:24:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd095677700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0900b4ae0 0x7fd0900c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd095677700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0900cdbe0 0x7fd0900b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd095677700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd09015cec0 0x7fd090150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd095677700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900b7590 con 0x7fd0900b4ae0 2023-03-03T06:24:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd095677700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900b66e0 con 0x7fd0900cdbe0 2023-03-03T06:24:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd095677700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900b69c0 con 0x7fd09015cec0 2023-03-03T06:24:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd08effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0900b4ae0 0x7fd0900c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd08effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0900b4ae0 0x7fd0900c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41992/0 (socket says 172.21.15.5:41992) 2023-03-03T06:24:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd08effd700 1 -- 172.21.15.5:0/2415046739 learned_addr learned my addr 172.21.15.5:0/2415046739 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd08f7fe700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd09015cec0 0x7fd090150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd08e7fc700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0900cdbe0 0x7fd0900b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd08effd700 1 -- 172.21.15.5:0/2415046739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd09015cec0 msgr2=0x7fd090150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd08effd700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd09015cec0 0x7fd090150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd08effd700 1 -- 172.21.15.5:0/2415046739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0900cdbe0 msgr2=0x7fd0900b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd08effd700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0900cdbe0 0x7fd0900b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd08effd700 1 -- 172.21.15.5:0/2415046739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0840094a0 con 0x7fd0900b4ae0 2023-03-03T06:24:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd08e7fc700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0900cdbe0 0x7fd0900b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:06.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.025+0000 7fd08effd700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0900b4ae0 0x7fd0900c91d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd08000e810 tx=0x7fd08000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.026+0000 7fd0777fe700 1 -- 172.21.15.5:0/2415046739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080013610 con 0x7fd0900b4ae0 2023-03-03T06:24:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.026+0000 7fd0777fe700 1 -- 172.21.15.5:0/2415046739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd080013770 con 0x7fd0900b4ae0 2023-03-03T06:24:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.026+0000 7fd095677700 1 -- 172.21.15.5:0/2415046739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09015dcd0 con 0x7fd0900b4ae0 2023-03-03T06:24:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.026+0000 7fd0777fe700 1 -- 172.21.15.5:0/2415046739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080013b20 con 0x7fd0900b4ae0 2023-03-03T06:24:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.026+0000 7fd095677700 1 -- 172.21.15.5:0/2415046739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09015d9f0 con 0x7fd0900b4ae0 2023-03-03T06:24:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.027+0000 7fd095677700 1 -- 172.21.15.5:0/2415046739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09006a540 con 0x7fd0900b4ae0 2023-03-03T06:24:06.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.027+0000 7fd0777fe700 1 -- 172.21.15.5:0/2415046739 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd080023070 con 0x7fd0900b4ae0 2023-03-03T06:24:06.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.027+0000 7fd0777fe700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd07c0682c0 0x7fd07c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.028+0000 7fd0777fe700 1 -- 172.21.15.5:0/2415046739 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd080085c90 con 0x7fd0900b4ae0 2023-03-03T06:24:06.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.028+0000 7fd08e7fc700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd07c0682c0 0x7fd07c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.028+0000 7fd08e7fc700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd07c0682c0 0x7fd07c06a770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd0901522d0 tx=0x7fd084008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:06.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.032+0000 7fd0777fe700 1 -- 172.21.15.5:0/2415046739 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd080052180 con 0x7fd0900b4ae0 2023-03-03T06:24:06.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.223+0000 7fd095677700 1 -- 172.21.15.5:0/2415046739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd09004e6e0 con 0x7fd0900b4ae0 2023-03-03T06:24:06.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.224+0000 7fd0777fe700 1 -- 172.21.15.5:0/2415046739 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0800557a0 con 0x7fd0900b4ae0 2023-03-03T06:24:06.226 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:24:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.225+0000 7fd095677700 1 -- 172.21.15.5:0/2415046739 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd07c0682c0 msgr2=0x7fd07c06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.225+0000 7fd095677700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd07c0682c0 0x7fd07c06a770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd0901522d0 tx=0x7fd084008030 comp rx=0 tx=0).stop 2023-03-03T06:24:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.225+0000 7fd095677700 1 -- 172.21.15.5:0/2415046739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0900b4ae0 msgr2=0x7fd0900c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.225+0000 7fd095677700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0900b4ae0 0x7fd0900c91d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd08000e810 tx=0x7fd08000ebd0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.225+0000 7fd095677700 1 -- 172.21.15.5:0/2415046739 shutdown_connections 2023-03-03T06:24:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.225+0000 7fd095677700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd07c0682c0 0x7fd07c06a770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.225+0000 7fd095677700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd09015cec0 0x7fd090150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.225+0000 7fd095677700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0900b4ae0 0x7fd0900c91d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.225+0000 7fd095677700 1 --2- 172.21.15.5:0/2415046739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0900cdbe0 0x7fd0900b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.225+0000 7fd095677700 1 -- 172.21.15.5:0/2415046739 >> 172.21.15.5:0/2415046739 conn(0x7fd0900cfae0 msgr2=0x7fd09015e060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:06.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.226+0000 7fd095677700 1 -- 172.21.15.5:0/2415046739 shutdown_connections 2023-03-03T06:24:06.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.226+0000 7fd095677700 1 -- 172.21.15.5:0/2415046739 wait complete. 2023-03-03T06:24:06.240 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:24:06.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.365+0000 7fc1974e7700 1 Processor -- start 2023-03-03T06:24:06.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.365+0000 7fc1974e7700 1 -- start start 2023-03-03T06:24:06.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.366+0000 7fc1974e7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1900b1960 0x7fc19006cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.366+0000 7fc1974e7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19015d110 con 0x7fc19015cd40 2023-03-03T06:24:06.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.366+0000 7fc1974e7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19006bf10 con 0x7fc1900cb050 2023-03-03T06:24:06.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.366+0000 7fc1974e7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19006c1f0 con 0x7fc1900b1960 2023-03-03T06:24:06.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.366+0000 7fc195283700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc19015cd40 0x7fc19006b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60074/0 (socket says 172.21.15.5:60074) 2023-03-03T06:24:06.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.366+0000 7fc195283700 1 -- 172.21.15.5:0/2480452776 learned_addr learned my addr 172.21.15.5:0/2480452776 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:06.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.367+0000 7fc194a82700 1 --2- 172.21.15.5:0/2480452776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1900b1960 0x7fc19006cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.367+0000 7fc187fff700 1 -- 172.21.15.5:0/2480452776 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190192989 0 0) 0x7fc19015d110 con 0x7fc19015cd40 2023-03-03T06:24:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.367+0000 7fc187fff700 1 -- 172.21.15.5:0/2480452776 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc17c0035b0 con 0x7fc19015cd40 2023-03-03T06:24:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.367+0000 7fc187fff700 1 -- 172.21.15.5:0/2480452776 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2972602862 0 0) 0x7fc17c0035b0 con 0x7fc19015cd40 2023-03-03T06:24:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.367+0000 7fc194a82700 1 -- 172.21.15.5:0/2480452776 >> v1:172.21.15.191:6789/0 conn(0x7fc1900cb050 legacy=0x7fc1900cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.367+0000 7fc194a82700 1 -- 172.21.15.5:0/2480452776 >> v1:172.21.15.5:6789/0 conn(0x7fc19015cd40 legacy=0x7fc19006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.367+0000 7fc194a82700 1 -- 172.21.15.5:0/2480452776 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19006c4d0 con 0x7fc1900b1960 2023-03-03T06:24:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.367+0000 7fc194a82700 1 --2- 172.21.15.5:0/2480452776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1900b1960 0x7fc19006cfb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009870 tx=0x7fc18c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5993be5b7f1f3b6e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.367+0000 7fc187fff700 1 -- 172.21.15.5:0/2480452776 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc180001670 con 0x7fc1900b1960 2023-03-03T06:24:06.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.367+0000 7fc187fff700 1 -- 172.21.15.5:0/2480452776 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c004030 con 0x7fc1900b1960 2023-03-03T06:24:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.367+0000 7fc187fff700 1 -- 172.21.15.5:0/2480452776 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0043c0 con 0x7fc1900b1960 2023-03-03T06:24:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.368+0000 7fc1974e7700 1 -- 172.21.15.5:0/2480452776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1900b1960 msgr2=0x7fc19006cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.368+0000 7fc1974e7700 1 --2- 172.21.15.5:0/2480452776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1900b1960 0x7fc19006cfb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009870 tx=0x7fc18c009b80 comp rx=0 tx=0).stop 2023-03-03T06:24:06.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.368+0000 7fc1974e7700 1 -- 172.21.15.5:0/2480452776 shutdown_connections 2023-03-03T06:24:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.368+0000 7fc1974e7700 1 --2- 172.21.15.5:0/2480452776 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc1900b1960 0x7fc19006cfb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.368+0000 7fc1974e7700 1 -- 172.21.15.5:0/2480452776 >> 172.21.15.5:0/2480452776 conn(0x7fc1900cc8d0 msgr2=0x7fc1900cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.368+0000 7fc1974e7700 1 -- 172.21.15.5:0/2480452776 shutdown_connections 2023-03-03T06:24:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.368+0000 7fc1974e7700 1 -- 172.21.15.5:0/2480452776 wait complete. 2023-03-03T06:24:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.369+0000 7fc1974e7700 1 Processor -- start 2023-03-03T06:24:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.369+0000 7fc1974e7700 1 -- start start 2023-03-03T06:24:06.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc1974e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1900b1960 0x7fc1900ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc1974e7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1900cb050 0x7fc1900c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc1974e7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc19015cd40 0x7fc190159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc1974e7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900ab8d0 con 0x7fc1900b1960 2023-03-03T06:24:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc1974e7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900c7e70 con 0x7fc1900cb050 2023-03-03T06:24:06.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc1974e7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900c80f0 con 0x7fc19015cd40 2023-03-03T06:24:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc195283700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1900b1960 0x7fc1900ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc195283700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1900b1960 0x7fc1900ae520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42006/0 (socket says 172.21.15.5:42006) 2023-03-03T06:24:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc195283700 1 -- 172.21.15.5:0/3050650999 learned_addr learned my addr 172.21.15.5:0/3050650999 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc195a84700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc19015cd40 0x7fc190159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc194a82700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1900cb050 0x7fc1900c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc195283700 1 -- 172.21.15.5:0/3050650999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc19015cd40 msgr2=0x7fc190159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc195283700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc19015cd40 0x7fc190159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc195283700 1 -- 172.21.15.5:0/3050650999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1900cb050 msgr2=0x7fc1900c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc195283700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1900cb050 0x7fc1900c7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.370+0000 7fc195283700 1 -- 172.21.15.5:0/3050650999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c0094a0 con 0x7fc1900b1960 2023-03-03T06:24:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.371+0000 7fc195a84700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc19015cd40 0x7fc190159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:06.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.371+0000 7fc195283700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1900b1960 0x7fc1900ae520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc18000c730 tx=0x7fc18000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:06.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.371+0000 7fc185ffb700 1 -- 172.21.15.5:0/3050650999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc180004c80 con 0x7fc1900b1960 2023-03-03T06:24:06.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.371+0000 7fc185ffb700 1 -- 172.21.15.5:0/3050650999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc180004de0 con 0x7fc1900b1960 2023-03-03T06:24:06.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.371+0000 7fc1974e7700 1 -- 172.21.15.5:0/3050650999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19006ca90 con 0x7fc1900b1960 2023-03-03T06:24:06.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.371+0000 7fc185ffb700 1 -- 172.21.15.5:0/3050650999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1800072f0 con 0x7fc1900b1960 2023-03-03T06:24:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.371+0000 7fc1974e7700 1 -- 172.21.15.5:0/3050650999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19006c7b0 con 0x7fc1900b1960 2023-03-03T06:24:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.372+0000 7fc1974e7700 1 -- 172.21.15.5:0/3050650999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19006bbb0 con 0x7fc1900b1960 2023-03-03T06:24:06.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.372+0000 7fc185ffb700 1 -- 172.21.15.5:0/3050650999 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc18001a020 con 0x7fc1900b1960 2023-03-03T06:24:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.373+0000 7fc185ffb700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc1740682f0 0x7fc17406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.373+0000 7fc185ffb700 1 -- 172.21.15.5:0/3050650999 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc180085c80 con 0x7fc1900b1960 2023-03-03T06:24:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.373+0000 7fc194a82700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc1740682f0 0x7fc17406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.373+0000 7fc194a82700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc1740682f0 0x7fc17406a7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc1900adc20 tx=0x7fc18c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:06.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.377+0000 7fc185ffb700 1 -- 172.21.15.5:0/3050650999 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc180052190 con 0x7fc1900b1960 2023-03-03T06:24:06.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.570+0000 7fc1974e7700 1 -- 172.21.15.5:0/3050650999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc19004e6e0 con 0x7fc1900b1960 2023-03-03T06:24:06.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.570+0000 7fc185ffb700 1 -- 172.21.15.5:0/3050650999 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc1800557b0 con 0x7fc1900b1960 2023-03-03T06:24:06.573 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:06.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.572+0000 7fc1974e7700 1 -- 172.21.15.5:0/3050650999 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc1740682f0 msgr2=0x7fc17406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.572+0000 7fc1974e7700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc1740682f0 0x7fc17406a7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc1900adc20 tx=0x7fc18c008030 comp rx=0 tx=0).stop 2023-03-03T06:24:06.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.572+0000 7fc1974e7700 1 -- 172.21.15.5:0/3050650999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1900b1960 msgr2=0x7fc1900ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.572+0000 7fc1974e7700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1900b1960 0x7fc1900ae520 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc18000c730 tx=0x7fc18000caf0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.573+0000 7fc1974e7700 1 -- 172.21.15.5:0/3050650999 shutdown_connections 2023-03-03T06:24:06.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.573+0000 7fc1974e7700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc1740682f0 0x7fc17406a7a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.573+0000 7fc1974e7700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc19015cd40 0x7fc190159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.573+0000 7fc1974e7700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1900b1960 0x7fc1900ae520 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.573+0000 7fc1974e7700 1 --2- 172.21.15.5:0/3050650999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1900cb050 0x7fc1900c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.573+0000 7fc1974e7700 1 -- 172.21.15.5:0/3050650999 >> 172.21.15.5:0/3050650999 conn(0x7fc1900cc8d0 msgr2=0x7fc190066040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:06.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.573+0000 7fc1974e7700 1 -- 172.21.15.5:0/3050650999 shutdown_connections 2023-03-03T06:24:06.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.573+0000 7fc1974e7700 1 -- 172.21.15.5:0/3050650999 wait complete. 2023-03-03T06:24:06.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:24:06.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.713+0000 7f79b3e2a700 1 Processor -- start 2023-03-03T06:24:06.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.713+0000 7f79b3e2a700 1 -- start start 2023-03-03T06:24:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b3e2a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0cd3e0 0x7f79ac0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b3e2a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ac15e160 con 0x7f79ac0b1fe0 2023-03-03T06:24:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b3e2a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ac15d110 con 0x7f79ac15cd40 2023-03-03T06:24:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b3e2a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0cd870 con 0x7f79ac0cd3e0 2023-03-03T06:24:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b23c7700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f79ac0b1fe0 0x7f79ac0ce290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60092/0 (socket says 172.21.15.5:60092) 2023-03-03T06:24:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b23c7700 1 -- 172.21.15.5:0/3471166252 learned_addr learned my addr 172.21.15.5:0/3471166252 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b13c5700 1 --2- 172.21.15.5:0/3471166252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0cd3e0 0x7f79ac0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410138574 0 0) 0x7f79ac15e160 con 0x7f79ac0b1fe0 2023-03-03T06:24:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79980035b0 con 0x7f79ac0b1fe0 2023-03-03T06:24:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3605429249 0 0) 0x7f79980035b0 con 0x7f79ac0b1fe0 2023-03-03T06:24:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0cd3e0 msgr2=0x7f79ac0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b0bc4700 1 --2- 172.21.15.5:0/3471166252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0cd3e0 0x7f79ac0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 >> v1:172.21.15.191:6789/0 conn(0x7f79ac15cd40 legacy=0x7f79ac0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac15d3c0 con 0x7f79ac0b1fe0 2023-03-03T06:24:06.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f79a40019f0 con 0x7f79ac0b1fe0 2023-03-03T06:24:06.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.714+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 >> v1:172.21.15.5:6789/0 conn(0x7f79ac0b1fe0 legacy=0x7f79ac0ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b0bc4700 1 --2- 172.21.15.5:0/3471166252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7998003a30 0x7f7998003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b0bc4700 1 --2- 172.21.15.5:0/3471166252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0cd3e0 0x7f7998004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b0bc4700 1 --2- 172.21.15.5:0/3471166252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7998004d90 0x7f7998005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0cd870 con 0x7f7998003a30 2023-03-03T06:24:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799800bac0 con 0x7f7998004d90 2023-03-03T06:24:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799800bc80 con 0x7f79ac0cd3e0 2023-03-03T06:24:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b1bc6700 1 --2- 172.21.15.5:0/3471166252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7998003a30 0x7f7998003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b13c5700 1 --2- 172.21.15.5:0/3471166252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0cd3e0 0x7f7998004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b23c7700 1 --2- 172.21.15.5:0/3471166252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7998004d90 0x7f7998005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b1bc6700 1 -- 172.21.15.5:0/3471166252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0cd3e0 msgr2=0x7f7998004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b1bc6700 1 --2- 172.21.15.5:0/3471166252 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0cd3e0 0x7f7998004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b1bc6700 1 -- 172.21.15.5:0/3471166252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7998004d90 msgr2=0x7f7998005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b1bc6700 1 --2- 172.21.15.5:0/3471166252 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7998004d90 0x7f7998005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b1bc6700 1 -- 172.21.15.5:0/3471166252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79980035b0 con 0x7f7998003a30 2023-03-03T06:24:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b1bc6700 1 --2- 172.21.15.5:0/3471166252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7998003a30 0x7f7998003e00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f79a80018d0 tx=0x7f7998005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93497a63ace0ade2 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800c690 con 0x7f7998003a30 2023-03-03T06:24:06.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a800c810 con 0x7f7998003a30 2023-03-03T06:24:06.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.715+0000 7f79b0bc4700 1 -- 172.21.15.5:0/3471166252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800cbc0 con 0x7f7998003a30 2023-03-03T06:24:06.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.716+0000 7f79b3e2a700 1 -- 172.21.15.5:0/3471166252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7998003a30 msgr2=0x7f7998003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.716+0000 7f79b3e2a700 1 --2- 172.21.15.5:0/3471166252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7998003a30 0x7f7998003e00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f79a80018d0 tx=0x7f7998005880 comp rx=0 tx=0).stop 2023-03-03T06:24:06.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.716+0000 7f79b23c7700 1 -- 172.21.15.5:0/3471166252 reap_dead start 2023-03-03T06:24:06.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.716+0000 7f79b3e2a700 1 -- 172.21.15.5:0/3471166252 shutdown_connections 2023-03-03T06:24:06.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.716+0000 7f79b3e2a700 1 -- 172.21.15.5:0/3471166252 >> 172.21.15.5:0/3471166252 conn(0x7f79ac0cc8d0 msgr2=0x7f79ac0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:06.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.716+0000 7f79b3e2a700 1 -- 172.21.15.5:0/3471166252 shutdown_connections 2023-03-03T06:24:06.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.716+0000 7f79b3e2a700 1 -- 172.21.15.5:0/3471166252 wait complete. 2023-03-03T06:24:06.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.717+0000 7f79b3e2a700 1 Processor -- start 2023-03-03T06:24:06.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.717+0000 7f79b3e2a700 1 -- start start 2023-03-03T06:24:06.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b3e2a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7998003a30 0x7f79ac15b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b3e2a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79ac0b0870 0x7f79ac0b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b3e2a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ab8d0 0x7f79ac0abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b3e2a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac151060 con 0x7f79ac0b0870 2023-03-03T06:24:06.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b3e2a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0b1050 con 0x7f7998003a30 2023-03-03T06:24:06.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b3e2a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac15a5c0 con 0x7f79ac0ab8d0 2023-03-03T06:24:06.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b13c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79ac0b0870 0x7f79ac0b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b13c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79ac0b0870 0x7f79ac0b14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42028/0 (socket says 172.21.15.5:42028) 2023-03-03T06:24:06.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b13c5700 1 -- 172.21.15.5:0/2079129103 learned_addr learned my addr 172.21.15.5:0/2079129103 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:06.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b1bc6700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7998003a30 0x7f79ac15b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b23c7700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ab8d0 0x7f79ac0abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b13c5700 1 -- 172.21.15.5:0/2079129103 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ab8d0 msgr2=0x7f79ac0abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b13c5700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ab8d0 0x7f79ac0abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b13c5700 1 -- 172.21.15.5:0/2079129103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7998003a30 msgr2=0x7f79ac15b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b13c5700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7998003a30 0x7f79ac15b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b13c5700 1 -- 172.21.15.5:0/2079129103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac15d980 con 0x7f79ac0b0870 2023-03-03T06:24:06.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b23c7700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ab8d0 0x7f79ac0abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:06.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.718+0000 7f79b13c5700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79ac0b0870 0x7f79ac0b14c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f799c0119c0 tx=0x7f799c011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:06.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.719+0000 7f79a27fc700 1 -- 172.21.15.5:0/2079129103 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c004240 con 0x7f79ac0b0870 2023-03-03T06:24:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.719+0000 7f79a27fc700 1 -- 172.21.15.5:0/2079129103 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c0043a0 con 0x7f79ac0b0870 2023-03-03T06:24:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.719+0000 7f79a27fc700 1 -- 172.21.15.5:0/2079129103 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c00f730 con 0x7f79ac0b0870 2023-03-03T06:24:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.719+0000 7f79b3e2a700 1 -- 172.21.15.5:0/2079129103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac15d6a0 con 0x7f79ac0b0870 2023-03-03T06:24:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.719+0000 7f79b3e2a700 1 -- 172.21.15.5:0/2079129103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ac15dc60 con 0x7f79ac0b0870 2023-03-03T06:24:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.720+0000 7f79b3e2a700 1 -- 172.21.15.5:0/2079129103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ac04e6e0 con 0x7f79ac0b0870 2023-03-03T06:24:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.720+0000 7f79a27fc700 1 -- 172.21.15.5:0/2079129103 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f799c025070 con 0x7f79ac0b0870 2023-03-03T06:24:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.720+0000 7f79a27fc700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f79900682f0 0x7f799006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.720+0000 7f79a27fc700 1 -- 172.21.15.5:0/2079129103 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f799c086310 con 0x7f79ac0b0870 2023-03-03T06:24:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.720+0000 7f79b1bc6700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f79900682f0 0x7f799006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.721+0000 7f79b1bc6700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f79900682f0 0x7f799006a7a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f79a8014040 tx=0x7f79a8005040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.725+0000 7f79a27fc700 1 -- 172.21.15.5:0/2079129103 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f799c052820 con 0x7f79ac0b0870 2023-03-03T06:24:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.917+0000 7f79b3e2a700 1 -- 172.21.15.5:0/2079129103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79ac0b25e0 con 0x7f79ac0b0870 2023-03-03T06:24:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.917+0000 7f79a27fc700 1 -- 172.21.15.5:0/2079129103 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f799c055e40 con 0x7f79ac0b0870 2023-03-03T06:24:06.920 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:24:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.919+0000 7f79b3e2a700 1 -- 172.21.15.5:0/2079129103 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f79900682f0 msgr2=0x7f799006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.919+0000 7f79b3e2a700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f79900682f0 0x7f799006a7a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f79a8014040 tx=0x7f79a8005040 comp rx=0 tx=0).stop 2023-03-03T06:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.919+0000 7f79b3e2a700 1 -- 172.21.15.5:0/2079129103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79ac0b0870 msgr2=0x7f79ac0b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.919+0000 7f79b3e2a700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79ac0b0870 0x7f79ac0b14c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f799c0119c0 tx=0x7f799c011d80 comp rx=0 tx=0).stop 2023-03-03T06:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.919+0000 7f79b3e2a700 1 -- 172.21.15.5:0/2079129103 shutdown_connections 2023-03-03T06:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.919+0000 7f79b3e2a700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f79900682f0 0x7f799006a7a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.919+0000 7f79b3e2a700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79ac0ab8d0 0x7f79ac0abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.919+0000 7f79b3e2a700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7998003a30 0x7f79ac15b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.919+0000 7f79b3e2a700 1 --2- 172.21.15.5:0/2079129103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79ac0b0870 0x7f79ac0b14c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.919+0000 7f79b3e2a700 1 -- 172.21.15.5:0/2079129103 >> 172.21.15.5:0/2079129103 conn(0x7f79ac0cc8d0 msgr2=0x7f79ac0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.919+0000 7f79b3e2a700 1 -- 172.21.15.5:0/2079129103 shutdown_connections 2023-03-03T06:24:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:06.919+0000 7f79b3e2a700 1 -- 172.21.15.5:0/2079129103 wait complete. 2023-03-03T06:24:06.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-03T06:24:07.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.059+0000 7fc4a5209700 1 Processor -- start 2023-03-03T06:24:07.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.059+0000 7fc4a5209700 1 -- start start 2023-03-03T06:24:07.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.059+0000 7fc4a5209700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4a00af080 0x7fc4a00cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:07.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.059+0000 7fc4a5209700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc4a006cf20 0x7fc4a00cb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:07.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.059+0000 7fc4a5209700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a00cd990 con 0x7fc4a00af450 2023-03-03T06:24:07.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.060+0000 7fc4a5209700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a006d540 con 0x7fc4a006cf20 2023-03-03T06:24:07.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.060+0000 7fc4a5209700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a00cdbe0 con 0x7fc4a00af080 2023-03-03T06:24:07.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.060+0000 7fc49ed9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4a00af080 0x7fc4a00cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:07.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.060+0000 7fc49ed9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4a00af080 0x7fc4a00cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:40114/0 (socket says 172.21.15.5:40114) 2023-03-03T06:24:07.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.060+0000 7fc49ed9d700 1 -- 172.21.15.5:0/2607258938 learned_addr learned my addr 172.21.15.5:0/2607258938 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:07.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.060+0000 7fc49f59e700 1 --2- 172.21.15.5:0/2607258938 >> v2:172.21.15.191:3300/0 conn(0x7fc4a006cf20 0x7fc4a00cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:07.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.060+0000 7fc49ed9d700 1 -- 172.21.15.5:0/2607258938 >> v2:172.21.15.191:3300/0 conn(0x7fc4a006cf20 msgr2=0x7fc4a00cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:07.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.060+0000 7fc49ed9d700 1 --2- 172.21.15.5:0/2607258938 >> v2:172.21.15.191:3300/0 conn(0x7fc4a006cf20 0x7fc4a00cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.060+0000 7fc49ed9d700 1 -- 172.21.15.5:0/2607258938 >> v1:172.21.15.191:6789/0 conn(0x7fc4a00af450 legacy=0x7fc4a006c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:07.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.060+0000 7fc49ed9d700 1 -- 172.21.15.5:0/2607258938 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a00cdec0 con 0x7fc4a00af080 2023-03-03T06:24:07.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.060+0000 7fc49ed9d700 1 --2- 172.21.15.5:0/2607258938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4a00af080 0x7fc4a00cafc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc4940098f0 tx=0x7fc494009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=468318267741fd8e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:07.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.061+0000 7fc49dd9b700 1 -- 172.21.15.5:0/2607258938 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494011830 con 0x7fc4a00af080 2023-03-03T06:24:07.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.061+0000 7fc49dd9b700 1 -- 172.21.15.5:0/2607258938 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc494011990 con 0x7fc4a00af080 2023-03-03T06:24:07.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.061+0000 7fc49dd9b700 1 -- 172.21.15.5:0/2607258938 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494011d20 con 0x7fc4a00af080 2023-03-03T06:24:07.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.061+0000 7fc4a5209700 1 -- 172.21.15.5:0/2607258938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4a00af080 msgr2=0x7fc4a00cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:07.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.061+0000 7fc4a5209700 1 --2- 172.21.15.5:0/2607258938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4a00af080 0x7fc4a00cafc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc4940098f0 tx=0x7fc494009c00 comp rx=0 tx=0).stop 2023-03-03T06:24:07.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.061+0000 7fc4a5209700 1 -- 172.21.15.5:0/2607258938 shutdown_connections 2023-03-03T06:24:07.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.061+0000 7fc4a5209700 1 --2- 172.21.15.5:0/2607258938 >> v2:172.21.15.191:3300/0 conn(0x7fc4a006cf20 0x7fc4a00cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.061+0000 7fc4a5209700 1 --2- 172.21.15.5:0/2607258938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4a00af080 0x7fc4a00cafc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.061+0000 7fc4a5209700 1 -- 172.21.15.5:0/2607258938 >> 172.21.15.5:0/2607258938 conn(0x7fc4a00cc840 msgr2=0x7fc4a00ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:07.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.061+0000 7fc4a5209700 1 -- 172.21.15.5:0/2607258938 shutdown_connections 2023-03-03T06:24:07.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.061+0000 7fc4a5209700 1 -- 172.21.15.5:0/2607258938 wait complete. 2023-03-03T06:24:07.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.063+0000 7fc4a5209700 1 Processor -- start 2023-03-03T06:24:07.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.063+0000 7fc4a5209700 1 -- start start 2023-03-03T06:24:07.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.063+0000 7fc4a5209700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4a006cf20 0x7fc4a00ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:07.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.063+0000 7fc4a5209700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4a00af080 0x7fc4a014fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:07.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.063+0000 7fc4a5209700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a00af450 0x7fc4a0150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:07.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.063+0000 7fc4a5209700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a015ed30 con 0x7fc4a00af450 2023-03-03T06:24:07.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.063+0000 7fc4a5209700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a015dc90 con 0x7fc4a006cf20 2023-03-03T06:24:07.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.063+0000 7fc4a5209700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a015df70 con 0x7fc4a00af080 2023-03-03T06:24:07.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc49f59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a00af450 0x7fc4a0150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:07.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc49f59e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a00af450 0x7fc4a0150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42044/0 (socket says 172.21.15.5:42044) 2023-03-03T06:24:07.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc49f59e700 1 -- 172.21.15.5:0/2871866268 learned_addr learned my addr 172.21.15.5:0/2871866268 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:07.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc49e59c700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4a00af080 0x7fc4a014fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:07.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc49ed9d700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4a006cf20 0x7fc4a00ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:07.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc49f59e700 1 -- 172.21.15.5:0/2871866268 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4a00af080 msgr2=0x7fc4a014fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:07.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc49f59e700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4a00af080 0x7fc4a014fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc49f59e700 1 -- 172.21.15.5:0/2871866268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4a006cf20 msgr2=0x7fc4a00ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:07.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc49f59e700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4a006cf20 0x7fc4a00ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc49f59e700 1 -- 172.21.15.5:0/2871866268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494009550 con 0x7fc4a00af450 2023-03-03T06:24:07.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc49ed9d700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4a006cf20 0x7fc4a00ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:07.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc49f59e700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a00af450 0x7fc4a0150370 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc49800efc0 tx=0x7fc49800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:07.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc4877fe700 1 -- 172.21.15.5:0/2871866268 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498009ea0 con 0x7fc4a00af450 2023-03-03T06:24:07.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc4877fe700 1 -- 172.21.15.5:0/2871866268 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49800f040 con 0x7fc4a00af450 2023-03-03T06:24:07.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc4a5209700 1 -- 172.21.15.5:0/2871866268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a00ce6c0 con 0x7fc4a00af450 2023-03-03T06:24:07.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc4877fe700 1 -- 172.21.15.5:0/2871866268 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc498014480 con 0x7fc4a00af450 2023-03-03T06:24:07.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.064+0000 7fc4a5209700 1 -- 172.21.15.5:0/2871866268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a00ce1a0 con 0x7fc4a00af450 2023-03-03T06:24:07.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.065+0000 7fc4a5209700 1 -- 172.21.15.5:0/2871866268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a00ce850 con 0x7fc4a00af450 2023-03-03T06:24:07.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.066+0000 7fc4877fe700 1 -- 172.21.15.5:0/2871866268 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc4980145e0 con 0x7fc4a00af450 2023-03-03T06:24:07.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.066+0000 7fc4877fe700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc48c0682f0 0x7fc48c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:07.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.066+0000 7fc4877fe700 1 -- 172.21.15.5:0/2871866268 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc498086c60 con 0x7fc4a00af450 2023-03-03T06:24:07.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.066+0000 7fc49ed9d700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc48c0682f0 0x7fc48c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:07.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.067+0000 7fc49ed9d700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc48c0682f0 0x7fc48c06a7a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc494009c40 tx=0x7fc494008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:07.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.070+0000 7fc4877fe700 1 -- 172.21.15.5:0/2871866268 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc4980531d0 con 0x7fc4a00af450 2023-03-03T06:24:07.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.265+0000 7fc4a5209700 1 -- 172.21.15.5:0/2871866268 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc4a004e6e0 con 0x7fc4a00af450 2023-03-03T06:24:07.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.266+0000 7fc4877fe700 1 -- 172.21.15.5:0/2871866268 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc4980180a0 con 0x7fc4a00af450 2023-03-03T06:24:07.270 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:07.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.268+0000 7fc4a5209700 1 -- 172.21.15.5:0/2871866268 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc48c0682f0 msgr2=0x7fc48c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.268+0000 7fc4a5209700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc48c0682f0 0x7fc48c06a7a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc494009c40 tx=0x7fc494008030 comp rx=0 tx=0).stop 2023-03-03T06:24:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.268+0000 7fc4a5209700 1 -- 172.21.15.5:0/2871866268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a00af450 msgr2=0x7fc4a0150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.268+0000 7fc4a5209700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a00af450 0x7fc4a0150370 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc49800efc0 tx=0x7fc49800c3a0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.268+0000 7fc4a5209700 1 -- 172.21.15.5:0/2871866268 shutdown_connections 2023-03-03T06:24:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.268+0000 7fc4a5209700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4a00af450 0x7fc4a0150370 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.268+0000 7fc4a5209700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4a006cf20 0x7fc4a00ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.268+0000 7fc4a5209700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc48c0682f0 0x7fc48c06a7a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.268+0000 7fc4a5209700 1 --2- 172.21.15.5:0/2871866268 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4a00af080 0x7fc4a014fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.268+0000 7fc4a5209700 1 -- 172.21.15.5:0/2871866268 >> 172.21.15.5:0/2871866268 conn(0x7fc4a00cc840 msgr2=0x7fc4a00ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.268+0000 7fc4a5209700 1 -- 172.21.15.5:0/2871866268 shutdown_connections 2023-03-03T06:24:07.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.268+0000 7fc4a5209700 1 -- 172.21.15.5:0/2871866268 wait complete. 2023-03-03T06:24:07.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:24:07.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.405+0000 7fc4c0eea700 1 Processor -- start 2023-03-03T06:24:07.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.405+0000 7fc4c0eea700 1 -- start start 2023-03-03T06:24:07.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4c0eea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc158a00 0x7fc4bc0cb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:07.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4c0eea700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc4bc0c9640 0x7fc4bc0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:07.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4c0eea700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc0cb5a0 con 0x7fc4bc15d180 2023-03-03T06:24:07.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4c0eea700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc0cabd0 con 0x7fc4bc0c9640 2023-03-03T06:24:07.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4c0eea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0ca2a0 con 0x7fc4bc158a00 2023-03-03T06:24:07.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4b9d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc4bc15d180 0x7fc4bc06d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60124/0 (socket says 172.21.15.5:60124) 2023-03-03T06:24:07.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4b9d9b700 1 -- 172.21.15.5:0/3575588511 learned_addr learned my addr 172.21.15.5:0/3575588511 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:07.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4ba59c700 1 --2- 172.21.15.5:0/3575588511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc158a00 0x7fc4bc0cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:07.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4bad9d700 1 --2- 172.21.15.5:0/3575588511 >> v2:172.21.15.191:3300/0 conn(0x7fc4bc0c9640 0x7fc4bc0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:07.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4b959a700 1 -- 172.21.15.5:0/3575588511 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748477918 0 0) 0x7fc4b0001110 con 0x7fc4bc15d180 2023-03-03T06:24:07.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4b959a700 1 -- 172.21.15.5:0/3575588511 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a40035b0 con 0x7fc4bc15d180 2023-03-03T06:24:07.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4ba59c700 1 -- 172.21.15.5:0/3575588511 >> v2:172.21.15.191:3300/0 conn(0x7fc4bc0c9640 msgr2=0x7fc4bc0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:07.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4ba59c700 1 --2- 172.21.15.5:0/3575588511 >> v2:172.21.15.191:3300/0 conn(0x7fc4bc0c9640 0x7fc4bc0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4ba59c700 1 -- 172.21.15.5:0/3575588511 >> v1:172.21.15.5:6789/0 conn(0x7fc4bc15d180 legacy=0x7fc4bc06d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:07.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4ba59c700 1 -- 172.21.15.5:0/3575588511 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0ca580 con 0x7fc4bc158a00 2023-03-03T06:24:07.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.406+0000 7fc4ba59c700 1 --2- 172.21.15.5:0/3575588511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc158a00 0x7fc4bc0cb060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00a9e0 tx=0x7fc4ac00acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f17686fd736d81a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:07.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.407+0000 7fc4b959a700 1 -- 172.21.15.5:0/3575588511 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00cb70 con 0x7fc4bc158a00 2023-03-03T06:24:07.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.407+0000 7fc4b959a700 1 -- 172.21.15.5:0/3575588511 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac00ccd0 con 0x7fc4bc158a00 2023-03-03T06:24:07.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.407+0000 7fc4b959a700 1 -- 172.21.15.5:0/3575588511 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac018620 con 0x7fc4bc158a00 2023-03-03T06:24:07.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.407+0000 7fc4c0eea700 1 -- 172.21.15.5:0/3575588511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc158a00 msgr2=0x7fc4bc0cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:07.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.407+0000 7fc4c0eea700 1 --2- 172.21.15.5:0/3575588511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc158a00 0x7fc4bc0cb060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00a9e0 tx=0x7fc4ac00acf0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.407+0000 7fc4c0eea700 1 -- 172.21.15.5:0/3575588511 shutdown_connections 2023-03-03T06:24:07.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.407+0000 7fc4c0eea700 1 --2- 172.21.15.5:0/3575588511 >> v2:172.21.15.191:3300/0 conn(0x7fc4bc0c9640 0x7fc4bc0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.407+0000 7fc4c0eea700 1 --2- 172.21.15.5:0/3575588511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc158a00 0x7fc4bc0cb060 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.407+0000 7fc4c0eea700 1 -- 172.21.15.5:0/3575588511 >> 172.21.15.5:0/3575588511 conn(0x7fc4bc0b1c60 msgr2=0x7fc4bc0cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:07.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.407+0000 7fc4c0eea700 1 -- 172.21.15.5:0/3575588511 shutdown_connections 2023-03-03T06:24:07.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.407+0000 7fc4c0eea700 1 -- 172.21.15.5:0/3575588511 wait complete. 2023-03-03T06:24:07.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.409+0000 7fc4c0eea700 1 Processor -- start 2023-03-03T06:24:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.409+0000 7fc4c0eea700 1 -- start start 2023-03-03T06:24:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.410+0000 7fc4c0eea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c9640 0x7fc4bc155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.410+0000 7fc4c0eea700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4bc158a00 0x7fc4bc0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.410+0000 7fc4c0eea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc15d180 0x7fc4bc1f1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.410+0000 7fc4c0eea700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0b5320 con 0x7fc4bc0c9640 2023-03-03T06:24:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.410+0000 7fc4c0eea700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0b4340 con 0x7fc4bc158a00 2023-03-03T06:24:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.410+0000 7fc4c0eea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc1f21f0 con 0x7fc4bc15d180 2023-03-03T06:24:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.410+0000 7fc4ba59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c9640 0x7fc4bc155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.410+0000 7fc4ba59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c9640 0x7fc4bc155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42054/0 (socket says 172.21.15.5:42054) 2023-03-03T06:24:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.410+0000 7fc4ba59c700 1 -- 172.21.15.5:0/4012772527 learned_addr learned my addr 172.21.15.5:0/4012772527 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.410+0000 7fc4b9d9b700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4bc158a00 0x7fc4bc0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.410+0000 7fc4bad9d700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc15d180 0x7fc4bc1f1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.411+0000 7fc4ba59c700 1 -- 172.21.15.5:0/4012772527 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc15d180 msgr2=0x7fc4bc1f1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:07.416 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.411+0000 7fc4ba59c700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc15d180 0x7fc4bc1f1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.411+0000 7fc4ba59c700 1 -- 172.21.15.5:0/4012772527 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4bc158a00 msgr2=0x7fc4bc0b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.411+0000 7fc4ba59c700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4bc158a00 0x7fc4bc0b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.411+0000 7fc4ba59c700 1 -- 172.21.15.5:0/4012772527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac00a640 con 0x7fc4bc0c9640 2023-03-03T06:24:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.411+0000 7fc4ba59c700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c9640 0x7fc4bc155d60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00a1c0 tx=0x7fc4ac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.411+0000 7fc4aaffd700 1 -- 172.21.15.5:0/4012772527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac003ab0 con 0x7fc4bc0c9640 2023-03-03T06:24:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.411+0000 7fc4aaffd700 1 -- 172.21.15.5:0/4012772527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac003c10 con 0x7fc4bc0c9640 2023-03-03T06:24:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.411+0000 7fc4c0eea700 1 -- 172.21.15.5:0/4012772527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc15d5f0 con 0x7fc4bc0c9640 2023-03-03T06:24:07.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.411+0000 7fc4aaffd700 1 -- 172.21.15.5:0/4012772527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac021480 con 0x7fc4bc0c9640 2023-03-03T06:24:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.411+0000 7fc4c0eea700 1 -- 172.21.15.5:0/4012772527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc0ca860 con 0x7fc4bc0c9640 2023-03-03T06:24:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.412+0000 7fc4c0eea700 1 -- 172.21.15.5:0/4012772527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc06ddb0 con 0x7fc4bc0c9640 2023-03-03T06:24:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.412+0000 7fc4aaffd700 1 -- 172.21.15.5:0/4012772527 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc4ac028030 con 0x7fc4bc0c9640 2023-03-03T06:24:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.413+0000 7fc4aaffd700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc49c0682f0 0x7fc49c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.413+0000 7fc4aaffd700 1 -- 172.21.15.5:0/4012772527 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc4ac087440 con 0x7fc4bc0c9640 2023-03-03T06:24:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.413+0000 7fc4b9d9b700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc49c0682f0 0x7fc49c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.413+0000 7fc4b9d9b700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc49c0682f0 0x7fc49c06a7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0007fd0 tx=0x7fc4b0007c40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:07.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.417+0000 7fc4aaffd700 1 -- 172.21.15.5:0/4012772527 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc4ac053930 con 0x7fc4bc0c9640 2023-03-03T06:24:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.655+0000 7fc4c0eea700 1 -- 172.21.15.5:0/4012772527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4bc04e6e0 con 0x7fc4bc0c9640 2023-03-03T06:24:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.655+0000 7fc4aaffd700 1 -- 172.21.15.5:0/4012772527 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4638 (secure 0 0 0) 0x7fc4ac056f50 con 0x7fc4bc0c9640 2023-03-03T06:24:07.658 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:07.658 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/277386051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":277386051},{"type":"v1","addr":"172.21.15.5:6837","nonce":277386051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2875199515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2875199515},{"type":"v1","addr":"172.21.15.191:6835","nonce":2875199515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2122425608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2122425608},{"type":"v1","addr":"172.21.15.191:6833","nonce":2122425608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:23:40.315678+0000","modified":"2023-03-03T06:23:58.532900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/305842942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":305842942},{"type":"v1","addr":"172.21.15.5:6836","nonce":305842942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-03T06:24:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.657+0000 7fc4c0eea700 1 -- 172.21.15.5:0/4012772527 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc49c0682f0 msgr2=0x7fc49c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:07.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.657+0000 7fc4c0eea700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc49c0682f0 0x7fc49c06a7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0007fd0 tx=0x7fc4b0007c40 comp rx=0 tx=0).stop 2023-03-03T06:24:07.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.657+0000 7fc4c0eea700 1 -- 172.21.15.5:0/4012772527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c9640 msgr2=0x7fc4bc155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:07.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.657+0000 7fc4c0eea700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c9640 0x7fc4bc155d60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00a1c0 tx=0x7fc4ac0047c0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.657+0000 7fc4c0eea700 1 -- 172.21.15.5:0/4012772527 shutdown_connections 2023-03-03T06:24:07.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.657+0000 7fc4c0eea700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc49c0682f0 0x7fc49c06a7a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.657+0000 7fc4c0eea700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc15d180 0x7fc4bc1f1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.657+0000 7fc4c0eea700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0c9640 0x7fc4bc155d60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.657+0000 7fc4c0eea700 1 --2- 172.21.15.5:0/4012772527 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4bc158a00 0x7fc4bc0b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.657+0000 7fc4c0eea700 1 -- 172.21.15.5:0/4012772527 >> 172.21.15.5:0/4012772527 conn(0x7fc4bc0b1c60 msgr2=0x7fc4bc0cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.658+0000 7fc4c0eea700 1 -- 172.21.15.5:0/4012772527 shutdown_connections 2023-03-03T06:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:07.658+0000 7fc4c0eea700 1 -- 172.21.15.5:0/4012772527 wait complete. 2023-03-03T06:24:07.661 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2023-03-03T06:24:08.074 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-03T06:23:40.315678+0000', 'modified': '2023-03-03T06:23:58.532900+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6836/305842942', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 305842942}, {'type': 'v1', 'addr': '172.21.15.5:6836', 'nonce': 305842942}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-03T06:24:08.075 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-03T06:24:08.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-03-03T06:24:08.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.203+0000 7f0215786700 1 Processor -- start 2023-03-03T06:24:08.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.203+0000 7f0215786700 1 -- start start 2023-03-03T06:24:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f0215786700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02100714c0 0x7f0210071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f0215786700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021015aa90 con 0x7f02100cec00 2023-03-03T06:24:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f0215786700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021015a220 con 0x7f0210159730 2023-03-03T06:24:08.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f0215786700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0210071ea0 con 0x7f02100714c0 2023-03-03T06:24:08.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f020f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f02100714c0 0x7f0210071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f020e7fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f02100cec00 0x7f0210159b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60138/0 (socket says 172.21.15.5:60138) 2023-03-03T06:24:08.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f020e7fc700 1 -- 172.21.15.5:0/2125011036 learned_addr learned my addr 172.21.15.5:0/2125011036 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:08.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f020f7fe700 1 -- 172.21.15.5:0/2125011036 >> v1:172.21.15.191:6789/0 conn(0x7f0210159730 legacy=0x7f021015d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:08.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f020f7fe700 1 -- 172.21.15.5:0/2125011036 >> v1:172.21.15.5:6789/0 conn(0x7f02100cec00 legacy=0x7f0210159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:08.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f020f7fe700 1 -- 172.21.15.5:0/2125011036 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021015a4d0 con 0x7f02100714c0 2023-03-03T06:24:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f020f7fe700 1 --2- 172.21.15.5:0/2125011036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02100714c0 0x7f0210071960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0208009d90 tx=0x7f020800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7c00df5c4c64fd server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f020dffb700 1 -- 172.21.15.5:0/2125011036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020800e070 con 0x7f02100714c0 2023-03-03T06:24:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f020dffb700 1 -- 172.21.15.5:0/2125011036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020800bb90 con 0x7f02100714c0 2023-03-03T06:24:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.204+0000 7f020dffb700 1 -- 172.21.15.5:0/2125011036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208003a20 con 0x7f02100714c0 2023-03-03T06:24:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.205+0000 7f0215786700 1 -- 172.21.15.5:0/2125011036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02100714c0 msgr2=0x7f0210071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.205+0000 7f0215786700 1 --2- 172.21.15.5:0/2125011036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02100714c0 0x7f0210071960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0208009d90 tx=0x7f020800b330 comp rx=0 tx=0).stop 2023-03-03T06:24:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.205+0000 7f0215786700 1 -- 172.21.15.5:0/2125011036 shutdown_connections 2023-03-03T06:24:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.205+0000 7f0215786700 1 --2- 172.21.15.5:0/2125011036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02100714c0 0x7f0210071960 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.205+0000 7f0215786700 1 -- 172.21.15.5:0/2125011036 >> 172.21.15.5:0/2125011036 conn(0x7f02100cf4b0 msgr2=0x7f02100cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.205+0000 7f0215786700 1 -- 172.21.15.5:0/2125011036 shutdown_connections 2023-03-03T06:24:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.205+0000 7f0215786700 1 -- 172.21.15.5:0/2125011036 wait complete. 2023-03-03T06:24:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.207+0000 7f0215786700 1 Processor -- start 2023-03-03T06:24:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.207+0000 7f0215786700 1 -- start start 2023-03-03T06:24:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f0215786700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02100714c0 0x7f021014ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f0215786700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02100cec00 0x7f02100c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f0215786700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02100c4670 0x7f021015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f0215786700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c3d10 con 0x7f02100cec00 2023-03-03T06:24:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f0215786700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021014bf70 con 0x7f02100c4670 2023-03-03T06:24:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f0215786700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c2df0 con 0x7f02100714c0 2023-03-03T06:24:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f020e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02100cec00 0x7f02100c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f020e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02100cec00 0x7f02100c4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42070/0 (socket says 172.21.15.5:42070) 2023-03-03T06:24:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f020e7fc700 1 -- 172.21.15.5:0/4179662129 learned_addr learned my addr 172.21.15.5:0/4179662129 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f020f7fe700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02100c4670 0x7f021015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f020effd700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02100714c0 0x7f021014ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f020e7fc700 1 -- 172.21.15.5:0/4179662129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02100714c0 msgr2=0x7f021014ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f020e7fc700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02100714c0 0x7f021014ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f020e7fc700 1 -- 172.21.15.5:0/4179662129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02100c4670 msgr2=0x7f021015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f020e7fc700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02100c4670 0x7f021015c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f020e7fc700 1 -- 172.21.15.5:0/4179662129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208009a70 con 0x7f02100cec00 2023-03-03T06:24:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f020effd700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02100714c0 0x7f021014ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:08.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.208+0000 7f020e7fc700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02100cec00 0x7f02100c4130 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f020400c3c0 tx=0x7f020400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:08.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.209+0000 7f01f77fe700 1 -- 172.21.15.5:0/4179662129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204005d70 con 0x7f02100cec00 2023-03-03T06:24:08.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.209+0000 7f01f77fe700 1 -- 172.21.15.5:0/4179662129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02040070d0 con 0x7f02100cec00 2023-03-03T06:24:08.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.209+0000 7f0215786700 1 -- 172.21.15.5:0/4179662129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021015d1f0 con 0x7f02100cec00 2023-03-03T06:24:08.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.209+0000 7f01f77fe700 1 -- 172.21.15.5:0/4179662129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204007460 con 0x7f02100cec00 2023-03-03T06:24:08.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.209+0000 7f0215786700 1 -- 172.21.15.5:0/4179662129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021015a7b0 con 0x7f02100cec00 2023-03-03T06:24:08.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.210+0000 7f01f77fe700 1 -- 172.21.15.5:0/4179662129 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0204019030 con 0x7f02100cec00 2023-03-03T06:24:08.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.211+0000 7f01f77fe700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01fc0682f0 0x7f01fc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.211+0000 7f020effd700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01fc0682f0 0x7f01fc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.211+0000 7f01f77fe700 1 -- 172.21.15.5:0/4179662129 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0204085380 con 0x7f02100cec00 2023-03-03T06:24:08.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.211+0000 7f020effd700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01fc0682f0 0x7f01fc06a7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0200003fc0 tx=0x7f0200009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:08.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.212+0000 7f022190fb80 1 Processor -- start 2023-03-03T06:24:08.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.213+0000 7f022190fb80 1 -- start start 2023-03-03T06:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.213+0000 7f022190fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09d91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.213+0000 7f022190fb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e09d62e0 0x5567e09f8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.213+0000 7f022190fb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e0a02c20 0x5567e0a03090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.213+0000 7f022190fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567e08c2bc0 con 0x5567e09f7d70 2023-03-03T06:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.213+0000 7f022190fb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567e0931350 con 0x5567e09d62e0 2023-03-03T06:24:08.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.213+0000 7f022190fb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567e092a880 con 0x5567e0a02c20 2023-03-03T06:24:08.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.213+0000 7f020effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09d91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.214+0000 7f020effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09d91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42076/0 (socket says 172.21.15.5:42076) 2023-03-03T06:24:08.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.214+0000 7f020effd700 1 -- 172.21.15.5:0/3413629477 learned_addr learned my addr 172.21.15.5:0/3413629477 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:08.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.214+0000 7f020f7fe700 1 --2- 172.21.15.5:0/3413629477 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e0a02c20 0x5567e0a03090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.214+0000 7f020e7fc700 1 --2- 172.21.15.5:0/3413629477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e09d62e0 0x5567e09f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.214+0000 7f020effd700 1 -- 172.21.15.5:0/3413629477 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e0a02c20 msgr2=0x5567e0a03090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:08.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.214+0000 7f020effd700 1 --2- 172.21.15.5:0/3413629477 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e0a02c20 0x5567e0a03090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.214+0000 7f020effd700 1 -- 172.21.15.5:0/3413629477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e09d62e0 msgr2=0x5567e09f8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:08.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.214+0000 7f020effd700 1 --2- 172.21.15.5:0/3413629477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e09d62e0 0x5567e09f8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.214+0000 7f020effd700 1 -- 172.21.15.5:0/3413629477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567e07ac5e0 con 0x5567e09f7d70 2023-03-03T06:24:08.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.214+0000 7f020effd700 1 --2- 172.21.15.5:0/3413629477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09d91f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f02000069f0 tx=0x7f0200011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f499c2c1644b27 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:08.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.214+0000 7f01f4ff9700 1 -- 172.21.15.5:0/3413629477 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020001d070 con 0x5567e09f7d70 2023-03-03T06:24:08.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.214+0000 7f01f4ff9700 1 -- 172.21.15.5:0/3413629477 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0200007370 con 0x5567e09f7d70 2023-03-03T06:24:08.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.214+0000 7f01f4ff9700 1 -- 172.21.15.5:0/3413629477 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02000074e0 con 0x5567e09f7d70 2023-03-03T06:24:08.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.215+0000 7f022190fb80 1 -- 172.21.15.5:0/3413629477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 msgr2=0x5567e09d91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:08.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.215+0000 7f022190fb80 1 --2- 172.21.15.5:0/3413629477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09d91f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f02000069f0 tx=0x7f0200011000 comp rx=0 tx=0).stop 2023-03-03T06:24:08.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.215+0000 7f022190fb80 1 -- 172.21.15.5:0/3413629477 shutdown_connections 2023-03-03T06:24:08.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.215+0000 7f022190fb80 1 --2- 172.21.15.5:0/3413629477 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e0a02c20 0x5567e0a03090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.215+0000 7f022190fb80 1 --2- 172.21.15.5:0/3413629477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09d91f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.215+0000 7f022190fb80 1 --2- 172.21.15.5:0/3413629477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e09d62e0 0x5567e09f8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.215+0000 7f022190fb80 1 -- 172.21.15.5:0/3413629477 >> 172.21.15.5:0/3413629477 conn(0x5567e09cd720 msgr2=0x5567e09d2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:08.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.215+0000 7f022190fb80 1 -- 172.21.15.5:0/3413629477 shutdown_connections 2023-03-03T06:24:08.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.215+0000 7f022190fb80 1 -- 172.21.15.5:0/3413629477 wait complete. 2023-03-03T06:24:08.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.216+0000 7f022190fb80 1 -- start start 2023-03-03T06:24:08.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.216+0000 7f022190fb80 1 Processor -- start 2023-03-03T06:24:08.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f022190fb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e09d62e0 0x5567e0a069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f022190fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09f8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f022190fb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e0a02c20 0x5567e09f8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f022190fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567e07ae8d0 con 0x5567e09f7d70 2023-03-03T06:24:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f022190fb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567e0a15eb0 con 0x5567e09d62e0 2023-03-03T06:24:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f022190fb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567e09fa710 con 0x5567e0a02c20 2023-03-03T06:24:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f022190fb80 10 client.0 _ll_register_callbacks cb 0x5567e08c8630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T06:24:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f020e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f020e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09f8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42084/0 (socket says 172.21.15.5:42084) 2023-03-03T06:24:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f020e7fc700 1 -- 172.21.15.5:0/525217078 learned_addr learned my addr 172.21.15.5:0/525217078 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f020f7fe700 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e0a02c20 0x5567e09f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f020effd700 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e09d62e0 0x5567e0a069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f020e7fc700 1 -- 172.21.15.5:0/525217078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e0a02c20 msgr2=0x5567e09f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f020e7fc700 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e0a02c20 0x5567e09f8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f020e7fc700 1 -- 172.21.15.5:0/525217078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e09d62e0 msgr2=0x5567e0a069f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f020e7fc700 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e09d62e0 0x5567e0a069f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f020e7fc700 1 -- 172.21.15.5:0/525217078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020000f040 con 0x5567e09f7d70 2023-03-03T06:24:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.217+0000 7f020effd700 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e09d62e0 0x5567e0a069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f020e7fc700 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09f8140 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f020400cb80 tx=0x7f0204059320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89024183422f50f2 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f01edffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-03-03T06:24:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f01edffb700 1 -- 172.21.15.5:0/525217078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020405d150 con 0x5567e09f7d70 2023-03-03T06:24:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f01edffb700 1 -- 172.21.15.5:0/525217078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f020405d2b0 con 0x5567e09f7d70 2023-03-03T06:24:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f022190fb80 1 -- 172.21.15.5:0/525217078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5567e08f8140 con 0x5567e09f7d70 2023-03-03T06:24:08.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f01edffb700 1 -- 172.21.15.5:0/525217078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0204083250 con 0x5567e09f7d70 2023-03-03T06:24:08.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f022190fb80 10 client.4797 fetch_fsmap learned FSMap version 9 2023-03-03T06:24:08.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f022190fb80 1 -- 172.21.15.5:0/525217078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5567e0758d90 con 0x5567e09f7d70 2023-03-03T06:24:08.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f01edffb700 1 -- 172.21.15.5:0/525217078 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5567e08f8140 con 0x5567e09f7d70 2023-03-03T06:24:08.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f01edffb700 1 -- 172.21.15.5:0/525217078 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 9) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f02040512b0 con 0x5567e09f7d70 2023-03-03T06:24:08.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f022190fb80 10 client.4797 fetch_fsmap finished waiting for FSMap version 9 2023-03-03T06:24:08.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f022190fb80 10 client.4797 resolve_mds: resolved name 'a' to daemon mds.a 2023-03-03T06:24:08.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f022190fb80 20 client.4797 populate_metadata read hostname 'smithi005' 2023-03-03T06:24:08.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f022190fb80 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x5567e0a196a0 0x5567e0a30330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f022190fb80 4 client.4797 mds_command: new command op to 4285 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-03T06:24:08.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f022190fb80 1 -- 172.21.15.5:0/525217078 --> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5567e07aef10 con 0x5567e0a196a0 2023-03-03T06:24:08.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.218+0000 7f020effd700 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x5567e0a196a0 0x5567e0a30330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f01edffb700 10 client.4797 ms_handle_connect on v2:172.21.15.5:6834/305842942 2023-03-03T06:24:08.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f020effd700 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x5567e0a196a0 0x5567e0a30330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d9c55312eca6bd7 server_cookie=98d114c82a1503c1 in_seq=0 out_seq=0 2023-03-03T06:24:08.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f01edffb700 1 -- 172.21.15.5:0/525217078 <== mds.0 v2:172.21.15.5:6834/305842942 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x5567e07aef10 con 0x5567e0a196a0 2023-03-03T06:24:08.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f01edffb700 10 client.4797 handle_command_reply: tid=0 2023-03-03T06:24:08.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f022190fb80 1 client.4797 shutdown 2023-03-03T06:24:08.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f022190fb80 1 -- 172.21.15.5:0/525217078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 msgr2=0x5567e09f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:08.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f022190fb80 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09f8140 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f020400cb80 tx=0x7f0204059320 comp rx=0 tx=0).stop 2023-03-03T06:24:08.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f022190fb80 1 -- 172.21.15.5:0/525217078 shutdown_connections 2023-03-03T06:24:08.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f022190fb80 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e0a02c20 0x5567e09f8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f022190fb80 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x5567e0a196a0 0x5567e0a30330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f022190fb80 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e09d62e0 0x5567e0a069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f022190fb80 1 --2- 172.21.15.5:0/525217078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09f8140 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f01edffb700 0 client.4797 ms_handle_reset on v2:172.21.15.5:6834/305842942 2023-03-03T06:24:08.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.219+0000 7f022190fb80 1 -- 172.21.15.5:0/525217078 >> 172.21.15.5:0/525217078 conn(0x5567e09cd720 msgr2=0x5567e09fb530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:08.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.220+0000 7f022190fb80 1 -- 172.21.15.5:0/525217078 shutdown_connections 2023-03-03T06:24:08.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.220+0000 7f022190fb80 1 -- 172.21.15.5:0/525217078 wait complete. 2023-03-03T06:24:08.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.220+0000 7f022190fb80 20 client.4797 trim_cache size 0 max 16384 2023-03-03T06:24:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.238+0000 7f022190fb80 1 Processor -- start 2023-03-03T06:24:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.238+0000 7f022190fb80 1 -- start start 2023-03-03T06:24:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.238+0000 7f022190fb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e09d62e0 0x5567e09d8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.238+0000 7f022190fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09fee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.238+0000 7f022190fb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e0a02c20 0x5567e09d6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.238+0000 7f022190fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567e09f7ae0 con 0x5567e09f7d70 2023-03-03T06:24:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.238+0000 7f022190fb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567e0a3fbb0 con 0x5567e0a02c20 2023-03-03T06:24:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.238+0000 7f022190fb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567e09d40e0 con 0x5567e09d62e0 2023-03-03T06:24:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f020e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09fee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f020e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09fee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42094/0 (socket says 172.21.15.5:42094) 2023-03-03T06:24:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f020e7fc700 1 -- 172.21.15.5:0/3530626324 learned_addr learned my addr 172.21.15.5:0/3530626324 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f020effd700 1 --2- 172.21.15.5:0/3530626324 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e09d62e0 0x5567e09d8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f020f7fe700 1 --2- 172.21.15.5:0/3530626324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e0a02c20 0x5567e09d6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f020e7fc700 1 -- 172.21.15.5:0/3530626324 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e09d62e0 msgr2=0x5567e09d8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f020e7fc700 1 --2- 172.21.15.5:0/3530626324 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e09d62e0 0x5567e09d8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f020e7fc700 1 -- 172.21.15.5:0/3530626324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e0a02c20 msgr2=0x5567e09d6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f020e7fc700 1 --2- 172.21.15.5:0/3530626324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e0a02c20 0x5567e09d6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f020e7fc700 1 -- 172.21.15.5:0/3530626324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567e08f1140 con 0x5567e09f7d70 2023-03-03T06:24:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f020effd700 1 --2- 172.21.15.5:0/3530626324 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e09d62e0 0x5567e09d8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f020e7fc700 1 --2- 172.21.15.5:0/3530626324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09fee20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f02040551c0 tx=0x7f0204014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dddeab1d140a665 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f01f57fa700 1 -- 172.21.15.5:0/3530626324 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02040512b0 con 0x5567e09f7d70 2023-03-03T06:24:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f01f57fa700 1 -- 172.21.15.5:0/3530626324 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0204051410 con 0x5567e09f7d70 2023-03-03T06:24:08.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.239+0000 7f01f57fa700 1 -- 172.21.15.5:0/3530626324 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020405d150 con 0x5567e09f7d70 2023-03-03T06:24:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.240+0000 7f022190fb80 1 -- 172.21.15.5:0/3530626324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 msgr2=0x5567e09fee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.240+0000 7f022190fb80 1 --2- 172.21.15.5:0/3530626324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09fee20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f02040551c0 tx=0x7f0204014000 comp rx=0 tx=0).stop 2023-03-03T06:24:08.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.240+0000 7f022190fb80 1 -- 172.21.15.5:0/3530626324 shutdown_connections 2023-03-03T06:24:08.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.240+0000 7f022190fb80 1 --2- 172.21.15.5:0/3530626324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e0a02c20 0x5567e09d6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.240+0000 7f022190fb80 1 --2- 172.21.15.5:0/3530626324 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e09d62e0 0x5567e09d8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.240+0000 7f022190fb80 1 --2- 172.21.15.5:0/3530626324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e09fee20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.240+0000 7f022190fb80 1 -- 172.21.15.5:0/3530626324 >> 172.21.15.5:0/3530626324 conn(0x5567e09cd720 msgr2=0x5567e0a19a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:08.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.240+0000 7f022190fb80 1 -- 172.21.15.5:0/3530626324 shutdown_connections 2023-03-03T06:24:08.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.240+0000 7f022190fb80 1 -- 172.21.15.5:0/3530626324 wait complete. 2023-03-03T06:24:08.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.240+0000 7f022190fb80 1 -- start start 2023-03-03T06:24:08.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.240+0000 7f022190fb80 1 Processor -- start 2023-03-03T06:24:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.241+0000 7f022190fb80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e09d62e0 0x5567e0a01440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.241+0000 7f022190fb80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e0a13ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.241+0000 7f022190fb80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e0a02c20 0x5567e0a88bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.241+0000 7f022190fb80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567e09d4ad0 con 0x5567e09f7d70 2023-03-03T06:24:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.241+0000 7f022190fb80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567e0a01980 con 0x5567e0a02c20 2023-03-03T06:24:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.241+0000 7f022190fb80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567e0a1ad50 con 0x5567e09d62e0 2023-03-03T06:24:08.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.241+0000 7f022190fb80 10 client.0 _ll_register_callbacks cb 0x5567e08c8630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T06:24:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.241+0000 7f020e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e0a13ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.241+0000 7f020e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e0a13ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42098/0 (socket says 172.21.15.5:42098) 2023-03-03T06:24:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.241+0000 7f020e7fc700 1 -- 172.21.15.5:0/2306106428 learned_addr learned my addr 172.21.15.5:0/2306106428 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.241+0000 7f020f7fe700 1 --2- 172.21.15.5:0/2306106428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e0a02c20 0x5567e0a88bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.241+0000 7f020effd700 1 --2- 172.21.15.5:0/2306106428 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e09d62e0 0x5567e0a01440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f020e7fc700 1 -- 172.21.15.5:0/2306106428 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e09d62e0 msgr2=0x5567e0a01440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:08.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f020e7fc700 1 --2- 172.21.15.5:0/2306106428 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e09d62e0 0x5567e0a01440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f020e7fc700 1 -- 172.21.15.5:0/2306106428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e0a02c20 msgr2=0x5567e0a88bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:08.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f020e7fc700 1 --2- 172.21.15.5:0/2306106428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e0a02c20 0x5567e0a88bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f020e7fc700 1 -- 172.21.15.5:0/2306106428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5567e0758d90 con 0x5567e09f7d70 2023-03-03T06:24:08.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f020e7fc700 1 --2- 172.21.15.5:0/2306106428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e0a13ec0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f02040551c0 tx=0x7f0204000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af304bb2dab53ba2 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:08.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f01edffb700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-03-03T06:24:08.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f01edffb700 1 -- 172.21.15.5:0/2306106428 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204083250 con 0x5567e09f7d70 2023-03-03T06:24:08.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f01edffb700 1 -- 172.21.15.5:0/2306106428 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f02040833b0 con 0x5567e09f7d70 2023-03-03T06:24:08.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f022190fb80 1 -- 172.21.15.5:0/2306106428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5567e08d2170 con 0x5567e09f7d70 2023-03-03T06:24:08.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f01edffb700 1 -- 172.21.15.5:0/2306106428 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f020405d150 con 0x5567e09f7d70 2023-03-03T06:24:08.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f022190fb80 10 client.4803 fetch_fsmap learned FSMap version 9 2023-03-03T06:24:08.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f022190fb80 1 -- 172.21.15.5:0/2306106428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5567e077f200 con 0x5567e09f7d70 2023-03-03T06:24:08.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f01edffb700 1 -- 172.21.15.5:0/2306106428 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5567e08d2170 con 0x5567e09f7d70 2023-03-03T06:24:08.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f01edffb700 1 -- 172.21.15.5:0/2306106428 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 9) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0204073070 con 0x5567e09f7d70 2023-03-03T06:24:08.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f022190fb80 10 client.4803 fetch_fsmap finished waiting for FSMap version 9 2023-03-03T06:24:08.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f022190fb80 10 client.4803 resolve_mds: resolved name 'a' to daemon mds.a 2023-03-03T06:24:08.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f022190fb80 20 client.4803 populate_metadata read hostname 'smithi005' 2023-03-03T06:24:08.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f022190fb80 1 --2- 172.21.15.5:0/2306106428 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x5567e09fedf0 0x5567e09d4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f022190fb80 4 client.4803 mds_command: new command op to 4285 tid=0[{"prefix": "status"}] 2023-03-03T06:24:08.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f022190fb80 1 -- 172.21.15.5:0/2306106428 --> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5567e08f9550 con 0x5567e09fedf0 2023-03-03T06:24:08.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.242+0000 7f020effd700 1 --2- 172.21.15.5:0/2306106428 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x5567e09fedf0 0x5567e09d4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f01edffb700 10 client.4803 ms_handle_connect on v2:172.21.15.5:6834/305842942 2023-03-03T06:24:08.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f020effd700 1 --2- 172.21.15.5:0/2306106428 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x5567e09fedf0 0x5567e09d4f60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbe57c873f122398 server_cookie=d47fc9c6d13492fc in_seq=0 out_seq=0 2023-03-03T06:24:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f01edffb700 1 -- 172.21.15.5:0/2306106428 <== mds.0 v2:172.21.15.5:6834/305842942 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5567e08f9550 con 0x5567e09fedf0 2023-03-03T06:24:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f01edffb700 10 client.4803 handle_command_reply: tid=0 2023-03-03T06:24:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f022190fb80 1 client.4803 shutdown 2023-03-03T06:24:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f022190fb80 1 -- 172.21.15.5:0/2306106428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 msgr2=0x5567e0a13ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f022190fb80 1 --2- 172.21.15.5:0/2306106428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e0a13ec0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f02040551c0 tx=0x7f0204000ed0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f022190fb80 1 -- 172.21.15.5:0/2306106428 shutdown_connections 2023-03-03T06:24:08.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f022190fb80 1 --2- 172.21.15.5:0/2306106428 >> [v2:172.21.15.5:6834/305842942,v1:172.21.15.5:6836/305842942] conn(0x5567e09fedf0 0x5567e09d4f60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f022190fb80 1 --2- 172.21.15.5:0/2306106428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5567e0a02c20 0x5567e0a88bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f022190fb80 1 --2- 172.21.15.5:0/2306106428 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5567e09d62e0 0x5567e0a01440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f022190fb80 1 --2- 172.21.15.5:0/2306106428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5567e09f7d70 0x5567e0a13ec0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f01edffb700 0 client.4803 ms_handle_reset on v2:172.21.15.5:6834/305842942 2023-03-03T06:24:08.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f022190fb80 1 -- 172.21.15.5:0/2306106428 >> 172.21.15.5:0/2306106428 conn(0x5567e09cd720 msgr2=0x5567e09d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:08.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f022190fb80 1 -- 172.21.15.5:0/2306106428 shutdown_connections 2023-03-03T06:24:08.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f022190fb80 1 -- 172.21.15.5:0/2306106428 wait complete. 2023-03-03T06:24:08.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.243+0000 7f022190fb80 20 client.4803 trim_cache size 0 max 16384 2023-03-03T06:24:08.256 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-03-03T06:24:08.256 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6", 2023-03-03T06:24:08.256 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-03-03T06:24:08.256 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 4285, 2023-03-03T06:24:08.256 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-03-03T06:24:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-03-03T06:24:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-03-03T06:24:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 27.921467172, 2023-03-03T06:24:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 9, 2023-03-03T06:24:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 25, 2023-03-03T06:24:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 25, 2023-03-03T06:24:08.257 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 33.238016907999999 2023-03-03T06:24:08.258 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-03-03T06:24:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.244+0000 7f0215786700 1 -- 172.21.15.5:0/4179662129 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01fc0682f0 msgr2=0x7f01fc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.244+0000 7f0215786700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01fc0682f0 0x7f01fc06a7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0200003fc0 tx=0x7f0200009040 comp rx=0 tx=0).stop 2023-03-03T06:24:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.244+0000 7f0215786700 1 -- 172.21.15.5:0/4179662129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02100cec00 msgr2=0x7f02100c4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:08.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.244+0000 7f0215786700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02100cec00 0x7f02100c4130 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f020400c3c0 tx=0x7f020400c780 comp rx=0 tx=0).stop 2023-03-03T06:24:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.244+0000 7f0215786700 1 -- 172.21.15.5:0/4179662129 shutdown_connections 2023-03-03T06:24:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.244+0000 7f0215786700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f02100c4670 0x7f021015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.244+0000 7f0215786700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01fc0682f0 0x7f01fc06a7a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.244+0000 7f0215786700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02100714c0 0x7f021014ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.244+0000 7f0215786700 1 --2- 172.21.15.5:0/4179662129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02100cec00 0x7f02100c4130 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.244+0000 7f0215786700 1 -- 172.21.15.5:0/4179662129 >> 172.21.15.5:0/4179662129 conn(0x7f02100cf4b0 msgr2=0x7f0210159b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:08.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.244+0000 7f0215786700 1 -- 172.21.15.5:0/4179662129 shutdown_connections 2023-03-03T06:24:08.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.244+0000 7f0215786700 1 -- 172.21.15.5:0/4179662129 wait complete. 2023-03-03T06:24:08.261 INFO:teuthology.run_tasks:Running task kclient... 2023-03-03T06:24:08.293 INFO:tasks.kclient:Mounting kernel clients... 2023-03-03T06:24:08.294 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-03-03T06:24:08.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:08.294 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-03-03T06:24:08.312 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-03-03T06:24:08.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:08.313 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-03-03T06:24:08.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:08.395 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-03-03T06:24:08.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:08.495 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-03-03T06:24:08.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:08.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2023-03-03T06:24:08.584 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2023-03-03T06:24:08.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T06:24:08.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:08.587 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-03-03T06:24:08.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:08.609 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2023-03-03T06:24:08.682 INFO:teuthology.orchestra.run.smithi191.stderr:Cannot find device "ceph-brx" 2023-03-03T06:24:08.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T06:24:08.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:08.684 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-03-03T06:24:08.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:08.742 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link delete ceph-brx 2023-03-03T06:24:08.810 INFO:teuthology.orchestra.run.smithi191.stderr:Cannot find device "ceph-brx" 2023-03-03T06:24:08.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T06:24:08.812 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-03-03T06:24:08.812 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-03T06:24:08.813 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-03T06:24:08.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-03T06:24:08.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.936+0000 7efd74c2d700 1 Processor -- start 2023-03-03T06:24:08.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.937+0000 7efd74c2d700 1 -- start start 2023-03-03T06:24:08.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.937+0000 7efd74c2d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efd700af080 0x7efd700cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.937+0000 7efd74c2d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7efd700af450 0x7efd700b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.937+0000 7efd74c2d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd7006cb70 0x7efd700b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.937+0000 7efd74c2d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7006b590 con 0x7efd7006cb70 2023-03-03T06:24:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd74c2d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7006b870 con 0x7efd700af450 2023-03-03T06:24:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd74c2d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7006bb50 con 0x7efd700af080 2023-03-03T06:24:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6ed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd7006cb70 0x7efd700b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6ed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efd7006cb70 0x7efd700b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42108/0 (socket says 172.21.15.5:42108) 2023-03-03T06:24:08.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6ed9d700 1 -- 172.21.15.5:0/2485867694 learned_addr learned my addr 172.21.15.5:0/2485867694 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6e59c700 1 --2- 172.21.15.5:0/2485867694 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efd700af080 0x7efd700cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6dd9b700 1 --2- 172.21.15.5:0/2485867694 >> v2:172.21.15.191:3300/0 conn(0x7efd700af450 0x7efd700b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6ed9d700 1 -- 172.21.15.5:0/2485867694 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efd700af080 msgr2=0x7efd700cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6ed9d700 1 --2- 172.21.15.5:0/2485867694 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efd700af080 0x7efd700cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6ed9d700 1 -- 172.21.15.5:0/2485867694 >> v2:172.21.15.191:3300/0 conn(0x7efd700af450 msgr2=0x7efd700b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6ed9d700 1 --2- 172.21.15.5:0/2485867694 >> v2:172.21.15.191:3300/0 conn(0x7efd700af450 0x7efd700b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6ed9d700 1 -- 172.21.15.5:0/2485867694 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7006be30 con 0x7efd7006cb70 2023-03-03T06:24:08.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6e59c700 1 --2- 172.21.15.5:0/2485867694 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efd700af080 0x7efd700cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:08.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6ed9d700 1 --2- 172.21.15.5:0/2485867694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd7006cb70 0x7efd700b1db0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efd700685a0 tx=0x7efd6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931a35246ec76c7c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:08.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6d59a700 1 -- 172.21.15.5:0/2485867694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6800e070 con 0x7efd7006cb70 2023-03-03T06:24:08.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6d59a700 1 -- 172.21.15.5:0/2485867694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6800b9c0 con 0x7efd7006cb70 2023-03-03T06:24:08.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.938+0000 7efd6d59a700 1 -- 172.21.15.5:0/2485867694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6800bd70 con 0x7efd7006cb70 2023-03-03T06:24:08.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.939+0000 7efd74c2d700 1 -- 172.21.15.5:0/2485867694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd7006cb70 msgr2=0x7efd700b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.939+0000 7efd74c2d700 1 --2- 172.21.15.5:0/2485867694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd7006cb70 0x7efd700b1db0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efd700685a0 tx=0x7efd6800b330 comp rx=0 tx=0).stop 2023-03-03T06:24:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.939+0000 7efd74c2d700 1 -- 172.21.15.5:0/2485867694 shutdown_connections 2023-03-03T06:24:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.939+0000 7efd74c2d700 1 --2- 172.21.15.5:0/2485867694 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efd700af080 0x7efd700cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.939+0000 7efd74c2d700 1 --2- 172.21.15.5:0/2485867694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd7006cb70 0x7efd700b1db0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.939+0000 7efd74c2d700 1 --2- 172.21.15.5:0/2485867694 >> v2:172.21.15.191:3300/0 conn(0x7efd700af450 0x7efd700b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.939+0000 7efd74c2d700 1 -- 172.21.15.5:0/2485867694 >> 172.21.15.5:0/2485867694 conn(0x7efd7006ea70 msgr2=0x7efd700cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:08.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.939+0000 7efd74c2d700 1 -- 172.21.15.5:0/2485867694 shutdown_connections 2023-03-03T06:24:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.939+0000 7efd74c2d700 1 -- 172.21.15.5:0/2485867694 wait complete. 2023-03-03T06:24:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.941+0000 7efd74c2d700 1 Processor -- start 2023-03-03T06:24:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.941+0000 7efd74c2d700 1 -- start start 2023-03-03T06:24:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.941+0000 7efd74c2d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd7006cb70 0x7efd700b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd74c2d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efd700af080 0x7efd700b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd74c2d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd700af450 0x7efd700b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd74c2d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700afc30 con 0x7efd7006cb70 2023-03-03T06:24:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd74c2d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700b3e60 con 0x7efd700af450 2023-03-03T06:24:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd74c2d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd700b4140 con 0x7efd700af080 2023-03-03T06:24:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd6e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd7006cb70 0x7efd700b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd6e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd7006cb70 0x7efd700b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42110/0 (socket says 172.21.15.5:42110) 2023-03-03T06:24:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd6e59c700 1 -- 172.21.15.5:0/3274943568 learned_addr learned my addr 172.21.15.5:0/3274943568 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd6dd9b700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efd700af080 0x7efd700b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd6ed9d700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd700af450 0x7efd700b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd6e59c700 1 -- 172.21.15.5:0/3274943568 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efd700af080 msgr2=0x7efd700b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:08.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd6e59c700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efd700af080 0x7efd700b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd6e59c700 1 -- 172.21.15.5:0/3274943568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd700af450 msgr2=0x7efd700b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:08.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd6e59c700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd700af450 0x7efd700b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:08.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd6e59c700 1 -- 172.21.15.5:0/3274943568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd68009b30 con 0x7efd7006cb70 2023-03-03T06:24:08.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd6ed9d700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd700af450 0x7efd700b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:08.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd6e59c700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd7006cb70 0x7efd700b3600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c740 tx=0x7efd6000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:08.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd66ffd700 1 -- 172.21.15.5:0/3274943568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60011800 con 0x7efd7006cb70 2023-03-03T06:24:08.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd66ffd700 1 -- 172.21.15.5:0/3274943568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd60011960 con 0x7efd7006cb70 2023-03-03T06:24:08.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd66ffd700 1 -- 172.21.15.5:0/3274943568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60011cd0 con 0x7efd7006cb70 2023-03-03T06:24:08.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd74c2d700 1 -- 172.21.15.5:0/3274943568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7006d370 con 0x7efd7006cb70 2023-03-03T06:24:08.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.942+0000 7efd74c2d700 1 -- 172.21.15.5:0/3274943568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7006c110 con 0x7efd7006cb70 2023-03-03T06:24:08.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.943+0000 7efd74c2d700 1 -- 172.21.15.5:0/3274943568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7006c630 con 0x7efd7006cb70 2023-03-03T06:24:08.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.944+0000 7efd66ffd700 1 -- 172.21.15.5:0/3274943568 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7efd60020070 con 0x7efd7006cb70 2023-03-03T06:24:08.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.944+0000 7efd66ffd700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efd500682f0 0x7efd5006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:08.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.944+0000 7efd66ffd700 1 -- 172.21.15.5:0/3274943568 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efd60085ed0 con 0x7efd7006cb70 2023-03-03T06:24:08.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.944+0000 7efd6dd9b700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efd500682f0 0x7efd5006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:08.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.945+0000 7efd6dd9b700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efd500682f0 0x7efd5006a7a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efd70159fd0 tx=0x7efd58008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:08.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:08.948+0000 7efd66ffd700 1 -- 172.21.15.5:0/3274943568 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7efd600523c0 con 0x7efd7006cb70 2023-03-03T06:24:09.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.188+0000 7efd74c2d700 1 -- 172.21.15.5:0/3274943568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efd700afea0 con 0x7efd7006cb70 2023-03-03T06:24:09.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.188+0000 7efd66ffd700 1 -- 172.21.15.5:0/3274943568 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7efd600559e0 con 0x7efd7006cb70 2023-03-03T06:24:09.191 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-03-03T06:24:09.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.190+0000 7efd74c2d700 1 -- 172.21.15.5:0/3274943568 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efd500682f0 msgr2=0x7efd5006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:09.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.190+0000 7efd74c2d700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efd500682f0 0x7efd5006a7a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efd70159fd0 tx=0x7efd58008040 comp rx=0 tx=0).stop 2023-03-03T06:24:09.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.190+0000 7efd74c2d700 1 -- 172.21.15.5:0/3274943568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd7006cb70 msgr2=0x7efd700b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:09.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.190+0000 7efd74c2d700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd7006cb70 0x7efd700b3600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c740 tx=0x7efd6000cb00 comp rx=0 tx=0).stop 2023-03-03T06:24:09.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.190+0000 7efd74c2d700 1 -- 172.21.15.5:0/3274943568 shutdown_connections 2023-03-03T06:24:09.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.190+0000 7efd74c2d700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efd700af450 0x7efd700b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:09.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.190+0000 7efd74c2d700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd7006cb70 0x7efd700b3600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:09.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.190+0000 7efd74c2d700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efd500682f0 0x7efd5006a7a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:09.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.190+0000 7efd74c2d700 1 --2- 172.21.15.5:0/3274943568 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efd700af080 0x7efd700b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:09.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.190+0000 7efd74c2d700 1 -- 172.21.15.5:0/3274943568 >> 172.21.15.5:0/3274943568 conn(0x7efd7006ea70 msgr2=0x7efd7015f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:09.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.190+0000 7efd74c2d700 1 -- 172.21.15.5:0/3274943568 shutdown_connections 2023-03-03T06:24:09.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:09.190+0000 7efd74c2d700 1 -- 172.21.15.5:0/3274943568 wait complete. 2023-03-03T06:24:09.204 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-03T06:24:09.205 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-03T06:24:09.205 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-03-03T06:24:09.205 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-03T06:24:09.205 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-03T06:24:09.205 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-03T06:24:09.206 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-03T06:24:09.206 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-03T06:24:09.206 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:24:09.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:09.206 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-03-03T06:24:09.224 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T06:24:09.224 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T06:24:09.224 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T06:24:09.224 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:09.225 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-03-03T06:24:09.225 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:09.225 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:24:09.225 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:09.225 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:24:09.225 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:09.225 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-03T06:24:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-03-03T06:24:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42494sec preferred_lft 42494sec 2023-03-03T06:24:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-03-03T06:24:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:09.226 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:24:09.226 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:09.227 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-03T06:24:09.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:09.227 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:24:09.227 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:24:09.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2023-03-03T06:24:09.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2023-03-03T06:24:09.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2023-03-03T06:24:09.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-03T06:24:09.229 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:24:09.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:09.343 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-03T06:24:09.369 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-03-03T06:24:09.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:09.371 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-03-03T06:24:09.430 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-03-03T06:24:09.431 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-03T06:24:09.431 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-03-03T06:24:09.431 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-03-03T06:24:09.431 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-03T06:24:09.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:09.432 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:24:09.432 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:24:09.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-03-03T06:24:09.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-03-03T06:24:09.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-03-03T06:24:09.433 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:24:09.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:09.538 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-03-03T06:24:09.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:09.556 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-03-03T06:24:09.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:09.613 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:24:09.614 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:24:09.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-03T06:24:09.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-03-03T06:24:09.614 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:24:09.707 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-03-03T06:24:09.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:09.708 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:24:09.708 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:24:09.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-03-03T06:24:09.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-03T06:24:09.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-03-03T06:24:09.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-03-03T06:24:09.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-03-03T06:24:09.710 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:24:09.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:09.926 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:24:09.926 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:24:09.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-03-03T06:24:09.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2023-03-03T06:24:09.927 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:24:10.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:24:10.045 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-03T06:24:10.075 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:24:10.076 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:24:10.076 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-03T06:24:10.133 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-03-03T06:24:10.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:10.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:10.220 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:10.220 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:24:10.362 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:10.363 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:24:10.363 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:24:10.363 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:24:10.363 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:24:10.364 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:24:10.364 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:24:10.364 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:24:10.441 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:10.442 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:24:10.442 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:24:10.442 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:24:10.442 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:24:10.442 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:24:10.443 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:24:10.443 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:24:10.443 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790" 2023-03-03T06:24:10.443 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2023-03-03T06:24:10.443 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6" will pass to kernel 2023-03-03T06:24:10.444 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-03T06:24:10.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:10.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-03T06:24:10.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:10.472 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:24:10.545 INFO:teuthology.orchestra.run.smithi005.stdout:client4720 2023-03-03T06:24:10.546 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:24:10.546 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:10.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:10.604 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:24:10.676 INFO:teuthology.orchestra.run.smithi005.stdout:client4720 2023-03-03T06:24:10.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:10.677 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:24:10.749 INFO:teuthology.orchestra.run.smithi005.stdout:client4720 2023-03-03T06:24:10.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:10.750 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.client4720/status') 2023-03-03T06:24:10.831 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4720 (3)172.21.15.5:0/3970953794 2023-03-03T06:24:10.831 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2023-03-03T06:24:10.832 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2023-03-03T06:24:10.832 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2023-03-03T06:24:10.833 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 2.2919e-05 s, 3.0 MB/s 2023-03-03T06:24:10.833 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-03-03T06:24:10.834 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-03T06:24:10.834 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-03-03T06:24:10.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-03T06:24:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.995+0000 7f3bc0bdb700 1 Processor -- start 2023-03-03T06:24:10.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.995+0000 7f3bc0bdb700 1 -- start start 2023-03-03T06:24:10.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.996+0000 7f3bc0bdb700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3bbc15d730 0x7f3bbc0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:10.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.996+0000 7f3bc0bdb700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc0cb8f0 con 0x7f3bbc0b1740 2023-03-03T06:24:10.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.996+0000 7f3bc0bdb700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc15dc00 con 0x7f3bbc0cbd80 2023-03-03T06:24:10.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.996+0000 7f3bc0bdb700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bbc159db0 con 0x7f3bbc15d730 2023-03-03T06:24:10.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.996+0000 7f3bbad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3bbc15d730 0x7f3bbc0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:10.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.996+0000 7f3bba59c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3bbc0b1740 0x7f3bbc0b1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60200/0 (socket says 172.21.15.5:60200) 2023-03-03T06:24:11.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.996+0000 7f3bba59c700 1 -- 172.21.15.5:0/669424317 learned_addr learned my addr 172.21.15.5:0/669424317 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:11.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.996+0000 7f3bbad9d700 1 -- 172.21.15.5:0/669424317 >> v1:172.21.15.191:6789/0 conn(0x7f3bbc0cbd80 legacy=0x7f3bbc15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:11.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.996+0000 7f3bbad9d700 1 -- 172.21.15.5:0/669424317 >> v1:172.21.15.5:6789/0 conn(0x7f3bbc0b1740 legacy=0x7f3bbc0b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:11.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.997+0000 7f3bbad9d700 1 -- 172.21.15.5:0/669424317 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0cb2a0 con 0x7f3bbc15d730 2023-03-03T06:24:11.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.996+0000 7f3bb959a700 1 -- 172.21.15.5:0/669424317 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54692743 0 0) 0x7f3bbc0cb8f0 con 0x7f3bbc0b1740 2023-03-03T06:24:11.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.997+0000 7f3bbad9d700 1 --2- 172.21.15.5:0/669424317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bbc15d730 0x7f3bbc0cd890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009d90 tx=0x7f3bb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b84a98a1724185 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.997+0000 7f3bb959a700 1 -- 172.21.15.5:0/669424317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400e070 con 0x7f3bbc15d730 2023-03-03T06:24:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.997+0000 7f3bb959a700 1 -- 172.21.15.5:0/669424317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb400bbd0 con 0x7f3bbc15d730 2023-03-03T06:24:11.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.997+0000 7f3bb959a700 1 -- 172.21.15.5:0/669424317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4012430 con 0x7f3bbc15d730 2023-03-03T06:24:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.997+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/669424317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bbc15d730 msgr2=0x7f3bbc0cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:11.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.997+0000 7f3bc0bdb700 1 --2- 172.21.15.5:0/669424317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bbc15d730 0x7f3bbc0cd890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009d90 tx=0x7f3bb400b330 comp rx=0 tx=0).stop 2023-03-03T06:24:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.997+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/669424317 shutdown_connections 2023-03-03T06:24:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.997+0000 7f3bc0bdb700 1 --2- 172.21.15.5:0/669424317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bbc15d730 0x7f3bbc0cd890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.997+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/669424317 >> 172.21.15.5:0/669424317 conn(0x7f3bbc0cc740 msgr2=0x7f3bbc0ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.997+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/669424317 shutdown_connections 2023-03-03T06:24:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.998+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/669424317 wait complete. 2023-03-03T06:24:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.999+0000 7f3bc0bdb700 1 Processor -- start 2023-03-03T06:24:11.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:10.999+0000 7f3bc0bdb700 1 -- start start 2023-03-03T06:24:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bc0bdb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bbc0b1740 0x7f3bbc0b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bc0bdb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bbc0cbd80 0x7f3bbc151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bc0bdb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bbc15d730 0x7f3bbc0cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bc0bdb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc149a30 con 0x7f3bbc0cbd80 2023-03-03T06:24:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bc0bdb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc151ab0 con 0x7f3bbc15d730 2023-03-03T06:24:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bc0bdb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc152c90 con 0x7f3bbc0b1740 2023-03-03T06:24:11.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bb9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bbc0cbd80 0x7f3bbc151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bb9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bbc0cbd80 0x7f3bbc151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42130/0 (socket says 172.21.15.5:42130) 2023-03-03T06:24:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bb9d9b700 1 -- 172.21.15.5:0/4244221705 learned_addr learned my addr 172.21.15.5:0/4244221705 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bbad9d700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bbc15d730 0x7f3bbc0cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bba59c700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bbc0b1740 0x7f3bbc0b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bb9d9b700 1 -- 172.21.15.5:0/4244221705 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bbc0b1740 msgr2=0x7f3bbc0b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bb9d9b700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bbc0b1740 0x7f3bbc0b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:11.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bb9d9b700 1 -- 172.21.15.5:0/4244221705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bbc15d730 msgr2=0x7f3bbc0cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bb9d9b700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bbc15d730 0x7f3bbc0cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bb9d9b700 1 -- 172.21.15.5:0/4244221705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb4009a70 con 0x7f3bbc0cbd80 2023-03-03T06:24:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bba59c700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bbc0b1740 0x7f3bbc0b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3bb9d9b700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bbc0cbd80 0x7f3bbc151260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c540 tx=0x7f3bac00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.000+0000 7f3baaffd700 1 -- 172.21.15.5:0/4244221705 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0052d0 con 0x7f3bbc0cbd80 2023-03-03T06:24:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.001+0000 7f3baaffd700 1 -- 172.21.15.5:0/4244221705 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac005430 con 0x7f3bbc0cbd80 2023-03-03T06:24:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.001+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/4244221705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bbc15dee0 con 0x7f3bbc0cbd80 2023-03-03T06:24:11.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.001+0000 7f3baaffd700 1 -- 172.21.15.5:0/4244221705 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0038c0 con 0x7f3bbc0cbd80 2023-03-03T06:24:11.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.001+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/4244221705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc0cb580 con 0x7f3bbc0cbd80 2023-03-03T06:24:11.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.001+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/4244221705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc153de0 con 0x7f3bbc0cbd80 2023-03-03T06:24:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.002+0000 7f3baaffd700 1 -- 172.21.15.5:0/4244221705 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3bac019030 con 0x7f3bbc0cbd80 2023-03-03T06:24:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.002+0000 7f3baaffd700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3b9c0682f0 0x7f3b9c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.002+0000 7f3baaffd700 1 -- 172.21.15.5:0/4244221705 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3bac0853e0 con 0x7f3bbc0cbd80 2023-03-03T06:24:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.002+0000 7f3bba59c700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3b9c0682f0 0x7f3b9c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.003+0000 7f3bba59c700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3b9c0682f0 0x7f3b9c06a7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0000f60 tx=0x7f3bb0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:11.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.007+0000 7f3baaffd700 1 -- 172.21.15.5:0/4244221705 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3bac051860 con 0x7f3bbc0cbd80 2023-03-03T06:24:11.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.246+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/4244221705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3bbc152f70 con 0x7f3bbc0cbd80 2023-03-03T06:24:11.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.247+0000 7f3baaffd700 1 -- 172.21.15.5:0/4244221705 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3bac054e80 con 0x7f3bbc0cbd80 2023-03-03T06:24:11.249 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-03-03T06:24:11.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.249+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/4244221705 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3b9c0682f0 msgr2=0x7f3b9c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:11.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.249+0000 7f3bc0bdb700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3b9c0682f0 0x7f3b9c06a7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0000f60 tx=0x7f3bb0009040 comp rx=0 tx=0).stop 2023-03-03T06:24:11.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.249+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/4244221705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bbc0cbd80 msgr2=0x7f3bbc151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:11.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.249+0000 7f3bc0bdb700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bbc0cbd80 0x7f3bbc151260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c540 tx=0x7f3bac00c900 comp rx=0 tx=0).stop 2023-03-03T06:24:11.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.249+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/4244221705 shutdown_connections 2023-03-03T06:24:11.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.249+0000 7f3bc0bdb700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bbc15d730 0x7f3bbc0cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:11.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.249+0000 7f3bc0bdb700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3b9c0682f0 0x7f3b9c06a7a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:11.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.249+0000 7f3bc0bdb700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bbc0b1740 0x7f3bbc0b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:11.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.249+0000 7f3bc0bdb700 1 --2- 172.21.15.5:0/4244221705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bbc0cbd80 0x7f3bbc151260 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:11.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.249+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/4244221705 >> 172.21.15.5:0/4244221705 conn(0x7f3bbc0cc740 msgr2=0x7f3bbc0c65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:11.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.249+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/4244221705 shutdown_connections 2023-03-03T06:24:11.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:11.249+0000 7f3bc0bdb700 1 -- 172.21.15.5:0/4244221705 wait complete. 2023-03-03T06:24:11.263 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-03T06:24:11.263 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-03T06:24:11.264 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-03-03T06:24:11.264 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-03-03T06:24:11.264 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-03-03T06:24:11.264 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-03T06:24:11.265 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-03T06:24:11.265 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-03T06:24:11.265 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-03-03T06:24:11.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:11.266 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-03-03T06:24:11.284 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T06:24:11.284 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T06:24:11.285 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T06:24:11.285 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.285 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-03-03T06:24:11.285 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.285 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:24:11.285 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:11.285 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:24:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:11.286 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-03T06:24:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-03-03T06:24:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42492sec preferred_lft 42492sec 2023-03-03T06:24:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-03-03T06:24:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.287 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:24:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:11.287 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-03T06:24:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 76:7c:c4:80:40:be brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-03-03T06:24:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::3415:96ff:fe7c:a178/64 scope link 2023-03-03T06:24:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.288 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-03T06:24:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 76:7c:c4:80:40:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-03T06:24:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::747c:c4ff:fe80:40be/64 scope link tentative 2023-03-03T06:24:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:11.289 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-03T06:24:11.350 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-03-03T06:24:11.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:11.351 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-03-03T06:24:11.411 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-03-03T06:24:11.411 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-03T06:24:11.411 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-03-03T06:24:11.411 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-03-03T06:24:11.412 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-03T06:24:11.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:11.412 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:24:11.413 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:24:11.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-03-03T06:24:11.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-03-03T06:24:11.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-03-03T06:24:11.413 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:24:11.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:11.518 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-03-03T06:24:11.535 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-03-03T06:24:11.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:11.537 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2023-03-03T06:24:11.593 INFO:teuthology.orchestra.run.smithi005.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-03-03T06:24:11.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:11.594 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:24:11.594 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:24:11.594 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-03-03T06:24:11.594 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-03-03T06:24:11.594 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:24:11.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:11.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-03-03T06:24:11.723 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T06:24:11.724 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T06:24:11.724 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T06:24:11.724 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.724 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-03-03T06:24:11.724 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.725 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-03T06:24:11.725 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 46:69:f7:f0:35:c5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-03-03T06:24:11.725 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-03-03T06:24:11.725 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.725 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4469:f7ff:fef0:35c5/64 scope link tentative 2023-03-03T06:24:11.725 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:11.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-03-03T06:24:11.823 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T06:24:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T06:24:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T06:24:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.823 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-03-03T06:24:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.824 INFO:teuthology.orchestra.run.smithi005.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-03T06:24:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 46:69:f7:f0:35:c5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-03-03T06:24:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-03-03T06:24:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::4469:f7ff:fef0:35c5/64 scope link tentative 2023-03-03T06:24:11.824 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:11.840 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-03-03T06:24:11.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:11.841 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:24:11.841 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:24:11.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-03-03T06:24:11.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-03-03T06:24:11.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-03-03T06:24:11.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-03-03T06:24:11.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-03-03T06:24:11.842 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:24:12.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:12.104 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:24:12.104 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:24:12.104 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.1 up 2023-03-03T06:24:12.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.1 master ceph-brx 2023-03-03T06:24:12.105 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:24:12.242 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:24:12.243 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-03-03T06:24:12.267 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-03-03T06:24:12.267 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:24:12.267 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-03-03T06:24:12.324 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-03-03T06:24:12.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:12.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:24:12.440 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:12.440 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:24:12.441 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:24:12.441 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 2@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:24:12.441 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:24:12.441 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:24:12.441 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:24:12.442 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:24:12.476 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:12.477 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:24:12.477 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:24:12.477 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 2@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:24:12.477 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:24:12.477 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:24:12.477 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:24:12.477 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:24:12.478 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790" 2023-03-03T06:24:12.478 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2023-03-03T06:24:12.478 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6" will pass to kernel 2023-03-03T06:24:12.481 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-03T06:24:12.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:12.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-03-03T06:24:12.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:12.519 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:24:12.592 INFO:teuthology.orchestra.run.smithi005.stdout:client4821 2023-03-03T06:24:12.592 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:24:12.593 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:12.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:12.650 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:24:12.722 INFO:teuthology.orchestra.run.smithi005.stdout:client4821 2023-03-03T06:24:12.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:12.723 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:24:12.795 INFO:teuthology.orchestra.run.smithi005.stdout:client4821 2023-03-03T06:24:12.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:12.797 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.client4821/status') 2023-03-03T06:24:12.877 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.4821 (3)192.168.0.2:0/1497863914 2023-03-03T06:24:12.878 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2023-03-03T06:24:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2023-03-03T06:24:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2023-03-03T06:24:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 2.2211e-05 s, 3.1 MB/s 2023-03-03T06:24:12.879 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-03-03T06:24:12.880 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-03T06:24:12.880 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-03-03T06:24:12.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-03T06:24:13.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.042+0000 7fb6c7a42700 1 Processor -- start 2023-03-03T06:24:13.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.042+0000 7fb6c7a42700 1 -- start start 2023-03-03T06:24:13.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c7a42700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb6c006c830 0x7fb6c0160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:13.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c7a42700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6c00cf2a0 0x7fb6c00d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:13.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c7a42700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c00d2e10 con 0x7fb6c00b8a40 2023-03-03T06:24:13.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c7a42700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c0161490 con 0x7fb6c006c830 2023-03-03T06:24:13.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c7a42700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c00cd8d0 con 0x7fb6c00cf2a0 2023-03-03T06:24:13.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c4fdd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb6c006c830 0x7fb6c0160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:13.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c57de700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb6c00b8a40 0x7fb6c006c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60214/0 (socket says 172.21.15.5:60214) 2023-03-03T06:24:13.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c4fdd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb6c006c830 0x7fb6c0160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42142/0 (socket says 172.21.15.5:42142) 2023-03-03T06:24:13.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c57de700 1 -- 172.21.15.5:0/4029070750 learned_addr learned my addr 172.21.15.5:0/4029070750 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:13.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c5fdf700 1 --2- 172.21.15.5:0/4029070750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6c00cf2a0 0x7fb6c00d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:13.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c4fdd700 1 -- 172.21.15.5:0/4029070750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6c00cf2a0 msgr2=0x7fb6c00d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:13.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c4fdd700 1 --2- 172.21.15.5:0/4029070750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6c00cf2a0 0x7fb6c00d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:13.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c4fdd700 1 -- 172.21.15.5:0/4029070750 >> v1:172.21.15.5:6789/0 conn(0x7fb6c00b8a40 legacy=0x7fb6c006c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:13.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c4fdd700 1 -- 172.21.15.5:0/4029070750 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c00d2520 con 0x7fb6c006c830 2023-03-03T06:24:13.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6b3fff700 1 -- 172.21.15.5:0/4029070750 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975174724 0 0) 0x7fb6b4001110 con 0x7fb6c00b8a40 2023-03-03T06:24:13.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.043+0000 7fb6c5fdf700 1 --2- 172.21.15.5:0/4029070750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6c00cf2a0 0x7fb6c00d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:13.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.044+0000 7fb6c4fdd700 1 --2- 172.21.15.5:0/4029070750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6c006c830 0x7fb6c0160f50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009840 tx=0x7fb6bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8250973ce8b1fe33 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.044+0000 7fb6b3fff700 1 -- 172.21.15.5:0/4029070750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc011830 con 0x7fb6c006c830 2023-03-03T06:24:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.044+0000 7fb6b3fff700 1 -- 172.21.15.5:0/4029070750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc011990 con 0x7fb6c006c830 2023-03-03T06:24:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.044+0000 7fb6b3fff700 1 -- 172.21.15.5:0/4029070750 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc011d20 con 0x7fb6c006c830 2023-03-03T06:24:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.044+0000 7fb6c7a42700 1 -- 172.21.15.5:0/4029070750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6c006c830 msgr2=0x7fb6c0160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:13.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.044+0000 7fb6c7a42700 1 --2- 172.21.15.5:0/4029070750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6c006c830 0x7fb6c0160f50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009840 tx=0x7fb6bc009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:13.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.044+0000 7fb6c7a42700 1 -- 172.21.15.5:0/4029070750 shutdown_connections 2023-03-03T06:24:13.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.044+0000 7fb6c7a42700 1 --2- 172.21.15.5:0/4029070750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6c00cf2a0 0x7fb6c00d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:13.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.044+0000 7fb6c7a42700 1 --2- 172.21.15.5:0/4029070750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6c006c830 0x7fb6c0160f50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:13.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.044+0000 7fb6c7a42700 1 -- 172.21.15.5:0/4029070750 >> 172.21.15.5:0/4029070750 conn(0x7fb6c00d05d0 msgr2=0x7fb6c00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:13.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.045+0000 7fb6c7a42700 1 -- 172.21.15.5:0/4029070750 shutdown_connections 2023-03-03T06:24:13.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.045+0000 7fb6c7a42700 1 -- 172.21.15.5:0/4029070750 wait complete. 2023-03-03T06:24:13.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.046+0000 7fb6c7a42700 1 Processor -- start 2023-03-03T06:24:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.046+0000 7fb6c7a42700 1 -- start start 2023-03-03T06:24:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c7a42700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6c006c830 0x7fb6c0153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c7a42700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6c00b8a40 0x7fb6c01f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:13.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c7a42700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6c00cf2a0 0x7fb6c00b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c7a42700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c01f28c0 con 0x7fb6c00b8a40 2023-03-03T06:24:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c7a42700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c01f3ae0 con 0x7fb6c006c830 2023-03-03T06:24:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c7a42700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c00ccfb0 con 0x7fb6c00cf2a0 2023-03-03T06:24:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c4fdd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6c00b8a40 0x7fb6c01f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:13.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c4fdd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6c00b8a40 0x7fb6c01f35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42148/0 (socket says 172.21.15.5:42148) 2023-03-03T06:24:13.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c4fdd700 1 -- 172.21.15.5:0/1908416391 learned_addr learned my addr 172.21.15.5:0/1908416391 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:13.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c5fdf700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6c00cf2a0 0x7fb6c00b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:13.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c57de700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6c006c830 0x7fb6c0153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:13.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c4fdd700 1 -- 172.21.15.5:0/1908416391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6c00cf2a0 msgr2=0x7fb6c00b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:13.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c4fdd700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6c00cf2a0 0x7fb6c00b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c4fdd700 1 -- 172.21.15.5:0/1908416391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6c006c830 msgr2=0x7fb6c0153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c4fdd700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6c006c830 0x7fb6c0153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c4fdd700 1 -- 172.21.15.5:0/1908416391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc0094a0 con 0x7fb6c00b8a40 2023-03-03T06:24:13.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c57de700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6c006c830 0x7fb6c0153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c4fdd700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6c00b8a40 0x7fb6c01f35a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009790 tx=0x7fb6bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6b1ffb700 1 -- 172.21.15.5:0/1908416391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0036a0 con 0x7fb6c00b8a40 2023-03-03T06:24:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6b1ffb700 1 -- 172.21.15.5:0/1908416391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc01e070 con 0x7fb6c00b8a40 2023-03-03T06:24:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c7a42700 1 -- 172.21.15.5:0/1908416391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c00d2850 con 0x7fb6c00b8a40 2023-03-03T06:24:13.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6b1ffb700 1 -- 172.21.15.5:0/1908416391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc003a60 con 0x7fb6c00b8a40 2023-03-03T06:24:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.047+0000 7fb6c7a42700 1 -- 172.21.15.5:0/1908416391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c015ce30 con 0x7fb6c00b8a40 2023-03-03T06:24:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.048+0000 7fb6c7a42700 1 -- 172.21.15.5:0/1908416391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c00d2b30 con 0x7fb6c00b8a40 2023-03-03T06:24:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.049+0000 7fb6b1ffb700 1 -- 172.21.15.5:0/1908416391 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb6bc00f050 con 0x7fb6c00b8a40 2023-03-03T06:24:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.049+0000 7fb6b1ffb700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb6a40682f0 0x7fb6a406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.049+0000 7fb6b1ffb700 1 -- 172.21.15.5:0/1908416391 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb6bc0870d0 con 0x7fb6c00b8a40 2023-03-03T06:24:13.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.049+0000 7fb6c57de700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb6a40682f0 0x7fb6a406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.050+0000 7fb6c57de700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb6a40682f0 0x7fb6a406a7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4007fd0 tx=0x7fb6b4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:13.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.054+0000 7fb6b1ffb700 1 -- 172.21.15.5:0/1908416391 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb6bc053550 con 0x7fb6c00b8a40 2023-03-03T06:24:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.291+0000 7fb6c7a42700 1 -- 172.21.15.5:0/1908416391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb6c004e6e0 con 0x7fb6c00b8a40 2023-03-03T06:24:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.292+0000 7fb6b1ffb700 1 -- 172.21.15.5:0/1908416391 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb6bc020070 con 0x7fb6c00b8a40 2023-03-03T06:24:13.294 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-03-03T06:24:13.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.294+0000 7fb6c7a42700 1 -- 172.21.15.5:0/1908416391 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb6a40682f0 msgr2=0x7fb6a406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:13.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.294+0000 7fb6c7a42700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb6a40682f0 0x7fb6a406a7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4007fd0 tx=0x7fb6b4009040 comp rx=0 tx=0).stop 2023-03-03T06:24:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.294+0000 7fb6c7a42700 1 -- 172.21.15.5:0/1908416391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6c00b8a40 msgr2=0x7fb6c01f35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.294+0000 7fb6c7a42700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6c00b8a40 0x7fb6c01f35a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009790 tx=0x7fb6bc004750 comp rx=0 tx=0).stop 2023-03-03T06:24:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.294+0000 7fb6c7a42700 1 -- 172.21.15.5:0/1908416391 shutdown_connections 2023-03-03T06:24:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.294+0000 7fb6c7a42700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb6a40682f0 0x7fb6a406a7a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.294+0000 7fb6c7a42700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb6c00cf2a0 0x7fb6c00b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.294+0000 7fb6c7a42700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6c006c830 0x7fb6c0153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.294+0000 7fb6c7a42700 1 --2- 172.21.15.5:0/1908416391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6c00b8a40 0x7fb6c01f35a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:13.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.294+0000 7fb6c7a42700 1 -- 172.21.15.5:0/1908416391 >> 172.21.15.5:0/1908416391 conn(0x7fb6c00d05d0 msgr2=0x7fb6c00b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:13.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.294+0000 7fb6c7a42700 1 -- 172.21.15.5:0/1908416391 shutdown_connections 2023-03-03T06:24:13.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:13.294+0000 7fb6c7a42700 1 -- 172.21.15.5:0/1908416391 wait complete. 2023-03-03T06:24:13.308 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-03T06:24:13.309 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-03T06:24:13.309 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi191.front.sepia.ceph.com 2023-03-03T06:24:13.309 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-03-03T06:24:13.309 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-03-03T06:24:13.310 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-03T06:24:13.310 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-03T06:24:13.310 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-03T06:24:13.310 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-03-03T06:24:13.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:13.312 DEBUG:teuthology.orchestra.run.smithi191:> ip addr 2023-03-03T06:24:13.333 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T06:24:13.333 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T06:24:13.333 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T06:24:13.334 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:13.334 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2023-03-03T06:24:13.334 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:13.334 INFO:teuthology.orchestra.run.smithi191.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:24:13.334 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f6 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:13.335 INFO:teuthology.orchestra.run.smithi191.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:24:13.335 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f7 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:13.335 INFO:teuthology.orchestra.run.smithi191.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:24:13.335 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:10 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:13.335 INFO:teuthology.orchestra.run.smithi191.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-03T06:24:13.336 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:11 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:13.336 INFO:teuthology.orchestra.run.smithi191.stdout: inet 172.21.15.191/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-03-03T06:24:13.336 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft 42489sec preferred_lft 42489sec 2023-03-03T06:24:13.336 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::6d01:c3dd:e3c:72fa/64 scope link noprefixroute 2023-03-03T06:24:13.336 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:13.337 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-03-03T06:24:13.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:13.337 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-03T06:24:13.338 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-03T06:24:13.338 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add name ceph-brx type bridge 2023-03-03T06:24:13.339 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr flush dev ceph-brx 2023-03-03T06:24:13.339 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set ceph-brx up 2023-03-03T06:24:13.339 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-03-03T06:24:13.340 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-03T06:24:13.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:13.518 DEBUG:teuthology.orchestra.run.smithi191:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-03T06:24:13.548 INFO:teuthology.orchestra.run.smithi191.stdout:1 2023-03-03T06:24:13.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:13.549 DEBUG:teuthology.orchestra.run.smithi191:> route 2023-03-03T06:24:13.624 INFO:teuthology.orchestra.run.smithi191.stdout:Kernel IP routing table 2023-03-03T06:24:13.624 INFO:teuthology.orchestra.run.smithi191.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-03T06:24:13.625 INFO:teuthology.orchestra.run.smithi191.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-03T06:24:13.625 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-03-03T06:24:13.625 INFO:teuthology.orchestra.run.smithi191.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-03T06:24:13.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:13.626 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-03T06:24:13.626 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-03T06:24:13.627 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-03T06:24:13.627 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-03T06:24:13.627 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-03T06:24:13.627 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-03T06:24:13.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:13.900 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-03-03T06:24:13.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:13.917 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list-id 2023-03-03T06:24:13.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:13.974 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-03T06:24:13.974 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-03T06:24:13.975 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-03-03T06:24:13.975 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-03-03T06:24:13.976 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-03T06:24:14.068 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-03-03T06:24:14.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:14.068 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-03T06:24:14.069 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-03T06:24:14.069 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-03-03T06:24:14.070 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-03-03T06:24:14.070 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-03-03T06:24:14.070 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-03-03T06:24:14.071 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-03-03T06:24:14.071 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-03T06:24:14.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:14.290 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-03T06:24:14.290 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-03T06:24:14.290 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set brx.0 up 2023-03-03T06:24:14.291 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set dev brx.0 master ceph-brx 2023-03-03T06:24:14.291 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-03T06:24:14.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:24:14.395 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-03-03T06:24:14.417 INFO:teuthology.orchestra.run.smithi191.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-03-03T06:24:14.418 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:24:14.418 DEBUG:teuthology.orchestra.run.smithi191:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-03-03T06:24:14.474 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-03-03T06:24:14.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:14.475 DEBUG:teuthology.orchestra.run.smithi191:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:14.569 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:14.570 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:24:14.676 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:14.677 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:24:14.677 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:24:14.677 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: trying mount with new device syntax: 1@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:24:14.677 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:24:14.677 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:24:14.677 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:24:14.677 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:24:14.706 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:14.706 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:24:14.706 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:24:14.706 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: trying mount with new device syntax: 1@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:24:14.707 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:24:14.707 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:24:14.707 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:24:14.707 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:24:14.707 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790" 2023-03-03T06:24:14.707 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2023-03-03T06:24:14.707 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6" will pass to kernel 2023-03-03T06:24:14.710 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-03T06:24:14.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:14.711 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-03-03T06:24:14.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:14.756 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:24:14.827 INFO:teuthology.orchestra.run.smithi191.stdout:client4592 2023-03-03T06:24:14.828 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:24:14.828 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:14.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:14.885 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:24:14.956 INFO:teuthology.orchestra.run.smithi191.stdout:client4592 2023-03-03T06:24:14.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:14.957 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:24:15.028 INFO:teuthology.orchestra.run.smithi191.stdout:client4592 2023-03-03T06:24:15.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:15.029 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.client4592/status') 2023-03-03T06:24:15.108 INFO:teuthology.orchestra.run.smithi191.stdout:instance: client.4592 (3)192.168.0.1:0/3280044397 2023-03-03T06:24:15.109 INFO:teuthology.orchestra.run.smithi191.stdout:blocklisted: false 2023-03-03T06:24:15.110 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records in 2023-03-03T06:24:15.110 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records out 2023-03-03T06:24:15.110 INFO:teuthology.orchestra.run.smithi191.stderr:69 bytes copied, 2.4658e-05 s, 2.8 MB/s 2023-03-03T06:24:15.111 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-03-03T06:24:15.111 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-03-03T06:24:15.111 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-03-03T06:24:15.112 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-03T06:24:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.249+0000 7fe4a9cfe700 1 Processor -- start 2023-03-03T06:24:15.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.249+0000 7fe4a9cfe700 1 -- start start 2023-03-03T06:24:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a9cfe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4a4070d00 0x7fe4a40cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a9cfe700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a40cab20 con 0x7fe4a40710d0 2023-03-03T06:24:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a9cfe700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a406dcc0 con 0x7fe4a406d650 2023-03-03T06:24:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a9cfe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a406dad0 con 0x7fe4a4070d00 2023-03-03T06:24:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a2ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe4a40710d0 0x7fe4a406cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60230/0 (socket says 172.21.15.5:60230) 2023-03-03T06:24:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a2ffd700 1 -- 172.21.15.5:0/3774248532 learned_addr learned my addr 172.21.15.5:0/3774248532 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a37fe700 1 --2- 172.21.15.5:0/3774248532 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4a4070d00 0x7fe4a40cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506583741 0 0) 0x7fe4a40cab20 con 0x7fe4a40710d0 2023-03-03T06:24:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe48c0035b0 con 0x7fe4a40710d0 2023-03-03T06:24:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4273454448 0 0) 0x7fe48c0035b0 con 0x7fe4a40710d0 2023-03-03T06:24:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4a4070d00 msgr2=0x7fe4a40cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a27fc700 1 --2- 172.21.15.5:0/3774248532 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4a4070d00 0x7fe4a40cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 >> v1:172.21.15.191:6789/0 conn(0x7fe4a406d650 legacy=0x7fe4a40b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a40ca4d0 con 0x7fe4a40710d0 2023-03-03T06:24:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.250+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fe498001670 con 0x7fe4a40710d0 2023-03-03T06:24:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 >> v1:172.21.15.5:6789/0 conn(0x7fe4a40710d0 legacy=0x7fe4a406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a27fc700 1 --2- 172.21.15.5:0/3774248532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe48c003aa0 0x7fe48c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a27fc700 1 --2- 172.21.15.5:0/3774248532 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4a4070d00 0x7fe48c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a27fc700 1 --2- 172.21.15.5:0/3774248532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe48c004d90 0x7fe48c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c00baf0 con 0x7fe48c003aa0 2023-03-03T06:24:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c00bc30 con 0x7fe48c004d90 2023-03-03T06:24:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c00bdf0 con 0x7fe4a4070d00 2023-03-03T06:24:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a37fe700 1 --2- 172.21.15.5:0/3774248532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe48c003aa0 0x7fe48c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a2ffd700 1 --2- 172.21.15.5:0/3774248532 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4a4070d00 0x7fe48c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a3fff700 1 --2- 172.21.15.5:0/3774248532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe48c004d90 0x7fe48c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a37fe700 1 -- 172.21.15.5:0/3774248532 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4a4070d00 msgr2=0x7fe48c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a37fe700 1 --2- 172.21.15.5:0/3774248532 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe4a4070d00 0x7fe48c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a37fe700 1 -- 172.21.15.5:0/3774248532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe48c004d90 msgr2=0x7fe48c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a37fe700 1 --2- 172.21.15.5:0/3774248532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe48c004d90 0x7fe48c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a37fe700 1 -- 172.21.15.5:0/3774248532 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c0035b0 con 0x7fe48c003aa0 2023-03-03T06:24:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a37fe700 1 --2- 172.21.15.5:0/3774248532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe48c003aa0 0x7fe48c003eb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe494009b60 tx=0x7fe48c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d90122664efa4aa server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400e6c0 con 0x7fe48c003aa0 2023-03-03T06:24:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400e820 con 0x7fe48c003aa0 2023-03-03T06:24:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.251+0000 7fe4a27fc700 1 -- 172.21.15.5:0/3774248532 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400eb90 con 0x7fe48c003aa0 2023-03-03T06:24:15.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.252+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/3774248532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe48c003aa0 msgr2=0x7fe48c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:15.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.252+0000 7fe4a9cfe700 1 --2- 172.21.15.5:0/3774248532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe48c003aa0 0x7fe48c003eb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe494009b60 tx=0x7fe48c005880 comp rx=0 tx=0).stop 2023-03-03T06:24:15.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.252+0000 7fe4a3fff700 1 -- 172.21.15.5:0/3774248532 reap_dead start 2023-03-03T06:24:15.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.252+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/3774248532 shutdown_connections 2023-03-03T06:24:15.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.252+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/3774248532 >> 172.21.15.5:0/3774248532 conn(0x7fe4a40cec40 msgr2=0x7fe4a40cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:15.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.252+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/3774248532 shutdown_connections 2023-03-03T06:24:15.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.252+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/3774248532 wait complete. 2023-03-03T06:24:15.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.253+0000 7fe4a9cfe700 1 Processor -- start 2023-03-03T06:24:15.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.253+0000 7fe4a9cfe700 1 -- start start 2023-03-03T06:24:15.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.254+0000 7fe4a9cfe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe48c003aa0 0x7fe4a4159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:15.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.254+0000 7fe4a9cfe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4a41574a0 0x7fe4a406a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:15.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.254+0000 7fe4a9cfe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a40ade90 0x7fe4a406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:15.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.254+0000 7fe4a9cfe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40c6720 con 0x7fe4a40ade90 2023-03-03T06:24:15.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.254+0000 7fe4a9cfe700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40ae390 con 0x7fe4a41574a0 2023-03-03T06:24:15.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.254+0000 7fe4a9cfe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40c6970 con 0x7fe48c003aa0 2023-03-03T06:24:15.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.254+0000 7fe4a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a40ade90 0x7fe4a406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:15.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.254+0000 7fe4a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a40ade90 0x7fe4a406a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42170/0 (socket says 172.21.15.5:42170) 2023-03-03T06:24:15.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.254+0000 7fe4a3fff700 1 -- 172.21.15.5:0/2241049273 learned_addr learned my addr 172.21.15.5:0/2241049273 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:15.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.254+0000 7fe4a2ffd700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4a41574a0 0x7fe4a406a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:15.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.254+0000 7fe4a37fe700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe48c003aa0 0x7fe4a4159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.255+0000 7fe4a3fff700 1 -- 172.21.15.5:0/2241049273 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe48c003aa0 msgr2=0x7fe4a4159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.255+0000 7fe4a3fff700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe48c003aa0 0x7fe4a4159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.255+0000 7fe4a3fff700 1 -- 172.21.15.5:0/2241049273 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4a41574a0 msgr2=0x7fe4a406a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.255+0000 7fe4a3fff700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4a41574a0 0x7fe4a406a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.255+0000 7fe4a3fff700 1 -- 172.21.15.5:0/2241049273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a4071540 con 0x7fe4a40ade90 2023-03-03T06:24:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.255+0000 7fe4a3fff700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a40ade90 0x7fe4a406a870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40c9ea0 tx=0x7fe49c00d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.255+0000 7fe48bfff700 1 -- 172.21.15.5:0/2241049273 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c003c10 con 0x7fe4a40ade90 2023-03-03T06:24:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.255+0000 7fe48bfff700 1 -- 172.21.15.5:0/2241049273 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c003d90 con 0x7fe4a40ade90 2023-03-03T06:24:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.255+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/2241049273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a40ca7b0 con 0x7fe4a40ade90 2023-03-03T06:24:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.255+0000 7fe48bfff700 1 -- 172.21.15.5:0/2241049273 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c00d950 con 0x7fe4a40ade90 2023-03-03T06:24:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.255+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/2241049273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a40ca130 con 0x7fe4a40ade90 2023-03-03T06:24:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.256+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/2241049273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a404e6e0 con 0x7fe4a40ade90 2023-03-03T06:24:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.256+0000 7fe48bfff700 1 -- 172.21.15.5:0/2241049273 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe49c00dab0 con 0x7fe4a40ade90 2023-03-03T06:24:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.257+0000 7fe48bfff700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe4900682f0 0x7fe49006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:15.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.257+0000 7fe48bfff700 1 -- 172.21.15.5:0/2241049273 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe49c0861d0 con 0x7fe4a40ade90 2023-03-03T06:24:15.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.257+0000 7fe4a37fe700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe4900682f0 0x7fe49006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:15.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.257+0000 7fe4a37fe700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe4900682f0 0x7fe49006a7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe49400a010 tx=0x7fe494008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:15.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.261+0000 7fe48bfff700 1 -- 172.21.15.5:0/2241049273 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe49c052740 con 0x7fe4a40ade90 2023-03-03T06:24:15.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.501+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/2241049273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe4a406b870 con 0x7fe4a40ade90 2023-03-03T06:24:15.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.501+0000 7fe48bfff700 1 -- 172.21.15.5:0/2241049273 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe49c055d60 con 0x7fe4a40ade90 2023-03-03T06:24:15.504 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-03-03T06:24:15.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.503+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/2241049273 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe4900682f0 msgr2=0x7fe49006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.503+0000 7fe4a9cfe700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe4900682f0 0x7fe49006a7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe49400a010 tx=0x7fe494008030 comp rx=0 tx=0).stop 2023-03-03T06:24:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.503+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/2241049273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a40ade90 msgr2=0x7fe4a406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.503+0000 7fe4a9cfe700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a40ade90 0x7fe4a406a870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40c9ea0 tx=0x7fe49c00d150 comp rx=0 tx=0).stop 2023-03-03T06:24:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.503+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/2241049273 shutdown_connections 2023-03-03T06:24:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.503+0000 7fe4a9cfe700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a40ade90 0x7fe4a406a870 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.503+0000 7fe4a9cfe700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe4900682f0 0x7fe49006a7a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:15.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.503+0000 7fe4a9cfe700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe48c003aa0 0x7fe4a4159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.503+0000 7fe4a9cfe700 1 --2- 172.21.15.5:0/2241049273 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe4a41574a0 0x7fe4a406a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.503+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/2241049273 >> 172.21.15.5:0/2241049273 conn(0x7fe4a40cec40 msgr2=0x7fe4a40b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.504+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/2241049273 shutdown_connections 2023-03-03T06:24:15.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:15.504+0000 7fe4a9cfe700 1 -- 172.21.15.5:0/2241049273 wait complete. 2023-03-03T06:24:15.518 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-03-03T06:24:15.518 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-03T06:24:15.519 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi191.front.sepia.ceph.com 2023-03-03T06:24:15.519 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-03-03T06:24:15.519 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-03-03T06:24:15.519 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-03-03T06:24:15.519 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-03-03T06:24:15.520 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-03T06:24:15.520 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-03-03T06:24:15.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:15.521 DEBUG:teuthology.orchestra.run.smithi191:> ip addr 2023-03-03T06:24:15.538 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T06:24:15.538 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T06:24:15.538 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T06:24:15.539 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:15.539 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2023-03-03T06:24:15.539 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:15.539 INFO:teuthology.orchestra.run.smithi191.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:24:15.539 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f6 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:15.539 INFO:teuthology.orchestra.run.smithi191.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:24:15.539 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:d9:37:f7 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:15.540 INFO:teuthology.orchestra.run.smithi191.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:24:15.540 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:10 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:15.540 INFO:teuthology.orchestra.run.smithi191.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-03T06:24:15.540 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 0c:c4:7a:88:72:11 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:15.540 INFO:teuthology.orchestra.run.smithi191.stdout: inet 172.21.15.191/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-03-03T06:24:15.540 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft 42487sec preferred_lft 42487sec 2023-03-03T06:24:15.540 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::6d01:c3dd:e3c:72fa/64 scope link noprefixroute 2023-03-03T06:24:15.540 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:15.541 INFO:teuthology.orchestra.run.smithi191.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-03T06:24:15.541 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 6e:b3:10:0f:50:e8 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:24:15.541 INFO:teuthology.orchestra.run.smithi191.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-03-03T06:24:15.541 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:15.541 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::6827:8eff:fe70:5751/64 scope link 2023-03-03T06:24:15.541 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:15.541 INFO:teuthology.orchestra.run.smithi191.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-03T06:24:15.542 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 6e:b3:10:0f:50:e8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-03-03T06:24:15.542 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::6cb3:10ff:fe0f:50e8/64 scope link tentative 2023-03-03T06:24:15.542 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:15.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:15.542 DEBUG:teuthology.orchestra.run.smithi191:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-03T06:24:15.605 INFO:teuthology.orchestra.run.smithi191.stdout:1 2023-03-03T06:24:15.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:15.607 DEBUG:teuthology.orchestra.run.smithi191:> route 2023-03-03T06:24:15.664 INFO:teuthology.orchestra.run.smithi191.stdout:Kernel IP routing table 2023-03-03T06:24:15.665 INFO:teuthology.orchestra.run.smithi191.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-03T06:24:15.665 INFO:teuthology.orchestra.run.smithi191.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-03-03T06:24:15.665 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-03-03T06:24:15.665 INFO:teuthology.orchestra.run.smithi191.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-03T06:24:15.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:15.666 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-03T06:24:15.667 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-03T06:24:15.667 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-03-03T06:24:15.667 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-03-03T06:24:15.667 DEBUG:teuthology.orchestra.run.smithi191:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-03-03T06:24:15.668 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-03T06:24:15.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:15.771 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list 2023-03-03T06:24:15.787 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-03-03T06:24:15.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:15.788 DEBUG:teuthology.orchestra.run.smithi191:> ip netns list-id 2023-03-03T06:24:15.844 INFO:teuthology.orchestra.run.smithi191.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-03-03T06:24:15.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:15.844 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-03T06:24:15.845 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-03T06:24:15.845 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-03-03T06:24:15.845 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-03-03T06:24:15.845 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-03T06:24:15.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:15.937 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-03-03T06:24:15.979 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T06:24:15.979 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T06:24:15.980 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T06:24:15.980 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:15.980 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2023-03-03T06:24:15.980 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:15.980 INFO:teuthology.orchestra.run.smithi191.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-03T06:24:15.980 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 5e:98:b4:3f:a4:80 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-03-03T06:24:15.980 INFO:teuthology.orchestra.run.smithi191.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-03-03T06:24:15.981 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:15.981 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::5c98:b4ff:fe3f:a480/64 scope link 2023-03-03T06:24:15.981 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:15.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:15.992 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-03-03T06:24:16.069 INFO:teuthology.orchestra.run.smithi191.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T06:24:16.070 INFO:teuthology.orchestra.run.smithi191.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T06:24:16.070 INFO:teuthology.orchestra.run.smithi191.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T06:24:16.070 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:16.070 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 ::1/128 scope host 2023-03-03T06:24:16.070 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:16.070 INFO:teuthology.orchestra.run.smithi191.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-03T06:24:16.070 INFO:teuthology.orchestra.run.smithi191.stdout: link/ether 5e:98:b4:3f:a4:80 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-03-03T06:24:16.071 INFO:teuthology.orchestra.run.smithi191.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-03-03T06:24:16.071 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:16.071 INFO:teuthology.orchestra.run.smithi191.stdout: inet6 fe80::5c98:b4ff:fe3f:a480/64 scope link 2023-03-03T06:24:16.071 INFO:teuthology.orchestra.run.smithi191.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:24:16.082 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-03-03T06:24:16.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:16.083 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-03T06:24:16.083 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-03T06:24:16.084 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-03-03T06:24:16.084 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-03-03T06:24:16.084 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-03-03T06:24:16.084 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-03-03T06:24:16.085 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-03-03T06:24:16.085 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-03T06:24:16.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:16.316 DEBUG:teuthology.orchestra.run.smithi191:> (cd / && exec bash -c ' 2023-03-03T06:24:16.317 DEBUG:teuthology.orchestra.run.smithi191:> set -e 2023-03-03T06:24:16.317 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set brx.1 up 2023-03-03T06:24:16.317 DEBUG:teuthology.orchestra.run.smithi191:> sudo ip link set dev brx.1 master ceph-brx 2023-03-03T06:24:16.317 DEBUG:teuthology.orchestra.run.smithi191:> ') 2023-03-03T06:24:16.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:24:16.425 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-03-03T06:24:16.445 INFO:teuthology.orchestra.run.smithi191.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-03-03T06:24:16.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:24:16.446 DEBUG:teuthology.orchestra.run.smithi191:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-03-03T06:24:16.501 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-03-03T06:24:16.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:16.502 DEBUG:teuthology.orchestra.run.smithi191:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:16.586 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:16.587 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:24:16.615 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:16.616 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:24:16.616 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:24:16.616 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: trying mount with new device syntax: 3@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:24:16.617 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:24:16.617 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:24:16.617 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:24:16.617 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:24:16.646 INFO:teuthology.orchestra.run.smithi191.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:24:16.647 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:24:16.647 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:24:16.647 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: trying mount with new device syntax: 3@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:24:16.647 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:24:16.647 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:24:16.647 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:24:16.647 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:24:16.648 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790" 2023-03-03T06:24:16.648 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2023-03-03T06:24:16.648 INFO:teuthology.orchestra.run.smithi191.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6" will pass to kernel 2023-03-03T06:24:16.650 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-03T06:24:16.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:16.650 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-03-03T06:24:16.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:16.683 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:24:16.754 INFO:teuthology.orchestra.run.smithi191.stdout:client4601 2023-03-03T06:24:16.755 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:24:16.755 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:16.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:16.812 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:24:16.883 INFO:teuthology.orchestra.run.smithi191.stdout:client4601 2023-03-03T06:24:16.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:16.884 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:24:16.955 INFO:teuthology.orchestra.run.smithi191.stdout:client4601 2023-03-03T06:24:16.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:16.956 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.client4601/status') 2023-03-03T06:24:17.035 INFO:teuthology.orchestra.run.smithi191.stdout:instance: client.4601 (3)192.168.0.2:0/4023475291 2023-03-03T06:24:17.036 INFO:teuthology.orchestra.run.smithi191.stdout:blocklisted: false 2023-03-03T06:24:17.037 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records in 2023-03-03T06:24:17.037 INFO:teuthology.orchestra.run.smithi191.stderr:0+1 records out 2023-03-03T06:24:17.037 INFO:teuthology.orchestra.run.smithi191.stderr:69 bytes copied, 2.1135e-05 s, 3.3 MB/s 2023-03-03T06:24:17.038 INFO:teuthology.run_tasks:Running task exec... 2023-03-03T06:24:17.166 INFO:teuthology.task.exec:Executing custom commands... 2023-03-03T06:24:17.167 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2023-03-03T06:24:17.168 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/crash/warn_recent_interval 0' 2023-03-03T06:24:17.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:24:17.213 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:24:17.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.307+0000 7fbfd090a700 1 Processor -- start 2023-03-03T06:24:17.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.307+0000 7fbfd090a700 1 -- start start 2023-03-03T06:24:17.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.308+0000 7fbfd090a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbfcc06a2e0 0x7fbfcc06a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:17.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.308+0000 7fbfd090a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfcc0b2380 0x7fbfcc06de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:17.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.308+0000 7fbfd090a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc06e360 0x7fbfcc06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.308+0000 7fbfd090a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfcc160420 con 0x7fbfcc0b2380 2023-03-03T06:24:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.308+0000 7fbfd090a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfcc0ca340 con 0x7fbfcc06a2e0 2023-03-03T06:24:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.308+0000 7fbfd090a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc15cd30 con 0x7fbfcc06e360 2023-03-03T06:24:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.308+0000 7fbfc9d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfcc0b2380 0x7fbfcc06de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.308+0000 7fbfc9d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfcc0b2380 0x7fbfcc06de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42174/0 (socket says 172.21.15.5:42174) 2023-03-03T06:24:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.308+0000 7fbfc9d9b700 1 -- 172.21.15.5:0/2448180544 learned_addr learned my addr 172.21.15.5:0/2448180544 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:17.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.309+0000 7fbfca59c700 1 --2- 172.21.15.5:0/2448180544 >> v2:172.21.15.191:3300/0 conn(0x7fbfcc06a2e0 0x7fbfcc06a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.309+0000 7fbfcad9d700 1 --2- 172.21.15.5:0/2448180544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc06e360 0x7fbfcc06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.309+0000 7fbfc9d9b700 1 -- 172.21.15.5:0/2448180544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc06e360 msgr2=0x7fbfcc06ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.309+0000 7fbfc9d9b700 1 --2- 172.21.15.5:0/2448180544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc06e360 0x7fbfcc06ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.309+0000 7fbfc9d9b700 1 -- 172.21.15.5:0/2448180544 >> v2:172.21.15.191:3300/0 conn(0x7fbfcc06a2e0 msgr2=0x7fbfcc06a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.309+0000 7fbfc9d9b700 1 --2- 172.21.15.5:0/2448180544 >> v2:172.21.15.191:3300/0 conn(0x7fbfcc06a2e0 0x7fbfcc06a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.309+0000 7fbfc9d9b700 1 -- 172.21.15.5:0/2448180544 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc06abf0 con 0x7fbfcc0b2380 2023-03-03T06:24:17.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.309+0000 7fbfca59c700 1 --2- 172.21.15.5:0/2448180544 >> v2:172.21.15.191:3300/0 conn(0x7fbfcc06a2e0 0x7fbfcc06a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:17.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.309+0000 7fbfcad9d700 1 --2- 172.21.15.5:0/2448180544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc06e360 0x7fbfcc06ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:17.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.309+0000 7fbfc9d9b700 1 --2- 172.21.15.5:0/2448180544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfcc0b2380 0x7fbfcc06de20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc070af0 tx=0x7fbfbc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a62ce5ed030144 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:17.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.309+0000 7fbfc959a700 1 -- 172.21.15.5:0/2448180544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc00b870 con 0x7fbfcc0b2380 2023-03-03T06:24:17.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.309+0000 7fbfc959a700 1 -- 172.21.15.5:0/2448180544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc00b9d0 con 0x7fbfcc0b2380 2023-03-03T06:24:17.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.309+0000 7fbfc959a700 1 -- 172.21.15.5:0/2448180544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc00bd60 con 0x7fbfcc0b2380 2023-03-03T06:24:17.317 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.310+0000 7fbfd090a700 1 -- 172.21.15.5:0/2448180544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfcc0b2380 msgr2=0x7fbfcc06de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.310+0000 7fbfd090a700 1 --2- 172.21.15.5:0/2448180544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfcc0b2380 0x7fbfcc06de20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc070af0 tx=0x7fbfbc009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.310+0000 7fbfd090a700 1 -- 172.21.15.5:0/2448180544 shutdown_connections 2023-03-03T06:24:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.310+0000 7fbfd090a700 1 --2- 172.21.15.5:0/2448180544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc06e360 0x7fbfcc06ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.310+0000 7fbfd090a700 1 --2- 172.21.15.5:0/2448180544 >> v2:172.21.15.191:3300/0 conn(0x7fbfcc06a2e0 0x7fbfcc06a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.310+0000 7fbfd090a700 1 --2- 172.21.15.5:0/2448180544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfcc0b2380 0x7fbfcc06de20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.310+0000 7fbfd090a700 1 -- 172.21.15.5:0/2448180544 >> 172.21.15.5:0/2448180544 conn(0x7fbfcc0cc770 msgr2=0x7fbfcc0ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:17.318 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.310+0000 7fbfd090a700 1 -- 172.21.15.5:0/2448180544 shutdown_connections 2023-03-03T06:24:17.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.310+0000 7fbfd090a700 1 -- 172.21.15.5:0/2448180544 wait complete. 2023-03-03T06:24:17.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.311+0000 7fbfd090a700 1 Processor -- start 2023-03-03T06:24:17.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.311+0000 7fbfd090a700 1 -- start start 2023-03-03T06:24:17.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfd090a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfcc06a2e0 0x7fbfcc0c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:17.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfd090a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfcc06e360 0x7fbfcc1f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:17.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfd090a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc0b2380 0x7fbfcc1f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:17.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfd090a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc1f67d0 con 0x7fbfcc06e360 2023-03-03T06:24:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfd090a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc0b4060 con 0x7fbfcc06a2e0 2023-03-03T06:24:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfd090a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc0b3aa0 con 0x7fbfcc0b2380 2023-03-03T06:24:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfc9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfcc06e360 0x7fbfcc1f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfc9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfcc06e360 0x7fbfcc1f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42182/0 (socket says 172.21.15.5:42182) 2023-03-03T06:24:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfc9d9b700 1 -- 172.21.15.5:0/3068911279 learned_addr learned my addr 172.21.15.5:0/3068911279 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfcad9d700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc0b2380 0x7fbfcc1f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfca59c700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfcc06a2e0 0x7fbfcc0c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:17.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfc9d9b700 1 -- 172.21.15.5:0/3068911279 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc0b2380 msgr2=0x7fbfcc1f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfc9d9b700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc0b2380 0x7fbfcc1f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfc9d9b700 1 -- 172.21.15.5:0/3068911279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfcc06a2e0 msgr2=0x7fbfcc0c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfc9d9b700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfcc06a2e0 0x7fbfcc0c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.312+0000 7fbfc9d9b700 1 -- 172.21.15.5:0/3068911279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc009550 con 0x7fbfcc06e360 2023-03-03T06:24:17.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.313+0000 7fbfc9d9b700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfcc06e360 0x7fbfcc1f58c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc000c00 tx=0x7fbfbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.313+0000 7fbfbaffd700 1 -- 172.21.15.5:0/3068911279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc004510 con 0x7fbfcc06e360 2023-03-03T06:24:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.313+0000 7fbfbaffd700 1 -- 172.21.15.5:0/3068911279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc0036a0 con 0x7fbfcc06e360 2023-03-03T06:24:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.313+0000 7fbfbaffd700 1 -- 172.21.15.5:0/3068911279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc003a30 con 0x7fbfcc06e360 2023-03-03T06:24:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.313+0000 7fbfd090a700 1 -- 172.21.15.5:0/3068911279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfcc160950 con 0x7fbfcc06e360 2023-03-03T06:24:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.313+0000 7fbfd090a700 1 -- 172.21.15.5:0/3068911279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfcc160670 con 0x7fbfcc06e360 2023-03-03T06:24:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.314+0000 7fbfd090a700 1 -- 172.21.15.5:0/3068911279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfcc160c30 con 0x7fbfcc06e360 2023-03-03T06:24:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.314+0000 7fbfbaffd700 1 -- 172.21.15.5:0/3068911279 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbfbc00f050 con 0x7fbfcc06e360 2023-03-03T06:24:17.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.315+0000 7fbfbaffd700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbfac0682f0 0x7fbfac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:17.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.315+0000 7fbfbaffd700 1 -- 172.21.15.5:0/3068911279 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbfbc087380 con 0x7fbfcc06e360 2023-03-03T06:24:17.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.315+0000 7fbfca59c700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbfac0682f0 0x7fbfac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:17.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.315+0000 7fbfca59c700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbfac0682f0 0x7fbfac06a7a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000ab70 tx=0x7fbfc0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:17.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.319+0000 7fbfbaffd700 1 -- 172.21.15.5:0/3068911279 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbfbc053800 con 0x7fbfcc06e360 2023-03-03T06:24:17.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.512+0000 7fbfd090a700 1 -- 172.21.15.5:0/3068911279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/crash/warn_recent_interval}] v 0) v1 -- 0x7fbfcc04e6e0 con 0x7fbfcc06e360 2023-03-03T06:24:17.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.515+0000 7fbfbaffd700 1 -- 172.21.15.5:0/3068911279 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/crash/warn_recent_interval}]=0 v10)=0 v10) v1 ==== 128+0+0 (secure 0 0 0) 0x7fbfbc056e20 con 0x7fbfcc06e360 2023-03-03T06:24:17.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.518+0000 7fbfd090a700 1 -- 172.21.15.5:0/3068911279 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbfac0682f0 msgr2=0x7fbfac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:17.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.518+0000 7fbfd090a700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbfac0682f0 0x7fbfac06a7a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000ab70 tx=0x7fbfc0008040 comp rx=0 tx=0).stop 2023-03-03T06:24:17.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.518+0000 7fbfd090a700 1 -- 172.21.15.5:0/3068911279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfcc06e360 msgr2=0x7fbfcc1f58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:17.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.518+0000 7fbfd090a700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfcc06e360 0x7fbfcc1f58c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc000c00 tx=0x7fbfbc004750 comp rx=0 tx=0).stop 2023-03-03T06:24:17.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.518+0000 7fbfd090a700 1 -- 172.21.15.5:0/3068911279 shutdown_connections 2023-03-03T06:24:17.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.518+0000 7fbfd090a700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbfac0682f0 0x7fbfac06a7a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.518+0000 7fbfd090a700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc0b2380 0x7fbfcc1f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.518+0000 7fbfd090a700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfcc06a2e0 0x7fbfcc0c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.518+0000 7fbfd090a700 1 --2- 172.21.15.5:0/3068911279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfcc06e360 0x7fbfcc1f58c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.518+0000 7fbfd090a700 1 -- 172.21.15.5:0/3068911279 >> 172.21.15.5:0/3068911279 conn(0x7fbfcc0cc770 msgr2=0x7fbfcc0cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:17.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.518+0000 7fbfd090a700 1 -- 172.21.15.5:0/3068911279 shutdown_connections 2023-03-03T06:24:17.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.518+0000 7fbfd090a700 1 -- 172.21.15.5:0/3068911279 wait complete. 2023-03-03T06:24:17.533 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-03-03T06:24:17.573 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:17.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.696+0000 7efff3d26700 1 Processor -- start 2023-03-03T06:24:17.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.697+0000 7efff3d26700 1 -- start start 2023-03-03T06:24:17.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.697+0000 7efff3d26700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7effec0ae530 0x7effec0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:17.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.697+0000 7efff3d26700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec0aed80 con 0x7effec06dc90 2023-03-03T06:24:17.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.697+0000 7efff3d26700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec15a160 con 0x7effec0ae900 2023-03-03T06:24:17.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.697+0000 7efff3d26700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec0ca170 con 0x7effec0ae530 2023-03-03T06:24:17.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.697+0000 7efff22c3700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7effec06dc90 0x7effec15cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60266/0 (socket says 172.21.15.5:60266) 2023-03-03T06:24:17.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff22c3700 1 -- 172.21.15.5:0/3971503301 learned_addr learned my addr 172.21.15.5:0/3971503301 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:17.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff1ac2700 1 --2- 172.21.15.5:0/3971503301 >> v2:172.21.15.191:3300/0 conn(0x7effec0ae530 0x7effec0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:17.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff0ac0700 1 -- 172.21.15.5:0/3971503301 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930039457 0 0) 0x7effec0aed80 con 0x7effec06dc90 2023-03-03T06:24:17.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff0ac0700 1 -- 172.21.15.5:0/3971503301 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd80035b0 con 0x7effec06dc90 2023-03-03T06:24:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff0ac0700 1 -- 172.21.15.5:0/3971503301 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502924359 0 0) 0x7effec15a160 con 0x7effec0ae900 2023-03-03T06:24:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff0ac0700 1 -- 172.21.15.5:0/3971503301 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effec0aed80 con 0x7effec0ae900 2023-03-03T06:24:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff1ac2700 1 -- 172.21.15.5:0/3971503301 >> v1:172.21.15.191:6789/0 conn(0x7effec0ae900 legacy=0x7effec06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:17.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff0ac0700 1 -- 172.21.15.5:0/3971503301 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 580214203 0 0) 0x7effd80035b0 con 0x7effec06dc90 2023-03-03T06:24:17.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff1ac2700 1 -- 172.21.15.5:0/3971503301 >> v1:172.21.15.5:6789/0 conn(0x7effec06dc90 legacy=0x7effec15cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:17.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff1ac2700 1 -- 172.21.15.5:0/3971503301 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec0ca380 con 0x7effec0ae530 2023-03-03T06:24:17.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff1ac2700 1 --2- 172.21.15.5:0/3971503301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effec0ae530 0x7effec0cb120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7effe800a9e0 tx=0x7effe800acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51eaa2fc3f3bad1d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:17.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff0ac0700 1 -- 172.21.15.5:0/3971503301 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe40019f0 con 0x7effec0ae530 2023-03-03T06:24:17.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff0ac0700 1 -- 172.21.15.5:0/3971503301 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe800ae80 con 0x7effec0ae530 2023-03-03T06:24:17.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.698+0000 7efff0ac0700 1 -- 172.21.15.5:0/3971503301 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8004250 con 0x7effec0ae530 2023-03-03T06:24:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.699+0000 7efff3d26700 1 -- 172.21.15.5:0/3971503301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effec0ae530 msgr2=0x7effec0cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.699+0000 7efff3d26700 1 --2- 172.21.15.5:0/3971503301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effec0ae530 0x7effec0cb120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7effe800a9e0 tx=0x7effe800acf0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.699+0000 7efff3d26700 1 -- 172.21.15.5:0/3971503301 shutdown_connections 2023-03-03T06:24:17.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.699+0000 7efff3d26700 1 --2- 172.21.15.5:0/3971503301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effec0ae530 0x7effec0cb120 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.699+0000 7efff3d26700 1 -- 172.21.15.5:0/3971503301 >> 172.21.15.5:0/3971503301 conn(0x7effec0cf4b0 msgr2=0x7effec0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:17.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.699+0000 7efff3d26700 1 -- 172.21.15.5:0/3971503301 shutdown_connections 2023-03-03T06:24:17.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.699+0000 7efff3d26700 1 -- 172.21.15.5:0/3971503301 wait complete. 2023-03-03T06:24:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.700+0000 7efff3d26700 1 Processor -- start 2023-03-03T06:24:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.700+0000 7efff3d26700 1 -- start start 2023-03-03T06:24:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff3d26700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effec06dc90 0x7effec0c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:17.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff3d26700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec0ae530 0x7effec15aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff3d26700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effec0ae900 0x7effec15b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff3d26700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec0b3590 con 0x7effec0ae530 2023-03-03T06:24:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff3d26700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec1f39d0 con 0x7effec0ae900 2023-03-03T06:24:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff3d26700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec0c75c0 con 0x7effec06dc90 2023-03-03T06:24:17.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff12c1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec0ae530 0x7effec15aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff12c1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec0ae530 0x7effec15aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42196/0 (socket says 172.21.15.5:42196) 2023-03-03T06:24:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff12c1700 1 -- 172.21.15.5:0/705065571 learned_addr learned my addr 172.21.15.5:0/705065571 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff22c3700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effec0ae900 0x7effec15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff1ac2700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effec06dc90 0x7effec0c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff12c1700 1 -- 172.21.15.5:0/705065571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effec06dc90 msgr2=0x7effec0c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:17.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff12c1700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effec06dc90 0x7effec0c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff12c1700 1 -- 172.21.15.5:0/705065571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effec0ae900 msgr2=0x7effec15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:17.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff12c1700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effec0ae900 0x7effec15b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff12c1700 1 -- 172.21.15.5:0/705065571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe800a640 con 0x7effec0ae530 2023-03-03T06:24:17.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.701+0000 7efff1ac2700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effec06dc90 0x7effec0c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:17.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.702+0000 7efff12c1700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec0ae530 0x7effec15aaf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7effdc00c520 tx=0x7effdc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:17.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.702+0000 7effe27fc700 1 -- 172.21.15.5:0/705065571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc0052d0 con 0x7effec0ae530 2023-03-03T06:24:17.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.702+0000 7effe27fc700 1 -- 172.21.15.5:0/705065571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc005430 con 0x7effec0ae530 2023-03-03T06:24:17.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.702+0000 7efff3d26700 1 -- 172.21.15.5:0/705065571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec0cac20 con 0x7effec0ae530 2023-03-03T06:24:17.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.702+0000 7effe27fc700 1 -- 172.21.15.5:0/705065571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc0038a0 con 0x7effec0ae530 2023-03-03T06:24:17.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.702+0000 7efff3d26700 1 -- 172.21.15.5:0/705065571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec0ca940 con 0x7effec0ae530 2023-03-03T06:24:17.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.703+0000 7efff3d26700 1 -- 172.21.15.5:0/705065571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec153520 con 0x7effec0ae530 2023-03-03T06:24:17.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.703+0000 7effe27fc700 1 -- 172.21.15.5:0/705065571 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7effdc019030 con 0x7effec0ae530 2023-03-03T06:24:17.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.704+0000 7effe27fc700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7effd00682f0 0x7effd006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:17.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.704+0000 7effe27fc700 1 -- 172.21.15.5:0/705065571 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7effdc085310 con 0x7effec0ae530 2023-03-03T06:24:17.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.704+0000 7efff1ac2700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7effd00682f0 0x7effd006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:17.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.704+0000 7efff1ac2700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7effd00682f0 0x7effd006a7a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7effe800a1c0 tx=0x7effe8012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:17.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.708+0000 7effe27fc700 1 -- 172.21.15.5:0/705065571 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7effdc051880 con 0x7effec0ae530 2023-03-03T06:24:17.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.902+0000 7efff3d26700 1 -- 172.21.15.5:0/705065571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effec04e6e0 con 0x7effec0ae530 2023-03-03T06:24:17.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.903+0000 7effe27fc700 1 -- 172.21.15.5:0/705065571 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7effdc054ea0 con 0x7effec0ae530 2023-03-03T06:24:17.905 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:17.906 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:17.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.905+0000 7efff3d26700 1 -- 172.21.15.5:0/705065571 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7effd00682f0 msgr2=0x7effd006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:17.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.905+0000 7efff3d26700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7effd00682f0 0x7effd006a7a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7effe800a1c0 tx=0x7effe8012000 comp rx=0 tx=0).stop 2023-03-03T06:24:17.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.905+0000 7efff3d26700 1 -- 172.21.15.5:0/705065571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec0ae530 msgr2=0x7effec15aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.905+0000 7efff3d26700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec0ae530 0x7effec15aaf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7effdc00c520 tx=0x7effdc00c830 comp rx=0 tx=0).stop 2023-03-03T06:24:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.905+0000 7efff3d26700 1 -- 172.21.15.5:0/705065571 shutdown_connections 2023-03-03T06:24:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.905+0000 7efff3d26700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7effec0ae900 0x7effec15b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.905+0000 7efff3d26700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7effd00682f0 0x7effd006a7a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.905+0000 7efff3d26700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effec06dc90 0x7effec0c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.905+0000 7efff3d26700 1 --2- 172.21.15.5:0/705065571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effec0ae530 0x7effec15aaf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.905+0000 7efff3d26700 1 -- 172.21.15.5:0/705065571 >> 172.21.15.5:0/705065571 conn(0x7effec0cf4b0 msgr2=0x7effec0cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.905+0000 7efff3d26700 1 -- 172.21.15.5:0/705065571 shutdown_connections 2023-03-03T06:24:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:17.905+0000 7efff3d26700 1 -- 172.21.15.5:0/705065571 wait complete. 2023-03-03T06:24:17.920 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:23:38.141777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:23:39.283589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-03T06:23:42.422930+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-03T06:24:17.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:24:18.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.046+0000 7f020cc56700 1 Processor -- start 2023-03-03T06:24:18.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.046+0000 7f020cc56700 1 -- start start 2023-03-03T06:24:18.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f020cc56700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f020815a7b0 0x7f020815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f020cc56700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02080cde30 0x7f02080cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f020cc56700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02080cf5c0 con 0x7f020806b700 2023-03-03T06:24:18.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f020cc56700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02080cf8a0 con 0x7f020815a7b0 2023-03-03T06:24:18.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f020cc56700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02080cfb80 con 0x7f02080cde30 2023-03-03T06:24:18.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f020659c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f020815a7b0 0x7f020815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f0205d9b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02080cde30 0x7f02080cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f020659c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f020815a7b0 0x7f020815ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42562/0 (socket says 172.21.15.5:42562) 2023-03-03T06:24:18.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f020659c700 1 -- 172.21.15.5:0/33969667 learned_addr learned my addr 172.21.15.5:0/33969667 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:18.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f0205d9b700 1 --2- 172.21.15.5:0/33969667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02080cde30 0x7f02080cec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:40282/0 (socket says 172.21.15.5:40282) 2023-03-03T06:24:18.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f0206d9d700 1 --1- 172.21.15.5:0/33969667 >> v1:172.21.15.191:6789/0 conn(0x7f020806b700 0x7f02080b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:46576/0 (socket says 172.21.15.5:46576) 2023-03-03T06:24:18.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f020659c700 1 -- 172.21.15.5:0/33969667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02080cde30 msgr2=0x7f02080cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:18.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f020659c700 1 --2- 172.21.15.5:0/33969667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02080cde30 0x7f02080cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f020659c700 1 -- 172.21.15.5:0/33969667 >> v1:172.21.15.191:6789/0 conn(0x7f020806b700 legacy=0x7f02080b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.047+0000 7f020659c700 1 -- 172.21.15.5:0/33969667 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02080b2d40 con 0x7f020815a7b0 2023-03-03T06:24:18.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.048+0000 7f020659c700 1 --2- 172.21.15.5:0/33969667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020815a7b0 0x7f020815ab80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f01f80098f0 tx=0x7f01f8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddf4687eba22a5df server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:18.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.048+0000 7f020559a700 1 -- 172.21.15.5:0/33969667 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8011830 con 0x7f020815a7b0 2023-03-03T06:24:18.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.048+0000 7f020559a700 1 -- 172.21.15.5:0/33969667 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f8011990 con 0x7f020815a7b0 2023-03-03T06:24:18.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.048+0000 7f020559a700 1 -- 172.21.15.5:0/33969667 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8011d20 con 0x7f020815a7b0 2023-03-03T06:24:18.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.048+0000 7f020cc56700 1 -- 172.21.15.5:0/33969667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020815a7b0 msgr2=0x7f020815ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.048+0000 7f020cc56700 1 --2- 172.21.15.5:0/33969667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020815a7b0 0x7f020815ab80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f01f80098f0 tx=0x7f01f8009c00 comp rx=0 tx=0).stop 2023-03-03T06:24:18.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.048+0000 7f020cc56700 1 -- 172.21.15.5:0/33969667 shutdown_connections 2023-03-03T06:24:18.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.048+0000 7f020cc56700 1 --2- 172.21.15.5:0/33969667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020815a7b0 0x7f020815ab80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.048+0000 7f020cc56700 1 --2- 172.21.15.5:0/33969667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02080cde30 0x7f02080cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.048+0000 7f020cc56700 1 -- 172.21.15.5:0/33969667 >> 172.21.15.5:0/33969667 conn(0x7f02080cc8d0 msgr2=0x7f02080cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.048+0000 7f020cc56700 1 -- 172.21.15.5:0/33969667 shutdown_connections 2023-03-03T06:24:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.048+0000 7f020cc56700 1 -- 172.21.15.5:0/33969667 wait complete. 2023-03-03T06:24:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.050+0000 7f020cc56700 1 Processor -- start 2023-03-03T06:24:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.050+0000 7f020cc56700 1 -- start start 2023-03-03T06:24:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.050+0000 7f020cc56700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020806b700 0x7f02081555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.050+0000 7f020cc56700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02080cde30 0x7f02080b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.050+0000 7f020cc56700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815a7b0 0x7f020815cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.050+0000 7f020cc56700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020815c3b0 con 0x7f020815a7b0 2023-03-03T06:24:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.050+0000 7f020cc56700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02080b1490 con 0x7f020806b700 2023-03-03T06:24:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.050+0000 7f020cc56700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02080b0bf0 con 0x7f02080cde30 2023-03-03T06:24:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f0206d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815a7b0 0x7f020815cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f0206d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815a7b0 0x7f020815cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42212/0 (socket says 172.21.15.5:42212) 2023-03-03T06:24:18.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f0206d9d700 1 -- 172.21.15.5:0/2959114559 learned_addr learned my addr 172.21.15.5:0/2959114559 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f020659c700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020806b700 0x7f02081555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f0205d9b700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02080cde30 0x7f02080b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f0206d9d700 1 -- 172.21.15.5:0/2959114559 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02080cde30 msgr2=0x7f02080b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f0206d9d700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02080cde30 0x7f02080b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f0206d9d700 1 -- 172.21.15.5:0/2959114559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020806b700 msgr2=0x7f02081555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f0206d9d700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020806b700 0x7f02081555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f0206d9d700 1 -- 172.21.15.5:0/2959114559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f8009550 con 0x7f020815a7b0 2023-03-03T06:24:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f020659c700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020806b700 0x7f02081555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f0206d9d700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815a7b0 0x7f020815cb00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f020000cbd0 tx=0x7f020000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f01f6ffd700 1 -- 172.21.15.5:0/2959114559 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000aaa0 con 0x7f020815a7b0 2023-03-03T06:24:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f01f6ffd700 1 -- 172.21.15.5:0/2959114559 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020000ac00 con 0x7f020815a7b0 2023-03-03T06:24:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f020cc56700 1 -- 172.21.15.5:0/2959114559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02080cf1b0 con 0x7f020815a7b0 2023-03-03T06:24:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f01f6ffd700 1 -- 172.21.15.5:0/2959114559 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200007070 con 0x7f020815a7b0 2023-03-03T06:24:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.051+0000 7f020cc56700 1 -- 172.21.15.5:0/2959114559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02080b3020 con 0x7f020815a7b0 2023-03-03T06:24:18.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.052+0000 7f020cc56700 1 -- 172.21.15.5:0/2959114559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02080cf340 con 0x7f020815a7b0 2023-03-03T06:24:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.053+0000 7f01f6ffd700 1 -- 172.21.15.5:0/2959114559 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0200019030 con 0x7f020815a7b0 2023-03-03T06:24:18.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.053+0000 7f01f6ffd700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01e80682f0 0x7f01e806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.053+0000 7f01f6ffd700 1 -- 172.21.15.5:0/2959114559 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0200085ab0 con 0x7f020815a7b0 2023-03-03T06:24:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.053+0000 7f020659c700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01e80682f0 0x7f01e806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.054+0000 7f020659c700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01e80682f0 0x7f01e806a7a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f01f8014040 tx=0x7f01f8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:18.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.057+0000 7f01f6ffd700 1 -- 172.21.15.5:0/2959114559 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f020004b5e0 con 0x7f020815a7b0 2023-03-03T06:24:18.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.247+0000 7f020cc56700 1 -- 172.21.15.5:0/2959114559 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f020804e6e0 con 0x7f020815a7b0 2023-03-03T06:24:18.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.248+0000 7f01f6ffd700 1 -- 172.21.15.5:0/2959114559 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f02000170a0 con 0x7f020815a7b0 2023-03-03T06:24:18.250 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:24:18.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.249+0000 7f020cc56700 1 -- 172.21.15.5:0/2959114559 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01e80682f0 msgr2=0x7f01e806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.249+0000 7f020cc56700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01e80682f0 0x7f01e806a7a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f01f8014040 tx=0x7f01f8008030 comp rx=0 tx=0).stop 2023-03-03T06:24:18.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.249+0000 7f020cc56700 1 -- 172.21.15.5:0/2959114559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815a7b0 msgr2=0x7f020815cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.249+0000 7f020cc56700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815a7b0 0x7f020815cb00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f020000cbd0 tx=0x7f020000cee0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.250+0000 7f020cc56700 1 -- 172.21.15.5:0/2959114559 shutdown_connections 2023-03-03T06:24:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.250+0000 7f020cc56700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f020815a7b0 0x7f020815cb00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.250+0000 7f020cc56700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f020806b700 0x7f02081555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.250+0000 7f020cc56700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f01e80682f0 0x7f01e806a7a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.250+0000 7f020cc56700 1 --2- 172.21.15.5:0/2959114559 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02080cde30 0x7f02080b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.250+0000 7f020cc56700 1 -- 172.21.15.5:0/2959114559 >> 172.21.15.5:0/2959114559 conn(0x7f02080cc8d0 msgr2=0x7f02080c6170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.250+0000 7f020cc56700 1 -- 172.21.15.5:0/2959114559 shutdown_connections 2023-03-03T06:24:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.250+0000 7f020cc56700 1 -- 172.21.15.5:0/2959114559 wait complete. 2023-03-03T06:24:18.264 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:24:18.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.389+0000 7f270f275700 1 Processor -- start 2023-03-03T06:24:18.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.389+0000 7f270f275700 1 -- start start 2023-03-03T06:24:18.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.390+0000 7f270f275700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f270815a7e0 0x7f27080d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.390+0000 7f270f275700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27080cb4a0 con 0x7f27080cd890 2023-03-03T06:24:18.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.390+0000 7f270f275700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27080cebe0 con 0x7f270815a410 2023-03-03T06:24:18.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.390+0000 7f270f275700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27080cb6f0 con 0x7f270815a7e0 2023-03-03T06:24:18.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.390+0000 7f270d812700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f27080cd890 0x7f27080cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60294/0 (socket says 172.21.15.5:60294) 2023-03-03T06:24:18.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.390+0000 7f270d812700 1 -- 172.21.15.5:0/2580371769 learned_addr learned my addr 172.21.15.5:0/2580371769 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:18.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.391+0000 7f270c810700 1 --2- 172.21.15.5:0/2580371769 >> v2:172.21.15.191:3300/0 conn(0x7f270815a7e0 0x7f27080d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.391+0000 7f26fffff700 1 -- 172.21.15.5:0/2580371769 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818750872 0 0) 0x7f27080cb4a0 con 0x7f27080cd890 2023-03-03T06:24:18.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.391+0000 7f26fffff700 1 -- 172.21.15.5:0/2580371769 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26f40035b0 con 0x7f27080cd890 2023-03-03T06:24:18.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.391+0000 7f270c810700 1 -- 172.21.15.5:0/2580371769 >> v1:172.21.15.191:6789/0 conn(0x7f270815a410 legacy=0x7f27080cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.391+0000 7f26fffff700 1 -- 172.21.15.5:0/2580371769 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 819316650 0 0) 0x7f26f40035b0 con 0x7f27080cd890 2023-03-03T06:24:18.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.391+0000 7f270c810700 1 -- 172.21.15.5:0/2580371769 >> v1:172.21.15.5:6789/0 conn(0x7f27080cd890 legacy=0x7f27080cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.391+0000 7f270c810700 1 -- 172.21.15.5:0/2580371769 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080cb9d0 con 0x7f270815a7e0 2023-03-03T06:24:18.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.391+0000 7f270c810700 1 --2- 172.21.15.5:0/2580371769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f270815a7e0 0x7f27080d1660 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2704009840 tx=0x7f2704009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68a3eed8229d4604 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:18.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.391+0000 7f26fffff700 1 -- 172.21.15.5:0/2580371769 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000019f0 con 0x7f270815a7e0 2023-03-03T06:24:18.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.391+0000 7f26fffff700 1 -- 172.21.15.5:0/2580371769 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2704004030 con 0x7f270815a7e0 2023-03-03T06:24:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.391+0000 7f26fffff700 1 -- 172.21.15.5:0/2580371769 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040043c0 con 0x7f270815a7e0 2023-03-03T06:24:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.392+0000 7f270f275700 1 -- 172.21.15.5:0/2580371769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f270815a7e0 msgr2=0x7f27080d1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.392+0000 7f270f275700 1 --2- 172.21.15.5:0/2580371769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f270815a7e0 0x7f27080d1660 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2704009840 tx=0x7f2704009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.392+0000 7f270f275700 1 -- 172.21.15.5:0/2580371769 shutdown_connections 2023-03-03T06:24:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.392+0000 7f270f275700 1 --2- 172.21.15.5:0/2580371769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f270815a7e0 0x7f27080d1660 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.392+0000 7f270f275700 1 -- 172.21.15.5:0/2580371769 >> 172.21.15.5:0/2580371769 conn(0x7f270806f3c0 msgr2=0x7f270806f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.392+0000 7f270f275700 1 -- 172.21.15.5:0/2580371769 shutdown_connections 2023-03-03T06:24:18.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.392+0000 7f270f275700 1 -- 172.21.15.5:0/2580371769 wait complete. 2023-03-03T06:24:18.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.393+0000 7f270f275700 1 Processor -- start 2023-03-03T06:24:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.393+0000 7f270f275700 1 -- start start 2023-03-03T06:24:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.394+0000 7f270f275700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27080cd890 0x7f27080cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.394+0000 7f270f275700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f270815a410 0x7f2708158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.394+0000 7f270f275700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815a7e0 0x7f2708150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.394+0000 7f270f275700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27081f1ad0 con 0x7f270815a7e0 2023-03-03T06:24:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.394+0000 7f270f275700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27080cfd30 con 0x7f270815a410 2023-03-03T06:24:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.394+0000 7f270f275700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270815b9d0 con 0x7f27080cd890 2023-03-03T06:24:18.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.394+0000 7f270d812700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815a7e0 0x7f2708150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.394+0000 7f270d812700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815a7e0 0x7f2708150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42226/0 (socket says 172.21.15.5:42226) 2023-03-03T06:24:18.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.394+0000 7f270d812700 1 -- 172.21.15.5:0/3358950089 learned_addr learned my addr 172.21.15.5:0/3358950089 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:18.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.394+0000 7f270c810700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f270815a410 0x7f2708158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.394+0000 7f270d011700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27080cd890 0x7f27080cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.395+0000 7f270d812700 1 -- 172.21.15.5:0/3358950089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27080cd890 msgr2=0x7f27080cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.395+0000 7f270d812700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27080cd890 0x7f27080cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.395+0000 7f270d812700 1 -- 172.21.15.5:0/3358950089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f270815a410 msgr2=0x7f2708158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.395+0000 7f270d812700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f270815a410 0x7f2708158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.395+0000 7f270d812700 1 -- 172.21.15.5:0/3358950089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27040094a0 con 0x7f270815a7e0 2023-03-03T06:24:18.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.395+0000 7f270d812700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815a7e0 0x7f2708150a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f270000cc90 tx=0x7f270000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:18.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.395+0000 7f26fdffb700 1 -- 172.21.15.5:0/3358950089 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270000aad0 con 0x7f270815a7e0 2023-03-03T06:24:18.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.395+0000 7f26fdffb700 1 -- 172.21.15.5:0/3358950089 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270000ac50 con 0x7f270815a7e0 2023-03-03T06:24:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.395+0000 7f270f275700 1 -- 172.21.15.5:0/3358950089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27080cdd10 con 0x7f270815a7e0 2023-03-03T06:24:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.395+0000 7f26fdffb700 1 -- 172.21.15.5:0/3358950089 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000070d0 con 0x7f270815a7e0 2023-03-03T06:24:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.395+0000 7f270f275700 1 -- 172.21.15.5:0/3358950089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27080cbcb0 con 0x7f270815a7e0 2023-03-03T06:24:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.396+0000 7f270f275700 1 -- 172.21.15.5:0/3358950089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27080cdea0 con 0x7f270815a7e0 2023-03-03T06:24:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.397+0000 7f26fdffb700 1 -- 172.21.15.5:0/3358950089 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f270001a030 con 0x7f270815a7e0 2023-03-03T06:24:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.397+0000 7f26fdffb700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26ec0682f0 0x7f26ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.397+0000 7f26fdffb700 1 -- 172.21.15.5:0/3358950089 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2700085c20 con 0x7f270815a7e0 2023-03-03T06:24:18.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.397+0000 7f270d011700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26ec0682f0 0x7f26ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.397+0000 7f270d011700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26ec0682f0 0x7f26ec06a7a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26f8007fd0 tx=0x7f26f8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:18.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.401+0000 7f26fdffb700 1 -- 172.21.15.5:0/3358950089 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2700052190 con 0x7f270815a7e0 2023-03-03T06:24:18.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.593+0000 7f270f275700 1 -- 172.21.15.5:0/3358950089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f270804e6e0 con 0x7f270815a7e0 2023-03-03T06:24:18.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.593+0000 7f26fdffb700 1 -- 172.21.15.5:0/3358950089 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27000180a0 con 0x7f270815a7e0 2023-03-03T06:24:18.596 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:24:18.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.595+0000 7f270f275700 1 -- 172.21.15.5:0/3358950089 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26ec0682f0 msgr2=0x7f26ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.595+0000 7f270f275700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26ec0682f0 0x7f26ec06a7a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26f8007fd0 tx=0x7f26f8009040 comp rx=0 tx=0).stop 2023-03-03T06:24:18.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.595+0000 7f270f275700 1 -- 172.21.15.5:0/3358950089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815a7e0 msgr2=0x7f2708150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.595+0000 7f270f275700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815a7e0 0x7f2708150a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f270000cc90 tx=0x7f270000a060 comp rx=0 tx=0).stop 2023-03-03T06:24:18.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.595+0000 7f270f275700 1 -- 172.21.15.5:0/3358950089 shutdown_connections 2023-03-03T06:24:18.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.595+0000 7f270f275700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f270815a7e0 0x7f2708150a00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.595+0000 7f270f275700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f26ec0682f0 0x7f26ec06a7a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.595+0000 7f270f275700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27080cd890 0x7f27080cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.595+0000 7f270f275700 1 --2- 172.21.15.5:0/3358950089 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f270815a410 0x7f2708158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.595+0000 7f270f275700 1 -- 172.21.15.5:0/3358950089 >> 172.21.15.5:0/3358950089 conn(0x7f270806f3c0 msgr2=0x7f27080c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:18.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.595+0000 7f270f275700 1 -- 172.21.15.5:0/3358950089 shutdown_connections 2023-03-03T06:24:18.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.595+0000 7f270f275700 1 -- 172.21.15.5:0/3358950089 wait complete. 2023-03-03T06:24:18.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:24:18.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.735+0000 7f9523234700 1 Processor -- start 2023-03-03T06:24:18.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.735+0000 7f9523234700 1 -- start start 2023-03-03T06:24:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9523234700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f951c15a460 0x7f951c0cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9523234700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f951c15a830 0x7f951c0cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9523234700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f951c0b01a0 0x7f951c0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9523234700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c0cb4a0 con 0x7f951c15a460 2023-03-03T06:24:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9523234700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c0cd650 con 0x7f951c0b01a0 2023-03-03T06:24:18.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9523234700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0d16a0 con 0x7f951c15a830 2023-03-03T06:24:18.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9520fd0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f951c15a460 0x7f951c0cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9520fd0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f951c15a460 0x7f951c0cd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42230/0 (socket says 172.21.15.5:42230) 2023-03-03T06:24:18.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9520fd0700 1 -- 172.21.15.5:0/810045364 learned_addr learned my addr 172.21.15.5:0/810045364 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:18.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9520fd0700 1 -- 172.21.15.5:0/810045364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f951c15a830 msgr2=0x7f951c0cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:18.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f95217d1700 1 --2- 172.21.15.5:0/810045364 >> v2:172.21.15.191:3300/0 conn(0x7f951c0b01a0 0x7f951c0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f951bfff700 1 --2- 172.21.15.5:0/810045364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f951c15a830 0x7f951c0cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9520fd0700 1 --2- 172.21.15.5:0/810045364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f951c15a830 0x7f951c0cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9520fd0700 1 -- 172.21.15.5:0/810045364 >> v2:172.21.15.191:3300/0 conn(0x7f951c0b01a0 msgr2=0x7f951c0cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:18.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9520fd0700 1 --2- 172.21.15.5:0/810045364 >> v2:172.21.15.191:3300/0 conn(0x7f951c0b01a0 0x7f951c0cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f9520fd0700 1 -- 172.21.15.5:0/810045364 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c0cbc70 con 0x7f951c15a460 2023-03-03T06:24:18.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f951bfff700 1 --2- 172.21.15.5:0/810045364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f951c15a830 0x7f951c0cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:18.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.736+0000 7f95217d1700 1 --2- 172.21.15.5:0/810045364 >> v2:172.21.15.191:3300/0 conn(0x7f951c0b01a0 0x7f951c0cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:18.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.737+0000 7f9520fd0700 1 --2- 172.21.15.5:0/810045364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f951c15a460 0x7f951c0cd110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f951c0ce9b0 tx=0x7f9510009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2dd5d843afb4cb server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:18.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.737+0000 7f951b7fe700 1 -- 172.21.15.5:0/810045364 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951000b870 con 0x7f951c15a460 2023-03-03T06:24:18.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.737+0000 7f951b7fe700 1 -- 172.21.15.5:0/810045364 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951000b9d0 con 0x7f951c15a460 2023-03-03T06:24:18.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.737+0000 7f951b7fe700 1 -- 172.21.15.5:0/810045364 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951000bd60 con 0x7f951c15a460 2023-03-03T06:24:18.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.737+0000 7f9523234700 1 -- 172.21.15.5:0/810045364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f951c15a460 msgr2=0x7f951c0cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.737+0000 7f9523234700 1 --2- 172.21.15.5:0/810045364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f951c15a460 0x7f951c0cd110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f951c0ce9b0 tx=0x7f9510009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.737+0000 7f9523234700 1 -- 172.21.15.5:0/810045364 shutdown_connections 2023-03-03T06:24:18.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.737+0000 7f9523234700 1 --2- 172.21.15.5:0/810045364 >> v2:172.21.15.191:3300/0 conn(0x7f951c0b01a0 0x7f951c0cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.737+0000 7f9523234700 1 --2- 172.21.15.5:0/810045364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f951c15a460 0x7f951c0cd110 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.737+0000 7f9523234700 1 --2- 172.21.15.5:0/810045364 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f951c15a830 0x7f951c0cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.737+0000 7f9523234700 1 -- 172.21.15.5:0/810045364 >> 172.21.15.5:0/810045364 conn(0x7f951c06f3c0 msgr2=0x7f951c06f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:18.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.737+0000 7f9523234700 1 -- 172.21.15.5:0/810045364 shutdown_connections 2023-03-03T06:24:18.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.737+0000 7f9523234700 1 -- 172.21.15.5:0/810045364 wait complete. 2023-03-03T06:24:18.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.738+0000 7f9523234700 1 Processor -- start 2023-03-03T06:24:18.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.739+0000 7f9523234700 1 -- start start 2023-03-03T06:24:18.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.739+0000 7f9523234700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f951c0b01a0 0x7f951c0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.739+0000 7f9523234700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f951c15a460 0x7f951c1f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.739+0000 7f9523234700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f951c15a830 0x7f951c15e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.739+0000 7f9523234700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0c9f10 con 0x7f951c15a460 2023-03-03T06:24:18.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.739+0000 7f9523234700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c15da80 con 0x7f951c15a830 2023-03-03T06:24:18.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.739+0000 7f9523234700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0ca140 con 0x7f951c0b01a0 2023-03-03T06:24:18.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f951bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f951c15a460 0x7f951c1f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f951bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f951c15a460 0x7f951c1f18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42236/0 (socket says 172.21.15.5:42236) 2023-03-03T06:24:18.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f951bfff700 1 -- 172.21.15.5:0/1458868241 learned_addr learned my addr 172.21.15.5:0/1458868241 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:18.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f9520fd0700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f951c0b01a0 0x7f951c0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f95217d1700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f951c15a830 0x7f951c15e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f951bfff700 1 -- 172.21.15.5:0/1458868241 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f951c0b01a0 msgr2=0x7f951c0af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f951bfff700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f951c0b01a0 0x7f951c0af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f951bfff700 1 -- 172.21.15.5:0/1458868241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f951c15a830 msgr2=0x7f951c15e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f951bfff700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f951c15a830 0x7f951c15e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f951bfff700 1 -- 172.21.15.5:0/1458868241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9510009550 con 0x7f951c15a460 2023-03-03T06:24:18.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f9520fd0700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f951c0b01a0 0x7f951c0af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:18.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f951bfff700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f951c15a460 0x7f951c1f18c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f950800c7f0 tx=0x7f950800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:18.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f95197fa700 1 -- 172.21.15.5:0/1458868241 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508011800 con 0x7f951c15a460 2023-03-03T06:24:18.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f95197fa700 1 -- 172.21.15.5:0/1458868241 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9508011960 con 0x7f951c15a460 2023-03-03T06:24:18.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f9523234700 1 -- 172.21.15.5:0/1458868241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c0cb990 con 0x7f951c15a460 2023-03-03T06:24:18.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f95197fa700 1 -- 172.21.15.5:0/1458868241 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508011d10 con 0x7f951c15a460 2023-03-03T06:24:18.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.740+0000 7f9523234700 1 -- 172.21.15.5:0/1458868241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c0cb6b0 con 0x7f951c15a460 2023-03-03T06:24:18.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.741+0000 7f9523234700 1 -- 172.21.15.5:0/1458868241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951c0d1940 con 0x7f951c15a460 2023-03-03T06:24:18.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.742+0000 7f95197fa700 1 -- 172.21.15.5:0/1458868241 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9508021070 con 0x7f951c15a460 2023-03-03T06:24:18.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.742+0000 7f95197fa700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f95000682f0 0x7f950006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:18.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.742+0000 7f95197fa700 1 -- 172.21.15.5:0/1458868241 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9508085e60 con 0x7f951c15a460 2023-03-03T06:24:18.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.742+0000 7f9520fd0700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f95000682f0 0x7f950006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:18.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.743+0000 7f9520fd0700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f95000682f0 0x7f950006a7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9510000c00 tx=0x7f9510008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:18.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.746+0000 7f95197fa700 1 -- 172.21.15.5:0/1458868241 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f95080523d0 con 0x7f951c15a460 2023-03-03T06:24:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.938+0000 7f9523234700 1 -- 172.21.15.5:0/1458868241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f951c04e6e0 con 0x7f951c15a460 2023-03-03T06:24:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.939+0000 7f95197fa700 1 -- 172.21.15.5:0/1458868241 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f950801f020 con 0x7f951c15a460 2023-03-03T06:24:18.941 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:18.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.941+0000 7f9523234700 1 -- 172.21.15.5:0/1458868241 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f95000682f0 msgr2=0x7f950006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.941+0000 7f9523234700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f95000682f0 0x7f950006a7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9510000c00 tx=0x7f9510008030 comp rx=0 tx=0).stop 2023-03-03T06:24:18.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.941+0000 7f9523234700 1 -- 172.21.15.5:0/1458868241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f951c15a460 msgr2=0x7f951c1f18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:18.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.941+0000 7f9523234700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f951c15a460 0x7f951c1f18c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f950800c7f0 tx=0x7f950800cbb0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.941+0000 7f9523234700 1 -- 172.21.15.5:0/1458868241 shutdown_connections 2023-03-03T06:24:18.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.941+0000 7f9523234700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f951c15a830 0x7f951c15e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.941+0000 7f9523234700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f95000682f0 0x7f950006a7a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.941+0000 7f9523234700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f951c0b01a0 0x7f951c0af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.941+0000 7f9523234700 1 --2- 172.21.15.5:0/1458868241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f951c15a460 0x7f951c1f18c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:18.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.941+0000 7f9523234700 1 -- 172.21.15.5:0/1458868241 >> 172.21.15.5:0/1458868241 conn(0x7f951c06f3c0 msgr2=0x7f951c1591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:18.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.941+0000 7f9523234700 1 -- 172.21.15.5:0/1458868241 shutdown_connections 2023-03-03T06:24:18.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:18.941+0000 7f9523234700 1 -- 172.21.15.5:0/1458868241 wait complete. 2023-03-03T06:24:18.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:24:19.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.081+0000 7fb56a47e700 1 Processor -- start 2023-03-03T06:24:19.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.081+0000 7fb56a47e700 1 -- start start 2023-03-03T06:24:19.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.082+0000 7fb56a47e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb564159530 0x7fb5640cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.082+0000 7fb56a47e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb56406b120 0x7fb564071590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.082+0000 7fb56a47e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb564159900 con 0x7fb564071ad0 2023-03-03T06:24:19.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.082+0000 7fb56a47e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb564071f50 con 0x7fb564159530 2023-03-03T06:24:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.082+0000 7fb56a47e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56406b6b0 con 0x7fb56406b120 2023-03-03T06:24:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb5637fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb56406b120 0x7fb564071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb563fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb564159530 0x7fb5640cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb563fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb564159530 0x7fb5640cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42604/0 (socket says 172.21.15.5:42604) 2023-03-03T06:24:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb563fff700 1 -- 172.21.15.5:0/1846133075 learned_addr learned my addr 172.21.15.5:0/1846133075 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:19.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb568a1b700 1 --1- 172.21.15.5:0/1846133075 >> v1:172.21.15.191:6789/0 conn(0x7fb564071ad0 0x7fb56415d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:46618/0 (socket says 172.21.15.5:46618) 2023-03-03T06:24:19.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb5637fe700 1 --2- 172.21.15.5:0/1846133075 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb56406b120 0x7fb564071590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:40322/0 (socket says 172.21.15.5:40322) 2023-03-03T06:24:19.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb5637fe700 1 -- 172.21.15.5:0/1846133075 >> v2:172.21.15.191:3300/0 conn(0x7fb564159530 msgr2=0x7fb5640cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:19.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb5637fe700 1 --2- 172.21.15.5:0/1846133075 >> v2:172.21.15.191:3300/0 conn(0x7fb564159530 0x7fb5640cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb5637fe700 1 -- 172.21.15.5:0/1846133075 >> v1:172.21.15.191:6789/0 conn(0x7fb564071ad0 legacy=0x7fb56415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb5637fe700 1 -- 172.21.15.5:0/1846133075 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56406b990 con 0x7fb56406b120 2023-03-03T06:24:19.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb563fff700 1 --2- 172.21.15.5:0/1846133075 >> v2:172.21.15.191:3300/0 conn(0x7fb564159530 0x7fb5640cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:19.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb562ffd700 1 -- 172.21.15.5:0/1846133075 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469378147 0 0) 0x7fb55c001490 con 0x7fb564071ad0 2023-03-03T06:24:19.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb5637fe700 1 --2- 172.21.15.5:0/1846133075 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb56406b120 0x7fb564071590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009840 tx=0x7fb54c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c410963f29d4eba server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:19.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb562ffd700 1 -- 172.21.15.5:0/1846133075 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c011830 con 0x7fb56406b120 2023-03-03T06:24:19.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb562ffd700 1 -- 172.21.15.5:0/1846133075 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c011990 con 0x7fb56406b120 2023-03-03T06:24:19.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.083+0000 7fb562ffd700 1 -- 172.21.15.5:0/1846133075 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c011d20 con 0x7fb56406b120 2023-03-03T06:24:19.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.084+0000 7fb56a47e700 1 -- 172.21.15.5:0/1846133075 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb56406b120 msgr2=0x7fb564071590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.084+0000 7fb56a47e700 1 --2- 172.21.15.5:0/1846133075 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb56406b120 0x7fb564071590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009840 tx=0x7fb54c009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:19.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.084+0000 7fb56a47e700 1 -- 172.21.15.5:0/1846133075 shutdown_connections 2023-03-03T06:24:19.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.084+0000 7fb56a47e700 1 --2- 172.21.15.5:0/1846133075 >> v2:172.21.15.191:3300/0 conn(0x7fb564159530 0x7fb5640cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.084+0000 7fb56a47e700 1 --2- 172.21.15.5:0/1846133075 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb56406b120 0x7fb564071590 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.084+0000 7fb56a47e700 1 -- 172.21.15.5:0/1846133075 >> 172.21.15.5:0/1846133075 conn(0x7fb5640b1c50 msgr2=0x7fb5640cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:19.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.084+0000 7fb56a47e700 1 -- 172.21.15.5:0/1846133075 shutdown_connections 2023-03-03T06:24:19.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.084+0000 7fb56a47e700 1 -- 172.21.15.5:0/1846133075 wait complete. 2023-03-03T06:24:19.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.085+0000 7fb56a47e700 1 Processor -- start 2023-03-03T06:24:19.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.085+0000 7fb56a47e700 1 -- start start 2023-03-03T06:24:19.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.086+0000 7fb56a47e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb56406b120 0x7fb5641ef780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.086+0000 7fb56a47e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb564071ad0 0x7fb5640b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.086+0000 7fb56a47e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb564159530 0x7fb5640c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.086+0000 7fb56a47e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b3c20 con 0x7fb564071ad0 2023-03-03T06:24:19.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.086+0000 7fb56a47e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b3f00 con 0x7fb56406b120 2023-03-03T06:24:19.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.086+0000 7fb56a47e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640b41e0 con 0x7fb564159530 2023-03-03T06:24:19.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.086+0000 7fb5637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb564071ad0 0x7fb5640b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.086+0000 7fb5637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb564071ad0 0x7fb5640b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42252/0 (socket says 172.21.15.5:42252) 2023-03-03T06:24:19.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.086+0000 7fb5637fe700 1 -- 172.21.15.5:0/321767234 learned_addr learned my addr 172.21.15.5:0/321767234 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:19.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb568a1b700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb564159530 0x7fb5640c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb563fff700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb56406b120 0x7fb5641ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb5637fe700 1 -- 172.21.15.5:0/321767234 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb564159530 msgr2=0x7fb5640c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb5637fe700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb564159530 0x7fb5640c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb5637fe700 1 -- 172.21.15.5:0/321767234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb56406b120 msgr2=0x7fb5641ef780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb5637fe700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb56406b120 0x7fb5641ef780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb5637fe700 1 -- 172.21.15.5:0/321767234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb554009550 con 0x7fb564071ad0 2023-03-03T06:24:19.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb563fff700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb56406b120 0x7fb5641ef780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:19.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb5637fe700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb564071ad0 0x7fb5640b3320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009fd0 tx=0x7fb54c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:19.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb560ff9700 1 -- 172.21.15.5:0/321767234 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0036a0 con 0x7fb564071ad0 2023-03-03T06:24:19.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb560ff9700 1 -- 172.21.15.5:0/321767234 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c01f070 con 0x7fb564071ad0 2023-03-03T06:24:19.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb56a47e700 1 -- 172.21.15.5:0/321767234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c0094a0 con 0x7fb564071ad0 2023-03-03T06:24:19.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb560ff9700 1 -- 172.21.15.5:0/321767234 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c003a60 con 0x7fb564071ad0 2023-03-03T06:24:19.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.087+0000 7fb56a47e700 1 -- 172.21.15.5:0/321767234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56406bf50 con 0x7fb564071ad0 2023-03-03T06:24:19.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.088+0000 7fb56a47e700 1 -- 172.21.15.5:0/321767234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56406bc70 con 0x7fb564071ad0 2023-03-03T06:24:19.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.088+0000 7fb560ff9700 1 -- 172.21.15.5:0/321767234 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb54c00f050 con 0x7fb564071ad0 2023-03-03T06:24:19.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.089+0000 7fb560ff9700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5440682f0 0x7fb54406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.089+0000 7fb560ff9700 1 -- 172.21.15.5:0/321767234 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb54c021070 con 0x7fb564071ad0 2023-03-03T06:24:19.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.089+0000 7fb563fff700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5440682f0 0x7fb54406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.089+0000 7fb563fff700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5440682f0 0x7fb54406a7a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb5641577d0 tx=0x7fb554008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:19.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.093+0000 7fb560ff9700 1 -- 172.21.15.5:0/321767234 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb54c053e60 con 0x7fb564071ad0 2023-03-03T06:24:19.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.286+0000 7fb56a47e700 1 -- 172.21.15.5:0/321767234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb56406c230 con 0x7fb564071ad0 2023-03-03T06:24:19.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.287+0000 7fb560ff9700 1 -- 172.21.15.5:0/321767234 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb54c057480 con 0x7fb564071ad0 2023-03-03T06:24:19.289 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:24:19.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.289+0000 7fb56a47e700 1 -- 172.21.15.5:0/321767234 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5440682f0 msgr2=0x7fb54406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.289+0000 7fb56a47e700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5440682f0 0x7fb54406a7a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb5641577d0 tx=0x7fb554008040 comp rx=0 tx=0).stop 2023-03-03T06:24:19.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.289+0000 7fb56a47e700 1 -- 172.21.15.5:0/321767234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb564071ad0 msgr2=0x7fb5640b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.289+0000 7fb56a47e700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb564071ad0 0x7fb5640b3320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009fd0 tx=0x7fb54c004750 comp rx=0 tx=0).stop 2023-03-03T06:24:19.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.289+0000 7fb56a47e700 1 -- 172.21.15.5:0/321767234 shutdown_connections 2023-03-03T06:24:19.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.289+0000 7fb56a47e700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5440682f0 0x7fb54406a7a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.289+0000 7fb56a47e700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb564159530 0x7fb5640c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.289+0000 7fb56a47e700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb56406b120 0x7fb5641ef780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.289+0000 7fb56a47e700 1 --2- 172.21.15.5:0/321767234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb564071ad0 0x7fb5640b3320 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.289+0000 7fb56a47e700 1 -- 172.21.15.5:0/321767234 >> 172.21.15.5:0/321767234 conn(0x7fb5640b1c50 msgr2=0x7fb564157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:19.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.289+0000 7fb56a47e700 1 -- 172.21.15.5:0/321767234 shutdown_connections 2023-03-03T06:24:19.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.289+0000 7fb56a47e700 1 -- 172.21.15.5:0/321767234 wait complete. 2023-03-03T06:24:19.303 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-03T06:24:19.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.428+0000 7f9cf035c700 1 Processor -- start 2023-03-03T06:24:19.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.428+0000 7f9cf035c700 1 -- start start 2023-03-03T06:24:19.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.429+0000 7f9cf035c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9ce80b8720 0x7f9ce806bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.429+0000 7f9cf035c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ce806c120 0x7f9ce806c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.429+0000 7f9cf035c700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce80d2d60 con 0x7f9ce80cd850 2023-03-03T06:24:19.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.429+0000 7f9cf035c700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce806cb00 con 0x7f9ce80b8720 2023-03-03T06:24:19.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.429+0000 7f9cf035c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce80cf400 con 0x7f9ce806c120 2023-03-03T06:24:19.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9cee8f9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ce806c120 0x7f9ce806c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9cee0f8700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9ce80b8720 0x7f9ce806bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9cee8f9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ce806c120 0x7f9ce806c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:40336/0 (socket says 172.21.15.5:40336) 2023-03-03T06:24:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9ced8f7700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f9ce80cd850 0x7f9ce8160d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:46628/0 (socket says 172.21.15.5:46628) 2023-03-03T06:24:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9cee0f8700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9ce80b8720 0x7f9ce806bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:42618/0 (socket says 172.21.15.5:42618) 2023-03-03T06:24:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9cee8f9700 1 -- 172.21.15.5:0/3178957530 learned_addr learned my addr 172.21.15.5:0/3178957530 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9cee8f9700 1 -- 172.21.15.5:0/3178957530 >> v2:172.21.15.191:3300/0 conn(0x7f9ce80b8720 msgr2=0x7f9ce806bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9cee8f9700 1 --2- 172.21.15.5:0/3178957530 >> v2:172.21.15.191:3300/0 conn(0x7f9ce80b8720 0x7f9ce806bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9cee8f9700 1 -- 172.21.15.5:0/3178957530 >> v1:172.21.15.191:6789/0 conn(0x7f9ce80cd850 legacy=0x7f9ce8160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9cee8f9700 1 -- 172.21.15.5:0/3178957530 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce80cf6e0 con 0x7f9ce806c120 2023-03-03T06:24:19.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9cee8f9700 1 --2- 172.21.15.5:0/3178957530 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ce806c120 0x7f9ce806c5c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009e50 tx=0x7f9ce000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6042a055eb4fc44 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:19.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9ced0f6700 1 -- 172.21.15.5:0/3178957530 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000e070 con 0x7f9ce806c120 2023-03-03T06:24:19.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9ced0f6700 1 -- 172.21.15.5:0/3178957530 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce000b910 con 0x7f9ce806c120 2023-03-03T06:24:19.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.430+0000 7f9ced0f6700 1 -- 172.21.15.5:0/3178957530 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000bcc0 con 0x7f9ce806c120 2023-03-03T06:24:19.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.431+0000 7f9cf035c700 1 -- 172.21.15.5:0/3178957530 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ce806c120 msgr2=0x7f9ce806c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.431+0000 7f9cf035c700 1 --2- 172.21.15.5:0/3178957530 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ce806c120 0x7f9ce806c5c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009e50 tx=0x7f9ce000b330 comp rx=0 tx=0).stop 2023-03-03T06:24:19.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.431+0000 7f9cf035c700 1 -- 172.21.15.5:0/3178957530 shutdown_connections 2023-03-03T06:24:19.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.431+0000 7f9cf035c700 1 --2- 172.21.15.5:0/3178957530 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ce806c120 0x7f9ce806c5c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.431+0000 7f9cf035c700 1 --2- 172.21.15.5:0/3178957530 >> v2:172.21.15.191:3300/0 conn(0x7f9ce80b8720 0x7f9ce806bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.431+0000 7f9cf035c700 1 -- 172.21.15.5:0/3178957530 >> 172.21.15.5:0/3178957530 conn(0x7f9ce80d0590 msgr2=0x7f9ce80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.431+0000 7f9cf035c700 1 -- 172.21.15.5:0/3178957530 shutdown_connections 2023-03-03T06:24:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.431+0000 7f9cf035c700 1 -- 172.21.15.5:0/3178957530 wait complete. 2023-03-03T06:24:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.432+0000 7f9cf035c700 1 Processor -- start 2023-03-03T06:24:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.432+0000 7f9cf035c700 1 -- start start 2023-03-03T06:24:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.433+0000 7f9cf035c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce806c120 0x7f9ce8157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.433+0000 7f9cf035c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ce80b8720 0x7f9ce815c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.433+0000 7f9cf035c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ce80cd850 0x7f9ce815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.433+0000 7f9cf035c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce81590c0 con 0x7f9ce806c120 2023-03-03T06:24:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.433+0000 7f9cf035c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce81f36d0 con 0x7f9ce80b8720 2023-03-03T06:24:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.433+0000 7f9cf035c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce81f38b0 con 0x7f9ce80cd850 2023-03-03T06:24:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.433+0000 7f9cee0f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce806c120 0x7f9ce8157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.433+0000 7f9cee0f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce806c120 0x7f9ce8157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42262/0 (socket says 172.21.15.5:42262) 2023-03-03T06:24:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.433+0000 7f9cee0f8700 1 -- 172.21.15.5:0/2933241850 learned_addr learned my addr 172.21.15.5:0/2933241850 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.433+0000 7f9ced8f7700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ce80b8720 0x7f9ce815c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.433+0000 7f9cee8f9700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ce80cd850 0x7f9ce815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.434+0000 7f9cee0f8700 1 -- 172.21.15.5:0/2933241850 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ce80cd850 msgr2=0x7f9ce815cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.434+0000 7f9cee0f8700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ce80cd850 0x7f9ce815cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.434+0000 7f9cee0f8700 1 -- 172.21.15.5:0/2933241850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ce80b8720 msgr2=0x7f9ce815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.434+0000 7f9cee0f8700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ce80b8720 0x7f9ce815c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.434+0000 7f9cee0f8700 1 -- 172.21.15.5:0/2933241850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce0009b30 con 0x7f9ce806c120 2023-03-03T06:24:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.434+0000 7f9cee0f8700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce806c120 0x7f9ce8157570 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800e9b0 tx=0x7f9cd800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:19.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.434+0000 7f9cdeffd700 1 -- 172.21.15.5:0/2933241850 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8009710 con 0x7f9ce806c120 2023-03-03T06:24:19.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.434+0000 7f9cdeffd700 1 -- 172.21.15.5:0/2933241850 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd800c850 con 0x7f9ce806c120 2023-03-03T06:24:19.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.434+0000 7f9cf035c700 1 -- 172.21.15.5:0/2933241850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce80cdcc0 con 0x7f9ce806c120 2023-03-03T06:24:19.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.434+0000 7f9cdeffd700 1 -- 172.21.15.5:0/2933241850 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd800cbc0 con 0x7f9ce806c120 2023-03-03T06:24:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.434+0000 7f9cf035c700 1 -- 172.21.15.5:0/2933241850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce80d29f0 con 0x7f9ce806c120 2023-03-03T06:24:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.435+0000 7f9cf035c700 1 -- 172.21.15.5:0/2933241850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce80b8af0 con 0x7f9ce806c120 2023-03-03T06:24:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.435+0000 7f9cdeffd700 1 -- 172.21.15.5:0/2933241850 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9cd8019030 con 0x7f9ce806c120 2023-03-03T06:24:19.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.436+0000 7f9cdeffd700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9ccc0682f0 0x7f9ccc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.436+0000 7f9cdeffd700 1 -- 172.21.15.5:0/2933241850 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9cd8086000 con 0x7f9ce806c120 2023-03-03T06:24:19.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.436+0000 7f9ced8f7700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9ccc0682f0 0x7f9ccc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.436+0000 7f9ced8f7700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9ccc0682f0 0x7f9ccc06a7a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8153fa0 tx=0x7f9ce4007d10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.440+0000 7f9cdeffd700 1 -- 172.21.15.5:0/2933241850 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9cd80524f0 con 0x7f9ce806c120 2023-03-03T06:24:19.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.637+0000 7f9cf035c700 1 -- 172.21.15.5:0/2933241850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9ce8067660 con 0x7f9ce806c120 2023-03-03T06:24:19.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.637+0000 7f9cdeffd700 1 -- 172.21.15.5:0/2933241850 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9cd80170a0 con 0x7f9ce806c120 2023-03-03T06:24:19.639 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:19.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.639+0000 7f9cf035c700 1 -- 172.21.15.5:0/2933241850 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9ccc0682f0 msgr2=0x7f9ccc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.639+0000 7f9cf035c700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9ccc0682f0 0x7f9ccc06a7a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8153fa0 tx=0x7f9ce4007d10 comp rx=0 tx=0).stop 2023-03-03T06:24:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.639+0000 7f9cf035c700 1 -- 172.21.15.5:0/2933241850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce806c120 msgr2=0x7f9ce8157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.639+0000 7f9cf035c700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce806c120 0x7f9ce8157570 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800e9b0 tx=0x7f9cd800ed70 comp rx=0 tx=0).stop 2023-03-03T06:24:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.639+0000 7f9cf035c700 1 -- 172.21.15.5:0/2933241850 shutdown_connections 2023-03-03T06:24:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.639+0000 7f9cf035c700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9ccc0682f0 0x7f9ccc06a7a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.639+0000 7f9cf035c700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ce80cd850 0x7f9ce815cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.639+0000 7f9cf035c700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ce806c120 0x7f9ce8157570 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.639+0000 7f9cf035c700 1 --2- 172.21.15.5:0/2933241850 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ce80b8720 0x7f9ce815c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.639+0000 7f9cf035c700 1 -- 172.21.15.5:0/2933241850 >> 172.21.15.5:0/2933241850 conn(0x7f9ce80d0590 msgr2=0x7f9ce806abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.639+0000 7f9cf035c700 1 -- 172.21.15.5:0/2933241850 shutdown_connections 2023-03-03T06:24:19.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.639+0000 7f9cf035c700 1 -- 172.21.15.5:0/2933241850 wait complete. 2023-03-03T06:24:19.654 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:19.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.777+0000 7f5f90026700 1 Processor -- start 2023-03-03T06:24:19.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.778+0000 7f5f90026700 1 -- start start 2023-03-03T06:24:19.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.778+0000 7f5f90026700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f880ca210 0x7f5f88160360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.778+0000 7f5f90026700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f88146100 0x7f5f8806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.778+0000 7f5f90026700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f88161290 con 0x7f5f8806dac0 2023-03-03T06:24:19.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.778+0000 7f5f90026700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8806df40 con 0x7f5f88146100 2023-03-03T06:24:19.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.778+0000 7f5f90026700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880cd520 con 0x7f5f880ca210 2023-03-03T06:24:19.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.779+0000 7f5f8d5c1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f88146100 0x7f5f8806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.779+0000 7f5f8d5c1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f88146100 0x7f5f8806d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42274/0 (socket says 172.21.15.5:42274) 2023-03-03T06:24:19.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.779+0000 7f5f8d5c1700 1 -- 172.21.15.5:0/1921851113 learned_addr learned my addr 172.21.15.5:0/1921851113 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:19.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.779+0000 7f5f8ddc2700 1 --2- 172.21.15.5:0/1921851113 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f880ca210 0x7f5f88160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.779+0000 7f5f8d5c1700 1 -- 172.21.15.5:0/1921851113 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f880ca210 msgr2=0x7f5f88160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.779+0000 7f5f8d5c1700 1 --2- 172.21.15.5:0/1921851113 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f880ca210 0x7f5f88160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.779+0000 7f5f8d5c1700 1 -- 172.21.15.5:0/1921851113 >> v1:172.21.15.191:6789/0 conn(0x7f5f8806dac0 legacy=0x7f5f880714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.779+0000 7f5f8d5c1700 1 -- 172.21.15.5:0/1921851113 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f88160cd0 con 0x7f5f88146100 2023-03-03T06:24:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.779+0000 7f5f8d5c1700 1 --2- 172.21.15.5:0/1921851113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f88146100 0x7f5f8806d580 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0098f0 tx=0x7f5f7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1019cd9ddbe5c4e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.779+0000 7f5f8cdc0700 1 -- 172.21.15.5:0/1921851113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c004230 con 0x7f5f88146100 2023-03-03T06:24:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.779+0000 7f5f8cdc0700 1 -- 172.21.15.5:0/1921851113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c004390 con 0x7f5f88146100 2023-03-03T06:24:19.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.779+0000 7f5f8cdc0700 1 -- 172.21.15.5:0/1921851113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c0036a0 con 0x7f5f88146100 2023-03-03T06:24:19.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.780+0000 7f5f90026700 1 -- 172.21.15.5:0/1921851113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f88146100 msgr2=0x7f5f8806d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.780+0000 7f5f90026700 1 --2- 172.21.15.5:0/1921851113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f88146100 0x7f5f8806d580 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0098f0 tx=0x7f5f7c009c00 comp rx=0 tx=0).stop 2023-03-03T06:24:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.780+0000 7f5f90026700 1 -- 172.21.15.5:0/1921851113 shutdown_connections 2023-03-03T06:24:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.780+0000 7f5f90026700 1 --2- 172.21.15.5:0/1921851113 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f880ca210 0x7f5f88160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.780+0000 7f5f90026700 1 --2- 172.21.15.5:0/1921851113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f88146100 0x7f5f8806d580 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.780+0000 7f5f90026700 1 -- 172.21.15.5:0/1921851113 >> 172.21.15.5:0/1921851113 conn(0x7f5f880cf4b0 msgr2=0x7f5f880cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.780+0000 7f5f90026700 1 -- 172.21.15.5:0/1921851113 shutdown_connections 2023-03-03T06:24:19.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.780+0000 7f5f90026700 1 -- 172.21.15.5:0/1921851113 wait complete. 2023-03-03T06:24:19.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.781+0000 7f5f90026700 1 Processor -- start 2023-03-03T06:24:19.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.781+0000 7f5f90026700 1 -- start start 2023-03-03T06:24:19.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f90026700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f8806dac0 0x7f5f88157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f90026700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f880ca210 0x7f5f88158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f90026700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f88146100 0x7f5f880c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f90026700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880c6b40 con 0x7f5f880ca210 2023-03-03T06:24:19.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f90026700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880b1e80 con 0x7f5f8806dac0 2023-03-03T06:24:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f90026700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880b19f0 con 0x7f5f88146100 2023-03-03T06:24:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f8d5c1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f880ca210 0x7f5f88158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f8d5c1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f880ca210 0x7f5f88158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42278/0 (socket says 172.21.15.5:42278) 2023-03-03T06:24:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f8d5c1700 1 -- 172.21.15.5:0/4113754637 learned_addr learned my addr 172.21.15.5:0/4113754637 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f8e5c3700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f88146100 0x7f5f880c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f8ddc2700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f8806dac0 0x7f5f88157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f8d5c1700 1 -- 172.21.15.5:0/4113754637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f88146100 msgr2=0x7f5f880c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f8d5c1700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f88146100 0x7f5f880c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f8d5c1700 1 -- 172.21.15.5:0/4113754637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f8806dac0 msgr2=0x7f5f88157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f8d5c1700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f8806dac0 0x7f5f88157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f8d5c1700 1 -- 172.21.15.5:0/4113754637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c009550 con 0x7f5f880ca210 2023-03-03T06:24:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.782+0000 7f5f8d5c1700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f880ca210 0x7f5f88158060 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c004000 tx=0x7f5f7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.783+0000 7f5f7a7fc700 1 -- 172.21.15.5:0/4113754637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c003e90 con 0x7f5f880ca210 2023-03-03T06:24:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.783+0000 7f5f7a7fc700 1 -- 172.21.15.5:0/4113754637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c00b660 con 0x7f5f880ca210 2023-03-03T06:24:19.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.783+0000 7f5f7a7fc700 1 -- 172.21.15.5:0/4113754637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c00ba10 con 0x7f5f880ca210 2023-03-03T06:24:19.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.783+0000 7f5f90026700 1 -- 172.21.15.5:0/4113754637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f880cd1b0 con 0x7f5f880ca210 2023-03-03T06:24:19.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.783+0000 7f5f90026700 1 -- 172.21.15.5:0/4113754637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f88160fb0 con 0x7f5f880ca210 2023-03-03T06:24:19.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.784+0000 7f5f90026700 1 -- 172.21.15.5:0/4113754637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f880ca5e0 con 0x7f5f880ca210 2023-03-03T06:24:19.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.784+0000 7f5f7a7fc700 1 -- 172.21.15.5:0/4113754637 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5f7c017020 con 0x7f5f880ca210 2023-03-03T06:24:19.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.784+0000 7f5f7a7fc700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f6c0682f0 0x7f5f6c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:19.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.785+0000 7f5f7a7fc700 1 -- 172.21.15.5:0/4113754637 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5f7c087a20 con 0x7f5f880ca210 2023-03-03T06:24:19.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.785+0000 7f5f8ddc2700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f6c0682f0 0x7f5f6c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:19.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.785+0000 7f5f8ddc2700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f6c0682f0 0x7f5f6c06a7a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f881f5c40 tx=0x7f5f84008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:19.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.789+0000 7f5f7a7fc700 1 -- 172.21.15.5:0/4113754637 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5f7c053f90 con 0x7f5f880ca210 2023-03-03T06:24:19.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.986+0000 7f5f90026700 1 -- 172.21.15.5:0/4113754637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f8804e6e0 con 0x7f5f880ca210 2023-03-03T06:24:19.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.987+0000 7f5f7a7fc700 1 -- 172.21.15.5:0/4113754637 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7f5f7c0575b0 con 0x7f5f880ca210 2023-03-03T06:24:19.989 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:19.990 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:19.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.989+0000 7f5f90026700 1 -- 172.21.15.5:0/4113754637 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f6c0682f0 msgr2=0x7f5f6c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.989+0000 7f5f90026700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f6c0682f0 0x7f5f6c06a7a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5f881f5c40 tx=0x7f5f84008040 comp rx=0 tx=0).stop 2023-03-03T06:24:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.989+0000 7f5f90026700 1 -- 172.21.15.5:0/4113754637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f880ca210 msgr2=0x7f5f88158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.989+0000 7f5f90026700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f880ca210 0x7f5f88158060 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c004000 tx=0x7f5f7c004750 comp rx=0 tx=0).stop 2023-03-03T06:24:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.989+0000 7f5f90026700 1 -- 172.21.15.5:0/4113754637 shutdown_connections 2023-03-03T06:24:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.989+0000 7f5f90026700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f6c0682f0 0x7f5f6c06a7a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.989+0000 7f5f90026700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f88146100 0x7f5f880c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.989+0000 7f5f90026700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f8806dac0 0x7f5f88157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.989+0000 7f5f90026700 1 --2- 172.21.15.5:0/4113754637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f880ca210 0x7f5f88158060 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.989+0000 7f5f90026700 1 -- 172.21.15.5:0/4113754637 >> 172.21.15.5:0/4113754637 conn(0x7f5f880cf4b0 msgr2=0x7f5f880cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.990+0000 7f5f90026700 1 -- 172.21.15.5:0/4113754637 shutdown_connections 2023-03-03T06:24:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:19.990+0000 7f5f90026700 1 -- 172.21.15.5:0/4113754637 wait complete. 2023-03-03T06:24:20.004 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:23:38.141777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:23:39.283589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-03T06:23:42.422930+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-03T06:24:20.005 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:24:20.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.130+0000 7f62aa913700 1 Processor -- start 2023-03-03T06:24:20.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.130+0000 7f62aa913700 1 -- start start 2023-03-03T06:24:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.131+0000 7f62aa913700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f62a4158e00 0x7f62a4070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.131+0000 7f62aa913700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a40c97c0 con 0x7f62a4158a30 2023-03-03T06:24:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.131+0000 7f62aa913700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a415d750 con 0x7f62a4071170 2023-03-03T06:24:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.131+0000 7f62aa913700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a40715f0 con 0x7f62a4158e00 2023-03-03T06:24:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.131+0000 7f62a3fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f62a4158a30 0x7f62a40ca4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60358/0 (socket says 172.21.15.5:60358) 2023-03-03T06:24:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.131+0000 7f62a3fff700 1 -- 172.21.15.5:0/3747598260 learned_addr learned my addr 172.21.15.5:0/3747598260 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a37fe700 1 --2- 172.21.15.5:0/3747598260 >> v2:172.21.15.191:3300/0 conn(0x7f62a4158e00 0x7f62a4070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392764941 0 0) 0x7f62a40c97c0 con 0x7f62a4158a30 2023-03-03T06:24:20.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62900035b0 con 0x7f62a4158a30 2023-03-03T06:24:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4129538039 0 0) 0x7f62900035b0 con 0x7f62a4158a30 2023-03-03T06:24:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 >> v2:172.21.15.191:3300/0 conn(0x7f62a4158e00 msgr2=0x7f62a4070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 --2- 172.21.15.5:0/3747598260 >> v2:172.21.15.191:3300/0 conn(0x7f62a4158e00 0x7f62a4070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 >> v1:172.21.15.191:6789/0 conn(0x7f62a4071170 legacy=0x7f62a406a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a40cabe0 con 0x7f62a4158a30 2023-03-03T06:24:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f628c001670 con 0x7f62a4158a30 2023-03-03T06:24:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 >> v1:172.21.15.5:6789/0 conn(0x7f62a4158a30 legacy=0x7f62a40ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 --2- 172.21.15.5:0/3747598260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6290003a00 0x7f6290003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 --2- 172.21.15.5:0/3747598260 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6290004850 0x7f6290004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 --2- 172.21.15.5:0/3747598260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6290005200 0x7f629000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40715f0 con 0x7f6290003a00 2023-03-03T06:24:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629000c080 con 0x7f6290005200 2023-03-03T06:24:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629000c240 con 0x7f6290004850 2023-03-03T06:24:20.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a3fff700 1 --2- 172.21.15.5:0/3747598260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6290003a00 0x7f6290003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a37fe700 1 --2- 172.21.15.5:0/3747598260 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6290004850 0x7f6290004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a8eb0700 1 --2- 172.21.15.5:0/3747598260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6290005200 0x7f629000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a3fff700 1 -- 172.21.15.5:0/3747598260 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6290004850 msgr2=0x7f6290004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a3fff700 1 --2- 172.21.15.5:0/3747598260 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6290004850 0x7f6290004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a3fff700 1 -- 172.21.15.5:0/3747598260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6290005200 msgr2=0x7f629000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a3fff700 1 --2- 172.21.15.5:0/3747598260 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6290005200 0x7f629000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a8eb0700 1 -- 172.21.15.5:0/3747598260 reap_dead start 2023-03-03T06:24:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a3fff700 1 -- 172.21.15.5:0/3747598260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900035b0 con 0x7f6290003a00 2023-03-03T06:24:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.132+0000 7f62a3fff700 1 --2- 172.21.15.5:0/3747598260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6290003a00 0x7f6290003e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c240 tx=0x7f6290005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e108c04086fdbd4 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.133+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c007c10 con 0x7f6290003a00 2023-03-03T06:24:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.133+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c00cde0 con 0x7f6290003a00 2023-03-03T06:24:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.133+0000 7f62a2ffd700 1 -- 172.21.15.5:0/3747598260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c005ba0 con 0x7f6290003a00 2023-03-03T06:24:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.133+0000 7f62aa913700 1 -- 172.21.15.5:0/3747598260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6290003a00 msgr2=0x7f6290003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.133+0000 7f62aa913700 1 --2- 172.21.15.5:0/3747598260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6290003a00 0x7f6290003e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c240 tx=0x7f6290005880 comp rx=0 tx=0).stop 2023-03-03T06:24:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.133+0000 7f62aa913700 1 -- 172.21.15.5:0/3747598260 shutdown_connections 2023-03-03T06:24:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.133+0000 7f62aa913700 1 --2- 172.21.15.5:0/3747598260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6290003a00 0x7f6290003e10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.133+0000 7f62aa913700 1 -- 172.21.15.5:0/3747598260 >> 172.21.15.5:0/3747598260 conn(0x7f62a40b1410 msgr2=0x7f62a40cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:20.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.133+0000 7f62aa913700 1 -- 172.21.15.5:0/3747598260 shutdown_connections 2023-03-03T06:24:20.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.133+0000 7f62aa913700 1 -- 172.21.15.5:0/3747598260 wait complete. 2023-03-03T06:24:20.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.134+0000 7f62aa913700 1 Processor -- start 2023-03-03T06:24:20.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.135+0000 7f62aa913700 1 -- start start 2023-03-03T06:24:20.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.135+0000 7f62aa913700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6290003a00 0x7f62a4151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.135+0000 7f62aa913700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62a40c3f90 0x7f62a40b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.135+0000 7f62aa913700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a40ac780 0x7f62a40acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.135+0000 7f62aa913700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40ad130 con 0x7f62a40ac780 2023-03-03T06:24:20.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.135+0000 7f62aa913700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a41518d0 con 0x7f62a40c3f90 2023-03-03T06:24:20.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.135+0000 7f62aa913700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a40c4500 con 0x7f6290003a00 2023-03-03T06:24:20.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a8eb0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a40ac780 0x7f62a40acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a8eb0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a40ac780 0x7f62a40acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42300/0 (socket says 172.21.15.5:42300) 2023-03-03T06:24:20.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a8eb0700 1 -- 172.21.15.5:0/2943697726 learned_addr learned my addr 172.21.15.5:0/2943697726 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:20.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a3fff700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6290003a00 0x7f62a4151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a37fe700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62a40c3f90 0x7f62a40b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a8eb0700 1 -- 172.21.15.5:0/2943697726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6290003a00 msgr2=0x7f62a4151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a8eb0700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6290003a00 0x7f62a4151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a8eb0700 1 -- 172.21.15.5:0/2943697726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62a40c3f90 msgr2=0x7f62a40b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a8eb0700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62a40c3f90 0x7f62a40b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a8eb0700 1 -- 172.21.15.5:0/2943697726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a40c99f0 con 0x7f62a40ac780 2023-03-03T06:24:20.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a37fe700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62a40c3f90 0x7f62a40b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:20.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a8eb0700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a40ac780 0x7f62a40acbf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f62a40b4d40 tx=0x7f629c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a0ff9700 1 -- 172.21.15.5:0/2943697726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c003c10 con 0x7f62a40ac780 2023-03-03T06:24:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a0ff9700 1 -- 172.21.15.5:0/2943697726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c003d90 con 0x7f62a40ac780 2023-03-03T06:24:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62aa913700 1 -- 172.21.15.5:0/2943697726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a415d470 con 0x7f62a40ac780 2023-03-03T06:24:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62a0ff9700 1 -- 172.21.15.5:0/2943697726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c005310 con 0x7f62a40ac780 2023-03-03T06:24:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.136+0000 7f62aa913700 1 -- 172.21.15.5:0/2943697726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a40c9cd0 con 0x7f62a40ac780 2023-03-03T06:24:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.137+0000 7f62aa913700 1 -- 172.21.15.5:0/2943697726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a404e6e0 con 0x7f62a40ac780 2023-03-03T06:24:20.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.138+0000 7f62a0ff9700 1 -- 172.21.15.5:0/2943697726 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f629c005470 con 0x7f62a40ac780 2023-03-03T06:24:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.138+0000 7f62a0ff9700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6284068320 0x7f628406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.138+0000 7f62a0ff9700 1 -- 172.21.15.5:0/2943697726 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f629c0860f0 con 0x7f62a40ac780 2023-03-03T06:24:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.138+0000 7f62a3fff700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6284068320 0x7f628406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.138+0000 7f62a3fff700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6284068320 0x7f628406a7d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f628c000c00 tx=0x7f628c007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:20.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.142+0000 7f62a0ff9700 1 -- 172.21.15.5:0/2943697726 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f629c0525d0 con 0x7f62a40ac780 2023-03-03T06:24:20.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.334+0000 7f62aa913700 1 -- 172.21.15.5:0/2943697726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f62a40c9f10 con 0x7f62a40ac780 2023-03-03T06:24:20.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.335+0000 7f62a0ff9700 1 -- 172.21.15.5:0/2943697726 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f629c055bf0 con 0x7f62a40ac780 2023-03-03T06:24:20.337 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:24:20.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.337+0000 7f62aa913700 1 -- 172.21.15.5:0/2943697726 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6284068320 msgr2=0x7f628406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.337+0000 7f62aa913700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6284068320 0x7f628406a7d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f628c000c00 tx=0x7f628c007000 comp rx=0 tx=0).stop 2023-03-03T06:24:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.337+0000 7f62aa913700 1 -- 172.21.15.5:0/2943697726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a40ac780 msgr2=0x7f62a40acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.337+0000 7f62aa913700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a40ac780 0x7f62a40acbf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f62a40b4d40 tx=0x7f629c00ee00 comp rx=0 tx=0).stop 2023-03-03T06:24:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.337+0000 7f62aa913700 1 -- 172.21.15.5:0/2943697726 shutdown_connections 2023-03-03T06:24:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.337+0000 7f62aa913700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62a40ac780 0x7f62a40acbf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.337+0000 7f62aa913700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6284068320 0x7f628406a7d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.337+0000 7f62aa913700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6290003a00 0x7f62a4151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.337+0000 7f62aa913700 1 --2- 172.21.15.5:0/2943697726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62a40c3f90 0x7f62a40b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.337+0000 7f62aa913700 1 -- 172.21.15.5:0/2943697726 >> 172.21.15.5:0/2943697726 conn(0x7f62a40b1410 msgr2=0x7f62a41521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.337+0000 7f62aa913700 1 -- 172.21.15.5:0/2943697726 shutdown_connections 2023-03-03T06:24:20.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.337+0000 7f62aa913700 1 -- 172.21.15.5:0/2943697726 wait complete. 2023-03-03T06:24:20.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:24:20.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.479+0000 7fc75f01f700 1 Processor -- start 2023-03-03T06:24:20.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.479+0000 7fc75f01f700 1 -- start start 2023-03-03T06:24:20.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc75f01f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7580b1fe0 0x7fc75815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc75f01f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7580cc5d0 con 0x7fc7580b55b0 2023-03-03T06:24:20.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc75f01f700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc758159c30 con 0x7fc7580cd500 2023-03-03T06:24:20.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc75f01f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75815e290 con 0x7fc7580b1fe0 2023-03-03T06:24:20.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc75cdbb700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc7580b55b0 0x7fc7580b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60378/0 (socket says 172.21.15.5:60378) 2023-03-03T06:24:20.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc75cdbb700 1 -- 172.21.15.5:0/3648592465 learned_addr learned my addr 172.21.15.5:0/3648592465 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:20.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc75d5bc700 1 --2- 172.21.15.5:0/3648592465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7580b1fe0 0x7fc75815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401266714 0 0) 0x7fc7580cc5d0 con 0x7fc7580b55b0 2023-03-03T06:24:20.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7480035b0 con 0x7fc7580b55b0 2023-03-03T06:24:20.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2309303596 0 0) 0x7fc7480035b0 con 0x7fc7580b55b0 2023-03-03T06:24:20.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7580b1fe0 msgr2=0x7fc75815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:20.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc7577fe700 1 --2- 172.21.15.5:0/3648592465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7580b1fe0 0x7fc75815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 >> v1:172.21.15.191:6789/0 conn(0x7fc7580cd500 legacy=0x7fc7580cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7580b5980 con 0x7fc7580b55b0 2023-03-03T06:24:20.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fc74c001670 con 0x7fc7580b55b0 2023-03-03T06:24:20.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 >> v1:172.21.15.5:6789/0 conn(0x7fc7580b55b0 legacy=0x7fc7580b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc7577fe700 1 --2- 172.21.15.5:0/3648592465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc748003a30 0x7fc748003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc7577fe700 1 --2- 172.21.15.5:0/3648592465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc748004850 0x7fc748004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.480+0000 7fc7577fe700 1 --2- 172.21.15.5:0/3648592465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7580b1fe0 0x7fc748005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74800bac0 con 0x7fc748003a30 2023-03-03T06:24:20.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74800bc00 con 0x7fc748004850 2023-03-03T06:24:20.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74800bd90 con 0x7fc7580b1fe0 2023-03-03T06:24:20.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc75cdbb700 1 --2- 172.21.15.5:0/3648592465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc748003a30 0x7fc748003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc75d5bc700 1 --2- 172.21.15.5:0/3648592465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7580b1fe0 0x7fc748005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc757fff700 1 --2- 172.21.15.5:0/3648592465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc748004850 0x7fc748004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc75cdbb700 1 -- 172.21.15.5:0/3648592465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7580b1fe0 msgr2=0x7fc748005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:20.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc75cdbb700 1 --2- 172.21.15.5:0/3648592465 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc7580b1fe0 0x7fc748005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc75cdbb700 1 -- 172.21.15.5:0/3648592465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc748004850 msgr2=0x7fc748004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:20.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc75cdbb700 1 --2- 172.21.15.5:0/3648592465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc748004850 0x7fc748004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc75cdbb700 1 -- 172.21.15.5:0/3648592465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480035b0 con 0x7fc748003a30 2023-03-03T06:24:20.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc757fff700 1 --2- 172.21.15.5:0/3648592465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc748004850 0x7fc748004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:20.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc75cdbb700 1 --2- 172.21.15.5:0/3648592465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc748003a30 0x7fc748003e40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00c240 tx=0x7fc748005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8017e19d3f5cdd51 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:20.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c007c10 con 0x7fc748003a30 2023-03-03T06:24:20.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c00cde0 con 0x7fc748003a30 2023-03-03T06:24:20.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.481+0000 7fc7577fe700 1 -- 172.21.15.5:0/3648592465 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c005ba0 con 0x7fc748003a30 2023-03-03T06:24:20.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.482+0000 7fc75f01f700 1 -- 172.21.15.5:0/3648592465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc748003a30 msgr2=0x7fc748003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.482+0000 7fc75f01f700 1 --2- 172.21.15.5:0/3648592465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc748003a30 0x7fc748003e40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00c240 tx=0x7fc748005880 comp rx=0 tx=0).stop 2023-03-03T06:24:20.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.482+0000 7fc75d5bc700 1 -- 172.21.15.5:0/3648592465 reap_dead start 2023-03-03T06:24:20.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.482+0000 7fc75f01f700 1 -- 172.21.15.5:0/3648592465 shutdown_connections 2023-03-03T06:24:20.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.482+0000 7fc75f01f700 1 -- 172.21.15.5:0/3648592465 >> 172.21.15.5:0/3648592465 conn(0x7fc7580cc8d0 msgr2=0x7fc7580cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:20.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.482+0000 7fc75f01f700 1 -- 172.21.15.5:0/3648592465 shutdown_connections 2023-03-03T06:24:20.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.482+0000 7fc75f01f700 1 -- 172.21.15.5:0/3648592465 wait complete. 2023-03-03T06:24:20.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.483+0000 7fc75f01f700 1 Processor -- start 2023-03-03T06:24:20.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.483+0000 7fc75f01f700 1 -- start start 2023-03-03T06:24:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75f01f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc748003a30 0x7fc7580c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75f01f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc758152c80 0x7fc7581421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75f01f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7581426f0 0x7fc75814eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75f01f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580c98f0 con 0x7fc748003a30 2023-03-03T06:24:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75f01f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758142b90 con 0x7fc7581426f0 2023-03-03T06:24:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75f01f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580c8850 con 0x7fc758152c80 2023-03-03T06:24:20.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75cdbb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc748003a30 0x7fc7580c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75cdbb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc748003a30 0x7fc7580c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42316/0 (socket says 172.21.15.5:42316) 2023-03-03T06:24:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75cdbb700 1 -- 172.21.15.5:0/1734908087 learned_addr learned my addr 172.21.15.5:0/1734908087 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc757fff700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc758152c80 0x7fc7581421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75d5bc700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7581426f0 0x7fc75814eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75cdbb700 1 -- 172.21.15.5:0/1734908087 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc758152c80 msgr2=0x7fc7581421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75cdbb700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc758152c80 0x7fc7581421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75cdbb700 1 -- 172.21.15.5:0/1734908087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7581426f0 msgr2=0x7fc75814eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75cdbb700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7581426f0 0x7fc75814eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75cdbb700 1 -- 172.21.15.5:0/1734908087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7580cbca0 con 0x7fc748003a30 2023-03-03T06:24:20.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.484+0000 7fc75cdbb700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc748003a30 0x7fc7580c7f70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc7480047a0 tx=0x7fc74c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:20.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.485+0000 7fc7557fa700 1 -- 172.21.15.5:0/1734908087 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c001640 con 0x7fc748003a30 2023-03-03T06:24:20.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.485+0000 7fc7557fa700 1 -- 172.21.15.5:0/1734908087 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c0070d0 con 0x7fc748003a30 2023-03-03T06:24:20.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.485+0000 7fc7557fa700 1 -- 172.21.15.5:0/1734908087 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0074a0 con 0x7fc748003a30 2023-03-03T06:24:20.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.485+0000 7fc75f01f700 1 -- 172.21.15.5:0/1734908087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7580cb9c0 con 0x7fc748003a30 2023-03-03T06:24:20.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.485+0000 7fc75f01f700 1 -- 172.21.15.5:0/1734908087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7580cbf80 con 0x7fc748003a30 2023-03-03T06:24:20.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.486+0000 7fc75f01f700 1 -- 172.21.15.5:0/1734908087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75804e6e0 con 0x7fc748003a30 2023-03-03T06:24:20.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.486+0000 7fc7557fa700 1 -- 172.21.15.5:0/1734908087 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc74c010070 con 0x7fc748003a30 2023-03-03T06:24:20.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.486+0000 7fc7557fa700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc73c0682f0 0x7fc73c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.487+0000 7fc7557fa700 1 -- 172.21.15.5:0/1734908087 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc74c086eb0 con 0x7fc748003a30 2023-03-03T06:24:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.487+0000 7fc757fff700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc73c0682f0 0x7fc73c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.487+0000 7fc757fff700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc73c0682f0 0x7fc73c06a7a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc75815a4f0 tx=0x7fc744009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:20.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.491+0000 7fc7557fa700 1 -- 172.21.15.5:0/1734908087 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc74c053450 con 0x7fc748003a30 2023-03-03T06:24:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.683+0000 7fc75f01f700 1 -- 172.21.15.5:0/1734908087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7580cf8b0 con 0x7fc748003a30 2023-03-03T06:24:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.684+0000 7fc7557fa700 1 -- 172.21.15.5:0/1734908087 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc74c0170a0 con 0x7fc748003a30 2023-03-03T06:24:20.687 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:24:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.685+0000 7fc75f01f700 1 -- 172.21.15.5:0/1734908087 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc73c0682f0 msgr2=0x7fc73c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.685+0000 7fc75f01f700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc73c0682f0 0x7fc73c06a7a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc75815a4f0 tx=0x7fc744009040 comp rx=0 tx=0).stop 2023-03-03T06:24:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.685+0000 7fc75f01f700 1 -- 172.21.15.5:0/1734908087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc748003a30 msgr2=0x7fc7580c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.685+0000 7fc75f01f700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc748003a30 0x7fc7580c7f70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc7480047a0 tx=0x7fc74c001a00 comp rx=0 tx=0).stop 2023-03-03T06:24:20.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.685+0000 7fc75f01f700 1 -- 172.21.15.5:0/1734908087 shutdown_connections 2023-03-03T06:24:20.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.685+0000 7fc75f01f700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7581426f0 0x7fc75814eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.685+0000 7fc75f01f700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc748003a30 0x7fc7580c7f70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.685+0000 7fc75f01f700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc73c0682f0 0x7fc73c06a7a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.685+0000 7fc75f01f700 1 --2- 172.21.15.5:0/1734908087 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc758152c80 0x7fc7581421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.685+0000 7fc75f01f700 1 -- 172.21.15.5:0/1734908087 >> 172.21.15.5:0/1734908087 conn(0x7fc7580cc8d0 msgr2=0x7fc75806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:20.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.686+0000 7fc75f01f700 1 -- 172.21.15.5:0/1734908087 shutdown_connections 2023-03-03T06:24:20.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.686+0000 7fc75f01f700 1 -- 172.21.15.5:0/1734908087 wait complete. 2023-03-03T06:24:20.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:24:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.826+0000 7fe891547700 1 Processor -- start 2023-03-03T06:24:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.826+0000 7fe891547700 1 -- start start 2023-03-03T06:24:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.827+0000 7fe891547700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe88c0b8720 0x7fe88c06bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.827+0000 7fe891547700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe88c06c120 0x7fe88c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.827+0000 7fe891547700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88c0d2d60 con 0x7fe88c0cd850 2023-03-03T06:24:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.827+0000 7fe891547700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88c06cae0 con 0x7fe88c06c120 2023-03-03T06:24:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.827+0000 7fe891547700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0cf400 con 0x7fe88c0b8720 2023-03-03T06:24:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.827+0000 7fe88b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe88c06c120 0x7fe88c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.827+0000 7fe88a7fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe88c0cd850 0x7fe88c160d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60396/0 (socket says 172.21.15.5:60396) 2023-03-03T06:24:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.827+0000 7fe88a7fc700 1 -- 172.21.15.5:0/1367811377 learned_addr learned my addr 172.21.15.5:0/1367811377 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.827+0000 7fe88b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe88c06c120 0x7fe88c06c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42324/0 (socket says 172.21.15.5:42324) 2023-03-03T06:24:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.827+0000 7fe88affd700 1 --2- 172.21.15.5:0/1367811377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe88c0b8720 0x7fe88c06bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.827+0000 7fe88b7fe700 1 -- 172.21.15.5:0/1367811377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe88c0b8720 msgr2=0x7fe88c06bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.827+0000 7fe88b7fe700 1 --2- 172.21.15.5:0/1367811377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe88c0b8720 0x7fe88c06bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.827+0000 7fe88b7fe700 1 -- 172.21.15.5:0/1367811377 >> v1:172.21.15.5:6789/0 conn(0x7fe88c0cd850 legacy=0x7fe88c160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe88b7fe700 1 -- 172.21.15.5:0/1367811377 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c0cf6e0 con 0x7fe88c06c120 2023-03-03T06:24:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe889ffb700 1 -- 172.21.15.5:0/1367811377 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992563577 0 0) 0x7fe88c0d2d60 con 0x7fe88c0cd850 2023-03-03T06:24:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe88affd700 1 --2- 172.21.15.5:0/1367811377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe88c0b8720 0x7fe88c06bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:20.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe88b7fe700 1 --2- 172.21.15.5:0/1367811377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe88c06c120 0x7fe88c06c5a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe884009d90 tx=0x7fe88400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368533d2ec06af37 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe889ffb700 1 -- 172.21.15.5:0/1367811377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400e070 con 0x7fe88c06c120 2023-03-03T06:24:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe889ffb700 1 -- 172.21.15.5:0/1367811377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88400bbd0 con 0x7fe88c06c120 2023-03-03T06:24:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe889ffb700 1 -- 172.21.15.5:0/1367811377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884012430 con 0x7fe88c06c120 2023-03-03T06:24:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe891547700 1 -- 172.21.15.5:0/1367811377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe88c06c120 msgr2=0x7fe88c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe891547700 1 --2- 172.21.15.5:0/1367811377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe88c06c120 0x7fe88c06c5a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe884009d90 tx=0x7fe88400b330 comp rx=0 tx=0).stop 2023-03-03T06:24:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe891547700 1 -- 172.21.15.5:0/1367811377 shutdown_connections 2023-03-03T06:24:20.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe891547700 1 --2- 172.21.15.5:0/1367811377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe88c06c120 0x7fe88c06c5a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe891547700 1 --2- 172.21.15.5:0/1367811377 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe88c0b8720 0x7fe88c06bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe891547700 1 -- 172.21.15.5:0/1367811377 >> 172.21.15.5:0/1367811377 conn(0x7fe88c0d0590 msgr2=0x7fe88c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe891547700 1 -- 172.21.15.5:0/1367811377 shutdown_connections 2023-03-03T06:24:20.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.828+0000 7fe891547700 1 -- 172.21.15.5:0/1367811377 wait complete. 2023-03-03T06:24:20.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.830+0000 7fe891547700 1 Processor -- start 2023-03-03T06:24:20.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.830+0000 7fe891547700 1 -- start start 2023-03-03T06:24:20.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.831+0000 7fe891547700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe88c06c120 0x7fe88c0cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.831+0000 7fe891547700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe88c0b8720 0x7fe88c0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.831+0000 7fe891547700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe88c0cd850 0x7fe88c15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.831+0000 7fe891547700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0cbf70 con 0x7fe88c06c120 2023-03-03T06:24:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.831+0000 7fe891547700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0cc250 con 0x7fe88c0b8720 2023-03-03T06:24:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.831+0000 7fe891547700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0cc530 con 0x7fe88c0cd850 2023-03-03T06:24:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.831+0000 7fe88affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe88c06c120 0x7fe88c0cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.831+0000 7fe88affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe88c06c120 0x7fe88c0cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42326/0 (socket says 172.21.15.5:42326) 2023-03-03T06:24:20.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.831+0000 7fe88affd700 1 -- 172.21.15.5:0/1474215596 learned_addr learned my addr 172.21.15.5:0/1474215596 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:20.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe88a7fc700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe88c0b8720 0x7fe88c0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe88b7fe700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe88c0cd850 0x7fe88c15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe88affd700 1 -- 172.21.15.5:0/1474215596 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe88c0cd850 msgr2=0x7fe88c15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe88affd700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe88c0cd850 0x7fe88c15a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe88affd700 1 -- 172.21.15.5:0/1474215596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe88c0b8720 msgr2=0x7fe88c0c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:20.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe88affd700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe88c0b8720 0x7fe88c0c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:20.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe88affd700 1 -- 172.21.15.5:0/1474215596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe884009a70 con 0x7fe88c06c120 2023-03-03T06:24:20.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe88b7fe700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe88c0cd850 0x7fe88c15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:20.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe88a7fc700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe88c0b8720 0x7fe88c0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:20.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe88affd700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe88c06c120 0x7fe88c0cb620 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c7f0 tx=0x7fe88000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:20.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe8737fe700 1 -- 172.21.15.5:0/1474215596 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880011800 con 0x7fe88c06c120 2023-03-03T06:24:20.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe8737fe700 1 -- 172.21.15.5:0/1474215596 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe880011960 con 0x7fe88c06c120 2023-03-03T06:24:20.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe891547700 1 -- 172.21.15.5:0/1474215596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88c0cdcc0 con 0x7fe88c06c120 2023-03-03T06:24:20.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe8737fe700 1 -- 172.21.15.5:0/1474215596 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880011d10 con 0x7fe88c06c120 2023-03-03T06:24:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.832+0000 7fe891547700 1 -- 172.21.15.5:0/1474215596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88c0d29f0 con 0x7fe88c06c120 2023-03-03T06:24:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.833+0000 7fe891547700 1 -- 172.21.15.5:0/1474215596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88c0b8af0 con 0x7fe88c06c120 2023-03-03T06:24:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.834+0000 7fe8737fe700 1 -- 172.21.15.5:0/1474215596 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe880021070 con 0x7fe88c06c120 2023-03-03T06:24:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.834+0000 7fe8737fe700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe8780682f0 0x7fe87806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.834+0000 7fe8737fe700 1 -- 172.21.15.5:0/1474215596 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe880085e00 con 0x7fe88c06c120 2023-03-03T06:24:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.834+0000 7fe88a7fc700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe8780682f0 0x7fe87806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:20.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.834+0000 7fe88a7fc700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe8780682f0 0x7fe87806a7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe87c000f60 tx=0x7fe87c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:20.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:20.838+0000 7fe8737fe700 1 -- 172.21.15.5:0/1474215596 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe880052370 con 0x7fe88c06c120 2023-03-03T06:24:21.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.030+0000 7fe891547700 1 -- 172.21.15.5:0/1474215596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe88c04e6e0 con 0x7fe88c06c120 2023-03-03T06:24:21.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.030+0000 7fe8737fe700 1 -- 172.21.15.5:0/1474215596 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe880055990 con 0x7fe88c06c120 2023-03-03T06:24:21.033 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:21.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.032+0000 7fe891547700 1 -- 172.21.15.5:0/1474215596 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe8780682f0 msgr2=0x7fe87806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.032+0000 7fe891547700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe8780682f0 0x7fe87806a7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe87c000f60 tx=0x7fe87c009040 comp rx=0 tx=0).stop 2023-03-03T06:24:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.032+0000 7fe891547700 1 -- 172.21.15.5:0/1474215596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe88c06c120 msgr2=0x7fe88c0cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.032+0000 7fe891547700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe88c06c120 0x7fe88c0cb620 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c7f0 tx=0x7fe88000cbb0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.032+0000 7fe891547700 1 -- 172.21.15.5:0/1474215596 shutdown_connections 2023-03-03T06:24:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.032+0000 7fe891547700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe8780682f0 0x7fe87806a7a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.032+0000 7fe891547700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe88c0cd850 0x7fe88c15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.032+0000 7fe891547700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe88c06c120 0x7fe88c0cb620 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.032+0000 7fe891547700 1 --2- 172.21.15.5:0/1474215596 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe88c0b8720 0x7fe88c0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.032+0000 7fe891547700 1 -- 172.21.15.5:0/1474215596 >> 172.21.15.5:0/1474215596 conn(0x7fe88c0d0590 msgr2=0x7fe88c0b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:21.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.032+0000 7fe891547700 1 -- 172.21.15.5:0/1474215596 shutdown_connections 2023-03-03T06:24:21.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.032+0000 7fe891547700 1 -- 172.21.15.5:0/1474215596 wait complete. 2023-03-03T06:24:21.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:24:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.172+0000 7f892af2c700 1 Processor -- start 2023-03-03T06:24:21.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.172+0000 7f892af2c700 1 -- start start 2023-03-03T06:24:21.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.173+0000 7f892af2c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f892406e310 0x7f89240cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.173+0000 7f892af2c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89240cf010 0x7f89240cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.173+0000 7f892af2c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f892415e110 con 0x7f892406d130 2023-03-03T06:24:21.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.173+0000 7f892af2c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89240cf720 con 0x7f89240cf010 2023-03-03T06:24:21.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.173+0000 7f892af2c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89240cf450 con 0x7f892406e310 2023-03-03T06:24:21.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.173+0000 7f89294c9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89240cf010 0x7f89240cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.173+0000 7f89294c9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f89240cf010 0x7f89240cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42338/0 (socket says 172.21.15.5:42338) 2023-03-03T06:24:21.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.173+0000 7f89294c9700 1 -- 172.21.15.5:0/2665252955 learned_addr learned my addr 172.21.15.5:0/2665252955 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:21.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.173+0000 7f8928cc8700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f892406d130 0x7f892406dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60408/0 (socket says 172.21.15.5:60408) 2023-03-03T06:24:21.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.174+0000 7f8923fff700 1 --2- 172.21.15.5:0/2665252955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f892406e310 0x7f89240cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.174+0000 7f89294c9700 1 -- 172.21.15.5:0/2665252955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f892406e310 msgr2=0x7f89240cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:21.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.174+0000 7f89294c9700 1 --2- 172.21.15.5:0/2665252955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f892406e310 0x7f89240cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.174+0000 7f89294c9700 1 -- 172.21.15.5:0/2665252955 >> v1:172.21.15.5:6789/0 conn(0x7f892406d130 legacy=0x7f892406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.174+0000 7f89294c9700 1 -- 172.21.15.5:0/2665252955 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892415d350 con 0x7f89240cf010 2023-03-03T06:24:21.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.174+0000 7f89294c9700 1 --2- 172.21.15.5:0/2665252955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89240cf010 0x7f89240cb260 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f891c009e50 tx=0x7f891c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b93294146aa668 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:21.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.174+0000 7f89237fe700 1 -- 172.21.15.5:0/2665252955 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c00e070 con 0x7f89240cf010 2023-03-03T06:24:21.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.174+0000 7f89237fe700 1 -- 172.21.15.5:0/2665252955 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c00b9c0 con 0x7f89240cf010 2023-03-03T06:24:21.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.174+0000 7f89237fe700 1 -- 172.21.15.5:0/2665252955 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c00bd70 con 0x7f89240cf010 2023-03-03T06:24:21.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.175+0000 7f892af2c700 1 -- 172.21.15.5:0/2665252955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89240cf010 msgr2=0x7f89240cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.175+0000 7f892af2c700 1 --2- 172.21.15.5:0/2665252955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89240cf010 0x7f89240cb260 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f891c009e50 tx=0x7f891c00b330 comp rx=0 tx=0).stop 2023-03-03T06:24:21.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.175+0000 7f892af2c700 1 -- 172.21.15.5:0/2665252955 shutdown_connections 2023-03-03T06:24:21.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.175+0000 7f892af2c700 1 --2- 172.21.15.5:0/2665252955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89240cf010 0x7f89240cb260 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.175+0000 7f892af2c700 1 --2- 172.21.15.5:0/2665252955 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f892406e310 0x7f89240cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.175+0000 7f892af2c700 1 -- 172.21.15.5:0/2665252955 >> 172.21.15.5:0/2665252955 conn(0x7f89240cfd00 msgr2=0x7f89240d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.175+0000 7f892af2c700 1 -- 172.21.15.5:0/2665252955 shutdown_connections 2023-03-03T06:24:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.175+0000 7f892af2c700 1 -- 172.21.15.5:0/2665252955 wait complete. 2023-03-03T06:24:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.176+0000 7f892af2c700 1 Processor -- start 2023-03-03T06:24:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.176+0000 7f892af2c700 1 -- start start 2023-03-03T06:24:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f892af2c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f892406d130 0x7f89240af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f892af2c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f892406e310 0x7f8924157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f892af2c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89240cf010 0x7f89240c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f892af2c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89240c8600 con 0x7f892406d130 2023-03-03T06:24:21.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f892af2c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89240c7980 con 0x7f89240cf010 2023-03-03T06:24:21.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f892af2c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89240c7c60 con 0x7f892406e310 2023-03-03T06:24:21.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f8928cc8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f892406d130 0x7f89240af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f8928cc8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f892406d130 0x7f89240af060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42340/0 (socket says 172.21.15.5:42340) 2023-03-03T06:24:21.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f8928cc8700 1 -- 172.21.15.5:0/2666463575 learned_addr learned my addr 172.21.15.5:0/2666463575 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:21.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f8923fff700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f892406e310 0x7f8924157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f89294c9700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89240cf010 0x7f89240c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f8928cc8700 1 -- 172.21.15.5:0/2666463575 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f892406e310 msgr2=0x7f8924157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f8928cc8700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f892406e310 0x7f8924157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f8928cc8700 1 -- 172.21.15.5:0/2666463575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89240cf010 msgr2=0x7f89240c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f8928cc8700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89240cf010 0x7f89240c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f8928cc8700 1 -- 172.21.15.5:0/2666463575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c009b30 con 0x7f892406d130 2023-03-03T06:24:21.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f89294c9700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89240cf010 0x7f89240c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:21.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.177+0000 7f8928cc8700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f892406d130 0x7f89240af060 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f891800c490 tx=0x7f891800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:21.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.178+0000 7f89217fa700 1 -- 172.21.15.5:0/2666463575 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918005cb0 con 0x7f892406d130 2023-03-03T06:24:21.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.178+0000 7f89217fa700 1 -- 172.21.15.5:0/2666463575 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8918005e10 con 0x7f892406d130 2023-03-03T06:24:21.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.178+0000 7f892af2c700 1 -- 172.21.15.5:0/2666463575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f892415d910 con 0x7f892406d130 2023-03-03T06:24:21.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.178+0000 7f89217fa700 1 -- 172.21.15.5:0/2666463575 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89180072d0 con 0x7f892406d130 2023-03-03T06:24:21.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.178+0000 7f892af2c700 1 -- 172.21.15.5:0/2666463575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892415d630 con 0x7f892406d130 2023-03-03T06:24:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.179+0000 7f892af2c700 1 -- 172.21.15.5:0/2666463575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f892415dbf0 con 0x7f892406d130 2023-03-03T06:24:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.179+0000 7f89217fa700 1 -- 172.21.15.5:0/2666463575 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8918019030 con 0x7f892406d130 2023-03-03T06:24:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.179+0000 7f89217fa700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89080682f0 0x7f890806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.180+0000 7f89217fa700 1 -- 172.21.15.5:0/2666463575 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8918085200 con 0x7f892406d130 2023-03-03T06:24:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.180+0000 7f8923fff700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89080682f0 0x7f890806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.180+0000 7f8923fff700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89080682f0 0x7f890806a7a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f89240af5a0 tx=0x7f8910008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.184+0000 7f89217fa700 1 -- 172.21.15.5:0/2666463575 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f891804b5e0 con 0x7f892406d130 2023-03-03T06:24:21.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.374+0000 7f892af2c700 1 -- 172.21.15.5:0/2666463575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f892406d840 con 0x7f892406d130 2023-03-03T06:24:21.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.375+0000 7f89217fa700 1 -- 172.21.15.5:0/2666463575 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89180170a0 con 0x7f892406d130 2023-03-03T06:24:21.378 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:24:21.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.376+0000 7f892af2c700 1 -- 172.21.15.5:0/2666463575 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89080682f0 msgr2=0x7f890806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.376+0000 7f892af2c700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89080682f0 0x7f890806a7a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f89240af5a0 tx=0x7f8910008040 comp rx=0 tx=0).stop 2023-03-03T06:24:21.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.376+0000 7f892af2c700 1 -- 172.21.15.5:0/2666463575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f892406d130 msgr2=0x7f89240af060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.376+0000 7f892af2c700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f892406d130 0x7f89240af060 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f891800c490 tx=0x7f891800c850 comp rx=0 tx=0).stop 2023-03-03T06:24:21.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.377+0000 7f892af2c700 1 -- 172.21.15.5:0/2666463575 shutdown_connections 2023-03-03T06:24:21.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.377+0000 7f892af2c700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f89240cf010 0x7f89240c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.377+0000 7f892af2c700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f892406d130 0x7f89240af060 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.377+0000 7f892af2c700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f89080682f0 0x7f890806a7a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.377+0000 7f892af2c700 1 --2- 172.21.15.5:0/2666463575 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f892406e310 0x7f8924157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.377+0000 7f892af2c700 1 -- 172.21.15.5:0/2666463575 >> 172.21.15.5:0/2666463575 conn(0x7f89240cfd00 msgr2=0x7f8924158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:21.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.377+0000 7f892af2c700 1 -- 172.21.15.5:0/2666463575 shutdown_connections 2023-03-03T06:24:21.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.377+0000 7f892af2c700 1 -- 172.21.15.5:0/2666463575 wait complete. 2023-03-03T06:24:21.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-03T06:24:21.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.518+0000 7fb7881b3700 1 Processor -- start 2023-03-03T06:24:21.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.518+0000 7fb7881b3700 1 -- start start 2023-03-03T06:24:21.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.519+0000 7fb7881b3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7801597d0 0x7fb7800b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.519+0000 7fb7881b3700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78006bcd0 con 0x7fb7800b58a0 2023-03-03T06:24:21.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.519+0000 7fb7881b3700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78006cce0 con 0x7fb7800b1d80 2023-03-03T06:24:21.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.519+0000 7fb7881b3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7800b21f0 con 0x7fb7801597d0 2023-03-03T06:24:21.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.519+0000 7fb785f4f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb7801597d0 0x7fb7800b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.519+0000 7fb786750700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb7800b58a0 0x7fb7800cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60424/0 (socket says 172.21.15.5:60424) 2023-03-03T06:24:21.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.519+0000 7fb786750700 1 -- 172.21.15.5:0/1994115437 learned_addr learned my addr 172.21.15.5:0/1994115437 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:21.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.519+0000 7fb785f4f700 1 --2- 172.21.15.5:0/1994115437 >> v2:172.21.15.5:3300/0 conn(0x7fb7801597d0 0x7fb7800b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42346/0 (socket says 172.21.15.5:42346) 2023-03-03T06:24:21.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.520+0000 7fb785f4f700 1 -- 172.21.15.5:0/1994115437 >> v1:172.21.15.191:6789/0 conn(0x7fb7800b1d80 legacy=0x7fb7800b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:21.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.520+0000 7fb785f4f700 1 -- 172.21.15.5:0/1994115437 >> v1:172.21.15.5:6789/0 conn(0x7fb7800b58a0 legacy=0x7fb7800cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.520+0000 7fb785f4f700 1 -- 172.21.15.5:0/1994115437 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78006bf20 con 0x7fb7801597d0 2023-03-03T06:24:21.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.520+0000 7fb784f4d700 1 -- 172.21.15.5:0/1994115437 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543002126 0 0) 0x7fb78006bcd0 con 0x7fb7800b58a0 2023-03-03T06:24:21.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.520+0000 7fb785f4f700 1 --2- 172.21.15.5:0/1994115437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7801597d0 0x7fb7800b1840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb770009840 tx=0x7fb770009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1691e8e5b05b5d4a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:21.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.520+0000 7fb784f4d700 1 -- 172.21.15.5:0/1994115437 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770011830 con 0x7fb7801597d0 2023-03-03T06:24:21.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.520+0000 7fb784f4d700 1 -- 172.21.15.5:0/1994115437 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb770011990 con 0x7fb7801597d0 2023-03-03T06:24:21.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.520+0000 7fb784f4d700 1 -- 172.21.15.5:0/1994115437 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770011d20 con 0x7fb7801597d0 2023-03-03T06:24:21.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.521+0000 7fb7881b3700 1 -- 172.21.15.5:0/1994115437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7801597d0 msgr2=0x7fb7800b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.521+0000 7fb7881b3700 1 --2- 172.21.15.5:0/1994115437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7801597d0 0x7fb7800b1840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb770009840 tx=0x7fb770009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:21.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.521+0000 7fb7881b3700 1 -- 172.21.15.5:0/1994115437 shutdown_connections 2023-03-03T06:24:21.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.521+0000 7fb7881b3700 1 --2- 172.21.15.5:0/1994115437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7801597d0 0x7fb7800b1840 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.521+0000 7fb7881b3700 1 -- 172.21.15.5:0/1994115437 >> 172.21.15.5:0/1994115437 conn(0x7fb7800cc840 msgr2=0x7fb7800ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:21.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.521+0000 7fb7881b3700 1 -- 172.21.15.5:0/1994115437 shutdown_connections 2023-03-03T06:24:21.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.521+0000 7fb7881b3700 1 -- 172.21.15.5:0/1994115437 wait complete. 2023-03-03T06:24:21.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.523+0000 7fb7881b3700 1 Processor -- start 2023-03-03T06:24:21.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.523+0000 7fb7881b3700 1 -- start start 2023-03-03T06:24:21.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb7881b3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7800b1d80 0x7fb780154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb7881b3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7800b58a0 0x7fb7801e4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb7881b3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7801597d0 0x7fb780159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb7881b3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7801e4c40 con 0x7fb7801597d0 2023-03-03T06:24:21.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb7881b3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78015a0e0 con 0x7fb7800b1d80 2023-03-03T06:24:21.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb7881b3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800c4aa0 con 0x7fb7800b58a0 2023-03-03T06:24:21.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb786750700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7801597d0 0x7fb780159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb786750700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7801597d0 0x7fb780159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42356/0 (socket says 172.21.15.5:42356) 2023-03-03T06:24:21.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb786750700 1 -- 172.21.15.5:0/3725546017 learned_addr learned my addr 172.21.15.5:0/3725546017 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb785f4f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7800b1d80 0x7fb780154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb78574e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7800b58a0 0x7fb7801e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb786750700 1 -- 172.21.15.5:0/3725546017 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7800b58a0 msgr2=0x7fb7801e4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb786750700 1 --2- 172.21.15.5:0/3725546017 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7800b58a0 0x7fb7801e4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb786750700 1 -- 172.21.15.5:0/3725546017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7800b1d80 msgr2=0x7fb780154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb786750700 1 --2- 172.21.15.5:0/3725546017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7800b1d80 0x7fb780154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb786750700 1 -- 172.21.15.5:0/3725546017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700094a0 con 0x7fb7801597d0 2023-03-03T06:24:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.524+0000 7fb786750700 1 --2- 172.21.15.5:0/3725546017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7801597d0 0x7fb780159ba0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb77800cb90 tx=0x7fb77800cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.525+0000 7fb7767fc700 1 -- 172.21.15.5:0/3725546017 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77800aa60 con 0x7fb7801597d0 2023-03-03T06:24:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.525+0000 7fb7767fc700 1 -- 172.21.15.5:0/3725546017 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77800abc0 con 0x7fb7801597d0 2023-03-03T06:24:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.525+0000 7fb7881b3700 1 -- 172.21.15.5:0/3725546017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78006c4e0 con 0x7fb7801597d0 2023-03-03T06:24:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.525+0000 7fb7767fc700 1 -- 172.21.15.5:0/3725546017 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7780070d0 con 0x7fb7801597d0 2023-03-03T06:24:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.525+0000 7fb7881b3700 1 -- 172.21.15.5:0/3725546017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78006c200 con 0x7fb7801597d0 2023-03-03T06:24:21.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.526+0000 7fb7881b3700 1 -- 172.21.15.5:0/3725546017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78006c7c0 con 0x7fb7801597d0 2023-03-03T06:24:21.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.526+0000 7fb7767fc700 1 -- 172.21.15.5:0/3725546017 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb77801a030 con 0x7fb7801597d0 2023-03-03T06:24:21.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.526+0000 7fb7767fc700 1 --2- 172.21.15.5:0/3725546017 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb7640682f0 0x7fb76406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.526+0000 7fb7767fc700 1 -- 172.21.15.5:0/3725546017 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb778085ad0 con 0x7fb7801597d0 2023-03-03T06:24:21.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.527+0000 7fb785f4f700 1 --2- 172.21.15.5:0/3725546017 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb7640682f0 0x7fb76406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.527+0000 7fb785f4f700 1 --2- 172.21.15.5:0/3725546017 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb7640682f0 0x7fb76406a7a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb7700090b0 tx=0x7fb770008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:21.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.531+0000 7fb7767fc700 1 -- 172.21.15.5:0/3725546017 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb778052040 con 0x7fb7801597d0 2023-03-03T06:24:21.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.724+0000 7fb7881b3700 1 -- 172.21.15.5:0/3725546017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb7800cc660 con 0x7fb7801597d0 2023-03-03T06:24:21.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.724+0000 7fb7767fc700 1 -- 172.21.15.5:0/3725546017 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb778018020 con 0x7fb7801597d0 2023-03-03T06:24:21.727 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:21.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.726+0000 7fb7881b3700 1 -- 172.21.15.5:0/3725546017 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb7640682f0 msgr2=0x7fb76406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.726+0000 7fb7881b3700 1 --2- 172.21.15.5:0/3725546017 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb7640682f0 0x7fb76406a7a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb7700090b0 tx=0x7fb770008030 comp rx=0 tx=0).stop 2023-03-03T06:24:21.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.726+0000 7fb7881b3700 1 -- 172.21.15.5:0/3725546017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7801597d0 msgr2=0x7fb780159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.726+0000 7fb7881b3700 1 --2- 172.21.15.5:0/3725546017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7801597d0 0x7fb780159ba0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb77800cb90 tx=0x7fb77800cea0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.726+0000 7fb7881b3700 1 -- 172.21.15.5:0/3725546017 shutdown_connections 2023-03-03T06:24:21.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.726+0000 7fb7881b3700 1 --2- 172.21.15.5:0/3725546017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7801597d0 0x7fb780159ba0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.726+0000 7fb7881b3700 1 --2- 172.21.15.5:0/3725546017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7800b1d80 0x7fb780154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.726+0000 7fb7881b3700 1 --2- 172.21.15.5:0/3725546017 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb7640682f0 0x7fb76406a7a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.726+0000 7fb7881b3700 1 --2- 172.21.15.5:0/3725546017 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7800b58a0 0x7fb7801e4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.726+0000 7fb7881b3700 1 -- 172.21.15.5:0/3725546017 >> 172.21.15.5:0/3725546017 conn(0x7fb7800cc840 msgr2=0x7fb780158ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:21.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.726+0000 7fb7881b3700 1 -- 172.21.15.5:0/3725546017 shutdown_connections 2023-03-03T06:24:21.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.726+0000 7fb7881b3700 1 -- 172.21.15.5:0/3725546017 wait complete. 2023-03-03T06:24:21.740 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:21.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.862+0000 7f7ce9844700 1 Processor -- start 2023-03-03T06:24:21.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.863+0000 7f7ce9844700 1 -- start start 2023-03-03T06:24:21.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.863+0000 7f7ce9844700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ce40b8a40 0x7f7ce4160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.863+0000 7f7ce9844700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ce406c830 0x7f7ce40d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.863+0000 7f7ce9844700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce40d2e10 con 0x7f7ce40cf2a0 2023-03-03T06:24:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.863+0000 7f7ce9844700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce4161490 con 0x7f7ce40b8a40 2023-03-03T06:24:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.863+0000 7f7ce9844700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce40cd8d0 con 0x7f7ce406c830 2023-03-03T06:24:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.863+0000 7f7ce2ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7ce40b8a40 0x7f7ce4160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.863+0000 7f7ce27fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7ce40cf2a0 0x7f7ce406c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60434/0 (socket says 172.21.15.5:60434) 2023-03-03T06:24:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.863+0000 7f7ce27fc700 1 -- 172.21.15.5:0/1100393307 learned_addr learned my addr 172.21.15.5:0/1100393307 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.864+0000 7f7ce37fe700 1 --2- 172.21.15.5:0/1100393307 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ce406c830 0x7f7ce40d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.864+0000 7f7ce2ffd700 1 -- 172.21.15.5:0/1100393307 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ce406c830 msgr2=0x7f7ce40d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.864+0000 7f7ce2ffd700 1 --2- 172.21.15.5:0/1100393307 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ce406c830 0x7f7ce40d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.864+0000 7f7ce2ffd700 1 -- 172.21.15.5:0/1100393307 >> v1:172.21.15.5:6789/0 conn(0x7f7ce40cf2a0 legacy=0x7f7ce406c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.864+0000 7f7ce2ffd700 1 -- 172.21.15.5:0/1100393307 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce40d2520 con 0x7f7ce40b8a40 2023-03-03T06:24:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.864+0000 7f7ce1ffb700 1 -- 172.21.15.5:0/1100393307 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797793255 0 0) 0x7f7cd8001110 con 0x7f7ce40cf2a0 2023-03-03T06:24:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.864+0000 7f7ce37fe700 1 --2- 172.21.15.5:0/1100393307 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ce406c830 0x7f7ce40d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.864+0000 7f7ce2ffd700 1 --2- 172.21.15.5:0/1100393307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ce40b8a40 0x7f7ce4160f50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009840 tx=0x7f7cd4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6533086b5e10dffa server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:21.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.864+0000 7f7ce1ffb700 1 -- 172.21.15.5:0/1100393307 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4011830 con 0x7f7ce40b8a40 2023-03-03T06:24:21.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.864+0000 7f7ce1ffb700 1 -- 172.21.15.5:0/1100393307 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd4011990 con 0x7f7ce40b8a40 2023-03-03T06:24:21.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.864+0000 7f7ce1ffb700 1 -- 172.21.15.5:0/1100393307 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4011d20 con 0x7f7ce40b8a40 2023-03-03T06:24:21.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.865+0000 7f7ce9844700 1 -- 172.21.15.5:0/1100393307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ce40b8a40 msgr2=0x7f7ce4160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.865+0000 7f7ce9844700 1 --2- 172.21.15.5:0/1100393307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ce40b8a40 0x7f7ce4160f50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009840 tx=0x7f7cd4009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:21.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.865+0000 7f7ce9844700 1 -- 172.21.15.5:0/1100393307 shutdown_connections 2023-03-03T06:24:21.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.865+0000 7f7ce9844700 1 --2- 172.21.15.5:0/1100393307 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ce406c830 0x7f7ce40d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.865+0000 7f7ce9844700 1 --2- 172.21.15.5:0/1100393307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ce40b8a40 0x7f7ce4160f50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.865+0000 7f7ce9844700 1 -- 172.21.15.5:0/1100393307 >> 172.21.15.5:0/1100393307 conn(0x7f7ce40d05d0 msgr2=0x7f7ce40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.865+0000 7f7ce9844700 1 -- 172.21.15.5:0/1100393307 shutdown_connections 2023-03-03T06:24:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.865+0000 7f7ce9844700 1 -- 172.21.15.5:0/1100393307 wait complete. 2023-03-03T06:24:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.866+0000 7f7ce9844700 1 Processor -- start 2023-03-03T06:24:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.866+0000 7f7ce9844700 1 -- start start 2023-03-03T06:24:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce9844700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ce406c830 0x7f7ce41e6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce9844700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ce40b8a40 0x7f7ce40c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce9844700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ce40cf2a0 0x7f7ce41e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce9844700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce41e7d70 con 0x7f7ce40b8a40 2023-03-03T06:24:21.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce9844700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce40c9bb0 con 0x7f7ce406c830 2023-03-03T06:24:21.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce9844700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce40c6d20 con 0x7f7ce40cf2a0 2023-03-03T06:24:21.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce27fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ce40b8a40 0x7f7ce40c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce27fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ce40b8a40 0x7f7ce40c9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42368/0 (socket says 172.21.15.5:42368) 2023-03-03T06:24:21.873 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce27fc700 1 -- 172.21.15.5:0/3660308087 learned_addr learned my addr 172.21.15.5:0/3660308087 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:21.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce2ffd700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ce406c830 0x7f7ce41e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce37fe700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ce40cf2a0 0x7f7ce41e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce27fc700 1 -- 172.21.15.5:0/3660308087 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ce40cf2a0 msgr2=0x7f7ce41e7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce27fc700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ce40cf2a0 0x7f7ce41e7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce27fc700 1 -- 172.21.15.5:0/3660308087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ce406c830 msgr2=0x7f7ce41e6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:21.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce27fc700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ce406c830 0x7f7ce41e6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:21.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce27fc700 1 -- 172.21.15.5:0/3660308087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd40094a0 con 0x7f7ce40b8a40 2023-03-03T06:24:21.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.867+0000 7f7ce2ffd700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ce406c830 0x7f7ce41e6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:21.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.868+0000 7f7ce27fc700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ce40b8a40 0x7f7ce40c9670 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800c730 tx=0x7f7cd800caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:21.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.868+0000 7f7ccbfff700 1 -- 172.21.15.5:0/3660308087 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8004c80 con 0x7f7ce40b8a40 2023-03-03T06:24:21.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.868+0000 7f7ccbfff700 1 -- 172.21.15.5:0/3660308087 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd8004e00 con 0x7f7ce40b8a40 2023-03-03T06:24:21.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.868+0000 7f7ccbfff700 1 -- 172.21.15.5:0/3660308087 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8007310 con 0x7f7ce40b8a40 2023-03-03T06:24:21.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.868+0000 7f7ce9844700 1 -- 172.21.15.5:0/3660308087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce40d2850 con 0x7f7ce40b8a40 2023-03-03T06:24:21.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.868+0000 7f7ce9844700 1 -- 172.21.15.5:0/3660308087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce415ce30 con 0x7f7ce40b8a40 2023-03-03T06:24:21.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.869+0000 7f7ce9844700 1 -- 172.21.15.5:0/3660308087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce40d2b30 con 0x7f7ce40b8a40 2023-03-03T06:24:21.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.869+0000 7f7ccbfff700 1 -- 172.21.15.5:0/3660308087 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7cd801a020 con 0x7f7ce40b8a40 2023-03-03T06:24:21.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.869+0000 7f7ccbfff700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7cd00682f0 0x7f7cd006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:21.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.869+0000 7f7ccbfff700 1 -- 172.21.15.5:0/3660308087 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7cd8085a20 con 0x7f7ce40b8a40 2023-03-03T06:24:21.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.870+0000 7f7ce2ffd700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7cd00682f0 0x7f7cd006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:21.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.870+0000 7f7ce2ffd700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7cd00682f0 0x7f7cd006a7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7ce415d410 tx=0x7f7cd4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:21.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:21.874+0000 7f7ccbfff700 1 -- 172.21.15.5:0/3660308087 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7cd8051f90 con 0x7f7ce40b8a40 2023-03-03T06:24:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.068+0000 7f7ce9844700 1 -- 172.21.15.5:0/3660308087 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ce40d2e10 con 0x7f7ce40b8a40 2023-03-03T06:24:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.070+0000 7f7ccbfff700 1 -- 172.21.15.5:0/3660308087 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7f7ce40d2e10 con 0x7f7ce40b8a40 2023-03-03T06:24:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:22.072 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.072+0000 7f7ce9844700 1 -- 172.21.15.5:0/3660308087 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7cd00682f0 msgr2=0x7f7cd006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.072+0000 7f7ce9844700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7cd00682f0 0x7f7cd006a7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7ce415d410 tx=0x7f7cd4008030 comp rx=0 tx=0).stop 2023-03-03T06:24:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.072+0000 7f7ce9844700 1 -- 172.21.15.5:0/3660308087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ce40b8a40 msgr2=0x7f7ce40c9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.072+0000 7f7ce9844700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ce40b8a40 0x7f7ce40c9670 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800c730 tx=0x7f7cd800caf0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.072+0000 7f7ce9844700 1 -- 172.21.15.5:0/3660308087 shutdown_connections 2023-03-03T06:24:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.072+0000 7f7ce9844700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7cd00682f0 0x7f7cd006a7a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.072+0000 7f7ce9844700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ce40cf2a0 0x7f7ce41e7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.072+0000 7f7ce9844700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ce406c830 0x7f7ce41e6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.072+0000 7f7ce9844700 1 --2- 172.21.15.5:0/3660308087 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ce40b8a40 0x7f7ce40c9670 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.072+0000 7f7ce9844700 1 -- 172.21.15.5:0/3660308087 >> 172.21.15.5:0/3660308087 conn(0x7f7ce40d05d0 msgr2=0x7f7ce40b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.072+0000 7f7ce9844700 1 -- 172.21.15.5:0/3660308087 shutdown_connections 2023-03-03T06:24:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.072+0000 7f7ce9844700 1 -- 172.21.15.5:0/3660308087 wait complete. 2023-03-03T06:24:22.086 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:23:38.141777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:23:39.283589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-03T06:23:42.422930+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-03T06:24:22.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:24:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.213+0000 7fb7fa085700 1 Processor -- start 2023-03-03T06:24:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.213+0000 7fb7fa085700 1 -- start start 2023-03-03T06:24:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.213+0000 7fb7fa085700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7f4158f30 0x7fb7f40cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7fa085700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f415d740 con 0x7fb7f40cd5c0 2023-03-03T06:24:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7fa085700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f415c850 con 0x7fb7f406d580 2023-03-03T06:24:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7fa085700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f415cb30 con 0x7fb7f4158f30 2023-03-03T06:24:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f3fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb7f40cd5c0 0x7fb7f40ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60452/0 (socket says 172.21.15.5:60452) 2023-03-03T06:24:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f3fff700 1 -- 172.21.15.5:0/3174487688 learned_addr learned my addr 172.21.15.5:0/3174487688 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f2ffd700 1 --2- 172.21.15.5:0/3174487688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7f4158f30 0x7fb7f40cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987400054 0 0) 0x7fb7f415d740 con 0x7fb7f40cd5c0 2023-03-03T06:24:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7dc0035b0 con 0x7fb7f40cd5c0 2023-03-03T06:24:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3920704130 0 0) 0x7fb7dc0035b0 con 0x7fb7f40cd5c0 2023-03-03T06:24:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7f4158f30 msgr2=0x7fb7f40cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 --2- 172.21.15.5:0/3174487688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7f4158f30 0x7fb7f40cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 >> v1:172.21.15.191:6789/0 conn(0x7fb7f406d580 legacy=0x7fb7f406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f415ce10 con 0x7fb7f40cd5c0 2023-03-03T06:24:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fb7ec0019f0 con 0x7fb7f40cd5c0 2023-03-03T06:24:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 >> v1:172.21.15.5:6789/0 conn(0x7fb7f40cd5c0 legacy=0x7fb7f40ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 --2- 172.21.15.5:0/3174487688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7f4158f30 0x7fb7dc003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 --2- 172.21.15.5:0/3174487688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7dc003f70 0x7fb7dc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 --2- 172.21.15.5:0/3174487688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7dc004d90 0x7fb7dc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f415cb30 con 0x7fb7dc004d90 2023-03-03T06:24:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc00baf0 con 0x7fb7dc003f70 2023-03-03T06:24:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc00dec0 con 0x7fb7f4158f30 2023-03-03T06:24:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.214+0000 7fb7f3fff700 1 --2- 172.21.15.5:0/3174487688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7dc004d90 0x7fb7dc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.215+0000 7fb7f2ffd700 1 --2- 172.21.15.5:0/3174487688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7dc003f70 0x7fb7dc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.215+0000 7fb7f37fe700 1 --2- 172.21.15.5:0/3174487688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7f4158f30 0x7fb7dc003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.215+0000 7fb7f3fff700 1 -- 172.21.15.5:0/3174487688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7f4158f30 msgr2=0x7fb7dc003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.215+0000 7fb7f3fff700 1 --2- 172.21.15.5:0/3174487688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7f4158f30 0x7fb7dc003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.215+0000 7fb7f3fff700 1 -- 172.21.15.5:0/3174487688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7dc003f70 msgr2=0x7fb7dc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.215+0000 7fb7f3fff700 1 --2- 172.21.15.5:0/3174487688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7dc003f70 0x7fb7dc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.215+0000 7fb7f3fff700 1 -- 172.21.15.5:0/3174487688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc0035b0 con 0x7fb7dc004d90 2023-03-03T06:24:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.215+0000 7fb7f3fff700 1 --2- 172.21.15.5:0/3174487688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7dc004d90 0x7fb7dc005200 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec002230 tx=0x7fb7dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bcbf3dde6e670f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.215+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec012600 con 0x7fb7dc004d90 2023-03-03T06:24:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.215+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec012760 con 0x7fb7dc004d90 2023-03-03T06:24:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.215+0000 7fb7f27fc700 1 -- 172.21.15.5:0/3174487688 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec012b10 con 0x7fb7dc004d90 2023-03-03T06:24:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.215+0000 7fb7fa085700 1 -- 172.21.15.5:0/3174487688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7dc004d90 msgr2=0x7fb7dc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.215+0000 7fb7fa085700 1 --2- 172.21.15.5:0/3174487688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7dc004d90 0x7fb7dc005200 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec002230 tx=0x7fb7dc005880 comp rx=0 tx=0).stop 2023-03-03T06:24:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.216+0000 7fb7f3fff700 1 -- 172.21.15.5:0/3174487688 reap_dead start 2023-03-03T06:24:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.216+0000 7fb7fa085700 1 -- 172.21.15.5:0/3174487688 shutdown_connections 2023-03-03T06:24:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.216+0000 7fb7fa085700 1 -- 172.21.15.5:0/3174487688 >> 172.21.15.5:0/3174487688 conn(0x7fb7f40cf4b0 msgr2=0x7fb7f40cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.216+0000 7fb7fa085700 1 -- 172.21.15.5:0/3174487688 shutdown_connections 2023-03-03T06:24:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.216+0000 7fb7fa085700 1 -- 172.21.15.5:0/3174487688 wait complete. 2023-03-03T06:24:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.217+0000 7fb7fa085700 1 Processor -- start 2023-03-03T06:24:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.217+0000 7fb7fa085700 1 -- start start 2023-03-03T06:24:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7fa085700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7f414c8b0 0x7fb7f41543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7fa085700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7f414cc80 0x7fb7f41548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7fa085700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7f40c7cd0 0x7fb7f40c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7fa085700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40c6690 con 0x7fb7f414cc80 2023-03-03T06:24:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7fa085700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40c6970 con 0x7fb7f414c8b0 2023-03-03T06:24:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7fa085700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40c6c50 con 0x7fb7f40c7cd0 2023-03-03T06:24:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7f2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7f414cc80 0x7fb7f41548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7f2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7f414cc80 0x7fb7f41548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42388/0 (socket says 172.21.15.5:42388) 2023-03-03T06:24:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7f2ffd700 1 -- 172.21.15.5:0/3735231908 learned_addr learned my addr 172.21.15.5:0/3735231908 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7f3fff700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7f40c7cd0 0x7fb7f40c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7f2ffd700 1 -- 172.21.15.5:0/3735231908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7f40c7cd0 msgr2=0x7fb7f40c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7f37fe700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7f414c8b0 0x7fb7f41543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7f2ffd700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7f40c7cd0 0x7fb7f40c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7f2ffd700 1 -- 172.21.15.5:0/3735231908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7f414c8b0 msgr2=0x7fb7f41543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7f2ffd700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7f414c8b0 0x7fb7f41543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7f2ffd700 1 -- 172.21.15.5:0/3735231908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f415d3d0 con 0x7fb7f414cc80 2023-03-03T06:24:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.218+0000 7fb7f2ffd700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7f414cc80 0x7fb7f41548f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80119c0 tx=0x7fb7e8011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.219+0000 7fb7dbfff700 1 -- 172.21.15.5:0/3735231908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8004240 con 0x7fb7f414cc80 2023-03-03T06:24:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.219+0000 7fb7dbfff700 1 -- 172.21.15.5:0/3735231908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e80043a0 con 0x7fb7f414cc80 2023-03-03T06:24:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.219+0000 7fb7dbfff700 1 -- 172.21.15.5:0/3735231908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e800f730 con 0x7fb7f414cc80 2023-03-03T06:24:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.219+0000 7fb7fa085700 1 -- 172.21.15.5:0/3735231908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f415d0f0 con 0x7fb7f414cc80 2023-03-03T06:24:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.219+0000 7fb7fa085700 1 -- 172.21.15.5:0/3735231908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f406b0d0 con 0x7fb7f414cc80 2023-03-03T06:24:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.220+0000 7fb7fa085700 1 -- 172.21.15.5:0/3735231908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f404e6e0 con 0x7fb7f414cc80 2023-03-03T06:24:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.220+0000 7fb7dbfff700 1 -- 172.21.15.5:0/3735231908 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb7e8025070 con 0x7fb7f414cc80 2023-03-03T06:24:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.220+0000 7fb7dbfff700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb7e00682f0 0x7fb7e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.220+0000 7fb7dbfff700 1 -- 172.21.15.5:0/3735231908 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb7e8086450 con 0x7fb7f414cc80 2023-03-03T06:24:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.220+0000 7fb7f37fe700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb7e00682f0 0x7fb7e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.221+0000 7fb7f37fe700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb7e00682f0 0x7fb7e006a7a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40b3fd0 tx=0x7fb7e4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.225+0000 7fb7dbfff700 1 -- 172.21.15.5:0/3735231908 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb7e80529c0 con 0x7fb7f414cc80 2023-03-03T06:24:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.418+0000 7fb7fa085700 1 -- 172.21.15.5:0/3735231908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb7f406e5c0 con 0x7fb7f414cc80 2023-03-03T06:24:22.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.418+0000 7fb7dbfff700 1 -- 172.21.15.5:0/3735231908 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb7e80190a0 con 0x7fb7f414cc80 2023-03-03T06:24:22.422 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:24:22.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.420+0000 7fb7fa085700 1 -- 172.21.15.5:0/3735231908 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb7e00682f0 msgr2=0x7fb7e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.420+0000 7fb7fa085700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb7e00682f0 0x7fb7e006a7a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40b3fd0 tx=0x7fb7e4009040 comp rx=0 tx=0).stop 2023-03-03T06:24:22.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.420+0000 7fb7fa085700 1 -- 172.21.15.5:0/3735231908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7f414cc80 msgr2=0x7fb7f41548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.420+0000 7fb7fa085700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7f414cc80 0x7fb7f41548f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80119c0 tx=0x7fb7e8011d80 comp rx=0 tx=0).stop 2023-03-03T06:24:22.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.420+0000 7fb7fa085700 1 -- 172.21.15.5:0/3735231908 shutdown_connections 2023-03-03T06:24:22.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.420+0000 7fb7fa085700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb7e00682f0 0x7fb7e006a7a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.420+0000 7fb7fa085700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb7f40c7cd0 0x7fb7f40c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.420+0000 7fb7fa085700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7f414c8b0 0x7fb7f41543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.420+0000 7fb7fa085700 1 --2- 172.21.15.5:0/3735231908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb7f414cc80 0x7fb7f41548f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.420+0000 7fb7fa085700 1 -- 172.21.15.5:0/3735231908 >> 172.21.15.5:0/3735231908 conn(0x7fb7f40cf4b0 msgr2=0x7fb7f415bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:22.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.421+0000 7fb7fa085700 1 -- 172.21.15.5:0/3735231908 shutdown_connections 2023-03-03T06:24:22.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.421+0000 7fb7fa085700 1 -- 172.21.15.5:0/3735231908 wait complete. 2023-03-03T06:24:22.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:24:22.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.561+0000 7f608ca0b700 1 Processor -- start 2023-03-03T06:24:22.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.561+0000 7f608ca0b700 1 -- start start 2023-03-03T06:24:22.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.562+0000 7f608ca0b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f608815cd40 0x7f608806cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.562+0000 7f608ca0b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60880cb050 0x7f60880cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.562+0000 7f608ca0b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60880cb990 con 0x7f60880b1960 2023-03-03T06:24:22.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.562+0000 7f608ca0b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608815d110 con 0x7f60880cb050 2023-03-03T06:24:22.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.562+0000 7f608ca0b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608806bf10 con 0x7f608815cd40 2023-03-03T06:24:22.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.562+0000 7f6086d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60880cb050 0x7f60880cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.562+0000 7f6086d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60880cb050 0x7f60880cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42396/0 (socket says 172.21.15.5:42396) 2023-03-03T06:24:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.562+0000 7f6086d9d700 1 -- 172.21.15.5:0/2044329069 learned_addr learned my addr 172.21.15.5:0/2044329069 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.563+0000 7f608659c700 1 --2- 172.21.15.5:0/2044329069 >> v2:172.21.15.191:3300/0 conn(0x7f608815cd40 0x7f608806cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.563+0000 7f6086d9d700 1 -- 172.21.15.5:0/2044329069 >> v2:172.21.15.191:3300/0 conn(0x7f608815cd40 msgr2=0x7f608806cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.563+0000 7f6086d9d700 1 --2- 172.21.15.5:0/2044329069 >> v2:172.21.15.191:3300/0 conn(0x7f608815cd40 0x7f608806cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.563+0000 7f6086d9d700 1 -- 172.21.15.5:0/2044329069 >> v1:172.21.15.191:6789/0 conn(0x7f60880b1960 legacy=0x7f608806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:22.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.563+0000 7f6086d9d700 1 -- 172.21.15.5:0/2044329069 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608806c1f0 con 0x7f60880cb050 2023-03-03T06:24:22.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.563+0000 7f6086d9d700 1 --2- 172.21.15.5:0/2044329069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60880cb050 0x7f60880cb450 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f60880ca6a0 tx=0x7f608000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a4171e8344a9c9 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:22.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.563+0000 7f608559a700 1 -- 172.21.15.5:0/2044329069 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608000e070 con 0x7f60880cb050 2023-03-03T06:24:22.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.563+0000 7f608559a700 1 -- 172.21.15.5:0/2044329069 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6080003a20 con 0x7f60880cb050 2023-03-03T06:24:22.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.563+0000 7f608559a700 1 -- 172.21.15.5:0/2044329069 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080003dd0 con 0x7f60880cb050 2023-03-03T06:24:22.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.563+0000 7f608ca0b700 1 -- 172.21.15.5:0/2044329069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60880cb050 msgr2=0x7f60880cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.563+0000 7f608ca0b700 1 --2- 172.21.15.5:0/2044329069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60880cb050 0x7f60880cb450 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f60880ca6a0 tx=0x7f608000b330 comp rx=0 tx=0).stop 2023-03-03T06:24:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.564+0000 7f608ca0b700 1 -- 172.21.15.5:0/2044329069 shutdown_connections 2023-03-03T06:24:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.564+0000 7f608ca0b700 1 --2- 172.21.15.5:0/2044329069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60880cb050 0x7f60880cb450 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.564+0000 7f608ca0b700 1 --2- 172.21.15.5:0/2044329069 >> v2:172.21.15.191:3300/0 conn(0x7f608815cd40 0x7f608806cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.564+0000 7f608ca0b700 1 -- 172.21.15.5:0/2044329069 >> 172.21.15.5:0/2044329069 conn(0x7f60880cc8d0 msgr2=0x7f60880cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.564+0000 7f608ca0b700 1 -- 172.21.15.5:0/2044329069 shutdown_connections 2023-03-03T06:24:22.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.564+0000 7f608ca0b700 1 -- 172.21.15.5:0/2044329069 wait complete. 2023-03-03T06:24:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.565+0000 7f608ca0b700 1 Processor -- start 2023-03-03T06:24:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.565+0000 7f608ca0b700 1 -- start start 2023-03-03T06:24:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608ca0b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60880b1960 0x7f60881f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608ca0b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60880cb050 0x7f60880b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608ca0b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f608815cd40 0x7f60880ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608ca0b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60880b5c30 con 0x7f60880b1960 2023-03-03T06:24:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608ca0b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60880b46e0 con 0x7f60880cb050 2023-03-03T06:24:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608ca0b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60880b4930 con 0x7f608815cd40 2023-03-03T06:24:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60880b1960 0x7f60881f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60880b1960 0x7f60881f1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42398/0 (socket says 172.21.15.5:42398) 2023-03-03T06:24:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608659c700 1 -- 172.21.15.5:0/1203481459 learned_addr learned my addr 172.21.15.5:0/1203481459 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608659c700 1 -- 172.21.15.5:0/1203481459 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f608815cd40 msgr2=0x7f60880ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608659c700 1 --2- 172.21.15.5:0/1203481459 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f608815cd40 0x7f60880ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608659c700 1 -- 172.21.15.5:0/1203481459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60880cb050 msgr2=0x7f60880b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608659c700 1 --2- 172.21.15.5:0/1203481459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60880cb050 0x7f60880b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608659c700 1 -- 172.21.15.5:0/1203481459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6080009b30 con 0x7f60880b1960 2023-03-03T06:24:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608659c700 1 --2- 172.21.15.5:0/1203481459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60880b1960 0x7f60881f1fd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f607c00d800 tx=0x7f607c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f6076ffd700 1 -- 172.21.15.5:0/1203481459 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c0125f0 con 0x7f60880b1960 2023-03-03T06:24:22.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f6076ffd700 1 -- 172.21.15.5:0/1203481459 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607c012750 con 0x7f60880b1960 2023-03-03T06:24:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608ca0b700 1 -- 172.21.15.5:0/1203481459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608806c7b0 con 0x7f60880b1960 2023-03-03T06:24:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f6076ffd700 1 -- 172.21.15.5:0/1203481459 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c012b00 con 0x7f60880b1960 2023-03-03T06:24:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.566+0000 7f608ca0b700 1 -- 172.21.15.5:0/1203481459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608806c4d0 con 0x7f60880b1960 2023-03-03T06:24:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.568+0000 7f608ca0b700 1 -- 172.21.15.5:0/1203481459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608806ca90 con 0x7f60880b1960 2023-03-03T06:24:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.568+0000 7f6076ffd700 1 -- 172.21.15.5:0/1203481459 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f607c012c60 con 0x7f60880b1960 2023-03-03T06:24:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.568+0000 7f6076ffd700 1 --2- 172.21.15.5:0/1203481459 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f60680682f0 0x7f606806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.568+0000 7f6076ffd700 1 -- 172.21.15.5:0/1203481459 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f607c0864e0 con 0x7f60880b1960 2023-03-03T06:24:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.568+0000 7f6085d9b700 1 --2- 172.21.15.5:0/1203481459 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f60680682f0 0x7f606806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.569+0000 7f6085d9b700 1 --2- 172.21.15.5:0/1203481459 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f60680682f0 0x7f606806a7a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f608806bdb0 tx=0x7f6078007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:22.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.573+0000 7f6076ffd700 1 -- 172.21.15.5:0/1203481459 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f607c052a50 con 0x7f60880b1960 2023-03-03T06:24:22.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.763+0000 7f608ca0b700 1 -- 172.21.15.5:0/1203481459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f608804e6e0 con 0x7f60880b1960 2023-03-03T06:24:22.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.763+0000 7f6076ffd700 1 -- 172.21.15.5:0/1203481459 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f607c056070 con 0x7f60880b1960 2023-03-03T06:24:22.766 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:24:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.766+0000 7f608ca0b700 1 -- 172.21.15.5:0/1203481459 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f60680682f0 msgr2=0x7f606806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.766+0000 7f608ca0b700 1 --2- 172.21.15.5:0/1203481459 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f60680682f0 0x7f606806a7a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f608806bdb0 tx=0x7f6078007a40 comp rx=0 tx=0).stop 2023-03-03T06:24:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.766+0000 7f608ca0b700 1 -- 172.21.15.5:0/1203481459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60880b1960 msgr2=0x7f60881f1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.766+0000 7f608ca0b700 1 --2- 172.21.15.5:0/1203481459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60880b1960 0x7f60881f1fd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f607c00d800 tx=0x7f607c00dbc0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.766+0000 7f608ca0b700 1 -- 172.21.15.5:0/1203481459 shutdown_connections 2023-03-03T06:24:22.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.766+0000 7f608ca0b700 1 --2- 172.21.15.5:0/1203481459 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f60680682f0 0x7f606806a7a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.766+0000 7f608ca0b700 1 --2- 172.21.15.5:0/1203481459 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f608815cd40 0x7f60880ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.766+0000 7f608ca0b700 1 --2- 172.21.15.5:0/1203481459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60880b1960 0x7f60881f1fd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.766+0000 7f608ca0b700 1 --2- 172.21.15.5:0/1203481459 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60880cb050 0x7f60880b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.766+0000 7f608ca0b700 1 -- 172.21.15.5:0/1203481459 >> 172.21.15.5:0/1203481459 conn(0x7f60880cc8d0 msgr2=0x7f608815c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.766+0000 7f608ca0b700 1 -- 172.21.15.5:0/1203481459 shutdown_connections 2023-03-03T06:24:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.766+0000 7f608ca0b700 1 -- 172.21.15.5:0/1203481459 wait complete. 2023-03-03T06:24:22.780 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:24:22.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.905+0000 7fcf6406c700 1 Processor -- start 2023-03-03T06:24:22.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.906+0000 7fcf6406c700 1 -- start start 2023-03-03T06:24:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.906+0000 7fcf6406c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf5c0cd3e0 0x7fcf5c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.906+0000 7fcf6406c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c15e160 con 0x7fcf5c0b1fe0 2023-03-03T06:24:22.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.906+0000 7fcf6406c700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c15d110 con 0x7fcf5c15cd40 2023-03-03T06:24:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.906+0000 7fcf6406c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0cd870 con 0x7fcf5c0cd3e0 2023-03-03T06:24:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf62609700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcf5c0b1fe0 0x7fcf5c0ce290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60484/0 (socket says 172.21.15.5:60484) 2023-03-03T06:24:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf62609700 1 -- 172.21.15.5:0/1394221275 learned_addr learned my addr 172.21.15.5:0/1394221275 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf61607700 1 --2- 172.21.15.5:0/1394221275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf5c0cd3e0 0x7fcf5c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846121342 0 0) 0x7fcf5c15e160 con 0x7fcf5c0b1fe0 2023-03-03T06:24:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf480035b0 con 0x7fcf5c0b1fe0 2023-03-03T06:24:22.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3365856481 0 0) 0x7fcf480035b0 con 0x7fcf5c0b1fe0 2023-03-03T06:24:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf5c0cd3e0 msgr2=0x7fcf5c0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 --2- 172.21.15.5:0/1394221275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf5c0cd3e0 0x7fcf5c0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 >> v1:172.21.15.191:6789/0 conn(0x7fcf5c15cd40 legacy=0x7fcf5c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c15d3c0 con 0x7fcf5c0b1fe0 2023-03-03T06:24:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fcf540019f0 con 0x7fcf5c0b1fe0 2023-03-03T06:24:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 >> v1:172.21.15.5:6789/0 conn(0x7fcf5c0b1fe0 legacy=0x7fcf5c0ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 --2- 172.21.15.5:0/1394221275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf48003a30 0x7fcf48003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 --2- 172.21.15.5:0/1394221275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf480043d0 0x7fcf48004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 --2- 172.21.15.5:0/1394221275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf5c0cd3e0 0x7fcf48005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0cd870 con 0x7fcf48003a30 2023-03-03T06:24:22.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4800bac0 con 0x7fcf480043d0 2023-03-03T06:24:22.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4800bc80 con 0x7fcf5c0cd3e0 2023-03-03T06:24:22.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf61e08700 1 --2- 172.21.15.5:0/1394221275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf48003a30 0x7fcf48003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf62609700 1 --2- 172.21.15.5:0/1394221275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf5c0cd3e0 0x7fcf48005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.907+0000 7fcf61607700 1 --2- 172.21.15.5:0/1394221275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf480043d0 0x7fcf48004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.908+0000 7fcf61e08700 1 -- 172.21.15.5:0/1394221275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf5c0cd3e0 msgr2=0x7fcf48005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:22.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.908+0000 7fcf61e08700 1 --2- 172.21.15.5:0/1394221275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf5c0cd3e0 0x7fcf48005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.908+0000 7fcf61e08700 1 -- 172.21.15.5:0/1394221275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf480043d0 msgr2=0x7fcf48004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.908+0000 7fcf61e08700 1 --2- 172.21.15.5:0/1394221275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf480043d0 0x7fcf48004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.908+0000 7fcf61e08700 1 -- 172.21.15.5:0/1394221275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf480035b0 con 0x7fcf48003a30 2023-03-03T06:24:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.908+0000 7fcf61e08700 1 --2- 172.21.15.5:0/1394221275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf48003a30 0x7fcf48003e00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcf500018d0 tx=0x7fcf48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc5e8a72146cd5d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.908+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000c690 con 0x7fcf48003a30 2023-03-03T06:24:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.908+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5000c810 con 0x7fcf48003a30 2023-03-03T06:24:22.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.908+0000 7fcf60e06700 1 -- 172.21.15.5:0/1394221275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000cbc0 con 0x7fcf48003a30 2023-03-03T06:24:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.908+0000 7fcf6406c700 1 -- 172.21.15.5:0/1394221275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf48003a30 msgr2=0x7fcf48003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.908+0000 7fcf6406c700 1 --2- 172.21.15.5:0/1394221275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf48003a30 0x7fcf48003e00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcf500018d0 tx=0x7fcf48005880 comp rx=0 tx=0).stop 2023-03-03T06:24:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.908+0000 7fcf62609700 1 -- 172.21.15.5:0/1394221275 reap_dead start 2023-03-03T06:24:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.909+0000 7fcf6406c700 1 -- 172.21.15.5:0/1394221275 shutdown_connections 2023-03-03T06:24:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.909+0000 7fcf6406c700 1 -- 172.21.15.5:0/1394221275 >> 172.21.15.5:0/1394221275 conn(0x7fcf5c0cc8d0 msgr2=0x7fcf5c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:22.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.909+0000 7fcf6406c700 1 -- 172.21.15.5:0/1394221275 shutdown_connections 2023-03-03T06:24:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.909+0000 7fcf6406c700 1 -- 172.21.15.5:0/1394221275 wait complete. 2023-03-03T06:24:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.910+0000 7fcf6406c700 1 Processor -- start 2023-03-03T06:24:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.910+0000 7fcf6406c700 1 -- start start 2023-03-03T06:24:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf6406c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf48003a30 0x7fcf5c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf6406c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf5c0b4850 0x7fcf5c1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf6406c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf5c0ac2b0 0x7fcf5c157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf6406c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0ad460 con 0x7fcf48003a30 2023-03-03T06:24:22.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf6406c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0ac7e0 con 0x7fcf5c0ac2b0 2023-03-03T06:24:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf6406c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0acac0 con 0x7fcf5c0b4850 2023-03-03T06:24:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf61e08700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf48003a30 0x7fcf5c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf61e08700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf48003a30 0x7fcf5c156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42418/0 (socket says 172.21.15.5:42418) 2023-03-03T06:24:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf61e08700 1 -- 172.21.15.5:0/373475521 learned_addr learned my addr 172.21.15.5:0/373475521 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:22.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf61607700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf5c0b4850 0x7fcf5c1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf62609700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf5c0ac2b0 0x7fcf5c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf61e08700 1 -- 172.21.15.5:0/373475521 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf5c0b4850 msgr2=0x7fcf5c1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf61e08700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf5c0b4850 0x7fcf5c1572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf61e08700 1 -- 172.21.15.5:0/373475521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf5c0ac2b0 msgr2=0x7fcf5c157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf61e08700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf5c0ac2b0 0x7fcf5c157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf61e08700 1 -- 172.21.15.5:0/373475521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c15d980 con 0x7fcf48003a30 2023-03-03T06:24:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf62609700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf5c0ac2b0 0x7fcf5c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:22.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf61e08700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf48003a30 0x7fcf5c156b30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000c0e0 tx=0x7fcf50001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:22.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf4e7fc700 1 -- 172.21.15.5:0/373475521 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000cb80 con 0x7fcf48003a30 2023-03-03T06:24:22.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf4e7fc700 1 -- 172.21.15.5:0/373475521 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf50021070 con 0x7fcf48003a30 2023-03-03T06:24:22.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf6406c700 1 -- 172.21.15.5:0/373475521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c15d6a0 con 0x7fcf48003a30 2023-03-03T06:24:22.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf4e7fc700 1 -- 172.21.15.5:0/373475521 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000cee0 con 0x7fcf48003a30 2023-03-03T06:24:22.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.911+0000 7fcf6406c700 1 -- 172.21.15.5:0/373475521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c15dc60 con 0x7fcf48003a30 2023-03-03T06:24:22.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.912+0000 7fcf6406c700 1 -- 172.21.15.5:0/373475521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c0ad6d0 con 0x7fcf48003a30 2023-03-03T06:24:22.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.913+0000 7fcf4e7fc700 1 -- 172.21.15.5:0/373475521 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fcf50010050 con 0x7fcf48003a30 2023-03-03T06:24:22.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.913+0000 7fcf4e7fc700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcf400682f0 0x7fcf4006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:22.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.913+0000 7fcf4e7fc700 1 -- 172.21.15.5:0/373475521 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf500870c0 con 0x7fcf48003a30 2023-03-03T06:24:22.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.913+0000 7fcf61607700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcf400682f0 0x7fcf4006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:22.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.914+0000 7fcf61607700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcf400682f0 0x7fcf4006a7a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0cbcb0 tx=0x7fcf58009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:22.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:22.917+0000 7fcf4e7fc700 1 -- 172.21.15.5:0/373475521 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fcf50053630 con 0x7fcf48003a30 2023-03-03T06:24:23.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.110+0000 7fcf6406c700 1 -- 172.21.15.5:0/373475521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf5c04e6e0 con 0x7fcf48003a30 2023-03-03T06:24:23.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.110+0000 7fcf4e7fc700 1 -- 172.21.15.5:0/373475521 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcf50056c50 con 0x7fcf48003a30 2023-03-03T06:24:23.113 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:23.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.112+0000 7fcf6406c700 1 -- 172.21.15.5:0/373475521 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcf400682f0 msgr2=0x7fcf4006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.112+0000 7fcf6406c700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcf400682f0 0x7fcf4006a7a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0cbcb0 tx=0x7fcf58009210 comp rx=0 tx=0).stop 2023-03-03T06:24:23.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.112+0000 7fcf6406c700 1 -- 172.21.15.5:0/373475521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf48003a30 msgr2=0x7fcf5c156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.112+0000 7fcf6406c700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf48003a30 0x7fcf5c156b30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000c0e0 tx=0x7fcf50001230 comp rx=0 tx=0).stop 2023-03-03T06:24:23.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.112+0000 7fcf6406c700 1 -- 172.21.15.5:0/373475521 shutdown_connections 2023-03-03T06:24:23.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.112+0000 7fcf6406c700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcf5c0ac2b0 0x7fcf5c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.112+0000 7fcf6406c700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf48003a30 0x7fcf5c156b30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.112+0000 7fcf6406c700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcf400682f0 0x7fcf4006a7a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.112+0000 7fcf6406c700 1 --2- 172.21.15.5:0/373475521 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcf5c0b4850 0x7fcf5c1572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.112+0000 7fcf6406c700 1 -- 172.21.15.5:0/373475521 >> 172.21.15.5:0/373475521 conn(0x7fcf5c0cc8d0 msgr2=0x7fcf5c0b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.112+0000 7fcf6406c700 1 -- 172.21.15.5:0/373475521 shutdown_connections 2023-03-03T06:24:23.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.112+0000 7fcf6406c700 1 -- 172.21.15.5:0/373475521 wait complete. 2023-03-03T06:24:23.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:24:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.253+0000 7f85d7087700 1 Processor -- start 2023-03-03T06:24:23.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.253+0000 7f85d7087700 1 -- start start 2023-03-03T06:24:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.254+0000 7f85d7087700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f85d015cd40 0x7f85d006cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.254+0000 7f85d7087700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d015d110 con 0x7f85d00cb050 2023-03-03T06:24:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.254+0000 7f85d7087700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d006bf10 con 0x7f85d00b1960 2023-03-03T06:24:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.254+0000 7f85d7087700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d006c1f0 con 0x7f85d015cd40 2023-03-03T06:24:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.254+0000 7f85d5624700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f85d00cb050 0x7f85d00cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60504/0 (socket says 172.21.15.5:60504) 2023-03-03T06:24:23.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.254+0000 7f85d5624700 1 -- 172.21.15.5:0/3948383088 learned_addr learned my addr 172.21.15.5:0/3948383088 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:23.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.254+0000 7f85d4e23700 1 --2- 172.21.15.5:0/3948383088 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f85d015cd40 0x7f85d006cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.254+0000 7f85cf7fe700 1 -- 172.21.15.5:0/3948383088 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048789892 0 0) 0x7f85d015d110 con 0x7f85d00cb050 2023-03-03T06:24:23.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.254+0000 7f85cf7fe700 1 -- 172.21.15.5:0/3948383088 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85c00035b0 con 0x7f85d00cb050 2023-03-03T06:24:23.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.255+0000 7f85cf7fe700 1 -- 172.21.15.5:0/3948383088 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685526094 0 0) 0x7f85d006bf10 con 0x7f85d00b1960 2023-03-03T06:24:23.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.255+0000 7f85cf7fe700 1 -- 172.21.15.5:0/3948383088 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d015d110 con 0x7f85d00b1960 2023-03-03T06:24:23.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.255+0000 7f85d4e23700 1 -- 172.21.15.5:0/3948383088 >> v1:172.21.15.191:6789/0 conn(0x7f85d00b1960 legacy=0x7f85d006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.255+0000 7f85d4e23700 1 -- 172.21.15.5:0/3948383088 >> v1:172.21.15.5:6789/0 conn(0x7f85d00cb050 legacy=0x7f85d00cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.255+0000 7f85cf7fe700 1 -- 172.21.15.5:0/3948383088 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1103196291 0 0) 0x7f85c00035b0 con 0x7f85d00cb050 2023-03-03T06:24:23.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.255+0000 7f85d4e23700 1 -- 172.21.15.5:0/3948383088 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d006c4d0 con 0x7f85d015cd40 2023-03-03T06:24:23.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.255+0000 7f85d4e23700 1 --2- 172.21.15.5:0/3948383088 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f85d015cd40 0x7f85d006cfb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009870 tx=0x7f85c4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c455021840ba304 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:23.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.255+0000 7f85cf7fe700 1 -- 172.21.15.5:0/3948383088 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c80019f0 con 0x7f85d015cd40 2023-03-03T06:24:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.255+0000 7f85cf7fe700 1 -- 172.21.15.5:0/3948383088 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c4004030 con 0x7f85d015cd40 2023-03-03T06:24:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.255+0000 7f85cf7fe700 1 -- 172.21.15.5:0/3948383088 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c40043a0 con 0x7f85d015cd40 2023-03-03T06:24:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.256+0000 7f85d7087700 1 -- 172.21.15.5:0/3948383088 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f85d015cd40 msgr2=0x7f85d006cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.256+0000 7f85d7087700 1 --2- 172.21.15.5:0/3948383088 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f85d015cd40 0x7f85d006cfb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f85c4009870 tx=0x7f85c4009b80 comp rx=0 tx=0).stop 2023-03-03T06:24:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.256+0000 7f85d7087700 1 -- 172.21.15.5:0/3948383088 shutdown_connections 2023-03-03T06:24:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.256+0000 7f85d7087700 1 --2- 172.21.15.5:0/3948383088 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f85d015cd40 0x7f85d006cfb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.256+0000 7f85d7087700 1 -- 172.21.15.5:0/3948383088 >> 172.21.15.5:0/3948383088 conn(0x7f85d00cc8d0 msgr2=0x7f85d00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:23.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.256+0000 7f85d7087700 1 -- 172.21.15.5:0/3948383088 shutdown_connections 2023-03-03T06:24:23.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.256+0000 7f85d7087700 1 -- 172.21.15.5:0/3948383088 wait complete. 2023-03-03T06:24:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.257+0000 7f85d7087700 1 Processor -- start 2023-03-03T06:24:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.257+0000 7f85d7087700 1 -- start start 2023-03-03T06:24:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.258+0000 7f85d7087700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f85d00b1960 0x7f85d015fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.258+0000 7f85d7087700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d00cb050 0x7f85d01f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.258+0000 7f85d7087700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85d015cd40 0x7f85d01f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.258+0000 7f85d7087700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00c68e0 con 0x7f85d00cb050 2023-03-03T06:24:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.258+0000 7f85d7087700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00ac920 con 0x7f85d015cd40 2023-03-03T06:24:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.258+0000 7f85d7087700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00acea0 con 0x7f85d00b1960 2023-03-03T06:24:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85cffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d00cb050 0x7f85d01f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85cffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d00cb050 0x7f85d01f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42434/0 (socket says 172.21.15.5:42434) 2023-03-03T06:24:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85cffff700 1 -- 172.21.15.5:0/2722955757 learned_addr learned my addr 172.21.15.5:0/2722955757 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85d4e23700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f85d00b1960 0x7f85d015fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85d5624700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85d015cd40 0x7f85d01f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85cffff700 1 -- 172.21.15.5:0/2722955757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f85d00b1960 msgr2=0x7f85d015fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85cffff700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f85d00b1960 0x7f85d015fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85cffff700 1 -- 172.21.15.5:0/2722955757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85d015cd40 msgr2=0x7f85d01f5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85cffff700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85d015cd40 0x7f85d01f5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85cffff700 1 -- 172.21.15.5:0/2722955757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c40094a0 con 0x7f85d00cb050 2023-03-03T06:24:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85cffff700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d00cb050 0x7f85d01f5a10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00c520 tx=0x7f85bc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85cd7fa700 1 -- 172.21.15.5:0/2722955757 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0052d0 con 0x7f85d00cb050 2023-03-03T06:24:23.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85d7087700 1 -- 172.21.15.5:0/2722955757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d006ca90 con 0x7f85d00cb050 2023-03-03T06:24:23.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85cd7fa700 1 -- 172.21.15.5:0/2722955757 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc005430 con 0x7f85d00cb050 2023-03-03T06:24:23.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85cd7fa700 1 -- 172.21.15.5:0/2722955757 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0038a0 con 0x7f85d00cb050 2023-03-03T06:24:23.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.259+0000 7f85d7087700 1 -- 172.21.15.5:0/2722955757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d006c7b0 con 0x7f85d00cb050 2023-03-03T06:24:23.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.260+0000 7f85d7087700 1 -- 172.21.15.5:0/2722955757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b00052e0 con 0x7f85d00cb050 2023-03-03T06:24:23.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.261+0000 7f85cd7fa700 1 -- 172.21.15.5:0/2722955757 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f85bc019030 con 0x7f85d00cb050 2023-03-03T06:24:23.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.261+0000 7f85cd7fa700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f85b40682f0 0x7f85b406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.261+0000 7f85cd7fa700 1 -- 172.21.15.5:0/2722955757 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85bc085370 con 0x7f85d00cb050 2023-03-03T06:24:23.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.261+0000 7f85d4e23700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f85b40682f0 0x7f85b406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.261+0000 7f85d4e23700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f85b40682f0 0x7f85b406a7a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f85c40097c0 tx=0x7f85c4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:23.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.265+0000 7f85cd7fa700 1 -- 172.21.15.5:0/2722955757 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f85bc051860 con 0x7f85d00cb050 2023-03-03T06:24:23.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.458+0000 7f85d7087700 1 -- 172.21.15.5:0/2722955757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f85b0005b10 con 0x7f85d00cb050 2023-03-03T06:24:23.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.458+0000 7f85cd7fa700 1 -- 172.21.15.5:0/2722955757 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f85bc054e80 con 0x7f85d00cb050 2023-03-03T06:24:23.461 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:24:23.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.460+0000 7f85d7087700 1 -- 172.21.15.5:0/2722955757 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f85b40682f0 msgr2=0x7f85b406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.460+0000 7f85d7087700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f85b40682f0 0x7f85b406a7a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f85c40097c0 tx=0x7f85c4008030 comp rx=0 tx=0).stop 2023-03-03T06:24:23.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.460+0000 7f85d7087700 1 -- 172.21.15.5:0/2722955757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d00cb050 msgr2=0x7f85d01f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.460+0000 7f85d7087700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d00cb050 0x7f85d01f5a10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00c520 tx=0x7f85bc00c830 comp rx=0 tx=0).stop 2023-03-03T06:24:23.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.460+0000 7f85d7087700 1 -- 172.21.15.5:0/2722955757 shutdown_connections 2023-03-03T06:24:23.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.460+0000 7f85d7087700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f85d015cd40 0x7f85d01f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.460+0000 7f85d7087700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f85b40682f0 0x7f85b406a7a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.460+0000 7f85d7087700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f85d00b1960 0x7f85d015fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.460+0000 7f85d7087700 1 --2- 172.21.15.5:0/2722955757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d00cb050 0x7f85d01f5a10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.460+0000 7f85d7087700 1 -- 172.21.15.5:0/2722955757 >> 172.21.15.5:0/2722955757 conn(0x7f85d00cc8d0 msgr2=0x7f85d015c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:23.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.460+0000 7f85d7087700 1 -- 172.21.15.5:0/2722955757 shutdown_connections 2023-03-03T06:24:23.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.460+0000 7f85d7087700 1 -- 172.21.15.5:0/2722955757 wait complete. 2023-03-03T06:24:23.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-03T06:24:23.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.602+0000 7fae0c02b700 1 Processor -- start 2023-03-03T06:24:23.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.602+0000 7fae0c02b700 1 -- start start 2023-03-03T06:24:23.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.603+0000 7fae0c02b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae0406d130 0x7fae0406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.603+0000 7fae0c02b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fae0406e140 0x7fae040cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.603+0000 7fae0c02b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0406e590 con 0x7fae040cf010 2023-03-03T06:24:23.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.603+0000 7fae0c02b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae040cf720 con 0x7fae0406e140 2023-03-03T06:24:23.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.603+0000 7fae0c02b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0415e110 con 0x7fae0406d130 2023-03-03T06:24:23.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.603+0000 7fae0a5c8700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fae040cf010 0x7fae0406f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60516/0 (socket says 172.21.15.5:60516) 2023-03-03T06:24:23.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.603+0000 7fae0a5c8700 1 -- 172.21.15.5:0/1727720698 learned_addr learned my addr 172.21.15.5:0/1727720698 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:23.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.603+0000 7fae09dc7700 1 --2- 172.21.15.5:0/1727720698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae0406d130 0x7fae0406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.603+0000 7fae095c6700 1 --2- 172.21.15.5:0/1727720698 >> v2:172.21.15.191:3300/0 conn(0x7fae0406e140 0x7fae040cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.603+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154400601 0 0) 0x7fadfc001490 con 0x7fae040cf010 2023-03-03T06:24:23.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.603+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf00035b0 con 0x7fae040cf010 2023-03-03T06:24:23.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1742061215 0 0) 0x7fadf00035b0 con 0x7fae040cf010 2023-03-03T06:24:23.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae0406d130 msgr2=0x7fae0406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:23.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 --2- 172.21.15.5:0/1727720698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae0406d130 0x7fae0406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 >> v2:172.21.15.191:3300/0 conn(0x7fae0406e140 msgr2=0x7fae040cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:23.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 --2- 172.21.15.5:0/1727720698 >> v2:172.21.15.191:3300/0 conn(0x7fae0406e140 0x7fae040cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae040cf470 con 0x7fae040cf010 2023-03-03T06:24:23.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fadfc001b80 con 0x7fae040cf010 2023-03-03T06:24:23.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 >> v1:172.21.15.5:6789/0 conn(0x7fae040cf010 legacy=0x7fae0406f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 --2- 172.21.15.5:0/1727720698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf0003a00 0x7fadf0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 --2- 172.21.15.5:0/1727720698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae0406d130 0x7fadf0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 --2- 172.21.15.5:0/1727720698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf0004d90 0x7fadf0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae040cf720 con 0x7fadf0004d90 2023-03-03T06:24:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0415e110 con 0x7fadf0003a00 2023-03-03T06:24:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf000ba10 con 0x7fae0406d130 2023-03-03T06:24:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae0a5c8700 1 --2- 172.21.15.5:0/1727720698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf0004d90 0x7fadf0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae09dc7700 1 --2- 172.21.15.5:0/1727720698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf0003a00 0x7fadf0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae095c6700 1 --2- 172.21.15.5:0/1727720698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae0406d130 0x7fadf0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae0a5c8700 1 -- 172.21.15.5:0/1727720698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae0406d130 msgr2=0x7fadf0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:23.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae0a5c8700 1 --2- 172.21.15.5:0/1727720698 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae0406d130 0x7fadf0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae0a5c8700 1 -- 172.21.15.5:0/1727720698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf0003a00 msgr2=0x7fadf0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:23.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae0a5c8700 1 --2- 172.21.15.5:0/1727720698 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadf0003a00 0x7fadf0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae0a5c8700 1 -- 172.21.15.5:0/1727720698 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00035b0 con 0x7fadf0004d90 2023-03-03T06:24:23.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae0a5c8700 1 --2- 172.21.15.5:0/1727720698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf0004d90 0x7fadf0005200 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00a860 tx=0x7fadf0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95d5612b80913c3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:23.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.604+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc00a4c0 con 0x7fadf0004d90 2023-03-03T06:24:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.605+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc012600 con 0x7fadf0004d90 2023-03-03T06:24:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.605+0000 7fae08dc5700 1 -- 172.21.15.5:0/1727720698 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0129b0 con 0x7fadf0004d90 2023-03-03T06:24:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.605+0000 7fae0c02b700 1 -- 172.21.15.5:0/1727720698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf0004d90 msgr2=0x7fadf0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.605+0000 7fae0c02b700 1 --2- 172.21.15.5:0/1727720698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf0004d90 0x7fadf0005200 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00a860 tx=0x7fadf0005880 comp rx=0 tx=0).stop 2023-03-03T06:24:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.605+0000 7fae0a5c8700 1 -- 172.21.15.5:0/1727720698 reap_dead start 2023-03-03T06:24:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.605+0000 7fae0c02b700 1 -- 172.21.15.5:0/1727720698 shutdown_connections 2023-03-03T06:24:23.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.605+0000 7fae0c02b700 1 -- 172.21.15.5:0/1727720698 >> 172.21.15.5:0/1727720698 conn(0x7fae040cfd00 msgr2=0x7fae040d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:23.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.605+0000 7fae0c02b700 1 -- 172.21.15.5:0/1727720698 shutdown_connections 2023-03-03T06:24:23.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.605+0000 7fae0c02b700 1 -- 172.21.15.5:0/1727720698 wait complete. 2023-03-03T06:24:23.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.607+0000 7fae0c02b700 1 Processor -- start 2023-03-03T06:24:23.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.607+0000 7fae0c02b700 1 -- start start 2023-03-03T06:24:23.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.607+0000 7fae0c02b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf0004d90 0x7fae040c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.607+0000 7fae0c02b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae041e3d50 0x7fae040c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.607+0000 7fae0c02b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae040b0370 0x7fae040c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.607+0000 7fae0c02b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae040c5230 con 0x7fadf0004d90 2023-03-03T06:24:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.607+0000 7fae0c02b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae040c80a0 con 0x7fae041e3d50 2023-03-03T06:24:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.607+0000 7fae0c02b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae040c4900 con 0x7fae040b0370 2023-03-03T06:24:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.607+0000 7fae09dc7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf0004d90 0x7fae040c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.607+0000 7fae09dc7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf0004d90 0x7fae040c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42450/0 (socket says 172.21.15.5:42450) 2023-03-03T06:24:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.607+0000 7fae09dc7700 1 -- 172.21.15.5:0/1492464657 learned_addr learned my addr 172.21.15.5:0/1492464657 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fae095c6700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae041e3d50 0x7fae040c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fae0a5c8700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae040b0370 0x7fae040c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fae09dc7700 1 -- 172.21.15.5:0/1492464657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae040b0370 msgr2=0x7fae040c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fae09dc7700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae040b0370 0x7fae040c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fae09dc7700 1 -- 172.21.15.5:0/1492464657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae041e3d50 msgr2=0x7fae040c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fae09dc7700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae041e3d50 0x7fae040c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fae09dc7700 1 -- 172.21.15.5:0/1492464657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0415d630 con 0x7fadf0004d90 2023-03-03T06:24:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fae0a5c8700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae040b0370 0x7fae040c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fae09dc7700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf0004d90 0x7fae040c77e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fadf4011aa0 tx=0x7fadf4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fadfa7fc700 1 -- 172.21.15.5:0/1492464657 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf400f980 con 0x7fadf0004d90 2023-03-03T06:24:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fadfa7fc700 1 -- 172.21.15.5:0/1492464657 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf400fae0 con 0x7fadf0004d90 2023-03-03T06:24:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fae0c02b700 1 -- 172.21.15.5:0/1492464657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0415d350 con 0x7fadf0004d90 2023-03-03T06:24:23.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fadfa7fc700 1 -- 172.21.15.5:0/1492464657 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf400fe90 con 0x7fadf0004d90 2023-03-03T06:24:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.608+0000 7fae0c02b700 1 -- 172.21.15.5:0/1492464657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0415d910 con 0x7fadf0004d90 2023-03-03T06:24:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.609+0000 7fae0c02b700 1 -- 172.21.15.5:0/1492464657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae040c5510 con 0x7fadf0004d90 2023-03-03T06:24:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.610+0000 7fadfa7fc700 1 -- 172.21.15.5:0/1492464657 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fadf40263f0 con 0x7fadf0004d90 2023-03-03T06:24:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.610+0000 7fadfa7fc700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fade80682f0 0x7fade806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.610+0000 7fadfa7fc700 1 -- 172.21.15.5:0/1492464657 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fadf4086c50 con 0x7fadf0004d90 2023-03-03T06:24:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.611+0000 7fae095c6700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fade80682f0 0x7fade806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.611+0000 7fae095c6700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fade80682f0 0x7fade806a7a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fae041f3670 tx=0x7fae00008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:23.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.614+0000 7fadfa7fc700 1 -- 172.21.15.5:0/1492464657 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fadf4056d50 con 0x7fadf0004d90 2023-03-03T06:24:23.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.807+0000 7fae0c02b700 1 -- 172.21.15.5:0/1492464657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fae0406d840 con 0x7fadf0004d90 2023-03-03T06:24:23.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.808+0000 7fadfa7fc700 1 -- 172.21.15.5:0/1492464657 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fadf40568e0 con 0x7fadf0004d90 2023-03-03T06:24:23.811 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.810+0000 7fae0c02b700 1 -- 172.21.15.5:0/1492464657 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fade80682f0 msgr2=0x7fade806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.810+0000 7fae0c02b700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fade80682f0 0x7fade806a7a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fae041f3670 tx=0x7fae00008040 comp rx=0 tx=0).stop 2023-03-03T06:24:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.810+0000 7fae0c02b700 1 -- 172.21.15.5:0/1492464657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf0004d90 msgr2=0x7fae040c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.810+0000 7fae0c02b700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf0004d90 0x7fae040c77e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fadf4011aa0 tx=0x7fadf4011e60 comp rx=0 tx=0).stop 2023-03-03T06:24:23.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.810+0000 7fae0c02b700 1 -- 172.21.15.5:0/1492464657 shutdown_connections 2023-03-03T06:24:23.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.810+0000 7fae0c02b700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fade80682f0 0x7fade806a7a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.810+0000 7fae0c02b700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fae040b0370 0x7fae040c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.810+0000 7fae0c02b700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf0004d90 0x7fae040c77e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.810+0000 7fae0c02b700 1 --2- 172.21.15.5:0/1492464657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fae041e3d50 0x7fae040c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.810+0000 7fae0c02b700 1 -- 172.21.15.5:0/1492464657 >> 172.21.15.5:0/1492464657 conn(0x7fae040cfd00 msgr2=0x7fae0415a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.810+0000 7fae0c02b700 1 -- 172.21.15.5:0/1492464657 shutdown_connections 2023-03-03T06:24:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.810+0000 7fae0c02b700 1 -- 172.21.15.5:0/1492464657 wait complete. 2023-03-03T06:24:23.843 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.965+0000 7f767e0be700 1 Processor -- start 2023-03-03T06:24:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.965+0000 7f767e0be700 1 -- start start 2023-03-03T06:24:23.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.966+0000 7f767e0be700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76780ca210 0x7f7678160360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.966+0000 7f767e0be700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f767806dc90 0x7f76780cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.966+0000 7f767e0be700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7678161290 con 0x7f7678146100 2023-03-03T06:24:23.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.966+0000 7f767e0be700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76780cd520 con 0x7f767806dc90 2023-03-03T06:24:23.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.966+0000 7f767e0be700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7678160cd0 con 0x7f76780ca210 2023-03-03T06:24:23.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f76777fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76780ca210 0x7f7678160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f7677fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f767806dc90 0x7f76780cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f7676ffd700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f7678146100 0x7f767806d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:46830/0 (socket says 172.21.15.5:46830) 2023-03-03T06:24:23.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f7676ffd700 1 -- 172.21.15.5:0/3646957017 learned_addr learned my addr 172.21.15.5:0/3646957017 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:23.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f7677fff700 1 -- 172.21.15.5:0/3646957017 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76780ca210 msgr2=0x7f7678160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:23.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f7677fff700 1 --2- 172.21.15.5:0/3646957017 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76780ca210 0x7f7678160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f7677fff700 1 -- 172.21.15.5:0/3646957017 >> v1:172.21.15.191:6789/0 conn(0x7f7678146100 legacy=0x7f767806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f7677fff700 1 -- 172.21.15.5:0/3646957017 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678160fb0 con 0x7f767806dc90 2023-03-03T06:24:23.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f76767fc700 1 -- 172.21.15.5:0/3646957017 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735206090 0 0) 0x7f7678161290 con 0x7f7678146100 2023-03-03T06:24:23.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f76777fe700 1 --2- 172.21.15.5:0/3646957017 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76780ca210 0x7f7678160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f7677fff700 1 --2- 172.21.15.5:0/3646957017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f767806dc90 0x7f76780cd9b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7670009d90 tx=0x7f767000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68078514eb47ea06 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f76767fc700 1 -- 172.21.15.5:0/3646957017 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767000e070 con 0x7f767806dc90 2023-03-03T06:24:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f76767fc700 1 -- 172.21.15.5:0/3646957017 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767000bb20 con 0x7f767806dc90 2023-03-03T06:24:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.967+0000 7f76767fc700 1 -- 172.21.15.5:0/3646957017 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670012430 con 0x7f767806dc90 2023-03-03T06:24:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.968+0000 7f767e0be700 1 -- 172.21.15.5:0/3646957017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f767806dc90 msgr2=0x7f76780cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.968+0000 7f767e0be700 1 --2- 172.21.15.5:0/3646957017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f767806dc90 0x7f76780cd9b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7670009d90 tx=0x7f767000b330 comp rx=0 tx=0).stop 2023-03-03T06:24:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.968+0000 7f767e0be700 1 -- 172.21.15.5:0/3646957017 shutdown_connections 2023-03-03T06:24:23.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.968+0000 7f767e0be700 1 --2- 172.21.15.5:0/3646957017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f767806dc90 0x7f76780cd9b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.968+0000 7f767e0be700 1 --2- 172.21.15.5:0/3646957017 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76780ca210 0x7f7678160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.968+0000 7f767e0be700 1 -- 172.21.15.5:0/3646957017 >> 172.21.15.5:0/3646957017 conn(0x7f76780cf4b0 msgr2=0x7f76780cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.968+0000 7f767e0be700 1 -- 172.21.15.5:0/3646957017 shutdown_connections 2023-03-03T06:24:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.968+0000 7f767e0be700 1 -- 172.21.15.5:0/3646957017 wait complete. 2023-03-03T06:24:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.969+0000 7f767e0be700 1 Processor -- start 2023-03-03T06:24:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.969+0000 7f767e0be700 1 -- start start 2023-03-03T06:24:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f767e0be700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f767806dc90 0x7f767806be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f767e0be700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76780ca210 0x7f76781458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f767e0be700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7678146100 0x7f76781f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f767e0be700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76781f6650 con 0x7f767806dc90 2023-03-03T06:24:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f767e0be700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780b4d30 con 0x7f7678146100 2023-03-03T06:24:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f767e0be700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76780b4120 con 0x7f76780ca210 2023-03-03T06:24:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f76777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f767806dc90 0x7f767806be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f76777fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f767806dc90 0x7f767806be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42464/0 (socket says 172.21.15.5:42464) 2023-03-03T06:24:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f76777fe700 1 -- 172.21.15.5:0/824074651 learned_addr learned my addr 172.21.15.5:0/824074651 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f7677fff700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7678146100 0x7f76781f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f7676ffd700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76780ca210 0x7f76781458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f76777fe700 1 -- 172.21.15.5:0/824074651 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76780ca210 msgr2=0x7f76781458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f76777fe700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76780ca210 0x7f76781458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f76777fe700 1 -- 172.21.15.5:0/824074651 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7678146100 msgr2=0x7f76781f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:23.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f76777fe700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7678146100 0x7f76781f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.970+0000 7f76777fe700 1 -- 172.21.15.5:0/824074651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76680094a0 con 0x7f767806dc90 2023-03-03T06:24:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.971+0000 7f76777fe700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f767806dc90 0x7f767806be50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f766800ec10 tx=0x7f766800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:23.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.971+0000 7f766ffff700 1 -- 172.21.15.5:0/824074651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766800c850 con 0x7f767806dc90 2023-03-03T06:24:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.971+0000 7f766ffff700 1 -- 172.21.15.5:0/824074651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766800c9b0 con 0x7f767806dc90 2023-03-03T06:24:23.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.971+0000 7f767e0be700 1 -- 172.21.15.5:0/824074651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7670009a70 con 0x7f767806dc90 2023-03-03T06:24:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.971+0000 7f766ffff700 1 -- 172.21.15.5:0/824074651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766800cd20 con 0x7f767806dc90 2023-03-03T06:24:23.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.971+0000 7f767e0be700 1 -- 172.21.15.5:0/824074651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76780ca5e0 con 0x7f767806dc90 2023-03-03T06:24:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.972+0000 7f767e0be700 1 -- 172.21.15.5:0/824074651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76780cd1b0 con 0x7f767806dc90 2023-03-03T06:24:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.972+0000 7f766ffff700 1 -- 172.21.15.5:0/824074651 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7668019030 con 0x7f767806dc90 2023-03-03T06:24:23.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.973+0000 7f766ffff700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76580682f0 0x7f765806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.973+0000 7f766ffff700 1 -- 172.21.15.5:0/824074651 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7668085e90 con 0x7f767806dc90 2023-03-03T06:24:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.973+0000 7f7676ffd700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76580682f0 0x7f765806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.973+0000 7f7676ffd700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76580682f0 0x7f765806a7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76780c9900 tx=0x7f7660007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:23.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:23.977+0000 7f766ffff700 1 -- 172.21.15.5:0/824074651 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7668052400 con 0x7f767806dc90 2023-03-03T06:24:24.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.168+0000 7f767e0be700 1 -- 172.21.15.5:0/824074651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76780ca770 con 0x7f767806dc90 2023-03-03T06:24:24.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.170+0000 7f766ffff700 1 -- 172.21.15.5:0/824074651 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7f7668021090 con 0x7f767806dc90 2023-03-03T06:24:24.173 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:24.173 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:24.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.172+0000 7f767e0be700 1 -- 172.21.15.5:0/824074651 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76580682f0 msgr2=0x7f765806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.172+0000 7f767e0be700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76580682f0 0x7f765806a7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76780c9900 tx=0x7f7660007de0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.172+0000 7f767e0be700 1 -- 172.21.15.5:0/824074651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f767806dc90 msgr2=0x7f767806be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.172+0000 7f767e0be700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f767806dc90 0x7f767806be50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f766800ec10 tx=0x7f766800ef20 comp rx=0 tx=0).stop 2023-03-03T06:24:24.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.172+0000 7f767e0be700 1 -- 172.21.15.5:0/824074651 shutdown_connections 2023-03-03T06:24:24.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.172+0000 7f767e0be700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7678146100 0x7f76781f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.172+0000 7f767e0be700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f767806dc90 0x7f767806be50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.172+0000 7f767e0be700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76580682f0 0x7f765806a7a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.172+0000 7f767e0be700 1 --2- 172.21.15.5:0/824074651 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f76780ca210 0x7f76781458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.172+0000 7f767e0be700 1 -- 172.21.15.5:0/824074651 >> 172.21.15.5:0/824074651 conn(0x7f76780cf4b0 msgr2=0x7f767815d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:24.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.172+0000 7f767e0be700 1 -- 172.21.15.5:0/824074651 shutdown_connections 2023-03-03T06:24:24.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.172+0000 7f767e0be700 1 -- 172.21.15.5:0/824074651 wait complete. 2023-03-03T06:24:24.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:23:38.141777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:23:39.283589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-03T06:23:42.422930+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-03T06:24:24.188 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:24:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.313+0000 7f3859052700 1 Processor -- start 2023-03-03T06:24:24.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.314+0000 7f3859052700 1 -- start start 2023-03-03T06:24:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.314+0000 7f3859052700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f385415a460 0x7f38540cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:24.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.314+0000 7f3859052700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f38540cdf70 0x7f38540cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.314+0000 7f3859052700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38540cd650 con 0x7f385415a830 2023-03-03T06:24:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.314+0000 7f3859052700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38540cb4a0 con 0x7f385415a460 2023-03-03T06:24:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.314+0000 7f3859052700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38540d16a0 con 0x7f38540cdf70 2023-03-03T06:24:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.314+0000 7f3852d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f385415a460 0x7f38540cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:24.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.315+0000 7f3852d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f385415a460 0x7f38540cd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42472/0 (socket says 172.21.15.5:42472) 2023-03-03T06:24:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.315+0000 7f385259c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f385415a830 0x7f38540cd860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60546/0 (socket says 172.21.15.5:60546) 2023-03-03T06:24:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.315+0000 7f3852d9d700 1 -- 172.21.15.5:0/2383486168 learned_addr learned my addr 172.21.15.5:0/2383486168 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.315+0000 7f385359e700 1 --2- 172.21.15.5:0/2383486168 >> v2:172.21.15.191:3300/0 conn(0x7f38540cdf70 0x7f38540cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.315+0000 7f3852d9d700 1 -- 172.21.15.5:0/2383486168 >> v2:172.21.15.191:3300/0 conn(0x7f38540cdf70 msgr2=0x7f38540cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.315+0000 7f3852d9d700 1 --2- 172.21.15.5:0/2383486168 >> v2:172.21.15.191:3300/0 conn(0x7f38540cdf70 0x7f38540cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.315+0000 7f3852d9d700 1 -- 172.21.15.5:0/2383486168 >> v1:172.21.15.5:6789/0 conn(0x7f385415a830 legacy=0x7f38540cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.315+0000 7f3852d9d700 1 -- 172.21.15.5:0/2383486168 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38540cbc70 con 0x7f385415a460 2023-03-03T06:24:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.315+0000 7f3851d9b700 1 -- 172.21.15.5:0/2383486168 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840189013 0 0) 0x7f38540cd650 con 0x7f385415a830 2023-03-03T06:24:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.315+0000 7f3852d9d700 1 --2- 172.21.15.5:0/2383486168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385415a460 0x7f38540cd110 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f385408a280 tx=0x7f3844009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced9ad0bae7c4c7d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.315+0000 7f3851d9b700 1 -- 172.21.15.5:0/2383486168 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400b870 con 0x7f385415a460 2023-03-03T06:24:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.315+0000 7f3851d9b700 1 -- 172.21.15.5:0/2383486168 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384400b9d0 con 0x7f385415a460 2023-03-03T06:24:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.315+0000 7f3851d9b700 1 -- 172.21.15.5:0/2383486168 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400bd60 con 0x7f385415a460 2023-03-03T06:24:24.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.316+0000 7f3859052700 1 -- 172.21.15.5:0/2383486168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385415a460 msgr2=0x7f38540cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.316+0000 7f3859052700 1 --2- 172.21.15.5:0/2383486168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385415a460 0x7f38540cd110 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f385408a280 tx=0x7f3844009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.316+0000 7f3859052700 1 -- 172.21.15.5:0/2383486168 shutdown_connections 2023-03-03T06:24:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.316+0000 7f3859052700 1 --2- 172.21.15.5:0/2383486168 >> v2:172.21.15.191:3300/0 conn(0x7f38540cdf70 0x7f38540cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.316+0000 7f3859052700 1 --2- 172.21.15.5:0/2383486168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f385415a460 0x7f38540cd110 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.316+0000 7f3859052700 1 -- 172.21.15.5:0/2383486168 >> 172.21.15.5:0/2383486168 conn(0x7f385406f3c0 msgr2=0x7f385406f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.316+0000 7f3859052700 1 -- 172.21.15.5:0/2383486168 shutdown_connections 2023-03-03T06:24:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.316+0000 7f3859052700 1 -- 172.21.15.5:0/2383486168 wait complete. 2023-03-03T06:24:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.317+0000 7f3859052700 1 Processor -- start 2023-03-03T06:24:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.317+0000 7f3859052700 1 -- start start 2023-03-03T06:24:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3859052700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38540cdf70 0x7f38540b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3859052700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f385415a460 0x7f38540c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3859052700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f385415a830 0x7f385413fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3859052700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3854143ef0 con 0x7f38540cdf70 2023-03-03T06:24:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3859052700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540c9980 con 0x7f385415a460 2023-03-03T06:24:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3859052700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38540c9c60 con 0x7f385415a830 2023-03-03T06:24:24.328 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3852d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38540cdf70 0x7f38540b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3852d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38540cdf70 0x7f38540b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42478/0 (socket says 172.21.15.5:42478) 2023-03-03T06:24:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3852d9d700 1 -- 172.21.15.5:0/2927002769 learned_addr learned my addr 172.21.15.5:0/2927002769 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f385359e700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f385415a830 0x7f385413fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f385259c700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f385415a460 0x7f38540c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3852d9d700 1 -- 172.21.15.5:0/2927002769 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f385415a830 msgr2=0x7f385413fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3852d9d700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f385415a830 0x7f385413fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3852d9d700 1 -- 172.21.15.5:0/2927002769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f385415a460 msgr2=0x7f38540c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3852d9d700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f385415a460 0x7f38540c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f3852d9d700 1 -- 172.21.15.5:0/2927002769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3844009550 con 0x7f38540cdf70 2023-03-03T06:24:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.318+0000 7f385259c700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f385415a460 0x7f38540c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.319+0000 7f3852d9d700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38540cdf70 0x7f38540b64a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3844009c10 tx=0x7f3844004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.319+0000 7f384b7fe700 1 -- 172.21.15.5:0/2927002769 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844004250 con 0x7f38540cdf70 2023-03-03T06:24:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.319+0000 7f384b7fe700 1 -- 172.21.15.5:0/2927002769 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384401f070 con 0x7f38540cdf70 2023-03-03T06:24:24.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.319+0000 7f3859052700 1 -- 172.21.15.5:0/2927002769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38540cb990 con 0x7f38540cdf70 2023-03-03T06:24:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.319+0000 7f384b7fe700 1 -- 172.21.15.5:0/2927002769 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38440045d0 con 0x7f38540cdf70 2023-03-03T06:24:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.319+0000 7f3859052700 1 -- 172.21.15.5:0/2927002769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38540cb6b0 con 0x7f38540cdf70 2023-03-03T06:24:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.320+0000 7f3859052700 1 -- 172.21.15.5:0/2927002769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38540d1940 con 0x7f38540cdf70 2023-03-03T06:24:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.320+0000 7f384b7fe700 1 -- 172.21.15.5:0/2927002769 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f384402a020 con 0x7f38540cdf70 2023-03-03T06:24:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.321+0000 7f384b7fe700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38340682f0 0x7f383406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.321+0000 7f384b7fe700 1 -- 172.21.15.5:0/2927002769 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f38440875d0 con 0x7f38540cdf70 2023-03-03T06:24:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.321+0000 7f385259c700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38340682f0 0x7f383406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:24.331 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.321+0000 7f385259c700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38340682f0 0x7f383406a7a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f383c007fd0 tx=0x7f383c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:24.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.325+0000 7f384b7fe700 1 -- 172.21.15.5:0/2927002769 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3844053ac0 con 0x7f38540cdf70 2023-03-03T06:24:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.519+0000 7f3859052700 1 -- 172.21.15.5:0/2927002769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3854140ff0 con 0x7f38540cdf70 2023-03-03T06:24:24.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.519+0000 7f384b7fe700 1 -- 172.21.15.5:0/2927002769 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f38440570e0 con 0x7f38540cdf70 2023-03-03T06:24:24.522 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:24:24.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.521+0000 7f3859052700 1 -- 172.21.15.5:0/2927002769 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38340682f0 msgr2=0x7f383406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.521+0000 7f3859052700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38340682f0 0x7f383406a7a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f383c007fd0 tx=0x7f383c009040 comp rx=0 tx=0).stop 2023-03-03T06:24:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.521+0000 7f3859052700 1 -- 172.21.15.5:0/2927002769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38540cdf70 msgr2=0x7f38540b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.521+0000 7f3859052700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38540cdf70 0x7f38540b64a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3844009c10 tx=0x7f3844004750 comp rx=0 tx=0).stop 2023-03-03T06:24:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.521+0000 7f3859052700 1 -- 172.21.15.5:0/2927002769 shutdown_connections 2023-03-03T06:24:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.521+0000 7f3859052700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38340682f0 0x7f383406a7a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.521+0000 7f3859052700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f385415a830 0x7f385413fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.521+0000 7f3859052700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38540cdf70 0x7f38540b64a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.521+0000 7f3859052700 1 --2- 172.21.15.5:0/2927002769 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f385415a460 0x7f38540c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.521+0000 7f3859052700 1 -- 172.21.15.5:0/2927002769 >> 172.21.15.5:0/2927002769 conn(0x7f385406f3c0 msgr2=0x7f3854070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:24.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.521+0000 7f3859052700 1 -- 172.21.15.5:0/2927002769 shutdown_connections 2023-03-03T06:24:24.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.521+0000 7f3859052700 1 -- 172.21.15.5:0/2927002769 wait complete. 2023-03-03T06:24:24.536 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:24:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.662+0000 7f8c332b9700 1 Processor -- start 2023-03-03T06:24:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.662+0000 7f8c332b9700 1 -- start start 2023-03-03T06:24:24.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c332b9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8c2c15a830 0x7f8c2c0cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c332b9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c0d16a0 con 0x7f8c2c15a460 2023-03-03T06:24:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c332b9700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c0cbc70 con 0x7f8c2c0b01a0 2023-03-03T06:24:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c332b9700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2c0cb4a0 con 0x7f8c2c15a830 2023-03-03T06:24:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c30854700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8c2c15a830 0x7f8c2c0cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c31055700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8c2c15a460 0x7f8c2c0cd110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60560/0 (socket says 172.21.15.5:60560) 2023-03-03T06:24:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c31055700 1 -- 172.21.15.5:0/1166444006 learned_addr learned my addr 172.21.15.5:0/1166444006 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c30854700 1 -- 172.21.15.5:0/1166444006 >> v1:172.21.15.191:6789/0 conn(0x7f8c2c0b01a0 legacy=0x7f8c2c0cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c30854700 1 -- 172.21.15.5:0/1166444006 >> v1:172.21.15.5:6789/0 conn(0x7f8c2c15a460 legacy=0x7f8c2c0cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c30854700 1 -- 172.21.15.5:0/1166444006 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0cb6b0 con 0x7f8c2c15a830 2023-03-03T06:24:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c30854700 1 --2- 172.21.15.5:0/1166444006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c15a830 0x7f8c2c0cd860 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009840 tx=0x7f8c1c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41929e8b7b8480af server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c23fff700 1 -- 172.21.15.5:0/1166444006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c004230 con 0x7f8c2c15a830 2023-03-03T06:24:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c23fff700 1 -- 172.21.15.5:0/1166444006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c004390 con 0x7f8c2c15a830 2023-03-03T06:24:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.663+0000 7f8c23fff700 1 -- 172.21.15.5:0/1166444006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c0036a0 con 0x7f8c2c15a830 2023-03-03T06:24:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.664+0000 7f8c332b9700 1 -- 172.21.15.5:0/1166444006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c15a830 msgr2=0x7f8c2c0cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.664+0000 7f8c332b9700 1 --2- 172.21.15.5:0/1166444006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c15a830 0x7f8c2c0cd860 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009840 tx=0x7f8c1c009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.664+0000 7f8c332b9700 1 -- 172.21.15.5:0/1166444006 shutdown_connections 2023-03-03T06:24:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.664+0000 7f8c332b9700 1 --2- 172.21.15.5:0/1166444006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c15a830 0x7f8c2c0cd860 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.664+0000 7f8c332b9700 1 -- 172.21.15.5:0/1166444006 >> 172.21.15.5:0/1166444006 conn(0x7f8c2c06f3c0 msgr2=0x7f8c2c06f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.664+0000 7f8c332b9700 1 -- 172.21.15.5:0/1166444006 shutdown_connections 2023-03-03T06:24:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.664+0000 7f8c332b9700 1 -- 172.21.15.5:0/1166444006 wait complete. 2023-03-03T06:24:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.665+0000 7f8c332b9700 1 Processor -- start 2023-03-03T06:24:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.665+0000 7f8c332b9700 1 -- start start 2023-03-03T06:24:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c332b9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c2c0b01a0 0x7f8c2c0b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c332b9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c15a460 0x7f8c2c0b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c332b9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c2c15a830 0x7f8c2c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c332b9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0c85e0 con 0x7f8c2c15a460 2023-03-03T06:24:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c332b9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c1f3600 con 0x7f8c2c0b01a0 2023-03-03T06:24:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c332b9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c15c970 con 0x7f8c2c15a830 2023-03-03T06:24:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c30854700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c15a460 0x7f8c2c0b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c30854700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c15a460 0x7f8c2c0b0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42494/0 (socket says 172.21.15.5:42494) 2023-03-03T06:24:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c30854700 1 -- 172.21.15.5:0/2166311832 learned_addr learned my addr 172.21.15.5:0/2166311832 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c31055700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c2c0b01a0 0x7f8c2c0b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c31856700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c2c15a830 0x7f8c2c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c30854700 1 -- 172.21.15.5:0/2166311832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c2c15a830 msgr2=0x7f8c2c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c30854700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c2c15a830 0x7f8c2c15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c30854700 1 -- 172.21.15.5:0/2166311832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c2c0b01a0 msgr2=0x7f8c2c0b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c30854700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c2c0b01a0 0x7f8c2c0b5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.666+0000 7f8c30854700 1 -- 172.21.15.5:0/2166311832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c0094a0 con 0x7f8c2c15a460 2023-03-03T06:24:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.667+0000 7f8c30854700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c15a460 0x7f8c2c0b0e90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0090b0 tx=0x7f8c1c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.667+0000 7f8c21ffb700 1 -- 172.21.15.5:0/2166311832 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c011630 con 0x7f8c2c15a460 2023-03-03T06:24:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.667+0000 7f8c21ffb700 1 -- 172.21.15.5:0/2166311832 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c011790 con 0x7f8c2c15a460 2023-03-03T06:24:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.667+0000 7f8c332b9700 1 -- 172.21.15.5:0/2166311832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c0d1940 con 0x7f8c2c15a460 2023-03-03T06:24:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.667+0000 7f8c21ffb700 1 -- 172.21.15.5:0/2166311832 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c011b40 con 0x7f8c2c15a460 2023-03-03T06:24:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.667+0000 7f8c332b9700 1 -- 172.21.15.5:0/2166311832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c0cb990 con 0x7f8c2c15a460 2023-03-03T06:24:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.668+0000 7f8c332b9700 1 -- 172.21.15.5:0/2166311832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c0cdda0 con 0x7f8c2c15a460 2023-03-03T06:24:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.668+0000 7f8c21ffb700 1 -- 172.21.15.5:0/2166311832 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8c1c017020 con 0x7f8c2c15a460 2023-03-03T06:24:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.669+0000 7f8c21ffb700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c100682f0 0x7f8c1006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.669+0000 7f8c31055700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c100682f0 0x7f8c1006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.669+0000 7f8c21ffb700 1 -- 172.21.15.5:0/2166311832 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c1c087740 con 0x7f8c2c15a460 2023-03-03T06:24:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.669+0000 7f8c31055700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c100682f0 0x7f8c1006a7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c28000f60 tx=0x7f8c28009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.673+0000 7f8c21ffb700 1 -- 172.21.15.5:0/2166311832 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8c1c053cb0 con 0x7f8c2c15a460 2023-03-03T06:24:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.864+0000 7f8c332b9700 1 -- 172.21.15.5:0/2166311832 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8c2c0c8720 con 0x7f8c2c15a460 2023-03-03T06:24:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.864+0000 7f8c21ffb700 1 -- 172.21.15.5:0/2166311832 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8c2c0c8720 con 0x7f8c2c15a460 2023-03-03T06:24:24.867 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:24:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.866+0000 7f8c332b9700 1 -- 172.21.15.5:0/2166311832 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c100682f0 msgr2=0x7f8c1006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.866+0000 7f8c332b9700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c100682f0 0x7f8c1006a7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c28000f60 tx=0x7f8c28009040 comp rx=0 tx=0).stop 2023-03-03T06:24:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.866+0000 7f8c332b9700 1 -- 172.21.15.5:0/2166311832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c15a460 msgr2=0x7f8c2c0b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.866+0000 7f8c332b9700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c15a460 0x7f8c2c0b0e90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0090b0 tx=0x7f8c1c0047c0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.866+0000 7f8c332b9700 1 -- 172.21.15.5:0/2166311832 shutdown_connections 2023-03-03T06:24:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.866+0000 7f8c332b9700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c100682f0 0x7f8c1006a7a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.866+0000 7f8c332b9700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8c2c15a830 0x7f8c2c15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.866+0000 7f8c332b9700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8c2c0b01a0 0x7f8c2c0b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.866+0000 7f8c332b9700 1 --2- 172.21.15.5:0/2166311832 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c2c15a460 0x7f8c2c0b0e90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.866+0000 7f8c332b9700 1 -- 172.21.15.5:0/2166311832 >> 172.21.15.5:0/2166311832 conn(0x7f8c2c06f3c0 msgr2=0x7f8c2c0cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.866+0000 7f8c332b9700 1 -- 172.21.15.5:0/2166311832 shutdown_connections 2023-03-03T06:24:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:24.866+0000 7f8c332b9700 1 -- 172.21.15.5:0/2166311832 wait complete. 2023-03-03T06:24:24.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:24:25.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.006+0000 7f3755fa2700 1 Processor -- start 2023-03-03T06:24:25.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.006+0000 7f3755fa2700 1 -- start start 2023-03-03T06:24:25.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.007+0000 7f3755fa2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37500b1fe0 0x7f37500ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.007+0000 7f3755fa2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375015e160 con 0x7f37500cd3e0 2023-03-03T06:24:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.007+0000 7f3755fa2700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375015d110 con 0x7f375015cd40 2023-03-03T06:24:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.007+0000 7f3755fa2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37500cd870 con 0x7f37500b1fe0 2023-03-03T06:24:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.007+0000 7f374ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37500b1fe0 0x7f37500ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.007+0000 7f374ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f37500b1fe0 0x7f37500ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42504/0 (socket says 172.21.15.5:42504) 2023-03-03T06:24:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.007+0000 7f374ffff700 1 -- 172.21.15.5:0/1037490447 learned_addr learned my addr 172.21.15.5:0/1037490447 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.008+0000 7f374ffff700 1 -- 172.21.15.5:0/1037490447 >> v1:172.21.15.191:6789/0 conn(0x7f375015cd40 legacy=0x7f37500b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.008+0000 7f374ffff700 1 -- 172.21.15.5:0/1037490447 >> v1:172.21.15.5:6789/0 conn(0x7f37500cd3e0 legacy=0x7f37500cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.008+0000 7f374ffff700 1 -- 172.21.15.5:0/1037490447 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375015d3c0 con 0x7f37500b1fe0 2023-03-03T06:24:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.008+0000 7f374e7fc700 1 -- 172.21.15.5:0/1037490447 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86500778 0 0) 0x7f375015e160 con 0x7f37500cd3e0 2023-03-03T06:24:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.008+0000 7f374ffff700 1 --2- 172.21.15.5:0/1037490447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37500b1fe0 0x7f37500ce460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3748009e50 tx=0x7f374800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c902ec4019c0692d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.008+0000 7f374e7fc700 1 -- 172.21.15.5:0/1037490447 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374800e070 con 0x7f37500b1fe0 2023-03-03T06:24:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.008+0000 7f374e7fc700 1 -- 172.21.15.5:0/1037490447 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374800b9c0 con 0x7f37500b1fe0 2023-03-03T06:24:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.008+0000 7f374e7fc700 1 -- 172.21.15.5:0/1037490447 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374800bd70 con 0x7f37500b1fe0 2023-03-03T06:24:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.008+0000 7f3755fa2700 1 -- 172.21.15.5:0/1037490447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37500b1fe0 msgr2=0x7f37500ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.008+0000 7f3755fa2700 1 --2- 172.21.15.5:0/1037490447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37500b1fe0 0x7f37500ce460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3748009e50 tx=0x7f374800b330 comp rx=0 tx=0).stop 2023-03-03T06:24:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.009+0000 7f3755fa2700 1 -- 172.21.15.5:0/1037490447 shutdown_connections 2023-03-03T06:24:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.009+0000 7f3755fa2700 1 --2- 172.21.15.5:0/1037490447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37500b1fe0 0x7f37500ce460 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.009+0000 7f3755fa2700 1 -- 172.21.15.5:0/1037490447 >> 172.21.15.5:0/1037490447 conn(0x7f37500cc8d0 msgr2=0x7f37500cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.009+0000 7f3755fa2700 1 -- 172.21.15.5:0/1037490447 shutdown_connections 2023-03-03T06:24:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.009+0000 7f3755fa2700 1 -- 172.21.15.5:0/1037490447 wait complete. 2023-03-03T06:24:25.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.010+0000 7f3755fa2700 1 Processor -- start 2023-03-03T06:24:25.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.010+0000 7f3755fa2700 1 -- start start 2023-03-03T06:24:25.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.011+0000 7f3755fa2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37500b1fe0 0x7f37500ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.011+0000 7f3755fa2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37500cd3e0 0x7f3750159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.011+0000 7f3755fa2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f375015cd40 0x7f37500ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.011+0000 7f3755fa2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37500add50 con 0x7f375015cd40 2023-03-03T06:24:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.011+0000 7f3755fa2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37500c9d50 con 0x7f37500cd3e0 2023-03-03T06:24:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.011+0000 7f3755fa2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37500ada80 con 0x7f37500b1fe0 2023-03-03T06:24:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.011+0000 7f374ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f375015cd40 0x7f37500ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f374ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f375015cd40 0x7f37500ac250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42510/0 (socket says 172.21.15.5:42510) 2023-03-03T06:24:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f374ffff700 1 -- 172.21.15.5:0/4227307401 learned_addr learned my addr 172.21.15.5:0/4227307401 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f374effd700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37500cd3e0 0x7f3750159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f374f7fe700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37500b1fe0 0x7f37500ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f374ffff700 1 -- 172.21.15.5:0/4227307401 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37500b1fe0 msgr2=0x7f37500ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f374ffff700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37500b1fe0 0x7f37500ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f374ffff700 1 -- 172.21.15.5:0/4227307401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37500cd3e0 msgr2=0x7f3750159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f374ffff700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37500cd3e0 0x7f3750159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f374ffff700 1 -- 172.21.15.5:0/4227307401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3748009b30 con 0x7f375015cd40 2023-03-03T06:24:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f374effd700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37500cd3e0 0x7f3750159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f374ffff700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f375015cd40 0x7f37500ac250 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f374800b730 tx=0x7f3748004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:25.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f3747fff700 1 -- 172.21.15.5:0/4227307401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374801c640 con 0x7f375015cd40 2023-03-03T06:24:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f3747fff700 1 -- 172.21.15.5:0/4227307401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374801c7a0 con 0x7f375015cd40 2023-03-03T06:24:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f3755fa2700 1 -- 172.21.15.5:0/4227307401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375015d980 con 0x7f375015cd40 2023-03-03T06:24:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f3747fff700 1 -- 172.21.15.5:0/4227307401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374801cb50 con 0x7f375015cd40 2023-03-03T06:24:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.012+0000 7f3755fa2700 1 -- 172.21.15.5:0/4227307401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375015d6a0 con 0x7f375015cd40 2023-03-03T06:24:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.013+0000 7f3755fa2700 1 -- 172.21.15.5:0/4227307401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375015dc60 con 0x7f375015cd40 2023-03-03T06:24:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.014+0000 7f3747fff700 1 -- 172.21.15.5:0/4227307401 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3748024030 con 0x7f375015cd40 2023-03-03T06:24:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.014+0000 7f3747fff700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f37300682f0 0x7f373006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.014+0000 7f3747fff700 1 -- 172.21.15.5:0/4227307401 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3748087920 con 0x7f375015cd40 2023-03-03T06:24:25.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.014+0000 7f374f7fe700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f37300682f0 0x7f373006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.015+0000 7f374f7fe700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f37300682f0 0x7f373006a7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3738007fd0 tx=0x7f3738009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:25.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.018+0000 7f3747fff700 1 -- 172.21.15.5:0/4227307401 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3748053e10 con 0x7f375015cd40 2023-03-03T06:24:25.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.209+0000 7f3755fa2700 1 -- 172.21.15.5:0/4227307401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f375004e6e0 con 0x7f375015cd40 2023-03-03T06:24:25.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.209+0000 7f3747fff700 1 -- 172.21.15.5:0/4227307401 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3748057430 con 0x7f375015cd40 2023-03-03T06:24:25.211 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:25.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.211+0000 7f3755fa2700 1 -- 172.21.15.5:0/4227307401 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f37300682f0 msgr2=0x7f373006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.211+0000 7f3755fa2700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f37300682f0 0x7f373006a7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3738007fd0 tx=0x7f3738009040 comp rx=0 tx=0).stop 2023-03-03T06:24:25.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.211+0000 7f3755fa2700 1 -- 172.21.15.5:0/4227307401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f375015cd40 msgr2=0x7f37500ac250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.211+0000 7f3755fa2700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f375015cd40 0x7f37500ac250 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f374800b730 tx=0x7f3748004ad0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.211+0000 7f3755fa2700 1 -- 172.21.15.5:0/4227307401 shutdown_connections 2023-03-03T06:24:25.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.211+0000 7f3755fa2700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f375015cd40 0x7f37500ac250 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.211+0000 7f3755fa2700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f37300682f0 0x7f373006a7a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.211+0000 7f3755fa2700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37500b1fe0 0x7f37500ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.211+0000 7f3755fa2700 1 --2- 172.21.15.5:0/4227307401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37500cd3e0 0x7f3750159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.211+0000 7f3755fa2700 1 -- 172.21.15.5:0/4227307401 >> 172.21.15.5:0/4227307401 conn(0x7f37500cc8d0 msgr2=0x7f37500ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:25.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.211+0000 7f3755fa2700 1 -- 172.21.15.5:0/4227307401 shutdown_connections 2023-03-03T06:24:25.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.211+0000 7f3755fa2700 1 -- 172.21.15.5:0/4227307401 wait complete. 2023-03-03T06:24:25.225 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:24:25.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.350+0000 7fa993b08700 1 Processor -- start 2023-03-03T06:24:25.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.350+0000 7fa993b08700 1 -- start start 2023-03-03T06:24:25.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.351+0000 7fa993b08700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa98c0d0080 0x7fa98c0d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.351+0000 7fa993b08700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c0cb4a0 con 0x7fa98c15a410 2023-03-03T06:24:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.351+0000 7fa993b08700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c0cebe0 con 0x7fa98c15a7e0 2023-03-03T06:24:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.351+0000 7fa993b08700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0cb6f0 con 0x7fa98c0d0080 2023-03-03T06:24:25.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.351+0000 7fa9918a4700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa98c15a410 0x7fa98c0cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60588/0 (socket says 172.21.15.5:60588) 2023-03-03T06:24:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.351+0000 7fa9918a4700 1 -- 172.21.15.5:0/2814690962 learned_addr learned my addr 172.21.15.5:0/2814690962 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9920a5700 1 --2- 172.21.15.5:0/2814690962 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa98c0d0080 0x7fa98c0d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301377338 0 0) 0x7fa98c0cb4a0 con 0x7fa98c15a410 2023-03-03T06:24:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9780035b0 con 0x7fa98c15a410 2023-03-03T06:24:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1837837847 0 0) 0x7fa9780035b0 con 0x7fa98c15a410 2023-03-03T06:24:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa98c0d0080 msgr2=0x7fa98c0d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:25.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 --2- 172.21.15.5:0/2814690962 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa98c0d0080 0x7fa98c0d1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 >> v1:172.21.15.191:6789/0 conn(0x7fa98c15a7e0 legacy=0x7fa98c0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0cb9d0 con 0x7fa98c15a410 2023-03-03T06:24:25.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fa97c001670 con 0x7fa98c15a410 2023-03-03T06:24:25.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 >> v1:172.21.15.5:6789/0 conn(0x7fa98c15a410 legacy=0x7fa98c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 --2- 172.21.15.5:0/2814690962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa978003a30 0x7fa978003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 --2- 172.21.15.5:0/2814690962 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa98c0d0080 0x7fa978004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 --2- 172.21.15.5:0/2814690962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa978004d90 0x7fa978005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0cb6f0 con 0x7fa978003a30 2023-03-03T06:24:25.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97800bb20 con 0x7fa978004d90 2023-03-03T06:24:25.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97800bce0 con 0x7fa98c0d0080 2023-03-03T06:24:25.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9918a4700 1 --2- 172.21.15.5:0/2814690962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa978003a30 0x7fa978003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9910a3700 1 --2- 172.21.15.5:0/2814690962 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa98c0d0080 0x7fa978004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9920a5700 1 --2- 172.21.15.5:0/2814690962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa978004d90 0x7fa978005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9918a4700 1 -- 172.21.15.5:0/2814690962 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa98c0d0080 msgr2=0x7fa978004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:25.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9918a4700 1 --2- 172.21.15.5:0/2814690962 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa98c0d0080 0x7fa978004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9918a4700 1 -- 172.21.15.5:0/2814690962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa978004d90 msgr2=0x7fa978005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9918a4700 1 --2- 172.21.15.5:0/2814690962 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa978004d90 0x7fa978005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9918a4700 1 -- 172.21.15.5:0/2814690962 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780035b0 con 0x7fa978003a30 2023-03-03T06:24:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.352+0000 7fa9910a3700 1 --2- 172.21.15.5:0/2814690962 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa98c0d0080 0x7fa978004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.353+0000 7fa9918a4700 1 --2- 172.21.15.5:0/2814690962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa978003a30 0x7fa978003e40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c240 tx=0x7fa978005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f1bf0acea54645 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.353+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c007c10 con 0x7fa978003a30 2023-03-03T06:24:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.353+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c00cde0 con 0x7fa978003a30 2023-03-03T06:24:25.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.353+0000 7fa9908a2700 1 -- 172.21.15.5:0/2814690962 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c005ba0 con 0x7fa978003a30 2023-03-03T06:24:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.353+0000 7fa993b08700 1 -- 172.21.15.5:0/2814690962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa978003a30 msgr2=0x7fa978003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.353+0000 7fa993b08700 1 --2- 172.21.15.5:0/2814690962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa978003a30 0x7fa978003e40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c240 tx=0x7fa978005880 comp rx=0 tx=0).stop 2023-03-03T06:24:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.353+0000 7fa9920a5700 1 -- 172.21.15.5:0/2814690962 reap_dead start 2023-03-03T06:24:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.353+0000 7fa993b08700 1 -- 172.21.15.5:0/2814690962 shutdown_connections 2023-03-03T06:24:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.353+0000 7fa993b08700 1 -- 172.21.15.5:0/2814690962 >> 172.21.15.5:0/2814690962 conn(0x7fa98c06f3c0 msgr2=0x7fa98c06f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.353+0000 7fa993b08700 1 -- 172.21.15.5:0/2814690962 shutdown_connections 2023-03-03T06:24:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.353+0000 7fa993b08700 1 -- 172.21.15.5:0/2814690962 wait complete. 2023-03-03T06:24:25.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.355+0000 7fa993b08700 1 Processor -- start 2023-03-03T06:24:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.355+0000 7fa993b08700 1 -- start start 2023-03-03T06:24:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.355+0000 7fa993b08700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa978003a30 0x7fa98c0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.355+0000 7fa993b08700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa98c158490 0x7fa98c151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.355+0000 7fa993b08700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa98c0b6430 0x7fa98c0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.355+0000 7fa993b08700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0ca0c0 con 0x7fa98c158490 2023-03-03T06:24:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.355+0000 7fa993b08700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c1517c0 con 0x7fa98c0b6430 2023-03-03T06:24:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.355+0000 7fa993b08700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0ca300 con 0x7fa978003a30 2023-03-03T06:24:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.355+0000 7fa9910a3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa98c158490 0x7fa98c151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.355+0000 7fa9910a3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa98c158490 0x7fa98c151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42526/0 (socket says 172.21.15.5:42526) 2023-03-03T06:24:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.355+0000 7fa9910a3700 1 -- 172.21.15.5:0/1477095300 learned_addr learned my addr 172.21.15.5:0/1477095300 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.356+0000 7fa9920a5700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa98c0b6430 0x7fa98c0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.356+0000 7fa9918a4700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa978003a30 0x7fa98c0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.356+0000 7fa9910a3700 1 -- 172.21.15.5:0/1477095300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa978003a30 msgr2=0x7fa98c0cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.356+0000 7fa9910a3700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa978003a30 0x7fa98c0cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.356+0000 7fa9910a3700 1 -- 172.21.15.5:0/1477095300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa98c0b6430 msgr2=0x7fa98c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.356+0000 7fa9910a3700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa98c0b6430 0x7fa98c0b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.356+0000 7fa9910a3700 1 -- 172.21.15.5:0/1477095300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c0cdfa0 con 0x7fa98c158490 2023-03-03T06:24:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.356+0000 7fa9910a3700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa98c158490 0x7fa98c151280 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa988001eb0 tx=0x7fa98800e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.356+0000 7fa9827fc700 1 -- 172.21.15.5:0/1477095300 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9880052e0 con 0x7fa98c158490 2023-03-03T06:24:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.356+0000 7fa9827fc700 1 -- 172.21.15.5:0/1477095300 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa988005440 con 0x7fa98c158490 2023-03-03T06:24:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.356+0000 7fa993b08700 1 -- 172.21.15.5:0/1477095300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c0cbcb0 con 0x7fa98c158490 2023-03-03T06:24:25.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.356+0000 7fa9827fc700 1 -- 172.21.15.5:0/1477095300 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988003880 con 0x7fa98c158490 2023-03-03T06:24:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.356+0000 7fa993b08700 1 -- 172.21.15.5:0/1477095300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c0d1660 con 0x7fa98c158490 2023-03-03T06:24:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.357+0000 7fa993b08700 1 -- 172.21.15.5:0/1477095300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c0caf10 con 0x7fa98c158490 2023-03-03T06:24:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.357+0000 7fa9827fc700 1 -- 172.21.15.5:0/1477095300 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa98801b030 con 0x7fa98c158490 2023-03-03T06:24:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.358+0000 7fa9827fc700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9700682f0 0x7fa97006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.358+0000 7fa9827fc700 1 -- 172.21.15.5:0/1477095300 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa9880853a0 con 0x7fa98c158490 2023-03-03T06:24:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.358+0000 7fa9918a4700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9700682f0 0x7fa97006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.358+0000 7fa9918a4700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9700682f0 0x7fa97006a7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa97c015040 tx=0x7fa97c007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.362+0000 7fa9827fc700 1 -- 172.21.15.5:0/1477095300 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa98804d5e0 con 0x7fa98c158490 2023-03-03T06:24:25.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.559+0000 7fa993b08700 1 -- 172.21.15.5:0/1477095300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa98c04e6e0 con 0x7fa98c158490 2023-03-03T06:24:25.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.559+0000 7fa9827fc700 1 -- 172.21.15.5:0/1477095300 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa988019020 con 0x7fa98c158490 2023-03-03T06:24:25.562 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:24:25.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.562+0000 7fa993b08700 1 -- 172.21.15.5:0/1477095300 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9700682f0 msgr2=0x7fa97006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.562+0000 7fa993b08700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9700682f0 0x7fa97006a7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa97c015040 tx=0x7fa97c007000 comp rx=0 tx=0).stop 2023-03-03T06:24:25.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.562+0000 7fa993b08700 1 -- 172.21.15.5:0/1477095300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa98c158490 msgr2=0x7fa98c151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.562+0000 7fa993b08700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa98c158490 0x7fa98c151280 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa988001eb0 tx=0x7fa98800e830 comp rx=0 tx=0).stop 2023-03-03T06:24:25.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.562+0000 7fa993b08700 1 -- 172.21.15.5:0/1477095300 shutdown_connections 2023-03-03T06:24:25.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.562+0000 7fa993b08700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa98c0b6430 0x7fa98c0b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.562+0000 7fa993b08700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9700682f0 0x7fa97006a7a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.562+0000 7fa993b08700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa978003a30 0x7fa98c0cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.562+0000 7fa993b08700 1 --2- 172.21.15.5:0/1477095300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa98c158490 0x7fa98c151280 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.562+0000 7fa993b08700 1 -- 172.21.15.5:0/1477095300 >> 172.21.15.5:0/1477095300 conn(0x7fa98c06f3c0 msgr2=0x7fa98c0b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:25.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.562+0000 7fa993b08700 1 -- 172.21.15.5:0/1477095300 shutdown_connections 2023-03-03T06:24:25.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.562+0000 7fa993b08700 1 -- 172.21.15.5:0/1477095300 wait complete. 2023-03-03T06:24:25.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-03T06:24:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.702+0000 7f88f4dc9700 1 Processor -- start 2023-03-03T06:24:25.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.702+0000 7f88f4dc9700 1 -- start start 2023-03-03T06:24:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88f4dc9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f015dd10 0x7f88f006d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88f4dc9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88f00cebc0 0x7f88f00cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88f4dc9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f006e3f0 con 0x7f88f0159550 2023-03-03T06:24:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88f4dc9700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f015e160 con 0x7f88f00cebc0 2023-03-03T06:24:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88f4dc9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f006d6f0 con 0x7f88f015dd10 2023-03-03T06:24:25.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88eed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f88f00cebc0 0x7f88f00cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88ee59c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f88f0159550 0x7f88f006dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60606/0 (socket says 172.21.15.5:60606) 2023-03-03T06:24:25.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88ee59c700 1 -- 172.21.15.5:0/1381939607 learned_addr learned my addr 172.21.15.5:0/1381939607 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:25.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88edd9b700 1 --2- 172.21.15.5:0/1381939607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f015dd10 0x7f88f006d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88eed9d700 1 -- 172.21.15.5:0/1381939607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f015dd10 msgr2=0x7f88f006d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:25.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88eed9d700 1 --2- 172.21.15.5:0/1381939607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f015dd10 0x7f88f006d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88eed9d700 1 -- 172.21.15.5:0/1381939607 >> v1:172.21.15.5:6789/0 conn(0x7f88f0159550 legacy=0x7f88f006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88eed9d700 1 -- 172.21.15.5:0/1381939607 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f006e6d0 con 0x7f88f00cebc0 2023-03-03T06:24:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.703+0000 7f88ed59a700 1 -- 172.21.15.5:0/1381939607 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479296179 0 0) 0x7f88f006e3f0 con 0x7f88f0159550 2023-03-03T06:24:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.704+0000 7f88eed9d700 1 --2- 172.21.15.5:0/1381939607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00cebc0 0x7f88f00cf040 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f88e800bfa0 tx=0x7f88e800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7050b67e44b93785 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.704+0000 7f88ed59a700 1 -- 172.21.15.5:0/1381939607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8010070 con 0x7f88f00cebc0 2023-03-03T06:24:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.704+0000 7f88ed59a700 1 -- 172.21.15.5:0/1381939607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e800b2e0 con 0x7f88f00cebc0 2023-03-03T06:24:25.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.704+0000 7f88ed59a700 1 -- 172.21.15.5:0/1381939607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800dcf0 con 0x7f88f00cebc0 2023-03-03T06:24:25.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.704+0000 7f88f4dc9700 1 -- 172.21.15.5:0/1381939607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00cebc0 msgr2=0x7f88f00cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.704+0000 7f88f4dc9700 1 --2- 172.21.15.5:0/1381939607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00cebc0 0x7f88f00cf040 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f88e800bfa0 tx=0x7f88e800d330 comp rx=0 tx=0).stop 2023-03-03T06:24:25.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.704+0000 7f88f4dc9700 1 -- 172.21.15.5:0/1381939607 shutdown_connections 2023-03-03T06:24:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.704+0000 7f88f4dc9700 1 --2- 172.21.15.5:0/1381939607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00cebc0 0x7f88f00cf040 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.704+0000 7f88f4dc9700 1 --2- 172.21.15.5:0/1381939607 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f015dd10 0x7f88f006d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.704+0000 7f88f4dc9700 1 -- 172.21.15.5:0/1381939607 >> 172.21.15.5:0/1381939607 conn(0x7f88f00cfd00 msgr2=0x7f88f00d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.704+0000 7f88f4dc9700 1 -- 172.21.15.5:0/1381939607 shutdown_connections 2023-03-03T06:24:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.704+0000 7f88f4dc9700 1 -- 172.21.15.5:0/1381939607 wait complete. 2023-03-03T06:24:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.706+0000 7f88f4dc9700 1 Processor -- start 2023-03-03T06:24:25.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.706+0000 7f88f4dc9700 1 -- start start 2023-03-03T06:24:25.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88f4dc9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00cebc0 0x7f88f0157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88f4dc9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f0159550 0x7f88f0150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88f4dc9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88f015dd10 0x7f88f00b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88f4dc9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f00b44c0 con 0x7f88f00cebc0 2023-03-03T06:24:25.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88f4dc9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f01584e0 con 0x7f88f015dd10 2023-03-03T06:24:25.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88f4dc9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0157b10 con 0x7f88f0159550 2023-03-03T06:24:25.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88ee59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00cebc0 0x7f88f0157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88ee59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00cebc0 0x7f88f0157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42538/0 (socket says 172.21.15.5:42538) 2023-03-03T06:24:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88ee59c700 1 -- 172.21.15.5:0/41900072 learned_addr learned my addr 172.21.15.5:0/41900072 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88ee59c700 1 -- 172.21.15.5:0/41900072 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f0159550 msgr2=0x7f88f0150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88ee59c700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f0159550 0x7f88f0150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88ee59c700 1 -- 172.21.15.5:0/41900072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88f015dd10 msgr2=0x7f88f00b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88eed9d700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88f015dd10 0x7f88f00b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88ee59c700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88f015dd10 0x7f88f00b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88ee59c700 1 -- 172.21.15.5:0/41900072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e800bc80 con 0x7f88f00cebc0 2023-03-03T06:24:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88eed9d700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88f015dd10 0x7f88f00b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88ee59c700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00cebc0 0x7f88f0157fa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c750 tx=0x7f88e400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88deffd700 1 -- 172.21.15.5:0/41900072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4004c80 con 0x7f88f00cebc0 2023-03-03T06:24:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88deffd700 1 -- 172.21.15.5:0/41900072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e4004e00 con 0x7f88f00cebc0 2023-03-03T06:24:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88f4dc9700 1 -- 172.21.15.5:0/41900072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f006c9b0 con 0x7f88f00cebc0 2023-03-03T06:24:25.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88deffd700 1 -- 172.21.15.5:0/41900072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4007310 con 0x7f88f00cebc0 2023-03-03T06:24:25.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.707+0000 7f88f4dc9700 1 -- 172.21.15.5:0/41900072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f006c6d0 con 0x7f88f00cebc0 2023-03-03T06:24:25.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.709+0000 7f88f4dc9700 1 -- 172.21.15.5:0/41900072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f006cc90 con 0x7f88f00cebc0 2023-03-03T06:24:25.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.709+0000 7f88deffd700 1 -- 172.21.15.5:0/41900072 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f88e401a020 con 0x7f88f00cebc0 2023-03-03T06:24:25.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.709+0000 7f88deffd700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f88d00682f0 0x7f88d006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:25.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.709+0000 7f88deffd700 1 -- 172.21.15.5:0/41900072 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f88e4085b80 con 0x7f88f00cebc0 2023-03-03T06:24:25.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.709+0000 7f88edd9b700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f88d00682f0 0x7f88d006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.710+0000 7f88edd9b700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f88d00682f0 0x7f88d006a7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f88e00097f0 tx=0x7f88e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:25.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.714+0000 7f88deffd700 1 -- 172.21.15.5:0/41900072 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f88e40520f0 con 0x7f88f00cebc0 2023-03-03T06:24:25.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.905+0000 7f88f4dc9700 1 -- 172.21.15.5:0/41900072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f88f006d840 con 0x7f88f00cebc0 2023-03-03T06:24:25.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.906+0000 7f88deffd700 1 -- 172.21.15.5:0/41900072 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f88e4055710 con 0x7f88f00cebc0 2023-03-03T06:24:25.908 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:25.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.908+0000 7f88f4dc9700 1 -- 172.21.15.5:0/41900072 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f88d00682f0 msgr2=0x7f88d006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.908+0000 7f88f4dc9700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f88d00682f0 0x7f88d006a7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f88e00097f0 tx=0x7f88e0008040 comp rx=0 tx=0).stop 2023-03-03T06:24:25.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.908+0000 7f88f4dc9700 1 -- 172.21.15.5:0/41900072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00cebc0 msgr2=0x7f88f0157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:25.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.908+0000 7f88f4dc9700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00cebc0 0x7f88f0157fa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c750 tx=0x7f88e400cb10 comp rx=0 tx=0).stop 2023-03-03T06:24:25.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.908+0000 7f88f4dc9700 1 -- 172.21.15.5:0/41900072 shutdown_connections 2023-03-03T06:24:25.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.908+0000 7f88f4dc9700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88f015dd10 0x7f88f00b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.908+0000 7f88f4dc9700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88f00cebc0 0x7f88f0157fa0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.908+0000 7f88f4dc9700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f88d00682f0 0x7f88d006a7a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.908+0000 7f88f4dc9700 1 --2- 172.21.15.5:0/41900072 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f0159550 0x7f88f0150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:25.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.908+0000 7f88f4dc9700 1 -- 172.21.15.5:0/41900072 >> 172.21.15.5:0/41900072 conn(0x7f88f00cfd00 msgr2=0x7f88f0154570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:25.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.908+0000 7f88f4dc9700 1 -- 172.21.15.5:0/41900072 shutdown_connections 2023-03-03T06:24:25.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:25.908+0000 7f88f4dc9700 1 -- 172.21.15.5:0/41900072 wait complete. 2023-03-03T06:24:25.951 INFO:tasks.cephfs_test_runner:Starting test: test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-03-03T06:24:25.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-03-03T06:24:26.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.075+0000 7f6b9872a700 1 Processor -- start 2023-03-03T06:24:26.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.075+0000 7f6b9872a700 1 -- start start 2023-03-03T06:24:26.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.076+0000 7f6b9872a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6b9015a4d0 0x7f6b9015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:26.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.076+0000 7f6b9872a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6b9015b8f0 0x7f6b9006b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:26.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.076+0000 7f6b9872a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b9015a8a0 0x7f6b9006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:26.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.076+0000 7f6b9872a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9015b460 con 0x7f6b9015a4d0 2023-03-03T06:24:26.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.076+0000 7f6b9872a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9006ba80 con 0x7f6b9015b8f0 2023-03-03T06:24:26.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.076+0000 7f6b9872a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9006bd00 con 0x7f6b9015a8a0 2023-03-03T06:24:26.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.076+0000 7f6b964c6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6b9015a4d0 0x7f6b9015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:26.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b964c6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6b9015a4d0 0x7f6b9015ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42546/0 (socket says 172.21.15.5:42546) 2023-03-03T06:24:26.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b964c6700 1 -- 172.21.15.5:0/3037019954 learned_addr learned my addr 172.21.15.5:0/3037019954 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:26.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b95cc5700 1 --2- 172.21.15.5:0/3037019954 >> v2:172.21.15.191:3300/0 conn(0x7f6b9015b8f0 0x7f6b9006b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:26.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b96cc7700 1 --2- 172.21.15.5:0/3037019954 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b9015a8a0 0x7f6b9006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:26.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b964c6700 1 -- 172.21.15.5:0/3037019954 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b9015a8a0 msgr2=0x7f6b9006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:26.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b964c6700 1 --2- 172.21.15.5:0/3037019954 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b9015a8a0 0x7f6b9006dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b964c6700 1 -- 172.21.15.5:0/3037019954 >> v2:172.21.15.191:3300/0 conn(0x7f6b9015b8f0 msgr2=0x7f6b9006b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:26.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b964c6700 1 --2- 172.21.15.5:0/3037019954 >> v2:172.21.15.191:3300/0 conn(0x7f6b9015b8f0 0x7f6b9006b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b964c6700 1 -- 172.21.15.5:0/3037019954 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9015ae10 con 0x7f6b9015a4d0 2023-03-03T06:24:26.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b95cc5700 1 --2- 172.21.15.5:0/3037019954 >> v2:172.21.15.191:3300/0 conn(0x7f6b9015b8f0 0x7f6b9006b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:26.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b96cc7700 1 --2- 172.21.15.5:0/3037019954 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b9015a8a0 0x7f6b9006dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:26.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b964c6700 1 --2- 172.21.15.5:0/3037019954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9015a4d0 0x7f6b9015ed20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6b9006ee20 tx=0x7f6b8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb81385df35929f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:26.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b954c4700 1 -- 172.21.15.5:0/3037019954 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c00b870 con 0x7f6b9015a4d0 2023-03-03T06:24:26.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b954c4700 1 -- 172.21.15.5:0/3037019954 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c00b9d0 con 0x7f6b9015a4d0 2023-03-03T06:24:26.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.077+0000 7f6b954c4700 1 -- 172.21.15.5:0/3037019954 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c00bd60 con 0x7f6b9015a4d0 2023-03-03T06:24:26.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.078+0000 7f6b9872a700 1 -- 172.21.15.5:0/3037019954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9015a4d0 msgr2=0x7f6b9015ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:26.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.078+0000 7f6b9872a700 1 --2- 172.21.15.5:0/3037019954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9015a4d0 0x7f6b9015ed20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6b9006ee20 tx=0x7f6b8c009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.078+0000 7f6b9872a700 1 -- 172.21.15.5:0/3037019954 shutdown_connections 2023-03-03T06:24:26.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.078+0000 7f6b9872a700 1 --2- 172.21.15.5:0/3037019954 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b9015a8a0 0x7f6b9006dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.078+0000 7f6b9872a700 1 --2- 172.21.15.5:0/3037019954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9015a4d0 0x7f6b9015ed20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.078+0000 7f6b9872a700 1 --2- 172.21.15.5:0/3037019954 >> v2:172.21.15.191:3300/0 conn(0x7f6b9015b8f0 0x7f6b9006b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.078+0000 7f6b9872a700 1 -- 172.21.15.5:0/3037019954 >> 172.21.15.5:0/3037019954 conn(0x7f6b900cfd00 msgr2=0x7f6b900d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:26.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.078+0000 7f6b9872a700 1 -- 172.21.15.5:0/3037019954 shutdown_connections 2023-03-03T06:24:26.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.078+0000 7f6b9872a700 1 -- 172.21.15.5:0/3037019954 wait complete. 2023-03-03T06:24:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.079+0000 7f6b9872a700 1 Processor -- start 2023-03-03T06:24:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.079+0000 7f6b9872a700 1 -- start start 2023-03-03T06:24:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b9872a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9015a4d0 0x7f6b900c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b9872a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b9015a8a0 0x7f6b900b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b9872a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b9015b8f0 0x7f6b9006f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b9872a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900c7530 con 0x7f6b9015a4d0 2023-03-03T06:24:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b9872a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900c7810 con 0x7f6b9015b8f0 2023-03-03T06:24:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b9872a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b900c7af0 con 0x7f6b9015a8a0 2023-03-03T06:24:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b964c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9015a4d0 0x7f6b900c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b964c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9015a4d0 0x7f6b900c2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42552/0 (socket says 172.21.15.5:42552) 2023-03-03T06:24:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b964c6700 1 -- 172.21.15.5:0/641800774 learned_addr learned my addr 172.21.15.5:0/641800774 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b95cc5700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b9015a8a0 0x7f6b900b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b96cc7700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b9015b8f0 0x7f6b9006f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b964c6700 1 -- 172.21.15.5:0/641800774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b9015a8a0 msgr2=0x7f6b900b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:26.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b964c6700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b9015a8a0 0x7f6b900b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b964c6700 1 -- 172.21.15.5:0/641800774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b9015b8f0 msgr2=0x7f6b9006f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:26.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b964c6700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b9015b8f0 0x7f6b9006f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b964c6700 1 -- 172.21.15.5:0/641800774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c009550 con 0x7f6b9015a4d0 2023-03-03T06:24:26.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b95cc5700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b9015a8a0 0x7f6b900b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:26.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b96cc7700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b9015b8f0 0x7f6b9006f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:26.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.080+0000 7f6b964c6700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9015a4d0 0x7f6b900c2580 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6b900706f0 tx=0x7f6b8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.081+0000 7f6b82ffd700 1 -- 172.21.15.5:0/641800774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c004310 con 0x7f6b9015a4d0 2023-03-03T06:24:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.081+0000 7f6b82ffd700 1 -- 172.21.15.5:0/641800774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c01f070 con 0x7f6b9015a4d0 2023-03-03T06:24:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.081+0000 7f6b82ffd700 1 -- 172.21.15.5:0/641800774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0036a0 con 0x7f6b9015a4d0 2023-03-03T06:24:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.081+0000 7f6b9872a700 1 -- 172.21.15.5:0/641800774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9006bfe0 con 0x7f6b9015a4d0 2023-03-03T06:24:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.081+0000 7f6b9872a700 1 -- 172.21.15.5:0/641800774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9015b0f0 con 0x7f6b9015a4d0 2023-03-03T06:24:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.082+0000 7f6b9872a700 1 -- 172.21.15.5:0/641800774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9006e140 con 0x7f6b9015a4d0 2023-03-03T06:24:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.082+0000 7f6b82ffd700 1 -- 172.21.15.5:0/641800774 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6b8c02a020 con 0x7f6b9015a4d0 2023-03-03T06:24:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.082+0000 7f6b82ffd700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6b740682f0 0x7f6b7406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.083+0000 7f6b95cc5700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6b740682f0 0x7f6b7406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.083+0000 7f6b82ffd700 1 -- 172.21.15.5:0/641800774 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6b8c0876c0 con 0x7f6b9015a4d0 2023-03-03T06:24:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.083+0000 7f6b95cc5700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6b740682f0 0x7f6b7406a7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6b900b5430 tx=0x7f6b84008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.087+0000 7f6b82ffd700 1 -- 172.21.15.5:0/641800774 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6b8c053b40 con 0x7f6b9015a4d0 2023-03-03T06:24:26.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.358+0000 7f6b9872a700 1 -- 172.21.15.5:0/641800774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7f6b9006d840 con 0x7f6b9015a4d0 2023-03-03T06:24:26.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.535+0000 7f6b82ffd700 1 -- 172.21.15.5:0/641800774 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v62) v1 ==== 176+0+0 (secure 0 0 0) 0x7f6b8c057160 con 0x7f6b9015a4d0 2023-03-03T06:24:26.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.537+0000 7f6b9872a700 1 -- 172.21.15.5:0/641800774 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6b740682f0 msgr2=0x7f6b7406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.537+0000 7f6b9872a700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6b740682f0 0x7f6b7406a7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6b900b5430 tx=0x7f6b84008040 comp rx=0 tx=0).stop 2023-03-03T06:24:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.538+0000 7f6b9872a700 1 -- 172.21.15.5:0/641800774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9015a4d0 msgr2=0x7f6b900c2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:26.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.538+0000 7f6b9872a700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9015a4d0 0x7f6b900c2580 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6b900706f0 tx=0x7f6b8c004750 comp rx=0 tx=0).stop 2023-03-03T06:24:26.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.538+0000 7f6b9872a700 1 -- 172.21.15.5:0/641800774 shutdown_connections 2023-03-03T06:24:26.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.538+0000 7f6b9872a700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b9015b8f0 0x7f6b9006f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.538+0000 7f6b9872a700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6b9015a4d0 0x7f6b900c2580 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.538+0000 7f6b9872a700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6b740682f0 0x7f6b7406a7a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.538+0000 7f6b9872a700 1 --2- 172.21.15.5:0/641800774 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6b9015a8a0 0x7f6b900b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.538+0000 7f6b9872a700 1 -- 172.21.15.5:0/641800774 >> 172.21.15.5:0/641800774 conn(0x7f6b900cfd00 msgr2=0x7f6b9015d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:26.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.538+0000 7f6b9872a700 1 -- 172.21.15.5:0/641800774 shutdown_connections 2023-03-03T06:24:26.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.538+0000 7f6b9872a700 1 -- 172.21.15.5:0/641800774 wait complete. 2023-03-03T06:24:26.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-03-03T06:24:26.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.679+0000 7f8a602e3700 1 Processor -- start 2023-03-03T06:24:26.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.679+0000 7f8a602e3700 1 -- start start 2023-03-03T06:24:26.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.680+0000 7f8a602e3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a5815dd40 0x7f8a580cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:26.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.680+0000 7f8a602e3700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a580cbaa0 con 0x7f8a580b1f50 2023-03-03T06:24:26.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.680+0000 7f8a602e3700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5815e110 con 0x7f8a580ca410 2023-03-03T06:24:26.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.680+0000 7f8a602e3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5806cbf0 con 0x7f8a5815dd40 2023-03-03T06:24:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.680+0000 7f8a5e07f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a5815dd40 0x7f8a580cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.680+0000 7f8a5e880700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8a580b1f50 0x7f8a580b2c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60638/0 (socket says 172.21.15.5:60638) 2023-03-03T06:24:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.681+0000 7f8a5e880700 1 -- 172.21.15.5:0/653640498 learned_addr learned my addr 172.21.15.5:0/653640498 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.681+0000 7f8a5e07f700 1 -- 172.21.15.5:0/653640498 >> v1:172.21.15.191:6789/0 conn(0x7f8a580ca410 legacy=0x7f8a580b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.681+0000 7f8a5e07f700 1 -- 172.21.15.5:0/653640498 >> v1:172.21.15.5:6789/0 conn(0x7f8a580b1f50 legacy=0x7f8a580b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.681+0000 7f8a5e07f700 1 -- 172.21.15.5:0/653640498 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a580cae90 con 0x7f8a5815dd40 2023-03-03T06:24:26.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.681+0000 7f8a5d07d700 1 -- 172.21.15.5:0/653640498 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383875011 0 0) 0x7f8a580cbaa0 con 0x7f8a580b1f50 2023-03-03T06:24:26.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.681+0000 7f8a5e07f700 1 --2- 172.21.15.5:0/653640498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a5815dd40 0x7f8a580cbf30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009840 tx=0x7f8a48009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5453e9bd50dee660 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:26.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.681+0000 7f8a5d07d700 1 -- 172.21.15.5:0/653640498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48011830 con 0x7f8a5815dd40 2023-03-03T06:24:26.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.681+0000 7f8a5d07d700 1 -- 172.21.15.5:0/653640498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a48011990 con 0x7f8a5815dd40 2023-03-03T06:24:26.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.681+0000 7f8a5d07d700 1 -- 172.21.15.5:0/653640498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48011d20 con 0x7f8a5815dd40 2023-03-03T06:24:26.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.682+0000 7f8a602e3700 1 -- 172.21.15.5:0/653640498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a5815dd40 msgr2=0x7f8a580cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:26.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.682+0000 7f8a602e3700 1 --2- 172.21.15.5:0/653640498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a5815dd40 0x7f8a580cbf30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009840 tx=0x7f8a48009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:26.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.682+0000 7f8a602e3700 1 -- 172.21.15.5:0/653640498 shutdown_connections 2023-03-03T06:24:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.682+0000 7f8a602e3700 1 --2- 172.21.15.5:0/653640498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a5815dd40 0x7f8a580cbf30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.682+0000 7f8a602e3700 1 -- 172.21.15.5:0/653640498 >> 172.21.15.5:0/653640498 conn(0x7f8a580cc840 msgr2=0x7f8a580ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.682+0000 7f8a602e3700 1 -- 172.21.15.5:0/653640498 shutdown_connections 2023-03-03T06:24:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.682+0000 7f8a602e3700 1 -- 172.21.15.5:0/653640498 wait complete. 2023-03-03T06:24:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.683+0000 7f8a602e3700 1 Processor -- start 2023-03-03T06:24:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.683+0000 7f8a602e3700 1 -- start start 2023-03-03T06:24:26.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a602e3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a580b1f50 0x7f8a5814e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:26.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a602e3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a580ca410 0x7f8a580c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:26.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a602e3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a5815dd40 0x7f8a580c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:26.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a602e3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5814f920 con 0x7f8a580b1f50 2023-03-03T06:24:26.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a602e3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580c42d0 con 0x7f8a5815dd40 2023-03-03T06:24:26.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a602e3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580c45b0 con 0x7f8a580ca410 2023-03-03T06:24:26.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a5e07f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a580b1f50 0x7f8a5814e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:26.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a5e07f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a580b1f50 0x7f8a5814e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42566/0 (socket says 172.21.15.5:42566) 2023-03-03T06:24:26.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a5e07f700 1 -- 172.21.15.5:0/675684363 learned_addr learned my addr 172.21.15.5:0/675684363 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:26.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a5d87e700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a580ca410 0x7f8a580c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:26.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a5e07f700 1 -- 172.21.15.5:0/675684363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a580ca410 msgr2=0x7f8a580c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:26.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a5e880700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a5815dd40 0x7f8a580c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:26.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a5e07f700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a580ca410 0x7f8a580c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a5e07f700 1 -- 172.21.15.5:0/675684363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a5815dd40 msgr2=0x7f8a580c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:26.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a5e07f700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a5815dd40 0x7f8a580c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a5e07f700 1 -- 172.21.15.5:0/675684363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a480094a0 con 0x7f8a580b1f50 2023-03-03T06:24:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a5d87e700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a580ca410 0x7f8a580c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a5e880700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a5815dd40 0x7f8a580c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a5e07f700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a580b1f50 0x7f8a5814e4d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8a48014040 tx=0x7f8a48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a4effd700 1 -- 172.21.15.5:0/675684363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4801a900 con 0x7f8a580b1f50 2023-03-03T06:24:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a4effd700 1 -- 172.21.15.5:0/675684363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4801aa60 con 0x7f8a580b1f50 2023-03-03T06:24:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.684+0000 7f8a602e3700 1 -- 172.21.15.5:0/675684363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a580cb450 con 0x7f8a580b1f50 2023-03-03T06:24:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.685+0000 7f8a4effd700 1 -- 172.21.15.5:0/675684363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4801add0 con 0x7f8a580b1f50 2023-03-03T06:24:26.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.685+0000 7f8a602e3700 1 -- 172.21.15.5:0/675684363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a580cb170 con 0x7f8a580b1f50 2023-03-03T06:24:26.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.685+0000 7f8a602e3700 1 -- 172.21.15.5:0/675684363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a580cb730 con 0x7f8a580b1f50 2023-03-03T06:24:26.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.686+0000 7f8a4effd700 1 -- 172.21.15.5:0/675684363 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8a4802b030 con 0x7f8a580b1f50 2023-03-03T06:24:26.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.686+0000 7f8a4effd700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8a3c0682f0 0x7f8a3c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:26.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.686+0000 7f8a4effd700 1 -- 172.21.15.5:0/675684363 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8a480872a0 con 0x7f8a580b1f50 2023-03-03T06:24:26.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.686+0000 7f8a5d87e700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8a3c0682f0 0x7f8a3c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:26.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.687+0000 7f8a5d87e700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8a3c0682f0 0x7f8a3c06a7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8a5806b000 tx=0x7f8a54009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:26.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.691+0000 7f8a4effd700 1 -- 172.21.15.5:0/675684363 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8a480538c0 con 0x7f8a580b1f50 2023-03-03T06:24:26.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.885+0000 7f8a602e3700 1 -- 172.21.15.5:0/675684363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8a580cd570 con 0x7f8a580b1f50 2023-03-03T06:24:26.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.889+0000 7f8a4effd700 1 -- 172.21.15.5:0/675684363 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v11)=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8a48056ee0 con 0x7f8a580b1f50 2023-03-03T06:24:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.891+0000 7f8a602e3700 1 -- 172.21.15.5:0/675684363 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8a3c0682f0 msgr2=0x7f8a3c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:26.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.891+0000 7f8a602e3700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8a3c0682f0 0x7f8a3c06a7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8a5806b000 tx=0x7f8a54009040 comp rx=0 tx=0).stop 2023-03-03T06:24:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.891+0000 7f8a602e3700 1 -- 172.21.15.5:0/675684363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a580b1f50 msgr2=0x7f8a5814e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.891+0000 7f8a602e3700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a580b1f50 0x7f8a5814e4d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8a48014040 tx=0x7f8a48004750 comp rx=0 tx=0).stop 2023-03-03T06:24:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.891+0000 7f8a602e3700 1 -- 172.21.15.5:0/675684363 shutdown_connections 2023-03-03T06:24:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.891+0000 7f8a602e3700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a5815dd40 0x7f8a580c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.891+0000 7f8a602e3700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a580b1f50 0x7f8a5814e4d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.891+0000 7f8a602e3700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8a3c0682f0 0x7f8a3c06a7a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.891+0000 7f8a602e3700 1 --2- 172.21.15.5:0/675684363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a580ca410 0x7f8a580c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.891+0000 7f8a602e3700 1 -- 172.21.15.5:0/675684363 >> 172.21.15.5:0/675684363 conn(0x7f8a580cc840 msgr2=0x7f8a580af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.891+0000 7f8a602e3700 1 -- 172.21.15.5:0/675684363 shutdown_connections 2023-03-03T06:24:26.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:26.891+0000 7f8a602e3700 1 -- 172.21.15.5:0/675684363 wait complete. 2023-03-03T06:24:26.905 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-03-03T06:24:26.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:24:26.948 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:24:26.996 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-03-03T06:24:26.997 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:24:26.998 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:27.016 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:24:27.017 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:27.074 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:24:27.074 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:27.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.292+0000 7f5a0792c700 1 Processor -- start 2023-03-03T06:24:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.292+0000 7f5a0792c700 1 -- start start 2023-03-03T06:24:27.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.293+0000 7f5a0792c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a000af080 0x7f5a000cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:27.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.293+0000 7f5a0792c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5a000b1f80 0x7f5a000cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:27.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.293+0000 7f5a0792c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a0006b590 con 0x7f5a000af450 2023-03-03T06:24:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.293+0000 7f5a0792c700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0006b870 con 0x7f5a000b1f80 2023-03-03T06:24:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.293+0000 7f5a0792c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0006bb50 con 0x7f5a000af080 2023-03-03T06:24:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.293+0000 7f5a04ec7700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5a000af450 0x7f5a000b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60648/0 (socket says 172.21.15.5:60648) 2023-03-03T06:24:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.293+0000 7f5a04ec7700 1 -- 172.21.15.5:0/3604993707 learned_addr learned my addr 172.21.15.5:0/3604993707 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f5a05ec9700 1 --2- 172.21.15.5:0/3604993707 >> v2:172.21.15.191:3300/0 conn(0x7f5a000b1f80 0x7f5a000cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f5a056c8700 1 --2- 172.21.15.5:0/3604993707 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a000af080 0x7f5a000cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f59f3fff700 1 -- 172.21.15.5:0/3604993707 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607712558 0 0) 0x7f5a0006b590 con 0x7f5a000af450 2023-03-03T06:24:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f59f3fff700 1 -- 172.21.15.5:0/3604993707 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59ec0035b0 con 0x7f5a000af450 2023-03-03T06:24:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f59f3fff700 1 -- 172.21.15.5:0/3604993707 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1722974066 0 0) 0x7f59ec0035b0 con 0x7f5a000af450 2023-03-03T06:24:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f5a056c8700 1 -- 172.21.15.5:0/3604993707 >> v2:172.21.15.191:3300/0 conn(0x7f5a000b1f80 msgr2=0x7f5a000cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f5a056c8700 1 --2- 172.21.15.5:0/3604993707 >> v2:172.21.15.191:3300/0 conn(0x7f5a000b1f80 0x7f5a000cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f5a056c8700 1 -- 172.21.15.5:0/3604993707 >> v1:172.21.15.5:6789/0 conn(0x7f5a000af450 legacy=0x7f5a000b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f5a056c8700 1 -- 172.21.15.5:0/3604993707 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0006be30 con 0x7f5a000af080 2023-03-03T06:24:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f5a05ec9700 1 --2- 172.21.15.5:0/3604993707 >> v2:172.21.15.191:3300/0 conn(0x7f5a000b1f80 0x7f5a000cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f5a056c8700 1 --2- 172.21.15.5:0/3604993707 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a000af080 0x7f5a000cd350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009840 tx=0x7f59f4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20aa41a010cc7d0e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f59f3fff700 1 -- 172.21.15.5:0/3604993707 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc001670 con 0x7f5a000af080 2023-03-03T06:24:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f59f3fff700 1 -- 172.21.15.5:0/3604993707 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f4004030 con 0x7f5a000af080 2023-03-03T06:24:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.294+0000 7f59f3fff700 1 -- 172.21.15.5:0/3604993707 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f40043c0 con 0x7f5a000af080 2023-03-03T06:24:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.295+0000 7f5a0792c700 1 -- 172.21.15.5:0/3604993707 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a000af080 msgr2=0x7f5a000cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.295+0000 7f5a0792c700 1 --2- 172.21.15.5:0/3604993707 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a000af080 0x7f5a000cd350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f59f4009840 tx=0x7f59f4009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.295+0000 7f5a0792c700 1 -- 172.21.15.5:0/3604993707 shutdown_connections 2023-03-03T06:24:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.295+0000 7f5a0792c700 1 --2- 172.21.15.5:0/3604993707 >> v2:172.21.15.191:3300/0 conn(0x7f5a000b1f80 0x7f5a000cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.295+0000 7f5a0792c700 1 --2- 172.21.15.5:0/3604993707 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a000af080 0x7f5a000cd350 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.295+0000 7f5a0792c700 1 -- 172.21.15.5:0/3604993707 >> 172.21.15.5:0/3604993707 conn(0x7f5a0006ea70 msgr2=0x7f5a000cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.295+0000 7f5a0792c700 1 -- 172.21.15.5:0/3604993707 shutdown_connections 2023-03-03T06:24:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.295+0000 7f5a0792c700 1 -- 172.21.15.5:0/3604993707 wait complete. 2023-03-03T06:24:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.296+0000 7f5a0792c700 1 Processor -- start 2023-03-03T06:24:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.296+0000 7f5a0792c700 1 -- start start 2023-03-03T06:24:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a0792c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a000af080 0x7f5a00153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a0792c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a000af450 0x7f5a0015d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a0792c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a000b1f80 0x7f5a001f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a0792c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0015d690 con 0x7f5a000af450 2023-03-03T06:24:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a0792c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a000b2c20 con 0x7f5a000af080 2023-03-03T06:24:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a0792c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0015d8f0 con 0x7f5a000b1f80 2023-03-03T06:24:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a04ec7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a000af450 0x7f5a0015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a04ec7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a000af450 0x7f5a0015d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42582/0 (socket says 172.21.15.5:42582) 2023-03-03T06:24:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a04ec7700 1 -- 172.21.15.5:0/3052730363 learned_addr learned my addr 172.21.15.5:0/3052730363 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a056c8700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a000af080 0x7f5a00153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a04ec7700 1 -- 172.21.15.5:0/3052730363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a000b1f80 msgr2=0x7f5a001f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a05ec9700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a000b1f80 0x7f5a001f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a04ec7700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a000b1f80 0x7f5a001f1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a04ec7700 1 -- 172.21.15.5:0/3052730363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a000af080 msgr2=0x7f5a00153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a04ec7700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a000af080 0x7f5a00153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a04ec7700 1 -- 172.21.15.5:0/3052730363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f8009a70 con 0x7f5a000af450 2023-03-03T06:24:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a056c8700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a000af080 0x7f5a00153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.297+0000 7f5a05ec9700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a000b1f80 0x7f5a001f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.298+0000 7f5a04ec7700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a000af450 0x7f5a0015d150 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00c780 tx=0x7f59fc00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.298+0000 7f59f1ffb700 1 -- 172.21.15.5:0/3052730363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc004c80 con 0x7f5a000af450 2023-03-03T06:24:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.298+0000 7f59f1ffb700 1 -- 172.21.15.5:0/3052730363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc004de0 con 0x7f5a000af450 2023-03-03T06:24:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.298+0000 7f59f1ffb700 1 -- 172.21.15.5:0/3052730363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc0072d0 con 0x7f5a000af450 2023-03-03T06:24:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.298+0000 7f5a0792c700 1 -- 172.21.15.5:0/3052730363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f40094a0 con 0x7f5a000af450 2023-03-03T06:24:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.298+0000 7f5a0792c700 1 -- 172.21.15.5:0/3052730363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0006d370 con 0x7f5a000af450 2023-03-03T06:24:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.299+0000 7f5a0792c700 1 -- 172.21.15.5:0/3052730363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0006c110 con 0x7f5a000af450 2023-03-03T06:24:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.299+0000 7f59f1ffb700 1 -- 172.21.15.5:0/3052730363 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f59fc010070 con 0x7f5a000af450 2023-03-03T06:24:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.300+0000 7f59f1ffb700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f59e40682f0 0x7f59e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.300+0000 7f5a056c8700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f59e40682f0 0x7f59e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.300+0000 7f59f1ffb700 1 -- 172.21.15.5:0/3052730363 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f59fc085220 con 0x7f5a000af450 2023-03-03T06:24:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.300+0000 7f5a056c8700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f59e40682f0 0x7f59e406a7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f59f40090b0 tx=0x7f59f4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.304+0000 7f59f1ffb700 1 -- 172.21.15.5:0/3052730363 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f59fc051710 con 0x7f5a000af450 2023-03-03T06:24:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.503+0000 7f5a0792c700 1 -- 172.21.15.5:0/3052730363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a0006cb70 con 0x7f5a000af450 2023-03-03T06:24:27.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.504+0000 7f59f1ffb700 1 -- 172.21.15.5:0/3052730363 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19546 (secure 0 0 0) 0x7f59fc018090 con 0x7f5a000af450 2023-03-03T06:24:27.506 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:27.506 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:23:44.818391+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.506+0000 7f5a0792c700 1 -- 172.21.15.5:0/3052730363 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f59e40682f0 msgr2=0x7f59e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.506+0000 7f5a0792c700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f59e40682f0 0x7f59e406a7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f59f40090b0 tx=0x7f59f4008030 comp rx=0 tx=0).stop 2023-03-03T06:24:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.506+0000 7f5a0792c700 1 -- 172.21.15.5:0/3052730363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a000af450 msgr2=0x7f5a0015d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.506+0000 7f5a0792c700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a000af450 0x7f5a0015d150 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00c780 tx=0x7f59fc00cb40 comp rx=0 tx=0).stop 2023-03-03T06:24:27.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.506+0000 7f5a0792c700 1 -- 172.21.15.5:0/3052730363 shutdown_connections 2023-03-03T06:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.506+0000 7f5a0792c700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f59e40682f0 0x7f59e406a7a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.506+0000 7f5a0792c700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a000b1f80 0x7f5a001f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.506+0000 7f5a0792c700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a000af080 0x7f5a00153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.506+0000 7f5a0792c700 1 --2- 172.21.15.5:0/3052730363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a000af450 0x7f5a0015d150 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.506+0000 7f5a0792c700 1 -- 172.21.15.5:0/3052730363 >> 172.21.15.5:0/3052730363 conn(0x7f5a0006ea70 msgr2=0x7f5a000cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.506+0000 7f5a0792c700 1 -- 172.21.15.5:0/3052730363 shutdown_connections 2023-03-03T06:24:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.506+0000 7f5a0792c700 1 -- 172.21.15.5:0/3052730363 wait complete. 2023-03-03T06:24:27.520 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:23:38.141777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:23:39.283589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-03T06:23:42.422930+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-03T06:24:27.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:24:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.647+0000 7f60756b3700 1 Processor -- start 2023-03-03T06:24:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.647+0000 7f60756b3700 1 -- start start 2023-03-03T06:24:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.648+0000 7f60756b3700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f607015a460 0x7f60700cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.648+0000 7f60756b3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60700cdf70 0x7f60700cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.648+0000 7f60756b3700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60700cd650 con 0x7f607015a830 2023-03-03T06:24:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.648+0000 7f60756b3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60700cb4a0 con 0x7f60700cdf70 2023-03-03T06:24:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.648+0000 7f60756b3700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60700d16a0 con 0x7f607015a460 2023-03-03T06:24:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.648+0000 7f606f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60700cdf70 0x7f60700cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.648+0000 7f606f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60700cdf70 0x7f60700cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42596/0 (socket says 172.21.15.5:42596) 2023-03-03T06:24:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.648+0000 7f606f7fe700 1 -- 172.21.15.5:0/2558856245 learned_addr learned my addr 172.21.15.5:0/2558856245 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.648+0000 7f606effd700 1 --2- 172.21.15.5:0/2558856245 >> v2:172.21.15.191:3300/0 conn(0x7f607015a460 0x7f60700cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.649+0000 7f606f7fe700 1 -- 172.21.15.5:0/2558856245 >> v2:172.21.15.191:3300/0 conn(0x7f607015a460 msgr2=0x7f60700cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.649+0000 7f606f7fe700 1 --2- 172.21.15.5:0/2558856245 >> v2:172.21.15.191:3300/0 conn(0x7f607015a460 0x7f60700cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.649+0000 7f606f7fe700 1 -- 172.21.15.5:0/2558856245 >> v1:172.21.15.191:6789/0 conn(0x7f607015a830 legacy=0x7f60700cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.649+0000 7f606f7fe700 1 -- 172.21.15.5:0/2558856245 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60700cbc70 con 0x7f60700cdf70 2023-03-03T06:24:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.649+0000 7f606effd700 1 --2- 172.21.15.5:0/2558856245 >> v2:172.21.15.191:3300/0 conn(0x7f607015a460 0x7f60700cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.649+0000 7f606f7fe700 1 --2- 172.21.15.5:0/2558856245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60700cdf70 0x7f60700cea20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f60700cd830 tx=0x7f606800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f880c3e1bae684 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.649+0000 7f606dffb700 1 -- 172.21.15.5:0/2558856245 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800e070 con 0x7f60700cdf70 2023-03-03T06:24:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.649+0000 7f606dffb700 1 -- 172.21.15.5:0/2558856245 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606800b9c0 con 0x7f60700cdf70 2023-03-03T06:24:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.649+0000 7f606dffb700 1 -- 172.21.15.5:0/2558856245 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800bd70 con 0x7f60700cdf70 2023-03-03T06:24:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.650+0000 7f60756b3700 1 -- 172.21.15.5:0/2558856245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60700cdf70 msgr2=0x7f60700cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.650+0000 7f60756b3700 1 --2- 172.21.15.5:0/2558856245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60700cdf70 0x7f60700cea20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f60700cd830 tx=0x7f606800b330 comp rx=0 tx=0).stop 2023-03-03T06:24:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.650+0000 7f60756b3700 1 -- 172.21.15.5:0/2558856245 shutdown_connections 2023-03-03T06:24:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.650+0000 7f60756b3700 1 --2- 172.21.15.5:0/2558856245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60700cdf70 0x7f60700cea20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.650+0000 7f60756b3700 1 --2- 172.21.15.5:0/2558856245 >> v2:172.21.15.191:3300/0 conn(0x7f607015a460 0x7f60700cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.650+0000 7f60756b3700 1 -- 172.21.15.5:0/2558856245 >> 172.21.15.5:0/2558856245 conn(0x7f607006f3c0 msgr2=0x7f607006f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.650+0000 7f60756b3700 1 -- 172.21.15.5:0/2558856245 shutdown_connections 2023-03-03T06:24:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.650+0000 7f60756b3700 1 -- 172.21.15.5:0/2558856245 wait complete. 2023-03-03T06:24:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.651+0000 7f60756b3700 1 Processor -- start 2023-03-03T06:24:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.651+0000 7f60756b3700 1 -- start start 2023-03-03T06:24:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.652+0000 7f60756b3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60700cdf70 0x7f6070156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.652+0000 7f60756b3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f607015a460 0x7f60700b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.652+0000 7f60756b3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607015a830 0x7f6070159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.652+0000 7f60756b3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6070157080 con 0x7f607015a830 2023-03-03T06:24:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.652+0000 7f60756b3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60700b4ee0 con 0x7f607015a460 2023-03-03T06:24:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.652+0000 7f60756b3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60700b51c0 con 0x7f60700cdf70 2023-03-03T06:24:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f606f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607015a830 0x7f6070159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f606f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607015a830 0x7f6070159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42602/0 (socket says 172.21.15.5:42602) 2023-03-03T06:24:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f606f7fe700 1 -- 172.21.15.5:0/2453155056 learned_addr learned my addr 172.21.15.5:0/2453155056 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f606e7fc700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f607015a460 0x7f60700b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f606effd700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60700cdf70 0x7f6070156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:27.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f606f7fe700 1 -- 172.21.15.5:0/2453155056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60700cdf70 msgr2=0x7f6070156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f606f7fe700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60700cdf70 0x7f6070156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f606f7fe700 1 -- 172.21.15.5:0/2453155056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f607015a460 msgr2=0x7f60700b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f606f7fe700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f607015a460 0x7f60700b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f606f7fe700 1 -- 172.21.15.5:0/2453155056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6068009b30 con 0x7f607015a830 2023-03-03T06:24:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f606f7fe700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607015a830 0x7f6070159280 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f60700d1f50 tx=0x7f6068004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f60577fe700 1 -- 172.21.15.5:0/2453155056 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60680099b0 con 0x7f607015a830 2023-03-03T06:24:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f60577fe700 1 -- 172.21.15.5:0/2453155056 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60680092e0 con 0x7f607015a830 2023-03-03T06:24:27.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f60756b3700 1 -- 172.21.15.5:0/2453155056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60700cb990 con 0x7f607015a830 2023-03-03T06:24:27.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f60577fe700 1 -- 172.21.15.5:0/2453155056 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606801c640 con 0x7f607015a830 2023-03-03T06:24:27.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.653+0000 7f60756b3700 1 -- 172.21.15.5:0/2453155056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60700cb6b0 con 0x7f607015a830 2023-03-03T06:24:27.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.654+0000 7f60756b3700 1 -- 172.21.15.5:0/2453155056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60700d1940 con 0x7f607015a830 2023-03-03T06:24:27.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.655+0000 7f60577fe700 1 -- 172.21.15.5:0/2453155056 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f606802c070 con 0x7f607015a830 2023-03-03T06:24:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.655+0000 7f60577fe700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f605c0682f0 0x7f605c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.655+0000 7f60577fe700 1 -- 172.21.15.5:0/2453155056 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6068087b80 con 0x7f607015a830 2023-03-03T06:24:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.655+0000 7f606effd700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f605c0682f0 0x7f605c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.656+0000 7f606effd700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f605c0682f0 0x7f605c06a7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6064009930 tx=0x7f6064008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.659+0000 7f60577fe700 1 -- 172.21.15.5:0/2453155056 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f60680540f0 con 0x7f607015a830 2023-03-03T06:24:27.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.853+0000 7f60756b3700 1 -- 172.21.15.5:0/2453155056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f60700b1120 con 0x7f607015a830 2023-03-03T06:24:27.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.853+0000 7f60577fe700 1 -- 172.21.15.5:0/2453155056 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6068057710 con 0x7f607015a830 2023-03-03T06:24:27.855 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:24:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.855+0000 7f60756b3700 1 -- 172.21.15.5:0/2453155056 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f605c0682f0 msgr2=0x7f605c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.855+0000 7f60756b3700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f605c0682f0 0x7f605c06a7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6064009930 tx=0x7f6064008040 comp rx=0 tx=0).stop 2023-03-03T06:24:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.855+0000 7f60756b3700 1 -- 172.21.15.5:0/2453155056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607015a830 msgr2=0x7f6070159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.855+0000 7f60756b3700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607015a830 0x7f6070159280 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f60700d1f50 tx=0x7f6068004ad0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.855+0000 7f60756b3700 1 -- 172.21.15.5:0/2453155056 shutdown_connections 2023-03-03T06:24:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.855+0000 7f60756b3700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f607015a830 0x7f6070159280 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.855+0000 7f60756b3700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f605c0682f0 0x7f605c06a7a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.855+0000 7f60756b3700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60700cdf70 0x7f6070156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.855+0000 7f60756b3700 1 --2- 172.21.15.5:0/2453155056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f607015a460 0x7f60700b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.855+0000 7f60756b3700 1 -- 172.21.15.5:0/2453155056 >> 172.21.15.5:0/2453155056 conn(0x7f607006f3c0 msgr2=0x7f60700cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.855+0000 7f60756b3700 1 -- 172.21.15.5:0/2453155056 shutdown_connections 2023-03-03T06:24:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.855+0000 7f60756b3700 1 -- 172.21.15.5:0/2453155056 wait complete. 2023-03-03T06:24:27.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:24:28.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.998+0000 7f9d036e3700 1 Processor -- start 2023-03-03T06:24:28.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.998+0000 7f9d036e3700 1 -- start start 2023-03-03T06:24:28.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.999+0000 7f9d036e3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cfc0cd3e0 0x7f9cfc0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.999+0000 7f9d036e3700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9cfc0b1fe0 0x7f9cfc0ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.999+0000 7f9d036e3700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc15e160 con 0x7f9cfc15cd40 2023-03-03T06:24:28.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.999+0000 7f9d036e3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc0cd870 con 0x7f9cfc0cd3e0 2023-03-03T06:24:28.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.999+0000 7f9d036e3700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc15d110 con 0x7f9cfc0b1fe0 2023-03-03T06:24:28.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.999+0000 7f9d00c7e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cfc0cd3e0 0x7f9cfc0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.999+0000 7f9d00c7e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9cfc0cd3e0 0x7f9cfc0cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42608/0 (socket says 172.21.15.5:42608) 2023-03-03T06:24:28.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.999+0000 7f9d0147f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9cfc15cd40 0x7f9cfc0b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60680/0 (socket says 172.21.15.5:60680) 2023-03-03T06:24:28.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.999+0000 7f9d00c7e700 1 -- 172.21.15.5:0/1251220131 learned_addr learned my addr 172.21.15.5:0/1251220131 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:28.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:27.999+0000 7f9d01c80700 1 --2- 172.21.15.5:0/1251220131 >> v2:172.21.15.191:3300/0 conn(0x7f9cfc0b1fe0 0x7f9cfc0ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.000+0000 7f9d00c7e700 1 -- 172.21.15.5:0/1251220131 >> v2:172.21.15.191:3300/0 conn(0x7f9cfc0b1fe0 msgr2=0x7f9cfc0ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:28.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.000+0000 7f9d00c7e700 1 --2- 172.21.15.5:0/1251220131 >> v2:172.21.15.191:3300/0 conn(0x7f9cfc0b1fe0 0x7f9cfc0ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.000+0000 7f9d00c7e700 1 -- 172.21.15.5:0/1251220131 >> v1:172.21.15.5:6789/0 conn(0x7f9cfc15cd40 legacy=0x7f9cfc0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.000+0000 7f9cf3fff700 1 -- 172.21.15.5:0/1251220131 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507001870 0 0) 0x7f9cfc15e160 con 0x7f9cfc15cd40 2023-03-03T06:24:28.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.000+0000 7f9d00c7e700 1 -- 172.21.15.5:0/1251220131 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc15d3c0 con 0x7f9cfc0cd3e0 2023-03-03T06:24:28.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.000+0000 7f9d00c7e700 1 --2- 172.21.15.5:0/1251220131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc0cd3e0 0x7f9cfc0cdd50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc068620 tx=0x7f9cf8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5596f4b27cdb717d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:28.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.000+0000 7f9cf3fff700 1 -- 172.21.15.5:0/1251220131 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8011830 con 0x7f9cfc0cd3e0 2023-03-03T06:24:28.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.000+0000 7f9cf3fff700 1 -- 172.21.15.5:0/1251220131 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf8011990 con 0x7f9cfc0cd3e0 2023-03-03T06:24:28.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.000+0000 7f9cf3fff700 1 -- 172.21.15.5:0/1251220131 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8011d20 con 0x7f9cfc0cd3e0 2023-03-03T06:24:28.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.001+0000 7f9d036e3700 1 -- 172.21.15.5:0/1251220131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc0cd3e0 msgr2=0x7f9cfc0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.001+0000 7f9d036e3700 1 --2- 172.21.15.5:0/1251220131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc0cd3e0 0x7f9cfc0cdd50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc068620 tx=0x7f9cf8009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.001+0000 7f9d036e3700 1 -- 172.21.15.5:0/1251220131 shutdown_connections 2023-03-03T06:24:28.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.001+0000 7f9d036e3700 1 --2- 172.21.15.5:0/1251220131 >> v2:172.21.15.191:3300/0 conn(0x7f9cfc0b1fe0 0x7f9cfc0ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.001+0000 7f9d036e3700 1 --2- 172.21.15.5:0/1251220131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc0cd3e0 0x7f9cfc0cdd50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.001+0000 7f9d036e3700 1 -- 172.21.15.5:0/1251220131 >> 172.21.15.5:0/1251220131 conn(0x7f9cfc0cc8d0 msgr2=0x7f9cfc0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:28.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.001+0000 7f9d036e3700 1 -- 172.21.15.5:0/1251220131 shutdown_connections 2023-03-03T06:24:28.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.001+0000 7f9d036e3700 1 -- 172.21.15.5:0/1251220131 wait complete. 2023-03-03T06:24:28.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.003+0000 7f9d036e3700 1 Processor -- start 2023-03-03T06:24:28.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.003+0000 7f9d036e3700 1 -- start start 2023-03-03T06:24:28.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.004+0000 7f9d036e3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cfc0b1fe0 0x7f9cfc0c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.004+0000 7f9d036e3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cfc0cd3e0 0x7f9cfc0ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.004+0000 7f9d036e3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc15cd40 0x7f9cfc1f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.004+0000 7f9d036e3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0c8120 con 0x7f9cfc15cd40 2023-03-03T06:24:28.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.004+0000 7f9d036e3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0ae9d0 con 0x7f9cfc0b1fe0 2023-03-03T06:24:28.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.004+0000 7f9d036e3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc0c8370 con 0x7f9cfc0cd3e0 2023-03-03T06:24:28.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.004+0000 7f9d01c80700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc15cd40 0x7f9cfc1f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.004+0000 7f9d01c80700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc15cd40 0x7f9cfc1f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42616/0 (socket says 172.21.15.5:42616) 2023-03-03T06:24:28.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.004+0000 7f9d01c80700 1 -- 172.21.15.5:0/3575803937 learned_addr learned my addr 172.21.15.5:0/3575803937 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:28.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.004+0000 7f9d0147f700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cfc0b1fe0 0x7f9cfc0c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.004+0000 7f9d00c7e700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cfc0cd3e0 0x7f9cfc0ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.005+0000 7f9d01c80700 1 -- 172.21.15.5:0/3575803937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cfc0cd3e0 msgr2=0x7f9cfc0ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.005+0000 7f9d01c80700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cfc0cd3e0 0x7f9cfc0ae490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.005+0000 7f9d01c80700 1 -- 172.21.15.5:0/3575803937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cfc0b1fe0 msgr2=0x7f9cfc0c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.005+0000 7f9d01c80700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cfc0b1fe0 0x7f9cfc0c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.005+0000 7f9d01c80700 1 -- 172.21.15.5:0/3575803937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf8009550 con 0x7f9cfc15cd40 2023-03-03T06:24:28.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.005+0000 7f9d01c80700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc15cd40 0x7f9cfc1f2460 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400efc0 tx=0x7f9cf400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:28.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.005+0000 7f9cf1ffb700 1 -- 172.21.15.5:0/3575803937 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4009ea0 con 0x7f9cfc15cd40 2023-03-03T06:24:28.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.005+0000 7f9cf1ffb700 1 -- 172.21.15.5:0/3575803937 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400f040 con 0x7f9cfc15cd40 2023-03-03T06:24:28.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.005+0000 7f9d036e3700 1 -- 172.21.15.5:0/3575803937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc15d980 con 0x7f9cfc15cd40 2023-03-03T06:24:28.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.005+0000 7f9cf1ffb700 1 -- 172.21.15.5:0/3575803937 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400ced0 con 0x7f9cfc15cd40 2023-03-03T06:24:28.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.005+0000 7f9d036e3700 1 -- 172.21.15.5:0/3575803937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc15d6a0 con 0x7f9cfc15cd40 2023-03-03T06:24:28.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.006+0000 7f9d036e3700 1 -- 172.21.15.5:0/3575803937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc15dc60 con 0x7f9cfc15cd40 2023-03-03T06:24:28.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.007+0000 7f9cf1ffb700 1 -- 172.21.15.5:0/3575803937 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9cf4014480 con 0x7f9cfc15cd40 2023-03-03T06:24:28.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.007+0000 7f9cf1ffb700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9ce00682f0 0x7f9ce006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.007+0000 7f9cf1ffb700 1 -- 172.21.15.5:0/3575803937 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9cf40868e0 con 0x7f9cfc15cd40 2023-03-03T06:24:28.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.007+0000 7f9d0147f700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9ce00682f0 0x7f9ce006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.008+0000 7f9d0147f700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9ce00682f0 0x7f9ce006a7a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9cec000f60 tx=0x7f9cec007e70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:28.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.011+0000 7f9cf1ffb700 1 -- 172.21.15.5:0/3575803937 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9cf4052db0 con 0x7f9cfc15cd40 2023-03-03T06:24:28.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.204+0000 7f9d036e3700 1 -- 172.21.15.5:0/3575803937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9cfc04e6e0 con 0x7f9cfc15cd40 2023-03-03T06:24:28.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.205+0000 7f9cf1ffb700 1 -- 172.21.15.5:0/3575803937 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cf40563d0 con 0x7f9cfc15cd40 2023-03-03T06:24:28.207 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:24:28.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.207+0000 7f9d036e3700 1 -- 172.21.15.5:0/3575803937 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9ce00682f0 msgr2=0x7f9ce006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.207+0000 7f9d036e3700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9ce00682f0 0x7f9ce006a7a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9cec000f60 tx=0x7f9cec007e70 comp rx=0 tx=0).stop 2023-03-03T06:24:28.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.207+0000 7f9d036e3700 1 -- 172.21.15.5:0/3575803937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc15cd40 msgr2=0x7f9cfc1f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.207+0000 7f9d036e3700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc15cd40 0x7f9cfc1f2460 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400efc0 tx=0x7f9cf400c3a0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.207+0000 7f9d036e3700 1 -- 172.21.15.5:0/3575803937 shutdown_connections 2023-03-03T06:24:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.207+0000 7f9d036e3700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cfc15cd40 0x7f9cfc1f2460 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.207+0000 7f9d036e3700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9cfc0b1fe0 0x7f9cfc0c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.207+0000 7f9d036e3700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9ce00682f0 0x7f9ce006a7a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.207+0000 7f9d036e3700 1 --2- 172.21.15.5:0/3575803937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9cfc0cd3e0 0x7f9cfc0ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.207+0000 7f9d036e3700 1 -- 172.21.15.5:0/3575803937 >> 172.21.15.5:0/3575803937 conn(0x7f9cfc0cc8d0 msgr2=0x7f9cfc0cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.207+0000 7f9d036e3700 1 -- 172.21.15.5:0/3575803937 shutdown_connections 2023-03-03T06:24:28.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.207+0000 7f9d036e3700 1 -- 172.21.15.5:0/3575803937 wait complete. 2023-03-03T06:24:28.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:24:28.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.349+0000 7f2b6a127700 1 Processor -- start 2023-03-03T06:24:28.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.349+0000 7f2b6a127700 1 -- start start 2023-03-03T06:24:28.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b6a127700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2b6415a460 0x7f2b640cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b6a127700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b640cd650 con 0x7f2b640cdf70 2023-03-03T06:24:28.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b6a127700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b640d16a0 con 0x7f2b6415a830 2023-03-03T06:24:28.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b6a127700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b640cb4a0 con 0x7f2b6415a460 2023-03-03T06:24:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b63fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2b640cdf70 0x7f2b640cea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60698/0 (socket says 172.21.15.5:60698) 2023-03-03T06:24:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b63fff700 1 -- 172.21.15.5:0/3253129689 learned_addr learned my addr 172.21.15.5:0/3253129689 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b637fe700 1 --2- 172.21.15.5:0/3253129689 >> v2:172.21.15.191:3300/0 conn(0x7f2b6415a460 0x7f2b640cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b627fc700 1 -- 172.21.15.5:0/3253129689 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160076373 0 0) 0x7f2b640cd650 con 0x7f2b640cdf70 2023-03-03T06:24:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b627fc700 1 -- 172.21.15.5:0/3253129689 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b500035b0 con 0x7f2b640cdf70 2023-03-03T06:24:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b627fc700 1 -- 172.21.15.5:0/3253129689 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774790894 0 0) 0x7f2b640d16a0 con 0x7f2b6415a830 2023-03-03T06:24:28.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b627fc700 1 -- 172.21.15.5:0/3253129689 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b640cd650 con 0x7f2b6415a830 2023-03-03T06:24:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b637fe700 1 -- 172.21.15.5:0/3253129689 >> v1:172.21.15.191:6789/0 conn(0x7f2b6415a830 legacy=0x7f2b640cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b637fe700 1 -- 172.21.15.5:0/3253129689 >> v1:172.21.15.5:6789/0 conn(0x7f2b640cdf70 legacy=0x7f2b640cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.350+0000 7f2b637fe700 1 -- 172.21.15.5:0/3253129689 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b640cbc70 con 0x7f2b6415a460 2023-03-03T06:24:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.351+0000 7f2b637fe700 1 --2- 172.21.15.5:0/3253129689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b6415a460 0x7f2b640cd110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009840 tx=0x7f2b54009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1554a5b6fb44e36e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.351+0000 7f2b627fc700 1 -- 172.21.15.5:0/3253129689 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54011830 con 0x7f2b6415a460 2023-03-03T06:24:28.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.351+0000 7f2b627fc700 1 -- 172.21.15.5:0/3253129689 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b54011990 con 0x7f2b6415a460 2023-03-03T06:24:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.351+0000 7f2b627fc700 1 -- 172.21.15.5:0/3253129689 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b54011d00 con 0x7f2b6415a460 2023-03-03T06:24:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.351+0000 7f2b6a127700 1 -- 172.21.15.5:0/3253129689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b6415a460 msgr2=0x7f2b640cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.351+0000 7f2b6a127700 1 --2- 172.21.15.5:0/3253129689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b6415a460 0x7f2b640cd110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009840 tx=0x7f2b54009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.351+0000 7f2b6a127700 1 -- 172.21.15.5:0/3253129689 shutdown_connections 2023-03-03T06:24:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.351+0000 7f2b6a127700 1 --2- 172.21.15.5:0/3253129689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b6415a460 0x7f2b640cd110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.351+0000 7f2b6a127700 1 -- 172.21.15.5:0/3253129689 >> 172.21.15.5:0/3253129689 conn(0x7f2b6406f3c0 msgr2=0x7f2b6406f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.351+0000 7f2b6a127700 1 -- 172.21.15.5:0/3253129689 shutdown_connections 2023-03-03T06:24:28.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.351+0000 7f2b6a127700 1 -- 172.21.15.5:0/3253129689 wait complete. 2023-03-03T06:24:28.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.353+0000 7f2b6a127700 1 Processor -- start 2023-03-03T06:24:28.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.353+0000 7f2b6a127700 1 -- start start 2023-03-03T06:24:28.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b6a127700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640cdf70 0x7f2b6415ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b6a127700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b6415a460 0x7f2b6415b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b6a127700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b6415a830 0x7f2b641ef770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b6a127700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640c7b60 con 0x7f2b640cdf70 2023-03-03T06:24:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b6a127700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b641efcb0 con 0x7f2b6415a830 2023-03-03T06:24:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b6a127700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640ca220 con 0x7f2b6415a460 2023-03-03T06:24:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640cdf70 0x7f2b6415ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640cdf70 0x7f2b6415ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42626/0 (socket says 172.21.15.5:42626) 2023-03-03T06:24:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b637fe700 1 -- 172.21.15.5:0/3815331019 learned_addr learned my addr 172.21.15.5:0/3815331019 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b62ffd700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b6415a460 0x7f2b6415b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b63fff700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b6415a830 0x7f2b641ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b637fe700 1 -- 172.21.15.5:0/3815331019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b6415a460 msgr2=0x7f2b6415b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b637fe700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b6415a460 0x7f2b6415b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.362 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b637fe700 1 -- 172.21.15.5:0/3815331019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b6415a830 msgr2=0x7f2b641ef770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b637fe700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b6415a830 0x7f2b641ef770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b637fe700 1 -- 172.21.15.5:0/3815331019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b540094a0 con 0x7f2b640cdf70 2023-03-03T06:24:28.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b637fe700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640cdf70 0x7f2b6415ac80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2b540090b0 tx=0x7f2b54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:28.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b5bfff700 1 -- 172.21.15.5:0/3815331019 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b540044d0 con 0x7f2b640cdf70 2023-03-03T06:24:28.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b6a127700 1 -- 172.21.15.5:0/3815331019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b640cb990 con 0x7f2b640cdf70 2023-03-03T06:24:28.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b5bfff700 1 -- 172.21.15.5:0/3815331019 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5401f070 con 0x7f2b640cdf70 2023-03-03T06:24:28.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b5bfff700 1 -- 172.21.15.5:0/3815331019 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b540038e0 con 0x7f2b640cdf70 2023-03-03T06:24:28.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.354+0000 7f2b6a127700 1 -- 172.21.15.5:0/3815331019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b640cb6b0 con 0x7f2b640cdf70 2023-03-03T06:24:28.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.355+0000 7f2b6a127700 1 -- 172.21.15.5:0/3815331019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b640d1940 con 0x7f2b640cdf70 2023-03-03T06:24:28.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.356+0000 7f2b5bfff700 1 -- 172.21.15.5:0/3815331019 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2b5400f050 con 0x7f2b640cdf70 2023-03-03T06:24:28.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.357+0000 7f2b5bfff700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2b440682f0 0x7f2b4406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.357+0000 7f2b62ffd700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2b440682f0 0x7f2b4406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.357+0000 7f2b5bfff700 1 -- 172.21.15.5:0/3815331019 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2b54021070 con 0x7f2b640cdf70 2023-03-03T06:24:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.357+0000 7f2b62ffd700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2b440682f0 0x7f2b4406a7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2b6415b1c0 tx=0x7f2b4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:28.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.361+0000 7f2b5bfff700 1 -- 172.21.15.5:0/3815331019 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2b54053ed0 con 0x7f2b640cdf70 2023-03-03T06:24:28.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.555+0000 7f2b6a127700 1 -- 172.21.15.5:0/3815331019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b6404e6e0 con 0x7f2b640cdf70 2023-03-03T06:24:28.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.556+0000 7f2b5bfff700 1 -- 172.21.15.5:0/3815331019 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b54006cc0 con 0x7f2b640cdf70 2023-03-03T06:24:28.558 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:28.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.558+0000 7f2b6a127700 1 -- 172.21.15.5:0/3815331019 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2b440682f0 msgr2=0x7f2b4406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.558+0000 7f2b6a127700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2b440682f0 0x7f2b4406a7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2b6415b1c0 tx=0x7f2b4c009040 comp rx=0 tx=0).stop 2023-03-03T06:24:28.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.558+0000 7f2b6a127700 1 -- 172.21.15.5:0/3815331019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640cdf70 msgr2=0x7f2b6415ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.558+0000 7f2b6a127700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640cdf70 0x7f2b6415ac80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2b540090b0 tx=0x7f2b54004750 comp rx=0 tx=0).stop 2023-03-03T06:24:28.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.558+0000 7f2b6a127700 1 -- 172.21.15.5:0/3815331019 shutdown_connections 2023-03-03T06:24:28.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.558+0000 7f2b6a127700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b6415a830 0x7f2b641ef770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.558+0000 7f2b6a127700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640cdf70 0x7f2b6415ac80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.558+0000 7f2b6a127700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2b440682f0 0x7f2b4406a7a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.558+0000 7f2b6a127700 1 --2- 172.21.15.5:0/3815331019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b6415a460 0x7f2b6415b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.558+0000 7f2b6a127700 1 -- 172.21.15.5:0/3815331019 >> 172.21.15.5:0/3815331019 conn(0x7f2b6406f3c0 msgr2=0x7f2b640b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:28.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.558+0000 7f2b6a127700 1 -- 172.21.15.5:0/3815331019 shutdown_connections 2023-03-03T06:24:28.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.558+0000 7f2b6a127700 1 -- 172.21.15.5:0/3815331019 wait complete. 2023-03-03T06:24:28.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:24:28.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.698+0000 7fa997bcd700 1 Processor -- start 2023-03-03T06:24:28.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.698+0000 7fa997bcd700 1 -- start start 2023-03-03T06:24:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.699+0000 7fa997bcd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa99015cd40 0x7fa9900b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.699+0000 7fa997bcd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa9900cb9d0 0x7fa9900b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.699+0000 7fa997bcd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99015e160 con 0x7fa9900cd3e0 2023-03-03T06:24:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.699+0000 7fa997bcd700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9900cd870 con 0x7fa99015cd40 2023-03-03T06:24:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.699+0000 7fa997bcd700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99015d110 con 0x7fa9900cb9d0 2023-03-03T06:24:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.699+0000 7fa995969700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa99015cd40 0x7fa9900b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.699+0000 7fa995168700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa9900cd3e0 0x7fa990160720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60708/0 (socket says 172.21.15.5:60708) 2023-03-03T06:24:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.699+0000 7fa995168700 1 -- 172.21.15.5:0/988137882 learned_addr learned my addr 172.21.15.5:0/988137882 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.700+0000 7fa99616a700 1 --2- 172.21.15.5:0/988137882 >> v2:172.21.15.191:3300/0 conn(0x7fa9900cb9d0 0x7fa9900b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.700+0000 7fa995969700 1 -- 172.21.15.5:0/988137882 >> v2:172.21.15.191:3300/0 conn(0x7fa9900cb9d0 msgr2=0x7fa9900b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.700+0000 7fa995969700 1 --2- 172.21.15.5:0/988137882 >> v2:172.21.15.191:3300/0 conn(0x7fa9900cb9d0 0x7fa9900b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.700+0000 7fa994967700 1 -- 172.21.15.5:0/988137882 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253790712 0 0) 0x7fa99015e160 con 0x7fa9900cd3e0 2023-03-03T06:24:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.700+0000 7fa995969700 1 -- 172.21.15.5:0/988137882 >> v1:172.21.15.5:6789/0 conn(0x7fa9900cd3e0 legacy=0x7fa990160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.700+0000 7fa995969700 1 -- 172.21.15.5:0/988137882 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99015d3c0 con 0x7fa99015cd40 2023-03-03T06:24:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.700+0000 7fa99616a700 1 --2- 172.21.15.5:0/988137882 >> v2:172.21.15.191:3300/0 conn(0x7fa9900cb9d0 0x7fa9900b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.700+0000 7fa995969700 1 --2- 172.21.15.5:0/988137882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa99015cd40 0x7fa9900b18d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa990068620 tx=0x7fa980009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b0e942f48218f7 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:28.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.700+0000 7fa994967700 1 -- 172.21.15.5:0/988137882 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980011830 con 0x7fa99015cd40 2023-03-03T06:24:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.700+0000 7fa994967700 1 -- 172.21.15.5:0/988137882 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa980011990 con 0x7fa99015cd40 2023-03-03T06:24:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.700+0000 7fa994967700 1 -- 172.21.15.5:0/988137882 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980011d20 con 0x7fa99015cd40 2023-03-03T06:24:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.701+0000 7fa997bcd700 1 -- 172.21.15.5:0/988137882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa99015cd40 msgr2=0x7fa9900b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.701+0000 7fa997bcd700 1 --2- 172.21.15.5:0/988137882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa99015cd40 0x7fa9900b18d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa990068620 tx=0x7fa980009b20 comp rx=0 tx=0).stop 2023-03-03T06:24:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.701+0000 7fa997bcd700 1 -- 172.21.15.5:0/988137882 shutdown_connections 2023-03-03T06:24:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.701+0000 7fa997bcd700 1 --2- 172.21.15.5:0/988137882 >> v2:172.21.15.191:3300/0 conn(0x7fa9900cb9d0 0x7fa9900b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.701+0000 7fa997bcd700 1 --2- 172.21.15.5:0/988137882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa99015cd40 0x7fa9900b18d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.701+0000 7fa997bcd700 1 -- 172.21.15.5:0/988137882 >> 172.21.15.5:0/988137882 conn(0x7fa9900cc8d0 msgr2=0x7fa9900cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.701+0000 7fa997bcd700 1 -- 172.21.15.5:0/988137882 shutdown_connections 2023-03-03T06:24:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.701+0000 7fa997bcd700 1 -- 172.21.15.5:0/988137882 wait complete. 2023-03-03T06:24:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.702+0000 7fa997bcd700 1 Processor -- start 2023-03-03T06:24:28.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.702+0000 7fa997bcd700 1 -- start start 2023-03-03T06:24:28.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa997bcd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9900cb9d0 0x7fa9900c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa997bcd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9900cd3e0 0x7fa9900b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa997bcd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa99015cd40 0x7fa9900b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa997bcd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900c9bc0 con 0x7fa99015cd40 2023-03-03T06:24:28.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa997bcd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900c7460 con 0x7fa9900cd3e0 2023-03-03T06:24:28.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa997bcd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900c7690 con 0x7fa9900cb9d0 2023-03-03T06:24:28.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa99616a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa99015cd40 0x7fa9900b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa99616a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa99015cd40 0x7fa9900b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42644/0 (socket says 172.21.15.5:42644) 2023-03-03T06:24:28.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa99616a700 1 -- 172.21.15.5:0/933965893 learned_addr learned my addr 172.21.15.5:0/933965893 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:28.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa995168700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9900cd3e0 0x7fa9900b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa995969700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9900cb9d0 0x7fa9900c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa99616a700 1 -- 172.21.15.5:0/933965893 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9900cb9d0 msgr2=0x7fa9900c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa99616a700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9900cb9d0 0x7fa9900c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa99616a700 1 -- 172.21.15.5:0/933965893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9900cd3e0 msgr2=0x7fa9900b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa99616a700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9900cd3e0 0x7fa9900b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa99616a700 1 -- 172.21.15.5:0/933965893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9800094a0 con 0x7fa99015cd40 2023-03-03T06:24:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa99616a700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa99015cd40 0x7fa9900b4880 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa98800cef0 tx=0x7fa98800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa9867fc700 1 -- 172.21.15.5:0/933965893 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800ae50 con 0x7fa99015cd40 2023-03-03T06:24:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa9867fc700 1 -- 172.21.15.5:0/933965893 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa988015440 con 0x7fa99015cd40 2023-03-03T06:24:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.703+0000 7fa997bcd700 1 -- 172.21.15.5:0/933965893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99015d980 con 0x7fa99015cd40 2023-03-03T06:24:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.704+0000 7fa9867fc700 1 -- 172.21.15.5:0/933965893 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9880157f0 con 0x7fa99015cd40 2023-03-03T06:24:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.704+0000 7fa997bcd700 1 -- 172.21.15.5:0/933965893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99015d6a0 con 0x7fa99015cd40 2023-03-03T06:24:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.705+0000 7fa997bcd700 1 -- 172.21.15.5:0/933965893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99015dc60 con 0x7fa99015cd40 2023-03-03T06:24:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.705+0000 7fa9867fc700 1 -- 172.21.15.5:0/933965893 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa98801c030 con 0x7fa99015cd40 2023-03-03T06:24:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.705+0000 7fa9867fc700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9740682f0 0x7fa97406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.706+0000 7fa9867fc700 1 -- 172.21.15.5:0/933965893 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa988086460 con 0x7fa99015cd40 2023-03-03T06:24:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.706+0000 7fa995969700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9740682f0 0x7fa97406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.706+0000 7fa995969700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9740682f0 0x7fa97406a7a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa9800090b0 tx=0x7fa98001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.710+0000 7fa9867fc700 1 -- 172.21.15.5:0/933965893 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa988052990 con 0x7fa99015cd40 2023-03-03T06:24:28.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.902+0000 7fa997bcd700 1 -- 172.21.15.5:0/933965893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa99004e6e0 con 0x7fa99015cd40 2023-03-03T06:24:28.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.902+0000 7fa9867fc700 1 -- 172.21.15.5:0/933965893 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa98801a020 con 0x7fa99015cd40 2023-03-03T06:24:28.905 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:24:28.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.904+0000 7fa997bcd700 1 -- 172.21.15.5:0/933965893 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9740682f0 msgr2=0x7fa97406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.904+0000 7fa997bcd700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9740682f0 0x7fa97406a7a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa9800090b0 tx=0x7fa98001c040 comp rx=0 tx=0).stop 2023-03-03T06:24:28.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.904+0000 7fa997bcd700 1 -- 172.21.15.5:0/933965893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa99015cd40 msgr2=0x7fa9900b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:28.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.904+0000 7fa997bcd700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa99015cd40 0x7fa9900b4880 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa98800cef0 tx=0x7fa98800a340 comp rx=0 tx=0).stop 2023-03-03T06:24:28.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.904+0000 7fa997bcd700 1 -- 172.21.15.5:0/933965893 shutdown_connections 2023-03-03T06:24:28.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.904+0000 7fa997bcd700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa99015cd40 0x7fa9900b4880 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.904+0000 7fa997bcd700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9740682f0 0x7fa97406a7a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.904+0000 7fa997bcd700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa9900cb9d0 0x7fa9900c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.904+0000 7fa997bcd700 1 --2- 172.21.15.5:0/933965893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa9900cd3e0 0x7fa9900b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:28.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.904+0000 7fa997bcd700 1 -- 172.21.15.5:0/933965893 >> 172.21.15.5:0/933965893 conn(0x7fa9900cc8d0 msgr2=0x7fa99006cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:28.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.905+0000 7fa997bcd700 1 -- 172.21.15.5:0/933965893 shutdown_connections 2023-03-03T06:24:28.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:28.905+0000 7fa997bcd700 1 -- 172.21.15.5:0/933965893 wait complete. 2023-03-03T06:24:28.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-03T06:24:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.044+0000 7fd99a23b700 1 Processor -- start 2023-03-03T06:24:29.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.044+0000 7fd99a23b700 1 -- start start 2023-03-03T06:24:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd99a23b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd99415a7b0 0x7fd99415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd99a23b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd99406b700 0x7fd99406bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd99a23b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9940cf380 con 0x7fd9940cde30 2023-03-03T06:24:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd99a23b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd99406c040 con 0x7fd99406b700 2023-03-03T06:24:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd99a23b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9940cf5c0 con 0x7fd99415a7b0 2023-03-03T06:24:29.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd993fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd99406b700 0x7fd99406bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd993fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd99406b700 0x7fd99406bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42652/0 (socket says 172.21.15.5:42652) 2023-03-03T06:24:29.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd993fff700 1 -- 172.21.15.5:0/2364198734 learned_addr learned my addr 172.21.15.5:0/2364198734 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:29.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd9937fe700 1 --2- 172.21.15.5:0/2364198734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd99415a7b0 0x7fd99415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd993fff700 1 -- 172.21.15.5:0/2364198734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd99415a7b0 msgr2=0x7fd99415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd993fff700 1 --2- 172.21.15.5:0/2364198734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd99415a7b0 0x7fd99415ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd993fff700 1 -- 172.21.15.5:0/2364198734 >> v1:172.21.15.191:6789/0 conn(0x7fd9940cde30 legacy=0x7fd9940cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd993fff700 1 -- 172.21.15.5:0/2364198734 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9940cf8a0 con 0x7fd99406b700 2023-03-03T06:24:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.045+0000 7fd9937fe700 1 --2- 172.21.15.5:0/2364198734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd99415a7b0 0x7fd99415ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.046+0000 7fd993fff700 1 --2- 172.21.15.5:0/2364198734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99406b700 0x7fd99406bb00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009e50 tx=0x7fd98c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de362e87f57c7fbc server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:29.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.046+0000 7fd9927fc700 1 -- 172.21.15.5:0/2364198734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c00e070 con 0x7fd99406b700 2023-03-03T06:24:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.046+0000 7fd9927fc700 1 -- 172.21.15.5:0/2364198734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98c00b9c0 con 0x7fd99406b700 2023-03-03T06:24:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.046+0000 7fd9927fc700 1 -- 172.21.15.5:0/2364198734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c00bd70 con 0x7fd99406b700 2023-03-03T06:24:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.046+0000 7fd99a23b700 1 -- 172.21.15.5:0/2364198734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99406b700 msgr2=0x7fd99406bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:29.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.046+0000 7fd99a23b700 1 --2- 172.21.15.5:0/2364198734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99406b700 0x7fd99406bb00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009e50 tx=0x7fd98c00b330 comp rx=0 tx=0).stop 2023-03-03T06:24:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.046+0000 7fd99a23b700 1 -- 172.21.15.5:0/2364198734 shutdown_connections 2023-03-03T06:24:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.046+0000 7fd99a23b700 1 --2- 172.21.15.5:0/2364198734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99406b700 0x7fd99406bb00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.046+0000 7fd99a23b700 1 --2- 172.21.15.5:0/2364198734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd99415a7b0 0x7fd99415ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.046+0000 7fd99a23b700 1 -- 172.21.15.5:0/2364198734 >> 172.21.15.5:0/2364198734 conn(0x7fd9940cc8d0 msgr2=0x7fd9940cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.046+0000 7fd99a23b700 1 -- 172.21.15.5:0/2364198734 shutdown_connections 2023-03-03T06:24:29.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.046+0000 7fd99a23b700 1 -- 172.21.15.5:0/2364198734 wait complete. 2023-03-03T06:24:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.048+0000 7fd99a23b700 1 Processor -- start 2023-03-03T06:24:29.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.048+0000 7fd99a23b700 1 -- start start 2023-03-03T06:24:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd99a23b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd99406b700 0x7fd9940c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd99a23b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9940cde30 0x7fd9940b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd99a23b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99415a7b0 0x7fd9940b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd99a23b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd994152d40 con 0x7fd99415a7b0 2023-03-03T06:24:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd99a23b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd994152fb0 con 0x7fd99406b700 2023-03-03T06:24:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd99a23b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd994153290 con 0x7fd9940cde30 2023-03-03T06:24:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd993fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99415a7b0 0x7fd9940b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd993fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99415a7b0 0x7fd9940b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42658/0 (socket says 172.21.15.5:42658) 2023-03-03T06:24:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd993fff700 1 -- 172.21.15.5:0/1247916567 learned_addr learned my addr 172.21.15.5:0/1247916567 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd992ffd700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9940cde30 0x7fd9940b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd9937fe700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd99406b700 0x7fd9940c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd993fff700 1 -- 172.21.15.5:0/1247916567 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9940cde30 msgr2=0x7fd9940b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd993fff700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9940cde30 0x7fd9940b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd993fff700 1 -- 172.21.15.5:0/1247916567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd99406b700 msgr2=0x7fd9940c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd993fff700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd99406b700 0x7fd9940c2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd993fff700 1 -- 172.21.15.5:0/1247916567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c009b30 con 0x7fd99415a7b0 2023-03-03T06:24:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd9937fe700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd99406b700 0x7fd9940c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd993fff700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99415a7b0 0x7fd9940b4b00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd994068890 tx=0x7fd98c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd98bfff700 1 -- 172.21.15.5:0/1247916567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c004960 con 0x7fd99415a7b0 2023-03-03T06:24:29.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd98bfff700 1 -- 172.21.15.5:0/1247916567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98c0099b0 con 0x7fd99415a7b0 2023-03-03T06:24:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd99a23b700 1 -- 172.21.15.5:0/1247916567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9940b2d40 con 0x7fd99415a7b0 2023-03-03T06:24:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd98bfff700 1 -- 172.21.15.5:0/1247916567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98c01c680 con 0x7fd99415a7b0 2023-03-03T06:24:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.049+0000 7fd99a23b700 1 -- 172.21.15.5:0/1247916567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9940cfb80 con 0x7fd99415a7b0 2023-03-03T06:24:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.050+0000 7fd99a23b700 1 -- 172.21.15.5:0/1247916567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9940b3020 con 0x7fd99415a7b0 2023-03-03T06:24:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.051+0000 7fd98bfff700 1 -- 172.21.15.5:0/1247916567 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd98c02c070 con 0x7fd99415a7b0 2023-03-03T06:24:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.051+0000 7fd98bfff700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9740682f0 0x7fd97406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.051+0000 7fd98bfff700 1 -- 172.21.15.5:0/1247916567 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd98c087bc0 con 0x7fd99415a7b0 2023-03-03T06:24:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.051+0000 7fd9937fe700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9740682f0 0x7fd97406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.052+0000 7fd9937fe700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9740682f0 0x7fd97406a7a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd9940d0800 tx=0x7fd984008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.055+0000 7fd98bfff700 1 -- 172.21.15.5:0/1247916567 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd98c0540f0 con 0x7fd99415a7b0 2023-03-03T06:24:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.248+0000 7fd99a23b700 1 -- 172.21.15.5:0/1247916567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd99404e6e0 con 0x7fd99415a7b0 2023-03-03T06:24:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.249+0000 7fd98bfff700 1 -- 172.21.15.5:0/1247916567 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd98c057710 con 0x7fd99415a7b0 2023-03-03T06:24:29.251 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.251+0000 7fd99a23b700 1 -- 172.21.15.5:0/1247916567 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9740682f0 msgr2=0x7fd97406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:29.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.251+0000 7fd99a23b700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9740682f0 0x7fd97406a7a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd9940d0800 tx=0x7fd984008040 comp rx=0 tx=0).stop 2023-03-03T06:24:29.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.251+0000 7fd99a23b700 1 -- 172.21.15.5:0/1247916567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99415a7b0 msgr2=0x7fd9940b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:29.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.251+0000 7fd99a23b700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99415a7b0 0x7fd9940b4b00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd994068890 tx=0x7fd98c004ad0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.251+0000 7fd99a23b700 1 -- 172.21.15.5:0/1247916567 shutdown_connections 2023-03-03T06:24:29.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.251+0000 7fd99a23b700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99415a7b0 0x7fd9940b4b00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.251+0000 7fd99a23b700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd99406b700 0x7fd9940c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.251+0000 7fd99a23b700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9740682f0 0x7fd97406a7a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.251+0000 7fd99a23b700 1 --2- 172.21.15.5:0/1247916567 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9940cde30 0x7fd9940b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.251+0000 7fd99a23b700 1 -- 172.21.15.5:0/1247916567 >> 172.21.15.5:0/1247916567 conn(0x7fd9940cc8d0 msgr2=0x7fd9940ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:29.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.251+0000 7fd99a23b700 1 -- 172.21.15.5:0/1247916567 shutdown_connections 2023-03-03T06:24:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.251+0000 7fd99a23b700 1 -- 172.21.15.5:0/1247916567 wait complete. 2023-03-03T06:24:29.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-03T06:24:29.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.392+0000 7f3bc6123700 1 Processor -- start 2023-03-03T06:24:29.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.392+0000 7f3bc6123700 1 -- start start 2023-03-03T06:24:29.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bc6123700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc015fcb0 0x7f3bc00cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bc6123700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc00d1c00 con 0x7f3bc006d0c0 2023-03-03T06:24:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bc6123700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc0160080 con 0x7f3bc00b03f0 2023-03-03T06:24:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bc6123700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0160cf0 con 0x7f3bc015fcb0 2023-03-03T06:24:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3bc006d0c0 0x7f3bc00d14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60740/0 (socket says 172.21.15.5:60740) 2023-03-03T06:24:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbffff700 1 -- 172.21.15.5:0/3599130354 learned_addr learned my addr 172.21.15.5:0/3599130354 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbf7fe700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc015fcb0 0x7f3bc00cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271093450 0 0) 0x7f3bc00d1c00 con 0x7f3bc006d0c0 2023-03-03T06:24:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bac0035b0 con 0x7f3bc006d0c0 2023-03-03T06:24:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447320917 0 0) 0x7f3bc0160080 con 0x7f3bc00b03f0 2023-03-03T06:24:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc00d1c00 con 0x7f3bc00b03f0 2023-03-03T06:24:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1701096026 0 0) 0x7f3bac0035b0 con 0x7f3bc006d0c0 2023-03-03T06:24:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc015fcb0 msgr2=0x7f3bc00cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbe7fc700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc015fcb0 0x7f3bc00cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 >> v1:172.21.15.191:6789/0 conn(0x7f3bc00b03f0 legacy=0x7f3bc00d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc0160ee0 con 0x7f3bc006d0c0 2023-03-03T06:24:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f3bb80019f0 con 0x7f3bc006d0c0 2023-03-03T06:24:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.393+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 >> v1:172.21.15.5:6789/0 conn(0x7f3bc006d0c0 legacy=0x7f3bc00d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbe7fc700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bac003c30 0x7f3bac004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbe7fc700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bac004850 0x7f3bac004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbe7fc700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bac005200 0x7f3bac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac00c0e0 con 0x7f3bac004850 2023-03-03T06:24:29.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac00c220 con 0x7f3bac005200 2023-03-03T06:24:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac00c3e0 con 0x7f3bac003c30 2023-03-03T06:24:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbf7fe700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc015fcb0 0x7f3bc00cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbeffd700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bac004850 0x7f3bac004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbffff700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bac005200 0x7f3bac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbf7fe700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bac003c30 0x7f3bac004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbeffd700 1 -- 172.21.15.5:0/3599130354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bac003c30 msgr2=0x7f3bac004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:29.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbeffd700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bac003c30 0x7f3bac004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbeffd700 1 -- 172.21.15.5:0/3599130354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bac005200 msgr2=0x7f3bac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbeffd700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bac005200 0x7f3bac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbeffd700 1 -- 172.21.15.5:0/3599130354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac0035b0 con 0x7f3bac004850 2023-03-03T06:24:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbf7fe700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bac003c30 0x7f3bac004020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbeffd700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bac004850 0x7f3bac004cc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8001930 tx=0x7f3bac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d1c6b2c9515db3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba80052d0 con 0x7f3bac004850 2023-03-03T06:24:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba8005430 con 0x7f3bac004850 2023-03-03T06:24:29.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.394+0000 7f3bbe7fc700 1 -- 172.21.15.5:0/3599130354 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba80038c0 con 0x7f3bac004850 2023-03-03T06:24:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.395+0000 7f3bc6123700 1 -- 172.21.15.5:0/3599130354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bac004850 msgr2=0x7f3bac004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.395+0000 7f3bc6123700 1 --2- 172.21.15.5:0/3599130354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bac004850 0x7f3bac004cc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8001930 tx=0x7f3bac005880 comp rx=0 tx=0).stop 2023-03-03T06:24:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.395+0000 7f3bbffff700 1 -- 172.21.15.5:0/3599130354 reap_dead start 2023-03-03T06:24:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.395+0000 7f3bc6123700 1 -- 172.21.15.5:0/3599130354 shutdown_connections 2023-03-03T06:24:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.395+0000 7f3bc6123700 1 -- 172.21.15.5:0/3599130354 >> 172.21.15.5:0/3599130354 conn(0x7f3bc006f3c0 msgr2=0x7f3bc006f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.395+0000 7f3bc6123700 1 -- 172.21.15.5:0/3599130354 shutdown_connections 2023-03-03T06:24:29.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.395+0000 7f3bc6123700 1 -- 172.21.15.5:0/3599130354 wait complete. 2023-03-03T06:24:29.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.396+0000 7f3bc6123700 1 Processor -- start 2023-03-03T06:24:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.396+0000 7f3bc6123700 1 -- start start 2023-03-03T06:24:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.397+0000 7f3bc6123700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bac004850 0x7f3bc00b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.397+0000 7f3bc6123700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bc015c550 0x7f3bc00abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.397+0000 7f3bc6123700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc00ac100 0x7f3bc01f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.397+0000 7f3bc6123700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00aca10 con 0x7f3bc015c550 2023-03-03T06:24:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.397+0000 7f3bc6123700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc015b860 con 0x7f3bac004850 2023-03-03T06:24:29.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.397+0000 7f3bc6123700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00ac730 con 0x7f3bc00ac100 2023-03-03T06:24:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.397+0000 7f3bbeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bc015c550 0x7f3bc00abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.397+0000 7f3bbeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bc015c550 0x7f3bc00abbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42676/0 (socket says 172.21.15.5:42676) 2023-03-03T06:24:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.397+0000 7f3bbeffd700 1 -- 172.21.15.5:0/3053752168 learned_addr learned my addr 172.21.15.5:0/3053752168 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.397+0000 7f3bbf7fe700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bac004850 0x7f3bc00b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.397+0000 7f3bbffff700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc00ac100 0x7f3bc01f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.397+0000 7f3bbeffd700 1 -- 172.21.15.5:0/3053752168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc00ac100 msgr2=0x7f3bc01f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:29.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.397+0000 7f3bbeffd700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc00ac100 0x7f3bc01f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.398+0000 7f3bbeffd700 1 -- 172.21.15.5:0/3053752168 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bac004850 msgr2=0x7f3bc00b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.398+0000 7f3bbeffd700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bac004850 0x7f3bc00b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.398+0000 7f3bbeffd700 1 -- 172.21.15.5:0/3053752168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc00ceac0 con 0x7f3bc015c550 2023-03-03T06:24:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.398+0000 7f3bbffff700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc00ac100 0x7f3bc01f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.398+0000 7f3bbeffd700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bc015c550 0x7f3bc00abbc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3bac005830 tx=0x7f3ba80012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.398+0000 7f3bb7fff700 1 -- 172.21.15.5:0/3053752168 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8007240 con 0x7f3bc015c550 2023-03-03T06:24:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.398+0000 7f3bb7fff700 1 -- 172.21.15.5:0/3053752168 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba80073a0 con 0x7f3bc015c550 2023-03-03T06:24:29.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.398+0000 7f3bc6123700 1 -- 172.21.15.5:0/3053752168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc01611c0 con 0x7f3bc015c550 2023-03-03T06:24:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.398+0000 7f3bb7fff700 1 -- 172.21.15.5:0/3053752168 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8007750 con 0x7f3bc015c550 2023-03-03T06:24:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.398+0000 7f3bc6123700 1 -- 172.21.15.5:0/3053752168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc00ceda0 con 0x7f3bc015c550 2023-03-03T06:24:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.399+0000 7f3bc6123700 1 -- 172.21.15.5:0/3053752168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc004e6e0 con 0x7f3bc015c550 2023-03-03T06:24:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.399+0000 7f3bb7fff700 1 -- 172.21.15.5:0/3053752168 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3ba802e070 con 0x7f3bc015c550 2023-03-03T06:24:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.400+0000 7f3bb7fff700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3ba00682f0 0x7f3ba006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.400+0000 7f3bb7fff700 1 -- 172.21.15.5:0/3053752168 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3ba8086eb0 con 0x7f3bc015c550 2023-03-03T06:24:29.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.400+0000 7f3bbf7fe700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3ba00682f0 0x7f3ba006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.400+0000 7f3bbf7fe700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3ba00682f0 0x7f3ba006a7a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3bc015e580 tx=0x7f3bb0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:29.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.404+0000 7f3bb7fff700 1 -- 172.21.15.5:0/3053752168 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3ba80533e0 con 0x7f3bc015c550 2023-03-03T06:24:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.613+0000 7f3bc6123700 1 -- 172.21.15.5:0/3053752168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3bc00b3370 con 0x7f3bc015c550 2023-03-03T06:24:29.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.613+0000 7f3bb7fff700 1 -- 172.21.15.5:0/3053752168 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3ba8056a00 con 0x7f3bc015c550 2023-03-03T06:24:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.615+0000 7f3bc6123700 1 -- 172.21.15.5:0/3053752168 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3ba00682f0 msgr2=0x7f3ba006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.615+0000 7f3bc6123700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3ba00682f0 0x7f3ba006a7a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3bc015e580 tx=0x7f3bb0008040 comp rx=0 tx=0).stop 2023-03-03T06:24:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.615+0000 7f3bc6123700 1 -- 172.21.15.5:0/3053752168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bc015c550 msgr2=0x7f3bc00abbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.615+0000 7f3bc6123700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bc015c550 0x7f3bc00abbc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3bac005830 tx=0x7f3ba80012d0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.615+0000 7f3bc6123700 1 -- 172.21.15.5:0/3053752168 shutdown_connections 2023-03-03T06:24:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.615+0000 7f3bc6123700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3ba00682f0 0x7f3ba006a7a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.615+0000 7f3bc6123700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3bc00ac100 0x7f3bc01f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.615+0000 7f3bc6123700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bac004850 0x7f3bc00b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.615+0000 7f3bc6123700 1 --2- 172.21.15.5:0/3053752168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3bc015c550 0x7f3bc00abbc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.615+0000 7f3bc6123700 1 -- 172.21.15.5:0/3053752168 >> 172.21.15.5:0/3053752168 conn(0x7f3bc006f3c0 msgr2=0x7f3bc00d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.616+0000 7f3bc6123700 1 -- 172.21.15.5:0/3053752168 shutdown_connections 2023-03-03T06:24:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:29.616+0000 7f3bc6123700 1 -- 172.21.15.5:0/3053752168 wait complete. 2023-03-03T06:24:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-03-03T06:24:29.629 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-03-03T06:24:29.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:29.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-03-03T06:24:29.744 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-03-03T06:24:29.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:29.745 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-03-03T06:24:29.763 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:24:29.764 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:29.784 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:24:29.785 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:29.844 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:24:29.844 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:29.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:30.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.028+0000 7f7ad7c4f700 1 Processor -- start 2023-03-03T06:24:30.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.029+0000 7f7ad7c4f700 1 -- start start 2023-03-03T06:24:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad7c4f700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7ad015d320 0x7f7ad00cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad7c4f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad00b18d0 0x7f7ad00b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad7c4f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad01577c0 con 0x7f7ad01573f0 2023-03-03T06:24:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad7c4f700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad00cc6e0 con 0x7f7ad015d320 2023-03-03T06:24:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad7c4f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00cd790 con 0x7f7ad00b18d0 2023-03-03T06:24:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad59eb700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7ad01573f0 0x7f7ad00cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60756/0 (socket says 172.21.15.5:60756) 2023-03-03T06:24:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad59eb700 1 -- 172.21.15.5:0/13776008 learned_addr learned my addr 172.21.15.5:0/13776008 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220403978 0 0) 0x7f7ad01577c0 con 0x7f7ad01573f0 2023-03-03T06:24:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad51ea700 1 --2- 172.21.15.5:0/13776008 >> v2:172.21.15.191:3300/0 conn(0x7f7ad015d320 0x7f7ad00cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7abc0035b0 con 0x7f7ad01573f0 2023-03-03T06:24:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad61ec700 1 --2- 172.21.15.5:0/13776008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad00b18d0 0x7f7ad00b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4192615721 0 0) 0x7f7abc0035b0 con 0x7f7ad01573f0 2023-03-03T06:24:30.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad00b18d0 msgr2=0x7f7ad00b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:30.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad49e9700 1 --2- 172.21.15.5:0/13776008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad00b18d0 0x7f7ad00b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 >> v2:172.21.15.191:3300/0 conn(0x7f7ad015d320 msgr2=0x7f7ad00cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:30.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad49e9700 1 --2- 172.21.15.5:0/13776008 >> v2:172.21.15.191:3300/0 conn(0x7f7ad015d320 0x7f7ad00cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad0159e60 con 0x7f7ad01573f0 2023-03-03T06:24:30.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f7acc001670 con 0x7f7ad01573f0 2023-03-03T06:24:30.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 >> v1:172.21.15.5:6789/0 conn(0x7f7ad01573f0 legacy=0x7f7ad00cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.030+0000 7f7ad49e9700 1 --2- 172.21.15.5:0/13776008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad00b18d0 0x7f7abc003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad49e9700 1 --2- 172.21.15.5:0/13776008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7abc003fb0 0x7f7abc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad49e9700 1 --2- 172.21.15.5:0/13776008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7abc004d90 0x7f7abc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00cd790 con 0x7f7abc004d90 2023-03-03T06:24:30.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc00ba10 con 0x7f7abc003fb0 2023-03-03T06:24:30.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc00bb50 con 0x7f7ad00b18d0 2023-03-03T06:24:30.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad61ec700 1 --2- 172.21.15.5:0/13776008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7abc004d90 0x7f7abc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad59eb700 1 --2- 172.21.15.5:0/13776008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad00b18d0 0x7f7abc003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad51ea700 1 --2- 172.21.15.5:0/13776008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7abc003fb0 0x7f7abc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad61ec700 1 -- 172.21.15.5:0/13776008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad00b18d0 msgr2=0x7f7abc003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:30.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad61ec700 1 --2- 172.21.15.5:0/13776008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad00b18d0 0x7f7abc003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad61ec700 1 -- 172.21.15.5:0/13776008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7abc003fb0 msgr2=0x7f7abc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:30.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad61ec700 1 --2- 172.21.15.5:0/13776008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7abc003fb0 0x7f7abc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad61ec700 1 -- 172.21.15.5:0/13776008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc0035b0 con 0x7f7abc004d90 2023-03-03T06:24:30.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad51ea700 1 --2- 172.21.15.5:0/13776008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7abc003fb0 0x7f7abc004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:30.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad61ec700 1 --2- 172.21.15.5:0/13776008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7abc004d90 0x7f7abc005200 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009fc0 tx=0x7f7abc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447bbda21dd003ac server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:30.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac800ec30 con 0x7f7abc004d90 2023-03-03T06:24:30.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac800f040 con 0x7f7abc004d90 2023-03-03T06:24:30.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.031+0000 7f7ad49e9700 1 -- 172.21.15.5:0/13776008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8014480 con 0x7f7abc004d90 2023-03-03T06:24:30.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.032+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/13776008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7abc004d90 msgr2=0x7f7abc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.032+0000 7f7ad7c4f700 1 --2- 172.21.15.5:0/13776008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7abc004d90 0x7f7abc005200 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009fc0 tx=0x7f7abc005880 comp rx=0 tx=0).stop 2023-03-03T06:24:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.032+0000 7f7ad61ec700 1 -- 172.21.15.5:0/13776008 reap_dead start 2023-03-03T06:24:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.032+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/13776008 shutdown_connections 2023-03-03T06:24:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.032+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/13776008 >> 172.21.15.5:0/13776008 conn(0x7f7ad00cc8d0 msgr2=0x7f7ad00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.032+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/13776008 shutdown_connections 2023-03-03T06:24:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.032+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/13776008 wait complete. 2023-03-03T06:24:30.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.033+0000 7f7ad7c4f700 1 Processor -- start 2023-03-03T06:24:30.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.033+0000 7f7ad7c4f700 1 -- start start 2023-03-03T06:24:30.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad7c4f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7abc004d90 0x7f7ad00b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad7c4f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad00c6220 0x7f7ad00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad7c4f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad00c6690 0x7f7ad00b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad7c4f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00c82a0 con 0x7f7ad00c6220 2023-03-03T06:24:30.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad7c4f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00c3cd0 con 0x7f7abc004d90 2023-03-03T06:24:30.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad7c4f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00c73f0 con 0x7f7ad00c6690 2023-03-03T06:24:30.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad51ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad00c6220 0x7f7ad00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad51ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad00c6220 0x7f7ad00b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42696/0 (socket says 172.21.15.5:42696) 2023-03-03T06:24:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad51ea700 1 -- 172.21.15.5:0/3022257113 learned_addr learned my addr 172.21.15.5:0/3022257113 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad59eb700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7abc004d90 0x7f7ad00b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad61ec700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad00c6690 0x7f7ad00b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad51ea700 1 -- 172.21.15.5:0/3022257113 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad00c6690 msgr2=0x7f7ad00b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad51ea700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad00c6690 0x7f7ad00b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad51ea700 1 -- 172.21.15.5:0/3022257113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7abc004d90 msgr2=0x7f7ad00b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad51ea700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7abc004d90 0x7f7ad00b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.034+0000 7f7ad51ea700 1 -- 172.21.15.5:0/3022257113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad015d900 con 0x7f7ad00c6220 2023-03-03T06:24:30.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.035+0000 7f7ad51ea700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad00c6220 0x7f7ad00b4e90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4011650 tx=0x7f7ac4011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:30.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.035+0000 7f7ac27fc700 1 -- 172.21.15.5:0/3022257113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4004220 con 0x7f7ad00c6220 2023-03-03T06:24:30.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.035+0000 7f7ac27fc700 1 -- 172.21.15.5:0/3022257113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac4004380 con 0x7f7ad00c6220 2023-03-03T06:24:30.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.035+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/3022257113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad00ce460 con 0x7f7ad00c6220 2023-03-03T06:24:30.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.035+0000 7f7ac27fc700 1 -- 172.21.15.5:0/3022257113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40036a0 con 0x7f7ad00c6220 2023-03-03T06:24:30.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.035+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/3022257113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad015dbe0 con 0x7f7ad00c6220 2023-03-03T06:24:30.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.036+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/3022257113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad004e6e0 con 0x7f7ad00c6220 2023-03-03T06:24:30.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.036+0000 7f7ac27fc700 1 -- 172.21.15.5:0/3022257113 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7ac4024070 con 0x7f7ad00c6220 2023-03-03T06:24:30.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.037+0000 7f7ac27fc700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ab40682f0 0x7f7ab406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.037+0000 7f7ac27fc700 1 -- 172.21.15.5:0/3022257113 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7ac40863c0 con 0x7f7ad00c6220 2023-03-03T06:24:30.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.037+0000 7f7ad59eb700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ab40682f0 0x7f7ab406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.037+0000 7f7ad59eb700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ab40682f0 0x7f7ab406a7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7acc001050 tx=0x7f7acc00a040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:30.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.041+0000 7f7ac27fc700 1 -- 172.21.15.5:0/3022257113 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7ac4052800 con 0x7f7ad00c6220 2023-03-03T06:24:30.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.235+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/3022257113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ad00b25b0 con 0x7f7ad00c6220 2023-03-03T06:24:30.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.237+0000 7f7ac27fc700 1 -- 172.21.15.5:0/3022257113 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19641 (secure 0 0 0) 0x7f7ac4055e20 con 0x7f7ad00c6220 2023-03-03T06:24:30.239 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:30.239 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:24:28.893239+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:30.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.239+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/3022257113 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ab40682f0 msgr2=0x7f7ab406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.239+0000 7f7ad7c4f700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ab40682f0 0x7f7ab406a7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7acc001050 tx=0x7f7acc00a040 comp rx=0 tx=0).stop 2023-03-03T06:24:30.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.239+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/3022257113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad00c6220 msgr2=0x7f7ad00b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.239+0000 7f7ad7c4f700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad00c6220 0x7f7ad00b4e90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4011650 tx=0x7f7ac4011a10 comp rx=0 tx=0).stop 2023-03-03T06:24:30.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.239+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/3022257113 shutdown_connections 2023-03-03T06:24:30.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.239+0000 7f7ad7c4f700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7ab40682f0 0x7f7ab406a7a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.239+0000 7f7ad7c4f700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ad00c6690 0x7f7ad00b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.239+0000 7f7ad7c4f700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7abc004d90 0x7f7ad00b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.239+0000 7f7ad7c4f700 1 --2- 172.21.15.5:0/3022257113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ad00c6220 0x7f7ad00b4e90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.239+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/3022257113 >> 172.21.15.5:0/3022257113 conn(0x7f7ad00cc8d0 msgr2=0x7f7ad0157eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:30.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.239+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/3022257113 shutdown_connections 2023-03-03T06:24:30.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.239+0000 7f7ad7c4f700 1 -- 172.21.15.5:0/3022257113 wait complete. 2023-03-03T06:24:30.253 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:23:38.141777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:23:39.283589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-03T06:23:42.422930+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-03T06:24:30.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:24:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.381+0000 7f9e36ddd700 1 Processor -- start 2023-03-03T06:24:30.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.381+0000 7f9e36ddd700 1 -- start start 2023-03-03T06:24:30.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.382+0000 7f9e36ddd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e300cd500 0x7f9e3015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.382+0000 7f9e36ddd700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e300cc5d0 con 0x7f9e300b1fe0 2023-03-03T06:24:30.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.382+0000 7f9e36ddd700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e30159c30 con 0x7f9e300b55b0 2023-03-03T06:24:30.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.382+0000 7f9e36ddd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3015e290 con 0x7f9e300cd500 2023-03-03T06:24:30.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.382+0000 7f9e3537a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9e300b1fe0 0x7f9e300cdf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60780/0 (socket says 172.21.15.5:60780) 2023-03-03T06:24:30.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.382+0000 7f9e3537a700 1 -- 172.21.15.5:0/509658019 learned_addr learned my addr 172.21.15.5:0/509658019 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:30.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.382+0000 7f9e2ffff700 1 --2- 172.21.15.5:0/509658019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e300cd500 0x7f9e3015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.382+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974373399 0 0) 0x7f9e300cc5d0 con 0x7f9e300b1fe0 2023-03-03T06:24:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.382+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e200035b0 con 0x7f9e300b1fe0 2023-03-03T06:24:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1292801456 0 0) 0x7f9e200035b0 con 0x7f9e300b1fe0 2023-03-03T06:24:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e300cd500 msgr2=0x7f9e3015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 --2- 172.21.15.5:0/509658019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e300cd500 0x7f9e3015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 >> v1:172.21.15.191:6789/0 conn(0x7f9e300b55b0 legacy=0x7f9e300b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e300b5980 con 0x7f9e300b1fe0 2023-03-03T06:24:30.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f9e280019f0 con 0x7f9e300b1fe0 2023-03-03T06:24:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 >> v1:172.21.15.5:6789/0 conn(0x7f9e300b1fe0 legacy=0x7f9e300cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 --2- 172.21.15.5:0/509658019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e300cd500 0x7f9e20003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 --2- 172.21.15.5:0/509658019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e20003f70 0x7f9e20004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 --2- 172.21.15.5:0/509658019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e20004d90 0x7f9e20005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2000ba10 con 0x7f9e20003f70 2023-03-03T06:24:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2000bb80 con 0x7f9e20004d90 2023-03-03T06:24:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2000bd40 con 0x7f9e300cd500 2023-03-03T06:24:30.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2ffff700 1 --2- 172.21.15.5:0/509658019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e20003f70 0x7f9e20004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e34b79700 1 --2- 172.21.15.5:0/509658019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e300cd500 0x7f9e20003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e3537a700 1 --2- 172.21.15.5:0/509658019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e20004d90 0x7f9e20005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2ffff700 1 -- 172.21.15.5:0/509658019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e300cd500 msgr2=0x7f9e20003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2ffff700 1 --2- 172.21.15.5:0/509658019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e300cd500 0x7f9e20003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2ffff700 1 -- 172.21.15.5:0/509658019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e20004d90 msgr2=0x7f9e20005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2ffff700 1 --2- 172.21.15.5:0/509658019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e20004d90 0x7f9e20005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2ffff700 1 -- 172.21.15.5:0/509658019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200035b0 con 0x7f9e20003f70 2023-03-03T06:24:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2ffff700 1 --2- 172.21.15.5:0/509658019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e20003f70 0x7f9e20004850 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009b60 tx=0x7f9e20005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d138bfda84a335f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00e6c0 con 0x7f9e20003f70 2023-03-03T06:24:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c00e820 con 0x7f9e20003f70 2023-03-03T06:24:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.383+0000 7f9e2f7fe700 1 -- 172.21.15.5:0/509658019 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00eb90 con 0x7f9e20003f70 2023-03-03T06:24:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.384+0000 7f9e36ddd700 1 -- 172.21.15.5:0/509658019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e20003f70 msgr2=0x7f9e20004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.384+0000 7f9e36ddd700 1 --2- 172.21.15.5:0/509658019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e20003f70 0x7f9e20004850 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009b60 tx=0x7f9e20005880 comp rx=0 tx=0).stop 2023-03-03T06:24:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.384+0000 7f9e3537a700 1 -- 172.21.15.5:0/509658019 reap_dead start 2023-03-03T06:24:30.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.384+0000 7f9e36ddd700 1 -- 172.21.15.5:0/509658019 shutdown_connections 2023-03-03T06:24:30.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.384+0000 7f9e36ddd700 1 -- 172.21.15.5:0/509658019 >> 172.21.15.5:0/509658019 conn(0x7f9e300cc8d0 msgr2=0x7f9e300cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:30.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.384+0000 7f9e36ddd700 1 -- 172.21.15.5:0/509658019 shutdown_connections 2023-03-03T06:24:30.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.384+0000 7f9e36ddd700 1 -- 172.21.15.5:0/509658019 wait complete. 2023-03-03T06:24:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.385+0000 7f9e36ddd700 1 Processor -- start 2023-03-03T06:24:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.385+0000 7f9e36ddd700 1 -- start start 2023-03-03T06:24:30.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.386+0000 7f9e36ddd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e20003f70 0x7f9e300b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.386+0000 7f9e36ddd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e300b3190 0x7f9e300cf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.386+0000 7f9e36ddd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e301f2dc0 0x7f9e3015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.386+0000 7f9e36ddd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e301e4500 con 0x7f9e20003f70 2023-03-03T06:24:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.386+0000 7f9e36ddd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300b3b20 con 0x7f9e300b3190 2023-03-03T06:24:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.386+0000 7f9e36ddd700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300b3650 con 0x7f9e301f2dc0 2023-03-03T06:24:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.386+0000 7f9e34b79700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e20003f70 0x7f9e300b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.386+0000 7f9e34b79700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e20003f70 0x7f9e300b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42714/0 (socket says 172.21.15.5:42714) 2023-03-03T06:24:30.395 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.386+0000 7f9e34b79700 1 -- 172.21.15.5:0/1788656702 learned_addr learned my addr 172.21.15.5:0/1788656702 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.386+0000 7f9e2ffff700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e300b3190 0x7f9e300cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e3537a700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e301f2dc0 0x7f9e3015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e34b79700 1 -- 172.21.15.5:0/1788656702 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e301f2dc0 msgr2=0x7f9e3015aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e34b79700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e301f2dc0 0x7f9e3015aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e34b79700 1 -- 172.21.15.5:0/1788656702 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e300b3190 msgr2=0x7f9e300cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e34b79700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e300b3190 0x7f9e300cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e34b79700 1 -- 172.21.15.5:0/1788656702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e300cbca0 con 0x7f9e20003f70 2023-03-03T06:24:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e2ffff700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e300b3190 0x7f9e300cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e3537a700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e301f2dc0 0x7f9e3015aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e34b79700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e20003f70 0x7f9e300b4850 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400f860 tx=0x7f9e2400fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e2d7fa700 1 -- 172.21.15.5:0/1788656702 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240050d0 con 0x7f9e20003f70 2023-03-03T06:24:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e2d7fa700 1 -- 172.21.15.5:0/1788656702 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e24005250 con 0x7f9e20003f70 2023-03-03T06:24:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e36ddd700 1 -- 172.21.15.5:0/1788656702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e300cb9c0 con 0x7f9e20003f70 2023-03-03T06:24:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e2d7fa700 1 -- 172.21.15.5:0/1788656702 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24003680 con 0x7f9e20003f70 2023-03-03T06:24:30.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.387+0000 7f9e36ddd700 1 -- 172.21.15.5:0/1788656702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e300cbf80 con 0x7f9e20003f70 2023-03-03T06:24:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.388+0000 7f9e36ddd700 1 -- 172.21.15.5:0/1788656702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3004e6e0 con 0x7f9e20003f70 2023-03-03T06:24:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.388+0000 7f9e2d7fa700 1 -- 172.21.15.5:0/1788656702 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9e240037e0 con 0x7f9e20003f70 2023-03-03T06:24:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.389+0000 7f9e2d7fa700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9e140682f0 0x7f9e1406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.389+0000 7f9e2d7fa700 1 -- 172.21.15.5:0/1788656702 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9e24086030 con 0x7f9e20003f70 2023-03-03T06:24:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.389+0000 7f9e2ffff700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9e140682f0 0x7f9e1406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.389+0000 7f9e2ffff700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9e140682f0 0x7f9e1406a7a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9e300b39e0 tx=0x7f9e1c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:30.399 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.393+0000 7f9e2d7fa700 1 -- 172.21.15.5:0/1788656702 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9e24052560 con 0x7f9e20003f70 2023-03-03T06:24:30.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.583+0000 7f9e36ddd700 1 -- 172.21.15.5:0/1788656702 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9e3015d080 con 0x7f9e20003f70 2023-03-03T06:24:30.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.583+0000 7f9e2d7fa700 1 -- 172.21.15.5:0/1788656702 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9e24055b80 con 0x7f9e20003f70 2023-03-03T06:24:30.586 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:24:30.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.585+0000 7f9e36ddd700 1 -- 172.21.15.5:0/1788656702 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9e140682f0 msgr2=0x7f9e1406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.585+0000 7f9e36ddd700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9e140682f0 0x7f9e1406a7a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9e300b39e0 tx=0x7f9e1c008030 comp rx=0 tx=0).stop 2023-03-03T06:24:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.585+0000 7f9e36ddd700 1 -- 172.21.15.5:0/1788656702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e20003f70 msgr2=0x7f9e300b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.585+0000 7f9e36ddd700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e20003f70 0x7f9e300b4850 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400f860 tx=0x7f9e2400fc20 comp rx=0 tx=0).stop 2023-03-03T06:24:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.585+0000 7f9e36ddd700 1 -- 172.21.15.5:0/1788656702 shutdown_connections 2023-03-03T06:24:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.585+0000 7f9e36ddd700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9e140682f0 0x7f9e1406a7a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.585+0000 7f9e36ddd700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9e301f2dc0 0x7f9e3015aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.585+0000 7f9e36ddd700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e20003f70 0x7f9e300b4850 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.585+0000 7f9e36ddd700 1 --2- 172.21.15.5:0/1788656702 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9e300b3190 0x7f9e300cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.585+0000 7f9e36ddd700 1 -- 172.21.15.5:0/1788656702 >> 172.21.15.5:0/1788656702 conn(0x7f9e300cc8d0 msgr2=0x7f9e300af890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.585+0000 7f9e36ddd700 1 -- 172.21.15.5:0/1788656702 shutdown_connections 2023-03-03T06:24:30.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.586+0000 7f9e36ddd700 1 -- 172.21.15.5:0/1788656702 wait complete. 2023-03-03T06:24:30.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:24:30.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.725+0000 7f8443d68700 1 Processor -- start 2023-03-03T06:24:30.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.725+0000 7f8443d68700 1 -- start start 2023-03-03T06:24:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.726+0000 7f8443d68700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f843c06d580 0x7f843c06da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.726+0000 7f8443d68700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843c0c9f70 con 0x7f843c15a8d0 2023-03-03T06:24:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.726+0000 7f8443d68700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843c0b2a10 con 0x7f843c15e230 2023-03-03T06:24:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.726+0000 7f8443d68700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c06df40 con 0x7f843c06d580 2023-03-03T06:24:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.726+0000 7f8441b04700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f843c15a8d0 0x7f843c0cb680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60796/0 (socket says 172.21.15.5:60796) 2023-03-03T06:24:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.726+0000 7f8441b04700 1 -- 172.21.15.5:0/891198624 learned_addr learned my addr 172.21.15.5:0/891198624 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8442305700 1 --2- 172.21.15.5:0/891198624 >> v2:172.21.15.191:3300/0 conn(0x7f843c06d580 0x7f843c06da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471955618 0 0) 0x7f843c0c9f70 con 0x7f843c15a8d0 2023-03-03T06:24:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84280035b0 con 0x7f843c15a8d0 2023-03-03T06:24:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224807966 0 0) 0x7f84280035b0 con 0x7f843c15a8d0 2023-03-03T06:24:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 >> v2:172.21.15.191:3300/0 conn(0x7f843c06d580 msgr2=0x7f843c06da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 --2- 172.21.15.5:0/891198624 >> v2:172.21.15.191:3300/0 conn(0x7f843c06d580 0x7f843c06da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 >> v1:172.21.15.191:6789/0 conn(0x7f843c15e230 legacy=0x7f843c0b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c15e7a0 con 0x7f843c15a8d0 2023-03-03T06:24:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f842c001670 con 0x7f843c15a8d0 2023-03-03T06:24:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 >> v1:172.21.15.5:6789/0 conn(0x7f843c15a8d0 legacy=0x7f843c0cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 --2- 172.21.15.5:0/891198624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8428003a00 0x7f8428003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 --2- 172.21.15.5:0/891198624 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8428004850 0x7f8428004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 --2- 172.21.15.5:0/891198624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8428005200 0x7f842800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c06df40 con 0x7f8428003a00 2023-03-03T06:24:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842800c110 con 0x7f8428005200 2023-03-03T06:24:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842800c2d0 con 0x7f8428004850 2023-03-03T06:24:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8441b04700 1 --2- 172.21.15.5:0/891198624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8428003a00 0x7f8428003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8442305700 1 --2- 172.21.15.5:0/891198624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8428005200 0x7f842800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8441303700 1 --2- 172.21.15.5:0/891198624 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8428004850 0x7f8428004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8441b04700 1 -- 172.21.15.5:0/891198624 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8428004850 msgr2=0x7f8428004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8441b04700 1 --2- 172.21.15.5:0/891198624 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8428004850 0x7f8428004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8441b04700 1 -- 172.21.15.5:0/891198624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8428005200 msgr2=0x7f842800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8441b04700 1 --2- 172.21.15.5:0/891198624 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8428005200 0x7f842800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8442305700 1 -- 172.21.15.5:0/891198624 reap_dead start 2023-03-03T06:24:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8441b04700 1 -- 172.21.15.5:0/891198624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280035b0 con 0x7f8428003a00 2023-03-03T06:24:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.727+0000 7f8441b04700 1 --2- 172.21.15.5:0/891198624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8428003a00 0x7f8428003e10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f842c00c240 tx=0x7f8428005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f4a87f2cf51a96 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.728+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c007c10 con 0x7f8428003a00 2023-03-03T06:24:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.728+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c00cd60 con 0x7f8428003a00 2023-03-03T06:24:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.728+0000 7f8440b02700 1 -- 172.21.15.5:0/891198624 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c005ba0 con 0x7f8428003a00 2023-03-03T06:24:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.728+0000 7f8443d68700 1 -- 172.21.15.5:0/891198624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8428003a00 msgr2=0x7f8428003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.728+0000 7f8443d68700 1 --2- 172.21.15.5:0/891198624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8428003a00 0x7f8428003e10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f842c00c240 tx=0x7f8428005880 comp rx=0 tx=0).stop 2023-03-03T06:24:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.728+0000 7f8443d68700 1 -- 172.21.15.5:0/891198624 shutdown_connections 2023-03-03T06:24:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.728+0000 7f8443d68700 1 --2- 172.21.15.5:0/891198624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8428003a00 0x7f8428003e10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.728+0000 7f8443d68700 1 -- 172.21.15.5:0/891198624 >> 172.21.15.5:0/891198624 conn(0x7f843c0cf4b0 msgr2=0x7f843c0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.728+0000 7f8443d68700 1 -- 172.21.15.5:0/891198624 shutdown_connections 2023-03-03T06:24:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.728+0000 7f8443d68700 1 -- 172.21.15.5:0/891198624 wait complete. 2023-03-03T06:24:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.730+0000 7f8443d68700 1 Processor -- start 2023-03-03T06:24:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.730+0000 7f8443d68700 1 -- start start 2023-03-03T06:24:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8443d68700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8428003a00 0x7f843c151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8443d68700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f843c156b90 0x7f843c157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8443d68700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f843c0c6f90 0x7f843c0c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8443d68700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c152a30 con 0x7f843c156b90 2023-03-03T06:24:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8443d68700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c157540 con 0x7f843c0c6f90 2023-03-03T06:24:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8443d68700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c0c7c80 con 0x7f8428003a00 2023-03-03T06:24:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8441303700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f843c156b90 0x7f843c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8441303700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f843c156b90 0x7f843c157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42736/0 (socket says 172.21.15.5:42736) 2023-03-03T06:24:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8441303700 1 -- 172.21.15.5:0/775755480 learned_addr learned my addr 172.21.15.5:0/775755480 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8441303700 1 -- 172.21.15.5:0/775755480 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8428003a00 msgr2=0x7f843c151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8441303700 1 --2- 172.21.15.5:0/775755480 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8428003a00 0x7f843c151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8441303700 1 -- 172.21.15.5:0/775755480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f843c0c6f90 msgr2=0x7f843c0c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8442305700 1 --2- 172.21.15.5:0/775755480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f843c0c6f90 0x7f843c0c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8441303700 1 --2- 172.21.15.5:0/775755480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f843c0c6f90 0x7f843c0c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.731+0000 7f8441303700 1 -- 172.21.15.5:0/775755480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c15ed60 con 0x7f843c156b90 2023-03-03T06:24:30.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.732+0000 7f8441303700 1 --2- 172.21.15.5:0/775755480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f843c156b90 0x7f843c157000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f843800e490 tx=0x7f843800e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:30.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.732+0000 7f84327fc700 1 -- 172.21.15.5:0/775755480 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84380052e0 con 0x7f843c156b90 2023-03-03T06:24:30.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.732+0000 7f84327fc700 1 -- 172.21.15.5:0/775755480 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8438005440 con 0x7f843c156b90 2023-03-03T06:24:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.732+0000 7f8443d68700 1 -- 172.21.15.5:0/775755480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843c15ea80 con 0x7f843c156b90 2023-03-03T06:24:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.732+0000 7f84327fc700 1 -- 172.21.15.5:0/775755480 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84380038a0 con 0x7f843c156b90 2023-03-03T06:24:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.732+0000 7f8443d68700 1 -- 172.21.15.5:0/775755480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843c15f040 con 0x7f843c156b90 2023-03-03T06:24:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.733+0000 7f8443d68700 1 -- 172.21.15.5:0/775755480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c04e6e0 con 0x7f843c156b90 2023-03-03T06:24:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.733+0000 7f84327fc700 1 -- 172.21.15.5:0/775755480 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f843801b030 con 0x7f843c156b90 2023-03-03T06:24:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.734+0000 7f84327fc700 1 --2- 172.21.15.5:0/775755480 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f84200682f0 0x7f842006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.734+0000 7f8441b04700 1 --2- 172.21.15.5:0/775755480 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f84200682f0 0x7f842006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.734+0000 7f84327fc700 1 -- 172.21.15.5:0/775755480 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f84380854f0 con 0x7f843c156b90 2023-03-03T06:24:30.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.734+0000 7f8441b04700 1 --2- 172.21.15.5:0/775755480 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f84200682f0 0x7f842006a7a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f843c0c2ee0 tx=0x7f842c00a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:30.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.738+0000 7f84327fc700 1 -- 172.21.15.5:0/775755480 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f843804d5e0 con 0x7f843c156b90 2023-03-03T06:24:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.930+0000 7f8443d68700 1 -- 172.21.15.5:0/775755480 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f843c152b70 con 0x7f843c156b90 2023-03-03T06:24:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.930+0000 7f84327fc700 1 -- 172.21.15.5:0/775755480 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8438019020 con 0x7f843c156b90 2023-03-03T06:24:30.933 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:24:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.932+0000 7f8443d68700 1 -- 172.21.15.5:0/775755480 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f84200682f0 msgr2=0x7f842006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.932+0000 7f8443d68700 1 --2- 172.21.15.5:0/775755480 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f84200682f0 0x7f842006a7a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f843c0c2ee0 tx=0x7f842c00a000 comp rx=0 tx=0).stop 2023-03-03T06:24:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.932+0000 7f8443d68700 1 -- 172.21.15.5:0/775755480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f843c156b90 msgr2=0x7f843c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.932+0000 7f8443d68700 1 --2- 172.21.15.5:0/775755480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f843c156b90 0x7f843c157000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f843800e490 tx=0x7f843800e850 comp rx=0 tx=0).stop 2023-03-03T06:24:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.932+0000 7f8443d68700 1 -- 172.21.15.5:0/775755480 shutdown_connections 2023-03-03T06:24:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.932+0000 7f8443d68700 1 --2- 172.21.15.5:0/775755480 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f843c0c6f90 0x7f843c0c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.932+0000 7f8443d68700 1 --2- 172.21.15.5:0/775755480 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f84200682f0 0x7f842006a7a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.932+0000 7f8443d68700 1 --2- 172.21.15.5:0/775755480 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8428003a00 0x7f843c151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.932+0000 7f8443d68700 1 --2- 172.21.15.5:0/775755480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f843c156b90 0x7f843c157000 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.932+0000 7f8443d68700 1 -- 172.21.15.5:0/775755480 >> 172.21.15.5:0/775755480 conn(0x7f843c0cf4b0 msgr2=0x7f843c06b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.932+0000 7f8443d68700 1 -- 172.21.15.5:0/775755480 shutdown_connections 2023-03-03T06:24:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:30.932+0000 7f8443d68700 1 -- 172.21.15.5:0/775755480 wait complete. 2023-03-03T06:24:30.946 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:24:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.072+0000 7facd6f0f700 1 Processor -- start 2023-03-03T06:24:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.072+0000 7facd6f0f700 1 -- start start 2023-03-03T06:24:31.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7facd6f0f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7facd015a7b0 0x7facd015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7facd6f0f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7facd00cde30 0x7facd00cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7facd6f0f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd00cf5c0 con 0x7facd006b700 2023-03-03T06:24:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7facd6f0f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd00cf8a0 con 0x7facd00cde30 2023-03-03T06:24:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7facd6f0f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd00cfb80 con 0x7facd015a7b0 2023-03-03T06:24:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7faccffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7facd00cde30 0x7facd00cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7facd54ac700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7facd006b700 0x7facd006bb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60818/0 (socket says 172.21.15.5:60818) 2023-03-03T06:24:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7facd54ac700 1 -- 172.21.15.5:0/4017991347 learned_addr learned my addr 172.21.15.5:0/4017991347 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:31.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7facd4cab700 1 --2- 172.21.15.5:0/4017991347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7facd015a7b0 0x7facd015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7faccffff700 1 -- 172.21.15.5:0/4017991347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7facd015a7b0 msgr2=0x7facd015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7faccffff700 1 --2- 172.21.15.5:0/4017991347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7facd015a7b0 0x7facd015ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7faccffff700 1 -- 172.21.15.5:0/4017991347 >> v1:172.21.15.5:6789/0 conn(0x7facd006b700 legacy=0x7facd006bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7faccffff700 1 -- 172.21.15.5:0/4017991347 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd00b2d40 con 0x7facd00cde30 2023-03-03T06:24:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.073+0000 7faccf7fe700 1 -- 172.21.15.5:0/4017991347 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025780875 0 0) 0x7facd00cf5c0 con 0x7facd006b700 2023-03-03T06:24:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.074+0000 7facd4cab700 1 --2- 172.21.15.5:0/4017991347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7facd015a7b0 0x7facd015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:31.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.074+0000 7faccffff700 1 --2- 172.21.15.5:0/4017991347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00cde30 0x7facd00cec70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7facbc009840 tx=0x7facbc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c738c767a7dc8e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.074+0000 7faccf7fe700 1 -- 172.21.15.5:0/4017991347 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc011830 con 0x7facd00cde30 2023-03-03T06:24:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.074+0000 7faccf7fe700 1 -- 172.21.15.5:0/4017991347 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc011990 con 0x7facd00cde30 2023-03-03T06:24:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.074+0000 7faccf7fe700 1 -- 172.21.15.5:0/4017991347 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc011d20 con 0x7facd00cde30 2023-03-03T06:24:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.074+0000 7facd6f0f700 1 -- 172.21.15.5:0/4017991347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00cde30 msgr2=0x7facd00cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.074+0000 7facd6f0f700 1 --2- 172.21.15.5:0/4017991347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00cde30 0x7facd00cec70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7facbc009840 tx=0x7facbc009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.074+0000 7facd6f0f700 1 -- 172.21.15.5:0/4017991347 shutdown_connections 2023-03-03T06:24:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.074+0000 7facd6f0f700 1 --2- 172.21.15.5:0/4017991347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7facd015a7b0 0x7facd015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.074+0000 7facd6f0f700 1 --2- 172.21.15.5:0/4017991347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd00cde30 0x7facd00cec70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.074+0000 7facd6f0f700 1 -- 172.21.15.5:0/4017991347 >> 172.21.15.5:0/4017991347 conn(0x7facd00cc8d0 msgr2=0x7facd00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:31.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.074+0000 7facd6f0f700 1 -- 172.21.15.5:0/4017991347 shutdown_connections 2023-03-03T06:24:31.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.074+0000 7facd6f0f700 1 -- 172.21.15.5:0/4017991347 wait complete. 2023-03-03T06:24:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.076+0000 7facd6f0f700 1 Processor -- start 2023-03-03T06:24:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.076+0000 7facd6f0f700 1 -- start start 2023-03-03T06:24:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.077+0000 7facd6f0f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7facd006b700 0x7facd0146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.077+0000 7facd6f0f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7facd00cde30 0x7facd00af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.077+0000 7facd6f0f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd015a7b0 0x7facd00b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.077+0000 7facd6f0f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd01e4240 con 0x7facd015a7b0 2023-03-03T06:24:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.077+0000 7facd6f0f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd00b1fc0 con 0x7facd00cde30 2023-03-03T06:24:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.077+0000 7facd6f0f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd00b22a0 con 0x7facd006b700 2023-03-03T06:24:31.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.077+0000 7facd54ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd015a7b0 0x7facd00b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.077+0000 7facd54ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd015a7b0 0x7facd00b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42750/0 (socket says 172.21.15.5:42750) 2023-03-03T06:24:31.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.077+0000 7facd54ac700 1 -- 172.21.15.5:0/2228128743 learned_addr learned my addr 172.21.15.5:0/2228128743 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:31.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.077+0000 7facd4cab700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7facd006b700 0x7facd0146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.077+0000 7faccffff700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7facd00cde30 0x7facd00af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.078+0000 7facd54ac700 1 -- 172.21.15.5:0/2228128743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7facd006b700 msgr2=0x7facd0146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.078+0000 7facd54ac700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7facd006b700 0x7facd0146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.078+0000 7facd54ac700 1 -- 172.21.15.5:0/2228128743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7facd00cde30 msgr2=0x7facd00af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.078+0000 7facd54ac700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7facd00cde30 0x7facd00af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.078+0000 7facd54ac700 1 -- 172.21.15.5:0/2228128743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0094a0 con 0x7facd015a7b0 2023-03-03T06:24:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.078+0000 7faccffff700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7facd00cde30 0x7facd00af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.078+0000 7facd54ac700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd015a7b0 0x7facd00b12f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7facc8002230 tx=0x7facc800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.078+0000 7faccd7fa700 1 -- 172.21.15.5:0/2228128743 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc800ab70 con 0x7facd015a7b0 2023-03-03T06:24:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.078+0000 7faccd7fa700 1 -- 172.21.15.5:0/2228128743 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc800acf0 con 0x7facd015a7b0 2023-03-03T06:24:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.078+0000 7facd6f0f700 1 -- 172.21.15.5:0/2228128743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd00cf1b0 con 0x7facd015a7b0 2023-03-03T06:24:31.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.078+0000 7faccd7fa700 1 -- 172.21.15.5:0/2228128743 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8007310 con 0x7facd015a7b0 2023-03-03T06:24:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.078+0000 7facd6f0f700 1 -- 172.21.15.5:0/2228128743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd00b3020 con 0x7facd015a7b0 2023-03-03T06:24:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.079+0000 7facd6f0f700 1 -- 172.21.15.5:0/2228128743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd00cf340 con 0x7facd015a7b0 2023-03-03T06:24:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.079+0000 7faccd7fa700 1 -- 172.21.15.5:0/2228128743 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7facc8010070 con 0x7facd015a7b0 2023-03-03T06:24:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.080+0000 7faccd7fa700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7facb40682f0 0x7facb406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.080+0000 7faccd7fa700 1 -- 172.21.15.5:0/2228128743 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7facc8085970 con 0x7facd015a7b0 2023-03-03T06:24:31.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.080+0000 7facd4cab700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7facb40682f0 0x7facb406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.080+0000 7facd4cab700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7facb40682f0 0x7facb406a7a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7facc400c940 tx=0x7facc4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:31.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.084+0000 7faccd7fa700 1 -- 172.21.15.5:0/2228128743 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7facc8051ea0 con 0x7facd015a7b0 2023-03-03T06:24:31.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.277+0000 7facd6f0f700 1 -- 172.21.15.5:0/2228128743 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7facd01e4380 con 0x7facd015a7b0 2023-03-03T06:24:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.277+0000 7faccd7fa700 1 -- 172.21.15.5:0/2228128743 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7facd01e4380 con 0x7facd015a7b0 2023-03-03T06:24:31.281 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.279+0000 7facd6f0f700 1 -- 172.21.15.5:0/2228128743 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7facb40682f0 msgr2=0x7facb406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.279+0000 7facd6f0f700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7facb40682f0 0x7facb406a7a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7facc400c940 tx=0x7facc4008040 comp rx=0 tx=0).stop 2023-03-03T06:24:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.279+0000 7facd6f0f700 1 -- 172.21.15.5:0/2228128743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd015a7b0 msgr2=0x7facd00b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.279+0000 7facd6f0f700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd015a7b0 0x7facd00b12f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7facc8002230 tx=0x7facc800cf50 comp rx=0 tx=0).stop 2023-03-03T06:24:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.279+0000 7facd6f0f700 1 -- 172.21.15.5:0/2228128743 shutdown_connections 2023-03-03T06:24:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.279+0000 7facd6f0f700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facd015a7b0 0x7facd00b12f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.279+0000 7facd6f0f700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7facb40682f0 0x7facb406a7a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.279+0000 7facd6f0f700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7facd006b700 0x7facd0146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.279+0000 7facd6f0f700 1 --2- 172.21.15.5:0/2228128743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7facd00cde30 0x7facd00af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.279+0000 7facd6f0f700 1 -- 172.21.15.5:0/2228128743 >> 172.21.15.5:0/2228128743 conn(0x7facd00cc8d0 msgr2=0x7facd006bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.279+0000 7facd6f0f700 1 -- 172.21.15.5:0/2228128743 shutdown_connections 2023-03-03T06:24:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.279+0000 7facd6f0f700 1 -- 172.21.15.5:0/2228128743 wait complete. 2023-03-03T06:24:31.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:24:31.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.420+0000 7ff4fe941700 1 Processor -- start 2023-03-03T06:24:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.420+0000 7ff4fe941700 1 -- start start 2023-03-03T06:24:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.420+0000 7ff4fe941700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f80cd450 0x7ff4f80b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.420+0000 7ff4fe941700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4f80b18d0 0x7ff4f80b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.420+0000 7ff4fe941700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f80cdef0 con 0x7ff4f815a850 2023-03-03T06:24:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.420+0000 7ff4fe941700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f806c320 con 0x7ff4f80b18d0 2023-03-03T06:24:31.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4fe941700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80b2290 con 0x7ff4f80cd450 2023-03-03T06:24:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4fcede700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff4f80b18d0 0x7ff4f80b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4f7fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff4f815a850 0x7ff4f80b5620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60828/0 (socket says 172.21.15.5:60828) 2023-03-03T06:24:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4f7fff700 1 -- 172.21.15.5:0/266101037 learned_addr learned my addr 172.21.15.5:0/266101037 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4f77fe700 1 --2- 172.21.15.5:0/266101037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f80cd450 0x7ff4f80b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4fcede700 1 -- 172.21.15.5:0/266101037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f80cd450 msgr2=0x7ff4f80b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4f6ffd700 1 -- 172.21.15.5:0/266101037 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132406575 0 0) 0x7ff4f80cdef0 con 0x7ff4f815a850 2023-03-03T06:24:31.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4fcede700 1 --2- 172.21.15.5:0/266101037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f80cd450 0x7ff4f80b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4fcede700 1 -- 172.21.15.5:0/266101037 >> v1:172.21.15.5:6789/0 conn(0x7ff4f815a850 legacy=0x7ff4f80b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4fcede700 1 -- 172.21.15.5:0/266101037 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f80ce1d0 con 0x7ff4f80b18d0 2023-03-03T06:24:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4fcede700 1 --2- 172.21.15.5:0/266101037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f80b18d0 0x7ff4f80b1d50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009d90 tx=0x7ff4f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcce641c30e65499 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4f6ffd700 1 -- 172.21.15.5:0/266101037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000e070 con 0x7ff4f80b18d0 2023-03-03T06:24:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4f6ffd700 1 -- 172.21.15.5:0/266101037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f000bbd0 con 0x7ff4f80b18d0 2023-03-03T06:24:31.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.421+0000 7ff4f6ffd700 1 -- 172.21.15.5:0/266101037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0012430 con 0x7ff4f80b18d0 2023-03-03T06:24:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.422+0000 7ff4fe941700 1 -- 172.21.15.5:0/266101037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f80b18d0 msgr2=0x7ff4f80b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.422+0000 7ff4fe941700 1 --2- 172.21.15.5:0/266101037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f80b18d0 0x7ff4f80b1d50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0009d90 tx=0x7ff4f000b330 comp rx=0 tx=0).stop 2023-03-03T06:24:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.422+0000 7ff4fe941700 1 -- 172.21.15.5:0/266101037 shutdown_connections 2023-03-03T06:24:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.422+0000 7ff4fe941700 1 --2- 172.21.15.5:0/266101037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f80b18d0 0x7ff4f80b1d50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.422+0000 7ff4fe941700 1 --2- 172.21.15.5:0/266101037 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f80cd450 0x7ff4f80b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.422+0000 7ff4fe941700 1 -- 172.21.15.5:0/266101037 >> 172.21.15.5:0/266101037 conn(0x7ff4f80cc8d0 msgr2=0x7ff4f80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.422+0000 7ff4fe941700 1 -- 172.21.15.5:0/266101037 shutdown_connections 2023-03-03T06:24:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.422+0000 7ff4fe941700 1 -- 172.21.15.5:0/266101037 wait complete. 2023-03-03T06:24:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.423+0000 7ff4fe941700 1 Processor -- start 2023-03-03T06:24:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.423+0000 7ff4fe941700 1 -- start start 2023-03-03T06:24:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4fe941700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f80b18d0 0x7ff4f8153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4fe941700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f80cd450 0x7ff4f81471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4fe941700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f815a850 0x7ff4f80c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4fe941700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81e3e10 con 0x7ff4f80b18d0 2023-03-03T06:24:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4fe941700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f8147710 con 0x7ff4f80cd450 2023-03-03T06:24:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4fe941700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81e3200 con 0x7ff4f815a850 2023-03-03T06:24:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4f7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f80b18d0 0x7ff4f8153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4f7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f80b18d0 0x7ff4f8153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42758/0 (socket says 172.21.15.5:42758) 2023-03-03T06:24:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4f7fff700 1 -- 172.21.15.5:0/3913222432 learned_addr learned my addr 172.21.15.5:0/3913222432 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:31.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4fcede700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f815a850 0x7ff4f80c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4f77fe700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f80cd450 0x7ff4f81471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4f7fff700 1 -- 172.21.15.5:0/3913222432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f815a850 msgr2=0x7ff4f80c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4f7fff700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f815a850 0x7ff4f80c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4f7fff700 1 -- 172.21.15.5:0/3913222432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f80cd450 msgr2=0x7ff4f81471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.424+0000 7ff4f7fff700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f80cd450 0x7ff4f81471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.425+0000 7ff4f7fff700 1 -- 172.21.15.5:0/3913222432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0009a70 con 0x7ff4f80b18d0 2023-03-03T06:24:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.425+0000 7ff4f77fe700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f80cd450 0x7ff4f81471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:31.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.425+0000 7ff4f7fff700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f80b18d0 0x7ff4f8153910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c580 tx=0x7ff4e800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:31.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.425+0000 7ff4f4ff9700 1 -- 172.21.15.5:0/3913222432 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8004c80 con 0x7ff4f80b18d0 2023-03-03T06:24:31.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.425+0000 7ff4f4ff9700 1 -- 172.21.15.5:0/3913222432 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8004e00 con 0x7ff4f80b18d0 2023-03-03T06:24:31.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.425+0000 7ff4f4ff9700 1 -- 172.21.15.5:0/3913222432 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8007310 con 0x7ff4f80b18d0 2023-03-03T06:24:31.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.425+0000 7ff4fe941700 1 -- 172.21.15.5:0/3913222432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f80ce790 con 0x7ff4f80b18d0 2023-03-03T06:24:31.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.425+0000 7ff4fe941700 1 -- 172.21.15.5:0/3913222432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f80ce4b0 con 0x7ff4f80b18d0 2023-03-03T06:24:31.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.426+0000 7ff4fe941700 1 -- 172.21.15.5:0/3913222432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f80cea70 con 0x7ff4f80b18d0 2023-03-03T06:24:31.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.426+0000 7ff4f4ff9700 1 -- 172.21.15.5:0/3913222432 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff4e801a020 con 0x7ff4f80b18d0 2023-03-03T06:24:31.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.427+0000 7ff4f4ff9700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff4e40682f0 0x7ff4e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.427+0000 7ff4f4ff9700 1 -- 172.21.15.5:0/3913222432 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff4e8085ce0 con 0x7ff4f80b18d0 2023-03-03T06:24:31.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.427+0000 7ff4f77fe700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff4e40682f0 0x7ff4e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.427+0000 7ff4f77fe700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff4e40682f0 0x7ff4e406a7a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff4f815e1e0 tx=0x7ff4ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:31.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.431+0000 7ff4f4ff9700 1 -- 172.21.15.5:0/3913222432 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff4e8052140 con 0x7ff4f80b18d0 2023-03-03T06:24:31.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.621+0000 7ff4fe941700 1 -- 172.21.15.5:0/3913222432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4f804e6e0 con 0x7ff4f80b18d0 2023-03-03T06:24:31.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.621+0000 7ff4f4ff9700 1 -- 172.21.15.5:0/3913222432 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4e8055760 con 0x7ff4f80b18d0 2023-03-03T06:24:31.624 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:24:31.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.623+0000 7ff4fe941700 1 -- 172.21.15.5:0/3913222432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff4e40682f0 msgr2=0x7ff4e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.623+0000 7ff4fe941700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff4e40682f0 0x7ff4e406a7a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff4f815e1e0 tx=0x7ff4ec008040 comp rx=0 tx=0).stop 2023-03-03T06:24:31.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.623+0000 7ff4fe941700 1 -- 172.21.15.5:0/3913222432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f80b18d0 msgr2=0x7ff4f8153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.623+0000 7ff4fe941700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f80b18d0 0x7ff4f8153910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c580 tx=0x7ff4e800c890 comp rx=0 tx=0).stop 2023-03-03T06:24:31.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.623+0000 7ff4fe941700 1 -- 172.21.15.5:0/3913222432 shutdown_connections 2023-03-03T06:24:31.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.623+0000 7ff4fe941700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff4e40682f0 0x7ff4e406a7a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.623+0000 7ff4fe941700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4f815a850 0x7ff4f80c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.623+0000 7ff4fe941700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4f80b18d0 0x7ff4f8153910 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.623+0000 7ff4fe941700 1 --2- 172.21.15.5:0/3913222432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4f80cd450 0x7ff4f81471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.623+0000 7ff4fe941700 1 -- 172.21.15.5:0/3913222432 >> 172.21.15.5:0/3913222432 conn(0x7ff4f80cc8d0 msgr2=0x7ff4f80b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.623+0000 7ff4fe941700 1 -- 172.21.15.5:0/3913222432 shutdown_connections 2023-03-03T06:24:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.623+0000 7ff4fe941700 1 -- 172.21.15.5:0/3913222432 wait complete. 2023-03-03T06:24:31.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-03T06:24:31.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.763+0000 7f702c43b700 1 Processor -- start 2023-03-03T06:24:31.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.763+0000 7f702c43b700 1 -- start start 2023-03-03T06:24:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.764+0000 7f702c43b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70240b55b0 0x7f702415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.764+0000 7f702c43b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70240cc5d0 con 0x7f70240cd500 2023-03-03T06:24:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.764+0000 7f702c43b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7024159c30 con 0x7f70240b1fe0 2023-03-03T06:24:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.764+0000 7f702c43b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702415e290 con 0x7f70240b55b0 2023-03-03T06:24:31.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.764+0000 7f702a1d7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70240b55b0 0x7f702415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.764+0000 7f70299d6700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f70240cd500 0x7f70240b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60842/0 (socket says 172.21.15.5:60842) 2023-03-03T06:24:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.764+0000 7f702a1d7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70240b55b0 0x7f702415dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42766/0 (socket says 172.21.15.5:42766) 2023-03-03T06:24:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.764+0000 7f70299d6700 1 -- 172.21.15.5:0/4231228229 learned_addr learned my addr 172.21.15.5:0/4231228229 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.764+0000 7f702a1d7700 1 -- 172.21.15.5:0/4231228229 >> v1:172.21.15.191:6789/0 conn(0x7f70240b1fe0 legacy=0x7f70240cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.764+0000 7f702a1d7700 1 -- 172.21.15.5:0/4231228229 >> v1:172.21.15.5:6789/0 conn(0x7f70240cd500 legacy=0x7f70240b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.765+0000 7f702a1d7700 1 -- 172.21.15.5:0/4231228229 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70240b5980 con 0x7f70240b55b0 2023-03-03T06:24:31.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.764+0000 7f70291d5700 1 -- 172.21.15.5:0/4231228229 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046824492 0 0) 0x7f70240cc5d0 con 0x7f70240cd500 2023-03-03T06:24:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.765+0000 7f702a1d7700 1 --2- 172.21.15.5:0/4231228229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70240b55b0 0x7f702415dd50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7014009840 tx=0x7f7014009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a76c208cbcad7e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.765+0000 7f70291d5700 1 -- 172.21.15.5:0/4231228229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7014004230 con 0x7f70240b55b0 2023-03-03T06:24:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.765+0000 7f70291d5700 1 -- 172.21.15.5:0/4231228229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7014004390 con 0x7f70240b55b0 2023-03-03T06:24:31.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.765+0000 7f70291d5700 1 -- 172.21.15.5:0/4231228229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70140036a0 con 0x7f70240b55b0 2023-03-03T06:24:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.765+0000 7f702c43b700 1 -- 172.21.15.5:0/4231228229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70240b55b0 msgr2=0x7f702415dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.765+0000 7f702c43b700 1 --2- 172.21.15.5:0/4231228229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70240b55b0 0x7f702415dd50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7014009840 tx=0x7f7014009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.765+0000 7f702c43b700 1 -- 172.21.15.5:0/4231228229 shutdown_connections 2023-03-03T06:24:31.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.765+0000 7f702c43b700 1 --2- 172.21.15.5:0/4231228229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70240b55b0 0x7f702415dd50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.765+0000 7f702c43b700 1 -- 172.21.15.5:0/4231228229 >> 172.21.15.5:0/4231228229 conn(0x7f70240cc8d0 msgr2=0x7f70240cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.766+0000 7f702c43b700 1 -- 172.21.15.5:0/4231228229 shutdown_connections 2023-03-03T06:24:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.766+0000 7f702c43b700 1 -- 172.21.15.5:0/4231228229 wait complete. 2023-03-03T06:24:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.767+0000 7f702c43b700 1 Processor -- start 2023-03-03T06:24:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.767+0000 7f702c43b700 1 -- start start 2023-03-03T06:24:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.767+0000 7f702c43b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70240b1fe0 0x7f70240b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.767+0000 7f702c43b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70240b55b0 0x7f7024156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.767+0000 7f702c43b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70240cd500 0x7f702415b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.767+0000 7f702c43b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702415abe0 con 0x7f70240b1fe0 2023-03-03T06:24:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.767+0000 7f702c43b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70240c82b0 con 0x7f70240cd500 2023-03-03T06:24:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.767+0000 7f702c43b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702415a870 con 0x7f70240b55b0 2023-03-03T06:24:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f702a1d7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70240b1fe0 0x7f70240b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f702a1d7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70240b1fe0 0x7f70240b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42772/0 (socket says 172.21.15.5:42772) 2023-03-03T06:24:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f702a1d7700 1 -- 172.21.15.5:0/2072380952 learned_addr learned my addr 172.21.15.5:0/2072380952 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:31.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f702a1d7700 1 -- 172.21.15.5:0/2072380952 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70240b55b0 msgr2=0x7f7024156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f702a1d7700 1 --2- 172.21.15.5:0/2072380952 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70240b55b0 0x7f7024156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f702a1d7700 1 -- 172.21.15.5:0/2072380952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70240cd500 msgr2=0x7f702415b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f702a9d8700 1 --2- 172.21.15.5:0/2072380952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70240cd500 0x7f702415b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f702a1d7700 1 --2- 172.21.15.5:0/2072380952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70240cd500 0x7f702415b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f702a1d7700 1 -- 172.21.15.5:0/2072380952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140094a0 con 0x7f70240b1fe0 2023-03-03T06:24:31.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f702a1d7700 1 --2- 172.21.15.5:0/2072380952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70240b1fe0 0x7f70240b1830 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7024070e60 tx=0x7f7014004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:31.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f701affd700 1 -- 172.21.15.5:0/2072380952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7014011630 con 0x7f70240b1fe0 2023-03-03T06:24:31.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f701affd700 1 -- 172.21.15.5:0/2072380952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701401e070 con 0x7f70240b1fe0 2023-03-03T06:24:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f702c43b700 1 -- 172.21.15.5:0/2072380952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70240cbca0 con 0x7f70240b1fe0 2023-03-03T06:24:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f701affd700 1 -- 172.21.15.5:0/2072380952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70140119f0 con 0x7f70240b1fe0 2023-03-03T06:24:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.768+0000 7f702c43b700 1 -- 172.21.15.5:0/2072380952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70240cb9c0 con 0x7f70240b1fe0 2023-03-03T06:24:31.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.769+0000 7f702c43b700 1 -- 172.21.15.5:0/2072380952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70240cbf80 con 0x7f70240b1fe0 2023-03-03T06:24:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.770+0000 7f701affd700 1 -- 172.21.15.5:0/2072380952 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7014017020 con 0x7f70240b1fe0 2023-03-03T06:24:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.770+0000 7f701affd700 1 --2- 172.21.15.5:0/2072380952 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70080682f0 0x7f700806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.770+0000 7f70299d6700 1 --2- 172.21.15.5:0/2072380952 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70080682f0 0x7f700806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.770+0000 7f701affd700 1 -- 172.21.15.5:0/2072380952 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7014087370 con 0x7f70240b1fe0 2023-03-03T06:24:31.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.771+0000 7f70299d6700 1 --2- 172.21.15.5:0/2072380952 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70080682f0 0x7f700806a7a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7020000c00 tx=0x7f7020007a50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:31.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.775+0000 7f701affd700 1 -- 172.21.15.5:0/2072380952 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f70140538a0 con 0x7f70240b1fe0 2023-03-03T06:24:31.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.967+0000 7f702c43b700 1 -- 172.21.15.5:0/2072380952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f702404e6e0 con 0x7f70240b1fe0 2023-03-03T06:24:31.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.968+0000 7f701affd700 1 -- 172.21.15.5:0/2072380952 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f70140200a0 con 0x7f70240b1fe0 2023-03-03T06:24:31.970 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.970+0000 7f702c43b700 1 -- 172.21.15.5:0/2072380952 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70080682f0 msgr2=0x7f700806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.970+0000 7f702c43b700 1 --2- 172.21.15.5:0/2072380952 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70080682f0 0x7f700806a7a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7020000c00 tx=0x7f7020007a50 comp rx=0 tx=0).stop 2023-03-03T06:24:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.970+0000 7f702c43b700 1 -- 172.21.15.5:0/2072380952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70240b1fe0 msgr2=0x7f70240b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.970+0000 7f702c43b700 1 --2- 172.21.15.5:0/2072380952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70240b1fe0 0x7f70240b1830 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7024070e60 tx=0x7f7014004750 comp rx=0 tx=0).stop 2023-03-03T06:24:31.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.970+0000 7f702c43b700 1 -- 172.21.15.5:0/2072380952 shutdown_connections 2023-03-03T06:24:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.970+0000 7f702c43b700 1 --2- 172.21.15.5:0/2072380952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70240cd500 0x7f702415b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.970+0000 7f702c43b700 1 --2- 172.21.15.5:0/2072380952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70240b1fe0 0x7f70240b1830 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.970+0000 7f702c43b700 1 --2- 172.21.15.5:0/2072380952 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70080682f0 0x7f700806a7a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.970+0000 7f702c43b700 1 --2- 172.21.15.5:0/2072380952 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70240b55b0 0x7f7024156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.970+0000 7f702c43b700 1 -- 172.21.15.5:0/2072380952 >> 172.21.15.5:0/2072380952 conn(0x7f70240cc8d0 msgr2=0x7f70240cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.970+0000 7f702c43b700 1 -- 172.21.15.5:0/2072380952 shutdown_connections 2023-03-03T06:24:31.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:31.970+0000 7f702c43b700 1 -- 172.21.15.5:0/2072380952 wait complete. 2023-03-03T06:24:31.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-03T06:24:32.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.108+0000 7fda59fbe700 1 Processor -- start 2023-03-03T06:24:32.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.108+0000 7fda59fbe700 1 -- start start 2023-03-03T06:24:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda59fbe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda5415a7d0 0x7fda540c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda59fbe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda540cb690 0x7fda5415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda59fbe700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5415e580 con 0x7fda5415ef50 2023-03-03T06:24:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda59fbe700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda540ca710 con 0x7fda540cb690 2023-03-03T06:24:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda59fbe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda540ca9f0 con 0x7fda5415a7d0 2023-03-03T06:24:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda52ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda540cb690 0x7fda5415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda52ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda540cb690 0x7fda5415ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42782/0 (socket says 172.21.15.5:42782) 2023-03-03T06:24:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda52ffd700 1 -- 172.21.15.5:0/904553356 learned_addr learned my addr 172.21.15.5:0/904553356 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:32.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda537fe700 1 --2- 172.21.15.5:0/904553356 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda5415a7d0 0x7fda540c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:32.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda52ffd700 1 -- 172.21.15.5:0/904553356 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda5415a7d0 msgr2=0x7fda540c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:32.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda52ffd700 1 --2- 172.21.15.5:0/904553356 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda5415a7d0 0x7fda540c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda52ffd700 1 -- 172.21.15.5:0/904553356 >> v1:172.21.15.191:6789/0 conn(0x7fda5415ef50 legacy=0x7fda5406a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:32.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda52ffd700 1 -- 172.21.15.5:0/904553356 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda540cacd0 con 0x7fda540cb690 2023-03-03T06:24:32.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda52ffd700 1 --2- 172.21.15.5:0/904553356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda540cb690 0x7fda5415ea10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fda480098f0 tx=0x7fda48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0434d702418187d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:32.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.109+0000 7fda527fc700 1 -- 172.21.15.5:0/904553356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4800b8a0 con 0x7fda540cb690 2023-03-03T06:24:32.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.110+0000 7fda527fc700 1 -- 172.21.15.5:0/904553356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4800ba00 con 0x7fda540cb690 2023-03-03T06:24:32.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.110+0000 7fda527fc700 1 -- 172.21.15.5:0/904553356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4800bd90 con 0x7fda540cb690 2023-03-03T06:24:32.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.110+0000 7fda59fbe700 1 -- 172.21.15.5:0/904553356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda540cb690 msgr2=0x7fda5415ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:32.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.110+0000 7fda59fbe700 1 --2- 172.21.15.5:0/904553356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda540cb690 0x7fda5415ea10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fda480098f0 tx=0x7fda48009c00 comp rx=0 tx=0).stop 2023-03-03T06:24:32.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.110+0000 7fda59fbe700 1 -- 172.21.15.5:0/904553356 shutdown_connections 2023-03-03T06:24:32.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.110+0000 7fda59fbe700 1 --2- 172.21.15.5:0/904553356 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda5415a7d0 0x7fda540c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.110+0000 7fda59fbe700 1 --2- 172.21.15.5:0/904553356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda540cb690 0x7fda5415ea10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.110+0000 7fda59fbe700 1 -- 172.21.15.5:0/904553356 >> 172.21.15.5:0/904553356 conn(0x7fda540cf4b0 msgr2=0x7fda540cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.110+0000 7fda59fbe700 1 -- 172.21.15.5:0/904553356 shutdown_connections 2023-03-03T06:24:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.110+0000 7fda59fbe700 1 -- 172.21.15.5:0/904553356 wait complete. 2023-03-03T06:24:32.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.111+0000 7fda59fbe700 1 Processor -- start 2023-03-03T06:24:32.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.111+0000 7fda59fbe700 1 -- start start 2023-03-03T06:24:32.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.112+0000 7fda59fbe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda540cb690 0x7fda54150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:32.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.112+0000 7fda59fbe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda5415a7d0 0x7fda540c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:32.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.112+0000 7fda59fbe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda5415ef50 0x7fda540b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:32.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.112+0000 7fda59fbe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda540b51a0 con 0x7fda540cb690 2023-03-03T06:24:32.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.112+0000 7fda59fbe700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda540c7ff0 con 0x7fda5415ef50 2023-03-03T06:24:32.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.112+0000 7fda59fbe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda540b4f50 con 0x7fda5415a7d0 2023-03-03T06:24:32.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.112+0000 7fda537fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda540cb690 0x7fda54150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:32.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.112+0000 7fda537fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda540cb690 0x7fda54150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42786/0 (socket says 172.21.15.5:42786) 2023-03-03T06:24:32.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.112+0000 7fda537fe700 1 -- 172.21.15.5:0/1056063636 learned_addr learned my addr 172.21.15.5:0/1056063636 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:32.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.112+0000 7fda53fff700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda5415ef50 0x7fda540b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:32.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.112+0000 7fda52ffd700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda5415a7d0 0x7fda540c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:32.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.113+0000 7fda537fe700 1 -- 172.21.15.5:0/1056063636 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda5415a7d0 msgr2=0x7fda540c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:32.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.113+0000 7fda537fe700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda5415a7d0 0x7fda540c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.113+0000 7fda537fe700 1 -- 172.21.15.5:0/1056063636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda5415ef50 msgr2=0x7fda540b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:32.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.113+0000 7fda537fe700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda5415ef50 0x7fda540b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.113+0000 7fda537fe700 1 -- 172.21.15.5:0/1056063636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48009550 con 0x7fda540cb690 2023-03-03T06:24:32.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.113+0000 7fda52ffd700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda5415a7d0 0x7fda540c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:32.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.113+0000 7fda537fe700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda540cb690 0x7fda54150fb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fda4400e840 tx=0x7fda4400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:32.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.113+0000 7fda3bfff700 1 -- 172.21.15.5:0/1056063636 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda44013610 con 0x7fda540cb690 2023-03-03T06:24:32.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.113+0000 7fda3bfff700 1 -- 172.21.15.5:0/1056063636 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda44013770 con 0x7fda540cb690 2023-03-03T06:24:32.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.113+0000 7fda59fbe700 1 -- 172.21.15.5:0/1056063636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda540ca400 con 0x7fda540cb690 2023-03-03T06:24:32.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.113+0000 7fda3bfff700 1 -- 172.21.15.5:0/1056063636 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda44013b20 con 0x7fda540cb690 2023-03-03T06:24:32.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.113+0000 7fda59fbe700 1 -- 172.21.15.5:0/1056063636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5415e210 con 0x7fda540cb690 2023-03-03T06:24:32.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.114+0000 7fda59fbe700 1 -- 172.21.15.5:0/1056063636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5406aa40 con 0x7fda540cb690 2023-03-03T06:24:32.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.114+0000 7fda3bfff700 1 -- 172.21.15.5:0/1056063636 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fda44023070 con 0x7fda540cb690 2023-03-03T06:24:32.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.115+0000 7fda3bfff700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda400682f0 0x7fda4006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:32.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.115+0000 7fda3bfff700 1 -- 172.21.15.5:0/1056063636 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fda44085bd0 con 0x7fda540cb690 2023-03-03T06:24:32.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.115+0000 7fda52ffd700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda400682f0 0x7fda4006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:32.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.115+0000 7fda52ffd700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda400682f0 0x7fda4006a7a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fda48009c40 tx=0x7fda48008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:32.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.119+0000 7fda3bfff700 1 -- 172.21.15.5:0/1056063636 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fda44052100 con 0x7fda540cb690 2023-03-03T06:24:32.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.327+0000 7fda59fbe700 1 -- 172.21.15.5:0/1056063636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fda5404e6e0 con 0x7fda540cb690 2023-03-03T06:24:32.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.327+0000 7fda3bfff700 1 -- 172.21.15.5:0/1056063636 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fda44055720 con 0x7fda540cb690 2023-03-03T06:24:32.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.329+0000 7fda59fbe700 1 -- 172.21.15.5:0/1056063636 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda400682f0 msgr2=0x7fda4006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:32.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.329+0000 7fda59fbe700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda400682f0 0x7fda4006a7a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fda48009c40 tx=0x7fda48008030 comp rx=0 tx=0).stop 2023-03-03T06:24:32.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.329+0000 7fda59fbe700 1 -- 172.21.15.5:0/1056063636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda540cb690 msgr2=0x7fda54150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:32.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.329+0000 7fda59fbe700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda540cb690 0x7fda54150fb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fda4400e840 tx=0x7fda4400eb50 comp rx=0 tx=0).stop 2023-03-03T06:24:32.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.329+0000 7fda59fbe700 1 -- 172.21.15.5:0/1056063636 shutdown_connections 2023-03-03T06:24:32.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.329+0000 7fda59fbe700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda5415ef50 0x7fda540b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.329+0000 7fda59fbe700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda540cb690 0x7fda54150fb0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.329+0000 7fda59fbe700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda400682f0 0x7fda4006a7a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.329+0000 7fda59fbe700 1 --2- 172.21.15.5:0/1056063636 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda5415a7d0 0x7fda540c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.329+0000 7fda59fbe700 1 -- 172.21.15.5:0/1056063636 >> 172.21.15.5:0/1056063636 conn(0x7fda540cf4b0 msgr2=0x7fda5406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:32.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.330+0000 7fda59fbe700 1 -- 172.21.15.5:0/1056063636 shutdown_connections 2023-03-03T06:24:32.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.330+0000 7fda59fbe700 1 -- 172.21.15.5:0/1056063636 wait complete. 2023-03-03T06:24:32.335 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-03-03T06:24:32.343 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-03-03T06:24:32.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:32.344 DEBUG:teuthology.orchestra.run.smithi191:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-03-03T06:24:32.396 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-03-03T06:24:32.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:32.397 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-03-03T06:24:32.428 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:24:32.429 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:32.447 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:24:32.447 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:32.504 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:24:32.505 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:32.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.725+0000 7feed10fa700 1 Processor -- start 2023-03-03T06:24:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.725+0000 7feed10fa700 1 -- start start 2023-03-03T06:24:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feed10fa700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feecc15cd40 0x7feecc0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:32.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feed10fa700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7feecc0cba50 0x7feecc0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feed10fa700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feecc0cd3e0 0x7feecc160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feed10fa700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feecc15d4e0 con 0x7feecc15cd40 2023-03-03T06:24:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feed10fa700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feecc15d7c0 con 0x7feecc0cba50 2023-03-03T06:24:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feed10fa700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc15daa0 con 0x7feecc0cd3e0 2023-03-03T06:24:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feecad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feecc15cd40 0x7feecc0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feecad9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feecc15cd40 0x7feecc0b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42794/0 (socket says 172.21.15.5:42794) 2023-03-03T06:24:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feecad9d700 1 -- 172.21.15.5:0/1444619234 learned_addr learned my addr 172.21.15.5:0/1444619234 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feecb59e700 1 --2- 172.21.15.5:0/1444619234 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feecc0cd3e0 0x7feecc160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feeca59c700 1 --2- 172.21.15.5:0/1444619234 >> v2:172.21.15.191:3300/0 conn(0x7feecc0cba50 0x7feecc0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feecad9d700 1 -- 172.21.15.5:0/1444619234 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feecc0cd3e0 msgr2=0x7feecc160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feecad9d700 1 --2- 172.21.15.5:0/1444619234 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feecc0cd3e0 0x7feecc160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feecad9d700 1 -- 172.21.15.5:0/1444619234 >> v2:172.21.15.191:3300/0 conn(0x7feecc0cba50 msgr2=0x7feecc0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feecad9d700 1 --2- 172.21.15.5:0/1444619234 >> v2:172.21.15.191:3300/0 conn(0x7feecc0cba50 0x7feecc0b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feecad9d700 1 -- 172.21.15.5:0/1444619234 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc15dd80 con 0x7feecc15cd40 2023-03-03T06:24:32.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feecb59e700 1 --2- 172.21.15.5:0/1444619234 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feecc0cd3e0 0x7feecc160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feeca59c700 1 --2- 172.21.15.5:0/1444619234 >> v2:172.21.15.191:3300/0 conn(0x7feecc0cba50 0x7feecc0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feecad9d700 1 --2- 172.21.15.5:0/1444619234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feecc15cd40 0x7feecc0b18d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feecc0c6ed0 tx=0x7feebc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3255f8bc0b22d146 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feec9d9b700 1 -- 172.21.15.5:0/1444619234 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc00b870 con 0x7feecc15cd40 2023-03-03T06:24:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feec9d9b700 1 -- 172.21.15.5:0/1444619234 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc00b9d0 con 0x7feecc15cd40 2023-03-03T06:24:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.726+0000 7feec9d9b700 1 -- 172.21.15.5:0/1444619234 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc00bd60 con 0x7feecc15cd40 2023-03-03T06:24:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.727+0000 7feed10fa700 1 -- 172.21.15.5:0/1444619234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feecc15cd40 msgr2=0x7feecc0b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:32.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.727+0000 7feed10fa700 1 --2- 172.21.15.5:0/1444619234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feecc15cd40 0x7feecc0b18d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feecc0c6ed0 tx=0x7feebc009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.727+0000 7feed10fa700 1 -- 172.21.15.5:0/1444619234 shutdown_connections 2023-03-03T06:24:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.727+0000 7feed10fa700 1 --2- 172.21.15.5:0/1444619234 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feecc0cd3e0 0x7feecc160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.727+0000 7feed10fa700 1 --2- 172.21.15.5:0/1444619234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feecc15cd40 0x7feecc0b18d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.727+0000 7feed10fa700 1 --2- 172.21.15.5:0/1444619234 >> v2:172.21.15.191:3300/0 conn(0x7feecc0cba50 0x7feecc0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.727+0000 7feed10fa700 1 -- 172.21.15.5:0/1444619234 >> 172.21.15.5:0/1444619234 conn(0x7feecc0cc8d0 msgr2=0x7feecc0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.727+0000 7feed10fa700 1 -- 172.21.15.5:0/1444619234 shutdown_connections 2023-03-03T06:24:32.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.727+0000 7feed10fa700 1 -- 172.21.15.5:0/1444619234 wait complete. 2023-03-03T06:24:32.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.729+0000 7feed10fa700 1 Processor -- start 2023-03-03T06:24:32.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.729+0000 7feed10fa700 1 -- start start 2023-03-03T06:24:32.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.729+0000 7feed10fa700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feecc0cba50 0x7feecc154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:32.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.729+0000 7feed10fa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feecc0cd3e0 0x7feecc06bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:32.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.729+0000 7feed10fa700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feecc15cd40 0x7feecc06c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:32.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.729+0000 7feed10fa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc0ac790 con 0x7feecc0cd3e0 2023-03-03T06:24:32.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.729+0000 7feed10fa700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc0aca70 con 0x7feecc0cba50 2023-03-03T06:24:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.729+0000 7feed10fa700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc0acd50 con 0x7feecc15cd40 2023-03-03T06:24:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.729+0000 7feeca59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feecc0cd3e0 0x7feecc06bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.729+0000 7feeca59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feecc0cd3e0 0x7feecc06bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42802/0 (socket says 172.21.15.5:42802) 2023-03-03T06:24:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feeca59c700 1 -- 172.21.15.5:0/380614824 learned_addr learned my addr 172.21.15.5:0/380614824 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feecb59e700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feecc15cd40 0x7feecc06c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:32.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feecad9d700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feecc0cba50 0x7feecc154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feeca59c700 1 -- 172.21.15.5:0/380614824 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feecc15cd40 msgr2=0x7feecc06c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feeca59c700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feecc15cd40 0x7feecc06c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feeca59c700 1 -- 172.21.15.5:0/380614824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feecc0cba50 msgr2=0x7feecc154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feeca59c700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feecc0cba50 0x7feecc154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feeca59c700 1 -- 172.21.15.5:0/380614824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc009550 con 0x7feecc0cd3e0 2023-03-03T06:24:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feeca59c700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feecc0cd3e0 0x7feecc06bca0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7feec000c7f0 tx=0x7feec000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:32.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feeb37fe700 1 -- 172.21.15.5:0/380614824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0005c20 con 0x7feecc0cd3e0 2023-03-03T06:24:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feeb37fe700 1 -- 172.21.15.5:0/380614824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0005da0 con 0x7feecc0cd3e0 2023-03-03T06:24:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feeb37fe700 1 -- 172.21.15.5:0/380614824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0004260 con 0x7feecc0cd3e0 2023-03-03T06:24:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feed10fa700 1 -- 172.21.15.5:0/380614824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc0ca530 con 0x7feecc0cd3e0 2023-03-03T06:24:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.730+0000 7feed10fa700 1 -- 172.21.15.5:0/380614824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc15e060 con 0x7feecc0cd3e0 2023-03-03T06:24:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.731+0000 7feed10fa700 1 -- 172.21.15.5:0/380614824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc15d110 con 0x7feecc0cd3e0 2023-03-03T06:24:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.732+0000 7feeb37fe700 1 -- 172.21.15.5:0/380614824 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7feec0020070 con 0x7feecc0cd3e0 2023-03-03T06:24:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.732+0000 7feeb37fe700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feeb80682f0 0x7feeb806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.732+0000 7feeb37fe700 1 -- 172.21.15.5:0/380614824 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feec0085e20 con 0x7feecc0cd3e0 2023-03-03T06:24:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.732+0000 7feecad9d700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feeb80682f0 0x7feeb806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.732+0000 7feecad9d700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feeb80682f0 0x7feeb806a7a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feebc000c00 tx=0x7feebc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:32.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.736+0000 7feeb37fe700 1 -- 172.21.15.5:0/380614824 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7feec00522c0 con 0x7feecc0cd3e0 2023-03-03T06:24:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.931+0000 7feed10fa700 1 -- 172.21.15.5:0/380614824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feecc0c7df0 con 0x7feecc0cd3e0 2023-03-03T06:24:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.932+0000 7feeb37fe700 1 -- 172.21.15.5:0/380614824 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19641 (secure 0 0 0) 0x7feecc0c7df0 con 0x7feecc0cd3e0 2023-03-03T06:24:32.934 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:32.935 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:24:28.893239+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:32.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.934+0000 7feed10fa700 1 -- 172.21.15.5:0/380614824 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feeb80682f0 msgr2=0x7feeb806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:32.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.934+0000 7feed10fa700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feeb80682f0 0x7feeb806a7a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feebc000c00 tx=0x7feebc008030 comp rx=0 tx=0).stop 2023-03-03T06:24:32.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.934+0000 7feed10fa700 1 -- 172.21.15.5:0/380614824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feecc0cd3e0 msgr2=0x7feecc06bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:32.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.934+0000 7feed10fa700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feecc0cd3e0 0x7feecc06bca0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7feec000c7f0 tx=0x7feec000cb00 comp rx=0 tx=0).stop 2023-03-03T06:24:32.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.934+0000 7feed10fa700 1 -- 172.21.15.5:0/380614824 shutdown_connections 2023-03-03T06:24:32.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.934+0000 7feed10fa700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feeb80682f0 0x7feeb806a7a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.934+0000 7feed10fa700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feecc15cd40 0x7feecc06c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.934+0000 7feed10fa700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feecc0cba50 0x7feecc154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.934+0000 7feed10fa700 1 --2- 172.21.15.5:0/380614824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feecc0cd3e0 0x7feecc06bca0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:32.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.934+0000 7feed10fa700 1 -- 172.21.15.5:0/380614824 >> 172.21.15.5:0/380614824 conn(0x7feecc0cc8d0 msgr2=0x7feecc0cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:32.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.934+0000 7feed10fa700 1 -- 172.21.15.5:0/380614824 shutdown_connections 2023-03-03T06:24:32.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:32.934+0000 7feed10fa700 1 -- 172.21.15.5:0/380614824 wait complete. 2023-03-03T06:24:32.949 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:23:38.141777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:23:39.283589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-03T06:23:42.422930+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-03T06:24:32.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:24:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.076+0000 7f05bc3cb700 1 Processor -- start 2023-03-03T06:24:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.076+0000 7f05bc3cb700 1 -- start start 2023-03-03T06:24:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05bc3cb700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05b40af080 0x7f05b40cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05bc3cb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05b406cf20 0x7f05b40cb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05bc3cb700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b40cd990 con 0x7f05b40af450 2023-03-03T06:24:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05bc3cb700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b406d360 con 0x7f05b40af080 2023-03-03T06:24:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05bc3cb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b406d540 con 0x7f05b406cf20 2023-03-03T06:24:33.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05ba167700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f05b40af080 0x7f05b40cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05b9966700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f05b40af450 0x7f05b406c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60884/0 (socket says 172.21.15.5:60884) 2023-03-03T06:24:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05b9966700 1 -- 172.21.15.5:0/1973224333 learned_addr learned my addr 172.21.15.5:0/1973224333 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05ba968700 1 --2- 172.21.15.5:0/1973224333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05b406cf20 0x7f05b40cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05ba167700 1 -- 172.21.15.5:0/1973224333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05b406cf20 msgr2=0x7f05b40cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05ba167700 1 --2- 172.21.15.5:0/1973224333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05b406cf20 0x7f05b40cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05ba167700 1 -- 172.21.15.5:0/1973224333 >> v1:172.21.15.5:6789/0 conn(0x7f05b40af450 legacy=0x7f05b406c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05ba167700 1 -- 172.21.15.5:0/1973224333 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b40cdbe0 con 0x7f05b40af080 2023-03-03T06:24:33.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.077+0000 7f05b9165700 1 -- 172.21.15.5:0/1973224333 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832910822 0 0) 0x7f05b40cd990 con 0x7f05b40af450 2023-03-03T06:24:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.078+0000 7f05ba167700 1 --2- 172.21.15.5:0/1973224333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b40af080 0x7f05b40cafc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009840 tx=0x7f05a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbfb6d613fcb8cd server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.078+0000 7f05b9165700 1 -- 172.21.15.5:0/1973224333 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a4011830 con 0x7f05b40af080 2023-03-03T06:24:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.078+0000 7f05b9165700 1 -- 172.21.15.5:0/1973224333 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a4011990 con 0x7f05b40af080 2023-03-03T06:24:33.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.078+0000 7f05b9165700 1 -- 172.21.15.5:0/1973224333 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a4011d20 con 0x7f05b40af080 2023-03-03T06:24:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.078+0000 7f05bc3cb700 1 -- 172.21.15.5:0/1973224333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b40af080 msgr2=0x7f05b40cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.078+0000 7f05bc3cb700 1 --2- 172.21.15.5:0/1973224333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b40af080 0x7f05b40cafc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009840 tx=0x7f05a4009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.078+0000 7f05bc3cb700 1 -- 172.21.15.5:0/1973224333 shutdown_connections 2023-03-03T06:24:33.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.078+0000 7f05bc3cb700 1 --2- 172.21.15.5:0/1973224333 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05b406cf20 0x7f05b40cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.078+0000 7f05bc3cb700 1 --2- 172.21.15.5:0/1973224333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b40af080 0x7f05b40cafc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.078+0000 7f05bc3cb700 1 -- 172.21.15.5:0/1973224333 >> 172.21.15.5:0/1973224333 conn(0x7f05b40cc840 msgr2=0x7f05b40ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.078+0000 7f05bc3cb700 1 -- 172.21.15.5:0/1973224333 shutdown_connections 2023-03-03T06:24:33.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.078+0000 7f05bc3cb700 1 -- 172.21.15.5:0/1973224333 wait complete. 2023-03-03T06:24:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.080+0000 7f05bc3cb700 1 Processor -- start 2023-03-03T06:24:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.080+0000 7f05bc3cb700 1 -- start start 2023-03-03T06:24:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.080+0000 7f05bc3cb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05b406cf20 0x7f05b40c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.080+0000 7f05bc3cb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05b40af080 0x7f05b41492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.080+0000 7f05bc3cb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b40af450 0x7f05b40c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.080+0000 7f05bc3cb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40c5970 con 0x7f05b40af450 2023-03-03T06:24:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.080+0000 7f05bc3cb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40c4fa0 con 0x7f05b406cf20 2023-03-03T06:24:33.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.080+0000 7f05bc3cb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b4149830 con 0x7f05b40af080 2023-03-03T06:24:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.080+0000 7f05ba968700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b40af450 0x7f05b40c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05ba968700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b40af450 0x7f05b40c38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42818/0 (socket says 172.21.15.5:42818) 2023-03-03T06:24:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05ba968700 1 -- 172.21.15.5:0/2836976278 learned_addr learned my addr 172.21.15.5:0/2836976278 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05b9966700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05b40af080 0x7f05b41492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05ba167700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05b406cf20 0x7f05b40c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05ba968700 1 -- 172.21.15.5:0/2836976278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05b40af080 msgr2=0x7f05b41492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05ba968700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05b40af080 0x7f05b41492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05ba968700 1 -- 172.21.15.5:0/2836976278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05b406cf20 msgr2=0x7f05b40c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05ba968700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05b406cf20 0x7f05b40c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05ba968700 1 -- 172.21.15.5:0/2836976278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a40094a0 con 0x7f05b40af450 2023-03-03T06:24:33.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05ba968700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b40af450 0x7f05b40c38f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00efc0 tx=0x7f05ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:33.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05aaffd700 1 -- 172.21.15.5:0/2836976278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac009ea0 con 0x7f05b40af450 2023-03-03T06:24:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05aaffd700 1 -- 172.21.15.5:0/2836976278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac00f040 con 0x7f05b40af450 2023-03-03T06:24:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05bc3cb700 1 -- 172.21.15.5:0/2836976278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b40ce1a0 con 0x7f05b40af450 2023-03-03T06:24:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05aaffd700 1 -- 172.21.15.5:0/2836976278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00ced0 con 0x7f05b40af450 2023-03-03T06:24:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.081+0000 7f05bc3cb700 1 -- 172.21.15.5:0/2836976278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b40cdec0 con 0x7f05b40af450 2023-03-03T06:24:33.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.082+0000 7f05bc3cb700 1 -- 172.21.15.5:0/2836976278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b40ce6c0 con 0x7f05b40af450 2023-03-03T06:24:33.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.083+0000 7f05aaffd700 1 -- 172.21.15.5:0/2836976278 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f05ac014480 con 0x7f05b40af450 2023-03-03T06:24:33.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.083+0000 7f05aaffd700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f05980682f0 0x7f059806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.083+0000 7f05ba167700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f05980682f0 0x7f059806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.083+0000 7f05aaffd700 1 -- 172.21.15.5:0/2836976278 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f05ac086be0 con 0x7f05b40af450 2023-03-03T06:24:33.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.084+0000 7f05ba167700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f05980682f0 0x7f059806a7a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f05a40090b0 tx=0x7f05a4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:33.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.087+0000 7f05aaffd700 1 -- 172.21.15.5:0/2836976278 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f05ac0530b0 con 0x7f05b40af450 2023-03-03T06:24:33.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.282+0000 7f05bc3cb700 1 -- 172.21.15.5:0/2836976278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f05b406c2b0 con 0x7f05b40af450 2023-03-03T06:24:33.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.283+0000 7f05aaffd700 1 -- 172.21.15.5:0/2836976278 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f05ac0180a0 con 0x7f05b40af450 2023-03-03T06:24:33.285 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:24:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.285+0000 7f05bc3cb700 1 -- 172.21.15.5:0/2836976278 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f05980682f0 msgr2=0x7f059806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.285+0000 7f05bc3cb700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f05980682f0 0x7f059806a7a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f05a40090b0 tx=0x7f05a4008030 comp rx=0 tx=0).stop 2023-03-03T06:24:33.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.285+0000 7f05bc3cb700 1 -- 172.21.15.5:0/2836976278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b40af450 msgr2=0x7f05b40c38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.285+0000 7f05bc3cb700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b40af450 0x7f05b40c38f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00efc0 tx=0x7f05ac00c3a0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.285+0000 7f05bc3cb700 1 -- 172.21.15.5:0/2836976278 shutdown_connections 2023-03-03T06:24:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.285+0000 7f05bc3cb700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05b40af450 0x7f05b40c38f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.285+0000 7f05bc3cb700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f05b406cf20 0x7f05b40c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.285+0000 7f05bc3cb700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f05980682f0 0x7f059806a7a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.285+0000 7f05bc3cb700 1 --2- 172.21.15.5:0/2836976278 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f05b40af080 0x7f05b41492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.285+0000 7f05bc3cb700 1 -- 172.21.15.5:0/2836976278 >> 172.21.15.5:0/2836976278 conn(0x7f05b40cc840 msgr2=0x7f05b40cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.285+0000 7f05bc3cb700 1 -- 172.21.15.5:0/2836976278 shutdown_connections 2023-03-03T06:24:33.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.285+0000 7f05bc3cb700 1 -- 172.21.15.5:0/2836976278 wait complete. 2023-03-03T06:24:33.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:24:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.425+0000 7fa106895700 1 Processor -- start 2023-03-03T06:24:33.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.425+0000 7fa106895700 1 -- start start 2023-03-03T06:24:33.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa106895700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa1000cd500 0x7fa10015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa106895700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa1000b1fe0 0x7fa1000cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa106895700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1000cc5d0 con 0x7fa1000b55b0 2023-03-03T06:24:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa106895700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10015e290 con 0x7fa1000b1fe0 2023-03-03T06:24:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa106895700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa100159c30 con 0x7fa1000cd500 2023-03-03T06:24:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa104e32700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa1000b1fe0 0x7fa1000cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa104e32700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa1000b1fe0 0x7fa1000cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42826/0 (socket says 172.21.15.5:42826) 2023-03-03T06:24:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa104e32700 1 -- 172.21.15.5:0/1765976408 learned_addr learned my addr 172.21.15.5:0/1765976408 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa0ff7fe700 1 --2- 172.21.15.5:0/1765976408 >> v2:172.21.15.191:3300/0 conn(0x7fa1000cd500 0x7fa10015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa104e32700 1 -- 172.21.15.5:0/1765976408 >> v2:172.21.15.191:3300/0 conn(0x7fa1000cd500 msgr2=0x7fa10015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa104e32700 1 --2- 172.21.15.5:0/1765976408 >> v2:172.21.15.191:3300/0 conn(0x7fa1000cd500 0x7fa10015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa104e32700 1 -- 172.21.15.5:0/1765976408 >> v1:172.21.15.5:6789/0 conn(0x7fa1000b55b0 legacy=0x7fa1000b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa104e32700 1 -- 172.21.15.5:0/1765976408 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1000b5980 con 0x7fa1000b1fe0 2023-03-03T06:24:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.426+0000 7fa0feffd700 1 -- 172.21.15.5:0/1765976408 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666932936 0 0) 0x7fa1000cc5d0 con 0x7fa1000b55b0 2023-03-03T06:24:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.427+0000 7fa104e32700 1 --2- 172.21.15.5:0/1765976408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1000b1fe0 0x7fa1000cdf90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa1000714a0 tx=0x7fa0f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28e64d31ac4760c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:33.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.427+0000 7fa0feffd700 1 -- 172.21.15.5:0/1765976408 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f800e070 con 0x7fa1000b1fe0 2023-03-03T06:24:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.427+0000 7fa0feffd700 1 -- 172.21.15.5:0/1765976408 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f800b9c0 con 0x7fa1000b1fe0 2023-03-03T06:24:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.427+0000 7fa0feffd700 1 -- 172.21.15.5:0/1765976408 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f800bd70 con 0x7fa1000b1fe0 2023-03-03T06:24:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.427+0000 7fa106895700 1 -- 172.21.15.5:0/1765976408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1000b1fe0 msgr2=0x7fa1000cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.427+0000 7fa106895700 1 --2- 172.21.15.5:0/1765976408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1000b1fe0 0x7fa1000cdf90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa1000714a0 tx=0x7fa0f800b330 comp rx=0 tx=0).stop 2023-03-03T06:24:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.427+0000 7fa106895700 1 -- 172.21.15.5:0/1765976408 shutdown_connections 2023-03-03T06:24:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.427+0000 7fa106895700 1 --2- 172.21.15.5:0/1765976408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1000b1fe0 0x7fa1000cdf90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.427+0000 7fa106895700 1 --2- 172.21.15.5:0/1765976408 >> v2:172.21.15.191:3300/0 conn(0x7fa1000cd500 0x7fa10015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.427+0000 7fa106895700 1 -- 172.21.15.5:0/1765976408 >> 172.21.15.5:0/1765976408 conn(0x7fa1000cc8d0 msgr2=0x7fa1000cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.427+0000 7fa106895700 1 -- 172.21.15.5:0/1765976408 shutdown_connections 2023-03-03T06:24:33.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.427+0000 7fa106895700 1 -- 172.21.15.5:0/1765976408 wait complete. 2023-03-03T06:24:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.428+0000 7fa106895700 1 Processor -- start 2023-03-03T06:24:33.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.429+0000 7fa106895700 1 -- start start 2023-03-03T06:24:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.429+0000 7fa106895700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1000b1fe0 0x7fa100153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.429+0000 7fa106895700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1000b55b0 0x7fa100155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.429+0000 7fa106895700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1000cd500 0x7fa10006c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.429+0000 7fa106895700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa100155280 con 0x7fa1000b1fe0 2023-03-03T06:24:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.429+0000 7fa106895700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa100154670 con 0x7fa1000cd500 2023-03-03T06:24:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.429+0000 7fa106895700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa100154950 con 0x7fa1000b55b0 2023-03-03T06:24:33.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa0fffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1000b1fe0 0x7fa100153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa0fffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1000b1fe0 0x7fa100153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42830/0 (socket says 172.21.15.5:42830) 2023-03-03T06:24:33.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa0fffff700 1 -- 172.21.15.5:0/342934553 learned_addr learned my addr 172.21.15.5:0/342934553 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:33.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa104e32700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1000cd500 0x7fa10006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa0ff7fe700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1000b55b0 0x7fa100155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa0fffff700 1 -- 172.21.15.5:0/342934553 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1000b55b0 msgr2=0x7fa100155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa0fffff700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1000b55b0 0x7fa100155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa0fffff700 1 -- 172.21.15.5:0/342934553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1000cd500 msgr2=0x7fa10006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa0fffff700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1000cd500 0x7fa10006c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa0fffff700 1 -- 172.21.15.5:0/342934553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f8009b30 con 0x7fa1000b1fe0 2023-03-03T06:24:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa0fffff700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1000b1fe0 0x7fa100153e20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00011e0 tx=0x7fa0f000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa0fcff9700 1 -- 172.21.15.5:0/342934553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00054e0 con 0x7fa1000b1fe0 2023-03-03T06:24:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa0fcff9700 1 -- 172.21.15.5:0/342934553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f0003680 con 0x7fa1000b1fe0 2023-03-03T06:24:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa106895700 1 -- 172.21.15.5:0/342934553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1000cbca0 con 0x7fa1000b1fe0 2023-03-03T06:24:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa0fcff9700 1 -- 172.21.15.5:0/342934553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0003a30 con 0x7fa1000b1fe0 2023-03-03T06:24:33.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.430+0000 7fa106895700 1 -- 172.21.15.5:0/342934553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1000cb9c0 con 0x7fa1000b1fe0 2023-03-03T06:24:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.431+0000 7fa106895700 1 -- 172.21.15.5:0/342934553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1000cbf80 con 0x7fa1000b1fe0 2023-03-03T06:24:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.432+0000 7fa0fcff9700 1 -- 172.21.15.5:0/342934553 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa0f0019030 con 0x7fa1000b1fe0 2023-03-03T06:24:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.432+0000 7fa0fcff9700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0e0068320 0x7fa0e006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.432+0000 7fa0fcff9700 1 -- 172.21.15.5:0/342934553 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa0f0085340 con 0x7fa1000b1fe0 2023-03-03T06:24:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.432+0000 7fa0ff7fe700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0e0068320 0x7fa0e006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.432+0000 7fa0ff7fe700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0e0068320 0x7fa0e006a7d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa1000c5ef0 tx=0x7fa0e8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:33.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.436+0000 7fa0fcff9700 1 -- 172.21.15.5:0/342934553 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa0f0051870 con 0x7fa1000b1fe0 2023-03-03T06:24:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.629+0000 7fa106895700 1 -- 172.21.15.5:0/342934553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1000b05e0 con 0x7fa1000b1fe0 2023-03-03T06:24:33.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.629+0000 7fa0fcff9700 1 -- 172.21.15.5:0/342934553 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0f00170a0 con 0x7fa1000b1fe0 2023-03-03T06:24:33.632 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:24:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.631+0000 7fa106895700 1 -- 172.21.15.5:0/342934553 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0e0068320 msgr2=0x7fa0e006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.631+0000 7fa106895700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0e0068320 0x7fa0e006a7d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa1000c5ef0 tx=0x7fa0e8008040 comp rx=0 tx=0).stop 2023-03-03T06:24:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.631+0000 7fa106895700 1 -- 172.21.15.5:0/342934553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1000b1fe0 msgr2=0x7fa100153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.631+0000 7fa106895700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1000b1fe0 0x7fa100153e20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00011e0 tx=0x7fa0f000cae0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.631+0000 7fa106895700 1 -- 172.21.15.5:0/342934553 shutdown_connections 2023-03-03T06:24:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.631+0000 7fa106895700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1000cd500 0x7fa10006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.631+0000 7fa106895700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1000b1fe0 0x7fa100153e20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.631+0000 7fa106895700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0e0068320 0x7fa0e006a7d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.631+0000 7fa106895700 1 --2- 172.21.15.5:0/342934553 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1000b55b0 0x7fa100155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.631+0000 7fa106895700 1 -- 172.21.15.5:0/342934553 >> 172.21.15.5:0/342934553 conn(0x7fa1000cc8d0 msgr2=0x7fa10006abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.631+0000 7fa106895700 1 -- 172.21.15.5:0/342934553 shutdown_connections 2023-03-03T06:24:33.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.631+0000 7fa106895700 1 -- 172.21.15.5:0/342934553 wait complete. 2023-03-03T06:24:33.645 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:24:33.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.771+0000 7f4aae902700 1 Processor -- start 2023-03-03T06:24:33.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.771+0000 7f4aae902700 1 -- start start 2023-03-03T06:24:33.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aae902700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4aa815dba0 0x7f4aa80cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aae902700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4aa80afda0 0x7f4aa80b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aae902700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa80b31d0 con 0x7f4aa80b2d90 2023-03-03T06:24:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aae902700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa80cd6f0 con 0x7f4aa815dba0 2023-03-03T06:24:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aae902700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80cfe70 con 0x7f4aa80afda0 2023-03-03T06:24:33.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aa77fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4aa80afda0 0x7f4aa80b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aa7fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4aa815dba0 0x7f4aa80cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aa77fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4aa80afda0 0x7f4aa80b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:40914/0 (socket says 172.21.15.5:40914) 2023-03-03T06:24:33.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aa7fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4aa815dba0 0x7f4aa80cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:43196/0 (socket says 172.21.15.5:43196) 2023-03-03T06:24:33.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aace9f700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f4aa80b2d90 0x7f4aa8070960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:47210/0 (socket says 172.21.15.5:47210) 2023-03-03T06:24:33.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aa77fe700 1 -- 172.21.15.5:0/929401804 learned_addr learned my addr 172.21.15.5:0/929401804 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:33.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aa77fe700 1 -- 172.21.15.5:0/929401804 >> v2:172.21.15.191:3300/0 conn(0x7f4aa815dba0 msgr2=0x7f4aa80cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aa77fe700 1 --2- 172.21.15.5:0/929401804 >> v2:172.21.15.191:3300/0 conn(0x7f4aa815dba0 0x7f4aa80cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aa77fe700 1 -- 172.21.15.5:0/929401804 >> v1:172.21.15.191:6789/0 conn(0x7f4aa80b2d90 legacy=0x7f4aa8070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aa77fe700 1 -- 172.21.15.5:0/929401804 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa815df70 con 0x7f4aa80afda0 2023-03-03T06:24:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.772+0000 7f4aa7fff700 1 --2- 172.21.15.5:0/929401804 >> v2:172.21.15.191:3300/0 conn(0x7f4aa815dba0 0x7f4aa80cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:33.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.773+0000 7f4aa77fe700 1 --2- 172.21.15.5:0/929401804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4aa80afda0 0x7f4aa80b2850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0098f0 tx=0x7f4a9c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=359659ff6d847c9f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.773+0000 7f4aa6ffd700 1 -- 172.21.15.5:0/929401804 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c011830 con 0x7f4aa80afda0 2023-03-03T06:24:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.773+0000 7f4aa6ffd700 1 -- 172.21.15.5:0/929401804 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c011990 con 0x7f4aa80afda0 2023-03-03T06:24:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.773+0000 7f4aa6ffd700 1 -- 172.21.15.5:0/929401804 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c011d20 con 0x7f4aa80afda0 2023-03-03T06:24:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.773+0000 7f4aae902700 1 -- 172.21.15.5:0/929401804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4aa80afda0 msgr2=0x7f4aa80b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.773+0000 7f4aae902700 1 --2- 172.21.15.5:0/929401804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4aa80afda0 0x7f4aa80b2850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0098f0 tx=0x7f4a9c009c00 comp rx=0 tx=0).stop 2023-03-03T06:24:33.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.773+0000 7f4aae902700 1 -- 172.21.15.5:0/929401804 shutdown_connections 2023-03-03T06:24:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.773+0000 7f4aae902700 1 --2- 172.21.15.5:0/929401804 >> v2:172.21.15.191:3300/0 conn(0x7f4aa815dba0 0x7f4aa80cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.773+0000 7f4aae902700 1 --2- 172.21.15.5:0/929401804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4aa80afda0 0x7f4aa80b2850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.773+0000 7f4aae902700 1 -- 172.21.15.5:0/929401804 >> 172.21.15.5:0/929401804 conn(0x7f4aa8070050 msgr2=0x7f4aa80cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.773+0000 7f4aae902700 1 -- 172.21.15.5:0/929401804 shutdown_connections 2023-03-03T06:24:33.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.773+0000 7f4aae902700 1 -- 172.21.15.5:0/929401804 wait complete. 2023-03-03T06:24:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.775+0000 7f4aae902700 1 Processor -- start 2023-03-03T06:24:33.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.775+0000 7f4aae902700 1 -- start start 2023-03-03T06:24:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.775+0000 7f4aae902700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa80afda0 0x7f4aa80b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.775+0000 7f4aae902700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4aa80b2d90 0x7f4aa80b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.775+0000 7f4aae902700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4aa815dba0 0x7f4aa80ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.775+0000 7f4aae902700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8151b40 con 0x7f4aa80afda0 2023-03-03T06:24:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.775+0000 7f4aae902700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80c9660 con 0x7f4aa815dba0 2023-03-03T06:24:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.775+0000 7f4aae902700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa80c98d0 con 0x7f4aa80b2d90 2023-03-03T06:24:33.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aa7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa80afda0 0x7f4aa80b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aa7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa80afda0 0x7f4aa80b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42842/0 (socket says 172.21.15.5:42842) 2023-03-03T06:24:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aa7fff700 1 -- 172.21.15.5:0/1583116221 learned_addr learned my addr 172.21.15.5:0/1583116221 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aa77fe700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4aa80b2d90 0x7f4aa80b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aace9f700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4aa815dba0 0x7f4aa80ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aa7fff700 1 -- 172.21.15.5:0/1583116221 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4aa80b2d90 msgr2=0x7f4aa80b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aa7fff700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4aa80b2d90 0x7f4aa80b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aa7fff700 1 -- 172.21.15.5:0/1583116221 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4aa815dba0 msgr2=0x7f4aa80ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aa7fff700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4aa815dba0 0x7f4aa80ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aa7fff700 1 -- 172.21.15.5:0/1583116221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a980094a0 con 0x7f4aa80afda0 2023-03-03T06:24:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aace9f700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4aa815dba0 0x7f4aa80ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aa7fff700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa80afda0 0x7f4aa80b5540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800ebe0 tx=0x7f4a9800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aa4ff9700 1 -- 172.21.15.5:0/1583116221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800c850 con 0x7f4aa80afda0 2023-03-03T06:24:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aa4ff9700 1 -- 172.21.15.5:0/1583116221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9800c9b0 con 0x7f4aa80afda0 2023-03-03T06:24:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aae902700 1 -- 172.21.15.5:0/1583116221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a9c009550 con 0x7f4aa80afda0 2023-03-03T06:24:33.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aa4ff9700 1 -- 172.21.15.5:0/1583116221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800cd40 con 0x7f4aa80afda0 2023-03-03T06:24:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.776+0000 7f4aae902700 1 -- 172.21.15.5:0/1583116221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa815e870 con 0x7f4aa80afda0 2023-03-03T06:24:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.777+0000 7f4aae902700 1 -- 172.21.15.5:0/1583116221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa815e590 con 0x7f4aa80afda0 2023-03-03T06:24:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.778+0000 7f4aa4ff9700 1 -- 172.21.15.5:0/1583116221 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4a98019030 con 0x7f4aa80afda0 2023-03-03T06:24:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.778+0000 7f4aa4ff9700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a940682f0 0x7f4a9406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.778+0000 7f4aa4ff9700 1 -- 172.21.15.5:0/1583116221 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4a98085fb0 con 0x7f4aa80afda0 2023-03-03T06:24:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.778+0000 7f4aa77fe700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a940682f0 0x7f4a9406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:33.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.779+0000 7f4aa77fe700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a940682f0 0x7f4a9406a7a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0098f0 tx=0x7f4a9c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:33.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.782+0000 7f4aa4ff9700 1 -- 172.21.15.5:0/1583116221 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4a98052460 con 0x7f4aa80afda0 2023-03-03T06:24:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.974+0000 7f4aae902700 1 -- 172.21.15.5:0/1583116221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4aa815eb50 con 0x7f4aa80afda0 2023-03-03T06:24:33.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.974+0000 7f4aa4ff9700 1 -- 172.21.15.5:0/1583116221 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a98017020 con 0x7f4aa80afda0 2023-03-03T06:24:33.977 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:33.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.976+0000 7f4aae902700 1 -- 172.21.15.5:0/1583116221 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a940682f0 msgr2=0x7f4a9406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.976+0000 7f4aae902700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a940682f0 0x7f4a9406a7a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0098f0 tx=0x7f4a9c008030 comp rx=0 tx=0).stop 2023-03-03T06:24:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.976+0000 7f4aae902700 1 -- 172.21.15.5:0/1583116221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa80afda0 msgr2=0x7f4aa80b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.976+0000 7f4aae902700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa80afda0 0x7f4aa80b5540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800ebe0 tx=0x7f4a9800eef0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.976+0000 7f4aae902700 1 -- 172.21.15.5:0/1583116221 shutdown_connections 2023-03-03T06:24:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.976+0000 7f4aae902700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4aa815dba0 0x7f4aa80ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.976+0000 7f4aae902700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4aa80afda0 0x7f4aa80b5540 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.976+0000 7f4aae902700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a940682f0 0x7f4a9406a7a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.976+0000 7f4aae902700 1 --2- 172.21.15.5:0/1583116221 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4aa80b2d90 0x7f4aa80b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.976+0000 7f4aae902700 1 -- 172.21.15.5:0/1583116221 >> 172.21.15.5:0/1583116221 conn(0x7f4aa8070050 msgr2=0x7f4aa80cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.976+0000 7f4aae902700 1 -- 172.21.15.5:0/1583116221 shutdown_connections 2023-03-03T06:24:33.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:33.976+0000 7f4aae902700 1 -- 172.21.15.5:0/1583116221 wait complete. 2023-03-03T06:24:33.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:24:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.116+0000 7fba9cc0c700 1 Processor -- start 2023-03-03T06:24:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.116+0000 7fba9cc0c700 1 -- start start 2023-03-03T06:24:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.117+0000 7fba9cc0c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fba9815cd40 0x7fba980b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.117+0000 7fba9cc0c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba980cb9d0 0x7fba980b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.117+0000 7fba9cc0c700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9815e160 con 0x7fba980cd3e0 2023-03-03T06:24:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.117+0000 7fba9cc0c700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba980cd870 con 0x7fba9815cd40 2023-03-03T06:24:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.117+0000 7fba9cc0c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9815d110 con 0x7fba980cb9d0 2023-03-03T06:24:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.117+0000 7fba96d9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba980cb9d0 0x7fba980b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.117+0000 7fba9659c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fba9815cd40 0x7fba980b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.117+0000 7fba95d9b700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fba980cd3e0 0x7fba98160720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:47220/0 (socket says 172.21.15.5:47220) 2023-03-03T06:24:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.117+0000 7fba96d9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba980cb9d0 0x7fba980b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:40932/0 (socket says 172.21.15.5:40932) 2023-03-03T06:24:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.117+0000 7fba95d9b700 1 -- 172.21.15.5:0/1962054638 learned_addr learned my addr 172.21.15.5:0/1962054638 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.118+0000 7fba9659c700 1 -- 172.21.15.5:0/1962054638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba980cb9d0 msgr2=0x7fba980b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.118+0000 7fba9659c700 1 --2- 172.21.15.5:0/1962054638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba980cb9d0 0x7fba980b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.118+0000 7fba9659c700 1 -- 172.21.15.5:0/1962054638 >> v1:172.21.15.191:6789/0 conn(0x7fba980cd3e0 legacy=0x7fba98160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.118+0000 7fba9659c700 1 -- 172.21.15.5:0/1962054638 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9815d3c0 con 0x7fba9815cd40 2023-03-03T06:24:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.118+0000 7fba9559a700 1 -- 172.21.15.5:0/1962054638 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468790372 0 0) 0x7fba9815e160 con 0x7fba980cd3e0 2023-03-03T06:24:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.118+0000 7fba96d9d700 1 --2- 172.21.15.5:0/1962054638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba980cb9d0 0x7fba980b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.118+0000 7fba9659c700 1 --2- 172.21.15.5:0/1962054638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba9815cd40 0x7fba980b18d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009840 tx=0x7fba8c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ad7a053195f6fd3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.118+0000 7fba9559a700 1 -- 172.21.15.5:0/1962054638 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c011830 con 0x7fba9815cd40 2023-03-03T06:24:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.118+0000 7fba9559a700 1 -- 172.21.15.5:0/1962054638 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c011990 con 0x7fba9815cd40 2023-03-03T06:24:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.118+0000 7fba9559a700 1 -- 172.21.15.5:0/1962054638 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c011d20 con 0x7fba9815cd40 2023-03-03T06:24:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.118+0000 7fba9cc0c700 1 -- 172.21.15.5:0/1962054638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba9815cd40 msgr2=0x7fba980b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.118+0000 7fba9cc0c700 1 --2- 172.21.15.5:0/1962054638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba9815cd40 0x7fba980b18d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009840 tx=0x7fba8c009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.119+0000 7fba9cc0c700 1 -- 172.21.15.5:0/1962054638 shutdown_connections 2023-03-03T06:24:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.119+0000 7fba9cc0c700 1 --2- 172.21.15.5:0/1962054638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba980cb9d0 0x7fba980b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.119+0000 7fba9cc0c700 1 --2- 172.21.15.5:0/1962054638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba9815cd40 0x7fba980b18d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.119+0000 7fba9cc0c700 1 -- 172.21.15.5:0/1962054638 >> 172.21.15.5:0/1962054638 conn(0x7fba980cc8d0 msgr2=0x7fba980cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.119+0000 7fba9cc0c700 1 -- 172.21.15.5:0/1962054638 shutdown_connections 2023-03-03T06:24:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.119+0000 7fba9cc0c700 1 -- 172.21.15.5:0/1962054638 wait complete. 2023-03-03T06:24:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.120+0000 7fba9cc0c700 1 Processor -- start 2023-03-03T06:24:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.120+0000 7fba9cc0c700 1 -- start start 2023-03-03T06:24:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba9cc0c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba980cb9d0 0x7fba980ad580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba9cc0c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba980cd3e0 0x7fba980c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba9cc0c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba9815cd40 0x7fba980adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba9cc0c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba980ad160 con 0x7fba9815cd40 2023-03-03T06:24:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba9cc0c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba980c6240 con 0x7fba980cb9d0 2023-03-03T06:24:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba9cc0c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9815b370 con 0x7fba980cd3e0 2023-03-03T06:24:34.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba96d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba9815cd40 0x7fba980adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba96d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba9815cd40 0x7fba980adc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42858/0 (socket says 172.21.15.5:42858) 2023-03-03T06:24:34.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba96d9d700 1 -- 172.21.15.5:0/3004412610 learned_addr learned my addr 172.21.15.5:0/3004412610 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:34.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba9659c700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba980cb9d0 0x7fba980ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba95d9b700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba980cd3e0 0x7fba980c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba96d9d700 1 -- 172.21.15.5:0/3004412610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba980cd3e0 msgr2=0x7fba980c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba96d9d700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba980cd3e0 0x7fba980c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba96d9d700 1 -- 172.21.15.5:0/3004412610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba980cb9d0 msgr2=0x7fba980ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba96d9d700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba980cb9d0 0x7fba980ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba96d9d700 1 -- 172.21.15.5:0/3004412610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90009a70 con 0x7fba9815cd40 2023-03-03T06:24:34.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba95d9b700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba980cd3e0 0x7fba980c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:34.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.121+0000 7fba96d9d700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba9815cd40 0x7fba980adc50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fba9000efc0 tx=0x7fba9000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:34.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.122+0000 7fba86ffd700 1 -- 172.21.15.5:0/3004412610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000cb40 con 0x7fba9815cd40 2023-03-03T06:24:34.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.122+0000 7fba86ffd700 1 -- 172.21.15.5:0/3004412610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9000f040 con 0x7fba9815cd40 2023-03-03T06:24:34.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.122+0000 7fba9cc0c700 1 -- 172.21.15.5:0/3004412610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c0094a0 con 0x7fba9815cd40 2023-03-03T06:24:34.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.122+0000 7fba86ffd700 1 -- 172.21.15.5:0/3004412610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90003a20 con 0x7fba9815cd40 2023-03-03T06:24:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.122+0000 7fba9cc0c700 1 -- 172.21.15.5:0/3004412610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9815d980 con 0x7fba9815cd40 2023-03-03T06:24:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.122+0000 7fba9cc0c700 1 -- 172.21.15.5:0/3004412610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9815d6a0 con 0x7fba9815cd40 2023-03-03T06:24:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.123+0000 7fba86ffd700 1 -- 172.21.15.5:0/3004412610 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fba90014480 con 0x7fba9815cd40 2023-03-03T06:24:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.123+0000 7fba86ffd700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fba780682f0 0x7fba7806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.123+0000 7fba86ffd700 1 -- 172.21.15.5:0/3004412610 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fba90086a70 con 0x7fba9815cd40 2023-03-03T06:24:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.123+0000 7fba9659c700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fba780682f0 0x7fba7806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.124+0000 7fba9659c700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fba780682f0 0x7fba7806a7a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009fd0 tx=0x7fba8c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:34.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.128+0000 7fba86ffd700 1 -- 172.21.15.5:0/3004412610 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fba90052f40 con 0x7fba9815cd40 2023-03-03T06:24:34.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.320+0000 7fba9cc0c700 1 -- 172.21.15.5:0/3004412610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fba9815dc60 con 0x7fba9815cd40 2023-03-03T06:24:34.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.320+0000 7fba86ffd700 1 -- 172.21.15.5:0/3004412610 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fba90056560 con 0x7fba9815cd40 2023-03-03T06:24:34.323 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:24:34.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.323+0000 7fba9cc0c700 1 -- 172.21.15.5:0/3004412610 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fba780682f0 msgr2=0x7fba7806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.323+0000 7fba9cc0c700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fba780682f0 0x7fba7806a7a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009fd0 tx=0x7fba8c01c040 comp rx=0 tx=0).stop 2023-03-03T06:24:34.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.323+0000 7fba9cc0c700 1 -- 172.21.15.5:0/3004412610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba9815cd40 msgr2=0x7fba980adc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.323+0000 7fba9cc0c700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba9815cd40 0x7fba980adc50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fba9000efc0 tx=0x7fba9000c3a0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.325 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.323+0000 7fba9cc0c700 1 -- 172.21.15.5:0/3004412610 shutdown_connections 2023-03-03T06:24:34.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.323+0000 7fba9cc0c700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba9815cd40 0x7fba980adc50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.323+0000 7fba9cc0c700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba980cb9d0 0x7fba980ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.323+0000 7fba9cc0c700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fba780682f0 0x7fba7806a7a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.323+0000 7fba9cc0c700 1 --2- 172.21.15.5:0/3004412610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fba980cd3e0 0x7fba980c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.323+0000 7fba9cc0c700 1 -- 172.21.15.5:0/3004412610 >> 172.21.15.5:0/3004412610 conn(0x7fba980cc8d0 msgr2=0x7fba9806cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:34.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.323+0000 7fba9cc0c700 1 -- 172.21.15.5:0/3004412610 shutdown_connections 2023-03-03T06:24:34.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.323+0000 7fba9cc0c700 1 -- 172.21.15.5:0/3004412610 wait complete. 2023-03-03T06:24:34.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-03T06:24:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.463+0000 7f771e2aa700 1 Processor -- start 2023-03-03T06:24:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.463+0000 7f771e2aa700 1 -- start start 2023-03-03T06:24:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f771e2aa700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f77180cf3f0 0x7f77180cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f771e2aa700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77180cf7c0 0x7f771815dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f771e2aa700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77180b18d0 0x7f77180b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f771e2aa700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77180b2290 con 0x7f77180cf7c0 2023-03-03T06:24:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f771e2aa700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77180cc370 con 0x7f77180cf3f0 2023-03-03T06:24:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f771e2aa700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771815e2b0 con 0x7f77180b18d0 2023-03-03T06:24:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f77177fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77180cf7c0 0x7f771815dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f77177fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f77180cf7c0 0x7f771815dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42864/0 (socket says 172.21.15.5:42864) 2023-03-03T06:24:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f77177fe700 1 -- 172.21.15.5:0/1024772990 learned_addr learned my addr 172.21.15.5:0/1024772990 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f771c847700 1 --2- 172.21.15.5:0/1024772990 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77180b18d0 0x7f77180b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f7717fff700 1 --2- 172.21.15.5:0/1024772990 >> v2:172.21.15.191:3300/0 conn(0x7f77180cf3f0 0x7f77180cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f77177fe700 1 -- 172.21.15.5:0/1024772990 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77180b18d0 msgr2=0x7f77180b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f77177fe700 1 --2- 172.21.15.5:0/1024772990 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77180b18d0 0x7f77180b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f77177fe700 1 -- 172.21.15.5:0/1024772990 >> v2:172.21.15.191:3300/0 conn(0x7f77180cf3f0 msgr2=0x7f77180cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f77177fe700 1 --2- 172.21.15.5:0/1024772990 >> v2:172.21.15.191:3300/0 conn(0x7f77180cf3f0 0x7f77180cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f77177fe700 1 -- 172.21.15.5:0/1024772990 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77180cb760 con 0x7f77180cf7c0 2023-03-03T06:24:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f771c847700 1 --2- 172.21.15.5:0/1024772990 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77180b18d0 0x7f77180b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f7717fff700 1 --2- 172.21.15.5:0/1024772990 >> v2:172.21.15.191:3300/0 conn(0x7f77180cf3f0 0x7f77180cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.464+0000 7f77177fe700 1 --2- 172.21.15.5:0/1024772990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77180cf7c0 0x7f771815dd70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7718068850 tx=0x7f7708009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc197116643c0223 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.465+0000 7f7716ffd700 1 -- 172.21.15.5:0/1024772990 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770800b870 con 0x7f77180cf7c0 2023-03-03T06:24:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.465+0000 7f7716ffd700 1 -- 172.21.15.5:0/1024772990 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770800b9d0 con 0x7f77180cf7c0 2023-03-03T06:24:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.465+0000 7f7716ffd700 1 -- 172.21.15.5:0/1024772990 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770800bd60 con 0x7f77180cf7c0 2023-03-03T06:24:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.465+0000 7f771e2aa700 1 -- 172.21.15.5:0/1024772990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77180cf7c0 msgr2=0x7f771815dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.465+0000 7f771e2aa700 1 --2- 172.21.15.5:0/1024772990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77180cf7c0 0x7f771815dd70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7718068850 tx=0x7f7708009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.465+0000 7f771e2aa700 1 -- 172.21.15.5:0/1024772990 shutdown_connections 2023-03-03T06:24:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.465+0000 7f771e2aa700 1 --2- 172.21.15.5:0/1024772990 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77180b18d0 0x7f77180b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.465+0000 7f771e2aa700 1 --2- 172.21.15.5:0/1024772990 >> v2:172.21.15.191:3300/0 conn(0x7f77180cf3f0 0x7f77180cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.465+0000 7f771e2aa700 1 --2- 172.21.15.5:0/1024772990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77180cf7c0 0x7f771815dd70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.465+0000 7f771e2aa700 1 -- 172.21.15.5:0/1024772990 >> 172.21.15.5:0/1024772990 conn(0x7f77180cc8d0 msgr2=0x7f77180cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.465+0000 7f771e2aa700 1 -- 172.21.15.5:0/1024772990 shutdown_connections 2023-03-03T06:24:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.465+0000 7f771e2aa700 1 -- 172.21.15.5:0/1024772990 wait complete. 2023-03-03T06:24:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.466+0000 7f771e2aa700 1 Processor -- start 2023-03-03T06:24:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.467+0000 7f771e2aa700 1 -- start start 2023-03-03T06:24:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.467+0000 7f771e2aa700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77180b18d0 0x7f77180ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.467+0000 7f771e2aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77180cf3f0 0x7f77180aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.467+0000 7f771e2aa700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77180cf7c0 0x7f771814e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.467+0000 7f771e2aa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180b34c0 con 0x7f77180cf3f0 2023-03-03T06:24:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.467+0000 7f771e2aa700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180af370 con 0x7f77180cf7c0 2023-03-03T06:24:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.467+0000 7f771e2aa700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771815b490 con 0x7f77180b18d0 2023-03-03T06:24:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f77177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77180cf3f0 0x7f77180aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f77177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77180cf3f0 0x7f77180aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42872/0 (socket says 172.21.15.5:42872) 2023-03-03T06:24:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f77177fe700 1 -- 172.21.15.5:0/993959326 learned_addr learned my addr 172.21.15.5:0/993959326 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f771c847700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77180cf7c0 0x7f771814e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f7717fff700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77180b18d0 0x7f77180ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f77177fe700 1 -- 172.21.15.5:0/993959326 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77180b18d0 msgr2=0x7f77180ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f77177fe700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77180b18d0 0x7f77180ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f77177fe700 1 -- 172.21.15.5:0/993959326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77180cf7c0 msgr2=0x7f771814e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f77177fe700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77180cf7c0 0x7f771814e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f77177fe700 1 -- 172.21.15.5:0/993959326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7708009550 con 0x7f77180cf3f0 2023-03-03T06:24:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f7717fff700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77180b18d0 0x7f77180ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f77177fe700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77180cf3f0 0x7f77180aee30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7708014040 tx=0x7f7708004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f7714ff9700 1 -- 172.21.15.5:0/993959326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708004310 con 0x7f77180cf3f0 2023-03-03T06:24:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f7714ff9700 1 -- 172.21.15.5:0/993959326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770801f070 con 0x7f77180cf3f0 2023-03-03T06:24:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f771e2aa700 1 -- 172.21.15.5:0/993959326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77180cbd20 con 0x7f77180cf3f0 2023-03-03T06:24:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f7714ff9700 1 -- 172.21.15.5:0/993959326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080036a0 con 0x7f77180cf3f0 2023-03-03T06:24:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.468+0000 7f771e2aa700 1 -- 172.21.15.5:0/993959326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77180cba40 con 0x7f77180cf3f0 2023-03-03T06:24:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.469+0000 7f771e2aa700 1 -- 172.21.15.5:0/993959326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77180cc000 con 0x7f77180cf3f0 2023-03-03T06:24:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.470+0000 7f7714ff9700 1 -- 172.21.15.5:0/993959326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f770800f050 con 0x7f77180cf3f0 2023-03-03T06:24:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.470+0000 7f7714ff9700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76f80682f0 0x7f76f806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.470+0000 7f7714ff9700 1 -- 172.21.15.5:0/993959326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7708087530 con 0x7f77180cf3f0 2023-03-03T06:24:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.470+0000 7f7717fff700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76f80682f0 0x7f76f806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.471+0000 7f7717fff700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76f80682f0 0x7f76f806a7a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7700006fd0 tx=0x7f7700008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.475+0000 7f7714ff9700 1 -- 172.21.15.5:0/993959326 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7708053970 con 0x7f77180cf3f0 2023-03-03T06:24:34.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.665+0000 7f771e2aa700 1 -- 172.21.15.5:0/993959326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f77180b3600 con 0x7f77180cf3f0 2023-03-03T06:24:34.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.666+0000 7f7714ff9700 1 -- 172.21.15.5:0/993959326 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f77180b3600 con 0x7f77180cf3f0 2023-03-03T06:24:34.668 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:34.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.667+0000 7f771e2aa700 1 -- 172.21.15.5:0/993959326 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76f80682f0 msgr2=0x7f76f806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.667+0000 7f771e2aa700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76f80682f0 0x7f76f806a7a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7700006fd0 tx=0x7f7700008040 comp rx=0 tx=0).stop 2023-03-03T06:24:34.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.668+0000 7f771e2aa700 1 -- 172.21.15.5:0/993959326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77180cf3f0 msgr2=0x7f77180aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.668+0000 7f771e2aa700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77180cf3f0 0x7f77180aee30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7708014040 tx=0x7f7708004750 comp rx=0 tx=0).stop 2023-03-03T06:24:34.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.668+0000 7f771e2aa700 1 -- 172.21.15.5:0/993959326 shutdown_connections 2023-03-03T06:24:34.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.668+0000 7f771e2aa700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77180cf7c0 0x7f771814e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.668+0000 7f771e2aa700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f76f80682f0 0x7f76f806a7a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.668+0000 7f771e2aa700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f77180b18d0 0x7f77180ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.668+0000 7f771e2aa700 1 --2- 172.21.15.5:0/993959326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77180cf3f0 0x7f77180aee30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.668+0000 7f771e2aa700 1 -- 172.21.15.5:0/993959326 >> 172.21.15.5:0/993959326 conn(0x7f77180cc8d0 msgr2=0x7f77180b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:34.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.668+0000 7f771e2aa700 1 -- 172.21.15.5:0/993959326 shutdown_connections 2023-03-03T06:24:34.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.668+0000 7f771e2aa700 1 -- 172.21.15.5:0/993959326 wait complete. 2023-03-03T06:24:34.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-03T06:24:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.806+0000 7f389c498700 1 Processor -- start 2023-03-03T06:24:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.806+0000 7f389c498700 1 -- start start 2023-03-03T06:24:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f389c498700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940af450 0x7f38940cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f389c498700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f38940b1f80 0x7f38940cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f389c498700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389406b590 con 0x7f38940af080 2023-03-03T06:24:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f389c498700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389406b870 con 0x7f38940b1f80 2023-03-03T06:24:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f389c498700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389406bb50 con 0x7f38940af450 2023-03-03T06:24:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f389a234700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f38940af080 0x7f38940b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:60952/0 (socket says 172.21.15.5:60952) 2023-03-03T06:24:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f389a234700 1 -- 172.21.15.5:0/996329557 learned_addr learned my addr 172.21.15.5:0/996329557 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f3899a33700 1 --2- 172.21.15.5:0/996329557 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940af450 0x7f38940cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107775682 0 0) 0x7f389406b590 con 0x7f38940af080 2023-03-03T06:24:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38800035b0 con 0x7f38940af080 2023-03-03T06:24:34.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f389aa35700 1 --2- 172.21.15.5:0/996329557 >> v2:172.21.15.191:3300/0 conn(0x7f38940b1f80 0x7f38940cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2440102498 0 0) 0x7f38800035b0 con 0x7f38940af080 2023-03-03T06:24:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940af450 msgr2=0x7f38940cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f3899232700 1 --2- 172.21.15.5:0/996329557 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940af450 0x7f38940cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 >> v2:172.21.15.191:3300/0 conn(0x7f38940b1f80 msgr2=0x7f38940cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.807+0000 7f3899232700 1 --2- 172.21.15.5:0/996329557 >> v2:172.21.15.191:3300/0 conn(0x7f38940b1f80 0x7f38940cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389406be30 con 0x7f38940af080 2023-03-03T06:24:34.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f3890001670 con 0x7f38940af080 2023-03-03T06:24:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 >> v1:172.21.15.5:6789/0 conn(0x7f38940af080 legacy=0x7f38940b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899232700 1 --2- 172.21.15.5:0/996329557 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940af450 0x7f3880003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899232700 1 --2- 172.21.15.5:0/996329557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3880003ff0 0x7f3880004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899232700 1 --2- 172.21.15.5:0/996329557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3880004d90 0x7f3880005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389406b870 con 0x7f3880003ff0 2023-03-03T06:24:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389406bb50 con 0x7f3880004d90 2023-03-03T06:24:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388000ba90 con 0x7f38940af450 2023-03-03T06:24:34.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899a33700 1 --2- 172.21.15.5:0/996329557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3880003ff0 0x7f3880004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f389a234700 1 --2- 172.21.15.5:0/996329557 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940af450 0x7f3880003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f389aa35700 1 --2- 172.21.15.5:0/996329557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3880004d90 0x7f3880005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899a33700 1 -- 172.21.15.5:0/996329557 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940af450 msgr2=0x7f3880003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899a33700 1 --2- 172.21.15.5:0/996329557 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940af450 0x7f3880003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899a33700 1 -- 172.21.15.5:0/996329557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3880004d90 msgr2=0x7f3880005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899a33700 1 --2- 172.21.15.5:0/996329557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3880004d90 0x7f3880005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899a33700 1 -- 172.21.15.5:0/996329557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38800035b0 con 0x7f3880003ff0 2023-03-03T06:24:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f389aa35700 1 --2- 172.21.15.5:0/996329557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3880004d90 0x7f3880005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899a33700 1 --2- 172.21.15.5:0/996329557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3880003ff0 0x7f3880004850 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3884009b30 tx=0x7f3880005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203565c92285eb70 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388400e6c0 con 0x7f3880003ff0 2023-03-03T06:24:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388400e820 con 0x7f3880003ff0 2023-03-03T06:24:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.808+0000 7f3899232700 1 -- 172.21.15.5:0/996329557 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388400eb90 con 0x7f3880003ff0 2023-03-03T06:24:34.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.809+0000 7f389c498700 1 -- 172.21.15.5:0/996329557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3880003ff0 msgr2=0x7f3880004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.809+0000 7f389c498700 1 --2- 172.21.15.5:0/996329557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3880003ff0 0x7f3880004850 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3884009b30 tx=0x7f3880005880 comp rx=0 tx=0).stop 2023-03-03T06:24:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.809+0000 7f389aa35700 1 -- 172.21.15.5:0/996329557 reap_dead start 2023-03-03T06:24:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.809+0000 7f389c498700 1 -- 172.21.15.5:0/996329557 shutdown_connections 2023-03-03T06:24:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.809+0000 7f389c498700 1 -- 172.21.15.5:0/996329557 >> 172.21.15.5:0/996329557 conn(0x7f389406ea70 msgr2=0x7f38940cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.809+0000 7f389c498700 1 -- 172.21.15.5:0/996329557 shutdown_connections 2023-03-03T06:24:34.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.809+0000 7f389c498700 1 -- 172.21.15.5:0/996329557 wait complete. 2023-03-03T06:24:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.810+0000 7f389c498700 1 Processor -- start 2023-03-03T06:24:34.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.810+0000 7f389c498700 1 -- start start 2023-03-03T06:24:34.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.811+0000 7f389c498700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3880003ff0 0x7f38941522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.811+0000 7f389c498700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38940ae4e0 0x7f38941554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.811+0000 7f389c498700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940b3db0 0x7f38940b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.811+0000 7f389c498700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940b3920 con 0x7f38940ae4e0 2023-03-03T06:24:34.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.811+0000 7f389c498700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940b2d50 con 0x7f3880003ff0 2023-03-03T06:24:34.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.811+0000 7f389c498700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38940b2ff0 con 0x7f38940b3db0 2023-03-03T06:24:34.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.811+0000 7f3899a33700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38940ae4e0 0x7f38941554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.811+0000 7f3899a33700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38940ae4e0 0x7f38941554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42892/0 (socket says 172.21.15.5:42892) 2023-03-03T06:24:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.811+0000 7f3899a33700 1 -- 172.21.15.5:0/378470513 learned_addr learned my addr 172.21.15.5:0/378470513 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.811+0000 7f389aa35700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940b3db0 0x7f38940b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.811+0000 7f389a234700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3880003ff0 0x7f38941522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.812+0000 7f3899a33700 1 -- 172.21.15.5:0/378470513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940b3db0 msgr2=0x7f38940b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.812+0000 7f3899a33700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940b3db0 0x7f38940b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.812+0000 7f3899a33700 1 -- 172.21.15.5:0/378470513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3880003ff0 msgr2=0x7f38941522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:34.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.812+0000 7f3899a33700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3880003ff0 0x7f38941522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.812+0000 7f3899a33700 1 -- 172.21.15.5:0/378470513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389406d370 con 0x7f38940ae4e0 2023-03-03T06:24:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.812+0000 7f389aa35700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940b3db0 0x7f38940b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.812+0000 7f389a234700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3880003ff0 0x7f38941522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.812+0000 7f3899a33700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38940ae4e0 0x7f38941554c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f38800047d0 tx=0x7f38840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.812+0000 7f388affd700 1 -- 172.21.15.5:0/378470513 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388400e6c0 con 0x7f38940ae4e0 2023-03-03T06:24:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.812+0000 7f388affd700 1 -- 172.21.15.5:0/378470513 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3884003ab0 con 0x7f38940ae4e0 2023-03-03T06:24:34.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.812+0000 7f389c498700 1 -- 172.21.15.5:0/378470513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389406c110 con 0x7f38940ae4e0 2023-03-03T06:24:34.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.812+0000 7f388affd700 1 -- 172.21.15.5:0/378470513 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884003e60 con 0x7f38940ae4e0 2023-03-03T06:24:34.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.812+0000 7f389c498700 1 -- 172.21.15.5:0/378470513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389406cb70 con 0x7f38940ae4e0 2023-03-03T06:24:34.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.813+0000 7f389c498700 1 -- 172.21.15.5:0/378470513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38940b5ac0 con 0x7f38940ae4e0 2023-03-03T06:24:34.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.813+0000 7f388affd700 1 -- 172.21.15.5:0/378470513 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3884019030 con 0x7f38940ae4e0 2023-03-03T06:24:34.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.814+0000 7f388affd700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38780682f0 0x7f387806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:34.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.814+0000 7f388affd700 1 -- 172.21.15.5:0/378470513 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3884087730 con 0x7f38940ae4e0 2023-03-03T06:24:34.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.814+0000 7f389a234700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38780682f0 0x7f387806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:34.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.814+0000 7f389a234700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38780682f0 0x7f387806a7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3890000fb0 tx=0x7f3890009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:34.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:34.818+0000 7f388affd700 1 -- 172.21.15.5:0/378470513 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3884053b70 con 0x7f38940ae4e0 2023-03-03T06:24:35.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.028+0000 7f389c498700 1 -- 172.21.15.5:0/378470513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f389404e6e0 con 0x7f38940ae4e0 2023-03-03T06:24:35.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.028+0000 7f388affd700 1 -- 172.21.15.5:0/378470513 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3884057190 con 0x7f38940ae4e0 2023-03-03T06:24:35.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.030+0000 7f389c498700 1 -- 172.21.15.5:0/378470513 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38780682f0 msgr2=0x7f387806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:35.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.030+0000 7f389c498700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38780682f0 0x7f387806a7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3890000fb0 tx=0x7f3890009040 comp rx=0 tx=0).stop 2023-03-03T06:24:35.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.030+0000 7f389c498700 1 -- 172.21.15.5:0/378470513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38940ae4e0 msgr2=0x7f38941554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:35.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.030+0000 7f389c498700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38940ae4e0 0x7f38941554c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f38800047d0 tx=0x7f38840047c0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.030+0000 7f389c498700 1 -- 172.21.15.5:0/378470513 shutdown_connections 2023-03-03T06:24:35.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.030+0000 7f389c498700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38780682f0 0x7f387806a7a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.030+0000 7f389c498700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38940b3db0 0x7f38940b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.030+0000 7f389c498700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3880003ff0 0x7f38941522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.030+0000 7f389c498700 1 --2- 172.21.15.5:0/378470513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38940ae4e0 0x7f38941554c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.030+0000 7f389c498700 1 -- 172.21.15.5:0/378470513 >> 172.21.15.5:0/378470513 conn(0x7f389406ea70 msgr2=0x7f38940cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.030+0000 7f389c498700 1 -- 172.21.15.5:0/378470513 shutdown_connections 2023-03-03T06:24:35.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.030+0000 7f389c498700 1 -- 172.21.15.5:0/378470513 wait complete. 2023-03-03T06:24:35.035 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-03-03T06:24:35.044 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-03-03T06:24:35.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:35.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-03-03T06:24:35.082 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-03-03T06:24:35.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:35.083 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-03-03T06:24:35.140 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:24:35.140 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:35.163 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:24:35.164 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:35.222 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:24:35.223 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:24:35.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:35.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.405+0000 7fb240542700 1 Processor -- start 2023-03-03T06:24:35.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.405+0000 7fb240542700 1 -- start start 2023-03-03T06:24:35.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.406+0000 7fb240542700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb23815c980 0x7fb238160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:35.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.406+0000 7fb240542700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb23806d1f0 0x7fb23806b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:35.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.406+0000 7fb240542700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb238160ea0 con 0x7fb23806b860 2023-03-03T06:24:35.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.406+0000 7fb240542700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb238161460 con 0x7fb23806d1f0 2023-03-03T06:24:35.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.406+0000 7fb240542700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb238161180 con 0x7fb23815c980 2023-03-03T06:24:35.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23dadd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb23806d1f0 0x7fb23806b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:35.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23e2de700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb23815c980 0x7fb238160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:35.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23dadd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb23806d1f0 0x7fb23806b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:43258/0 (socket says 172.21.15.5:43258) 2023-03-03T06:24:35.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23eadf700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fb23806b860 0x7fb23806dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:47270/0 (socket says 172.21.15.5:47270) 2023-03-03T06:24:35.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23e2de700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb23815c980 0x7fb238160530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:40976/0 (socket says 172.21.15.5:40976) 2023-03-03T06:24:35.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23dadd700 1 -- 172.21.15.5:0/3480329254 learned_addr learned my addr 172.21.15.5:0/3480329254 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:35.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23dadd700 1 -- 172.21.15.5:0/3480329254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb23815c980 msgr2=0x7fb238160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23dadd700 1 --2- 172.21.15.5:0/3480329254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb23815c980 0x7fb238160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23dadd700 1 -- 172.21.15.5:0/3480329254 >> v1:172.21.15.191:6789/0 conn(0x7fb23806b860 legacy=0x7fb23806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23dadd700 1 -- 172.21.15.5:0/3480329254 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2380ce890 con 0x7fb23806d1f0 2023-03-03T06:24:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23e2de700 1 --2- 172.21.15.5:0/3480329254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb23815c980 0x7fb238160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23dadd700 1 --2- 172.21.15.5:0/3480329254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb23806d1f0 0x7fb23806b320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb2340098f0 tx=0x7fb234009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c18982f54fc690d4 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:35.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23d2dc700 1 -- 172.21.15.5:0/3480329254 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234011830 con 0x7fb23806d1f0 2023-03-03T06:24:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23d2dc700 1 -- 172.21.15.5:0/3480329254 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb234011990 con 0x7fb23806d1f0 2023-03-03T06:24:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.407+0000 7fb23d2dc700 1 -- 172.21.15.5:0/3480329254 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234011d20 con 0x7fb23806d1f0 2023-03-03T06:24:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.408+0000 7fb240542700 1 -- 172.21.15.5:0/3480329254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb23806d1f0 msgr2=0x7fb23806b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.408+0000 7fb240542700 1 --2- 172.21.15.5:0/3480329254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb23806d1f0 0x7fb23806b320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb2340098f0 tx=0x7fb234009c00 comp rx=0 tx=0).stop 2023-03-03T06:24:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.408+0000 7fb240542700 1 -- 172.21.15.5:0/3480329254 shutdown_connections 2023-03-03T06:24:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.408+0000 7fb240542700 1 --2- 172.21.15.5:0/3480329254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb23815c980 0x7fb238160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.408+0000 7fb240542700 1 --2- 172.21.15.5:0/3480329254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb23806d1f0 0x7fb23806b320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.408+0000 7fb240542700 1 -- 172.21.15.5:0/3480329254 >> 172.21.15.5:0/3480329254 conn(0x7fb2380cfd00 msgr2=0x7fb2380d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.408+0000 7fb240542700 1 -- 172.21.15.5:0/3480329254 shutdown_connections 2023-03-03T06:24:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.408+0000 7fb240542700 1 -- 172.21.15.5:0/3480329254 wait complete. 2023-03-03T06:24:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.409+0000 7fb240542700 1 Processor -- start 2023-03-03T06:24:35.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.409+0000 7fb240542700 1 -- start start 2023-03-03T06:24:35.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.410+0000 7fb240542700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb23806b860 0x7fb2381f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:35.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.410+0000 7fb240542700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23806d1f0 0x7fb2380c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:35.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.410+0000 7fb240542700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb23815c980 0x7fb2380c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:35.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.410+0000 7fb240542700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380c5570 con 0x7fb23806d1f0 2023-03-03T06:24:35.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.410+0000 7fb240542700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380c57f0 con 0x7fb23806b860 2023-03-03T06:24:35.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.410+0000 7fb240542700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380aba00 con 0x7fb23815c980 2023-03-03T06:24:35.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.410+0000 7fb23dadd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23806d1f0 0x7fb2380c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:35.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.410+0000 7fb23dadd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23806d1f0 0x7fb2380c6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42904/0 (socket says 172.21.15.5:42904) 2023-03-03T06:24:35.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.410+0000 7fb23dadd700 1 -- 172.21.15.5:0/3822172360 learned_addr learned my addr 172.21.15.5:0/3822172360 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:35.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb23eadf700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb23815c980 0x7fb2380c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:35.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb23e2de700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb23806b860 0x7fb2381f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:35.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb23dadd700 1 -- 172.21.15.5:0/3822172360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb23815c980 msgr2=0x7fb2380c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:35.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb23dadd700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb23815c980 0x7fb2380c5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb23dadd700 1 -- 172.21.15.5:0/3822172360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb23806b860 msgr2=0x7fb2381f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:35.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb23dadd700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb23806b860 0x7fb2381f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb23dadd700 1 -- 172.21.15.5:0/3822172360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280094a0 con 0x7fb23806d1f0 2023-03-03T06:24:35.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb23e2de700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb23806b860 0x7fb2381f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:35.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb23dadd700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23806d1f0 0x7fb2380c6fb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb234000c00 tx=0x7fb234004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:35.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb22effd700 1 -- 172.21.15.5:0/3822172360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234004570 con 0x7fb23806d1f0 2023-03-03T06:24:35.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb22effd700 1 -- 172.21.15.5:0/3822172360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23401f070 con 0x7fb23806d1f0 2023-03-03T06:24:35.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb240542700 1 -- 172.21.15.5:0/3822172360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb234009550 con 0x7fb23806d1f0 2023-03-03T06:24:35.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb22effd700 1 -- 172.21.15.5:0/3822172360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2340038c0 con 0x7fb23806d1f0 2023-03-03T06:24:35.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.411+0000 7fb240542700 1 -- 172.21.15.5:0/3822172360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23815cd50 con 0x7fb23806d1f0 2023-03-03T06:24:35.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.412+0000 7fb240542700 1 -- 172.21.15.5:0/3822172360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2380ceb70 con 0x7fb23806d1f0 2023-03-03T06:24:35.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.413+0000 7fb22effd700 1 -- 172.21.15.5:0/3822172360 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb23402a020 con 0x7fb23806d1f0 2023-03-03T06:24:35.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.413+0000 7fb22effd700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb21c0682f0 0x7fb21c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:35.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.413+0000 7fb22effd700 1 -- 172.21.15.5:0/3822172360 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb2340875d0 con 0x7fb23806d1f0 2023-03-03T06:24:35.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.413+0000 7fb23e2de700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb21c0682f0 0x7fb21c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:35.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.414+0000 7fb23e2de700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb21c0682f0 0x7fb21c06a7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb228009cf0 tx=0x7fb228008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:35.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.417+0000 7fb22effd700 1 -- 172.21.15.5:0/3822172360 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb234053b00 con 0x7fb23806d1f0 2023-03-03T06:24:35.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.612+0000 7fb240542700 1 -- 172.21.15.5:0/3822172360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb238160a70 con 0x7fb23806d1f0 2023-03-03T06:24:35.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.614+0000 7fb22effd700 1 -- 172.21.15.5:0/3822172360 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19641 (secure 0 0 0) 0x7fb234057120 con 0x7fb23806d1f0 2023-03-03T06:24:35.616 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:35.616 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:24:28.893239+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.616+0000 7fb240542700 1 -- 172.21.15.5:0/3822172360 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb21c0682f0 msgr2=0x7fb21c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.616+0000 7fb240542700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb21c0682f0 0x7fb21c06a7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb228009cf0 tx=0x7fb228008040 comp rx=0 tx=0).stop 2023-03-03T06:24:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.616+0000 7fb240542700 1 -- 172.21.15.5:0/3822172360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23806d1f0 msgr2=0x7fb2380c6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.616+0000 7fb240542700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23806d1f0 0x7fb2380c6fb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb234000c00 tx=0x7fb234004750 comp rx=0 tx=0).stop 2023-03-03T06:24:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.616+0000 7fb240542700 1 -- 172.21.15.5:0/3822172360 shutdown_connections 2023-03-03T06:24:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.616+0000 7fb240542700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb21c0682f0 0x7fb21c06a7a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.616+0000 7fb240542700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb23815c980 0x7fb2380c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.616+0000 7fb240542700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb23806b860 0x7fb2381f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.616+0000 7fb240542700 1 --2- 172.21.15.5:0/3822172360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb23806d1f0 0x7fb2380c6fb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.616+0000 7fb240542700 1 -- 172.21.15.5:0/3822172360 >> 172.21.15.5:0/3822172360 conn(0x7fb2380cfd00 msgr2=0x7fb23806dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.616+0000 7fb240542700 1 -- 172.21.15.5:0/3822172360 shutdown_connections 2023-03-03T06:24:35.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.616+0000 7fb240542700 1 -- 172.21.15.5:0/3822172360 wait complete. 2023-03-03T06:24:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:23:38.141777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:23:39.283589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-03T06:23:42.422930+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-03T06:24:35.631 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:24:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.757+0000 7f48e7bfc700 1 Processor -- start 2023-03-03T06:24:35.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.757+0000 7f48e7bfc700 1 -- start start 2023-03-03T06:24:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.758+0000 7f48e7bfc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48e00cd500 0x7f48e015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.758+0000 7f48e7bfc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e00b1fe0 0x7f48e00cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.758+0000 7f48e7bfc700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e00cc5d0 con 0x7f48e00b55b0 2023-03-03T06:24:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.758+0000 7f48e7bfc700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e015e290 con 0x7f48e00cd500 2023-03-03T06:24:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.758+0000 7f48e7bfc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0159c30 con 0x7f48e00b1fe0 2023-03-03T06:24:35.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.758+0000 7f48e5197700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48e00cd500 0x7f48e015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.758+0000 7f48e5197700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48e00cd500 0x7f48e015dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42912/0 (socket says 172.21.15.5:42912) 2023-03-03T06:24:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.758+0000 7f48e5197700 1 -- 172.21.15.5:0/1732327500 learned_addr learned my addr 172.21.15.5:0/1732327500 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.758+0000 7f48e6199700 1 --2- 172.21.15.5:0/1732327500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e00b1fe0 0x7f48e00cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.758+0000 7f48e5197700 1 -- 172.21.15.5:0/1732327500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e00b1fe0 msgr2=0x7f48e00cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.758+0000 7f48e5197700 1 --2- 172.21.15.5:0/1732327500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e00b1fe0 0x7f48e00cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.758+0000 7f48e5197700 1 -- 172.21.15.5:0/1732327500 >> v1:172.21.15.191:6789/0 conn(0x7f48e00b55b0 legacy=0x7f48e00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.758+0000 7f48e5197700 1 -- 172.21.15.5:0/1732327500 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e00b5980 con 0x7f48e00cd500 2023-03-03T06:24:35.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.759+0000 7f48e5197700 1 --2- 172.21.15.5:0/1732327500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e00cd500 0x7f48e015dd50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00bb90 tx=0x7f48dc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52811c1beaee3a0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.759+0000 7f48e4996700 1 -- 172.21.15.5:0/1732327500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc00dd50 con 0x7f48e00cd500 2023-03-03T06:24:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.759+0000 7f48e4996700 1 -- 172.21.15.5:0/1732327500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc010470 con 0x7f48e00cd500 2023-03-03T06:24:35.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.759+0000 7f48e4996700 1 -- 172.21.15.5:0/1732327500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc010800 con 0x7f48e00cd500 2023-03-03T06:24:35.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.759+0000 7f48e7bfc700 1 -- 172.21.15.5:0/1732327500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e00cd500 msgr2=0x7f48e015dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:35.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.759+0000 7f48e7bfc700 1 --2- 172.21.15.5:0/1732327500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e00cd500 0x7f48e015dd50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00bb90 tx=0x7f48dc00bea0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.759+0000 7f48e7bfc700 1 -- 172.21.15.5:0/1732327500 shutdown_connections 2023-03-03T06:24:35.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.759+0000 7f48e7bfc700 1 --2- 172.21.15.5:0/1732327500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e00b1fe0 0x7f48e00cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.759+0000 7f48e7bfc700 1 --2- 172.21.15.5:0/1732327500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e00cd500 0x7f48e015dd50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.759+0000 7f48e7bfc700 1 -- 172.21.15.5:0/1732327500 >> 172.21.15.5:0/1732327500 conn(0x7f48e00cc8d0 msgr2=0x7f48e00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.760+0000 7f48e7bfc700 1 -- 172.21.15.5:0/1732327500 shutdown_connections 2023-03-03T06:24:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.760+0000 7f48e7bfc700 1 -- 172.21.15.5:0/1732327500 wait complete. 2023-03-03T06:24:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.761+0000 7f48e7bfc700 1 Processor -- start 2023-03-03T06:24:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.761+0000 7f48e7bfc700 1 -- start start 2023-03-03T06:24:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.761+0000 7f48e7bfc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48e00b1fe0 0x7f48e0150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:35.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e7bfc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e00b55b0 0x7f48e0154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e7bfc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e00cd500 0x7f48e014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e7bfc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e01550e0 con 0x7f48e00cd500 2023-03-03T06:24:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e7bfc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0155b40 con 0x7f48e00b1fe0 2023-03-03T06:24:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e7bfc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e014fbb0 con 0x7f48e00b55b0 2023-03-03T06:24:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e6199700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e00cd500 0x7f48e014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e6199700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e00cd500 0x7f48e014f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42920/0 (socket says 172.21.15.5:42920) 2023-03-03T06:24:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e6199700 1 -- 172.21.15.5:0/587563945 learned_addr learned my addr 172.21.15.5:0/587563945 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:35.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e6199700 1 -- 172.21.15.5:0/587563945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e00b55b0 msgr2=0x7f48e0154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e6199700 1 --2- 172.21.15.5:0/587563945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e00b55b0 0x7f48e0154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e6199700 1 -- 172.21.15.5:0/587563945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48e00b1fe0 msgr2=0x7f48e0150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e5998700 1 --2- 172.21.15.5:0/587563945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48e00b1fe0 0x7f48e0150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e6199700 1 --2- 172.21.15.5:0/587563945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48e00b1fe0 0x7f48e0150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e6199700 1 -- 172.21.15.5:0/587563945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc00b7f0 con 0x7f48e00cd500 2023-03-03T06:24:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e6199700 1 --2- 172.21.15.5:0/587563945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e00cd500 0x7f48e014f670 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f48d8007de0 tx=0x7f48d800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48d67fc700 1 -- 172.21.15.5:0/587563945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d800ede0 con 0x7f48e00cd500 2023-03-03T06:24:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48d67fc700 1 -- 172.21.15.5:0/587563945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d8014420 con 0x7f48e00cd500 2023-03-03T06:24:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e7bfc700 1 -- 172.21.15.5:0/587563945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e00cbca0 con 0x7f48e00cd500 2023-03-03T06:24:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48d67fc700 1 -- 172.21.15.5:0/587563945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80147d0 con 0x7f48e00cd500 2023-03-03T06:24:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.762+0000 7f48e7bfc700 1 -- 172.21.15.5:0/587563945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e00cb9c0 con 0x7f48e00cd500 2023-03-03T06:24:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.763+0000 7f48e7bfc700 1 -- 172.21.15.5:0/587563945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e00cbf80 con 0x7f48e00cd500 2023-03-03T06:24:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.764+0000 7f48d67fc700 1 -- 172.21.15.5:0/587563945 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f48d8012050 con 0x7f48e00cd500 2023-03-03T06:24:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.764+0000 7f48d67fc700 1 --2- 172.21.15.5:0/587563945 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f48c40682f0 0x7f48c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.764+0000 7f48d67fc700 1 -- 172.21.15.5:0/587563945 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f48d8086630 con 0x7f48e00cd500 2023-03-03T06:24:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.764+0000 7f48e5998700 1 --2- 172.21.15.5:0/587563945 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f48c40682f0 0x7f48c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.765+0000 7f48e5998700 1 --2- 172.21.15.5:0/587563945 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f48c40682f0 0x7f48c406a7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f48d0007fd0 tx=0x7f48d0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:35.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.768+0000 7f48d67fc700 1 -- 172.21.15.5:0/587563945 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f48d8052b00 con 0x7f48e00cd500 2023-03-03T06:24:35.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.964+0000 7f48e7bfc700 1 -- 172.21.15.5:0/587563945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f48e004e6e0 con 0x7f48e00cd500 2023-03-03T06:24:35.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.964+0000 7f48d67fc700 1 -- 172.21.15.5:0/587563945 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f48d8056120 con 0x7f48e00cd500 2023-03-03T06:24:35.967 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:24:35.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.966+0000 7f48e7bfc700 1 -- 172.21.15.5:0/587563945 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f48c40682f0 msgr2=0x7f48c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:35.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.966+0000 7f48e7bfc700 1 --2- 172.21.15.5:0/587563945 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f48c40682f0 0x7f48c406a7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f48d0007fd0 tx=0x7f48d0009040 comp rx=0 tx=0).stop 2023-03-03T06:24:35.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.966+0000 7f48e7bfc700 1 -- 172.21.15.5:0/587563945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e00cd500 msgr2=0x7f48e014f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:35.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.966+0000 7f48e7bfc700 1 --2- 172.21.15.5:0/587563945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e00cd500 0x7f48e014f670 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f48d8007de0 tx=0x7f48d800e3c0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.966+0000 7f48e7bfc700 1 -- 172.21.15.5:0/587563945 shutdown_connections 2023-03-03T06:24:35.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.966+0000 7f48e7bfc700 1 --2- 172.21.15.5:0/587563945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48e00cd500 0x7f48e014f670 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.966+0000 7f48e7bfc700 1 --2- 172.21.15.5:0/587563945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48e00b1fe0 0x7f48e0150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.966+0000 7f48e7bfc700 1 --2- 172.21.15.5:0/587563945 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f48c40682f0 0x7f48c406a7a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.966+0000 7f48e7bfc700 1 --2- 172.21.15.5:0/587563945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48e00b55b0 0x7f48e0154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:35.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.966+0000 7f48e7bfc700 1 -- 172.21.15.5:0/587563945 >> 172.21.15.5:0/587563945 conn(0x7f48e00cc8d0 msgr2=0x7f48e00cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:35.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.966+0000 7f48e7bfc700 1 -- 172.21.15.5:0/587563945 shutdown_connections 2023-03-03T06:24:35.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:35.966+0000 7f48e7bfc700 1 -- 172.21.15.5:0/587563945 wait complete. 2023-03-03T06:24:35.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:24:36.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.106+0000 7ff6aed6d700 1 Processor -- start 2023-03-03T06:24:36.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.106+0000 7ff6aed6d700 1 -- start start 2023-03-03T06:24:36.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6aed6d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6a815c950 0x7ff6a8160da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6aed6d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff6a80cb420 0x7ff6a80cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6aed6d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6a815d4b0 0x7ff6a815d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6aed6d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a815d020 con 0x7ff6a815c950 2023-03-03T06:24:36.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6aed6d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a815cd20 con 0x7ff6a80cb420 2023-03-03T06:24:36.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6aed6d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a81612e0 con 0x7ff6a815d4b0 2023-03-03T06:24:36.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6acb09700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6a815c950 0x7ff6a8160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6acb09700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff6a815c950 0x7ff6a8160da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42924/0 (socket says 172.21.15.5:42924) 2023-03-03T06:24:36.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6acb09700 1 -- 172.21.15.5:0/2688897233 learned_addr learned my addr 172.21.15.5:0/2688897233 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:36.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6a7fff700 1 --2- 172.21.15.5:0/2688897233 >> v2:172.21.15.191:3300/0 conn(0x7ff6a80cb420 0x7ff6a80cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6acb09700 1 -- 172.21.15.5:0/2688897233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6a815d4b0 msgr2=0x7ff6a815d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:36.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6ad30a700 1 --2- 172.21.15.5:0/2688897233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6a815d4b0 0x7ff6a815d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6acb09700 1 --2- 172.21.15.5:0/2688897233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6a815d4b0 0x7ff6a815d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6acb09700 1 -- 172.21.15.5:0/2688897233 >> v2:172.21.15.191:3300/0 conn(0x7ff6a80cb420 msgr2=0x7ff6a80cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:36.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6acb09700 1 --2- 172.21.15.5:0/2688897233 >> v2:172.21.15.191:3300/0 conn(0x7ff6a80cb420 0x7ff6a80cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6acb09700 1 -- 172.21.15.5:0/2688897233 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a80b2bf0 con 0x7ff6a815c950 2023-03-03T06:24:36.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6a7fff700 1 --2- 172.21.15.5:0/2688897233 >> v2:172.21.15.191:3300/0 conn(0x7ff6a80cb420 0x7ff6a80cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:36.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.107+0000 7ff6ad30a700 1 --2- 172.21.15.5:0/2688897233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6a815d4b0 0x7ff6a815d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:36.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.108+0000 7ff6acb09700 1 --2- 172.21.15.5:0/2688897233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a815c950 0x7ff6a8160da0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8068620 tx=0x7ff69c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49554eb1da1935a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:36.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.108+0000 7ff6a77fe700 1 -- 172.21.15.5:0/2688897233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00b870 con 0x7ff6a815c950 2023-03-03T06:24:36.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.108+0000 7ff6a77fe700 1 -- 172.21.15.5:0/2688897233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c00b9d0 con 0x7ff6a815c950 2023-03-03T06:24:36.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.108+0000 7ff6a77fe700 1 -- 172.21.15.5:0/2688897233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00bd60 con 0x7ff6a815c950 2023-03-03T06:24:36.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.108+0000 7ff6aed6d700 1 -- 172.21.15.5:0/2688897233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a815c950 msgr2=0x7ff6a8160da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.108+0000 7ff6aed6d700 1 --2- 172.21.15.5:0/2688897233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a815c950 0x7ff6a8160da0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8068620 tx=0x7ff69c009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.108+0000 7ff6aed6d700 1 -- 172.21.15.5:0/2688897233 shutdown_connections 2023-03-03T06:24:36.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.108+0000 7ff6aed6d700 1 --2- 172.21.15.5:0/2688897233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6a815d4b0 0x7ff6a815d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.108+0000 7ff6aed6d700 1 --2- 172.21.15.5:0/2688897233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a815c950 0x7ff6a8160da0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.108+0000 7ff6aed6d700 1 --2- 172.21.15.5:0/2688897233 >> v2:172.21.15.191:3300/0 conn(0x7ff6a80cb420 0x7ff6a80cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.108+0000 7ff6aed6d700 1 -- 172.21.15.5:0/2688897233 >> 172.21.15.5:0/2688897233 conn(0x7ff6a8070010 msgr2=0x7ff6a80cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:36.115 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.108+0000 7ff6aed6d700 1 -- 172.21.15.5:0/2688897233 shutdown_connections 2023-03-03T06:24:36.116 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.108+0000 7ff6aed6d700 1 -- 172.21.15.5:0/2688897233 wait complete. 2023-03-03T06:24:36.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.110+0000 7ff6aed6d700 1 Processor -- start 2023-03-03T06:24:36.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.110+0000 7ff6aed6d700 1 -- start start 2023-03-03T06:24:36.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6aed6d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6a80cb420 0x7ff6a81f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6aed6d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a815c950 0x7ff6a81f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.118 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6aed6d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6a815d4b0 0x7ff6a80d0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6aed6d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a81f67b0 con 0x7ff6a815c950 2023-03-03T06:24:36.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6aed6d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80c97b0 con 0x7ff6a815d4b0 2023-03-03T06:24:36.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6aed6d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80c9a90 con 0x7ff6a80cb420 2023-03-03T06:24:36.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6a7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a815c950 0x7ff6a81f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6a7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a815c950 0x7ff6a81f51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42932/0 (socket says 172.21.15.5:42932) 2023-03-03T06:24:36.119 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6a7fff700 1 -- 172.21.15.5:0/3246616937 learned_addr learned my addr 172.21.15.5:0/3246616937 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:36.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6ad30a700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6a815d4b0 0x7ff6a80d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6acb09700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6a80cb420 0x7ff6a81f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6a7fff700 1 -- 172.21.15.5:0/3246616937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6a80cb420 msgr2=0x7ff6a81f3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6a7fff700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6a80cb420 0x7ff6a81f3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.120 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6a7fff700 1 -- 172.21.15.5:0/3246616937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6a815d4b0 msgr2=0x7ff6a80d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6a7fff700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6a815d4b0 0x7ff6a80d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6a7fff700 1 -- 172.21.15.5:0/3246616937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c009550 con 0x7ff6a815c950 2023-03-03T06:24:36.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6a7fff700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a815c950 0x7ff6a81f51c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff69400c750 tx=0x7ff69400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:36.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6a57fa700 1 -- 172.21.15.5:0/3246616937 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694011800 con 0x7ff6a815c950 2023-03-03T06:24:36.121 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6a57fa700 1 -- 172.21.15.5:0/3246616937 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff694011960 con 0x7ff6a815c950 2023-03-03T06:24:36.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6aed6d700 1 -- 172.21.15.5:0/3246616937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a80b31b0 con 0x7ff6a815c950 2023-03-03T06:24:36.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6a57fa700 1 -- 172.21.15.5:0/3246616937 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694011cd0 con 0x7ff6a815c950 2023-03-03T06:24:36.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.111+0000 7ff6aed6d700 1 -- 172.21.15.5:0/3246616937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a80b2ed0 con 0x7ff6a815c950 2023-03-03T06:24:36.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.112+0000 7ff6aed6d700 1 -- 172.21.15.5:0/3246616937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a80b0520 con 0x7ff6a815c950 2023-03-03T06:24:36.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.113+0000 7ff6a57fa700 1 -- 172.21.15.5:0/3246616937 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff694020070 con 0x7ff6a815c950 2023-03-03T06:24:36.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.113+0000 7ff6a57fa700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff68c0682f0 0x7ff68c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.114+0000 7ff6acb09700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff68c0682f0 0x7ff68c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.114+0000 7ff6a57fa700 1 -- 172.21.15.5:0/3246616937 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff694085f30 con 0x7ff6a815c950 2023-03-03T06:24:36.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.114+0000 7ff6acb09700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff68c0682f0 0x7ff68c06a7a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff69c000c00 tx=0x7ff69c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:36.123 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.118+0000 7ff6a57fa700 1 -- 172.21.15.5:0/3246616937 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff694052370 con 0x7ff6a815c950 2023-03-03T06:24:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.309+0000 7ff6aed6d700 1 -- 172.21.15.5:0/3246616937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6a80c9f50 con 0x7ff6a815c950 2023-03-03T06:24:36.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.309+0000 7ff6a57fa700 1 -- 172.21.15.5:0/3246616937 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff694055990 con 0x7ff6a815c950 2023-03-03T06:24:36.312 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:24:36.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.311+0000 7ff6aed6d700 1 -- 172.21.15.5:0/3246616937 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff68c0682f0 msgr2=0x7ff68c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.311+0000 7ff6aed6d700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff68c0682f0 0x7ff68c06a7a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff69c000c00 tx=0x7ff69c008030 comp rx=0 tx=0).stop 2023-03-03T06:24:36.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.311+0000 7ff6aed6d700 1 -- 172.21.15.5:0/3246616937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a815c950 msgr2=0x7ff6a81f51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.311+0000 7ff6aed6d700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a815c950 0x7ff6a81f51c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff69400c750 tx=0x7ff69400cb10 comp rx=0 tx=0).stop 2023-03-03T06:24:36.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.311+0000 7ff6aed6d700 1 -- 172.21.15.5:0/3246616937 shutdown_connections 2023-03-03T06:24:36.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.311+0000 7ff6aed6d700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6a815d4b0 0x7ff6a80d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.311+0000 7ff6aed6d700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff68c0682f0 0x7ff68c06a7a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.311+0000 7ff6aed6d700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff6a80cb420 0x7ff6a81f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.311+0000 7ff6aed6d700 1 --2- 172.21.15.5:0/3246616937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6a815c950 0x7ff6a81f51c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.311+0000 7ff6aed6d700 1 -- 172.21.15.5:0/3246616937 >> 172.21.15.5:0/3246616937 conn(0x7ff6a8070010 msgr2=0x7ff6a80b1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:36.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.312+0000 7ff6aed6d700 1 -- 172.21.15.5:0/3246616937 shutdown_connections 2023-03-03T06:24:36.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.312+0000 7ff6aed6d700 1 -- 172.21.15.5:0/3246616937 wait complete. 2023-03-03T06:24:36.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:24:36.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.453+0000 7f0b32f19700 1 Processor -- start 2023-03-03T06:24:36.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.453+0000 7f0b32f19700 1 -- start start 2023-03-03T06:24:36.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.454+0000 7f0b32f19700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b2c0cf3f0 0x7f0b2c0cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.454+0000 7f0b32f19700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b2c0cf7c0 0x7f0b2c15dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.454+0000 7f0b32f19700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b2c0cc370 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.454+0000 7f0b32f19700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2c15e2b0 con 0x7f0b2c0cf3f0 2023-03-03T06:24:36.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.454+0000 7f0b32f19700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c0cb760 con 0x7f0b2c0cf7c0 2023-03-03T06:24:36.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.454+0000 7f0b30cb5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b2c0cf3f0 0x7f0b2c0cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.454+0000 7f0b30cb5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0b2c0cf3f0 0x7f0b2c0cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42938/0 (socket says 172.21.15.5:42938) 2023-03-03T06:24:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.454+0000 7f0b30cb5700 1 -- 172.21.15.5:0/1840774038 learned_addr learned my addr 172.21.15.5:0/1840774038 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.455+0000 7f0b2bfff700 1 --2- 172.21.15.5:0/1840774038 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b2c0cf7c0 0x7f0b2c15dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.455+0000 7f0b30cb5700 1 -- 172.21.15.5:0/1840774038 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b2c0cf7c0 msgr2=0x7f0b2c15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:36.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.455+0000 7f0b30cb5700 1 --2- 172.21.15.5:0/1840774038 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b2c0cf7c0 0x7f0b2c15dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.455+0000 7f0b30cb5700 1 -- 172.21.15.5:0/1840774038 >> v1:172.21.15.191:6789/0 conn(0x7f0b2c0b18d0 legacy=0x7f0b2c06bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.455+0000 7f0b30cb5700 1 -- 172.21.15.5:0/1840774038 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c0cba40 con 0x7f0b2c0cf3f0 2023-03-03T06:24:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.455+0000 7f0b30cb5700 1 --2- 172.21.15.5:0/1840774038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0cf3f0 0x7f0b2c0cd450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0b200098f0 tx=0x7f0b20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a842fa4ee975819f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:36.461 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.455+0000 7f0b2b7fe700 1 -- 172.21.15.5:0/1840774038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b20004230 con 0x7f0b2c0cf3f0 2023-03-03T06:24:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.455+0000 7f0b2b7fe700 1 -- 172.21.15.5:0/1840774038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b20004390 con 0x7f0b2c0cf3f0 2023-03-03T06:24:36.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.455+0000 7f0b2b7fe700 1 -- 172.21.15.5:0/1840774038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b200036a0 con 0x7f0b2c0cf3f0 2023-03-03T06:24:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.456+0000 7f0b32f19700 1 -- 172.21.15.5:0/1840774038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0cf3f0 msgr2=0x7f0b2c0cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.456+0000 7f0b32f19700 1 --2- 172.21.15.5:0/1840774038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0cf3f0 0x7f0b2c0cd450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0b200098f0 tx=0x7f0b20009c00 comp rx=0 tx=0).stop 2023-03-03T06:24:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.456+0000 7f0b32f19700 1 -- 172.21.15.5:0/1840774038 shutdown_connections 2023-03-03T06:24:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.456+0000 7f0b32f19700 1 --2- 172.21.15.5:0/1840774038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0cf3f0 0x7f0b2c0cd450 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.456+0000 7f0b32f19700 1 --2- 172.21.15.5:0/1840774038 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b2c0cf7c0 0x7f0b2c15dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.456+0000 7f0b32f19700 1 -- 172.21.15.5:0/1840774038 >> 172.21.15.5:0/1840774038 conn(0x7f0b2c0cc8d0 msgr2=0x7f0b2c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.456+0000 7f0b32f19700 1 -- 172.21.15.5:0/1840774038 shutdown_connections 2023-03-03T06:24:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.456+0000 7f0b32f19700 1 -- 172.21.15.5:0/1840774038 wait complete. 2023-03-03T06:24:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.457+0000 7f0b32f19700 1 Processor -- start 2023-03-03T06:24:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.457+0000 7f0b32f19700 1 -- start start 2023-03-03T06:24:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b32f19700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b18d0 0x7f0b2c159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b32f19700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b2c0cf3f0 0x7f0b2c1507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b32f19700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b2c0cf7c0 0x7f0b2c0c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b32f19700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c0c49e0 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b32f19700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c0c6400 con 0x7f0b2c0cf3f0 2023-03-03T06:24:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b32f19700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2c0c66e0 con 0x7f0b2c0cf7c0 2023-03-03T06:24:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b30cb5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b18d0 0x7f0b2c159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b30cb5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b18d0 0x7f0b2c159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42944/0 (socket says 172.21.15.5:42944) 2023-03-03T06:24:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b30cb5700 1 -- 172.21.15.5:0/3874976138 learned_addr learned my addr 172.21.15.5:0/3874976138 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:36.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b2bfff700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b2c0cf3f0 0x7f0b2c1507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b314b6700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b2c0cf7c0 0x7f0b2c0c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b30cb5700 1 -- 172.21.15.5:0/3874976138 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b2c0cf7c0 msgr2=0x7f0b2c0c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b30cb5700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b2c0cf7c0 0x7f0b2c0c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b30cb5700 1 -- 172.21.15.5:0/3874976138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b2c0cf3f0 msgr2=0x7f0b2c1507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b30cb5700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b2c0cf3f0 0x7f0b2c1507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b30cb5700 1 -- 172.21.15.5:0/3874976138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b20009550 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b314b6700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b2c0cf7c0 0x7f0b2c0c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b30cb5700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b18d0 0x7f0b2c159e00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c071010 tx=0x7f0b20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.458+0000 7f0b297fa700 1 -- 172.21.15.5:0/3874976138 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b20003e70 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.459+0000 7f0b297fa700 1 -- 172.21.15.5:0/3874976138 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2001f070 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.459+0000 7f0b32f19700 1 -- 172.21.15.5:0/3874976138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b2c0cc000 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.459+0000 7f0b297fa700 1 -- 172.21.15.5:0/3874976138 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2000b8a0 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.459+0000 7f0b32f19700 1 -- 172.21.15.5:0/3874976138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2c0cbd20 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.460+0000 7f0b32f19700 1 -- 172.21.15.5:0/3874976138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2c0ced60 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.460+0000 7f0b297fa700 1 -- 172.21.15.5:0/3874976138 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0b2002a020 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.461+0000 7f0b297fa700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0b100682f0 0x7f0b1006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.461+0000 7f0b2bfff700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0b100682f0 0x7f0b1006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.461+0000 7f0b297fa700 1 -- 172.21.15.5:0/3874976138 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0b200879a0 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.461+0000 7f0b2bfff700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0b100682f0 0x7f0b1006a7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800a950 tx=0x7f0b18008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:36.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.465+0000 7f0b297fa700 1 -- 172.21.15.5:0/3874976138 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0b20053ed0 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.659+0000 7f0b32f19700 1 -- 172.21.15.5:0/3874976138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b2c0ced60 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.659+0000 7f0b297fa700 1 -- 172.21.15.5:0/3874976138 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b20085e60 con 0x7f0b2c0b18d0 2023-03-03T06:24:36.662 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.662+0000 7f0b32f19700 1 -- 172.21.15.5:0/3874976138 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0b100682f0 msgr2=0x7f0b1006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.662+0000 7f0b32f19700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0b100682f0 0x7f0b1006a7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800a950 tx=0x7f0b18008040 comp rx=0 tx=0).stop 2023-03-03T06:24:36.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.662+0000 7f0b32f19700 1 -- 172.21.15.5:0/3874976138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b18d0 msgr2=0x7f0b2c159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.662+0000 7f0b32f19700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b18d0 0x7f0b2c159e00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c071010 tx=0x7f0b20004750 comp rx=0 tx=0).stop 2023-03-03T06:24:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.662+0000 7f0b32f19700 1 -- 172.21.15.5:0/3874976138 shutdown_connections 2023-03-03T06:24:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.662+0000 7f0b32f19700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0b100682f0 0x7f0b1006a7a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.662+0000 7f0b32f19700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0b2c0cf7c0 0x7f0b2c0c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.662+0000 7f0b32f19700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b2c0b18d0 0x7f0b2c159e00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.662+0000 7f0b32f19700 1 --2- 172.21.15.5:0/3874976138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b2c0cf3f0 0x7f0b2c1507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.662+0000 7f0b32f19700 1 -- 172.21.15.5:0/3874976138 >> 172.21.15.5:0/3874976138 conn(0x7f0b2c0cc8d0 msgr2=0x7f0b2c06abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:36.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.662+0000 7f0b32f19700 1 -- 172.21.15.5:0/3874976138 shutdown_connections 2023-03-03T06:24:36.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.662+0000 7f0b32f19700 1 -- 172.21.15.5:0/3874976138 wait complete. 2023-03-03T06:24:36.676 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:24:36.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.802+0000 7ffad3f3a700 1 Processor -- start 2023-03-03T06:24:36.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.802+0000 7ffad3f3a700 1 -- start start 2023-03-03T06:24:36.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.803+0000 7ffad3f3a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffacc0cd3e0 0x7ffacc0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.803+0000 7ffad3f3a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ffacc0b1fe0 0x7ffacc0ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.803+0000 7ffad3f3a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc15e160 con 0x7ffacc15cd40 2023-03-03T06:24:36.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.803+0000 7ffad3f3a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0cd870 con 0x7ffacc0cd3e0 2023-03-03T06:24:36.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.803+0000 7ffad3f3a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc15d110 con 0x7ffacc0b1fe0 2023-03-03T06:24:36.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.803+0000 7ffad14d5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffacc0cd3e0 0x7ffacc0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.803+0000 7ffad14d5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ffacc0cd3e0 0x7ffacc0cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42954/0 (socket says 172.21.15.5:42954) 2023-03-03T06:24:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.803+0000 7ffad14d5700 1 -- 172.21.15.5:0/2669402434 learned_addr learned my addr 172.21.15.5:0/2669402434 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.803+0000 7ffad24d7700 1 --2- 172.21.15.5:0/2669402434 >> v2:172.21.15.191:3300/0 conn(0x7ffacc0b1fe0 0x7ffacc0ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.803+0000 7ffad14d5700 1 -- 172.21.15.5:0/2669402434 >> v2:172.21.15.191:3300/0 conn(0x7ffacc0b1fe0 msgr2=0x7ffacc0ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.803+0000 7ffad14d5700 1 --2- 172.21.15.5:0/2669402434 >> v2:172.21.15.191:3300/0 conn(0x7ffacc0b1fe0 0x7ffacc0ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.803+0000 7ffad14d5700 1 -- 172.21.15.5:0/2669402434 >> v1:172.21.15.191:6789/0 conn(0x7ffacc15cd40 legacy=0x7ffacc0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.803+0000 7ffad14d5700 1 -- 172.21.15.5:0/2669402434 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc15d3c0 con 0x7ffacc0cd3e0 2023-03-03T06:24:36.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.804+0000 7ffad14d5700 1 --2- 172.21.15.5:0/2669402434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffacc0cd3e0 0x7ffacc0cdd50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffacc068620 tx=0x7ffac8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb1793d5258e8ee server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.804+0000 7ffad0cd4700 1 -- 172.21.15.5:0/2669402434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac800b870 con 0x7ffacc0cd3e0 2023-03-03T06:24:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.804+0000 7ffad0cd4700 1 -- 172.21.15.5:0/2669402434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac800b9d0 con 0x7ffacc0cd3e0 2023-03-03T06:24:36.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.804+0000 7ffad0cd4700 1 -- 172.21.15.5:0/2669402434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac800bd60 con 0x7ffacc0cd3e0 2023-03-03T06:24:36.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.804+0000 7ffad3f3a700 1 -- 172.21.15.5:0/2669402434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffacc0cd3e0 msgr2=0x7ffacc0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.804+0000 7ffad3f3a700 1 --2- 172.21.15.5:0/2669402434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffacc0cd3e0 0x7ffacc0cdd50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffacc068620 tx=0x7ffac8009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.804+0000 7ffad3f3a700 1 -- 172.21.15.5:0/2669402434 shutdown_connections 2023-03-03T06:24:36.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.804+0000 7ffad3f3a700 1 --2- 172.21.15.5:0/2669402434 >> v2:172.21.15.191:3300/0 conn(0x7ffacc0b1fe0 0x7ffacc0ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.804+0000 7ffad3f3a700 1 --2- 172.21.15.5:0/2669402434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffacc0cd3e0 0x7ffacc0cdd50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.804+0000 7ffad3f3a700 1 -- 172.21.15.5:0/2669402434 >> 172.21.15.5:0/2669402434 conn(0x7ffacc0cc8d0 msgr2=0x7ffacc0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.804+0000 7ffad3f3a700 1 -- 172.21.15.5:0/2669402434 shutdown_connections 2023-03-03T06:24:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.805+0000 7ffad3f3a700 1 -- 172.21.15.5:0/2669402434 wait complete. 2023-03-03T06:24:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.806+0000 7ffad3f3a700 1 Processor -- start 2023-03-03T06:24:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.806+0000 7ffad3f3a700 1 -- start start 2023-03-03T06:24:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.806+0000 7ffad3f3a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffacc0b1fe0 0x7ffacc0c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.806+0000 7ffad3f3a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffacc0cd3e0 0x7ffacc0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.806+0000 7ffad3f3a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffacc15cd40 0x7ffacc0c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.806+0000 7ffad3f3a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0c6860 con 0x7ffacc15cd40 2023-03-03T06:24:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.806+0000 7ffad3f3a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0c57c0 con 0x7ffacc0b1fe0 2023-03-03T06:24:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.806+0000 7ffad3f3a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0c44c0 con 0x7ffacc0cd3e0 2023-03-03T06:24:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffad24d7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffacc15cd40 0x7ffacc0c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffad24d7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffacc15cd40 0x7ffacc0c5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42962/0 (socket says 172.21.15.5:42962) 2023-03-03T06:24:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffad24d7700 1 -- 172.21.15.5:0/1882690523 learned_addr learned my addr 172.21.15.5:0/1882690523 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffad14d5700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffacc0cd3e0 0x7ffacc0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffad1cd6700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffacc0b1fe0 0x7ffacc0c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffad24d7700 1 -- 172.21.15.5:0/1882690523 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffacc0cd3e0 msgr2=0x7ffacc0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffad24d7700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffacc0cd3e0 0x7ffacc0c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffad24d7700 1 -- 172.21.15.5:0/1882690523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffacc0b1fe0 msgr2=0x7ffacc0c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:36.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffad24d7700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffacc0b1fe0 0x7ffacc0c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:36.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffad24d7700 1 -- 172.21.15.5:0/1882690523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac8009550 con 0x7ffacc15cd40 2023-03-03T06:24:36.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffad24d7700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffacc15cd40 0x7ffacc0c5280 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffac4007e40 tx=0x7ffac400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:36.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffac27fc700 1 -- 172.21.15.5:0/1882690523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400ed30 con 0x7ffacc15cd40 2023-03-03T06:24:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffac27fc700 1 -- 172.21.15.5:0/1882690523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac4014420 con 0x7ffacc15cd40 2023-03-03T06:24:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffad3f3a700 1 -- 172.21.15.5:0/1882690523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc15d980 con 0x7ffacc15cd40 2023-03-03T06:24:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffac27fc700 1 -- 172.21.15.5:0/1882690523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac40147d0 con 0x7ffacc15cd40 2023-03-03T06:24:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.807+0000 7ffad3f3a700 1 -- 172.21.15.5:0/1882690523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc15d6a0 con 0x7ffacc15cd40 2023-03-03T06:24:36.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.808+0000 7ffad3f3a700 1 -- 172.21.15.5:0/1882690523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc15dc60 con 0x7ffacc15cd40 2023-03-03T06:24:36.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.809+0000 7ffac27fc700 1 -- 172.21.15.5:0/1882690523 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ffac4012050 con 0x7ffacc15cd40 2023-03-03T06:24:36.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.809+0000 7ffac27fc700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffab00682f0 0x7ffab006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:36.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.809+0000 7ffac27fc700 1 -- 172.21.15.5:0/1882690523 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffac4086540 con 0x7ffacc15cd40 2023-03-03T06:24:36.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.809+0000 7ffad1cd6700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffab00682f0 0x7ffab006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:36.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.810+0000 7ffad1cd6700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffab00682f0 0x7ffab006a7a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffacc160320 tx=0x7ffabc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:36.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:36.813+0000 7ffac27fc700 1 -- 172.21.15.5:0/1882690523 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ffac4052a70 con 0x7ffacc15cd40 2023-03-03T06:24:37.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.005+0000 7ffad3f3a700 1 -- 172.21.15.5:0/1882690523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffacc04e6e0 con 0x7ffacc15cd40 2023-03-03T06:24:37.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.006+0000 7ffac27fc700 1 -- 172.21.15.5:0/1882690523 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffac4056090 con 0x7ffacc15cd40 2023-03-03T06:24:37.008 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:24:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.007+0000 7ffad3f3a700 1 -- 172.21.15.5:0/1882690523 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffab00682f0 msgr2=0x7ffab006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.007+0000 7ffad3f3a700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffab00682f0 0x7ffab006a7a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffacc160320 tx=0x7ffabc009040 comp rx=0 tx=0).stop 2023-03-03T06:24:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.007+0000 7ffad3f3a700 1 -- 172.21.15.5:0/1882690523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffacc15cd40 msgr2=0x7ffacc0c5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.007+0000 7ffad3f3a700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffacc15cd40 0x7ffacc0c5280 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffac4007e40 tx=0x7ffac400e3c0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.007+0000 7ffad3f3a700 1 -- 172.21.15.5:0/1882690523 shutdown_connections 2023-03-03T06:24:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.007+0000 7ffad3f3a700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffacc15cd40 0x7ffacc0c5280 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.007+0000 7ffad3f3a700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffacc0b1fe0 0x7ffacc0c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.007+0000 7ffad3f3a700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffab00682f0 0x7ffab006a7a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.007+0000 7ffad3f3a700 1 --2- 172.21.15.5:0/1882690523 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffacc0cd3e0 0x7ffacc0c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.008+0000 7ffad3f3a700 1 -- 172.21.15.5:0/1882690523 >> 172.21.15.5:0/1882690523 conn(0x7ffacc0cc8d0 msgr2=0x7ffacc0cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:37.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.008+0000 7ffad3f3a700 1 -- 172.21.15.5:0/1882690523 shutdown_connections 2023-03-03T06:24:37.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.008+0000 7ffad3f3a700 1 -- 172.21.15.5:0/1882690523 wait complete. 2023-03-03T06:24:37.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-03T06:24:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.147+0000 7fc68a6d3700 1 Processor -- start 2023-03-03T06:24:37.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.147+0000 7fc68a6d3700 1 -- start start 2023-03-03T06:24:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.148+0000 7fc68a6d3700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc684071bd0 0x7fc6840cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.148+0000 7fc68a6d3700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6840cab30 con 0x7fc6840cb410 2023-03-03T06:24:37.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.148+0000 7fc68a6d3700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68406bda0 con 0x7fc684159660 2023-03-03T06:24:37.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.148+0000 7fc68a6d3700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6840cb8c0 con 0x7fc684071bd0 2023-03-03T06:24:37.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.148+0000 7fc6837fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc6840cb410 0x7fc6840714c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32810/0 (socket says 172.21.15.5:32810) 2023-03-03T06:24:37.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.148+0000 7fc6837fe700 1 -- 172.21.15.5:0/1439813164 learned_addr learned my addr 172.21.15.5:0/1439813164 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871651057 0 0) 0x7fc6840cab30 con 0x7fc6840cb410 2023-03-03T06:24:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc688c70700 1 --2- 172.21.15.5:0/1439813164 >> v2:172.21.15.191:3300/0 conn(0x7fc684071bd0 0x7fc6840cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6700057c0 con 0x7fc6840cb410 2023-03-03T06:24:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3228632039 0 0) 0x7fc6700057c0 con 0x7fc6840cb410 2023-03-03T06:24:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 >> v2:172.21.15.191:3300/0 conn(0x7fc684071bd0 msgr2=0x7fc6840cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 --2- 172.21.15.5:0/1439813164 >> v2:172.21.15.191:3300/0 conn(0x7fc684071bd0 0x7fc6840cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 >> v1:172.21.15.191:6789/0 conn(0x7fc684159660 legacy=0x7fc6840cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68406b1d0 con 0x7fc6840cb410 2023-03-03T06:24:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fc66c001670 con 0x7fc6840cb410 2023-03-03T06:24:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 >> v1:172.21.15.5:6789/0 conn(0x7fc6840cb410 legacy=0x7fc6840714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 --2- 172.21.15.5:0/1439813164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc670005c10 0x7fc670006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 --2- 172.21.15.5:0/1439813164 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc670006a60 0x7fc670006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 --2- 172.21.15.5:0/1439813164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc670007410 0x7fc67000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840cb8c0 con 0x7fc670007410 2023-03-03T06:24:37.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67000e320 con 0x7fc670005c10 2023-03-03T06:24:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67000e4e0 con 0x7fc670006a60 2023-03-03T06:24:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc688c70700 1 --2- 172.21.15.5:0/1439813164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc670007410 0x7fc67000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc683fff700 1 --2- 172.21.15.5:0/1439813164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc670005c10 0x7fc670006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc6837fe700 1 --2- 172.21.15.5:0/1439813164 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc670006a60 0x7fc670006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc688c70700 1 -- 172.21.15.5:0/1439813164 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc670006a60 msgr2=0x7fc670006ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc688c70700 1 --2- 172.21.15.5:0/1439813164 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc670006a60 0x7fc670006ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc688c70700 1 -- 172.21.15.5:0/1439813164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc670005c10 msgr2=0x7fc670006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc688c70700 1 --2- 172.21.15.5:0/1439813164 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc670005c10 0x7fc670006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.149+0000 7fc688c70700 1 -- 172.21.15.5:0/1439813164 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6700057c0 con 0x7fc670007410 2023-03-03T06:24:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.150+0000 7fc688c70700 1 -- 172.21.15.5:0/1439813164 reap_dead start 2023-03-03T06:24:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.150+0000 7fc688c70700 1 --2- 172.21.15.5:0/1439813164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc670007410 0x7fc67000dc20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009f90 tx=0x7fc670007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd7ca41c0e1f80c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.150+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c00ec30 con 0x7fc670007410 2023-03-03T06:24:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.150+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c00f040 con 0x7fc670007410 2023-03-03T06:24:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.150+0000 7fc682ffd700 1 -- 172.21.15.5:0/1439813164 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c014480 con 0x7fc670007410 2023-03-03T06:24:37.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.150+0000 7fc68a6d3700 1 -- 172.21.15.5:0/1439813164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc670007410 msgr2=0x7fc67000dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.150+0000 7fc68a6d3700 1 --2- 172.21.15.5:0/1439813164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc670007410 0x7fc67000dc20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009f90 tx=0x7fc670007a90 comp rx=0 tx=0).stop 2023-03-03T06:24:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.150+0000 7fc68a6d3700 1 -- 172.21.15.5:0/1439813164 shutdown_connections 2023-03-03T06:24:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.150+0000 7fc68a6d3700 1 --2- 172.21.15.5:0/1439813164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc670007410 0x7fc67000dc20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.150+0000 7fc68a6d3700 1 -- 172.21.15.5:0/1439813164 >> 172.21.15.5:0/1439813164 conn(0x7fc6840cf4b0 msgr2=0x7fc6840cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.150+0000 7fc68a6d3700 1 -- 172.21.15.5:0/1439813164 shutdown_connections 2023-03-03T06:24:37.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.150+0000 7fc68a6d3700 1 -- 172.21.15.5:0/1439813164 wait complete. 2023-03-03T06:24:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.152+0000 7fc68a6d3700 1 Processor -- start 2023-03-03T06:24:37.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.152+0000 7fc68a6d3700 1 -- start start 2023-03-03T06:24:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.152+0000 7fc68a6d3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc670007410 0x7fc684158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc68a6d3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6840c2a20 0x7fc6840b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc68a6d3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6840b3240 0x7fc6840b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc68a6d3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68415cbd0 con 0x7fc6840c2a20 2023-03-03T06:24:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc68a6d3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840b2db0 con 0x7fc670007410 2023-03-03T06:24:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc68a6d3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc684158bc0 con 0x7fc6840b3240 2023-03-03T06:24:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc6837fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6840c2a20 0x7fc6840b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc6837fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6840c2a20 0x7fc6840b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42980/0 (socket says 172.21.15.5:42980) 2023-03-03T06:24:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc6837fe700 1 -- 172.21.15.5:0/2948949617 learned_addr learned my addr 172.21.15.5:0/2948949617 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc6837fe700 1 -- 172.21.15.5:0/2948949617 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6840b3240 msgr2=0x7fc6840b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc683fff700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc670007410 0x7fc684158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc688c70700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6840b3240 0x7fc6840b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc6837fe700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6840b3240 0x7fc6840b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc6837fe700 1 -- 172.21.15.5:0/2948949617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc670007410 msgr2=0x7fc684158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc6837fe700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc670007410 0x7fc684158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc6837fe700 1 -- 172.21.15.5:0/2948949617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68406b470 con 0x7fc6840c2a20 2023-03-03T06:24:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc6837fe700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6840c2a20 0x7fc6840b5960 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc66c0072c0 tx=0x7fc66c007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc680ff9700 1 -- 172.21.15.5:0/2948949617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c00f850 con 0x7fc6840c2a20 2023-03-03T06:24:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc680ff9700 1 -- 172.21.15.5:0/2948949617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66c00f9b0 con 0x7fc6840c2a20 2023-03-03T06:24:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc68a6d3700 1 -- 172.21.15.5:0/2948949617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc684159a30 con 0x7fc6840c2a20 2023-03-03T06:24:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc680ff9700 1 -- 172.21.15.5:0/2948949617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c00fd60 con 0x7fc6840c2a20 2023-03-03T06:24:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.153+0000 7fc68a6d3700 1 -- 172.21.15.5:0/2948949617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68406b750 con 0x7fc6840c2a20 2023-03-03T06:24:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.154+0000 7fc68a6d3700 1 -- 172.21.15.5:0/2948949617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6840b5ea0 con 0x7fc6840c2a20 2023-03-03T06:24:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.155+0000 7fc680ff9700 1 -- 172.21.15.5:0/2948949617 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc66c01d460 con 0x7fc6840c2a20 2023-03-03T06:24:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.155+0000 7fc680ff9700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc6640682f0 0x7fc66406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.155+0000 7fc680ff9700 1 -- 172.21.15.5:0/2948949617 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc66c086070 con 0x7fc6840c2a20 2023-03-03T06:24:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.155+0000 7fc683fff700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc6640682f0 0x7fc66406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.156+0000 7fc683fff700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc6640682f0 0x7fc66406a7a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc674000c00 tx=0x7fc674009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.159+0000 7fc680ff9700 1 -- 172.21.15.5:0/2948949617 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc66c052540 con 0x7fc6840c2a20 2023-03-03T06:24:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.351+0000 7fc68a6d3700 1 -- 172.21.15.5:0/2948949617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc68404e6e0 con 0x7fc6840c2a20 2023-03-03T06:24:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.352+0000 7fc680ff9700 1 -- 172.21.15.5:0/2948949617 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc66c055b60 con 0x7fc6840c2a20 2023-03-03T06:24:37.355 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.354+0000 7fc68a6d3700 1 -- 172.21.15.5:0/2948949617 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc6640682f0 msgr2=0x7fc66406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.354+0000 7fc68a6d3700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc6640682f0 0x7fc66406a7a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc674000c00 tx=0x7fc674009040 comp rx=0 tx=0).stop 2023-03-03T06:24:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.354+0000 7fc68a6d3700 1 -- 172.21.15.5:0/2948949617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6840c2a20 msgr2=0x7fc6840b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.354+0000 7fc68a6d3700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6840c2a20 0x7fc6840b5960 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc66c0072c0 tx=0x7fc66c007680 comp rx=0 tx=0).stop 2023-03-03T06:24:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.354+0000 7fc68a6d3700 1 -- 172.21.15.5:0/2948949617 shutdown_connections 2023-03-03T06:24:37.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.354+0000 7fc68a6d3700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc6640682f0 0x7fc66406a7a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.354+0000 7fc68a6d3700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6840b3240 0x7fc6840b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.354+0000 7fc68a6d3700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc670007410 0x7fc684158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.354+0000 7fc68a6d3700 1 --2- 172.21.15.5:0/2948949617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6840c2a20 0x7fc6840b5960 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.354+0000 7fc68a6d3700 1 -- 172.21.15.5:0/2948949617 >> 172.21.15.5:0/2948949617 conn(0x7fc6840cf4b0 msgr2=0x7fc6840cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:37.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.354+0000 7fc68a6d3700 1 -- 172.21.15.5:0/2948949617 shutdown_connections 2023-03-03T06:24:37.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.354+0000 7fc68a6d3700 1 -- 172.21.15.5:0/2948949617 wait complete. 2023-03-03T06:24:37.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-03T06:24:37.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.491+0000 7f391046d700 1 Processor -- start 2023-03-03T06:24:37.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.491+0000 7f391046d700 1 -- start start 2023-03-03T06:24:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.492+0000 7f391046d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39081573f0 0x7f390815d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.492+0000 7f391046d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f39080cc1a0 0x7f39080cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.492+0000 7f391046d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39081577c0 con 0x7f39080b18d0 2023-03-03T06:24:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.492+0000 7f391046d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39080cd790 con 0x7f39080cc1a0 2023-03-03T06:24:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.492+0000 7f391046d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3908159e60 con 0x7f39081573f0 2023-03-03T06:24:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.492+0000 7f390e209700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39081573f0 0x7f390815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.492+0000 7f390da08700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f39080cc1a0 0x7f39080cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.492+0000 7f390ea0a700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f39080b18d0 0x7f390815a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:47360/0 (socket says 172.21.15.5:47360) 2023-03-03T06:24:37.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.492+0000 7f390ea0a700 1 -- 172.21.15.5:0/1823182832 learned_addr learned my addr 172.21.15.5:0/1823182832 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:37.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.493+0000 7f390e209700 1 -- 172.21.15.5:0/1823182832 >> v2:172.21.15.191:3300/0 conn(0x7f39080cc1a0 msgr2=0x7f39080cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:37.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.493+0000 7f390e209700 1 --2- 172.21.15.5:0/1823182832 >> v2:172.21.15.191:3300/0 conn(0x7f39080cc1a0 0x7f39080cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.493+0000 7f390e209700 1 -- 172.21.15.5:0/1823182832 >> v1:172.21.15.191:6789/0 conn(0x7f39080b18d0 legacy=0x7f390815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.493+0000 7f390e209700 1 -- 172.21.15.5:0/1823182832 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39080cc610 con 0x7f39081573f0 2023-03-03T06:24:37.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.493+0000 7f390da08700 1 --2- 172.21.15.5:0/1823182832 >> v2:172.21.15.191:3300/0 conn(0x7f39080cc1a0 0x7f39080cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.493+0000 7f390d207700 1 -- 172.21.15.5:0/1823182832 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184415457 0 0) 0x7f39081577c0 con 0x7f39080b18d0 2023-03-03T06:24:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.493+0000 7f390e209700 1 --2- 172.21.15.5:0/1823182832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39081573f0 0x7f390815d320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009840 tx=0x7f38f8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bd3b5c181353eb0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.493+0000 7f390d207700 1 -- 172.21.15.5:0/1823182832 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8011830 con 0x7f39081573f0 2023-03-03T06:24:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.493+0000 7f390d207700 1 -- 172.21.15.5:0/1823182832 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f8011990 con 0x7f39081573f0 2023-03-03T06:24:37.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.493+0000 7f390d207700 1 -- 172.21.15.5:0/1823182832 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8011d20 con 0x7f39081573f0 2023-03-03T06:24:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.494+0000 7f391046d700 1 -- 172.21.15.5:0/1823182832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39081573f0 msgr2=0x7f390815d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.494+0000 7f391046d700 1 --2- 172.21.15.5:0/1823182832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39081573f0 0x7f390815d320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009840 tx=0x7f38f8009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.494+0000 7f391046d700 1 -- 172.21.15.5:0/1823182832 shutdown_connections 2023-03-03T06:24:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.494+0000 7f391046d700 1 --2- 172.21.15.5:0/1823182832 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39081573f0 0x7f390815d320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.494+0000 7f391046d700 1 --2- 172.21.15.5:0/1823182832 >> v2:172.21.15.191:3300/0 conn(0x7f39080cc1a0 0x7f39080cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.494+0000 7f391046d700 1 -- 172.21.15.5:0/1823182832 >> 172.21.15.5:0/1823182832 conn(0x7f39080cc8d0 msgr2=0x7f39080cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.494+0000 7f391046d700 1 -- 172.21.15.5:0/1823182832 shutdown_connections 2023-03-03T06:24:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.494+0000 7f391046d700 1 -- 172.21.15.5:0/1823182832 wait complete. 2023-03-03T06:24:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.495+0000 7f391046d700 1 Processor -- start 2023-03-03T06:24:37.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.495+0000 7f391046d700 1 -- start start 2023-03-03T06:24:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f391046d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39080b18d0 0x7f39080b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f391046d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39080cc1a0 0x7f3908148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f391046d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39081573f0 0x7f39080cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f391046d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39081f0ec0 con 0x7f39080cc1a0 2023-03-03T06:24:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f391046d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39081f0260 con 0x7f39081573f0 2023-03-03T06:24:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f391046d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39081f0520 con 0x7f39080b18d0 2023-03-03T06:24:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f390da08700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39080cc1a0 0x7f3908148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f390da08700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39080cc1a0 0x7f3908148140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42996/0 (socket says 172.21.15.5:42996) 2023-03-03T06:24:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f390da08700 1 -- 172.21.15.5:0/4111595158 learned_addr learned my addr 172.21.15.5:0/4111595158 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f390e209700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39080b18d0 0x7f39080b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f390ea0a700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39081573f0 0x7f39080cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f390da08700 1 -- 172.21.15.5:0/4111595158 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39080b18d0 msgr2=0x7f39080b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f390da08700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39080b18d0 0x7f39080b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f390da08700 1 -- 172.21.15.5:0/4111595158 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39081573f0 msgr2=0x7f39080cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f390da08700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39081573f0 0x7f39080cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f390da08700 1 -- 172.21.15.5:0/4111595158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3904009430 con 0x7f39080cc1a0 2023-03-03T06:24:37.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f390e209700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39080b18d0 0x7f39080b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:37.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.496+0000 7f390da08700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39080cc1a0 0x7f3908148140 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f390400ebe0 tx=0x7f3904009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:37.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.497+0000 7f38feffd700 1 -- 172.21.15.5:0/4111595158 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904005a20 con 0x7f39080cc1a0 2023-03-03T06:24:37.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.497+0000 7f38feffd700 1 -- 172.21.15.5:0/4111595158 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3904005b80 con 0x7f39080cc1a0 2023-03-03T06:24:37.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.497+0000 7f391046d700 1 -- 172.21.15.5:0/4111595158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f80094a0 con 0x7f39080cc1a0 2023-03-03T06:24:37.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.497+0000 7f38feffd700 1 -- 172.21.15.5:0/4111595158 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390400c8b0 con 0x7f39080cc1a0 2023-03-03T06:24:37.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.497+0000 7f391046d700 1 -- 172.21.15.5:0/4111595158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390815dbe0 con 0x7f39080cc1a0 2023-03-03T06:24:37.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.498+0000 7f391046d700 1 -- 172.21.15.5:0/4111595158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390815d900 con 0x7f39080cc1a0 2023-03-03T06:24:37.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.498+0000 7f38feffd700 1 -- 172.21.15.5:0/4111595158 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3904022070 con 0x7f39080cc1a0 2023-03-03T06:24:37.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.498+0000 7f38feffd700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38ec0682f0 0x7f38ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.498+0000 7f38feffd700 1 -- 172.21.15.5:0/4111595158 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f39040861d0 con 0x7f39080cc1a0 2023-03-03T06:24:37.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.499+0000 7f390e209700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38ec0682f0 0x7f38ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.499+0000 7f390e209700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38ec0682f0 0x7f38ec06a7a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38f80090b0 tx=0x7f38f8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:37.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.503+0000 7f38feffd700 1 -- 172.21.15.5:0/4111595158 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3904052680 con 0x7f39080cc1a0 2023-03-03T06:24:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.714+0000 7f391046d700 1 -- 172.21.15.5:0/4111595158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f390815dec0 con 0x7f39080cc1a0 2023-03-03T06:24:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.714+0000 7f38feffd700 1 -- 172.21.15.5:0/4111595158 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3904020080 con 0x7f39080cc1a0 2023-03-03T06:24:37.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.716+0000 7f391046d700 1 -- 172.21.15.5:0/4111595158 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38ec0682f0 msgr2=0x7f38ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.716+0000 7f391046d700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38ec0682f0 0x7f38ec06a7a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f38f80090b0 tx=0x7f38f8008030 comp rx=0 tx=0).stop 2023-03-03T06:24:37.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.716+0000 7f391046d700 1 -- 172.21.15.5:0/4111595158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39080cc1a0 msgr2=0x7f3908148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.716+0000 7f391046d700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39080cc1a0 0x7f3908148140 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f390400ebe0 tx=0x7f3904009e00 comp rx=0 tx=0).stop 2023-03-03T06:24:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.716+0000 7f391046d700 1 -- 172.21.15.5:0/4111595158 shutdown_connections 2023-03-03T06:24:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.716+0000 7f391046d700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39081573f0 0x7f39080cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.716+0000 7f391046d700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38ec0682f0 0x7f38ec06a7a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.716+0000 7f391046d700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39080b18d0 0x7f39080b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.716+0000 7f391046d700 1 --2- 172.21.15.5:0/4111595158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39080cc1a0 0x7f3908148140 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.716+0000 7f391046d700 1 -- 172.21.15.5:0/4111595158 >> 172.21.15.5:0/4111595158 conn(0x7f39080cc8d0 msgr2=0x7f3908158400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:37.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.716+0000 7f391046d700 1 -- 172.21.15.5:0/4111595158 shutdown_connections 2023-03-03T06:24:37.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.716+0000 7f391046d700 1 -- 172.21.15.5:0/4111595158 wait complete. 2023-03-03T06:24:37.720 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-03-03T06:24:37.730 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-03-03T06:24:37.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:37.731 DEBUG:teuthology.orchestra.run.smithi191:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-03-03T06:24:37.773 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi191.front.sepia.ceph.com 2023-03-03T06:24:37.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:24:37.774 DEBUG:teuthology.orchestra.run.smithi191:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-03-03T06:24:37.833 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-03-03T06:24:37.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:24:37.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.957+0000 7f4b4c038700 1 Processor -- start 2023-03-03T06:24:37.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.957+0000 7f4b4c038700 1 -- start start 2023-03-03T06:24:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b4c038700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b440cbae0 0x7f4b440b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b4c038700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4b440b41e0 0x7f4b4415e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b4c038700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4415f2a0 con 0x7f4b440cb710 2023-03-03T06:24:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b4c038700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b440cd820 con 0x7f4b440cbae0 2023-03-03T06:24:37.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b4c038700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b440cf550 con 0x7f4b440b41e0 2023-03-03T06:24:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b495d3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b440cbae0 0x7f4b440b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b49dd4700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4b440cb710 0x7f4b440cf9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32842/0 (socket says 172.21.15.5:32842) 2023-03-03T06:24:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b49dd4700 1 -- 172.21.15.5:0/4073685873 learned_addr learned my addr 172.21.15.5:0/4073685873 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b4a5d5700 1 --2- 172.21.15.5:0/4073685873 >> v2:172.21.15.191:3300/0 conn(0x7f4b440b41e0 0x7f4b4415e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b495d3700 1 -- 172.21.15.5:0/4073685873 >> v2:172.21.15.191:3300/0 conn(0x7f4b440b41e0 msgr2=0x7f4b4415e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b495d3700 1 --2- 172.21.15.5:0/4073685873 >> v2:172.21.15.191:3300/0 conn(0x7f4b440b41e0 0x7f4b4415e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b495d3700 1 -- 172.21.15.5:0/4073685873 >> v1:172.21.15.5:6789/0 conn(0x7f4b440cb710 legacy=0x7f4b440cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b495d3700 1 -- 172.21.15.5:0/4073685873 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b440b45f0 con 0x7f4b440cbae0 2023-03-03T06:24:37.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.958+0000 7f4b48dd2700 1 -- 172.21.15.5:0/4073685873 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500380160 0 0) 0x7f4b4415f2a0 con 0x7f4b440cb710 2023-03-03T06:24:37.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.959+0000 7f4b495d3700 1 --2- 172.21.15.5:0/4073685873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b440cbae0 0x7f4b440b3ca0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4b4408a250 tx=0x7f4b40009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ffc9ede048a535 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:37.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.959+0000 7f4b48dd2700 1 -- 172.21.15.5:0/4073685873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40011830 con 0x7f4b440cbae0 2023-03-03T06:24:37.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.959+0000 7f4b48dd2700 1 -- 172.21.15.5:0/4073685873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b40011990 con 0x7f4b440cbae0 2023-03-03T06:24:37.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.959+0000 7f4b48dd2700 1 -- 172.21.15.5:0/4073685873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40011d20 con 0x7f4b440cbae0 2023-03-03T06:24:37.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.959+0000 7f4b4c038700 1 -- 172.21.15.5:0/4073685873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b440cbae0 msgr2=0x7f4b440b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.959+0000 7f4b4c038700 1 --2- 172.21.15.5:0/4073685873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b440cbae0 0x7f4b440b3ca0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4b4408a250 tx=0x7f4b40009b20 comp rx=0 tx=0).stop 2023-03-03T06:24:37.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.959+0000 7f4b4c038700 1 -- 172.21.15.5:0/4073685873 shutdown_connections 2023-03-03T06:24:37.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.959+0000 7f4b4c038700 1 --2- 172.21.15.5:0/4073685873 >> v2:172.21.15.191:3300/0 conn(0x7f4b440b41e0 0x7f4b4415e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.959+0000 7f4b4c038700 1 --2- 172.21.15.5:0/4073685873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b440cbae0 0x7f4b440b3ca0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.959+0000 7f4b4c038700 1 -- 172.21.15.5:0/4073685873 >> 172.21.15.5:0/4073685873 conn(0x7f4b44070050 msgr2=0x7f4b44070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:37.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.959+0000 7f4b4c038700 1 -- 172.21.15.5:0/4073685873 shutdown_connections 2023-03-03T06:24:37.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.959+0000 7f4b4c038700 1 -- 172.21.15.5:0/4073685873 wait complete. 2023-03-03T06:24:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.961+0000 7f4b4c038700 1 Processor -- start 2023-03-03T06:24:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.961+0000 7f4b4c038700 1 -- start start 2023-03-03T06:24:37.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.961+0000 7f4b4c038700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b440b41e0 0x7f4b44159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.961+0000 7f4b4c038700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b440cb710 0x7f4b440c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.961+0000 7f4b4c038700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b440cbae0 0x7f4b4415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.961+0000 7f4b4c038700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4415a000 con 0x7f4b440cbae0 2023-03-03T06:24:37.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.961+0000 7f4b4c038700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b440c6800 con 0x7f4b440cb710 2023-03-03T06:24:37.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.961+0000 7f4b4c038700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b440c6ae0 con 0x7f4b440b41e0 2023-03-03T06:24:37.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.961+0000 7f4b4a5d5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b440cbae0 0x7f4b4415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b4a5d5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b440cbae0 0x7f4b4415ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43010/0 (socket says 172.21.15.5:43010) 2023-03-03T06:24:37.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b4a5d5700 1 -- 172.21.15.5:0/644852733 learned_addr learned my addr 172.21.15.5:0/644852733 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:37.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b49dd4700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b440b41e0 0x7f4b44159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b495d3700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b440cb710 0x7f4b440c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b4a5d5700 1 -- 172.21.15.5:0/644852733 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b440b41e0 msgr2=0x7f4b44159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b4a5d5700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b440b41e0 0x7f4b44159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b4a5d5700 1 -- 172.21.15.5:0/644852733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b440cb710 msgr2=0x7f4b440c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:37.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b4a5d5700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b440cb710 0x7f4b440c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:37.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b4a5d5700 1 -- 172.21.15.5:0/644852733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b400094a0 con 0x7f4b440cbae0 2023-03-03T06:24:37.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b49dd4700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b440b41e0 0x7f4b44159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:37.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b4a5d5700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b440cbae0 0x7f4b4415ce00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c007e40 tx=0x7f4b3c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:37.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b3a7fc700 1 -- 172.21.15.5:0/644852733 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c00eea0 con 0x7f4b440cbae0 2023-03-03T06:24:37.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b3a7fc700 1 -- 172.21.15.5:0/644852733 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c014420 con 0x7f4b440cbae0 2023-03-03T06:24:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b4c038700 1 -- 172.21.15.5:0/644852733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b440cef00 con 0x7f4b440cbae0 2023-03-03T06:24:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b3a7fc700 1 -- 172.21.15.5:0/644852733 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0147b0 con 0x7f4b440cbae0 2023-03-03T06:24:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.962+0000 7f4b4c038700 1 -- 172.21.15.5:0/644852733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4415efc0 con 0x7f4b440cbae0 2023-03-03T06:24:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.963+0000 7f4b4c038700 1 -- 172.21.15.5:0/644852733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b440cf1e0 con 0x7f4b440cbae0 2023-03-03T06:24:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.964+0000 7f4b3a7fc700 1 -- 172.21.15.5:0/644852733 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4b3c012050 con 0x7f4b440cbae0 2023-03-03T06:24:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.964+0000 7f4b3a7fc700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4b280682f0 0x7f4b2806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.964+0000 7f4b3a7fc700 1 -- 172.21.15.5:0/644852733 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4b3c086690 con 0x7f4b440cbae0 2023-03-03T06:24:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.964+0000 7f4b49dd4700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4b280682f0 0x7f4b2806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.965+0000 7f4b49dd4700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4b280682f0 0x7f4b2806a7a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4b34000f60 tx=0x7f4b34009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:37.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:37.969+0000 7f4b3a7fc700 1 -- 172.21.15.5:0/644852733 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4b3c052bc0 con 0x7f4b440cbae0 2023-03-03T06:24:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.207+0000 7f4b4c038700 1 -- 172.21.15.5:0/644852733 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b44071480 con 0x7f4b440cbae0 2023-03-03T06:24:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.208+0000 7f4b3a7fc700 1 -- 172.21.15.5:0/644852733 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4638 (secure 0 0 0) 0x7f4b3c0561e0 con 0x7f4b440cbae0 2023-03-03T06:24:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:38.211 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/277386051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":277386051},{"type":"v1","addr":"172.21.15.5:6837","nonce":277386051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2875199515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2875199515},{"type":"v1","addr":"172.21.15.191:6835","nonce":2875199515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2122425608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2122425608},{"type":"v1","addr":"172.21.15.191:6833","nonce":2122425608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:23:40.315678+0000","modified":"2023-03-03T06:23:58.532900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/305842942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":305842942},{"type":"v1","addr":"172.21.15.5:6836","nonce":305842942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-03T06:24:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.210+0000 7f4b4c038700 1 -- 172.21.15.5:0/644852733 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4b280682f0 msgr2=0x7f4b2806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.210+0000 7f4b4c038700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4b280682f0 0x7f4b2806a7a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4b34000f60 tx=0x7f4b34009040 comp rx=0 tx=0).stop 2023-03-03T06:24:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.210+0000 7f4b4c038700 1 -- 172.21.15.5:0/644852733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b440cbae0 msgr2=0x7f4b4415ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.210+0000 7f4b4c038700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b440cbae0 0x7f4b4415ce00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c007e40 tx=0x7f4b3c00e3c0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.210+0000 7f4b4c038700 1 -- 172.21.15.5:0/644852733 shutdown_connections 2023-03-03T06:24:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.210+0000 7f4b4c038700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b440cbae0 0x7f4b4415ce00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.210+0000 7f4b4c038700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4b280682f0 0x7f4b2806a7a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.210+0000 7f4b4c038700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b440b41e0 0x7f4b44159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.210+0000 7f4b4c038700 1 --2- 172.21.15.5:0/644852733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b440cb710 0x7f4b440c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.210+0000 7f4b4c038700 1 -- 172.21.15.5:0/644852733 >> 172.21.15.5:0/644852733 conn(0x7f4b44070050 msgr2=0x7f4b440afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.210+0000 7f4b4c038700 1 -- 172.21.15.5:0/644852733 shutdown_connections 2023-03-03T06:24:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.210+0000 7f4b4c038700 1 -- 172.21.15.5:0/644852733 wait complete. 2023-03-03T06:24:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2023-03-03T06:24:38.225 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:38.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.347+0000 7f04e7a1e700 1 Processor -- start 2023-03-03T06:24:38.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.347+0000 7f04e7a1e700 1 -- start start 2023-03-03T06:24:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.348+0000 7f04e7a1e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04e00ca210 0x7f04e0160360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.348+0000 7f04e7a1e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e0161290 con 0x7f04e0146100 2023-03-03T06:24:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.348+0000 7f04e7a1e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e00cd520 con 0x7f04e006dc90 2023-03-03T06:24:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.348+0000 7f04e7a1e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e0160cd0 con 0x7f04e00ca210 2023-03-03T06:24:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.348+0000 7f04e57ba700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f04e00ca210 0x7f04e0160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.348+0000 7f04e4fb9700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f04e0146100 0x7f04e006d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32856/0 (socket says 172.21.15.5:32856) 2023-03-03T06:24:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.348+0000 7f04e4fb9700 1 -- 172.21.15.5:0/2261945284 learned_addr learned my addr 172.21.15.5:0/2261945284 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:38.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.349+0000 7f04e57ba700 1 -- 172.21.15.5:0/2261945284 >> v1:172.21.15.191:6789/0 conn(0x7f04e006dc90 legacy=0x7f04e00cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:38.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.349+0000 7f04e57ba700 1 -- 172.21.15.5:0/2261945284 >> v1:172.21.15.5:6789/0 conn(0x7f04e0146100 legacy=0x7f04e006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:38.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.349+0000 7f04e57ba700 1 -- 172.21.15.5:0/2261945284 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0160fb0 con 0x7f04e00ca210 2023-03-03T06:24:38.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.349+0000 7f04e57ba700 1 --2- 172.21.15.5:0/2261945284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04e00ca210 0x7f04e0160360 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009840 tx=0x7f04d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b3ab68dea7a9f6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:38.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.349+0000 7f04d7fff700 1 -- 172.21.15.5:0/2261945284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0004230 con 0x7f04e00ca210 2023-03-03T06:24:38.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.349+0000 7f04d7fff700 1 -- 172.21.15.5:0/2261945284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d0004390 con 0x7f04e00ca210 2023-03-03T06:24:38.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.349+0000 7f04d7fff700 1 -- 172.21.15.5:0/2261945284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d00036a0 con 0x7f04e00ca210 2023-03-03T06:24:38.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.349+0000 7f04e7a1e700 1 -- 172.21.15.5:0/2261945284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04e00ca210 msgr2=0x7f04e0160360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:38.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.349+0000 7f04e7a1e700 1 --2- 172.21.15.5:0/2261945284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04e00ca210 0x7f04e0160360 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009840 tx=0x7f04d0009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:38.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.349+0000 7f04e7a1e700 1 -- 172.21.15.5:0/2261945284 shutdown_connections 2023-03-03T06:24:38.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.349+0000 7f04e7a1e700 1 --2- 172.21.15.5:0/2261945284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04e00ca210 0x7f04e0160360 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.349+0000 7f04e7a1e700 1 -- 172.21.15.5:0/2261945284 >> 172.21.15.5:0/2261945284 conn(0x7f04e00cf4b0 msgr2=0x7f04e00cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:38.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.350+0000 7f04e7a1e700 1 -- 172.21.15.5:0/2261945284 shutdown_connections 2023-03-03T06:24:38.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.350+0000 7f04e7a1e700 1 -- 172.21.15.5:0/2261945284 wait complete. 2023-03-03T06:24:38.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.351+0000 7f04e7a1e700 1 Processor -- start 2023-03-03T06:24:38.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.351+0000 7f04e7a1e700 1 -- start start 2023-03-03T06:24:38.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.351+0000 7f04e7a1e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04e006dc90 0x7f04e0156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:38.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.351+0000 7f04e7a1e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04e00ca210 0x7f04e00c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:38.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e7a1e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04e0146100 0x7f04e00c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:38.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e7a1e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e01566d0 con 0x7f04e006dc90 2023-03-03T06:24:38.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e7a1e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00c3a30 con 0x7f04e00ca210 2023-03-03T06:24:38.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e7a1e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00c3d10 con 0x7f04e0146100 2023-03-03T06:24:38.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e57ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04e006dc90 0x7f04e0156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:38.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e57ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04e006dc90 0x7f04e0156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43018/0 (socket says 172.21.15.5:43018) 2023-03-03T06:24:38.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e57ba700 1 -- 172.21.15.5:0/4160880806 learned_addr learned my addr 172.21.15.5:0/4160880806 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:38.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e5fbb700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04e0146100 0x7f04e00c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:38.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e4fb9700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04e00ca210 0x7f04e00c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:38.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e57ba700 1 -- 172.21.15.5:0/4160880806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04e0146100 msgr2=0x7f04e00c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:38.357 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e57ba700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04e0146100 0x7f04e00c4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e57ba700 1 -- 172.21.15.5:0/4160880806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04e00ca210 msgr2=0x7f04e00c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:38.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e57ba700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04e00ca210 0x7f04e00c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e57ba700 1 -- 172.21.15.5:0/4160880806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d00094a0 con 0x7f04e006dc90 2023-03-03T06:24:38.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e57ba700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04e006dc90 0x7f04e0156190 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f04d00090b0 tx=0x7f04d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:38.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04d5ffb700 1 -- 172.21.15.5:0/4160880806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0011830 con 0x7f04e006dc90 2023-03-03T06:24:38.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04d5ffb700 1 -- 172.21.15.5:0/4160880806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d001e070 con 0x7f04e006dc90 2023-03-03T06:24:38.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04e7a1e700 1 -- 172.21.15.5:0/4160880806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e00ca5e0 con 0x7f04e006dc90 2023-03-03T06:24:38.358 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.352+0000 7f04d5ffb700 1 -- 172.21.15.5:0/4160880806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0011bf0 con 0x7f04e006dc90 2023-03-03T06:24:38.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.353+0000 7f04e7a1e700 1 -- 172.21.15.5:0/4160880806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e00cd1b0 con 0x7f04e006dc90 2023-03-03T06:24:38.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.353+0000 7f04e7a1e700 1 -- 172.21.15.5:0/4160880806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e00ca770 con 0x7f04e006dc90 2023-03-03T06:24:38.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.354+0000 7f04d5ffb700 1 -- 172.21.15.5:0/4160880806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f04d0017020 con 0x7f04e006dc90 2023-03-03T06:24:38.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.354+0000 7f04d5ffb700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f04c40682f0 0x7f04c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:38.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.354+0000 7f04d5ffb700 1 -- 172.21.15.5:0/4160880806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f04d0087360 con 0x7f04e006dc90 2023-03-03T06:24:38.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.354+0000 7f04e4fb9700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f04c40682f0 0x7f04c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:38.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.355+0000 7f04e4fb9700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f04c40682f0 0x7f04c406a7a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f04e015f730 tx=0x7f04dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:38.361 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.358+0000 7f04d5ffb700 1 -- 172.21.15.5:0/4160880806 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f04d0053890 con 0x7f04e006dc90 2023-03-03T06:24:38.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.555+0000 7f04e7a1e700 1 -- 172.21.15.5:0/4160880806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04e004e6e0 con 0x7f04e006dc90 2023-03-03T06:24:38.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.556+0000 7f04d5ffb700 1 -- 172.21.15.5:0/4160880806 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19641 (secure 0 0 0) 0x7f04d0056eb0 con 0x7f04e006dc90 2023-03-03T06:24:38.559 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:38.559 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:24:28.893239+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.558+0000 7f04e7a1e700 1 -- 172.21.15.5:0/4160880806 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f04c40682f0 msgr2=0x7f04c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.558+0000 7f04e7a1e700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f04c40682f0 0x7f04c406a7a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f04e015f730 tx=0x7f04dc009040 comp rx=0 tx=0).stop 2023-03-03T06:24:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.558+0000 7f04e7a1e700 1 -- 172.21.15.5:0/4160880806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04e006dc90 msgr2=0x7f04e0156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.558+0000 7f04e7a1e700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04e006dc90 0x7f04e0156190 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f04d00090b0 tx=0x7f04d0004750 comp rx=0 tx=0).stop 2023-03-03T06:24:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.558+0000 7f04e7a1e700 1 -- 172.21.15.5:0/4160880806 shutdown_connections 2023-03-03T06:24:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.558+0000 7f04e7a1e700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f04c40682f0 0x7f04c406a7a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.558+0000 7f04e7a1e700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04e0146100 0x7f04e00c4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.558+0000 7f04e7a1e700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04e006dc90 0x7f04e0156190 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.558+0000 7f04e7a1e700 1 --2- 172.21.15.5:0/4160880806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04e00ca210 0x7f04e00c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.558+0000 7f04e7a1e700 1 -- 172.21.15.5:0/4160880806 >> 172.21.15.5:0/4160880806 conn(0x7f04e00cf4b0 msgr2=0x7f04e00cd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.558+0000 7f04e7a1e700 1 -- 172.21.15.5:0/4160880806 shutdown_connections 2023-03-03T06:24:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.558+0000 7f04e7a1e700 1 -- 172.21.15.5:0/4160880806 wait complete. 2023-03-03T06:24:38.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:23:38.141777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:23:39.283589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-03-03T06:23:42.422930+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-03-03T06:24:38.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:24:38.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.702+0000 7ff693fff700 1 Processor -- start 2023-03-03T06:24:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.702+0000 7ff693fff700 1 -- start start 2023-03-03T06:24:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.703+0000 7ff693fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff69415a6e0 0x7ff6940ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.703+0000 7ff693fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff6940b22a0 0x7ff694070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.703+0000 7ff693fff700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6940cfb30 con 0x7ff6940cb260 2023-03-03T06:24:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.703+0000 7ff693fff700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6940cb740 con 0x7ff69415a6e0 2023-03-03T06:24:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.703+0000 7ff693fff700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6940cf4e0 con 0x7ff6940b22a0 2023-03-03T06:24:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.703+0000 7ff692ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff69415a6e0 0x7ff6940ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.703+0000 7ff692ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff69415a6e0 0x7ff6940ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43026/0 (socket says 172.21.15.5:43026) 2023-03-03T06:24:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.703+0000 7ff692ffd700 1 -- 172.21.15.5:0/2749230869 learned_addr learned my addr 172.21.15.5:0/2749230869 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.703+0000 7ff6927fc700 1 --2- 172.21.15.5:0/2749230869 >> v2:172.21.15.191:3300/0 conn(0x7ff6940b22a0 0x7ff694070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.703+0000 7ff692ffd700 1 -- 172.21.15.5:0/2749230869 >> v2:172.21.15.191:3300/0 conn(0x7ff6940b22a0 msgr2=0x7ff694070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.704+0000 7ff692ffd700 1 --2- 172.21.15.5:0/2749230869 >> v2:172.21.15.191:3300/0 conn(0x7ff6940b22a0 0x7ff694070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.704+0000 7ff692ffd700 1 -- 172.21.15.5:0/2749230869 >> v1:172.21.15.191:6789/0 conn(0x7ff6940cb260 legacy=0x7ff69415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.704+0000 7ff692ffd700 1 -- 172.21.15.5:0/2749230869 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6940cf7c0 con 0x7ff69415a6e0 2023-03-03T06:24:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.704+0000 7ff692ffd700 1 --2- 172.21.15.5:0/2749230869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff69415a6e0 0x7ff6940ccf00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff69406b370 tx=0x7ff688009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbc27dd94cda692 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:38.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.704+0000 7ff691ffb700 1 -- 172.21.15.5:0/2749230869 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68800b870 con 0x7ff69415a6e0 2023-03-03T06:24:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.704+0000 7ff691ffb700 1 -- 172.21.15.5:0/2749230869 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68800b9d0 con 0x7ff69415a6e0 2023-03-03T06:24:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.704+0000 7ff691ffb700 1 -- 172.21.15.5:0/2749230869 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68800bd60 con 0x7ff69415a6e0 2023-03-03T06:24:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.704+0000 7ff693fff700 1 -- 172.21.15.5:0/2749230869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff69415a6e0 msgr2=0x7ff6940ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:38.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.704+0000 7ff693fff700 1 --2- 172.21.15.5:0/2749230869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff69415a6e0 0x7ff6940ccf00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff69406b370 tx=0x7ff688009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.704+0000 7ff693fff700 1 -- 172.21.15.5:0/2749230869 shutdown_connections 2023-03-03T06:24:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.704+0000 7ff693fff700 1 --2- 172.21.15.5:0/2749230869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff69415a6e0 0x7ff6940ccf00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.704+0000 7ff693fff700 1 --2- 172.21.15.5:0/2749230869 >> v2:172.21.15.191:3300/0 conn(0x7ff6940b22a0 0x7ff694070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.705+0000 7ff693fff700 1 -- 172.21.15.5:0/2749230869 >> 172.21.15.5:0/2749230869 conn(0x7ff6940d0c10 msgr2=0x7ff6940d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.705+0000 7ff693fff700 1 -- 172.21.15.5:0/2749230869 shutdown_connections 2023-03-03T06:24:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.705+0000 7ff693fff700 1 -- 172.21.15.5:0/2749230869 wait complete. 2023-03-03T06:24:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.706+0000 7ff693fff700 1 Processor -- start 2023-03-03T06:24:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.706+0000 7ff693fff700 1 -- start start 2023-03-03T06:24:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff693fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6940cb260 0x7ff6941f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:38.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff693fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff69415a6e0 0x7ff6940ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff693fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6940ca7e0 0x7ff69406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff693fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6941f37b0 con 0x7ff6940ca7e0 2023-03-03T06:24:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff693fff700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff694155870 con 0x7ff6940cb260 2023-03-03T06:24:38.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff693fff700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff694156450 con 0x7ff69415a6e0 2023-03-03T06:24:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff6937fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6940ca7e0 0x7ff69406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff6937fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6940ca7e0 0x7ff69406dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43034/0 (socket says 172.21.15.5:43034) 2023-03-03T06:24:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff6937fe700 1 -- 172.21.15.5:0/2631089137 learned_addr learned my addr 172.21.15.5:0/2631089137 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:38.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff6927fc700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff69415a6e0 0x7ff6940ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff692ffd700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6940cb260 0x7ff6941f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff6937fe700 1 -- 172.21.15.5:0/2631089137 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff69415a6e0 msgr2=0x7ff6940ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff6937fe700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff69415a6e0 0x7ff6940ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff6937fe700 1 -- 172.21.15.5:0/2631089137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6940cb260 msgr2=0x7ff6941f3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff6937fe700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6940cb260 0x7ff6941f3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff6937fe700 1 -- 172.21.15.5:0/2631089137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff688009550 con 0x7ff6940ca7e0 2023-03-03T06:24:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff6937fe700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6940ca7e0 0x7ff69406dee0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00cc50 tx=0x7ff68c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff67b7fe700 1 -- 172.21.15.5:0/2631089137 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c003c00 con 0x7ff6940ca7e0 2023-03-03T06:24:38.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff67b7fe700 1 -- 172.21.15.5:0/2631089137 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c003d60 con 0x7ff6940ca7e0 2023-03-03T06:24:38.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.707+0000 7ff67b7fe700 1 -- 172.21.15.5:0/2631089137 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c00aab0 con 0x7ff6940ca7e0 2023-03-03T06:24:38.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.708+0000 7ff693fff700 1 -- 172.21.15.5:0/2631089137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69415aab0 con 0x7ff6940ca7e0 2023-03-03T06:24:38.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.708+0000 7ff693fff700 1 -- 172.21.15.5:0/2631089137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6940cba20 con 0x7ff6940ca7e0 2023-03-03T06:24:38.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.709+0000 7ff693fff700 1 -- 172.21.15.5:0/2631089137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6940b1100 con 0x7ff6940ca7e0 2023-03-03T06:24:38.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.709+0000 7ff67b7fe700 1 -- 172.21.15.5:0/2631089137 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff68c010050 con 0x7ff6940ca7e0 2023-03-03T06:24:38.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.709+0000 7ff67b7fe700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff6800682f0 0x7ff68006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:38.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.709+0000 7ff67b7fe700 1 -- 172.21.15.5:0/2631089137 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff68c085e00 con 0x7ff6940ca7e0 2023-03-03T06:24:38.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.709+0000 7ff692ffd700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff6800682f0 0x7ff68006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:38.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.710+0000 7ff692ffd700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff6800682f0 0x7ff68006a7a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff688014040 tx=0x7ff688008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:38.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.714+0000 7ff67b7fe700 1 -- 172.21.15.5:0/2631089137 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff68c052330 con 0x7ff6940ca7e0 2023-03-03T06:24:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.906+0000 7ff693fff700 1 -- 172.21.15.5:0/2631089137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff694074300 con 0x7ff6940ca7e0 2023-03-03T06:24:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.906+0000 7ff67b7fe700 1 -- 172.21.15.5:0/2631089137 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff68c055950 con 0x7ff6940ca7e0 2023-03-03T06:24:38.909 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:24:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.908+0000 7ff693fff700 1 -- 172.21.15.5:0/2631089137 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff6800682f0 msgr2=0x7ff68006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.908+0000 7ff693fff700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff6800682f0 0x7ff68006a7a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff688014040 tx=0x7ff688008030 comp rx=0 tx=0).stop 2023-03-03T06:24:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.908+0000 7ff693fff700 1 -- 172.21.15.5:0/2631089137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6940ca7e0 msgr2=0x7ff69406dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.908+0000 7ff693fff700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6940ca7e0 0x7ff69406dee0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00cc50 tx=0x7ff68c00cf60 comp rx=0 tx=0).stop 2023-03-03T06:24:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.908+0000 7ff693fff700 1 -- 172.21.15.5:0/2631089137 shutdown_connections 2023-03-03T06:24:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.908+0000 7ff693fff700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6940ca7e0 0x7ff69406dee0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.908+0000 7ff693fff700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6940cb260 0x7ff6941f3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.908+0000 7ff693fff700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff6800682f0 0x7ff68006a7a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.908+0000 7ff693fff700 1 --2- 172.21.15.5:0/2631089137 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff69415a6e0 0x7ff6940ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.908+0000 7ff693fff700 1 -- 172.21.15.5:0/2631089137 >> 172.21.15.5:0/2631089137 conn(0x7ff6940d0c10 msgr2=0x7ff6940b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.909+0000 7ff693fff700 1 -- 172.21.15.5:0/2631089137 shutdown_connections 2023-03-03T06:24:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:38.909+0000 7ff693fff700 1 -- 172.21.15.5:0/2631089137 wait complete. 2023-03-03T06:24:38.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:24:39.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.048+0000 7f87524ea700 1 Processor -- start 2023-03-03T06:24:39.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.048+0000 7f87524ea700 1 -- start start 2023-03-03T06:24:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.049+0000 7f87524ea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0cd3e0 0x7f874c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.049+0000 7f87524ea700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f874c0b1fe0 0x7f874c0ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.049+0000 7f87524ea700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874c15e160 con 0x7f874c15cd40 2023-03-03T06:24:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.049+0000 7f87524ea700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874c0cd870 con 0x7f874c0b1fe0 2023-03-03T06:24:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.049+0000 7f87524ea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c15d110 con 0x7f874c0cd3e0 2023-03-03T06:24:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.049+0000 7f8750a87700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f874c0b1fe0 0x7f874c0ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.049+0000 7f874b7fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0cd3e0 0x7f874c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.050+0000 7f874b7fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0cd3e0 0x7f874c0cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:41118/0 (socket says 172.21.15.5:41118) 2023-03-03T06:24:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.050+0000 7f874bfff700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f874c15cd40 0x7f874c0b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:47408/0 (socket says 172.21.15.5:47408) 2023-03-03T06:24:39.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.050+0000 7f8750a87700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f874c0b1fe0 0x7f874c0ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:43402/0 (socket says 172.21.15.5:43402) 2023-03-03T06:24:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.050+0000 7f874b7fe700 1 -- 172.21.15.5:0/4284160549 learned_addr learned my addr 172.21.15.5:0/4284160549 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.050+0000 7f874b7fe700 1 -- 172.21.15.5:0/4284160549 >> v2:172.21.15.191:3300/0 conn(0x7f874c0b1fe0 msgr2=0x7f874c0ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.050+0000 7f874b7fe700 1 --2- 172.21.15.5:0/4284160549 >> v2:172.21.15.191:3300/0 conn(0x7f874c0b1fe0 0x7f874c0ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.050+0000 7f874b7fe700 1 -- 172.21.15.5:0/4284160549 >> v1:172.21.15.191:6789/0 conn(0x7f874c15cd40 legacy=0x7f874c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.050+0000 7f874b7fe700 1 -- 172.21.15.5:0/4284160549 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c15d3c0 con 0x7f874c0cd3e0 2023-03-03T06:24:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.050+0000 7f8750a87700 1 --2- 172.21.15.5:0/4284160549 >> v2:172.21.15.191:3300/0 conn(0x7f874c0b1fe0 0x7f874c0ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.050+0000 7f874b7fe700 1 --2- 172.21.15.5:0/4284160549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0cd3e0 0x7f874c0cdd50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f87400098f0 tx=0x7f8740009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eb844782c4dd57f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:39.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.050+0000 7f874affd700 1 -- 172.21.15.5:0/4284160549 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740011830 con 0x7f874c0cd3e0 2023-03-03T06:24:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.050+0000 7f874affd700 1 -- 172.21.15.5:0/4284160549 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8740011990 con 0x7f874c0cd3e0 2023-03-03T06:24:39.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.050+0000 7f874affd700 1 -- 172.21.15.5:0/4284160549 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740011d20 con 0x7f874c0cd3e0 2023-03-03T06:24:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.051+0000 7f87524ea700 1 -- 172.21.15.5:0/4284160549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0cd3e0 msgr2=0x7f874c0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.051+0000 7f87524ea700 1 --2- 172.21.15.5:0/4284160549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0cd3e0 0x7f874c0cdd50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f87400098f0 tx=0x7f8740009c00 comp rx=0 tx=0).stop 2023-03-03T06:24:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.051+0000 7f87524ea700 1 -- 172.21.15.5:0/4284160549 shutdown_connections 2023-03-03T06:24:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.051+0000 7f87524ea700 1 --2- 172.21.15.5:0/4284160549 >> v2:172.21.15.191:3300/0 conn(0x7f874c0b1fe0 0x7f874c0ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.051+0000 7f87524ea700 1 --2- 172.21.15.5:0/4284160549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c0cd3e0 0x7f874c0cdd50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.051+0000 7f87524ea700 1 -- 172.21.15.5:0/4284160549 >> 172.21.15.5:0/4284160549 conn(0x7f874c0cc8d0 msgr2=0x7f874c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.051+0000 7f87524ea700 1 -- 172.21.15.5:0/4284160549 shutdown_connections 2023-03-03T06:24:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.051+0000 7f87524ea700 1 -- 172.21.15.5:0/4284160549 wait complete. 2023-03-03T06:24:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.052+0000 7f87524ea700 1 Processor -- start 2023-03-03T06:24:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.052+0000 7f87524ea700 1 -- start start 2023-03-03T06:24:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.053+0000 7f87524ea700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f874c0b1fe0 0x7f874c1471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.053+0000 7f87524ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0cd3e0 0x7f874c0c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.053+0000 7f87524ea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c15cd40 0x7f874c0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.053+0000 7f87524ea700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0c5470 con 0x7f874c0cd3e0 2023-03-03T06:24:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.053+0000 7f87524ea700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0c5750 con 0x7f874c0b1fe0 2023-03-03T06:24:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.053+0000 7f87524ea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0c5a30 con 0x7f874c15cd40 2023-03-03T06:24:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.053+0000 7f874b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0cd3e0 0x7f874c0c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.053+0000 7f874b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0cd3e0 0x7f874c0c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43046/0 (socket says 172.21.15.5:43046) 2023-03-03T06:24:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.053+0000 7f874b7fe700 1 -- 172.21.15.5:0/3593079833 learned_addr learned my addr 172.21.15.5:0/3593079833 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.053+0000 7f8750a87700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c15cd40 0x7f874c0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.053+0000 7f874bfff700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f874c0b1fe0 0x7f874c1471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.054+0000 7f874b7fe700 1 -- 172.21.15.5:0/3593079833 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c15cd40 msgr2=0x7f874c0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.054+0000 7f874b7fe700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c15cd40 0x7f874c0adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.054+0000 7f874b7fe700 1 -- 172.21.15.5:0/3593079833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f874c0b1fe0 msgr2=0x7f874c1471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.054+0000 7f874b7fe700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f874c0b1fe0 0x7f874c1471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.054+0000 7f874b7fe700 1 -- 172.21.15.5:0/3593079833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744009a70 con 0x7f874c0cd3e0 2023-03-03T06:24:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.054+0000 7f874b7fe700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0cd3e0 0x7f874c0c49d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8740000c00 tx=0x7f8740004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.054+0000 7f8748ff9700 1 -- 172.21.15.5:0/3593079833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740004570 con 0x7f874c0cd3e0 2023-03-03T06:24:39.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.054+0000 7f8748ff9700 1 -- 172.21.15.5:0/3593079833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874001f070 con 0x7f874c0cd3e0 2023-03-03T06:24:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.054+0000 7f8748ff9700 1 -- 172.21.15.5:0/3593079833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400038c0 con 0x7f874c0cd3e0 2023-03-03T06:24:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.054+0000 7f87524ea700 1 -- 172.21.15.5:0/3593079833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8740009550 con 0x7f874c0cd3e0 2023-03-03T06:24:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.054+0000 7f87524ea700 1 -- 172.21.15.5:0/3593079833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874c15d980 con 0x7f874c0cd3e0 2023-03-03T06:24:39.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.055+0000 7f87524ea700 1 -- 172.21.15.5:0/3593079833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874c15d6a0 con 0x7f874c0cd3e0 2023-03-03T06:24:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.055+0000 7f8748ff9700 1 -- 172.21.15.5:0/3593079833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f874002a020 con 0x7f874c0cd3e0 2023-03-03T06:24:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.056+0000 7f8748ff9700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f87380682c0 0x7f873806a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.056+0000 7f8748ff9700 1 -- 172.21.15.5:0/3593079833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f87400875c0 con 0x7f874c0cd3e0 2023-03-03T06:24:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.056+0000 7f874bfff700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f87380682c0 0x7f873806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.056+0000 7f874bfff700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f87380682c0 0x7f873806a770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f873c000f60 tx=0x7f873c007d10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.060+0000 7f8748ff9700 1 -- 172.21.15.5:0/3593079833 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8740053af0 con 0x7f874c0cd3e0 2023-03-03T06:24:39.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.250+0000 7f87524ea700 1 -- 172.21.15.5:0/3593079833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f874c15dc60 con 0x7f874c0cd3e0 2023-03-03T06:24:39.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.250+0000 7f8748ff9700 1 -- 172.21.15.5:0/3593079833 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8740057110 con 0x7f874c0cd3e0 2023-03-03T06:24:39.253 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:24:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.252+0000 7f87524ea700 1 -- 172.21.15.5:0/3593079833 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f87380682c0 msgr2=0x7f873806a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.252+0000 7f87524ea700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f87380682c0 0x7f873806a770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f873c000f60 tx=0x7f873c007d10 comp rx=0 tx=0).stop 2023-03-03T06:24:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.252+0000 7f87524ea700 1 -- 172.21.15.5:0/3593079833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0cd3e0 msgr2=0x7f874c0c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.252+0000 7f87524ea700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0cd3e0 0x7f874c0c49d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8740000c00 tx=0x7f8740004750 comp rx=0 tx=0).stop 2023-03-03T06:24:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.252+0000 7f87524ea700 1 -- 172.21.15.5:0/3593079833 shutdown_connections 2023-03-03T06:24:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.252+0000 7f87524ea700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f87380682c0 0x7f873806a770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.252+0000 7f87524ea700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f874c15cd40 0x7f874c0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.252+0000 7f87524ea700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f874c0b1fe0 0x7f874c1471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.252+0000 7f87524ea700 1 --2- 172.21.15.5:0/3593079833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f874c0cd3e0 0x7f874c0c49d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.252+0000 7f87524ea700 1 -- 172.21.15.5:0/3593079833 >> 172.21.15.5:0/3593079833 conn(0x7f874c0cc8d0 msgr2=0x7f874c0ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.252+0000 7f87524ea700 1 -- 172.21.15.5:0/3593079833 shutdown_connections 2023-03-03T06:24:39.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.252+0000 7f87524ea700 1 -- 172.21.15.5:0/3593079833 wait complete. 2023-03-03T06:24:39.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:24:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.396+0000 7fd195ed9700 1 Processor -- start 2023-03-03T06:24:39.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.396+0000 7fd195ed9700 1 -- start start 2023-03-03T06:24:39.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd195ed9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1900cf3f0 0x7fd1900cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.400 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd195ed9700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd1900b18d0 0x7fd1900b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd195ed9700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1900cc370 con 0x7fd1900cf7c0 2023-03-03T06:24:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd195ed9700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1900b2290 con 0x7fd1900cf3f0 2023-03-03T06:24:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd195ed9700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1900cb760 con 0x7fd1900b18d0 2023-03-03T06:24:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd18f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1900cf3f0 0x7fd1900cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd18f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1900cf3f0 0x7fd1900cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43052/0 (socket says 172.21.15.5:43052) 2023-03-03T06:24:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd18f7fe700 1 -- 172.21.15.5:0/3158183879 learned_addr learned my addr 172.21.15.5:0/3158183879 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd18ffff700 1 --2- 172.21.15.5:0/3158183879 >> v2:172.21.15.191:3300/0 conn(0x7fd1900b18d0 0x7fd1900b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd18f7fe700 1 -- 172.21.15.5:0/3158183879 >> v2:172.21.15.191:3300/0 conn(0x7fd1900b18d0 msgr2=0x7fd1900b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd18f7fe700 1 --2- 172.21.15.5:0/3158183879 >> v2:172.21.15.191:3300/0 conn(0x7fd1900b18d0 0x7fd1900b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd18f7fe700 1 -- 172.21.15.5:0/3158183879 >> v1:172.21.15.191:6789/0 conn(0x7fd1900cf7c0 legacy=0x7fd19015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd18f7fe700 1 -- 172.21.15.5:0/3158183879 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1900cba40 con 0x7fd1900cf3f0 2023-03-03T06:24:39.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.397+0000 7fd18f7fe700 1 --2- 172.21.15.5:0/3158183879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1900cf3f0 0x7fd1900cd450 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd190070d60 tx=0x7fd180009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d305e73f850dbfcd server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.398+0000 7fd18e7fc700 1 -- 172.21.15.5:0/3158183879 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd180004230 con 0x7fd1900cf3f0 2023-03-03T06:24:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.398+0000 7fd18e7fc700 1 -- 172.21.15.5:0/3158183879 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd180004390 con 0x7fd1900cf3f0 2023-03-03T06:24:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.398+0000 7fd18e7fc700 1 -- 172.21.15.5:0/3158183879 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1800036a0 con 0x7fd1900cf3f0 2023-03-03T06:24:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.398+0000 7fd195ed9700 1 -- 172.21.15.5:0/3158183879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1900cf3f0 msgr2=0x7fd1900cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.398+0000 7fd195ed9700 1 --2- 172.21.15.5:0/3158183879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1900cf3f0 0x7fd1900cd450 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd190070d60 tx=0x7fd180009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.398+0000 7fd195ed9700 1 -- 172.21.15.5:0/3158183879 shutdown_connections 2023-03-03T06:24:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.398+0000 7fd195ed9700 1 --2- 172.21.15.5:0/3158183879 >> v2:172.21.15.191:3300/0 conn(0x7fd1900b18d0 0x7fd1900b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.398+0000 7fd195ed9700 1 --2- 172.21.15.5:0/3158183879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1900cf3f0 0x7fd1900cd450 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.398+0000 7fd195ed9700 1 -- 172.21.15.5:0/3158183879 >> 172.21.15.5:0/3158183879 conn(0x7fd1900cc8d0 msgr2=0x7fd1900cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.398+0000 7fd195ed9700 1 -- 172.21.15.5:0/3158183879 shutdown_connections 2023-03-03T06:24:39.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.398+0000 7fd195ed9700 1 -- 172.21.15.5:0/3158183879 wait complete. 2023-03-03T06:24:39.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.399+0000 7fd195ed9700 1 Processor -- start 2023-03-03T06:24:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.400+0000 7fd195ed9700 1 -- start start 2023-03-03T06:24:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.400+0000 7fd195ed9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1900b18d0 0x7fd19014f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.400+0000 7fd195ed9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1900cf3f0 0x7fd190147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.400+0000 7fd195ed9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1900cf7c0 0x7fd190147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.408 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.400+0000 7fd195ed9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd190153580 con 0x7fd1900cf3f0 2023-03-03T06:24:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.400+0000 7fd195ed9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1900c7900 con 0x7fd1900cf7c0 2023-03-03T06:24:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.400+0000 7fd195ed9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1900c7be0 con 0x7fd1900b18d0 2023-03-03T06:24:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.400+0000 7fd18effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1900cf3f0 0x7fd190147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.400+0000 7fd18effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1900cf3f0 0x7fd190147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43060/0 (socket says 172.21.15.5:43060) 2023-03-03T06:24:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.400+0000 7fd18effd700 1 -- 172.21.15.5:0/233807286 learned_addr learned my addr 172.21.15.5:0/233807286 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.400+0000 7fd18f7fe700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1900b18d0 0x7fd19014f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.401+0000 7fd18ffff700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1900cf7c0 0x7fd190147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.401+0000 7fd18effd700 1 -- 172.21.15.5:0/233807286 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1900b18d0 msgr2=0x7fd19014f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.401+0000 7fd18effd700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1900b18d0 0x7fd19014f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.401+0000 7fd18effd700 1 -- 172.21.15.5:0/233807286 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1900cf7c0 msgr2=0x7fd190147ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.401+0000 7fd18effd700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1900cf7c0 0x7fd190147ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.401+0000 7fd18effd700 1 -- 172.21.15.5:0/233807286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180009550 con 0x7fd1900cf3f0 2023-03-03T06:24:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.401+0000 7fd18effd700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1900cf3f0 0x7fd190147980 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd17800b4a0 tx=0x7fd17800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.401+0000 7fd187fff700 1 -- 172.21.15.5:0/233807286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd178011830 con 0x7fd1900cf3f0 2023-03-03T06:24:39.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.401+0000 7fd187fff700 1 -- 172.21.15.5:0/233807286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd178011990 con 0x7fd1900cf3f0 2023-03-03T06:24:39.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.401+0000 7fd195ed9700 1 -- 172.21.15.5:0/233807286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1900cc000 con 0x7fd1900cf3f0 2023-03-03T06:24:39.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.401+0000 7fd187fff700 1 -- 172.21.15.5:0/233807286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd178011d40 con 0x7fd1900cf3f0 2023-03-03T06:24:39.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.401+0000 7fd195ed9700 1 -- 172.21.15.5:0/233807286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1900cbd20 con 0x7fd1900cf3f0 2023-03-03T06:24:39.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.402+0000 7fd195ed9700 1 -- 172.21.15.5:0/233807286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1900cdd50 con 0x7fd1900cf3f0 2023-03-03T06:24:39.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.402+0000 7fd187fff700 1 -- 172.21.15.5:0/233807286 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd17800f050 con 0x7fd1900cf3f0 2023-03-03T06:24:39.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.403+0000 7fd187fff700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd1700682f0 0x7fd17006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.403+0000 7fd18f7fe700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd1700682f0 0x7fd17006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.403+0000 7fd187fff700 1 -- 172.21.15.5:0/233807286 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd178085a30 con 0x7fd1900cf3f0 2023-03-03T06:24:39.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.403+0000 7fd18f7fe700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd1700682f0 0x7fd17006a7a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd180009130 tx=0x7fd180008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:39.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.407+0000 7fd187fff700 1 -- 172.21.15.5:0/233807286 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd178051f60 con 0x7fd1900cf3f0 2023-03-03T06:24:39.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.597+0000 7fd195ed9700 1 -- 172.21.15.5:0/233807286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd19004e6e0 con 0x7fd1900cf3f0 2023-03-03T06:24:39.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.598+0000 7fd187fff700 1 -- 172.21.15.5:0/233807286 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd178055580 con 0x7fd1900cf3f0 2023-03-03T06:24:39.601 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:39.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.600+0000 7fd195ed9700 1 -- 172.21.15.5:0/233807286 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd1700682f0 msgr2=0x7fd17006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.600+0000 7fd195ed9700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd1700682f0 0x7fd17006a7a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd180009130 tx=0x7fd180008030 comp rx=0 tx=0).stop 2023-03-03T06:24:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.600+0000 7fd195ed9700 1 -- 172.21.15.5:0/233807286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1900cf3f0 msgr2=0x7fd190147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.600+0000 7fd195ed9700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1900cf3f0 0x7fd190147980 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd17800b4a0 tx=0x7fd17800b7b0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.600+0000 7fd195ed9700 1 -- 172.21.15.5:0/233807286 shutdown_connections 2023-03-03T06:24:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.600+0000 7fd195ed9700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1900cf7c0 0x7fd190147ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.600+0000 7fd195ed9700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd1700682f0 0x7fd17006a7a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.600+0000 7fd195ed9700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1900b18d0 0x7fd19014f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.600+0000 7fd195ed9700 1 --2- 172.21.15.5:0/233807286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1900cf3f0 0x7fd190147980 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.600+0000 7fd195ed9700 1 -- 172.21.15.5:0/233807286 >> 172.21.15.5:0/233807286 conn(0x7fd1900cc8d0 msgr2=0x7fd19015d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:39.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.600+0000 7fd195ed9700 1 -- 172.21.15.5:0/233807286 shutdown_connections 2023-03-03T06:24:39.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.600+0000 7fd195ed9700 1 -- 172.21.15.5:0/233807286 wait complete. 2023-03-03T06:24:39.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:24:39.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.740+0000 7f5f98d0a700 1 Processor -- start 2023-03-03T06:24:39.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.740+0000 7f5f98d0a700 1 -- start start 2023-03-03T06:24:39.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f98d0a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f9406d580 0x7f5f940ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f98d0a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f940c9b00 0x7f5f9406d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f98d0a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f940ca7f0 con 0x7f5f94160dc0 2023-03-03T06:24:39.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f98d0a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f94160930 con 0x7f5f940c9b00 2023-03-03T06:24:39.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f98d0a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940c9f70 con 0x7f5f9406d580 2023-03-03T06:24:39.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f91d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f940c9b00 0x7f5f9406d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f92d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5f94160dc0 0x7f5f940714c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32912/0 (socket says 172.21.15.5:32912) 2023-03-03T06:24:39.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f91d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f940c9b00 0x7f5f9406d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43066/0 (socket says 172.21.15.5:43066) 2023-03-03T06:24:39.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f91d9b700 1 -- 172.21.15.5:0/1121823613 learned_addr learned my addr 172.21.15.5:0/1121823613 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:39.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f9259c700 1 --2- 172.21.15.5:0/1121823613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f9406d580 0x7f5f940ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f91d9b700 1 -- 172.21.15.5:0/1121823613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f9406d580 msgr2=0x7f5f940ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:39.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f91d9b700 1 --2- 172.21.15.5:0/1121823613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f9406d580 0x7f5f940ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f9159a700 1 -- 172.21.15.5:0/1121823613 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318773538 0 0) 0x7f5f8c001490 con 0x7f5f94160dc0 2023-03-03T06:24:39.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f91d9b700 1 -- 172.21.15.5:0/1121823613 >> v1:172.21.15.5:6789/0 conn(0x7f5f94160dc0 legacy=0x7f5f940714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f91d9b700 1 -- 172.21.15.5:0/1121823613 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9406de90 con 0x7f5f940c9b00 2023-03-03T06:24:39.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f91d9b700 1 --2- 172.21.15.5:0/1121823613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f940c9b00 0x7f5f9406d950 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5f880098f0 tx=0x7f5f88009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7aa73c6b0ab6fd server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:39.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f9159a700 1 -- 172.21.15.5:0/1121823613 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800b8a0 con 0x7f5f940c9b00 2023-03-03T06:24:39.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.741+0000 7f5f9159a700 1 -- 172.21.15.5:0/1121823613 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8800ba00 con 0x7f5f940c9b00 2023-03-03T06:24:39.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.742+0000 7f5f9159a700 1 -- 172.21.15.5:0/1121823613 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800bd90 con 0x7f5f940c9b00 2023-03-03T06:24:39.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.742+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1121823613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f940c9b00 msgr2=0x7f5f9406d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.742+0000 7f5f98d0a700 1 --2- 172.21.15.5:0/1121823613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f940c9b00 0x7f5f9406d950 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5f880098f0 tx=0x7f5f88009c00 comp rx=0 tx=0).stop 2023-03-03T06:24:39.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.742+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1121823613 shutdown_connections 2023-03-03T06:24:39.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.742+0000 7f5f98d0a700 1 --2- 172.21.15.5:0/1121823613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f9406d580 0x7f5f940ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.742+0000 7f5f98d0a700 1 --2- 172.21.15.5:0/1121823613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f940c9b00 0x7f5f9406d950 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.742+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1121823613 >> 172.21.15.5:0/1121823613 conn(0x7f5f940cf4b0 msgr2=0x7f5f940cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:39.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.742+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1121823613 shutdown_connections 2023-03-03T06:24:39.748 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.742+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1121823613 wait complete. 2023-03-03T06:24:39.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.744+0000 7f5f98d0a700 1 Processor -- start 2023-03-03T06:24:39.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.744+0000 7f5f98d0a700 1 -- start start 2023-03-03T06:24:39.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.744+0000 7f5f98d0a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f9406d580 0x7f5f940b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.744+0000 7f5f98d0a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f940c9b00 0x7f5f94155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.744+0000 7f5f98d0a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f94160dc0 0x7f5f940b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.744+0000 7f5f98d0a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940c4b50 con 0x7f5f940c9b00 2023-03-03T06:24:39.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.744+0000 7f5f98d0a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940c4e30 con 0x7f5f9406d580 2023-03-03T06:24:39.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.744+0000 7f5f98d0a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940c5110 con 0x7f5f94160dc0 2023-03-03T06:24:39.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.744+0000 7f5f91d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f940c9b00 0x7f5f94155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.751 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.744+0000 7f5f91d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f940c9b00 0x7f5f94155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43076/0 (socket says 172.21.15.5:43076) 2023-03-03T06:24:39.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.744+0000 7f5f91d9b700 1 -- 172.21.15.5:0/1651059854 learned_addr learned my addr 172.21.15.5:0/1651059854 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:39.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.745+0000 7f5f92d9d700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f94160dc0 0x7f5f940b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.745+0000 7f5f9259c700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f9406d580 0x7f5f940b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.745+0000 7f5f91d9b700 1 -- 172.21.15.5:0/1651059854 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f94160dc0 msgr2=0x7f5f940b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.745+0000 7f5f91d9b700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f94160dc0 0x7f5f940b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.745+0000 7f5f91d9b700 1 -- 172.21.15.5:0/1651059854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f9406d580 msgr2=0x7f5f940b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.745+0000 7f5f91d9b700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f9406d580 0x7f5f940b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.745+0000 7f5f91d9b700 1 -- 172.21.15.5:0/1651059854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f88009550 con 0x7f5f940c9b00 2023-03-03T06:24:39.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.745+0000 7f5f91d9b700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f940c9b00 0x7f5f94155750 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009c40 tx=0x7f5f88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:39.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.745+0000 7f5f82ffd700 1 -- 172.21.15.5:0/1651059854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88004510 con 0x7f5f940c9b00 2023-03-03T06:24:39.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.745+0000 7f5f82ffd700 1 -- 172.21.15.5:0/1651059854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8801e070 con 0x7f5f940c9b00 2023-03-03T06:24:39.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.745+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1651059854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f940ca510 con 0x7f5f940c9b00 2023-03-03T06:24:39.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.745+0000 7f5f82ffd700 1 -- 172.21.15.5:0/1651059854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f880038c0 con 0x7f5f940c9b00 2023-03-03T06:24:39.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.745+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1651059854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f940ca230 con 0x7f5f940c9b00 2023-03-03T06:24:39.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.746+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1651059854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f941605c0 con 0x7f5f940c9b00 2023-03-03T06:24:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.747+0000 7f5f82ffd700 1 -- 172.21.15.5:0/1651059854 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5f8800f050 con 0x7f5f940c9b00 2023-03-03T06:24:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.747+0000 7f5f82ffd700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f740682f0 0x7f5f7406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.747+0000 7f5f82ffd700 1 -- 172.21.15.5:0/1651059854 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5f88020070 con 0x7f5f940c9b00 2023-03-03T06:24:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.747+0000 7f5f9259c700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f740682f0 0x7f5f7406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.747+0000 7f5f9259c700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f740682f0 0x7f5f7406a7a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5f84006b20 tx=0x7f5f84008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:39.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.751+0000 7f5f82ffd700 1 -- 172.21.15.5:0/1651059854 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5f880538a0 con 0x7f5f940c9b00 2023-03-03T06:24:39.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.943+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1651059854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f9404e6e0 con 0x7f5f940c9b00 2023-03-03T06:24:39.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.943+0000 7f5f82ffd700 1 -- 172.21.15.5:0/1651059854 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f88056ec0 con 0x7f5f940c9b00 2023-03-03T06:24:39.945 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:24:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.945+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1651059854 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f740682f0 msgr2=0x7f5f7406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.945+0000 7f5f98d0a700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f740682f0 0x7f5f7406a7a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5f84006b20 tx=0x7f5f84008040 comp rx=0 tx=0).stop 2023-03-03T06:24:39.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.945+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1651059854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f940c9b00 msgr2=0x7f5f94155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.945+0000 7f5f98d0a700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f940c9b00 0x7f5f94155750 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009c40 tx=0x7f5f88004750 comp rx=0 tx=0).stop 2023-03-03T06:24:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.945+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1651059854 shutdown_connections 2023-03-03T06:24:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.945+0000 7f5f98d0a700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5f740682f0 0x7f5f7406a7a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.945+0000 7f5f98d0a700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5f94160dc0 0x7f5f940b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.945+0000 7f5f98d0a700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f9406d580 0x7f5f940b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.945+0000 7f5f98d0a700 1 --2- 172.21.15.5:0/1651059854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f940c9b00 0x7f5f94155750 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:39.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.945+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1651059854 >> 172.21.15.5:0/1651059854 conn(0x7f5f940cf4b0 msgr2=0x7f5f9406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.945+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1651059854 shutdown_connections 2023-03-03T06:24:39.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:39.945+0000 7f5f98d0a700 1 -- 172.21.15.5:0/1651059854 wait complete. 2023-03-03T06:24:39.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-03-03T06:24:40.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.086+0000 7f38a4eb1700 1 Processor -- start 2023-03-03T06:24:40.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.086+0000 7f38a4eb1700 1 -- start start 2023-03-03T06:24:40.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f38a4eb1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38a015cd40 0x7f38a00b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f38a4eb1700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a015e160 con 0x7f38a00cb9d0 2023-03-03T06:24:40.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f38a4eb1700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a0161540 con 0x7f38a00cd3e0 2023-03-03T06:24:40.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f38a4eb1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a00cd870 con 0x7f38a015cd40 2023-03-03T06:24:40.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f389e59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38a015cd40 0x7f38a00b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f389e59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38a015cd40 0x7f38a00b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43080/0 (socket says 172.21.15.5:43080) 2023-03-03T06:24:40.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f389ed9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f38a00cb9d0 0x7f38a0160e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32926/0 (socket says 172.21.15.5:32926) 2023-03-03T06:24:40.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f389e59c700 1 -- 172.21.15.5:0/2885078114 learned_addr learned my addr 172.21.15.5:0/2885078114 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:40.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f389e59c700 1 -- 172.21.15.5:0/2885078114 >> v1:172.21.15.191:6789/0 conn(0x7f38a00cd3e0 legacy=0x7f38a0160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f389e59c700 1 -- 172.21.15.5:0/2885078114 >> v1:172.21.15.5:6789/0 conn(0x7f38a00cb9d0 legacy=0x7f38a0160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f389e59c700 1 -- 172.21.15.5:0/2885078114 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a015d110 con 0x7f38a015cd40 2023-03-03T06:24:40.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f389d59a700 1 -- 172.21.15.5:0/2885078114 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265986070 0 0) 0x7f38a015e160 con 0x7f38a00cb9d0 2023-03-03T06:24:40.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f389e59c700 1 --2- 172.21.15.5:0/2885078114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a015cd40 0x7f38a00b18d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f38900098f0 tx=0x7f3890009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f5d869fcd07c72 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:40.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f389d59a700 1 -- 172.21.15.5:0/2885078114 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389000b8a0 con 0x7f38a015cd40 2023-03-03T06:24:40.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f389d59a700 1 -- 172.21.15.5:0/2885078114 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389000ba00 con 0x7f38a015cd40 2023-03-03T06:24:40.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.087+0000 7f389d59a700 1 -- 172.21.15.5:0/2885078114 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389000bd90 con 0x7f38a015cd40 2023-03-03T06:24:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.088+0000 7f38a4eb1700 1 -- 172.21.15.5:0/2885078114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a015cd40 msgr2=0x7f38a00b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.088+0000 7f38a4eb1700 1 --2- 172.21.15.5:0/2885078114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a015cd40 0x7f38a00b18d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f38900098f0 tx=0x7f3890009c00 comp rx=0 tx=0).stop 2023-03-03T06:24:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.088+0000 7f38a4eb1700 1 -- 172.21.15.5:0/2885078114 shutdown_connections 2023-03-03T06:24:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.088+0000 7f38a4eb1700 1 --2- 172.21.15.5:0/2885078114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a015cd40 0x7f38a00b18d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.088+0000 7f38a4eb1700 1 -- 172.21.15.5:0/2885078114 >> 172.21.15.5:0/2885078114 conn(0x7f38a00cc8d0 msgr2=0x7f38a00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.088+0000 7f38a4eb1700 1 -- 172.21.15.5:0/2885078114 shutdown_connections 2023-03-03T06:24:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.088+0000 7f38a4eb1700 1 -- 172.21.15.5:0/2885078114 wait complete. 2023-03-03T06:24:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.089+0000 7f38a4eb1700 1 Processor -- start 2023-03-03T06:24:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.089+0000 7f38a4eb1700 1 -- start start 2023-03-03T06:24:40.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.090+0000 7f38a4eb1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38a00cb9d0 0x7f38a014f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.090+0000 7f38a4eb1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a00cd3e0 0x7f38a01f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.090+0000 7f38a4eb1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38a015cd40 0x7f38a00b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.090+0000 7f38a4eb1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a01f3670 con 0x7f38a00cd3e0 2023-03-03T06:24:40.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.090+0000 7f38a4eb1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a01f3d30 con 0x7f38a00cb9d0 2023-03-03T06:24:40.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.090+0000 7f38a4eb1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a01f30b0 con 0x7f38a015cd40 2023-03-03T06:24:40.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.090+0000 7f389dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a00cd3e0 0x7f38a01f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.090+0000 7f389dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a00cd3e0 0x7f38a01f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43086/0 (socket says 172.21.15.5:43086) 2023-03-03T06:24:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.090+0000 7f389dd9b700 1 -- 172.21.15.5:0/1235125786 learned_addr learned my addr 172.21.15.5:0/1235125786 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.090+0000 7f389e59c700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38a00cb9d0 0x7f38a014f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.090+0000 7f389ed9d700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38a015cd40 0x7f38a00b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.091+0000 7f389dd9b700 1 -- 172.21.15.5:0/1235125786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38a015cd40 msgr2=0x7f38a00b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.091+0000 7f389dd9b700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38a015cd40 0x7f38a00b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.091+0000 7f389dd9b700 1 -- 172.21.15.5:0/1235125786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38a00cb9d0 msgr2=0x7f38a014f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.091+0000 7f389dd9b700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38a00cb9d0 0x7f38a014f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.091+0000 7f389dd9b700 1 -- 172.21.15.5:0/1235125786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3890009550 con 0x7f38a00cd3e0 2023-03-03T06:24:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.091+0000 7f389ed9d700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38a015cd40 0x7f38a00b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.091+0000 7f389dd9b700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a00cd3e0 0x7f38a01f26d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f389400c480 tx=0x7f389400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.091+0000 7f388effd700 1 -- 172.21.15.5:0/1235125786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38940052d0 con 0x7f38a00cd3e0 2023-03-03T06:24:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.091+0000 7f388effd700 1 -- 172.21.15.5:0/1235125786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3894005430 con 0x7f38a00cd3e0 2023-03-03T06:24:40.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.091+0000 7f38a4eb1700 1 -- 172.21.15.5:0/1235125786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a015d6a0 con 0x7f38a00cd3e0 2023-03-03T06:24:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.091+0000 7f388effd700 1 -- 172.21.15.5:0/1235125786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38940038c0 con 0x7f38a00cd3e0 2023-03-03T06:24:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.091+0000 7f38a4eb1700 1 -- 172.21.15.5:0/1235125786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a015d3c0 con 0x7f38a00cd3e0 2023-03-03T06:24:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.092+0000 7f38a4eb1700 1 -- 172.21.15.5:0/1235125786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a015d980 con 0x7f38a00cd3e0 2023-03-03T06:24:40.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.092+0000 7f388effd700 1 -- 172.21.15.5:0/1235125786 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3894019030 con 0x7f38a00cd3e0 2023-03-03T06:24:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.093+0000 7f388effd700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38800682f0 0x7f388006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.093+0000 7f388effd700 1 -- 172.21.15.5:0/1235125786 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3894085270 con 0x7f38a00cd3e0 2023-03-03T06:24:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.093+0000 7f389e59c700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38800682f0 0x7f388006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.093+0000 7f389e59c700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38800682f0 0x7f388006a7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3890014040 tx=0x7f389001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:40.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.097+0000 7f388effd700 1 -- 172.21.15.5:0/1235125786 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3894051860 con 0x7f38a00cd3e0 2023-03-03T06:24:40.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.291+0000 7f38a4eb1700 1 -- 172.21.15.5:0/1235125786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f38a01f3ea0 con 0x7f38a00cd3e0 2023-03-03T06:24:40.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.292+0000 7f388effd700 1 -- 172.21.15.5:0/1235125786 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3894054e80 con 0x7f38a00cd3e0 2023-03-03T06:24:40.295 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:24:40.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.294+0000 7f38a4eb1700 1 -- 172.21.15.5:0/1235125786 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38800682f0 msgr2=0x7f388006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.294+0000 7f38a4eb1700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38800682f0 0x7f388006a7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3890014040 tx=0x7f389001c040 comp rx=0 tx=0).stop 2023-03-03T06:24:40.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.294+0000 7f38a4eb1700 1 -- 172.21.15.5:0/1235125786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a00cd3e0 msgr2=0x7f38a01f26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.294+0000 7f38a4eb1700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a00cd3e0 0x7f38a01f26d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f389400c480 tx=0x7f389400c790 comp rx=0 tx=0).stop 2023-03-03T06:24:40.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.294+0000 7f38a4eb1700 1 -- 172.21.15.5:0/1235125786 shutdown_connections 2023-03-03T06:24:40.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.294+0000 7f38a4eb1700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38800682f0 0x7f388006a7a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.294+0000 7f38a4eb1700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38a015cd40 0x7f38a00b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.294+0000 7f38a4eb1700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38a00cb9d0 0x7f38a014f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.294+0000 7f38a4eb1700 1 --2- 172.21.15.5:0/1235125786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38a00cd3e0 0x7f38a01f26d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.294+0000 7f38a4eb1700 1 -- 172.21.15.5:0/1235125786 >> 172.21.15.5:0/1235125786 conn(0x7f38a00cc8d0 msgr2=0x7f38a006ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:40.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.294+0000 7f38a4eb1700 1 -- 172.21.15.5:0/1235125786 shutdown_connections 2023-03-03T06:24:40.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.294+0000 7f38a4eb1700 1 -- 172.21.15.5:0/1235125786 wait complete. 2023-03-03T06:24:40.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:24:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.434+0000 7f4dbe0b1700 1 Processor -- start 2023-03-03T06:24:40.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.434+0000 7f4dbe0b1700 1 -- start start 2023-03-03T06:24:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.434+0000 7f4dbe0b1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db8144150 0x7f4db815ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.434+0000 7f4dbe0b1700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db806bd00 con 0x7f4db815b930 2023-03-03T06:24:40.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.434+0000 7f4dbe0b1700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db815ae50 con 0x7f4db806dc00 2023-03-03T06:24:40.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.434+0000 7f4dbe0b1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db815b130 con 0x7f4db8144150 2023-03-03T06:24:40.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db6ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4db815b930 0x7f4db806b540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32936/0 (socket says 172.21.15.5:32936) 2023-03-03T06:24:40.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db6ffd700 1 -- 172.21.15.5:0/2455086837 learned_addr learned my addr 172.21.15.5:0/2455086837 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:40.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db77fe700 1 --2- 172.21.15.5:0/2455086837 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db8144150 0x7f4db815ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870203931 0 0) 0x7f4db806bd00 con 0x7f4db815b930 2023-03-03T06:24:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4da00035b0 con 0x7f4db815b930 2023-03-03T06:24:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064209281 0 0) 0x7f4db815ae50 con 0x7f4db806dc00 2023-03-03T06:24:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4db806bd00 con 0x7f4db806dc00 2023-03-03T06:24:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3564549357 0 0) 0x7f4da00035b0 con 0x7f4db815b930 2023-03-03T06:24:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db8144150 msgr2=0x7f4db815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 --2- 172.21.15.5:0/2455086837 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db8144150 0x7f4db815ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 >> v1:172.21.15.191:6789/0 conn(0x7f4db806dc00 legacy=0x7f4db8157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db815b410 con 0x7f4db815b930 2023-03-03T06:24:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f4dac001670 con 0x7f4db815b930 2023-03-03T06:24:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 >> v1:172.21.15.5:6789/0 conn(0x7f4db815b930 legacy=0x7f4db806b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 --2- 172.21.15.5:0/2455086837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da0003c30 0x7f4da0004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 --2- 172.21.15.5:0/2455086837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4da0004850 0x7f4da0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 --2- 172.21.15.5:0/2455086837 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db8144150 0x7f4da0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db815b130 con 0x7f4da0004850 2023-03-03T06:24:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da000baf0 con 0x7f4da0003c30 2023-03-03T06:24:40.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da000bcb0 con 0x7f4db8144150 2023-03-03T06:24:40.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db6ffd700 1 --2- 172.21.15.5:0/2455086837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4da0004850 0x7f4da0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db77fe700 1 --2- 172.21.15.5:0/2455086837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da0003c30 0x7f4da0004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.435+0000 7f4db7fff700 1 --2- 172.21.15.5:0/2455086837 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db8144150 0x7f4da0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4db6ffd700 1 -- 172.21.15.5:0/2455086837 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db8144150 msgr2=0x7f4da0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:40.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4db6ffd700 1 --2- 172.21.15.5:0/2455086837 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db8144150 0x7f4da0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4db6ffd700 1 -- 172.21.15.5:0/2455086837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da0003c30 msgr2=0x7f4da0004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:40.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4db6ffd700 1 --2- 172.21.15.5:0/2455086837 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da0003c30 0x7f4da0004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4db6ffd700 1 -- 172.21.15.5:0/2455086837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da00035b0 con 0x7f4da0004850 2023-03-03T06:24:40.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4db6ffd700 1 --2- 172.21.15.5:0/2455086837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4da0004850 0x7f4da0004cc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00c210 tx=0x7f4da0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb6d69a70ab7951 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:40.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac00cdb0 con 0x7f4da0004850 2023-03-03T06:24:40.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac001af0 con 0x7f4da0004850 2023-03-03T06:24:40.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4db67fc700 1 -- 172.21.15.5:0/2455086837 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac005ba0 con 0x7f4da0004850 2023-03-03T06:24:40.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2455086837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4da0004850 msgr2=0x7f4da0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4dbe0b1700 1 --2- 172.21.15.5:0/2455086837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4da0004850 0x7f4da0004cc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00c210 tx=0x7f4da0005880 comp rx=0 tx=0).stop 2023-03-03T06:24:40.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4db7fff700 1 -- 172.21.15.5:0/2455086837 reap_dead start 2023-03-03T06:24:40.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2455086837 shutdown_connections 2023-03-03T06:24:40.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2455086837 >> 172.21.15.5:0/2455086837 conn(0x7f4db80cfd00 msgr2=0x7f4db80d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:40.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2455086837 shutdown_connections 2023-03-03T06:24:40.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.436+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2455086837 wait complete. 2023-03-03T06:24:40.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.438+0000 7f4dbe0b1700 1 Processor -- start 2023-03-03T06:24:40.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.438+0000 7f4dbe0b1700 1 -- start start 2023-03-03T06:24:40.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4dbe0b1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da0004850 0x7f4db80c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4dbe0b1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4db80c2e80 0x7f4db80c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4dbe0b1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db815ddd0 0x7f4db815e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4dbe0b1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80c9490 con 0x7f4db80c2e80 2023-03-03T06:24:40.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4dbe0b1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db815e780 con 0x7f4da0004850 2023-03-03T06:24:40.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4dbe0b1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80c43a0 con 0x7f4db815ddd0 2023-03-03T06:24:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4db6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4db80c2e80 0x7f4db80c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4db6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4db80c2e80 0x7f4db80c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43108/0 (socket says 172.21.15.5:43108) 2023-03-03T06:24:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4db6ffd700 1 -- 172.21.15.5:0/2622837866 learned_addr learned my addr 172.21.15.5:0/2622837866 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4db77fe700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da0004850 0x7f4db80c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4db7fff700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db815ddd0 0x7f4db815e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4db6ffd700 1 -- 172.21.15.5:0/2622837866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db815ddd0 msgr2=0x7f4db815e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4db6ffd700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db815ddd0 0x7f4db815e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4db6ffd700 1 -- 172.21.15.5:0/2622837866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da0004850 msgr2=0x7f4db80c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4db6ffd700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da0004850 0x7f4db80c4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4db6ffd700 1 -- 172.21.15.5:0/2622837866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db806bfe0 con 0x7f4db80c2e80 2023-03-03T06:24:40.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4db77fe700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da0004850 0x7f4db80c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:40.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4db7fff700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db815ddd0 0x7f4db815e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:40.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4db6ffd700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4db80c2e80 0x7f4db80c9630 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00c800 tx=0x7f4dac001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:40.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4d9ffff700 1 -- 172.21.15.5:0/2622837866 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac004d00 con 0x7f4db80c2e80 2023-03-03T06:24:40.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4d9ffff700 1 -- 172.21.15.5:0/2622837866 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac004e60 con 0x7f4db80c2e80 2023-03-03T06:24:40.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2622837866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db8144520 con 0x7f4db80c2e80 2023-03-03T06:24:40.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4d9ffff700 1 -- 172.21.15.5:0/2622837866 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0072f0 con 0x7f4db80c2e80 2023-03-03T06:24:40.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.439+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2622837866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db815ed40 con 0x7f4db80c2e80 2023-03-03T06:24:40.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.440+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2622837866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db806d840 con 0x7f4db80c2e80 2023-03-03T06:24:40.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.441+0000 7f4d9ffff700 1 -- 172.21.15.5:0/2622837866 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4dac02d070 con 0x7f4db80c2e80 2023-03-03T06:24:40.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.441+0000 7f4d9ffff700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4da4068320 0x7f4da406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.441+0000 7f4db77fe700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4da4068320 0x7f4da406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.441+0000 7f4d9ffff700 1 -- 172.21.15.5:0/2622837866 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4dac086e20 con 0x7f4db80c2e80 2023-03-03T06:24:40.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.442+0000 7f4db77fe700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4da4068320 0x7f4da406a7d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009b00 tx=0x7f4da8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:40.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.446+0000 7f4d9ffff700 1 -- 172.21.15.5:0/2622837866 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4dac053350 con 0x7f4db80c2e80 2023-03-03T06:24:40.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.683+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2622837866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4db8067d10 con 0x7f4db80c2e80 2023-03-03T06:24:40.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.684+0000 7f4d9ffff700 1 -- 172.21.15.5:0/2622837866 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4638 (secure 0 0 0) 0x7f4dac056970 con 0x7f4db80c2e80 2023-03-03T06:24:40.686 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:40.686 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/277386051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":277386051},{"type":"v1","addr":"172.21.15.5:6837","nonce":277386051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2875199515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2875199515},{"type":"v1","addr":"172.21.15.191:6835","nonce":2875199515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2122425608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2122425608},{"type":"v1","addr":"172.21.15.191:6833","nonce":2122425608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:23:40.315678+0000","modified":"2023-03-03T06:23:58.532900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/305842942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":305842942},{"type":"v1","addr":"172.21.15.5:6836","nonce":305842942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-03T06:24:40.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.686+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2622837866 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4da4068320 msgr2=0x7f4da406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.686+0000 7f4dbe0b1700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4da4068320 0x7f4da406a7d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009b00 tx=0x7f4da8008040 comp rx=0 tx=0).stop 2023-03-03T06:24:40.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.686+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2622837866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4db80c2e80 msgr2=0x7f4db80c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.686+0000 7f4dbe0b1700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4db80c2e80 0x7f4db80c9630 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00c800 tx=0x7f4dac001980 comp rx=0 tx=0).stop 2023-03-03T06:24:40.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.686+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2622837866 shutdown_connections 2023-03-03T06:24:40.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.686+0000 7f4dbe0b1700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4da4068320 0x7f4da406a7d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.686+0000 7f4dbe0b1700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4db815ddd0 0x7f4db815e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.686+0000 7f4dbe0b1700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da0004850 0x7f4db80c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.686+0000 7f4dbe0b1700 1 --2- 172.21.15.5:0/2622837866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4db80c2e80 0x7f4db80c9630 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.686+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2622837866 >> 172.21.15.5:0/2622837866 conn(0x7f4db80cfd00 msgr2=0x7f4db80b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:40.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.686+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2622837866 shutdown_connections 2023-03-03T06:24:40.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.686+0000 7f4dbe0b1700 1 -- 172.21.15.5:0/2622837866 wait complete. 2023-03-03T06:24:40.690 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2023-03-03T06:24:40.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:40.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.822+0000 7f2f8e37b700 1 Processor -- start 2023-03-03T06:24:40.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.823+0000 7f2f8e37b700 1 -- start start 2023-03-03T06:24:40.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.823+0000 7f2f8e37b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f8815cd40 0x7f2f880b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.823+0000 7f2f8e37b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f880cba50 0x7f2f880b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.823+0000 7f2f8e37b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8815d4e0 con 0x7f2f880cd3e0 2023-03-03T06:24:40.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.823+0000 7f2f8e37b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8815d7c0 con 0x7f2f8815cd40 2023-03-03T06:24:40.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.823+0000 7f2f8e37b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8815daa0 con 0x7f2f880cba50 2023-03-03T06:24:40.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.823+0000 7f2f87fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2f8815cd40 0x7f2f880b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.823+0000 7f2f8c918700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2f880cd3e0 0x7f2f88160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32956/0 (socket says 172.21.15.5:32956) 2023-03-03T06:24:40.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.824+0000 7f2f8c918700 1 -- 172.21.15.5:0/3591126878 learned_addr learned my addr 172.21.15.5:0/3591126878 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.824+0000 7f2f877fe700 1 --2- 172.21.15.5:0/3591126878 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f880cba50 0x7f2f880b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.824+0000 7f2f86ffd700 1 -- 172.21.15.5:0/3591126878 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861740072 0 0) 0x7f2f8815d4e0 con 0x7f2f880cd3e0 2023-03-03T06:24:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.824+0000 7f2f86ffd700 1 -- 172.21.15.5:0/3591126878 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f700035b0 con 0x7f2f880cd3e0 2023-03-03T06:24:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.824+0000 7f2f87fff700 1 -- 172.21.15.5:0/3591126878 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f880cba50 msgr2=0x7f2f880b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.824+0000 7f2f87fff700 1 --2- 172.21.15.5:0/3591126878 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f880cba50 0x7f2f880b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.824+0000 7f2f87fff700 1 -- 172.21.15.5:0/3591126878 >> v1:172.21.15.5:6789/0 conn(0x7f2f880cd3e0 legacy=0x7f2f88160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.824+0000 7f2f87fff700 1 -- 172.21.15.5:0/3591126878 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8815dd80 con 0x7f2f8815cd40 2023-03-03T06:24:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.824+0000 7f2f87fff700 1 --2- 172.21.15.5:0/3591126878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f8815cd40 0x7f2f880b18d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009840 tx=0x7f2f78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe8b549ce0aae5e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.824+0000 7f2f86ffd700 1 -- 172.21.15.5:0/3591126878 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78011830 con 0x7f2f8815cd40 2023-03-03T06:24:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.824+0000 7f2f86ffd700 1 -- 172.21.15.5:0/3591126878 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f78011990 con 0x7f2f8815cd40 2023-03-03T06:24:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.824+0000 7f2f86ffd700 1 -- 172.21.15.5:0/3591126878 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78011d20 con 0x7f2f8815cd40 2023-03-03T06:24:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.825+0000 7f2f8e37b700 1 -- 172.21.15.5:0/3591126878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f8815cd40 msgr2=0x7f2f880b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.825+0000 7f2f8e37b700 1 --2- 172.21.15.5:0/3591126878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f8815cd40 0x7f2f880b18d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009840 tx=0x7f2f78009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:40.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.825+0000 7f2f8e37b700 1 -- 172.21.15.5:0/3591126878 shutdown_connections 2023-03-03T06:24:40.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.825+0000 7f2f8e37b700 1 --2- 172.21.15.5:0/3591126878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f8815cd40 0x7f2f880b18d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.825+0000 7f2f8e37b700 1 --2- 172.21.15.5:0/3591126878 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f880cba50 0x7f2f880b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.825+0000 7f2f8e37b700 1 -- 172.21.15.5:0/3591126878 >> 172.21.15.5:0/3591126878 conn(0x7f2f880cc8d0 msgr2=0x7f2f880cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:40.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.825+0000 7f2f8e37b700 1 -- 172.21.15.5:0/3591126878 shutdown_connections 2023-03-03T06:24:40.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.825+0000 7f2f8e37b700 1 -- 172.21.15.5:0/3591126878 wait complete. 2023-03-03T06:24:40.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.826+0000 7f2f8e37b700 1 Processor -- start 2023-03-03T06:24:40.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.826+0000 7f2f8e37b700 1 -- start start 2023-03-03T06:24:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8e37b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f880cba50 0x7f2f88153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8e37b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f880cd3e0 0x7f2f880ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8e37b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f8815cd40 0x7f2f880b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8e37b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880c5c90 con 0x7f2f8815cd40 2023-03-03T06:24:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8e37b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880abb00 con 0x7f2f880cd3e0 2023-03-03T06:24:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8e37b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880c53f0 con 0x7f2f880cba50 2023-03-03T06:24:40.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8c918700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f8815cd40 0x7f2f880b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8c918700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f8815cd40 0x7f2f880b4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43124/0 (socket says 172.21.15.5:43124) 2023-03-03T06:24:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8c918700 1 -- 172.21.15.5:0/2444653640 learned_addr learned my addr 172.21.15.5:0/2444653640 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f87fff700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f880cba50 0x7f2f88153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f877fe700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f880cd3e0 0x7f2f880ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8c918700 1 -- 172.21.15.5:0/2444653640 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f880cba50 msgr2=0x7f2f88153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8c918700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f880cba50 0x7f2f88153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8c918700 1 -- 172.21.15.5:0/2444653640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f880cd3e0 msgr2=0x7f2f880ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8c918700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f880cd3e0 0x7f2f880ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f8c918700 1 -- 172.21.15.5:0/2444653640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f780094a0 con 0x7f2f8815cd40 2023-03-03T06:24:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.827+0000 7f2f877fe700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f880cd3e0 0x7f2f880ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.828+0000 7f2f8c918700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f8815cd40 0x7f2f880b4e30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000cb40 tx=0x7f2f8000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.828+0000 7f2f84ff9700 1 -- 172.21.15.5:0/2444653640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000aaa0 con 0x7f2f8815cd40 2023-03-03T06:24:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.828+0000 7f2f84ff9700 1 -- 172.21.15.5:0/2444653640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8000ac00 con 0x7f2f8815cd40 2023-03-03T06:24:40.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.828+0000 7f2f84ff9700 1 -- 172.21.15.5:0/2444653640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80012400 con 0x7f2f8815cd40 2023-03-03T06:24:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.828+0000 7f2f8e37b700 1 -- 172.21.15.5:0/2444653640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f880ca530 con 0x7f2f8815cd40 2023-03-03T06:24:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.828+0000 7f2f8e37b700 1 -- 172.21.15.5:0/2444653640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8815e060 con 0x7f2f8815cd40 2023-03-03T06:24:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.829+0000 7f2f8e37b700 1 -- 172.21.15.5:0/2444653640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8815d110 con 0x7f2f8815cd40 2023-03-03T06:24:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.829+0000 7f2f84ff9700 1 -- 172.21.15.5:0/2444653640 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2f80019030 con 0x7f2f8815cd40 2023-03-03T06:24:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.829+0000 7f2f84ff9700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2f740682f0 0x7f2f7406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.830+0000 7f2f84ff9700 1 -- 172.21.15.5:0/2444653640 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2f80085ba0 con 0x7f2f8815cd40 2023-03-03T06:24:40.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.830+0000 7f2f87fff700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2f740682f0 0x7f2f7406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:40.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.830+0000 7f2f87fff700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2f740682f0 0x7f2f7406a7a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f78000c00 tx=0x7f2f7801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:40.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:40.834+0000 7f2f84ff9700 1 -- 172.21.15.5:0/2444653640 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2f800520d0 con 0x7f2f8815cd40 2023-03-03T06:24:41.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.027+0000 7f2f8e37b700 1 -- 172.21.15.5:0/2444653640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f880ab8d0 con 0x7f2f8815cd40 2023-03-03T06:24:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.028+0000 7f2f84ff9700 1 -- 172.21.15.5:0/2444653640 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19641 (secure 0 0 0) 0x7f2f880ab8d0 con 0x7f2f8815cd40 2023-03-03T06:24:41.031 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:41.031 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:24:28.893239+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.031+0000 7f2f8e37b700 1 -- 172.21.15.5:0/2444653640 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2f740682f0 msgr2=0x7f2f7406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.031+0000 7f2f8e37b700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2f740682f0 0x7f2f7406a7a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f78000c00 tx=0x7f2f7801c040 comp rx=0 tx=0).stop 2023-03-03T06:24:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.031+0000 7f2f8e37b700 1 -- 172.21.15.5:0/2444653640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f8815cd40 msgr2=0x7f2f880b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.031+0000 7f2f8e37b700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f8815cd40 0x7f2f880b4e30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000cb40 tx=0x7f2f8000ce50 comp rx=0 tx=0).stop 2023-03-03T06:24:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.031+0000 7f2f8e37b700 1 -- 172.21.15.5:0/2444653640 shutdown_connections 2023-03-03T06:24:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.031+0000 7f2f8e37b700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2f8815cd40 0x7f2f880b4e30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.031+0000 7f2f8e37b700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2f740682f0 0x7f2f7406a7a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.031+0000 7f2f8e37b700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2f880cba50 0x7f2f88153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.031+0000 7f2f8e37b700 1 --2- 172.21.15.5:0/2444653640 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f880cd3e0 0x7f2f880ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.031+0000 7f2f8e37b700 1 -- 172.21.15.5:0/2444653640 >> 172.21.15.5:0/2444653640 conn(0x7f2f880cc8d0 msgr2=0x7f2f880af490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.031+0000 7f2f8e37b700 1 -- 172.21.15.5:0/2444653640 shutdown_connections 2023-03-03T06:24:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.031+0000 7f2f8e37b700 1 -- 172.21.15.5:0/2444653640 wait complete. 2023-03-03T06:24:41.045 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-03-03T06:24:41.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:24:41.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.168+0000 7f066daf8700 1 Processor -- start 2023-03-03T06:24:41.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.168+0000 7f066daf8700 1 -- start start 2023-03-03T06:24:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f066daf8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680cb710 0x7f06680cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f066daf8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06680cff20 0x7f06680b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f066daf8700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f06680cbae0 0x7f06680b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f066daf8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06680cd820 con 0x7f06680cff20 2023-03-03T06:24:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f066daf8700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066815f2a0 con 0x7f06680cbae0 2023-03-03T06:24:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f066daf8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06680cf550 con 0x7f06680cb710 2023-03-03T06:24:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f0666ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06680cff20 0x7f06680b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f0666ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06680cff20 0x7f06680b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43128/0 (socket says 172.21.15.5:43128) 2023-03-03T06:24:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f0666ffd700 1 -- 172.21.15.5:0/38838931 learned_addr learned my addr 172.21.15.5:0/38838931 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f0667fff700 1 --2- 172.21.15.5:0/38838931 >> v2:172.21.15.191:3300/0 conn(0x7f06680cbae0 0x7f06680b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f0666ffd700 1 -- 172.21.15.5:0/38838931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680cb710 msgr2=0x7f06680cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f06677fe700 1 --2- 172.21.15.5:0/38838931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680cb710 0x7f06680cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f0666ffd700 1 --2- 172.21.15.5:0/38838931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680cb710 0x7f06680cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f0666ffd700 1 -- 172.21.15.5:0/38838931 >> v2:172.21.15.191:3300/0 conn(0x7f06680cbae0 msgr2=0x7f06680b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f0666ffd700 1 --2- 172.21.15.5:0/38838931 >> v2:172.21.15.191:3300/0 conn(0x7f06680cbae0 0x7f06680b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f0666ffd700 1 -- 172.21.15.5:0/38838931 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066815efc0 con 0x7f06680cff20 2023-03-03T06:24:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.169+0000 7f0667fff700 1 --2- 172.21.15.5:0/38838931 >> v2:172.21.15.191:3300/0 conn(0x7f06680cbae0 0x7f06680b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.170+0000 7f0666ffd700 1 --2- 172.21.15.5:0/38838931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06680cff20 0x7f06680b3ca0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f066808a280 tx=0x7f0650009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff170d0e085c097d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.170+0000 7f06667fc700 1 -- 172.21.15.5:0/38838931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065000b870 con 0x7f06680cff20 2023-03-03T06:24:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.170+0000 7f06667fc700 1 -- 172.21.15.5:0/38838931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065000b9d0 con 0x7f06680cff20 2023-03-03T06:24:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.170+0000 7f06667fc700 1 -- 172.21.15.5:0/38838931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065000bd60 con 0x7f06680cff20 2023-03-03T06:24:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.170+0000 7f066daf8700 1 -- 172.21.15.5:0/38838931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06680cff20 msgr2=0x7f06680b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.170+0000 7f066daf8700 1 --2- 172.21.15.5:0/38838931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06680cff20 0x7f06680b3ca0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f066808a280 tx=0x7f0650009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.170+0000 7f066daf8700 1 -- 172.21.15.5:0/38838931 shutdown_connections 2023-03-03T06:24:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.170+0000 7f066daf8700 1 --2- 172.21.15.5:0/38838931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680cb710 0x7f06680cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.170+0000 7f066daf8700 1 --2- 172.21.15.5:0/38838931 >> v2:172.21.15.191:3300/0 conn(0x7f06680cbae0 0x7f06680b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.170+0000 7f066daf8700 1 --2- 172.21.15.5:0/38838931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06680cff20 0x7f06680b3ca0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.170+0000 7f066daf8700 1 -- 172.21.15.5:0/38838931 >> 172.21.15.5:0/38838931 conn(0x7f0668070050 msgr2=0x7f0668070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:41.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.170+0000 7f066daf8700 1 -- 172.21.15.5:0/38838931 shutdown_connections 2023-03-03T06:24:41.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.170+0000 7f066daf8700 1 -- 172.21.15.5:0/38838931 wait complete. 2023-03-03T06:24:41.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.172+0000 7f066daf8700 1 Processor -- start 2023-03-03T06:24:41.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.172+0000 7f066daf8700 1 -- start start 2023-03-03T06:24:41.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f066daf8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680cb710 0x7f0668157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f066daf8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06680cbae0 0x7f06680cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f066daf8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06680cff20 0x7f06680cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f066daf8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066815b7c0 con 0x7f06680cbae0 2023-03-03T06:24:41.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f066daf8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066815baa0 con 0x7f06680cff20 2023-03-03T06:24:41.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f066daf8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066815bd80 con 0x7f06680cb710 2023-03-03T06:24:41.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f0666ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06680cbae0 0x7f06680cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f0666ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06680cbae0 0x7f06680cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43136/0 (socket says 172.21.15.5:43136) 2023-03-03T06:24:41.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f0666ffd700 1 -- 172.21.15.5:0/941314533 learned_addr learned my addr 172.21.15.5:0/941314533 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:41.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f06677fe700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680cb710 0x7f0668157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f0667fff700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06680cff20 0x7f06680cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f0666ffd700 1 -- 172.21.15.5:0/941314533 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680cb710 msgr2=0x7f0668157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f0666ffd700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680cb710 0x7f0668157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f0666ffd700 1 -- 172.21.15.5:0/941314533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06680cff20 msgr2=0x7f06680cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f0666ffd700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06680cff20 0x7f06680cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f0666ffd700 1 -- 172.21.15.5:0/941314533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0650009550 con 0x7f06680cbae0 2023-03-03T06:24:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f0667fff700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06680cff20 0x7f06680cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f0666ffd700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06680cbae0 0x7f06680cd960 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0650014040 tx=0x7f0650004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f065ffff700 1 -- 172.21.15.5:0/941314533 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650004520 con 0x7f06680cbae0 2023-03-03T06:24:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f065ffff700 1 -- 172.21.15.5:0/941314533 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065001e070 con 0x7f06680cbae0 2023-03-03T06:24:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f065ffff700 1 -- 172.21.15.5:0/941314533 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500038e0 con 0x7f06680cbae0 2023-03-03T06:24:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.173+0000 7f066daf8700 1 -- 172.21.15.5:0/941314533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06680cf1e0 con 0x7f06680cbae0 2023-03-03T06:24:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.174+0000 7f066daf8700 1 -- 172.21.15.5:0/941314533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06680cef00 con 0x7f06680cbae0 2023-03-03T06:24:41.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.174+0000 7f066daf8700 1 -- 172.21.15.5:0/941314533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066815e3b0 con 0x7f06680cbae0 2023-03-03T06:24:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.175+0000 7f065ffff700 1 -- 172.21.15.5:0/941314533 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f065000f050 con 0x7f06680cbae0 2023-03-03T06:24:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.175+0000 7f065ffff700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f06480682f0 0x7f064806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.175+0000 7f065ffff700 1 -- 172.21.15.5:0/941314533 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0650020070 con 0x7f06680cbae0 2023-03-03T06:24:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.175+0000 7f06677fe700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f06480682f0 0x7f064806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.176+0000 7f06677fe700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f06480682f0 0x7f064806a7a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f065800aa30 tx=0x7f0658008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:41.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.179+0000 7f065ffff700 1 -- 172.21.15.5:0/941314533 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0650053b00 con 0x7f06680cbae0 2023-03-03T06:24:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.419+0000 7f066daf8700 1 -- 172.21.15.5:0/941314533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06680c5d80 con 0x7f06680cbae0 2023-03-03T06:24:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.419+0000 7f065ffff700 1 -- 172.21.15.5:0/941314533 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4638 (secure 0 0 0) 0x7f0650015090 con 0x7f06680cbae0 2023-03-03T06:24:41.423 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:41.423 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/277386051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":277386051},{"type":"v1","addr":"172.21.15.5:6837","nonce":277386051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2875199515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2875199515},{"type":"v1","addr":"172.21.15.191:6835","nonce":2875199515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2122425608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2122425608},{"type":"v1","addr":"172.21.15.191:6833","nonce":2122425608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:23:40.315678+0000","modified":"2023-03-03T06:23:58.532900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/305842942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":305842942},{"type":"v1","addr":"172.21.15.5:6836","nonce":305842942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-03T06:24:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.422+0000 7f066daf8700 1 -- 172.21.15.5:0/941314533 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f06480682f0 msgr2=0x7f064806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.422+0000 7f066daf8700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f06480682f0 0x7f064806a7a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f065800aa30 tx=0x7f0658008040 comp rx=0 tx=0).stop 2023-03-03T06:24:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.422+0000 7f066daf8700 1 -- 172.21.15.5:0/941314533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06680cbae0 msgr2=0x7f06680cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.422+0000 7f066daf8700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06680cbae0 0x7f06680cd960 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0650014040 tx=0x7f0650004750 comp rx=0 tx=0).stop 2023-03-03T06:24:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.422+0000 7f066daf8700 1 -- 172.21.15.5:0/941314533 shutdown_connections 2023-03-03T06:24:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.422+0000 7f066daf8700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06680cff20 0x7f06680cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.422+0000 7f066daf8700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f06480682f0 0x7f064806a7a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.422+0000 7f066daf8700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06680cb710 0x7f0668157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.422+0000 7f066daf8700 1 --2- 172.21.15.5:0/941314533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06680cbae0 0x7f06680cd960 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.422+0000 7f066daf8700 1 -- 172.21.15.5:0/941314533 >> 172.21.15.5:0/941314533 conn(0x7f0668070050 msgr2=0x7f066815e800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.422+0000 7f066daf8700 1 -- 172.21.15.5:0/941314533 shutdown_connections 2023-03-03T06:24:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.422+0000 7f066daf8700 1 -- 172.21.15.5:0/941314533 wait complete. 2023-03-03T06:24:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2023-03-03T06:24:41.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:24:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.559+0000 7fd56275e700 1 Processor -- start 2023-03-03T06:24:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.559+0000 7fd56275e700 1 -- start start 2023-03-03T06:24:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.560+0000 7fd56275e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd55c1573f0 0x7fd55c15d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.560+0000 7fd56275e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd55c0b18d0 0x7fd55c0b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.560+0000 7fd56275e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55c1577c0 con 0x7fd55c0cc1a0 2023-03-03T06:24:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.560+0000 7fd56275e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55c0cd790 con 0x7fd55c1573f0 2023-03-03T06:24:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.560+0000 7fd56275e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55c159e60 con 0x7fd55c0b18d0 2023-03-03T06:24:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.560+0000 7fd55bfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd55c1573f0 0x7fd55c15d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.560+0000 7fd55bfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd55c1573f0 0x7fd55c15d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43142/0 (socket says 172.21.15.5:43142) 2023-03-03T06:24:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.560+0000 7fd55bfff700 1 -- 172.21.15.5:0/501952312 learned_addr learned my addr 172.21.15.5:0/501952312 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.560+0000 7fd560cfb700 1 --2- 172.21.15.5:0/501952312 >> v2:172.21.15.191:3300/0 conn(0x7fd55c0b18d0 0x7fd55c0b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd55bfff700 1 -- 172.21.15.5:0/501952312 >> v2:172.21.15.191:3300/0 conn(0x7fd55c0b18d0 msgr2=0x7fd55c0b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd55bfff700 1 --2- 172.21.15.5:0/501952312 >> v2:172.21.15.191:3300/0 conn(0x7fd55c0b18d0 0x7fd55c0b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd55bfff700 1 -- 172.21.15.5:0/501952312 >> v1:172.21.15.191:6789/0 conn(0x7fd55c0cc1a0 legacy=0x7fd55c0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd55bfff700 1 -- 172.21.15.5:0/501952312 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c0ce460 con 0x7fd55c1573f0 2023-03-03T06:24:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd55bfff700 1 --2- 172.21.15.5:0/501952312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c1573f0 0x7fd55c15d320 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd55c070dc0 tx=0x7fd54c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23694a589d7b6eb4 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd55affd700 1 -- 172.21.15.5:0/501952312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c004230 con 0x7fd55c1573f0 2023-03-03T06:24:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd55affd700 1 -- 172.21.15.5:0/501952312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c004390 con 0x7fd55c1573f0 2023-03-03T06:24:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd55affd700 1 -- 172.21.15.5:0/501952312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0036a0 con 0x7fd55c1573f0 2023-03-03T06:24:41.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd56275e700 1 -- 172.21.15.5:0/501952312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c1573f0 msgr2=0x7fd55c15d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd56275e700 1 --2- 172.21.15.5:0/501952312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c1573f0 0x7fd55c15d320 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd55c070dc0 tx=0x7fd54c009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd56275e700 1 -- 172.21.15.5:0/501952312 shutdown_connections 2023-03-03T06:24:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd56275e700 1 --2- 172.21.15.5:0/501952312 >> v2:172.21.15.191:3300/0 conn(0x7fd55c0b18d0 0x7fd55c0b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd56275e700 1 --2- 172.21.15.5:0/501952312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c1573f0 0x7fd55c15d320 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd56275e700 1 -- 172.21.15.5:0/501952312 >> 172.21.15.5:0/501952312 conn(0x7fd55c0cc8d0 msgr2=0x7fd55c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd56275e700 1 -- 172.21.15.5:0/501952312 shutdown_connections 2023-03-03T06:24:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.561+0000 7fd56275e700 1 -- 172.21.15.5:0/501952312 wait complete. 2023-03-03T06:24:41.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.563+0000 7fd56275e700 1 Processor -- start 2023-03-03T06:24:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.563+0000 7fd56275e700 1 -- start start 2023-03-03T06:24:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd56275e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c0b18d0 0x7fd55c15be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd56275e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd55c0cc1a0 0x7fd55c14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd56275e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd55c1573f0 0x7fd55c0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd56275e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c14ecf0 con 0x7fd55c0b18d0 2023-03-03T06:24:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd56275e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c0c4cc0 con 0x7fd55c0cc1a0 2023-03-03T06:24:41.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd56275e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c0c5550 con 0x7fd55c1573f0 2023-03-03T06:24:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd55bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c0b18d0 0x7fd55c15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd55bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c0b18d0 0x7fd55c15be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43146/0 (socket says 172.21.15.5:43146) 2023-03-03T06:24:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd55bfff700 1 -- 172.21.15.5:0/1888172039 learned_addr learned my addr 172.21.15.5:0/1888172039 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd560cfb700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd55c1573f0 0x7fd55c0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd55b7fe700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd55c0cc1a0 0x7fd55c14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd55bfff700 1 -- 172.21.15.5:0/1888172039 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd55c1573f0 msgr2=0x7fd55c0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd55bfff700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd55c1573f0 0x7fd55c0b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd55bfff700 1 -- 172.21.15.5:0/1888172039 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd55c0cc1a0 msgr2=0x7fd55c14e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd55bfff700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd55c0cc1a0 0x7fd55c14e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.564+0000 7fd55bfff700 1 -- 172.21.15.5:0/1888172039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c009550 con 0x7fd55c0b18d0 2023-03-03T06:24:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.565+0000 7fd55bfff700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c0b18d0 0x7fd55c15be90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd55c071050 tx=0x7fd54c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.565+0000 7fd558ff9700 1 -- 172.21.15.5:0/1888172039 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c003b90 con 0x7fd55c0b18d0 2023-03-03T06:24:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.565+0000 7fd558ff9700 1 -- 172.21.15.5:0/1888172039 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c01f070 con 0x7fd55c0b18d0 2023-03-03T06:24:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.565+0000 7fd56275e700 1 -- 172.21.15.5:0/1888172039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55c15d900 con 0x7fd55c0b18d0 2023-03-03T06:24:41.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.565+0000 7fd558ff9700 1 -- 172.21.15.5:0/1888172039 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c011630 con 0x7fd55c0b18d0 2023-03-03T06:24:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.566+0000 7fd56275e700 1 -- 172.21.15.5:0/1888172039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55c0b2210 con 0x7fd55c0b18d0 2023-03-03T06:24:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.566+0000 7fd56275e700 1 -- 172.21.15.5:0/1888172039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55c15dbe0 con 0x7fd55c0b18d0 2023-03-03T06:24:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.567+0000 7fd558ff9700 1 -- 172.21.15.5:0/1888172039 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd54c017020 con 0x7fd55c0b18d0 2023-03-03T06:24:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.567+0000 7fd558ff9700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd53c0682f0 0x7fd53c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.568+0000 7fd558ff9700 1 -- 172.21.15.5:0/1888172039 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd54c087710 con 0x7fd55c0b18d0 2023-03-03T06:24:41.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.568+0000 7fd55b7fe700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd53c0682f0 0x7fd53c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.568+0000 7fd55b7fe700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd53c0682f0 0x7fd53c06a7a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd55c156d20 tx=0x7fd544007f10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:41.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.572+0000 7fd558ff9700 1 -- 172.21.15.5:0/1888172039 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd54c053ad0 con 0x7fd55c0b18d0 2023-03-03T06:24:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.809+0000 7fd56275e700 1 -- 172.21.15.5:0/1888172039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd55c04e6e0 con 0x7fd55c0b18d0 2023-03-03T06:24:41.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.810+0000 7fd558ff9700 1 -- 172.21.15.5:0/1888172039 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4638 (secure 0 0 0) 0x7fd54c0570f0 con 0x7fd55c0b18d0 2023-03-03T06:24:41.812 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:41.812 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/277386051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":277386051},{"type":"v1","addr":"172.21.15.5:6837","nonce":277386051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/2875199515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":2875199515},{"type":"v1","addr":"172.21.15.191:6835","nonce":2875199515}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/2122425608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":2122425608},{"type":"v1","addr":"172.21.15.191:6833","nonce":2122425608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:23:40.315678+0000","modified":"2023-03-03T06:23:58.532900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/305842942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":305842942},{"type":"v1","addr":"172.21.15.5:6836","nonce":305842942}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-03-03T06:24:41.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.812+0000 7fd56275e700 1 -- 172.21.15.5:0/1888172039 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd53c0682f0 msgr2=0x7fd53c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.812+0000 7fd56275e700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd53c0682f0 0x7fd53c06a7a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd55c156d20 tx=0x7fd544007f10 comp rx=0 tx=0).stop 2023-03-03T06:24:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.812+0000 7fd56275e700 1 -- 172.21.15.5:0/1888172039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c0b18d0 msgr2=0x7fd55c15be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.812+0000 7fd56275e700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c0b18d0 0x7fd55c15be90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd55c071050 tx=0x7fd54c004750 comp rx=0 tx=0).stop 2023-03-03T06:24:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.812+0000 7fd56275e700 1 -- 172.21.15.5:0/1888172039 shutdown_connections 2023-03-03T06:24:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.812+0000 7fd56275e700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd53c0682f0 0x7fd53c06a7a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.812+0000 7fd56275e700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd55c1573f0 0x7fd55c0b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.812+0000 7fd56275e700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd55c0b18d0 0x7fd55c15be90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.812+0000 7fd56275e700 1 --2- 172.21.15.5:0/1888172039 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd55c0cc1a0 0x7fd55c14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.812+0000 7fd56275e700 1 -- 172.21.15.5:0/1888172039 >> 172.21.15.5:0/1888172039 conn(0x7fd55c0cc8d0 msgr2=0x7fd55c0cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:41.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.812+0000 7fd56275e700 1 -- 172.21.15.5:0/1888172039 shutdown_connections 2023-03-03T06:24:41.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.812+0000 7fd56275e700 1 -- 172.21.15.5:0/1888172039 wait complete. 2023-03-03T06:24:41.816 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2023-03-03T06:24:41.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:41.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.948+0000 7f6ed6eca700 1 Processor -- start 2023-03-03T06:24:41.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.948+0000 7f6ed6eca700 1 -- start start 2023-03-03T06:24:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.949+0000 7f6ed6eca700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6ed0156f50 0x7f6ed006df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.949+0000 7f6ed6eca700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ed00cf700 0x7f6ed00cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.949+0000 7f6ed6eca700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed0157320 con 0x7f6ed00cac40 2023-03-03T06:24:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.949+0000 7f6ed6eca700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed00cb620 con 0x7f6ed0156f50 2023-03-03T06:24:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.949+0000 7f6ed6eca700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed015d1c0 con 0x7f6ed00cf700 2023-03-03T06:24:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.949+0000 7f6ecffff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6ed00cac40 0x7f6ed006f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:32996/0 (socket says 172.21.15.5:32996) 2023-03-03T06:24:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.949+0000 7f6ecffff700 1 -- 172.21.15.5:0/3190782082 learned_addr learned my addr 172.21.15.5:0/3190782082 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:41.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ed5467700 1 --2- 172.21.15.5:0/3190782082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ed00cf700 0x7f6ed00cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ed4c66700 1 --2- 172.21.15.5:0/3190782082 >> v2:172.21.15.191:3300/0 conn(0x7f6ed0156f50 0x7f6ed006df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020424442 0 0) 0x7f6ed0157320 con 0x7f6ed00cac40 2023-03-03T06:24:41.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ec00035b0 con 0x7f6ed00cac40 2023-03-03T06:24:41.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1549319962 0 0) 0x7f6ec00035b0 con 0x7f6ed00cac40 2023-03-03T06:24:41.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ed00cf700 msgr2=0x7f6ed00cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:41.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 --2- 172.21.15.5:0/3190782082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ed00cf700 0x7f6ed00cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 >> v2:172.21.15.191:3300/0 conn(0x7f6ed0156f50 msgr2=0x7f6ed006df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 --2- 172.21.15.5:0/3190782082 >> v2:172.21.15.191:3300/0 conn(0x7f6ed0156f50 0x7f6ed006df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed015d4a0 con 0x7f6ed00cac40 2023-03-03T06:24:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f6ebc001670 con 0x7f6ed00cac40 2023-03-03T06:24:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 >> v1:172.21.15.5:6789/0 conn(0x7f6ed00cac40 legacy=0x7f6ed006f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 --2- 172.21.15.5:0/3190782082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ed00cf700 0x7f6ec0003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 --2- 172.21.15.5:0/3190782082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ec0003ff0 0x7f6ec0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 --2- 172.21.15.5:0/3190782082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec0004d90 0x7f6ec0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed015d1c0 con 0x7f6ec0004d90 2023-03-03T06:24:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec000ba10 con 0x7f6ec0003ff0 2023-03-03T06:24:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec000bb50 con 0x7f6ed00cf700 2023-03-03T06:24:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ed5467700 1 --2- 172.21.15.5:0/3190782082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec0004d90 0x7f6ec0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ed4c66700 1 --2- 172.21.15.5:0/3190782082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ed00cf700 0x7f6ec0003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecffff700 1 --2- 172.21.15.5:0/3190782082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ec0003ff0 0x7f6ec0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ed5467700 1 -- 172.21.15.5:0/3190782082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ed00cf700 msgr2=0x7f6ec0003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:41.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ed5467700 1 --2- 172.21.15.5:0/3190782082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ed00cf700 0x7f6ec0003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ed5467700 1 -- 172.21.15.5:0/3190782082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ec0003ff0 msgr2=0x7f6ec0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ed5467700 1 --2- 172.21.15.5:0/3190782082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ec0003ff0 0x7f6ec0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ed5467700 1 -- 172.21.15.5:0/3190782082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00035b0 con 0x7f6ec0004d90 2023-03-03T06:24:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.950+0000 7f6ecffff700 1 --2- 172.21.15.5:0/3190782082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ec0003ff0 0x7f6ec0004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.951+0000 7f6ed5467700 1 --2- 172.21.15.5:0/3190782082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec0004d90 0x7f6ec0005200 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800e170 tx=0x7f6ec0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f16e3d09333ea16 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.951+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec800ec90 con 0x7f6ec0004d90 2023-03-03T06:24:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.951+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec800f040 con 0x7f6ec0004d90 2023-03-03T06:24:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.951+0000 7f6ecf7fe700 1 -- 172.21.15.5:0/3190782082 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8014480 con 0x7f6ec0004d90 2023-03-03T06:24:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.951+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3190782082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec0004d90 msgr2=0x7f6ec0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.951+0000 7f6ed6eca700 1 --2- 172.21.15.5:0/3190782082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ec0004d90 0x7f6ec0005200 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800e170 tx=0x7f6ec0005880 comp rx=0 tx=0).stop 2023-03-03T06:24:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.951+0000 7f6ed5467700 1 -- 172.21.15.5:0/3190782082 reap_dead start 2023-03-03T06:24:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.951+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3190782082 shutdown_connections 2023-03-03T06:24:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.951+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3190782082 >> 172.21.15.5:0/3190782082 conn(0x7f6ed00cfd00 msgr2=0x7f6ed00d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.951+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3190782082 shutdown_connections 2023-03-03T06:24:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.951+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3190782082 wait complete. 2023-03-03T06:24:41.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.953+0000 7f6ed6eca700 1 Processor -- start 2023-03-03T06:24:41.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.953+0000 7f6ed6eca700 1 -- start start 2023-03-03T06:24:41.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.953+0000 7f6ed6eca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed0155740 0x7f6ed00b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.953+0000 7f6ed6eca700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ed00b57f0 0x7f6ed00c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.953+0000 7f6ed6eca700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ed00c8a10 0x7f6ed00c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.953+0000 7f6ed6eca700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00c9d40 con 0x7f6ed0155740 2023-03-03T06:24:41.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.953+0000 7f6ed6eca700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00c94a0 con 0x7f6ed00b57f0 2023-03-03T06:24:41.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.953+0000 7f6ed6eca700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00c9780 con 0x7f6ed00c8a10 2023-03-03T06:24:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ed4c66700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed0155740 0x7f6ed00b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ed4c66700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed0155740 0x7f6ed00b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43166/0 (socket says 172.21.15.5:43166) 2023-03-03T06:24:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ed4c66700 1 -- 172.21.15.5:0/3436645284 learned_addr learned my addr 172.21.15.5:0/3436645284 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:41.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ecffff700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ed00b57f0 0x7f6ed00c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ed5467700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ed00c8a10 0x7f6ed00c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ed4c66700 1 -- 172.21.15.5:0/3436645284 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ed00c8a10 msgr2=0x7f6ed00c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ed4c66700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ed00c8a10 0x7f6ed00c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ed4c66700 1 -- 172.21.15.5:0/3436645284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ed00b57f0 msgr2=0x7f6ed00c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ed4c66700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ed00b57f0 0x7f6ed00c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ed4c66700 1 -- 172.21.15.5:0/3436645284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed015da60 con 0x7f6ed0155740 2023-03-03T06:24:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ed4c66700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed0155740 0x7f6ed00b52b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4011aa0 tx=0x7f6ec4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ecd7fa700 1 -- 172.21.15.5:0/3436645284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec400f9e0 con 0x7f6ed0155740 2023-03-03T06:24:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ecd7fa700 1 -- 172.21.15.5:0/3436645284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400fb40 con 0x7f6ed0155740 2023-03-03T06:24:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3436645284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed015d780 con 0x7f6ed0155740 2023-03-03T06:24:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ecd7fa700 1 -- 172.21.15.5:0/3436645284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4014440 con 0x7f6ed0155740 2023-03-03T06:24:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.954+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3436645284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed015ce90 con 0x7f6ed0155740 2023-03-03T06:24:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.955+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3436645284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed00cc560 con 0x7f6ed0155740 2023-03-03T06:24:41.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.956+0000 7f6ecd7fa700 1 -- 172.21.15.5:0/3436645284 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6ec401d400 con 0x7f6ed0155740 2023-03-03T06:24:41.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.956+0000 7f6ecd7fa700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6eb40682f0 0x7f6eb406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:41.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.956+0000 7f6ecd7fa700 1 -- 172.21.15.5:0/3436645284 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6ec4086970 con 0x7f6ed0155740 2023-03-03T06:24:41.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.956+0000 7f6ecffff700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6eb40682f0 0x7f6eb406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:41.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.956+0000 7f6ecffff700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6eb40682f0 0x7f6eb406a7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc001eb0 tx=0x7f6ebc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:41.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:41.960+0000 7f6ecd7fa700 1 -- 172.21.15.5:0/3436645284 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6ec4052e40 con 0x7f6ed0155740 2023-03-03T06:24:42.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.152+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3436645284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ed004e6e0 con 0x7f6ed0155740 2023-03-03T06:24:42.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.153+0000 7f6ecd7fa700 1 -- 172.21.15.5:0/3436645284 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19641 (secure 0 0 0) 0x7f6ec4056460 con 0x7f6ed0155740 2023-03-03T06:24:42.155 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:42.155 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:24:28.893239+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:23:38.141777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-03-03T06:23:39.283589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-03-03T06:23:42.422930+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.155+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3436645284 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6eb40682f0 msgr2=0x7f6eb406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.155+0000 7f6ed6eca700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6eb40682f0 0x7f6eb406a7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc001eb0 tx=0x7f6ebc009040 comp rx=0 tx=0).stop 2023-03-03T06:24:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.155+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3436645284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed0155740 msgr2=0x7f6ed00b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:42.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.155+0000 7f6ed6eca700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed0155740 0x7f6ed00b52b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4011aa0 tx=0x7f6ec4011e60 comp rx=0 tx=0).stop 2023-03-03T06:24:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.155+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3436645284 shutdown_connections 2023-03-03T06:24:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.155+0000 7f6ed6eca700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6eb40682f0 0x7f6eb406a7a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.155+0000 7f6ed6eca700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6ed00c8a10 0x7f6ed00c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.155+0000 7f6ed6eca700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6ed0155740 0x7f6ed00b52b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.155+0000 7f6ed6eca700 1 --2- 172.21.15.5:0/3436645284 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6ed00b57f0 0x7f6ed00c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.155+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3436645284 >> 172.21.15.5:0/3436645284 conn(0x7f6ed00cfd00 msgr2=0x7f6ed00b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:42.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.155+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3436645284 shutdown_connections 2023-03-03T06:24:42.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.155+0000 7f6ed6eca700 1 -- 172.21.15.5:0/3436645284 wait complete. 2023-03-03T06:24:42.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-03-03T06:24:42.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.293+0000 7fca9b05d700 1 Processor -- start 2023-03-03T06:24:42.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.293+0000 7fca9b05d700 1 -- start start 2023-03-03T06:24:42.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca9b05d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca940b87b0 0x7fca94160d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:42.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca9b05d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca940d2b60 0x7fca940b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:42.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca9b05d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fca940b5010 0x7fca9406a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:42.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca9b05d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca940cf2a0 con 0x7fca940b87b0 2023-03-03T06:24:42.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca9b05d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca94161240 con 0x7fca940b5010 2023-03-03T06:24:42.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca9b05d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca940b5420 con 0x7fca940d2b60 2023-03-03T06:24:42.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca98df9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca940b87b0 0x7fca94160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:42.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca98df9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca940b87b0 0x7fca94160d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43174/0 (socket says 172.21.15.5:43174) 2023-03-03T06:24:42.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca98df9700 1 -- 172.21.15.5:0/69834308 learned_addr learned my addr 172.21.15.5:0/69834308 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:42.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca93fff700 1 --2- 172.21.15.5:0/69834308 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca940d2b60 0x7fca940b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:42.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca995fa700 1 --2- 172.21.15.5:0/69834308 >> v2:172.21.15.191:3300/0 conn(0x7fca940b5010 0x7fca9406a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:42.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca98df9700 1 -- 172.21.15.5:0/69834308 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca940d2b60 msgr2=0x7fca940b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:42.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca98df9700 1 --2- 172.21.15.5:0/69834308 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca940d2b60 0x7fca940b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:42.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca98df9700 1 -- 172.21.15.5:0/69834308 >> v2:172.21.15.191:3300/0 conn(0x7fca940b5010 msgr2=0x7fca9406a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:42.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca98df9700 1 --2- 172.21.15.5:0/69834308 >> v2:172.21.15.191:3300/0 conn(0x7fca940b5010 0x7fca9406a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:42.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca98df9700 1 -- 172.21.15.5:0/69834308 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca940cf520 con 0x7fca940b87b0 2023-03-03T06:24:42.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca995fa700 1 --2- 172.21.15.5:0/69834308 >> v2:172.21.15.191:3300/0 conn(0x7fca940b5010 0x7fca9406a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:42.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.294+0000 7fca98df9700 1 --2- 172.21.15.5:0/69834308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca940b87b0 0x7fca94160d00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fca940ca0a0 tx=0x7fca88009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf56899e97adf19 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:42.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.295+0000 7fca937fe700 1 -- 172.21.15.5:0/69834308 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8800b870 con 0x7fca940b87b0 2023-03-03T06:24:42.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.295+0000 7fca937fe700 1 -- 172.21.15.5:0/69834308 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8800b9d0 con 0x7fca940b87b0 2023-03-03T06:24:42.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.295+0000 7fca937fe700 1 -- 172.21.15.5:0/69834308 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8800bd60 con 0x7fca940b87b0 2023-03-03T06:24:42.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.295+0000 7fca9b05d700 1 -- 172.21.15.5:0/69834308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca940b87b0 msgr2=0x7fca94160d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.295+0000 7fca9b05d700 1 --2- 172.21.15.5:0/69834308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca940b87b0 0x7fca94160d00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fca940ca0a0 tx=0x7fca88009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.295+0000 7fca9b05d700 1 -- 172.21.15.5:0/69834308 shutdown_connections 2023-03-03T06:24:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.295+0000 7fca9b05d700 1 --2- 172.21.15.5:0/69834308 >> v2:172.21.15.191:3300/0 conn(0x7fca940b5010 0x7fca9406a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.295+0000 7fca9b05d700 1 --2- 172.21.15.5:0/69834308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca940b87b0 0x7fca94160d00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.295+0000 7fca9b05d700 1 --2- 172.21.15.5:0/69834308 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca940d2b60 0x7fca940b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.295+0000 7fca9b05d700 1 -- 172.21.15.5:0/69834308 >> 172.21.15.5:0/69834308 conn(0x7fca9406d0b0 msgr2=0x7fca940cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.295+0000 7fca9b05d700 1 -- 172.21.15.5:0/69834308 shutdown_connections 2023-03-03T06:24:42.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.295+0000 7fca9b05d700 1 -- 172.21.15.5:0/69834308 wait complete. 2023-03-03T06:24:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.297+0000 7fca9b05d700 1 Processor -- start 2023-03-03T06:24:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.297+0000 7fca9b05d700 1 -- start start 2023-03-03T06:24:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.297+0000 7fca9b05d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca940b5010 0x7fca941515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.297+0000 7fca9b05d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca940b87b0 0x7fca9415c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.297+0000 7fca9b05d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca940d2b60 0x7fca940b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.297+0000 7fca9b05d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca94151b10 con 0x7fca940b5010 2023-03-03T06:24:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.297+0000 7fca9b05d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca940ca4a0 con 0x7fca940b87b0 2023-03-03T06:24:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.297+0000 7fca9b05d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9415cb80 con 0x7fca940d2b60 2023-03-03T06:24:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca98df9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca940b5010 0x7fca941515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca98df9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca940b5010 0x7fca941515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43180/0 (socket says 172.21.15.5:43180) 2023-03-03T06:24:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca98df9700 1 -- 172.21.15.5:0/2091086430 learned_addr learned my addr 172.21.15.5:0/2091086430 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca995fa700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca940d2b60 0x7fca940b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca93fff700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca940b87b0 0x7fca9415c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca98df9700 1 -- 172.21.15.5:0/2091086430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca940d2b60 msgr2=0x7fca940b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca98df9700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca940d2b60 0x7fca940b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca98df9700 1 -- 172.21.15.5:0/2091086430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca940b87b0 msgr2=0x7fca9415c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:42.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca98df9700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca940b87b0 0x7fca9415c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca98df9700 1 -- 172.21.15.5:0/2091086430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca88009550 con 0x7fca940b5010 2023-03-03T06:24:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca995fa700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca940d2b60 0x7fca940b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca93fff700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca940b87b0 0x7fca9415c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:42.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca98df9700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca940b5010 0x7fca941515d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fca88000c00 tx=0x7fca88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca917fa700 1 -- 172.21.15.5:0/2091086430 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88004540 con 0x7fca940b5010 2023-03-03T06:24:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca917fa700 1 -- 172.21.15.5:0/2091086430 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca880036a0 con 0x7fca940b5010 2023-03-03T06:24:42.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca9b05d700 1 -- 172.21.15.5:0/2091086430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca940cd740 con 0x7fca940b5010 2023-03-03T06:24:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca917fa700 1 -- 172.21.15.5:0/2091086430 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88003a50 con 0x7fca940b5010 2023-03-03T06:24:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.298+0000 7fca9b05d700 1 -- 172.21.15.5:0/2091086430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca940cf800 con 0x7fca940b5010 2023-03-03T06:24:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.299+0000 7fca9b05d700 1 -- 172.21.15.5:0/2091086430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca940cda20 con 0x7fca940b5010 2023-03-03T06:24:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.300+0000 7fca917fa700 1 -- 172.21.15.5:0/2091086430 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fca8800f050 con 0x7fca940b5010 2023-03-03T06:24:42.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.300+0000 7fca917fa700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fca780682f0 0x7fca7806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:42.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.300+0000 7fca917fa700 1 -- 172.21.15.5:0/2091086430 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fca88087850 con 0x7fca940b5010 2023-03-03T06:24:42.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.300+0000 7fca93fff700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fca780682f0 0x7fca7806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:42.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.301+0000 7fca93fff700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fca780682f0 0x7fca7806a7a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fca94161160 tx=0x7fca80008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:42.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.304+0000 7fca917fa700 1 -- 172.21.15.5:0/2091086430 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fca88053d80 con 0x7fca940b5010 2023-03-03T06:24:42.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:42.546+0000 7fca9b05d700 1 -- 172.21.15.5:0/2091086430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fca940ca7a0 con 0x7fca940b5010 2023-03-03T06:24:43.405 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T06:24:43.403+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-03-03T06:24:43.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.408+0000 7fca917fa700 1 -- 172.21.15.5:0/2091086430 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fca880573a0 con 0x7fca940b5010 2023-03-03T06:24:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.411+0000 7fca9b05d700 1 -- 172.21.15.5:0/2091086430 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fca780682f0 msgr2=0x7fca7806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.411+0000 7fca9b05d700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fca780682f0 0x7fca7806a7a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fca94161160 tx=0x7fca80008040 comp rx=0 tx=0).stop 2023-03-03T06:24:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.411+0000 7fca9b05d700 1 -- 172.21.15.5:0/2091086430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca940b5010 msgr2=0x7fca941515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:43.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.411+0000 7fca9b05d700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca940b5010 0x7fca941515d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fca88000c00 tx=0x7fca88004750 comp rx=0 tx=0).stop 2023-03-03T06:24:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.411+0000 7fca9b05d700 1 -- 172.21.15.5:0/2091086430 shutdown_connections 2023-03-03T06:24:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.411+0000 7fca9b05d700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fca780682f0 0x7fca7806a7a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.411+0000 7fca9b05d700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca940d2b60 0x7fca940b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.411+0000 7fca9b05d700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca940b5010 0x7fca941515d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.411+0000 7fca9b05d700 1 --2- 172.21.15.5:0/2091086430 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca940b87b0 0x7fca9415c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.411+0000 7fca9b05d700 1 -- 172.21.15.5:0/2091086430 >> 172.21.15.5:0/2091086430 conn(0x7fca9406d0b0 msgr2=0x7fca940b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.411+0000 7fca9b05d700 1 -- 172.21.15.5:0/2091086430 shutdown_connections 2023-03-03T06:24:43.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.411+0000 7fca9b05d700 1 -- 172.21.15.5:0/2091086430 wait complete. 2023-03-03T06:24:43.415 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-03-03T06:24:43.415 INFO:tasks.ceph.mds.a.smithi005.stderr: -5508> 2023-03-03T06:23:46.028+0000 7fe5a6f69700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-03T06:24:43.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-03-03T06:24:43.448 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-03-03T06:24:43.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.562+0000 7f5bc0ef7700 1 Processor -- start 2023-03-03T06:24:43.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.563+0000 7f5bc0ef7700 1 -- start start 2023-03-03T06:24:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.563+0000 7f5bc0ef7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5bbc0b1960 0x7f5bbc06cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.563+0000 7f5bc0ef7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5bbc0cb050 0x7f5bbc0cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.563+0000 7f5bc0ef7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bbc0cb990 con 0x7f5bbc15cd40 2023-03-03T06:24:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.563+0000 7f5bc0ef7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc15d110 con 0x7f5bbc0b1960 2023-03-03T06:24:43.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.563+0000 7f5bc0ef7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc06bf10 con 0x7f5bbc0cb050 2023-03-03T06:24:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.564+0000 7f5bb9d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5bbc0b1960 0x7f5bbc06cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.564+0000 7f5bb9d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5bbc0b1960 0x7f5bbc06cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43202/0 (socket says 172.21.15.5:43202) 2023-03-03T06:24:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.564+0000 7f5bb9d9b700 1 -- 172.21.15.5:0/3763931731 learned_addr learned my addr 172.21.15.5:0/3763931731 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.564+0000 7f5bbad9d700 1 --2- 172.21.15.5:0/3763931731 >> v2:172.21.15.191:3300/0 conn(0x7f5bbc0cb050 0x7f5bbc0cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.564+0000 7f5bb9d9b700 1 -- 172.21.15.5:0/3763931731 >> v2:172.21.15.191:3300/0 conn(0x7f5bbc0cb050 msgr2=0x7f5bbc0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.564+0000 7f5bb9d9b700 1 --2- 172.21.15.5:0/3763931731 >> v2:172.21.15.191:3300/0 conn(0x7f5bbc0cb050 0x7f5bbc0cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:43.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.564+0000 7f5bb9d9b700 1 -- 172.21.15.5:0/3763931731 >> v1:172.21.15.191:6789/0 conn(0x7f5bbc15cd40 legacy=0x7f5bbc06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.564+0000 7f5bb9d9b700 1 -- 172.21.15.5:0/3763931731 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc06c1f0 con 0x7f5bbc0b1960 2023-03-03T06:24:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.564+0000 7f5bb9d9b700 1 --2- 172.21.15.5:0/3763931731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bbc0b1960 0x7f5bbc06cfb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc071b20 tx=0x7f5bac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494f33bf38610401 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.564+0000 7f5bb959a700 1 -- 172.21.15.5:0/3763931731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac004230 con 0x7f5bbc0b1960 2023-03-03T06:24:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.564+0000 7f5bb959a700 1 -- 172.21.15.5:0/3763931731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac004390 con 0x7f5bbc0b1960 2023-03-03T06:24:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.564+0000 7f5bb959a700 1 -- 172.21.15.5:0/3763931731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0036a0 con 0x7f5bbc0b1960 2023-03-03T06:24:43.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.565+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/3763931731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bbc0b1960 msgr2=0x7f5bbc06cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.565+0000 7f5bc0ef7700 1 --2- 172.21.15.5:0/3763931731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bbc0b1960 0x7f5bbc06cfb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc071b20 tx=0x7f5bac009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.565+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/3763931731 shutdown_connections 2023-03-03T06:24:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.565+0000 7f5bc0ef7700 1 --2- 172.21.15.5:0/3763931731 >> v2:172.21.15.191:3300/0 conn(0x7f5bbc0cb050 0x7f5bbc0cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.565+0000 7f5bc0ef7700 1 --2- 172.21.15.5:0/3763931731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bbc0b1960 0x7f5bbc06cfb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.565+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/3763931731 >> 172.21.15.5:0/3763931731 conn(0x7f5bbc0cc8d0 msgr2=0x7f5bbc0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.565+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/3763931731 shutdown_connections 2023-03-03T06:24:43.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.565+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/3763931731 wait complete. 2023-03-03T06:24:43.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.566+0000 7f5bc0ef7700 1 Processor -- start 2023-03-03T06:24:43.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.566+0000 7f5bc0ef7700 1 -- start start 2023-03-03T06:24:43.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.567+0000 7f5bc0ef7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bbc0b1960 0x7f5bbc0ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:43.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.567+0000 7f5bc0ef7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bbc0cb050 0x7f5bbc1f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:43.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.567+0000 7f5bc0ef7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bbc15cd40 0x7f5bbc0b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:43.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.567+0000 7f5bc0ef7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc15e1e0 con 0x7f5bbc0cb050 2023-03-03T06:24:43.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.567+0000 7f5bc0ef7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0abeb0 con 0x7f5bbc0b1960 2023-03-03T06:24:43.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.567+0000 7f5bc0ef7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0ac190 con 0x7f5bbc15cd40 2023-03-03T06:24:43.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.567+0000 7f5bb9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bbc0cb050 0x7f5bbc1f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:43.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.567+0000 7f5bb9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bbc0cb050 0x7f5bbc1f2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43208/0 (socket says 172.21.15.5:43208) 2023-03-03T06:24:43.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.567+0000 7f5bb9d9b700 1 -- 172.21.15.5:0/644122370 learned_addr learned my addr 172.21.15.5:0/644122370 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:43.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.567+0000 7f5bbad9d700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bbc15cd40 0x7f5bbc0b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:43.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.567+0000 7f5bba59c700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bbc0b1960 0x7f5bbc0ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:43.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.568+0000 7f5bb9d9b700 1 -- 172.21.15.5:0/644122370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bbc15cd40 msgr2=0x7f5bbc0b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:43.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.568+0000 7f5bb9d9b700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bbc15cd40 0x7f5bbc0b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:43.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.568+0000 7f5bb9d9b700 1 -- 172.21.15.5:0/644122370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bbc0b1960 msgr2=0x7f5bbc0ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:43.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.568+0000 7f5bb9d9b700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bbc0b1960 0x7f5bbc0ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:43.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.568+0000 7f5bb9d9b700 1 -- 172.21.15.5:0/644122370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac009550 con 0x7f5bbc0cb050 2023-03-03T06:24:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.568+0000 7f5bb9d9b700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bbc0cb050 0x7f5bbc1f2030 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009130 tx=0x7f5bac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.568+0000 7f5baaffd700 1 -- 172.21.15.5:0/644122370 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac003b90 con 0x7f5bbc0cb050 2023-03-03T06:24:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.568+0000 7f5baaffd700 1 -- 172.21.15.5:0/644122370 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac01f070 con 0x7f5bbc0cb050 2023-03-03T06:24:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.568+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/644122370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bbc06c7b0 con 0x7f5bbc0cb050 2023-03-03T06:24:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.568+0000 7f5baaffd700 1 -- 172.21.15.5:0/644122370 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac011630 con 0x7f5bbc0cb050 2023-03-03T06:24:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.568+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/644122370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc06c4d0 con 0x7f5bbc0cb050 2023-03-03T06:24:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.569+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/644122370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bbc06ca90 con 0x7f5bbc0cb050 2023-03-03T06:24:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.569+0000 7f5baaffd700 1 -- 172.21.15.5:0/644122370 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5bac017020 con 0x7f5bbc0cb050 2023-03-03T06:24:43.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.570+0000 7f5baaffd700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5b9c0682f0 0x7f5b9c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:43.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.570+0000 7f5baaffd700 1 -- 172.21.15.5:0/644122370 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f5bac087610 con 0x7f5bbc0cb050 2023-03-03T06:24:43.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.570+0000 7f5bba59c700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5b9c0682f0 0x7f5b9c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:43.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.570+0000 7f5bba59c700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5b9c0682f0 0x7f5b9c06a7a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009960 tx=0x7f5bb00090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:43.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.575+0000 7f5baaffd700 1 -- 172.21.15.5:0/644122370 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5bac053a70 con 0x7f5bbc0cb050 2023-03-03T06:24:43.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:43.812+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/644122370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5bbc15dfb0 con 0x7f5bbc0cb050 2023-03-03T06:24:44.410 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.409+0000 7f5baaffd700 1 -- 172.21.15.5:0/644122370 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5bbc15dfb0 con 0x7f5bbc0cb050 2023-03-03T06:24:44.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.411+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/644122370 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5b9c0682f0 msgr2=0x7f5b9c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:44.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.411+0000 7f5bc0ef7700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5b9c0682f0 0x7f5b9c06a7a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009960 tx=0x7f5bb00090e0 comp rx=0 tx=0).stop 2023-03-03T06:24:44.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.411+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/644122370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bbc0cb050 msgr2=0x7f5bbc1f2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:44.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.411+0000 7f5bc0ef7700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bbc0cb050 0x7f5bbc1f2030 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009130 tx=0x7f5bac004750 comp rx=0 tx=0).stop 2023-03-03T06:24:44.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.411+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/644122370 shutdown_connections 2023-03-03T06:24:44.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.411+0000 7f5bc0ef7700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5b9c0682f0 0x7f5b9c06a7a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:44.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.411+0000 7f5bc0ef7700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5bbc15cd40 0x7f5bbc0b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:44.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.411+0000 7f5bc0ef7700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5bbc0b1960 0x7f5bbc0ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:44.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.411+0000 7f5bc0ef7700 1 --2- 172.21.15.5:0/644122370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5bbc0cb050 0x7f5bbc1f2030 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:44.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.411+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/644122370 >> 172.21.15.5:0/644122370 conn(0x7f5bbc0cc8d0 msgr2=0x7f5bbc06ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:44.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.412+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/644122370 shutdown_connections 2023-03-03T06:24:44.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.412+0000 7f5bc0ef7700 1 -- 172.21.15.5:0/644122370 wait complete. 2023-03-03T06:24:44.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-03-03T06:24:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.604+0000 7f6c24eb7700 1 Processor -- start 2023-03-03T06:24:44.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.604+0000 7f6c24eb7700 1 -- start start 2023-03-03T06:24:44.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.605+0000 7f6c24eb7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6c200cb430 0x7f6c200cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:44.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.605+0000 7f6c24eb7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c200b17b0 0x7f6c200b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:44.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.605+0000 7f6c24eb7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c200cddb0 con 0x7f6c200cd090 2023-03-03T06:24:44.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.605+0000 7f6c24eb7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2015cd70 con 0x7f6c200b17b0 2023-03-03T06:24:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.605+0000 7f6c24eb7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c200cebf0 con 0x7f6c200cb430 2023-03-03T06:24:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.605+0000 7f6c1ed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c200b17b0 0x7f6c200b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.605+0000 7f6c1ed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c200b17b0 0x7f6c200b1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43220/0 (socket says 172.21.15.5:43220) 2023-03-03T06:24:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.605+0000 7f6c1ed9d700 1 -- 172.21.15.5:0/2072348729 learned_addr learned my addr 172.21.15.5:0/2072348729 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.606+0000 7f6c1e59c700 1 --2- 172.21.15.5:0/2072348729 >> v2:172.21.15.191:3300/0 conn(0x7f6c200cb430 0x7f6c200cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.606+0000 7f6c1ed9d700 1 -- 172.21.15.5:0/2072348729 >> v2:172.21.15.191:3300/0 conn(0x7f6c200cb430 msgr2=0x7f6c200cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:44.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.606+0000 7f6c1ed9d700 1 --2- 172.21.15.5:0/2072348729 >> v2:172.21.15.191:3300/0 conn(0x7f6c200cb430 0x7f6c200cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:44.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.606+0000 7f6c1ed9d700 1 -- 172.21.15.5:0/2072348729 >> v1:172.21.15.191:6789/0 conn(0x7f6c200cd090 legacy=0x7f6c200cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:44.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.606+0000 7f6c1ed9d700 1 -- 172.21.15.5:0/2072348729 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c200b2150 con 0x7f6c200b17b0 2023-03-03T06:24:44.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.606+0000 7f6c1e59c700 1 --2- 172.21.15.5:0/2072348729 >> v2:172.21.15.191:3300/0 conn(0x7f6c200cb430 0x7f6c200cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:44.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.606+0000 7f6c1ed9d700 1 --2- 172.21.15.5:0/2072348729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c200b17b0 0x7f6c200b1c10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009e50 tx=0x7f6c1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6cc0fa7e33bc8f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:44.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.606+0000 7f6c1d59a700 1 -- 172.21.15.5:0/2072348729 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1800e070 con 0x7f6c200b17b0 2023-03-03T06:24:44.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.606+0000 7f6c1d59a700 1 -- 172.21.15.5:0/2072348729 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c18003a20 con 0x7f6c200b17b0 2023-03-03T06:24:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.606+0000 7f6c1d59a700 1 -- 172.21.15.5:0/2072348729 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18003dd0 con 0x7f6c200b17b0 2023-03-03T06:24:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.607+0000 7f6c24eb7700 1 -- 172.21.15.5:0/2072348729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c200b17b0 msgr2=0x7f6c200b1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.607+0000 7f6c24eb7700 1 --2- 172.21.15.5:0/2072348729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c200b17b0 0x7f6c200b1c10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009e50 tx=0x7f6c1800b330 comp rx=0 tx=0).stop 2023-03-03T06:24:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.607+0000 7f6c24eb7700 1 -- 172.21.15.5:0/2072348729 shutdown_connections 2023-03-03T06:24:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.607+0000 7f6c24eb7700 1 --2- 172.21.15.5:0/2072348729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c200b17b0 0x7f6c200b1c10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.607+0000 7f6c24eb7700 1 --2- 172.21.15.5:0/2072348729 >> v2:172.21.15.191:3300/0 conn(0x7f6c200cb430 0x7f6c200cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.607+0000 7f6c24eb7700 1 -- 172.21.15.5:0/2072348729 >> 172.21.15.5:0/2072348729 conn(0x7f6c200d09c0 msgr2=0x7f6c200cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:44.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.607+0000 7f6c24eb7700 1 -- 172.21.15.5:0/2072348729 shutdown_connections 2023-03-03T06:24:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.607+0000 7f6c24eb7700 1 -- 172.21.15.5:0/2072348729 wait complete. 2023-03-03T06:24:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.608+0000 7f6c24eb7700 1 Processor -- start 2023-03-03T06:24:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.608+0000 7f6c24eb7700 1 -- start start 2023-03-03T06:24:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c24eb7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c200b17b0 0x7f6c200b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c24eb7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c200cb430 0x7f6c200c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c24eb7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c200cd090 0x7f6c2015ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c24eb7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200c9250 con 0x7f6c200cd090 2023-03-03T06:24:44.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c24eb7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200b2ce0 con 0x7f6c200b17b0 2023-03-03T06:24:44.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c24eb7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200b2fc0 con 0x7f6c200cb430 2023-03-03T06:24:44.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c1ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c200cd090 0x7f6c2015ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:44.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c1ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c200cd090 0x7f6c2015ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43226/0 (socket says 172.21.15.5:43226) 2023-03-03T06:24:44.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c1ed9d700 1 -- 172.21.15.5:0/1117678006 learned_addr learned my addr 172.21.15.5:0/1117678006 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:44.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c1e59c700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c200b17b0 0x7f6c200b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:44.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c1ed9d700 1 -- 172.21.15.5:0/1117678006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c200cb430 msgr2=0x7f6c200c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:44.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c1dd9b700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c200cb430 0x7f6c200c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:44.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c1ed9d700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c200cb430 0x7f6c200c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:44.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c1ed9d700 1 -- 172.21.15.5:0/1117678006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c200b17b0 msgr2=0x7f6c200b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:44.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c1ed9d700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c200b17b0 0x7f6c200b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:44.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c1ed9d700 1 -- 172.21.15.5:0/1117678006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c18009b30 con 0x7f6c200cd090 2023-03-03T06:24:44.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c1e59c700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c200b17b0 0x7f6c200b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:44.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.609+0000 7f6c1ed9d700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c200cd090 0x7f6c2015ac30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6c200715c0 tx=0x7f6c18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:44.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.610+0000 7f6c0effd700 1 -- 172.21.15.5:0/1117678006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18004440 con 0x7f6c200cd090 2023-03-03T06:24:44.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.610+0000 7f6c0effd700 1 -- 172.21.15.5:0/1117678006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c180045c0 con 0x7f6c200cd090 2023-03-03T06:24:44.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.610+0000 7f6c24eb7700 1 -- 172.21.15.5:0/1117678006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c200cdfe0 con 0x7f6c200cd090 2023-03-03T06:24:44.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.610+0000 7f6c0effd700 1 -- 172.21.15.5:0/1117678006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18004970 con 0x7f6c200cd090 2023-03-03T06:24:44.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.610+0000 7f6c24eb7700 1 -- 172.21.15.5:0/1117678006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c200cb800 con 0x7f6c200cd090 2023-03-03T06:24:44.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.611+0000 7f6c24eb7700 1 -- 172.21.15.5:0/1117678006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c200ce2c0 con 0x7f6c200cd090 2023-03-03T06:24:44.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.612+0000 7f6c0effd700 1 -- 172.21.15.5:0/1117678006 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6c18022030 con 0x7f6c200cd090 2023-03-03T06:24:44.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.612+0000 7f6c0effd700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6c000682f0 0x7f6c0006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:44.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.612+0000 7f6c0effd700 1 -- 172.21.15.5:0/1117678006 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f6c18087830 con 0x7f6c200cd090 2023-03-03T06:24:44.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.612+0000 7f6c1e59c700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6c000682f0 0x7f6c0006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:44.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.613+0000 7f6c1e59c700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6c000682f0 0x7f6c0006a7a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6c2015b7d0 tx=0x7f6c14008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:44.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.615+0000 7f6c0effd700 1 -- 172.21.15.5:0/1117678006 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6c18053ca0 con 0x7f6c200cd090 2023-03-03T06:24:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:44.807+0000 7f6c24eb7700 1 -- 172.21.15.5:0/1117678006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6c200b3610 con 0x7f6c200cd090 2023-03-03T06:24:45.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.574+0000 7f6c0effd700 1 -- 172.21.15.5:0/1117678006 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6c180572c0 con 0x7f6c200cd090 2023-03-03T06:24:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.581+0000 7f6c24eb7700 1 -- 172.21.15.5:0/1117678006 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6c000682f0 msgr2=0x7f6c0006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.581+0000 7f6c24eb7700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6c000682f0 0x7f6c0006a7a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6c2015b7d0 tx=0x7f6c14008040 comp rx=0 tx=0).stop 2023-03-03T06:24:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.581+0000 7f6c24eb7700 1 -- 172.21.15.5:0/1117678006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c200cd090 msgr2=0x7f6c2015ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:45.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.581+0000 7f6c24eb7700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c200cd090 0x7f6c2015ac30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6c200715c0 tx=0x7f6c18004ad0 comp rx=0 tx=0).stop 2023-03-03T06:24:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.581+0000 7f6c24eb7700 1 -- 172.21.15.5:0/1117678006 shutdown_connections 2023-03-03T06:24:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.581+0000 7f6c24eb7700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c200cd090 0x7f6c2015ac30 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.581+0000 7f6c24eb7700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c200b17b0 0x7f6c200b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.581+0000 7f6c24eb7700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6c000682f0 0x7f6c0006a7a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.581+0000 7f6c24eb7700 1 --2- 172.21.15.5:0/1117678006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c200cb430 0x7f6c200c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.581+0000 7f6c24eb7700 1 -- 172.21.15.5:0/1117678006 >> 172.21.15.5:0/1117678006 conn(0x7f6c200d09c0 msgr2=0x7f6c200af790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:45.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.581+0000 7f6c24eb7700 1 -- 172.21.15.5:0/1117678006 shutdown_connections 2023-03-03T06:24:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.581+0000 7f6c24eb7700 1 -- 172.21.15.5:0/1117678006 wait complete. 2023-03-03T06:24:45.584 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-03-03T06:24:45.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-03-03T06:24:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.733+0000 7f52a953b700 1 Processor -- start 2023-03-03T06:24:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.734+0000 7f52a953b700 1 -- start start 2023-03-03T06:24:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.734+0000 7f52a953b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52a40b8a80 0x7f52a40b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.734+0000 7f52a953b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f52a406c830 0x7f52a40d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.734+0000 7f52a953b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a40cf980 con 0x7f52a40b2130 2023-03-03T06:24:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.734+0000 7f52a953b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a40cd980 con 0x7f52a40b8a80 2023-03-03T06:24:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.734+0000 7f52a953b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a415ce70 con 0x7f52a406c830 2023-03-03T06:24:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.734+0000 7f52a2ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f52a40b8a80 0x7f52a40b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.735+0000 7f52a27fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f52a40b2130 0x7f52a406c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33072/0 (socket says 172.21.15.5:33072) 2023-03-03T06:24:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.735+0000 7f52a27fc700 1 -- 172.21.15.5:0/1486656672 learned_addr learned my addr 172.21.15.5:0/1486656672 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.735+0000 7f52a2ffd700 1 -- 172.21.15.5:0/1486656672 >> v2:172.21.15.191:3300/0 conn(0x7f52a406c830 msgr2=0x7f52a40d0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.735+0000 7f52a37fe700 1 --2- 172.21.15.5:0/1486656672 >> v2:172.21.15.191:3300/0 conn(0x7f52a406c830 0x7f52a40d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.735+0000 7f52a1ffb700 1 -- 172.21.15.5:0/1486656672 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884013984 0 0) 0x7f52a40cf980 con 0x7f52a40b2130 2023-03-03T06:24:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.735+0000 7f52a2ffd700 1 --2- 172.21.15.5:0/1486656672 >> v2:172.21.15.191:3300/0 conn(0x7f52a406c830 0x7f52a40d0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:45.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.735+0000 7f52a2ffd700 1 -- 172.21.15.5:0/1486656672 >> v1:172.21.15.5:6789/0 conn(0x7f52a40b2130 legacy=0x7f52a406c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.735+0000 7f52a2ffd700 1 -- 172.21.15.5:0/1486656672 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40cdda0 con 0x7f52a40b8a80 2023-03-03T06:24:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.735+0000 7f52a37fe700 1 --2- 172.21.15.5:0/1486656672 >> v2:172.21.15.191:3300/0 conn(0x7f52a406c830 0x7f52a40d0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.735+0000 7f52a2ffd700 1 --2- 172.21.15.5:0/1486656672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52a40b8a80 0x7f52a40b2560 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f52a40b4b10 tx=0x7f5298009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b913c7fca27b87 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.735+0000 7f52a1ffb700 1 -- 172.21.15.5:0/1486656672 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298011830 con 0x7f52a40b8a80 2023-03-03T06:24:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.735+0000 7f52a1ffb700 1 -- 172.21.15.5:0/1486656672 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5298011990 con 0x7f52a40b8a80 2023-03-03T06:24:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.735+0000 7f52a1ffb700 1 -- 172.21.15.5:0/1486656672 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298011d20 con 0x7f52a40b8a80 2023-03-03T06:24:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.736+0000 7f52a953b700 1 -- 172.21.15.5:0/1486656672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52a40b8a80 msgr2=0x7f52a40b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.736+0000 7f52a953b700 1 --2- 172.21.15.5:0/1486656672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52a40b8a80 0x7f52a40b2560 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f52a40b4b10 tx=0x7f5298009b20 comp rx=0 tx=0).stop 2023-03-03T06:24:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.736+0000 7f52a953b700 1 -- 172.21.15.5:0/1486656672 shutdown_connections 2023-03-03T06:24:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.736+0000 7f52a953b700 1 --2- 172.21.15.5:0/1486656672 >> v2:172.21.15.191:3300/0 conn(0x7f52a406c830 0x7f52a40d0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.736+0000 7f52a953b700 1 --2- 172.21.15.5:0/1486656672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52a40b8a80 0x7f52a40b2560 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.736+0000 7f52a953b700 1 -- 172.21.15.5:0/1486656672 >> 172.21.15.5:0/1486656672 conn(0x7f52a40d0610 msgr2=0x7f52a40d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.736+0000 7f52a953b700 1 -- 172.21.15.5:0/1486656672 shutdown_connections 2023-03-03T06:24:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.736+0000 7f52a953b700 1 -- 172.21.15.5:0/1486656672 wait complete. 2023-03-03T06:24:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.737+0000 7f52a953b700 1 Processor -- start 2023-03-03T06:24:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.737+0000 7f52a953b700 1 -- start start 2023-03-03T06:24:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a953b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52a406c830 0x7f52a414a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a953b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52a40b2130 0x7f52a40caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a953b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52a40b8a80 0x7f52a406a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a953b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40cbdf0 con 0x7f52a40b2130 2023-03-03T06:24:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a953b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a415f760 con 0x7f52a40b8a80 2023-03-03T06:24:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a953b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a415ee30 con 0x7f52a406c830 2023-03-03T06:24:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a27fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52a40b2130 0x7f52a40caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a27fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52a40b2130 0x7f52a40caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43238/0 (socket says 172.21.15.5:43238) 2023-03-03T06:24:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a27fc700 1 -- 172.21.15.5:0/2375812488 learned_addr learned my addr 172.21.15.5:0/2375812488 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a2ffd700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52a406c830 0x7f52a414a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a37fe700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52a40b8a80 0x7f52a406a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a27fc700 1 -- 172.21.15.5:0/2375812488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52a406c830 msgr2=0x7f52a414a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:45.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a27fc700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52a406c830 0x7f52a414a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a27fc700 1 -- 172.21.15.5:0/2375812488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52a40b8a80 msgr2=0x7f52a406a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a27fc700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52a40b8a80 0x7f52a406a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.738+0000 7f52a27fc700 1 -- 172.21.15.5:0/2375812488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52980094a0 con 0x7f52a40b2130 2023-03-03T06:24:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.739+0000 7f52a27fc700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52a40b2130 0x7f52a40caef0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f529400c550 tx=0x7f529400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.739+0000 7f528b7fe700 1 -- 172.21.15.5:0/2375812488 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5294004c80 con 0x7f52a40b2130 2023-03-03T06:24:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.739+0000 7f528b7fe700 1 -- 172.21.15.5:0/2375812488 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5294004e00 con 0x7f52a40b2130 2023-03-03T06:24:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.739+0000 7f52a953b700 1 -- 172.21.15.5:0/2375812488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a40cf6a0 con 0x7f52a40b2130 2023-03-03T06:24:45.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.739+0000 7f528b7fe700 1 -- 172.21.15.5:0/2375812488 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5294007310 con 0x7f52a40b2130 2023-03-03T06:24:45.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.739+0000 7f52a953b700 1 -- 172.21.15.5:0/2375812488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a4161300 con 0x7f52a40b2130 2023-03-03T06:24:45.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.740+0000 7f52a953b700 1 -- 172.21.15.5:0/2375812488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a40cf2e0 con 0x7f52a40b2130 2023-03-03T06:24:45.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.740+0000 7f528b7fe700 1 -- 172.21.15.5:0/2375812488 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f529401a020 con 0x7f52a40b2130 2023-03-03T06:24:45.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.741+0000 7f528b7fe700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f52900682f0 0x7f529006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:45.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.741+0000 7f52a2ffd700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f52900682f0 0x7f529006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:45.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.741+0000 7f528b7fe700 1 -- 172.21.15.5:0/2375812488 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f5294085920 con 0x7f52a40b2130 2023-03-03T06:24:45.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.741+0000 7f52a2ffd700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f52900682f0 0x7f529006a7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f52980090b0 tx=0x7f529801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:45.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.745+0000 7f528b7fe700 1 -- 172.21.15.5:0/2375812488 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5294051f30 con 0x7f52a40b2130 2023-03-03T06:24:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:45.939+0000 7f52a953b700 1 -- 172.21.15.5:0/2375812488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f52a415eff0 con 0x7f52a40b2130 2023-03-03T06:24:46.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.576+0000 7f528b7fe700 1 -- 172.21.15.5:0/2375812488 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5294055550 con 0x7f52a40b2130 2023-03-03T06:24:46.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.579+0000 7f52a953b700 1 -- 172.21.15.5:0/2375812488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f52900682f0 msgr2=0x7f529006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:46.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.579+0000 7f52a953b700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f52900682f0 0x7f529006a7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f52980090b0 tx=0x7f529801c040 comp rx=0 tx=0).stop 2023-03-03T06:24:46.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.579+0000 7f52a953b700 1 -- 172.21.15.5:0/2375812488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52a40b2130 msgr2=0x7f52a40caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:46.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.579+0000 7f52a953b700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52a40b2130 0x7f52a40caef0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f529400c550 tx=0x7f529400c860 comp rx=0 tx=0).stop 2023-03-03T06:24:46.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.579+0000 7f52a953b700 1 -- 172.21.15.5:0/2375812488 shutdown_connections 2023-03-03T06:24:46.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.579+0000 7f52a953b700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52a40b8a80 0x7f52a406a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:46.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.579+0000 7f52a953b700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f52900682f0 0x7f529006a7a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:46.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.579+0000 7f52a953b700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52a406c830 0x7f52a414a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:46.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.579+0000 7f52a953b700 1 --2- 172.21.15.5:0/2375812488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f52a40b2130 0x7f52a40caef0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:46.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.579+0000 7f52a953b700 1 -- 172.21.15.5:0/2375812488 >> 172.21.15.5:0/2375812488 conn(0x7f52a40d0610 msgr2=0x7f52a41604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:46.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.579+0000 7f52a953b700 1 -- 172.21.15.5:0/2375812488 shutdown_connections 2023-03-03T06:24:46.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.579+0000 7f52a953b700 1 -- 172.21.15.5:0/2375812488 wait complete. 2023-03-03T06:24:46.583 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-03-03T06:24:46.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-03-03T06:24:46.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.730+0000 7f778e0f1700 1 Processor -- start 2023-03-03T06:24:46.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.730+0000 7f778e0f1700 1 -- start start 2023-03-03T06:24:46.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.731+0000 7f778e0f1700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7788145a30 0x7f778815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:46.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.731+0000 7f778e0f1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7788160960 0x7f7788160da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:46.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.731+0000 7f778e0f1700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778815d230 con 0x7f778806d560 2023-03-03T06:24:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.731+0000 7f778e0f1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778815dd30 con 0x7f7788160960 2023-03-03T06:24:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.731+0000 7f778e0f1700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77881462b0 con 0x7f7788145a30 2023-03-03T06:24:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.731+0000 7f7787fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7788160960 0x7f7788160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.731+0000 7f7787fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7788160960 0x7f7788160da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43248/0 (socket says 172.21.15.5:43248) 2023-03-03T06:24:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.731+0000 7f7787fff700 1 -- 172.21.15.5:0/828274732 learned_addr learned my addr 172.21.15.5:0/828274732 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.731+0000 7f7786ffd700 1 --2- 172.21.15.5:0/828274732 >> v2:172.21.15.191:3300/0 conn(0x7f7788145a30 0x7f778815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.731+0000 7f7787fff700 1 -- 172.21.15.5:0/828274732 >> v2:172.21.15.191:3300/0 conn(0x7f7788145a30 msgr2=0x7f778815ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:46.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.731+0000 7f7787fff700 1 --2- 172.21.15.5:0/828274732 >> v2:172.21.15.191:3300/0 conn(0x7f7788145a30 0x7f778815ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.732+0000 7f7787fff700 1 -- 172.21.15.5:0/828274732 >> v1:172.21.15.191:6789/0 conn(0x7f778806d560 legacy=0x7f778806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.732+0000 7f7787fff700 1 -- 172.21.15.5:0/828274732 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77880ca550 con 0x7f7788160960 2023-03-03T06:24:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.732+0000 7f7786ffd700 1 --2- 172.21.15.5:0/828274732 >> v2:172.21.15.191:3300/0 conn(0x7f7788145a30 0x7f778815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.732+0000 7f7787fff700 1 --2- 172.21.15.5:0/828274732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7788160960 0x7f7788160da0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f778806e860 tx=0x7f778000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72bb3c0cfa18876 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.732+0000 7f77867fc700 1 -- 172.21.15.5:0/828274732 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778000e070 con 0x7f7788160960 2023-03-03T06:24:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.732+0000 7f77867fc700 1 -- 172.21.15.5:0/828274732 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778000b9c0 con 0x7f7788160960 2023-03-03T06:24:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.732+0000 7f77867fc700 1 -- 172.21.15.5:0/828274732 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778000bd70 con 0x7f7788160960 2023-03-03T06:24:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.732+0000 7f778e0f1700 1 -- 172.21.15.5:0/828274732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7788160960 msgr2=0x7f7788160da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.732+0000 7f778e0f1700 1 --2- 172.21.15.5:0/828274732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7788160960 0x7f7788160da0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f778806e860 tx=0x7f778000b330 comp rx=0 tx=0).stop 2023-03-03T06:24:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.732+0000 7f778e0f1700 1 -- 172.21.15.5:0/828274732 shutdown_connections 2023-03-03T06:24:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.732+0000 7f778e0f1700 1 --2- 172.21.15.5:0/828274732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7788160960 0x7f7788160da0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.732+0000 7f778e0f1700 1 --2- 172.21.15.5:0/828274732 >> v2:172.21.15.191:3300/0 conn(0x7f7788145a30 0x7f778815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.732+0000 7f778e0f1700 1 -- 172.21.15.5:0/828274732 >> 172.21.15.5:0/828274732 conn(0x7f77880b1bd0 msgr2=0x7f77880cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.733+0000 7f778e0f1700 1 -- 172.21.15.5:0/828274732 shutdown_connections 2023-03-03T06:24:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.733+0000 7f778e0f1700 1 -- 172.21.15.5:0/828274732 wait complete. 2023-03-03T06:24:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.734+0000 7f778e0f1700 1 Processor -- start 2023-03-03T06:24:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.734+0000 7f778e0f1700 1 -- start start 2023-03-03T06:24:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f778e0f1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778806d560 0x7f77880c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f778e0f1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7788145a30 0x7f77880b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f778e0f1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7788160960 0x7f77881527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f778e0f1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77880b2260 con 0x7f778806d560 2023-03-03T06:24:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f778e0f1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77880c5b00 con 0x7f7788145a30 2023-03-03T06:24:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f778e0f1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77880c4f00 con 0x7f7788160960 2023-03-03T06:24:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f77877fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778806d560 0x7f77880c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f77877fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778806d560 0x7f77880c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43250/0 (socket says 172.21.15.5:43250) 2023-03-03T06:24:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f77877fe700 1 -- 172.21.15.5:0/440734234 learned_addr learned my addr 172.21.15.5:0/440734234 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f7786ffd700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7788145a30 0x7f77880b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f7787fff700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7788160960 0x7f77881527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f77877fe700 1 -- 172.21.15.5:0/440734234 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7788160960 msgr2=0x7f77881527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f77877fe700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7788160960 0x7f77881527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f77877fe700 1 -- 172.21.15.5:0/440734234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7788145a30 msgr2=0x7f77880b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f77877fe700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7788145a30 0x7f77880b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f77877fe700 1 -- 172.21.15.5:0/440734234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7780009b30 con 0x7f778806d560 2023-03-03T06:24:46.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f77877fe700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778806d560 0x7f77880c49c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f777000c450 tx=0x7f777000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.735+0000 7f777ffff700 1 -- 172.21.15.5:0/440734234 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77700052d0 con 0x7f778806d560 2023-03-03T06:24:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.736+0000 7f777ffff700 1 -- 172.21.15.5:0/440734234 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7770005430 con 0x7f778806d560 2023-03-03T06:24:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.736+0000 7f777ffff700 1 -- 172.21.15.5:0/440734234 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77700038c0 con 0x7f778806d560 2023-03-03T06:24:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.736+0000 7f778e0f1700 1 -- 172.21.15.5:0/440734234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778815d770 con 0x7f778806d560 2023-03-03T06:24:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.736+0000 7f778e0f1700 1 -- 172.21.15.5:0/440734234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778815d490 con 0x7f778806d560 2023-03-03T06:24:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.736+0000 7f778e0f1700 1 -- 172.21.15.5:0/440734234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778815da50 con 0x7f778806d560 2023-03-03T06:24:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.737+0000 7f777ffff700 1 -- 172.21.15.5:0/440734234 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7770019030 con 0x7f778806d560 2023-03-03T06:24:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.737+0000 7f777ffff700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f77680682f0 0x7f776806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.737+0000 7f777ffff700 1 -- 172.21.15.5:0/440734234 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f7770084f10 con 0x7f778806d560 2023-03-03T06:24:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.737+0000 7f7786ffd700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f77680682f0 0x7f776806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.738+0000 7f7786ffd700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f77680682f0 0x7f776806a7a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f77881f5cc0 tx=0x7f7778008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.742+0000 7f777ffff700 1 -- 172.21.15.5:0/440734234 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7770051690 con 0x7f778806d560 2023-03-03T06:24:46.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:46.950+0000 7f778e0f1700 1 -- 172.21.15.5:0/440734234 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f778804e6e0 con 0x7f778806d560 2023-03-03T06:24:47.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:24:47.273 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:24:47.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.593+0000 7f777ffff700 1 -- 172.21.15.5:0/440734234 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f77700170d0 con 0x7f778806d560 2023-03-03T06:24:47.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.597+0000 7f778e0f1700 1 -- 172.21.15.5:0/440734234 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f77680682f0 msgr2=0x7f776806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:47.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.597+0000 7f778e0f1700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f77680682f0 0x7f776806a7a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f77881f5cc0 tx=0x7f7778008040 comp rx=0 tx=0).stop 2023-03-03T06:24:47.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.597+0000 7f778e0f1700 1 -- 172.21.15.5:0/440734234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778806d560 msgr2=0x7f77880c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:47.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.597+0000 7f778e0f1700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778806d560 0x7f77880c49c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f777000c450 tx=0x7f777000c760 comp rx=0 tx=0).stop 2023-03-03T06:24:47.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.598+0000 7f778e0f1700 1 -- 172.21.15.5:0/440734234 shutdown_connections 2023-03-03T06:24:47.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.598+0000 7f778e0f1700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f77680682f0 0x7f776806a7a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:47.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.598+0000 7f778e0f1700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7788160960 0x7f77881527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:47.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.598+0000 7f778e0f1700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778806d560 0x7f77880c49c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:47.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.598+0000 7f778e0f1700 1 --2- 172.21.15.5:0/440734234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7788145a30 0x7f77880b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:47.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.598+0000 7f778e0f1700 1 -- 172.21.15.5:0/440734234 >> 172.21.15.5:0/440734234 conn(0x7f77880b1bd0 msgr2=0x7f77880aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:47.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.598+0000 7f778e0f1700 1 -- 172.21.15.5:0/440734234 shutdown_connections 2023-03-03T06:24:47.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.598+0000 7f778e0f1700 1 -- 172.21.15.5:0/440734234 wait complete. 2023-03-03T06:24:47.601 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' removed 2023-03-03T06:24:47.616 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-03T06:24:47.616 INFO:tasks.ceph.mds.a:Stopping old one... 2023-03-03T06:24:47.616 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-03-03T06:24:47.616 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:24:47.617 INFO:tasks.ceph.mds.c:Restarting daemon 2023-03-03T06:24:47.617 INFO:tasks.ceph.mds.c:Stopping old one... 2023-03-03T06:24:47.617 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-03-03T06:24:47.617 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:24:47.618 INFO:tasks.ceph.mds.b:Restarting daemon 2023-03-03T06:24:47.618 INFO:tasks.ceph.mds.b:Stopping old one... 2023-03-03T06:24:47.618 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-03-03T06:24:47.618 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:24:47.618 INFO:tasks.ceph.mds.d:Restarting daemon 2023-03-03T06:24:47.619 INFO:tasks.ceph.mds.d:Stopping old one... 2023-03-03T06:24:47.619 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-03-03T06:24:47.619 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:24:47.627 INFO:tasks.ceph.mds.a:Stopped 2023-03-03T06:24:47.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-03T06:24:47.628 INFO:tasks.ceph.mds.c:Stopped 2023-03-03T06:24:47.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-03-03T06:24:47.629 INFO:tasks.ceph.mds.b:Stopped 2023-03-03T06:24:47.630 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-03-03T06:24:47.630 INFO:tasks.ceph.mds.d:Stopped 2023-03-03T06:24:47.631 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-03-03T06:24:47.669 INFO:tasks.ceph.mds.a:Started 2023-03-03T06:24:47.669 DEBUG:teuthology.parallel:result is None 2023-03-03T06:24:47.670 INFO:tasks.ceph.mds.c:Started 2023-03-03T06:24:47.670 DEBUG:teuthology.parallel:result is None 2023-03-03T06:24:47.672 INFO:tasks.ceph.mds.b:Started 2023-03-03T06:24:47.673 DEBUG:teuthology.parallel:result is None 2023-03-03T06:24:47.673 INFO:tasks.ceph.mds.d:Started 2023-03-03T06:24:47.674 DEBUG:teuthology.parallel:result is None 2023-03-03T06:24:47.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-03-03T06:24:47.756 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-03-03T06:24:47.756 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-03-03T06:24:47.757 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-03-03T06:24:47.757 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-03-03T06:24:47.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.814+0000 7f8a86d0d700 1 Processor -- start 2023-03-03T06:24:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.815+0000 7f8a86d0d700 1 -- start start 2023-03-03T06:24:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.815+0000 7f8a86d0d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a8006dc90 0x7f8a800cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.815+0000 7f8a86d0d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a8015a160 con 0x7f8a800ae900 2023-03-03T06:24:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.815+0000 7f8a86d0d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a800ca380 con 0x7f8a800ae530 2023-03-03T06:24:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.815+0000 7f8a86d0d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a800ca170 con 0x7f8a8006dc90 2023-03-03T06:24:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.816+0000 7f8a7ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8a8006dc90 0x7f8a800cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.816+0000 7f8a852aa700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8a800ae900 0x7f8a8015cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33128/0 (socket says 172.21.15.5:33128) 2023-03-03T06:24:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.816+0000 7f8a852aa700 1 -- 172.21.15.5:0/3369719032 learned_addr learned my addr 172.21.15.5:0/3369719032 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.816+0000 7f8a7ffff700 1 -- 172.21.15.5:0/3369719032 >> v1:172.21.15.191:6789/0 conn(0x7f8a800ae530 legacy=0x7f8a8006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:47.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.816+0000 7f8a7ffff700 1 -- 172.21.15.5:0/3369719032 >> v1:172.21.15.5:6789/0 conn(0x7f8a800ae900 legacy=0x7f8a8015cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.816+0000 7f8a7ffff700 1 -- 172.21.15.5:0/3369719032 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a800ca660 con 0x7f8a8006dc90 2023-03-03T06:24:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.816+0000 7f8a7f7fe700 1 -- 172.21.15.5:0/3369719032 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477080783 0 0) 0x7f8a8015a160 con 0x7f8a800ae900 2023-03-03T06:24:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.816+0000 7f8a7ffff700 1 --2- 172.21.15.5:0/3369719032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a8006dc90 0x7f8a800cb120 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00a9e0 tx=0x7f8a6c00acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c827527ffa9b475 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.816+0000 7f8a7f7fe700 1 -- 172.21.15.5:0/3369719032 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00cb30 con 0x7f8a8006dc90 2023-03-03T06:24:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.816+0000 7f8a7f7fe700 1 -- 172.21.15.5:0/3369719032 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c00cc90 con 0x7f8a8006dc90 2023-03-03T06:24:47.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.816+0000 7f8a7f7fe700 1 -- 172.21.15.5:0/3369719032 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c004030 con 0x7f8a8006dc90 2023-03-03T06:24:47.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.817+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3369719032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a8006dc90 msgr2=0x7f8a800cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.817+0000 7f8a86d0d700 1 --2- 172.21.15.5:0/3369719032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a8006dc90 0x7f8a800cb120 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00a9e0 tx=0x7f8a6c00acf0 comp rx=0 tx=0).stop 2023-03-03T06:24:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.817+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3369719032 shutdown_connections 2023-03-03T06:24:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.817+0000 7f8a86d0d700 1 --2- 172.21.15.5:0/3369719032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a8006dc90 0x7f8a800cb120 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.817+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3369719032 >> 172.21.15.5:0/3369719032 conn(0x7f8a800cf4b0 msgr2=0x7f8a800cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.817+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3369719032 shutdown_connections 2023-03-03T06:24:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.817+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3369719032 wait complete. 2023-03-03T06:24:47.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.818+0000 7f8a86d0d700 1 Processor -- start 2023-03-03T06:24:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.818+0000 7f8a86d0d700 1 -- start start 2023-03-03T06:24:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.819+0000 7f8a86d0d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a8006dc90 0x7f8a80149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.819+0000 7f8a86d0d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a800ae530 0x7f8a800c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a86d0d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a800ae900 0x7f8a800c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a86d0d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a800c73d0 con 0x7f8a8006dc90 2023-03-03T06:24:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a86d0d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a800c43b0 con 0x7f8a800ae530 2023-03-03T06:24:47.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a86d0d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a800c5830 con 0x7f8a800ae900 2023-03-03T06:24:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a84aa9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a8006dc90 0x7f8a80149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a84aa9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a8006dc90 0x7f8a80149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43288/0 (socket says 172.21.15.5:43288) 2023-03-03T06:24:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a84aa9700 1 -- 172.21.15.5:0/3466638867 learned_addr learned my addr 172.21.15.5:0/3466638867 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a7ffff700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a800ae530 0x7f8a800c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a852aa700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a800ae900 0x7f8a800c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a84aa9700 1 -- 172.21.15.5:0/3466638867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a800ae900 msgr2=0x7f8a800c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:47.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a84aa9700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a800ae900 0x7f8a800c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:47.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a84aa9700 1 -- 172.21.15.5:0/3466638867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a800ae530 msgr2=0x7f8a800c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:47.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a84aa9700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a800ae530 0x7f8a800c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:47.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a84aa9700 1 -- 172.21.15.5:0/3466638867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c00a640 con 0x7f8a8006dc90 2023-03-03T06:24:47.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a84aa9700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a8006dc90 0x7f8a80149d10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c4a0 tx=0x7f8a7400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:47.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a7d7fa700 1 -- 172.21.15.5:0/3466638867 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a740054e0 con 0x7f8a8006dc90 2023-03-03T06:24:47.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a7d7fa700 1 -- 172.21.15.5:0/3466638867 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a74003680 con 0x7f8a8006dc90 2023-03-03T06:24:47.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3466638867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a800cac20 con 0x7f8a8006dc90 2023-03-03T06:24:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.820+0000 7f8a7d7fa700 1 -- 172.21.15.5:0/3466638867 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74003a30 con 0x7f8a8006dc90 2023-03-03T06:24:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.821+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3466638867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a800ca940 con 0x7f8a8006dc90 2023-03-03T06:24:47.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.821+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3466638867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a80153520 con 0x7f8a8006dc90 2023-03-03T06:24:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.822+0000 7f8a7d7fa700 1 -- 172.21.15.5:0/3466638867 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8a74019030 con 0x7f8a8006dc90 2023-03-03T06:24:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.822+0000 7f8a7d7fa700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8a640682f0 0x7f8a6406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.822+0000 7f8a7d7fa700 1 -- 172.21.15.5:0/3466638867 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f8a74084ed0 con 0x7f8a8006dc90 2023-03-03T06:24:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.822+0000 7f8a7ffff700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8a640682f0 0x7f8a6406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:47.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.823+0000 7f8a7ffff700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8a640682f0 0x7f8a6406a7a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a8006e080 tx=0x7f8a6c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:47.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:47.827+0000 7f8a7d7fa700 1 -- 172.21.15.5:0/3466638867 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8a740518f0 con 0x7f8a8006dc90 2023-03-03T06:24:48.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.044+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3466638867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8a800c4620 con 0x7f8a8006dc90 2023-03-03T06:24:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.785+0000 7f8a7d7fa700 1 -- 172.21.15.5:0/3466638867 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8a74017080 con 0x7f8a8006dc90 2023-03-03T06:24:48.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.788+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3466638867 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8a640682f0 msgr2=0x7f8a6406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:48.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.788+0000 7f8a86d0d700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8a640682f0 0x7f8a6406a7a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a8006e080 tx=0x7f8a6c008040 comp rx=0 tx=0).stop 2023-03-03T06:24:48.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.788+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3466638867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a8006dc90 msgr2=0x7f8a80149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:48.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.788+0000 7f8a86d0d700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a8006dc90 0x7f8a80149d10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c4a0 tx=0x7f8a7400c860 comp rx=0 tx=0).stop 2023-03-03T06:24:48.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.788+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3466638867 shutdown_connections 2023-03-03T06:24:48.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.788+0000 7f8a86d0d700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8a640682f0 0x7f8a6406a7a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:48.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.788+0000 7f8a86d0d700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a800ae900 0x7f8a800c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:48.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.788+0000 7f8a86d0d700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a8006dc90 0x7f8a80149d10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:48.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.788+0000 7f8a86d0d700 1 --2- 172.21.15.5:0/3466638867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a800ae530 0x7f8a800c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:48.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.788+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3466638867 >> 172.21.15.5:0/3466638867 conn(0x7f8a800cf4b0 msgr2=0x7f8a80150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:48.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.788+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3466638867 shutdown_connections 2023-03-03T06:24:48.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.788+0000 7f8a86d0d700 1 -- 172.21.15.5:0/3466638867 wait complete. 2023-03-03T06:24:48.792 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-03-03T06:24:48.806 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-03-03T06:24:48.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.935+0000 7f7cbae9c700 1 Processor -- start 2023-03-03T06:24:48.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.935+0000 7f7cbae9c700 1 -- start start 2023-03-03T06:24:48.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.936+0000 7f7cbae9c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7cb415cd40 0x7f7cb40b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.936+0000 7f7cbae9c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb41615b0 con 0x7f7cb40cef60 2023-03-03T06:24:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.936+0000 7f7cbae9c700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb415d4e0 con 0x7f7cb40cba50 2023-03-03T06:24:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.936+0000 7f7cbae9c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb415d7c0 con 0x7f7cb415cd40 2023-03-03T06:24:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.936+0000 7f7cb9439700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7cb40cef60 0x7f7cb4160ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33142/0 (socket says 172.21.15.5:33142) 2023-03-03T06:24:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.936+0000 7f7cb9439700 1 -- 172.21.15.5:0/2102778781 learned_addr learned my addr 172.21.15.5:0/2102778781 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:48.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb8c38700 1 --2- 172.21.15.5:0/2102778781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7cb415cd40 0x7f7cb40b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564377222 0 0) 0x7f7cb41615b0 con 0x7f7cb40cef60 2023-03-03T06:24:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca40035b0 con 0x7f7cb40cef60 2023-03-03T06:24:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3295262964 0 0) 0x7f7ca40035b0 con 0x7f7cb40cef60 2023-03-03T06:24:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7cb415cd40 msgr2=0x7f7cb40b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 --2- 172.21.15.5:0/2102778781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7cb415cd40 0x7f7cb40b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 >> v1:172.21.15.191:6789/0 conn(0x7f7cb40cba50 legacy=0x7f7cb4160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:48.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb415daa0 con 0x7f7cb40cef60 2023-03-03T06:24:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f7cac0019f0 con 0x7f7cb40cef60 2023-03-03T06:24:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 >> v1:172.21.15.5:6789/0 conn(0x7f7cb40cef60 legacy=0x7f7cb4160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 --2- 172.21.15.5:0/2102778781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ca4003aa0 0x7f7ca4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 --2- 172.21.15.5:0/2102778781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7cb415cd40 0x7f7ca4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 --2- 172.21.15.5:0/2102778781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4004d90 0x7f7ca4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:48.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb415d7c0 con 0x7f7ca4004d90 2023-03-03T06:24:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca400bac0 con 0x7f7ca4003aa0 2023-03-03T06:24:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca400bc30 con 0x7f7cb415cd40 2023-03-03T06:24:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb9439700 1 --2- 172.21.15.5:0/2102778781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4004d90 0x7f7ca4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb3fff700 1 --2- 172.21.15.5:0/2102778781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7cb415cd40 0x7f7ca4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.937+0000 7f7cb8c38700 1 --2- 172.21.15.5:0/2102778781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ca4003aa0 0x7f7ca4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cb9439700 1 -- 172.21.15.5:0/2102778781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7cb415cd40 msgr2=0x7f7ca4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:48.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cb9439700 1 --2- 172.21.15.5:0/2102778781 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7cb415cd40 0x7f7ca4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cb9439700 1 -- 172.21.15.5:0/2102778781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ca4003aa0 msgr2=0x7f7ca4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cb9439700 1 --2- 172.21.15.5:0/2102778781 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ca4003aa0 0x7f7ca4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cb9439700 1 -- 172.21.15.5:0/2102778781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca40035b0 con 0x7f7ca4004d90 2023-03-03T06:24:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cb9439700 1 --2- 172.21.15.5:0/2102778781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4004d90 0x7f7ca4005200 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00a830 tx=0x7f7ca4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae9ac517abd4728 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac012600 con 0x7f7ca4004d90 2023-03-03T06:24:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac012780 con 0x7f7ca4004d90 2023-03-03T06:24:48.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cb37fe700 1 -- 172.21.15.5:0/2102778781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac012b30 con 0x7f7ca4004d90 2023-03-03T06:24:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cbae9c700 1 -- 172.21.15.5:0/2102778781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4004d90 msgr2=0x7f7ca4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cbae9c700 1 --2- 172.21.15.5:0/2102778781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4004d90 0x7f7ca4005200 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00a830 tx=0x7f7ca4005880 comp rx=0 tx=0).stop 2023-03-03T06:24:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cb9439700 1 -- 172.21.15.5:0/2102778781 reap_dead start 2023-03-03T06:24:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cbae9c700 1 -- 172.21.15.5:0/2102778781 shutdown_connections 2023-03-03T06:24:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cbae9c700 1 -- 172.21.15.5:0/2102778781 >> 172.21.15.5:0/2102778781 conn(0x7f7cb40cc8d0 msgr2=0x7f7cb40cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:48.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cbae9c700 1 -- 172.21.15.5:0/2102778781 shutdown_connections 2023-03-03T06:24:48.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.938+0000 7f7cbae9c700 1 -- 172.21.15.5:0/2102778781 wait complete. 2023-03-03T06:24:48.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.940+0000 7f7cbae9c700 1 Processor -- start 2023-03-03T06:24:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.940+0000 7f7cbae9c700 1 -- start start 2023-03-03T06:24:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cbae9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4004d90 0x7f7cb40b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cbae9c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7cb40b1170 0x7f7cb40b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cbae9c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7cb414bdb0 0x7f7cb414c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cbae9c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40b58a0 con 0x7f7ca4004d90 2023-03-03T06:24:48.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cbae9c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40b1b20 con 0x7f7cb414bdb0 2023-03-03T06:24:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cbae9c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40b49a0 con 0x7f7cb40b1170 2023-03-03T06:24:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb8c38700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4004d90 0x7f7cb40b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb8c38700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4004d90 0x7f7cb40b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43310/0 (socket says 172.21.15.5:43310) 2023-03-03T06:24:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb8c38700 1 -- 172.21.15.5:0/119331916 learned_addr learned my addr 172.21.15.5:0/119331916 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb9439700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7cb414bdb0 0x7f7cb414c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:48.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb8c38700 1 -- 172.21.15.5:0/119331916 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7cb40b1170 msgr2=0x7f7cb40b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:48.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb8c38700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7cb40b1170 0x7f7cb40b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:48.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb8c38700 1 -- 172.21.15.5:0/119331916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7cb414bdb0 msgr2=0x7f7cb414c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:48.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb8c38700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7cb414bdb0 0x7f7cb414c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:48.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb8c38700 1 -- 172.21.15.5:0/119331916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb415e060 con 0x7f7ca4004d90 2023-03-03T06:24:48.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb9439700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7cb414bdb0 0x7f7cb414c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb8c38700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4004d90 0x7f7cb40b4460 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8011b00 tx=0x7f7ca8011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb17fa700 1 -- 172.21.15.5:0/119331916 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800fa00 con 0x7f7ca4004d90 2023-03-03T06:24:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb17fa700 1 -- 172.21.15.5:0/119331916 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca800fb60 con 0x7f7ca4004d90 2023-03-03T06:24:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cbae9c700 1 -- 172.21.15.5:0/119331916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb415dd80 con 0x7f7ca4004d90 2023-03-03T06:24:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cb17fa700 1 -- 172.21.15.5:0/119331916 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8014440 con 0x7f7ca4004d90 2023-03-03T06:24:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.941+0000 7f7cbae9c700 1 -- 172.21.15.5:0/119331916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb40ca530 con 0x7f7ca4004d90 2023-03-03T06:24:48.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.942+0000 7f7cbae9c700 1 -- 172.21.15.5:0/119331916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb404e6e0 con 0x7f7ca4004d90 2023-03-03T06:24:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.943+0000 7f7cb17fa700 1 -- 172.21.15.5:0/119331916 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7ca80145a0 con 0x7f7ca4004d90 2023-03-03T06:24:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.943+0000 7f7cb17fa700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c980682f0 0x7f7c9806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.943+0000 7f7cb17fa700 1 -- 172.21.15.5:0/119331916 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7ca80863b0 con 0x7f7ca4004d90 2023-03-03T06:24:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.943+0000 7f7cb3fff700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c980682f0 0x7f7c9806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:48.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.944+0000 7f7cb3fff700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c980682f0 0x7f7c9806a7a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7cb415b930 tx=0x7f7ca0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:48.947+0000 7f7cb17fa700 1 -- 172.21.15.5:0/119331916 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7ca8052ee0 con 0x7f7ca4004d90 2023-03-03T06:24:49.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.214+0000 7f7cbae9c700 1 -- 172.21.15.5:0/119331916 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7cb40b5b10 con 0x7f7ca4004d90 2023-03-03T06:24:49.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.214+0000 7f7cb17fa700 1 -- 172.21.15.5:0/119331916 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f7cb40b5b10 con 0x7f7ca4004d90 2023-03-03T06:24:49.217 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:49.217 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-03-03T06:24:49.217 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-03-03T06:24:49.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.217 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-03-03T06:24:49.217 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkziqmKRAARZXnnbV545/aKwJvt9QAgw==", 2023-03-03T06:24:49.218 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:24:49.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:24:49.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:24:49.218 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.219 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.219 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-03-03T06:24:49.220 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkYP9KNhAA/yyEBoBn/eJ8/6mufuiznQ==", 2023-03-03T06:24:49.220 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:24:49.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:24:49.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:24:49.220 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.221 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.221 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-03-03T06:24:49.221 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFk23MbMRAA1E6lR036GpHdLG9WAVzE2A==", 2023-03-03T06:24:49.222 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:24:49.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:24:49.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:24:49.223 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.223 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.224 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-03-03T06:24:49.224 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFkQYUSAhAAt9Hj4Yq5VW5NJENi11Gsag==", 2023-03-03T06:24:49.224 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:24:49.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:24:49.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:24:49.225 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.225 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.226 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.226 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-03-03T06:24:49.226 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7kgFkiS2tKRAAuYbICLnn3CQtdepNk9uG7Q==", 2023-03-03T06:24:49.226 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:24:49.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:24:49.226 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.227 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.227 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.227 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-03-03T06:24:49.227 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA+kgFkpDf4KBAA77yBycaKiSFdrCP9F0C5IA==", 2023-03-03T06:24:49.227 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:24:49.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:24:49.228 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.228 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.228 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.229 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-03-03T06:24:49.229 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBkgFk/OK7JxAAQFCaUo0b/+8gDkgP1Ifqwg==", 2023-03-03T06:24:49.229 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.229 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:24:49.229 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:24:49.229 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.230 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.230 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.230 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-03-03T06:24:49.230 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEkgFkhcBFJxAA3Q62rulwQRz9/VZeV938sg==", 2023-03-03T06:24:49.230 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.230 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:24:49.231 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:24:49.231 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.231 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.231 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.231 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-03-03T06:24:49.231 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKkgFkHSO9KBAATkFiqiMet/gmDP9rNTozLA==", 2023-03-03T06:24:49.232 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.232 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:24:49.232 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:24:49.232 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.232 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.232 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-03-03T06:24:49.233 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBNkgFkOUmVJxAA4gVwSp2IhnyXKPt+72wXOw==", 2023-03-03T06:24:49.233 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.233 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:24:49.233 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:24:49.233 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.233 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.233 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.234 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-03-03T06:24:49.234 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBQkgFkBHsSJxAA0kN0Sob1BvksDKPj4e/yTA==", 2023-03-03T06:24:49.234 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.234 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:24:49.234 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:24:49.234 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.234 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.235 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-03-03T06:24:49.235 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBTkgFkusR5JhAAsvEY2m5hImRjdFSqtEFVBw==", 2023-03-03T06:24:49.235 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.235 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:24:49.235 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:24:49.235 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.236 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.236 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-03-03T06:24:49.236 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFkkZyRBhAA/Q44zwMnP6p4QwYJUCk0Ow==", 2023-03-03T06:24:49.236 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.236 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:24:49.236 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-03-03T06:24:49.237 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-03-03T06:24:49.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-03-03T06:24:49.237 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.237 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-03-03T06:24:49.237 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFke8dHDRAA5tXiSg31lHzCfcffU+ycDw==", 2023-03-03T06:24:49.237 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.238 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:24:49.238 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-03-03T06:24:49.238 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-03-03T06:24:49.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-03-03T06:24:49.238 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.239 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-03-03T06:24:49.239 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFk6W3zCRAAMk0SzOs1po/kkiSR41EAbA==", 2023-03-03T06:24:49.239 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.239 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:24:49.239 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-03-03T06:24:49.239 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-03-03T06:24:49.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-03-03T06:24:49.240 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.240 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-03-03T06:24:49.240 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFk4NGTEBAAQne/fOUfeZe1sWAZXnJ5Cw==", 2023-03-03T06:24:49.240 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.240 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:24:49.241 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-03-03T06:24:49.241 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-03-03T06:24:49.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-03-03T06:24:49.241 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.241 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-03-03T06:24:49.241 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkrhMlDBAAIRxVSXIMLiI0L4p+Odt4AA==", 2023-03-03T06:24:49.242 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.242 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-03-03T06:24:49.242 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:24:49.242 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:24:49.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.242 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.243 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mds", 2023-03-03T06:24:49.243 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBZkgFkijdXJRAAGujofhk1UlAXPLP3Mzjrww==", 2023-03-03T06:24:49.243 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.243 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mds" 2023-03-03T06:24:49.243 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.244 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-mgr", 2023-03-03T06:24:49.244 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBZkgFkQkJXJRAAiR7TvfS6sK2twJTwXghTlA==", 2023-03-03T06:24:49.244 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.244 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-mgr" 2023-03-03T06:24:49.244 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.245 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-osd", 2023-03-03T06:24:49.245 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBZkgFkXUtXJRAAVb3nc/lZmq95IGx3itwopQ==", 2023-03-03T06:24:49.245 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.245 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-osd" 2023-03-03T06:24:49.245 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.245 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.245 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd", 2023-03-03T06:24:49.246 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBZkgFkVVNXJRAA9SsVe76Uy2EV8HVbmxG4Og==", 2023-03-03T06:24:49.246 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.246 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd" 2023-03-03T06:24:49.246 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.246 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-03-03T06:24:49.246 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBZkgFkiVtXJRAAvxDRGvNMYbU6bKNj/F7ssw==", 2023-03-03T06:24:49.247 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.247 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-03-03T06:24:49.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.247 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.bootstrap-rgw", 2023-03-03T06:24:49.247 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBZkgFkyWNXJRAAn4JF/rY4RUpiusH0N37Xpw==", 2023-03-03T06:24:49.248 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.248 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile bootstrap-rgw" 2023-03-03T06:24:49.248 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.248 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-03-03T06:24:49.248 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkRHQbJhAAq2ZAqxUiXeNQLLcfaVvj7g==", 2023-03-03T06:24:49.248 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.249 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-03-03T06:24:49.249 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-03-03T06:24:49.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:49.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:49.249 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-03-03T06:24:49.249 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFktxgZIhAAsvbF/OzJf4OZ7a85LkWKtw==", 2023-03-03T06:24:49.250 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:24:49.250 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-03-03T06:24:49.250 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-03-03T06:24:49.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:24:49.250 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.250 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:49.250 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-03-03T06:24:49.250 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-03-03T06:24:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.216+0000 7f7cbae9c700 1 -- 172.21.15.5:0/119331916 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c980682f0 msgr2=0x7f7c9806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.216+0000 7f7cbae9c700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c980682f0 0x7f7c9806a7a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7cb415b930 tx=0x7f7ca0009040 comp rx=0 tx=0).stop 2023-03-03T06:24:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.216+0000 7f7cbae9c700 1 -- 172.21.15.5:0/119331916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4004d90 msgr2=0x7f7cb40b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.216+0000 7f7cbae9c700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4004d90 0x7f7cb40b4460 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8011b00 tx=0x7f7ca8011ec0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.216+0000 7f7cbae9c700 1 -- 172.21.15.5:0/119331916 shutdown_connections 2023-03-03T06:24:49.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.216+0000 7f7cbae9c700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7cb414bdb0 0x7f7cb414c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.216+0000 7f7cbae9c700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca4004d90 0x7f7cb40b4460 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.216+0000 7f7cbae9c700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c980682f0 0x7f7c9806a7a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.216+0000 7f7cbae9c700 1 --2- 172.21.15.5:0/119331916 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7cb40b1170 0x7f7cb40b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.216+0000 7f7cbae9c700 1 -- 172.21.15.5:0/119331916 >> 172.21.15.5:0/119331916 conn(0x7f7cb40cc8d0 msgr2=0x7f7cb406b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:49.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.216+0000 7f7cbae9c700 1 -- 172.21.15.5:0/119331916 shutdown_connections 2023-03-03T06:24:49.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.216+0000 7f7cbae9c700 1 -- 172.21.15.5:0/119331916 wait complete. 2023-03-03T06:24:49.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-03-03T06:24:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.378+0000 7f1872e50700 1 Processor -- start 2023-03-03T06:24:49.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.378+0000 7f1872e50700 1 -- start start 2023-03-03T06:24:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f1872e50700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f186c15cd40 0x7f186c0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f1872e50700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f186c0cba50 0x7f186c0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f1872e50700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c15d4e0 con 0x7f186c0cd3e0 2023-03-03T06:24:49.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f1872e50700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186c15d7c0 con 0x7f186c15cd40 2023-03-03T06:24:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f1872e50700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c15daa0 con 0x7f186c0cba50 2023-03-03T06:24:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f18713ed700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f186c0cd3e0 0x7f186c160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33164/0 (socket says 172.21.15.5:33164) 2023-03-03T06:24:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f18713ed700 1 -- 172.21.15.5:0/432568305 learned_addr learned my addr 172.21.15.5:0/432568305 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f1870bec700 1 --2- 172.21.15.5:0/432568305 >> v2:172.21.15.191:3300/0 conn(0x7f186c15cd40 0x7f186c0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f186bfff700 1 --2- 172.21.15.5:0/432568305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f186c0cba50 0x7f186c0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f186b7fe700 1 -- 172.21.15.5:0/432568305 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395926581 0 0) 0x7f186c15d4e0 con 0x7f186c0cd3e0 2023-03-03T06:24:49.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f186b7fe700 1 -- 172.21.15.5:0/432568305 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f185c0035b0 con 0x7f186c0cd3e0 2023-03-03T06:24:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f1870bec700 1 -- 172.21.15.5:0/432568305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f186c0cba50 msgr2=0x7f186c0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f1870bec700 1 --2- 172.21.15.5:0/432568305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f186c0cba50 0x7f186c0b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f1870bec700 1 -- 172.21.15.5:0/432568305 >> v1:172.21.15.5:6789/0 conn(0x7f186c0cd3e0 legacy=0x7f186c160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f1870bec700 1 -- 172.21.15.5:0/432568305 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c15dd80 con 0x7f186c15cd40 2023-03-03T06:24:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.379+0000 7f186bfff700 1 --2- 172.21.15.5:0/432568305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f186c0cba50 0x7f186c0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.380+0000 7f1870bec700 1 --2- 172.21.15.5:0/432568305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f186c15cd40 0x7f186c0b18d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1860009840 tx=0x7f1860009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11fe6213dfb8e9e4 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.380+0000 7f186b7fe700 1 -- 172.21.15.5:0/432568305 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860011830 con 0x7f186c15cd40 2023-03-03T06:24:49.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.380+0000 7f186b7fe700 1 -- 172.21.15.5:0/432568305 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860011990 con 0x7f186c15cd40 2023-03-03T06:24:49.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.380+0000 7f186b7fe700 1 -- 172.21.15.5:0/432568305 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860011d20 con 0x7f186c15cd40 2023-03-03T06:24:49.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.380+0000 7f1872e50700 1 -- 172.21.15.5:0/432568305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f186c15cd40 msgr2=0x7f186c0b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.380+0000 7f1872e50700 1 --2- 172.21.15.5:0/432568305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f186c15cd40 0x7f186c0b18d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1860009840 tx=0x7f1860009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.380+0000 7f1872e50700 1 -- 172.21.15.5:0/432568305 shutdown_connections 2023-03-03T06:24:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.380+0000 7f1872e50700 1 --2- 172.21.15.5:0/432568305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f186c15cd40 0x7f186c0b18d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.380+0000 7f1872e50700 1 --2- 172.21.15.5:0/432568305 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f186c0cba50 0x7f186c0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.380+0000 7f1872e50700 1 -- 172.21.15.5:0/432568305 >> 172.21.15.5:0/432568305 conn(0x7f186c0cc8d0 msgr2=0x7f186c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:49.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.381+0000 7f1872e50700 1 -- 172.21.15.5:0/432568305 shutdown_connections 2023-03-03T06:24:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.381+0000 7f1872e50700 1 -- 172.21.15.5:0/432568305 wait complete. 2023-03-03T06:24:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.382+0000 7f1872e50700 1 Processor -- start 2023-03-03T06:24:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.382+0000 7f1872e50700 1 -- start start 2023-03-03T06:24:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f1872e50700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f186c0cba50 0x7f186c0ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f1872e50700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f186c0cd3e0 0x7f186c0c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:49.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f1872e50700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c15cd40 0x7f186c0c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f1872e50700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0c6f20 con 0x7f186c15cd40 2023-03-03T06:24:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f1872e50700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0acb10 con 0x7f186c0cd3e0 2023-03-03T06:24:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f1872e50700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0acdf0 con 0x7f186c0cba50 2023-03-03T06:24:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f18713ed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c15cd40 0x7f186c0c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f18713ed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c15cd40 0x7f186c0c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43328/0 (socket says 172.21.15.5:43328) 2023-03-03T06:24:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f18713ed700 1 -- 172.21.15.5:0/1487900780 learned_addr learned my addr 172.21.15.5:0/1487900780 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:49.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f186bfff700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f186c0cd3e0 0x7f186c0c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f1870bec700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f186c0cba50 0x7f186c0ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f18713ed700 1 -- 172.21.15.5:0/1487900780 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f186c0cba50 msgr2=0x7f186c0ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f18713ed700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f186c0cba50 0x7f186c0ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f18713ed700 1 -- 172.21.15.5:0/1487900780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f186c0cd3e0 msgr2=0x7f186c0c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f18713ed700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f186c0cd3e0 0x7f186c0c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f18713ed700 1 -- 172.21.15.5:0/1487900780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858009430 con 0x7f186c15cd40 2023-03-03T06:24:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f186bfff700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f186c0cd3e0 0x7f186c0c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:49.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f18713ed700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c15cd40 0x7f186c0c4ac0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f186400cb40 tx=0x7f186400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f18697fa700 1 -- 172.21.15.5:0/1487900780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186400ab50 con 0x7f186c15cd40 2023-03-03T06:24:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f1872e50700 1 -- 172.21.15.5:0/1487900780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18600094a0 con 0x7f186c15cd40 2023-03-03T06:24:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f18697fa700 1 -- 172.21.15.5:0/1487900780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186400acb0 con 0x7f186c15cd40 2023-03-03T06:24:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.383+0000 7f18697fa700 1 -- 172.21.15.5:0/1487900780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864012620 con 0x7f186c15cd40 2023-03-03T06:24:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.384+0000 7f1872e50700 1 -- 172.21.15.5:0/1487900780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c0ca530 con 0x7f186c15cd40 2023-03-03T06:24:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.384+0000 7f1872e50700 1 -- 172.21.15.5:0/1487900780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c15e060 con 0x7f186c15cd40 2023-03-03T06:24:49.391 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.385+0000 7f18697fa700 1 -- 172.21.15.5:0/1487900780 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1864019030 con 0x7f186c15cd40 2023-03-03T06:24:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.385+0000 7f18697fa700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f18500682f0 0x7f185006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.386+0000 7f1870bec700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f18500682f0 0x7f185006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:49.392 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.386+0000 7f18697fa700 1 -- 172.21.15.5:0/1487900780 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1864085790 con 0x7f186c15cd40 2023-03-03T06:24:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.386+0000 7f1870bec700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f18500682f0 0x7f185006a7a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1860000c00 tx=0x7f186001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:49.393 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.390+0000 7f18697fa700 1 -- 172.21.15.5:0/1487900780 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1864052180 con 0x7f186c15cd40 2023-03-03T06:24:49.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.659+0000 7f1872e50700 1 -- 172.21.15.5:0/1487900780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f186c15d110 con 0x7f186c15cd40 2023-03-03T06:24:49.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.662+0000 7f18697fa700 1 -- 172.21.15.5:0/1487900780 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f18640557a0 con 0x7f186c15cd40 2023-03-03T06:24:49.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.664+0000 7f1872e50700 1 -- 172.21.15.5:0/1487900780 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f18500682f0 msgr2=0x7f185006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.664+0000 7f1872e50700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f18500682f0 0x7f185006a7a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1860000c00 tx=0x7f186001c040 comp rx=0 tx=0).stop 2023-03-03T06:24:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.664+0000 7f1872e50700 1 -- 172.21.15.5:0/1487900780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c15cd40 msgr2=0x7f186c0c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.664+0000 7f1872e50700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c15cd40 0x7f186c0c4ac0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f186400cb40 tx=0x7f186400cf00 comp rx=0 tx=0).stop 2023-03-03T06:24:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.664+0000 7f1872e50700 1 -- 172.21.15.5:0/1487900780 shutdown_connections 2023-03-03T06:24:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.664+0000 7f1872e50700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c15cd40 0x7f186c0c4ac0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.664+0000 7f1872e50700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f18500682f0 0x7f185006a7a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.664+0000 7f1872e50700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f186c0cba50 0x7f186c0ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.664+0000 7f1872e50700 1 --2- 172.21.15.5:0/1487900780 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f186c0cd3e0 0x7f186c0c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.664+0000 7f1872e50700 1 -- 172.21.15.5:0/1487900780 >> 172.21.15.5:0/1487900780 conn(0x7f186c0cc8d0 msgr2=0x7f186c0ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:49.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.664+0000 7f1872e50700 1 -- 172.21.15.5:0/1487900780 shutdown_connections 2023-03-03T06:24:49.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.664+0000 7f1872e50700 1 -- 172.21.15.5:0/1487900780 wait complete. 2023-03-03T06:24:49.678 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-03-03T06:24:49.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.801+0000 7fd04d500700 1 Processor -- start 2023-03-03T06:24:49.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.802+0000 7fd04d500700 1 -- start start 2023-03-03T06:24:49.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.802+0000 7fd04d500700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd0480cb710 0x7fd0480cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:49.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.803+0000 7fd04d500700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04815f2a0 con 0x7fd0480b43b0 2023-03-03T06:24:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.803+0000 7fd04d500700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0480cf550 con 0x7fd0480cff20 2023-03-03T06:24:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.803+0000 7fd04d500700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0480cd820 con 0x7fd0480cb710 2023-03-03T06:24:49.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.803+0000 7fd0477fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd0480b43b0 0x7fd04815e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33178/0 (socket says 172.21.15.5:33178) 2023-03-03T06:24:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.803+0000 7fd0477fe700 1 -- 172.21.15.5:0/3500999496 learned_addr learned my addr 172.21.15.5:0/3500999496 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.803+0000 7fd046ffd700 1 --2- 172.21.15.5:0/3500999496 >> v2:172.21.15.191:3300/0 conn(0x7fd0480cb710 0x7fd0480cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:49.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.803+0000 7fd045ffb700 1 -- 172.21.15.5:0/3500999496 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480452392 0 0) 0x7fd04815f2a0 con 0x7fd0480b43b0 2023-03-03T06:24:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.803+0000 7fd045ffb700 1 -- 172.21.15.5:0/3500999496 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0300035b0 con 0x7fd0480b43b0 2023-03-03T06:24:49.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.803+0000 7fd046ffd700 1 -- 172.21.15.5:0/3500999496 >> v1:172.21.15.191:6789/0 conn(0x7fd0480cff20 legacy=0x7fd0480b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.803+0000 7fd045ffb700 1 -- 172.21.15.5:0/3500999496 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298654760 0 0) 0x7fd0480cf550 con 0x7fd0480cff20 2023-03-03T06:24:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.803+0000 7fd046ffd700 1 -- 172.21.15.5:0/3500999496 >> v1:172.21.15.5:6789/0 conn(0x7fd0480b43b0 legacy=0x7fd04815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:49.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.803+0000 7fd046ffd700 1 -- 172.21.15.5:0/3500999496 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04815efc0 con 0x7fd0480cb710 2023-03-03T06:24:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.803+0000 7fd046ffd700 1 --2- 172.21.15.5:0/3500999496 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480cb710 0x7fd0480cf9e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd03c009840 tx=0x7fd03c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ff2b33d4de1a0e2 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.804+0000 7fd045ffb700 1 -- 172.21.15.5:0/3500999496 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c011830 con 0x7fd0480cb710 2023-03-03T06:24:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.804+0000 7fd045ffb700 1 -- 172.21.15.5:0/3500999496 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c011990 con 0x7fd0480cb710 2023-03-03T06:24:49.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.804+0000 7fd045ffb700 1 -- 172.21.15.5:0/3500999496 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c011d20 con 0x7fd0480cb710 2023-03-03T06:24:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.804+0000 7fd04d500700 1 -- 172.21.15.5:0/3500999496 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480cb710 msgr2=0x7fd0480cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:49.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.804+0000 7fd04d500700 1 --2- 172.21.15.5:0/3500999496 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480cb710 0x7fd0480cf9e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd03c009840 tx=0x7fd03c009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.804+0000 7fd04d500700 1 -- 172.21.15.5:0/3500999496 shutdown_connections 2023-03-03T06:24:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.804+0000 7fd04d500700 1 --2- 172.21.15.5:0/3500999496 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480cb710 0x7fd0480cf9e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.804+0000 7fd04d500700 1 -- 172.21.15.5:0/3500999496 >> 172.21.15.5:0/3500999496 conn(0x7fd048070050 msgr2=0x7fd048070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.804+0000 7fd04d500700 1 -- 172.21.15.5:0/3500999496 shutdown_connections 2023-03-03T06:24:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.804+0000 7fd04d500700 1 -- 172.21.15.5:0/3500999496 wait complete. 2023-03-03T06:24:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.806+0000 7fd04d500700 1 Processor -- start 2023-03-03T06:24:49.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.806+0000 7fd04d500700 1 -- start start 2023-03-03T06:24:49.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.806+0000 7fd04d500700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0480b43b0 0x7fd0480c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:49.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.806+0000 7fd04d500700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0480cb710 0x7fd0480b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:49.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.806+0000 7fd04d500700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480cff20 0x7fd0480c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:49.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.806+0000 7fd04d500700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480c9a70 con 0x7fd0480cb710 2023-03-03T06:24:49.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.806+0000 7fd04d500700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480b3470 con 0x7fd0480cff20 2023-03-03T06:24:49.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.806+0000 7fd04d500700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480b2d10 con 0x7fd0480b43b0 2023-03-03T06:24:49.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd0467fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0480cb710 0x7fd0480b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd0467fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0480cb710 0x7fd0480b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43340/0 (socket says 172.21.15.5:43340) 2023-03-03T06:24:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd0467fc700 1 -- 172.21.15.5:0/4107949337 learned_addr learned my addr 172.21.15.5:0/4107949337 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:49.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd0477fe700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480cff20 0x7fd0480c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd046ffd700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0480b43b0 0x7fd0480c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd0467fc700 1 -- 172.21.15.5:0/4107949337 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0480b43b0 msgr2=0x7fd0480c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:49.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd0467fc700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0480b43b0 0x7fd0480c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd0467fc700 1 -- 172.21.15.5:0/4107949337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480cff20 msgr2=0x7fd0480c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:49.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd0467fc700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480cff20 0x7fd0480c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:49.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd0467fc700 1 -- 172.21.15.5:0/4107949337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c0094a0 con 0x7fd0480cb710 2023-03-03T06:24:49.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd046ffd700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0480b43b0 0x7fd0480c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:49.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd0467fc700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0480cb710 0x7fd0480b27d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd03800c550 tx=0x7fd03800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:49.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd02f7fe700 1 -- 172.21.15.5:0/4107949337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0380054e0 con 0x7fd0480cb710 2023-03-03T06:24:49.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd02f7fe700 1 -- 172.21.15.5:0/4107949337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd038003680 con 0x7fd0480cb710 2023-03-03T06:24:49.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd02f7fe700 1 -- 172.21.15.5:0/4107949337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd038003a30 con 0x7fd0480cb710 2023-03-03T06:24:49.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd04d500700 1 -- 172.21.15.5:0/4107949337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0480cf1e0 con 0x7fd0480cb710 2023-03-03T06:24:49.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.807+0000 7fd04d500700 1 -- 172.21.15.5:0/4107949337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0480cef00 con 0x7fd0480cb710 2023-03-03T06:24:49.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.808+0000 7fd04d500700 1 -- 172.21.15.5:0/4107949337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04815eac0 con 0x7fd0480cb710 2023-03-03T06:24:49.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.809+0000 7fd02f7fe700 1 -- 172.21.15.5:0/4107949337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd038019030 con 0x7fd0480cb710 2023-03-03T06:24:49.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.809+0000 7fd02f7fe700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd0340682f0 0x7fd03406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:49.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.809+0000 7fd02f7fe700 1 -- 172.21.15.5:0/4107949337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd038084d90 con 0x7fd0480cb710 2023-03-03T06:24:49.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.809+0000 7fd046ffd700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd0340682f0 0x7fd03406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:49.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.809+0000 7fd046ffd700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd0340682f0 0x7fd03406a7a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd03c009fd0 tx=0x7fd03c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:49.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:49.813+0000 7fd02f7fe700 1 -- 172.21.15.5:0/4107949337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd038051800 con 0x7fd0480cb710 2023-03-03T06:24:50.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.087+0000 7fd04d500700 1 -- 172.21.15.5:0/4107949337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd0480c9bb0 con 0x7fd0480cb710 2023-03-03T06:24:50.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.090+0000 7fd02f7fe700 1 -- 172.21.15.5:0/4107949337 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd0480c9bb0 con 0x7fd0480cb710 2023-03-03T06:24:50.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.092+0000 7fd04d500700 1 -- 172.21.15.5:0/4107949337 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd0340682f0 msgr2=0x7fd03406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.092+0000 7fd04d500700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd0340682f0 0x7fd03406a7a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd03c009fd0 tx=0x7fd03c01c040 comp rx=0 tx=0).stop 2023-03-03T06:24:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.092+0000 7fd04d500700 1 -- 172.21.15.5:0/4107949337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0480cb710 msgr2=0x7fd0480b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.092+0000 7fd04d500700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0480cb710 0x7fd0480b27d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd03800c550 tx=0x7fd03800c860 comp rx=0 tx=0).stop 2023-03-03T06:24:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.092+0000 7fd04d500700 1 -- 172.21.15.5:0/4107949337 shutdown_connections 2023-03-03T06:24:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.092+0000 7fd04d500700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480cff20 0x7fd0480c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.092+0000 7fd04d500700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd0340682f0 0x7fd03406a7a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.092+0000 7fd04d500700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0480b43b0 0x7fd0480c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.092+0000 7fd04d500700 1 --2- 172.21.15.5:0/4107949337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0480cb710 0x7fd0480b27d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.092+0000 7fd04d500700 1 -- 172.21.15.5:0/4107949337 >> 172.21.15.5:0/4107949337 conn(0x7fd048070050 msgr2=0x7fd04815aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.093+0000 7fd04d500700 1 -- 172.21.15.5:0/4107949337 shutdown_connections 2023-03-03T06:24:50.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.093+0000 7fd04d500700 1 -- 172.21.15.5:0/4107949337 wait complete. 2023-03-03T06:24:50.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-03-03T06:24:50.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.231+0000 7fa3bd9b5700 1 Processor -- start 2023-03-03T06:24:50.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.231+0000 7fa3bd9b5700 1 -- start start 2023-03-03T06:24:50.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.232+0000 7fa3bd9b5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3b806c830 0x7fa3b8160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:50.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.232+0000 7fa3bd9b5700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa3b80cf2a0 0x7fa3b80d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:50.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.232+0000 7fa3bd9b5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b80d2e10 con 0x7fa3b80b8a40 2023-03-03T06:24:50.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.232+0000 7fa3bd9b5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b8161490 con 0x7fa3b806c830 2023-03-03T06:24:50.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.232+0000 7fa3bd9b5700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b80cd8d0 con 0x7fa3b80cf2a0 2023-03-03T06:24:50.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.232+0000 7fa3b67fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3b806c830 0x7fa3b8160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:50.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.232+0000 7fa3b6ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa3b80b8a40 0x7fa3b806c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33188/0 (socket says 172.21.15.5:33188) 2023-03-03T06:24:50.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.232+0000 7fa3b6ffd700 1 -- 172.21.15.5:0/137030084 learned_addr learned my addr 172.21.15.5:0/137030084 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:50.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.232+0000 7fa3b77fe700 1 --2- 172.21.15.5:0/137030084 >> v2:172.21.15.191:3300/0 conn(0x7fa3b80cf2a0 0x7fa3b80d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:50.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.232+0000 7fa3b67fc700 1 -- 172.21.15.5:0/137030084 >> v2:172.21.15.191:3300/0 conn(0x7fa3b80cf2a0 msgr2=0x7fa3b80d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:50.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.232+0000 7fa3b67fc700 1 --2- 172.21.15.5:0/137030084 >> v2:172.21.15.191:3300/0 conn(0x7fa3b80cf2a0 0x7fa3b80d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.232+0000 7fa3b67fc700 1 -- 172.21.15.5:0/137030084 >> v1:172.21.15.5:6789/0 conn(0x7fa3b80b8a40 legacy=0x7fa3b806c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.232+0000 7fa3b67fc700 1 -- 172.21.15.5:0/137030084 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b80d2520 con 0x7fa3b806c830 2023-03-03T06:24:50.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.233+0000 7fa3b67fc700 1 --2- 172.21.15.5:0/137030084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b806c830 0x7fa3b8160f50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80b8e10 tx=0x7fa3a8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfe1f6541887fce server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:50.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.233+0000 7fa3b5ffb700 1 -- 172.21.15.5:0/137030084 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8011830 con 0x7fa3b806c830 2023-03-03T06:24:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.233+0000 7fa3b5ffb700 1 -- 172.21.15.5:0/137030084 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a8011990 con 0x7fa3b806c830 2023-03-03T06:24:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.233+0000 7fa3b5ffb700 1 -- 172.21.15.5:0/137030084 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8011d20 con 0x7fa3b806c830 2023-03-03T06:24:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.233+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/137030084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b806c830 msgr2=0x7fa3b8160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.233+0000 7fa3bd9b5700 1 --2- 172.21.15.5:0/137030084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b806c830 0x7fa3b8160f50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80b8e10 tx=0x7fa3a8009b20 comp rx=0 tx=0).stop 2023-03-03T06:24:50.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.233+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/137030084 shutdown_connections 2023-03-03T06:24:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.233+0000 7fa3bd9b5700 1 --2- 172.21.15.5:0/137030084 >> v2:172.21.15.191:3300/0 conn(0x7fa3b80cf2a0 0x7fa3b80d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.233+0000 7fa3bd9b5700 1 --2- 172.21.15.5:0/137030084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b806c830 0x7fa3b8160f50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.233+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/137030084 >> 172.21.15.5:0/137030084 conn(0x7fa3b80d05d0 msgr2=0x7fa3b80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.233+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/137030084 shutdown_connections 2023-03-03T06:24:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.233+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/137030084 wait complete. 2023-03-03T06:24:50.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.235+0000 7fa3bd9b5700 1 Processor -- start 2023-03-03T06:24:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.235+0000 7fa3bd9b5700 1 -- start start 2023-03-03T06:24:50.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.235+0000 7fa3bd9b5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b806c830 0x7fa3b80b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:50.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3bd9b5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b80b8a40 0x7fa3b81f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:50.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3bd9b5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3b80cf2a0 0x7fa3b80b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:50.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3bd9b5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b814ef80 con 0x7fa3b806c830 2023-03-03T06:24:50.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3bd9b5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80b4780 con 0x7fa3b80cf2a0 2023-03-03T06:24:50.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3bd9b5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b81f2080 con 0x7fa3b80b8a40 2023-03-03T06:24:50.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3b6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b806c830 0x7fa3b80b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:50.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3b6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b806c830 0x7fa3b80b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43352/0 (socket says 172.21.15.5:43352) 2023-03-03T06:24:50.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3b6ffd700 1 -- 172.21.15.5:0/558392622 learned_addr learned my addr 172.21.15.5:0/558392622 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:50.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3b77fe700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3b80cf2a0 0x7fa3b80b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:50.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3b67fc700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b80b8a40 0x7fa3b81f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3b6ffd700 1 -- 172.21.15.5:0/558392622 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b80b8a40 msgr2=0x7fa3b81f1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3b6ffd700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b80b8a40 0x7fa3b81f1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3b6ffd700 1 -- 172.21.15.5:0/558392622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3b80cf2a0 msgr2=0x7fa3b80b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3b6ffd700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3b80cf2a0 0x7fa3b80b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3b6ffd700 1 -- 172.21.15.5:0/558392622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a80094a0 con 0x7fa3b806c830 2023-03-03T06:24:50.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3b6ffd700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b806c830 0x7fa3b80b4240 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c520 tx=0x7fa3a000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:50.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3affff700 1 -- 172.21.15.5:0/558392622 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0005d70 con 0x7fa3b806c830 2023-03-03T06:24:50.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3affff700 1 -- 172.21.15.5:0/558392622 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a00070d0 con 0x7fa3b806c830 2023-03-03T06:24:50.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/558392622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b80d2850 con 0x7fa3b806c830 2023-03-03T06:24:50.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3affff700 1 -- 172.21.15.5:0/558392622 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0007440 con 0x7fa3b806c830 2023-03-03T06:24:50.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.236+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/558392622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b815ce30 con 0x7fa3b806c830 2023-03-03T06:24:50.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.237+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/558392622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b80d2b30 con 0x7fa3b806c830 2023-03-03T06:24:50.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.238+0000 7fa3affff700 1 -- 172.21.15.5:0/558392622 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa3a0019030 con 0x7fa3b806c830 2023-03-03T06:24:50.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.238+0000 7fa3affff700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa3980682f0 0x7fa39806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:50.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.238+0000 7fa3affff700 1 -- 172.21.15.5:0/558392622 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa3a0084b70 con 0x7fa3b806c830 2023-03-03T06:24:50.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.238+0000 7fa3b67fc700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa3980682f0 0x7fa39806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:50.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.239+0000 7fa3b67fc700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa3980682f0 0x7fa39806a7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa3b806cc20 tx=0x7fa3a801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:50.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.243+0000 7fa3affff700 1 -- 172.21.15.5:0/558392622 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa3a004b5e0 con 0x7fa3b806c830 2023-03-03T06:24:50.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.517+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/558392622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fa3b80d2e10 con 0x7fa3b806c830 2023-03-03T06:24:50.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.521+0000 7fa3affff700 1 -- 172.21.15.5:0/558392622 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa3b80d2e10 con 0x7fa3b806c830 2023-03-03T06:24:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.523+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/558392622 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa3980682f0 msgr2=0x7fa39806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.523+0000 7fa3bd9b5700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa3980682f0 0x7fa39806a7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa3b806cc20 tx=0x7fa3a801c040 comp rx=0 tx=0).stop 2023-03-03T06:24:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.523+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/558392622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b806c830 msgr2=0x7fa3b80b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.523+0000 7fa3bd9b5700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b806c830 0x7fa3b80b4240 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c520 tx=0x7fa3a000c8e0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.523+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/558392622 shutdown_connections 2023-03-03T06:24:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.523+0000 7fa3bd9b5700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3b80cf2a0 0x7fa3b80b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.523+0000 7fa3bd9b5700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b806c830 0x7fa3b80b4240 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.523+0000 7fa3bd9b5700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa3980682f0 0x7fa39806a7a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.523+0000 7fa3bd9b5700 1 --2- 172.21.15.5:0/558392622 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b80b8a40 0x7fa3b81f1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.523+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/558392622 >> 172.21.15.5:0/558392622 conn(0x7fa3b80d05d0 msgr2=0x7fa3b80b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.523+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/558392622 shutdown_connections 2023-03-03T06:24:50.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.523+0000 7fa3bd9b5700 1 -- 172.21.15.5:0/558392622 wait complete. 2023-03-03T06:24:50.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-03-03T06:24:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.663+0000 7f2603ea5700 1 Processor -- start 2023-03-03T06:24:50.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.663+0000 7f2603ea5700 1 -- start start 2023-03-03T06:24:50.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.664+0000 7f2603ea5700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f25fc159550 0x7f25fc15dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.664+0000 7f2603ea5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25fc0cebc0 0x7f25fc0cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.664+0000 7f2603ea5700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25fc06e3f0 con 0x7f25fc06d1b0 2023-03-03T06:24:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.664+0000 7f2603ea5700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25fc0cf580 con 0x7f25fc159550 2023-03-03T06:24:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.664+0000 7f2603ea5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc06e6d0 con 0x7f25fc0cebc0 2023-03-03T06:24:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2601c41700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f25fc159550 0x7f25fc15dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2602442700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25fc0cebc0 0x7f25fc0cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:50.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2602442700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25fc0cebc0 0x7f25fc0cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:41442/0 (socket says 172.21.15.5:41442) 2023-03-03T06:24:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2601440700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f25fc06d1b0 0x7f25fc06dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:47730/0 (socket says 172.21.15.5:47730) 2023-03-03T06:24:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2601c41700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f25fc159550 0x7f25fc15dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:43720/0 (socket says 172.21.15.5:43720) 2023-03-03T06:24:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2602442700 1 -- 172.21.15.5:0/202818470 learned_addr learned my addr 172.21.15.5:0/202818470 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2601c41700 1 -- 172.21.15.5:0/202818470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25fc0cebc0 msgr2=0x7f25fc0cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2601c41700 1 --2- 172.21.15.5:0/202818470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25fc0cebc0 0x7f25fc0cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2601c41700 1 -- 172.21.15.5:0/202818470 >> v1:172.21.15.191:6789/0 conn(0x7f25fc06d1b0 legacy=0x7f25fc06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2600c3f700 1 -- 172.21.15.5:0/202818470 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189349356 0 0) 0x7f25fc06e3f0 con 0x7f25fc06d1b0 2023-03-03T06:24:50.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2601c41700 1 -- 172.21.15.5:0/202818470 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc06c6d0 con 0x7f25fc159550 2023-03-03T06:24:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2602442700 1 --2- 172.21.15.5:0/202818470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25fc0cebc0 0x7f25fc0cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2601c41700 1 --2- 172.21.15.5:0/202818470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc159550 0x7f25fc15dd10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009840 tx=0x7f25ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52ddad9663e98c9a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2600c3f700 1 -- 172.21.15.5:0/202818470 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec011830 con 0x7f25fc159550 2023-03-03T06:24:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2600c3f700 1 -- 172.21.15.5:0/202818470 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec011990 con 0x7f25fc159550 2023-03-03T06:24:50.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.665+0000 7f2600c3f700 1 -- 172.21.15.5:0/202818470 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec011d20 con 0x7f25fc159550 2023-03-03T06:24:50.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.666+0000 7f2603ea5700 1 -- 172.21.15.5:0/202818470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc159550 msgr2=0x7f25fc15dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.666+0000 7f2603ea5700 1 --2- 172.21.15.5:0/202818470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc159550 0x7f25fc15dd10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009840 tx=0x7f25ec009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:50.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.666+0000 7f2603ea5700 1 -- 172.21.15.5:0/202818470 shutdown_connections 2023-03-03T06:24:50.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.666+0000 7f2603ea5700 1 --2- 172.21.15.5:0/202818470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25fc0cebc0 0x7f25fc0cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.666+0000 7f2603ea5700 1 --2- 172.21.15.5:0/202818470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc159550 0x7f25fc15dd10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.666+0000 7f2603ea5700 1 -- 172.21.15.5:0/202818470 >> 172.21.15.5:0/202818470 conn(0x7f25fc0cfd00 msgr2=0x7f25fc0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:50.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.666+0000 7f2603ea5700 1 -- 172.21.15.5:0/202818470 shutdown_connections 2023-03-03T06:24:50.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.666+0000 7f2603ea5700 1 -- 172.21.15.5:0/202818470 wait complete. 2023-03-03T06:24:50.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.668+0000 7f2603ea5700 1 Processor -- start 2023-03-03T06:24:50.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.668+0000 7f2603ea5700 1 -- start start 2023-03-03T06:24:50.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2603ea5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25fc06d1b0 0x7f25fc14a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:50.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2603ea5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25fc0cebc0 0x7f25fc14b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:50.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2603ea5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc159550 0x7f25fc14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:50.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2603ea5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc14dd60 con 0x7f25fc06d1b0 2023-03-03T06:24:50.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2603ea5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc14a780 con 0x7f25fc159550 2023-03-03T06:24:50.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2603ea5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc14d120 con 0x7f25fc0cebc0 2023-03-03T06:24:50.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2601c41700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25fc06d1b0 0x7f25fc14a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:50.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2601c41700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25fc06d1b0 0x7f25fc14a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43366/0 (socket says 172.21.15.5:43366) 2023-03-03T06:24:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2601c41700 1 -- 172.21.15.5:0/4064173905 learned_addr learned my addr 172.21.15.5:0/4064173905 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2602442700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc159550 0x7f25fc14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2601440700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25fc0cebc0 0x7f25fc14b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2601c41700 1 -- 172.21.15.5:0/4064173905 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25fc0cebc0 msgr2=0x7f25fc14b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2601c41700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25fc0cebc0 0x7f25fc14b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2601c41700 1 -- 172.21.15.5:0/4064173905 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc159550 msgr2=0x7f25fc14b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2601c41700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc159550 0x7f25fc14b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2601c41700 1 -- 172.21.15.5:0/4064173905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f4009b30 con 0x7f25fc06d1b0 2023-03-03T06:24:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2602442700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc159550 0x7f25fc14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.669+0000 7f2601c41700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25fc06d1b0 0x7f25fc14a240 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009fd0 tx=0x7f25ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.670+0000 7f25f27fc700 1 -- 172.21.15.5:0/4064173905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec004570 con 0x7f25fc06d1b0 2023-03-03T06:24:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.670+0000 7f25f27fc700 1 -- 172.21.15.5:0/4064173905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec0036a0 con 0x7f25fc06d1b0 2023-03-03T06:24:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.670+0000 7f25f27fc700 1 -- 172.21.15.5:0/4064173905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec003a50 con 0x7f25fc06d1b0 2023-03-03T06:24:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.670+0000 7f2603ea5700 1 -- 172.21.15.5:0/4064173905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ec0094a0 con 0x7f25fc06d1b0 2023-03-03T06:24:50.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.670+0000 7f2603ea5700 1 -- 172.21.15.5:0/4064173905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25fc06cc90 con 0x7f25fc06d1b0 2023-03-03T06:24:50.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.671+0000 7f2603ea5700 1 -- 172.21.15.5:0/4064173905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25fc06c9b0 con 0x7f25fc06d1b0 2023-03-03T06:24:50.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.671+0000 7f25f27fc700 1 -- 172.21.15.5:0/4064173905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f25ec00f050 con 0x7f25fc06d1b0 2023-03-03T06:24:50.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.671+0000 7f25f27fc700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f25e00682f0 0x7f25e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:50.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.671+0000 7f25f27fc700 1 -- 172.21.15.5:0/4064173905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f25ec088800 con 0x7f25fc06d1b0 2023-03-03T06:24:50.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.671+0000 7f2601440700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f25e00682f0 0x7f25e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:50.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.672+0000 7f2601440700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f25e00682f0 0x7f25e006a7a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f25fc14cc10 tx=0x7f25f8007be0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:50.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.676+0000 7f25f27fc700 1 -- 172.21.15.5:0/4064173905 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f25ec055270 con 0x7f25fc06d1b0 2023-03-03T06:24:50.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.947+0000 7f2603ea5700 1 -- 172.21.15.5:0/4064173905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f25fc06d840 con 0x7f25fc06d1b0 2023-03-03T06:24:50.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.951+0000 7f25f27fc700 1 -- 172.21.15.5:0/4064173905 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f25ec0150a0 con 0x7f25fc06d1b0 2023-03-03T06:24:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.952+0000 7f2603ea5700 1 -- 172.21.15.5:0/4064173905 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f25e00682f0 msgr2=0x7f25e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.952+0000 7f2603ea5700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f25e00682f0 0x7f25e006a7a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f25fc14cc10 tx=0x7f25f8007be0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.952+0000 7f2603ea5700 1 -- 172.21.15.5:0/4064173905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25fc06d1b0 msgr2=0x7f25fc14a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.952+0000 7f2603ea5700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25fc06d1b0 0x7f25fc14a240 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009fd0 tx=0x7f25ec004750 comp rx=0 tx=0).stop 2023-03-03T06:24:50.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.953+0000 7f2603ea5700 1 -- 172.21.15.5:0/4064173905 shutdown_connections 2023-03-03T06:24:50.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.953+0000 7f2603ea5700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25fc159550 0x7f25fc14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.953+0000 7f2603ea5700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25fc06d1b0 0x7f25fc14a240 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.953+0000 7f2603ea5700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f25e00682f0 0x7f25e006a7a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.953+0000 7f2603ea5700 1 --2- 172.21.15.5:0/4064173905 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25fc0cebc0 0x7f25fc14b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:50.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.953+0000 7f2603ea5700 1 -- 172.21.15.5:0/4064173905 >> 172.21.15.5:0/4064173905 conn(0x7f25fc0cfd00 msgr2=0x7f25fc0c8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:50.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.953+0000 7f2603ea5700 1 -- 172.21.15.5:0/4064173905 shutdown_connections 2023-03-03T06:24:50.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:50.953+0000 7f2603ea5700 1 -- 172.21.15.5:0/4064173905 wait complete. 2023-03-03T06:24:50.967 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-03-03T06:24:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.090+0000 7f711eb86700 1 Processor -- start 2023-03-03T06:24:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.090+0000 7f711eb86700 1 -- start start 2023-03-03T06:24:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.091+0000 7f711eb86700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f711815cd40 0x7f71180b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.091+0000 7f711eb86700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f71180cba50 0x7f71180b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.091+0000 7f711eb86700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71180cd3e0 0x7f7118160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.091+0000 7f711eb86700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711815d4e0 con 0x7f71180cd3e0 2023-03-03T06:24:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.091+0000 7f711eb86700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711815d7c0 con 0x7f71180cba50 2023-03-03T06:24:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.091+0000 7f711eb86700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711815daa0 con 0x7f711815cd40 2023-03-03T06:24:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.091+0000 7f711d123700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71180cd3e0 0x7f7118160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.091+0000 7f711d123700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f71180cd3e0 0x7f7118160790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43378/0 (socket says 172.21.15.5:43378) 2023-03-03T06:24:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.091+0000 7f711d123700 1 -- 172.21.15.5:0/986365277 learned_addr learned my addr 172.21.15.5:0/986365277 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.091+0000 7f711c922700 1 --2- 172.21.15.5:0/986365277 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f711815cd40 0x7f71180b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.091+0000 7f7117fff700 1 --2- 172.21.15.5:0/986365277 >> v2:172.21.15.191:3300/0 conn(0x7f71180cba50 0x7f71180b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711d123700 1 -- 172.21.15.5:0/986365277 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f711815cd40 msgr2=0x7f71180b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711d123700 1 --2- 172.21.15.5:0/986365277 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f711815cd40 0x7f71180b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711d123700 1 -- 172.21.15.5:0/986365277 >> v2:172.21.15.191:3300/0 conn(0x7f71180cba50 msgr2=0x7f71180b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711d123700 1 --2- 172.21.15.5:0/986365277 >> v2:172.21.15.191:3300/0 conn(0x7f71180cba50 0x7f71180b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711d123700 1 -- 172.21.15.5:0/986365277 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711815dd80 con 0x7f71180cd3e0 2023-03-03T06:24:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711d123700 1 --2- 172.21.15.5:0/986365277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71180cd3e0 0x7f7118160790 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7118068820 tx=0x7f711000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1978647c78391d44 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f71177fe700 1 -- 172.21.15.5:0/986365277 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711000e070 con 0x7f71180cd3e0 2023-03-03T06:24:51.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f71177fe700 1 -- 172.21.15.5:0/986365277 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711000b910 con 0x7f71180cd3e0 2023-03-03T06:24:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f71177fe700 1 -- 172.21.15.5:0/986365277 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711000bcc0 con 0x7f71180cd3e0 2023-03-03T06:24:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711eb86700 1 -- 172.21.15.5:0/986365277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71180cd3e0 msgr2=0x7f7118160790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711eb86700 1 --2- 172.21.15.5:0/986365277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71180cd3e0 0x7f7118160790 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7118068820 tx=0x7f711000b330 comp rx=0 tx=0).stop 2023-03-03T06:24:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711eb86700 1 -- 172.21.15.5:0/986365277 shutdown_connections 2023-03-03T06:24:51.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711eb86700 1 --2- 172.21.15.5:0/986365277 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f711815cd40 0x7f71180b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711eb86700 1 --2- 172.21.15.5:0/986365277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71180cd3e0 0x7f7118160790 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711eb86700 1 --2- 172.21.15.5:0/986365277 >> v2:172.21.15.191:3300/0 conn(0x7f71180cba50 0x7f71180b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711eb86700 1 -- 172.21.15.5:0/986365277 >> 172.21.15.5:0/986365277 conn(0x7f71180cc8d0 msgr2=0x7f71180cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711eb86700 1 -- 172.21.15.5:0/986365277 shutdown_connections 2023-03-03T06:24:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.092+0000 7f711eb86700 1 -- 172.21.15.5:0/986365277 wait complete. 2023-03-03T06:24:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.094+0000 7f711eb86700 1 Processor -- start 2023-03-03T06:24:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.094+0000 7f711eb86700 1 -- start start 2023-03-03T06:24:51.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711eb86700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71180cba50 0x7f71180b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711eb86700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71180cd3e0 0x7f71181f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711eb86700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f711815cd40 0x7f71180c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711eb86700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71181f59a0 con 0x7f711815cd40 2023-03-03T06:24:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711eb86700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71180c7e70 con 0x7f71180cd3e0 2023-03-03T06:24:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711eb86700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71180c8110 con 0x7f71180cba50 2023-03-03T06:24:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711d123700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f711815cd40 0x7f71180c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711d123700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f711815cd40 0x7f71180c7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43384/0 (socket says 172.21.15.5:43384) 2023-03-03T06:24:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711d123700 1 -- 172.21.15.5:0/2949622434 learned_addr learned my addr 172.21.15.5:0/2949622434 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711c922700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71180cba50 0x7f71180b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f7117fff700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71180cd3e0 0x7f71181f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711d123700 1 -- 172.21.15.5:0/2949622434 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71180cba50 msgr2=0x7f71180b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711d123700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71180cba50 0x7f71180b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711d123700 1 -- 172.21.15.5:0/2949622434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71180cd3e0 msgr2=0x7f71181f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711d123700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71180cd3e0 0x7f71181f5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711d123700 1 -- 172.21.15.5:0/2949622434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110009b30 con 0x7f711815cd40 2023-03-03T06:24:51.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f7117fff700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71180cd3e0 0x7f71181f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:51.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711d123700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f711815cd40 0x7f71180c7930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7118071050 tx=0x7f7110004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:51.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f71157fa700 1 -- 172.21.15.5:0/2949622434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711000ce80 con 0x7f711815cd40 2023-03-03T06:24:51.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f71157fa700 1 -- 172.21.15.5:0/2949622434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7110004250 con 0x7f711815cd40 2023-03-03T06:24:51.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f711eb86700 1 -- 172.21.15.5:0/2949622434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71180ca530 con 0x7f711815cd40 2023-03-03T06:24:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.095+0000 7f71157fa700 1 -- 172.21.15.5:0/2949622434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110004600 con 0x7f711815cd40 2023-03-03T06:24:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.096+0000 7f711eb86700 1 -- 172.21.15.5:0/2949622434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711815e060 con 0x7f711815cd40 2023-03-03T06:24:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.096+0000 7f711eb86700 1 -- 172.21.15.5:0/2949622434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711815d110 con 0x7f711815cd40 2023-03-03T06:24:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.097+0000 7f71157fa700 1 -- 172.21.15.5:0/2949622434 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7110004760 con 0x7f711815cd40 2023-03-03T06:24:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.097+0000 7f71157fa700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70fc0682f0 0x7f70fc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.097+0000 7f71157fa700 1 -- 172.21.15.5:0/2949622434 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7110087050 con 0x7f711815cd40 2023-03-03T06:24:51.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.097+0000 7f711c922700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70fc0682f0 0x7f70fc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.098+0000 7f711c922700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70fc0682f0 0x7f70fc06a7a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f710c009b70 tx=0x7f710c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:51.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.101+0000 7f71157fa700 1 -- 172.21.15.5:0/2949622434 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7110053ac0 con 0x7f711815cd40 2023-03-03T06:24:51.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.375+0000 7f711eb86700 1 -- 172.21.15.5:0/2949622434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f711804e6e0 con 0x7f711815cd40 2023-03-03T06:24:51.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.379+0000 7f71157fa700 1 -- 172.21.15.5:0/2949622434 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f71100200a0 con 0x7f711815cd40 2023-03-03T06:24:51.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.381+0000 7f711eb86700 1 -- 172.21.15.5:0/2949622434 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70fc0682f0 msgr2=0x7f70fc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.381+0000 7f711eb86700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70fc0682f0 0x7f70fc06a7a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f710c009b70 tx=0x7f710c008040 comp rx=0 tx=0).stop 2023-03-03T06:24:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.381+0000 7f711eb86700 1 -- 172.21.15.5:0/2949622434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f711815cd40 msgr2=0x7f71180c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.381+0000 7f711eb86700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f711815cd40 0x7f71180c7930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7118071050 tx=0x7f7110004ad0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.381+0000 7f711eb86700 1 -- 172.21.15.5:0/2949622434 shutdown_connections 2023-03-03T06:24:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.381+0000 7f711eb86700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f711815cd40 0x7f71180c7930 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.381+0000 7f711eb86700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70fc0682f0 0x7f70fc06a7a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.381+0000 7f711eb86700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71180cba50 0x7f71180b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.381+0000 7f711eb86700 1 --2- 172.21.15.5:0/2949622434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71180cd3e0 0x7f71181f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.381+0000 7f711eb86700 1 -- 172.21.15.5:0/2949622434 >> 172.21.15.5:0/2949622434 conn(0x7f71180cc8d0 msgr2=0x7f71180ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:51.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.381+0000 7f711eb86700 1 -- 172.21.15.5:0/2949622434 shutdown_connections 2023-03-03T06:24:51.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.381+0000 7f711eb86700 1 -- 172.21.15.5:0/2949622434 wait complete. 2023-03-03T06:24:51.395 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-03-03T06:24:51.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.520+0000 7f8cada19700 1 Processor -- start 2023-03-03T06:24:51.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.520+0000 7f8cada19700 1 -- start start 2023-03-03T06:24:51.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.520+0000 7f8cada19700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ca815cda0 0x7f8ca80d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.520+0000 7f8cada19700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8ca80cd960 0x7f8ca80cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8cada19700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca80d10b0 con 0x7f8ca80cf9e0 2023-03-03T06:24:51.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8cada19700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca80d1c30 con 0x7f8ca815cda0 2023-03-03T06:24:51.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8cada19700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca80d1300 con 0x7f8ca80cd960 2023-03-03T06:24:51.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8ca6ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8ca815cda0 0x7f8ca80d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8ca77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8ca80cf9e0 0x7f8ca80cfe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33234/0 (socket says 172.21.15.5:33234) 2023-03-03T06:24:51.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8ca77fe700 1 -- 172.21.15.5:0/3846272635 learned_addr learned my addr 172.21.15.5:0/3846272635 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:51.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8ca67fc700 1 --2- 172.21.15.5:0/3846272635 >> v2:172.21.15.191:3300/0 conn(0x7f8ca80cd960 0x7f8ca80cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8ca6ffd700 1 -- 172.21.15.5:0/3846272635 >> v2:172.21.15.191:3300/0 conn(0x7f8ca80cd960 msgr2=0x7f8ca80cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:51.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8ca6ffd700 1 --2- 172.21.15.5:0/3846272635 >> v2:172.21.15.191:3300/0 conn(0x7f8ca80cd960 0x7f8ca80cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8ca6ffd700 1 -- 172.21.15.5:0/3846272635 >> v1:172.21.15.5:6789/0 conn(0x7f8ca80cf9e0 legacy=0x7f8ca80cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8ca5ffb700 1 -- 172.21.15.5:0/3846272635 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529823593 0 0) 0x7f8ca80d10b0 con 0x7f8ca80cf9e0 2023-03-03T06:24:51.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8ca6ffd700 1 -- 172.21.15.5:0/3846272635 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca80d15e0 con 0x7f8ca815cda0 2023-03-03T06:24:51.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8ca6ffd700 1 --2- 172.21.15.5:0/3846272635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ca815cda0 0x7f8ca80d20c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8ca808bfd0 tx=0x7f8c98009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bf8cecae7d1001 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:51.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8ca5ffb700 1 -- 172.21.15.5:0/3846272635 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98011830 con 0x7f8ca815cda0 2023-03-03T06:24:51.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8ca5ffb700 1 -- 172.21.15.5:0/3846272635 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c98011990 con 0x7f8ca815cda0 2023-03-03T06:24:51.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.521+0000 7f8ca5ffb700 1 -- 172.21.15.5:0/3846272635 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98011d20 con 0x7f8ca815cda0 2023-03-03T06:24:51.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.522+0000 7f8cada19700 1 -- 172.21.15.5:0/3846272635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ca815cda0 msgr2=0x7f8ca80d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.522+0000 7f8cada19700 1 --2- 172.21.15.5:0/3846272635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ca815cda0 0x7f8ca80d20c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8ca808bfd0 tx=0x7f8c98009b20 comp rx=0 tx=0).stop 2023-03-03T06:24:51.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.522+0000 7f8cada19700 1 -- 172.21.15.5:0/3846272635 shutdown_connections 2023-03-03T06:24:51.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.522+0000 7f8cada19700 1 --2- 172.21.15.5:0/3846272635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ca815cda0 0x7f8ca80d20c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.522+0000 7f8cada19700 1 --2- 172.21.15.5:0/3846272635 >> v2:172.21.15.191:3300/0 conn(0x7f8ca80cd960 0x7f8ca80cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.522+0000 7f8cada19700 1 -- 172.21.15.5:0/3846272635 >> 172.21.15.5:0/3846272635 conn(0x7f8ca80b4c10 msgr2=0x7f8ca80b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:51.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.522+0000 7f8cada19700 1 -- 172.21.15.5:0/3846272635 shutdown_connections 2023-03-03T06:24:51.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.522+0000 7f8cada19700 1 -- 172.21.15.5:0/3846272635 wait complete. 2023-03-03T06:24:51.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.523+0000 7f8cada19700 1 Processor -- start 2023-03-03T06:24:51.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.523+0000 7f8cada19700 1 -- start start 2023-03-03T06:24:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8cada19700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ca80cd960 0x7f8ca8154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8cada19700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ca80cf9e0 0x7f8ca81f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8cada19700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ca815cda0 0x7f8ca80b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8cada19700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca81f6ef0 con 0x7f8ca815cda0 2023-03-03T06:24:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8cada19700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca80b6790 con 0x7f8ca80cf9e0 2023-03-03T06:24:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8cada19700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca8155480 con 0x7f8ca80cd960 2023-03-03T06:24:51.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8ca77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ca815cda0 0x7f8ca80b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8ca77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ca815cda0 0x7f8ca80b83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43398/0 (socket says 172.21.15.5:43398) 2023-03-03T06:24:51.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8ca77fe700 1 -- 172.21.15.5:0/2759590807 learned_addr learned my addr 172.21.15.5:0/2759590807 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:51.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8ca67fc700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ca80cf9e0 0x7f8ca81f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8ca6ffd700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ca80cd960 0x7f8ca8154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8ca77fe700 1 -- 172.21.15.5:0/2759590807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ca80cd960 msgr2=0x7f8ca8154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8ca77fe700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ca80cd960 0x7f8ca8154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8ca77fe700 1 -- 172.21.15.5:0/2759590807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ca80cf9e0 msgr2=0x7f8ca81f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8ca77fe700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ca80cf9e0 0x7f8ca81f29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8ca77fe700 1 -- 172.21.15.5:0/2759590807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c980094a0 con 0x7f8ca815cda0 2023-03-03T06:24:51.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8ca6ffd700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ca80cd960 0x7f8ca8154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:51.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.524+0000 7f8ca67fc700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ca80cf9e0 0x7f8ca81f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:51.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.525+0000 7f8ca77fe700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ca815cda0 0x7f8ca80b83f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000cca0 tx=0x7f8ca000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:51.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.525+0000 7f8c8ffff700 1 -- 172.21.15.5:0/2759590807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000cea0 con 0x7f8ca815cda0 2023-03-03T06:24:51.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.525+0000 7f8c8ffff700 1 -- 172.21.15.5:0/2759590807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca000ad80 con 0x7f8ca815cda0 2023-03-03T06:24:51.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.525+0000 7f8cada19700 1 -- 172.21.15.5:0/2759590807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca80ce310 con 0x7f8ca815cda0 2023-03-03T06:24:51.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.525+0000 7f8c8ffff700 1 -- 172.21.15.5:0/2759590807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0007310 con 0x7f8ca815cda0 2023-03-03T06:24:51.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.525+0000 7f8cada19700 1 -- 172.21.15.5:0/2759590807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca80d18c0 con 0x7f8ca815cda0 2023-03-03T06:24:51.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.526+0000 7f8cada19700 1 -- 172.21.15.5:0/2759590807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca815d170 con 0x7f8ca815cda0 2023-03-03T06:24:51.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.526+0000 7f8c8ffff700 1 -- 172.21.15.5:0/2759590807 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8ca0010070 con 0x7f8ca815cda0 2023-03-03T06:24:51.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.527+0000 7f8c8ffff700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c940682f0 0x7f8c9406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.527+0000 7f8c8ffff700 1 -- 172.21.15.5:0/2759590807 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8ca0085650 con 0x7f8ca815cda0 2023-03-03T06:24:51.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.527+0000 7f8ca6ffd700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c940682f0 0x7f8c9406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.527+0000 7f8ca6ffd700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c940682f0 0x7f8c9406a7a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8c980090b0 tx=0x7f8c98008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:51.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.531+0000 7f8c8ffff700 1 -- 172.21.15.5:0/2759590807 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8ca0051fe0 con 0x7f8ca815cda0 2023-03-03T06:24:51.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.802+0000 7f8cada19700 1 -- 172.21.15.5:0/2759590807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f8ca80b68d0 con 0x7f8ca815cda0 2023-03-03T06:24:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.805+0000 7f8c8ffff700 1 -- 172.21.15.5:0/2759590807 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8ca80b68d0 con 0x7f8ca815cda0 2023-03-03T06:24:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.808+0000 7f8cada19700 1 -- 172.21.15.5:0/2759590807 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c940682f0 msgr2=0x7f8c9406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.808+0000 7f8cada19700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c940682f0 0x7f8c9406a7a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8c980090b0 tx=0x7f8c98008030 comp rx=0 tx=0).stop 2023-03-03T06:24:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.808+0000 7f8cada19700 1 -- 172.21.15.5:0/2759590807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ca815cda0 msgr2=0x7f8ca80b83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.808+0000 7f8cada19700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ca815cda0 0x7f8ca80b83f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000cca0 tx=0x7f8ca000a340 comp rx=0 tx=0).stop 2023-03-03T06:24:51.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.808+0000 7f8cada19700 1 -- 172.21.15.5:0/2759590807 shutdown_connections 2023-03-03T06:24:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.808+0000 7f8cada19700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8ca815cda0 0x7f8ca80b83f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.808+0000 7f8cada19700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8c940682f0 0x7f8c9406a7a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.808+0000 7f8cada19700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ca80cd960 0x7f8ca8154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.808+0000 7f8cada19700 1 --2- 172.21.15.5:0/2759590807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ca80cf9e0 0x7f8ca81f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.808+0000 7f8cada19700 1 -- 172.21.15.5:0/2759590807 >> 172.21.15.5:0/2759590807 conn(0x7f8ca80b4c10 msgr2=0x7f8ca80b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.808+0000 7f8cada19700 1 -- 172.21.15.5:0/2759590807 shutdown_connections 2023-03-03T06:24:51.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.808+0000 7f8cada19700 1 -- 172.21.15.5:0/2759590807 wait complete. 2023-03-03T06:24:51.822 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:51.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.945+0000 7f21b8a1f700 1 Processor -- start 2023-03-03T06:24:51.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.945+0000 7f21b8a1f700 1 -- start start 2023-03-03T06:24:51.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.946+0000 7f21b8a1f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21b41573f0 0x7f21b415d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.946+0000 7f21b8a1f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b41577c0 con 0x7f21b40b18d0 2023-03-03T06:24:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.946+0000 7f21b8a1f700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b4159e60 con 0x7f21b40cc1a0 2023-03-03T06:24:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.946+0000 7f21b8a1f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b40cd790 con 0x7f21b41573f0 2023-03-03T06:24:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.946+0000 7f21b259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21b41573f0 0x7f21b415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.946+0000 7f21b2d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f21b40b18d0 0x7f21b40b1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33248/0 (socket says 172.21.15.5:33248) 2023-03-03T06:24:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.946+0000 7f21b2d9d700 1 -- 172.21.15.5:0/2882011367 learned_addr learned my addr 172.21.15.5:0/2882011367 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.946+0000 7f21b259c700 1 -- 172.21.15.5:0/2882011367 >> v1:172.21.15.191:6789/0 conn(0x7f21b40cc1a0 legacy=0x7f21b40cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.946+0000 7f21b159a700 1 -- 172.21.15.5:0/2882011367 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672184990 0 0) 0x7f21b41577c0 con 0x7f21b40b18d0 2023-03-03T06:24:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.946+0000 7f21b259c700 1 -- 172.21.15.5:0/2882011367 >> v1:172.21.15.5:6789/0 conn(0x7f21b40b18d0 legacy=0x7f21b40b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.946+0000 7f21b259c700 1 -- 172.21.15.5:0/2882011367 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b40ce460 con 0x7f21b41573f0 2023-03-03T06:24:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.946+0000 7f21b259c700 1 --2- 172.21.15.5:0/2882011367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b41573f0 0x7f21b415d320 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009840 tx=0x7f21a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5e29043637346 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.947+0000 7f21b159a700 1 -- 172.21.15.5:0/2882011367 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a4011830 con 0x7f21b41573f0 2023-03-03T06:24:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.947+0000 7f21b159a700 1 -- 172.21.15.5:0/2882011367 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a4011990 con 0x7f21b41573f0 2023-03-03T06:24:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.947+0000 7f21b159a700 1 -- 172.21.15.5:0/2882011367 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a4011d20 con 0x7f21b41573f0 2023-03-03T06:24:51.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.947+0000 7f21b8a1f700 1 -- 172.21.15.5:0/2882011367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b41573f0 msgr2=0x7f21b415d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.947+0000 7f21b8a1f700 1 --2- 172.21.15.5:0/2882011367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b41573f0 0x7f21b415d320 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009840 tx=0x7f21a4009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:51.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.947+0000 7f21b8a1f700 1 -- 172.21.15.5:0/2882011367 shutdown_connections 2023-03-03T06:24:51.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.947+0000 7f21b8a1f700 1 --2- 172.21.15.5:0/2882011367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b41573f0 0x7f21b415d320 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.947+0000 7f21b8a1f700 1 -- 172.21.15.5:0/2882011367 >> 172.21.15.5:0/2882011367 conn(0x7f21b40cc8d0 msgr2=0x7f21b40cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:51.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.947+0000 7f21b8a1f700 1 -- 172.21.15.5:0/2882011367 shutdown_connections 2023-03-03T06:24:51.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.947+0000 7f21b8a1f700 1 -- 172.21.15.5:0/2882011367 wait complete. 2023-03-03T06:24:51.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.949+0000 7f21b8a1f700 1 Processor -- start 2023-03-03T06:24:51.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.949+0000 7f21b8a1f700 1 -- start start 2023-03-03T06:24:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.949+0000 7f21b8a1f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21b40b18d0 0x7f21b41eed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.949+0000 7f21b8a1f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b40cc1a0 0x7f21b40c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.949+0000 7f21b8a1f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21b41573f0 0x7f21b40c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.949+0000 7f21b8a1f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b41ef360 con 0x7f21b40cc1a0 2023-03-03T06:24:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.949+0000 7f21b8a1f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b41ef640 con 0x7f21b40b18d0 2023-03-03T06:24:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.949+0000 7f21b8a1f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b41ef920 con 0x7f21b41573f0 2023-03-03T06:24:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b40cc1a0 0x7f21b40c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b40cc1a0 0x7f21b40c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43408/0 (socket says 172.21.15.5:43408) 2023-03-03T06:24:51.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b1d9b700 1 -- 172.21.15.5:0/1264347418 learned_addr learned my addr 172.21.15.5:0/1264347418 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:51.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b259c700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21b40b18d0 0x7f21b41eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b2d9d700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21b41573f0 0x7f21b40c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b1d9b700 1 -- 172.21.15.5:0/1264347418 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21b41573f0 msgr2=0x7f21b40c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b1d9b700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21b41573f0 0x7f21b40c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b1d9b700 1 -- 172.21.15.5:0/1264347418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21b40b18d0 msgr2=0x7f21b41eed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:51.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b1d9b700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21b40b18d0 0x7f21b41eed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:51.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b1d9b700 1 -- 172.21.15.5:0/1264347418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a40094a0 con 0x7f21b40cc1a0 2023-03-03T06:24:51.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b2d9d700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21b41573f0 0x7f21b40c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:51.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b1d9b700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b40cc1a0 0x7f21b40c79c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c520 tx=0x7f21a800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:51.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21a2ffd700 1 -- 172.21.15.5:0/1264347418 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a80052d0 con 0x7f21b40cc1a0 2023-03-03T06:24:51.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21a2ffd700 1 -- 172.21.15.5:0/1264347418 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a8005430 con 0x7f21b40cc1a0 2023-03-03T06:24:51.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b8a1f700 1 -- 172.21.15.5:0/1264347418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b415dbe0 con 0x7f21b40cc1a0 2023-03-03T06:24:51.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21a2ffd700 1 -- 172.21.15.5:0/1264347418 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a80038f0 con 0x7f21b40cc1a0 2023-03-03T06:24:51.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.950+0000 7f21b8a1f700 1 -- 172.21.15.5:0/1264347418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b415d900 con 0x7f21b40cc1a0 2023-03-03T06:24:51.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.951+0000 7f21b8a1f700 1 -- 172.21.15.5:0/1264347418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b415dec0 con 0x7f21b40cc1a0 2023-03-03T06:24:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.952+0000 7f21a2ffd700 1 -- 172.21.15.5:0/1264347418 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f21a8019030 con 0x7f21b40cc1a0 2023-03-03T06:24:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.952+0000 7f21a2ffd700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f21940682f0 0x7f219406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.952+0000 7f21a2ffd700 1 -- 172.21.15.5:0/1264347418 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f21a8084eb0 con 0x7f21b40cc1a0 2023-03-03T06:24:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.952+0000 7f21b259c700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f21940682f0 0x7f219406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:51.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.952+0000 7f21b259c700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f21940682f0 0x7f219406a7a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f21a4000c00 tx=0x7f21a401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:51.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:51.956+0000 7f21a2ffd700 1 -- 172.21.15.5:0/1264347418 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f21a80518c0 con 0x7f21b40cc1a0 2023-03-03T06:24:52.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.152+0000 7f21b8a1f700 1 -- 172.21.15.5:0/1264347418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21b404e6e0 con 0x7f21b40cc1a0 2023-03-03T06:24:52.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.153+0000 7f21a2ffd700 1 -- 172.21.15.5:0/1264347418 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+14270 (secure 0 0 0) 0x7f21a8054ee0 con 0x7f21b40cc1a0 2023-03-03T06:24:52.155 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:52.156 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:24:48.782850+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:52.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.155+0000 7f21b8a1f700 1 -- 172.21.15.5:0/1264347418 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f21940682f0 msgr2=0x7f219406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.155+0000 7f21b8a1f700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f21940682f0 0x7f219406a7a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f21a4000c00 tx=0x7f21a401c040 comp rx=0 tx=0).stop 2023-03-03T06:24:52.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.155+0000 7f21b8a1f700 1 -- 172.21.15.5:0/1264347418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b40cc1a0 msgr2=0x7f21b40c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.155+0000 7f21b8a1f700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b40cc1a0 0x7f21b40c79c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c520 tx=0x7f21a800c8e0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.155+0000 7f21b8a1f700 1 -- 172.21.15.5:0/1264347418 shutdown_connections 2023-03-03T06:24:52.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.155+0000 7f21b8a1f700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f21940682f0 0x7f219406a7a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.155+0000 7f21b8a1f700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21b41573f0 0x7f21b40c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.155+0000 7f21b8a1f700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21b40b18d0 0x7f21b41eed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.155+0000 7f21b8a1f700 1 --2- 172.21.15.5:0/1264347418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21b40cc1a0 0x7f21b40c79c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.155+0000 7f21b8a1f700 1 -- 172.21.15.5:0/1264347418 >> 172.21.15.5:0/1264347418 conn(0x7f21b40cc8d0 msgr2=0x7f21b4156620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:52.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.155+0000 7f21b8a1f700 1 -- 172.21.15.5:0/1264347418 shutdown_connections 2023-03-03T06:24:52.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.155+0000 7f21b8a1f700 1 -- 172.21.15.5:0/1264347418 wait complete. 2023-03-03T06:24:52.170 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T06:24:52.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:24:52.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.295+0000 7fd1aa9a8700 1 Processor -- start 2023-03-03T06:24:52.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.295+0000 7fd1aa9a8700 1 -- start start 2023-03-03T06:24:52.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.296+0000 7fd1aa9a8700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd1a415a460 0x7fd1a40cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.296+0000 7fd1aa9a8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a415a830 0x7fd1a40cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.296+0000 7fd1aa9a8700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a40cd650 con 0x7fd1a40b01a0 2023-03-03T06:24:52.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.296+0000 7fd1aa9a8700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a40cb4a0 con 0x7fd1a415a460 2023-03-03T06:24:52.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.296+0000 7fd1aa9a8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40d16a0 con 0x7fd1a415a830 2023-03-03T06:24:52.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.297+0000 7fd1a37fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a415a830 0x7fd1a40cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.297+0000 7fd1a3fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd1a415a460 0x7fd1a40cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.297+0000 7fd1a37fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a415a830 0x7fd1a40cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:41494/0 (socket says 172.21.15.5:41494) 2023-03-03T06:24:52.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.297+0000 7fd1a37fe700 1 -- 172.21.15.5:0/1027235211 learned_addr learned my addr 172.21.15.5:0/1027235211 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.297+0000 7fd1a3fff700 1 -- 172.21.15.5:0/1027235211 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a415a830 msgr2=0x7fd1a40cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.297+0000 7fd1a3fff700 1 --2- 172.21.15.5:0/1027235211 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a415a830 0x7fd1a40cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.297+0000 7fd1a3fff700 1 -- 172.21.15.5:0/1027235211 >> v1:172.21.15.191:6789/0 conn(0x7fd1a40b01a0 legacy=0x7fd1a415e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.297+0000 7fd1a3fff700 1 -- 172.21.15.5:0/1027235211 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a40cbc70 con 0x7fd1a415a460 2023-03-03T06:24:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.297+0000 7fd1a37fe700 1 --2- 172.21.15.5:0/1027235211 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a415a830 0x7fd1a40cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.297+0000 7fd1a3fff700 1 --2- 172.21.15.5:0/1027235211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1a415a460 0x7fd1a40cd110 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd194009840 tx=0x7fd194009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c91ed67aeaca016 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:52.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.297+0000 7fd1a2ffd700 1 -- 172.21.15.5:0/1027235211 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194011830 con 0x7fd1a415a460 2023-03-03T06:24:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.297+0000 7fd1a2ffd700 1 -- 172.21.15.5:0/1027235211 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd194011990 con 0x7fd1a415a460 2023-03-03T06:24:52.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.297+0000 7fd1a2ffd700 1 -- 172.21.15.5:0/1027235211 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194011d20 con 0x7fd1a415a460 2023-03-03T06:24:52.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.298+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/1027235211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1a415a460 msgr2=0x7fd1a40cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.298+0000 7fd1aa9a8700 1 --2- 172.21.15.5:0/1027235211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1a415a460 0x7fd1a40cd110 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd194009840 tx=0x7fd194009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:52.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.298+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/1027235211 shutdown_connections 2023-03-03T06:24:52.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.298+0000 7fd1aa9a8700 1 --2- 172.21.15.5:0/1027235211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1a415a460 0x7fd1a40cd110 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.298+0000 7fd1aa9a8700 1 --2- 172.21.15.5:0/1027235211 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a415a830 0x7fd1a40cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.298+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/1027235211 >> 172.21.15.5:0/1027235211 conn(0x7fd1a406f3c0 msgr2=0x7fd1a406f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:52.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.298+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/1027235211 shutdown_connections 2023-03-03T06:24:52.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.298+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/1027235211 wait complete. 2023-03-03T06:24:52.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.299+0000 7fd1aa9a8700 1 Processor -- start 2023-03-03T06:24:52.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.299+0000 7fd1aa9a8700 1 -- start start 2023-03-03T06:24:52.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.300+0000 7fd1aa9a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a40b01a0 0x7fd1a41efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.300+0000 7fd1aa9a8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1a415a460 0x7fd1a415c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.300+0000 7fd1aa9a8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a415a830 0x7fd1a41f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.300+0000 7fd1aa9a8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a415bc00 con 0x7fd1a40b01a0 2023-03-03T06:24:52.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.300+0000 7fd1aa9a8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a41eff70 con 0x7fd1a415a460 2023-03-03T06:24:52.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.300+0000 7fd1aa9a8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a415caf0 con 0x7fd1a415a830 2023-03-03T06:24:52.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.300+0000 7fd1a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a40b01a0 0x7fd1a41efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.300+0000 7fd1a3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a40b01a0 0x7fd1a41efa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43422/0 (socket says 172.21.15.5:43422) 2023-03-03T06:24:52.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.300+0000 7fd1a3fff700 1 -- 172.21.15.5:0/2815183511 learned_addr learned my addr 172.21.15.5:0/2815183511 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:52.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.300+0000 7fd1a37fe700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1a415a460 0x7fd1a415c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.300+0000 7fd1a8f45700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a415a830 0x7fd1a41f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.301+0000 7fd1a3fff700 1 -- 172.21.15.5:0/2815183511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a415a830 msgr2=0x7fd1a41f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.301+0000 7fd1a3fff700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a415a830 0x7fd1a41f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.301+0000 7fd1a3fff700 1 -- 172.21.15.5:0/2815183511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1a415a460 msgr2=0x7fd1a415c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.301+0000 7fd1a3fff700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1a415a460 0x7fd1a415c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.301+0000 7fd1a3fff700 1 -- 172.21.15.5:0/2815183511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd198009550 con 0x7fd1a40b01a0 2023-03-03T06:24:52.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.301+0000 7fd1a3fff700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a40b01a0 0x7fd1a41efa30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd194009fd0 tx=0x7fd194004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:52.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.301+0000 7fd1a0ff9700 1 -- 172.21.15.5:0/2815183511 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1940036a0 con 0x7fd1a40b01a0 2023-03-03T06:24:52.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.301+0000 7fd1a0ff9700 1 -- 172.21.15.5:0/2815183511 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19401f070 con 0x7fd1a40b01a0 2023-03-03T06:24:52.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.301+0000 7fd1a0ff9700 1 -- 172.21.15.5:0/2815183511 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194003a40 con 0x7fd1a40b01a0 2023-03-03T06:24:52.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.301+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/2815183511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1940094a0 con 0x7fd1a40b01a0 2023-03-03T06:24:52.308 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.301+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/2815183511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a40cb990 con 0x7fd1a40b01a0 2023-03-03T06:24:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.302+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/2815183511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a40cb6b0 con 0x7fd1a40b01a0 2023-03-03T06:24:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.302+0000 7fd1a0ff9700 1 -- 172.21.15.5:0/2815183511 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd19400f050 con 0x7fd1a40b01a0 2023-03-03T06:24:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.303+0000 7fd1a0ff9700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd1900682f0 0x7fd19006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.303+0000 7fd1a0ff9700 1 -- 172.21.15.5:0/2815183511 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd194021070 con 0x7fd1a40b01a0 2023-03-03T06:24:52.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.303+0000 7fd1a37fe700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd1900682f0 0x7fd19006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.303+0000 7fd1a37fe700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd1900682f0 0x7fd19006a7a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd198006d30 tx=0x7fd1980092c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:52.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.307+0000 7fd1a0ff9700 1 -- 172.21.15.5:0/2815183511 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd194053cd0 con 0x7fd1a40b01a0 2023-03-03T06:24:52.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.498+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/2815183511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd1a40d1940 con 0x7fd1a40b01a0 2023-03-03T06:24:52.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.498+0000 7fd1a0ff9700 1 -- 172.21.15.5:0/2815183511 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd1940572f0 con 0x7fd1a40b01a0 2023-03-03T06:24:52.501 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:24:52.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.500+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/2815183511 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd1900682f0 msgr2=0x7fd19006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.500+0000 7fd1aa9a8700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd1900682f0 0x7fd19006a7a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd198006d30 tx=0x7fd1980092c0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.500+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/2815183511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a40b01a0 msgr2=0x7fd1a41efa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.500+0000 7fd1aa9a8700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a40b01a0 0x7fd1a41efa30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd194009fd0 tx=0x7fd194004750 comp rx=0 tx=0).stop 2023-03-03T06:24:52.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.500+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/2815183511 shutdown_connections 2023-03-03T06:24:52.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.500+0000 7fd1aa9a8700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd1900682f0 0x7fd19006a7a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.500+0000 7fd1aa9a8700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd1a415a830 0x7fd1a41f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.500+0000 7fd1aa9a8700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1a40b01a0 0x7fd1a41efa30 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.500+0000 7fd1aa9a8700 1 --2- 172.21.15.5:0/2815183511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1a415a460 0x7fd1a415c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.500+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/2815183511 >> 172.21.15.5:0/2815183511 conn(0x7fd1a406f3c0 msgr2=0x7fd1a40cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:52.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.500+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/2815183511 shutdown_connections 2023-03-03T06:24:52.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.500+0000 7fd1aa9a8700 1 -- 172.21.15.5:0/2815183511 wait complete. 2023-03-03T06:24:52.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:24:52.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.641+0000 7fda40d40700 1 Processor -- start 2023-03-03T06:24:52.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.641+0000 7fda40d40700 1 -- start start 2023-03-03T06:24:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.642+0000 7fda40d40700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda3c15a7b0 0x7fda3c15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.642+0000 7fda40d40700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fda3c06b700 0x7fda3c06bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.642+0000 7fda40d40700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3c0cf380 con 0x7fda3c0cde30 2023-03-03T06:24:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.642+0000 7fda40d40700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3c06c060 con 0x7fda3c15a7b0 2023-03-03T06:24:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.642+0000 7fda40d40700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3c0cf5c0 con 0x7fda3c06b700 2023-03-03T06:24:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda3a59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda3c15a7b0 0x7fda3c15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda39d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fda3c0cde30 0x7fda3c0cec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33274/0 (socket says 172.21.15.5:33274) 2023-03-03T06:24:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda39d9b700 1 -- 172.21.15.5:0/3062576570 learned_addr learned my addr 172.21.15.5:0/3062576570 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:52.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda3a59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda3c15a7b0 0x7fda3c15ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43430/0 (socket says 172.21.15.5:43430) 2023-03-03T06:24:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda3ad9d700 1 --2- 172.21.15.5:0/3062576570 >> v2:172.21.15.191:3300/0 conn(0x7fda3c06b700 0x7fda3c06bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda3a59c700 1 -- 172.21.15.5:0/3062576570 >> v2:172.21.15.191:3300/0 conn(0x7fda3c06b700 msgr2=0x7fda3c06bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda3a59c700 1 --2- 172.21.15.5:0/3062576570 >> v2:172.21.15.191:3300/0 conn(0x7fda3c06b700 0x7fda3c06bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda3a59c700 1 -- 172.21.15.5:0/3062576570 >> v1:172.21.15.5:6789/0 conn(0x7fda3c0cde30 legacy=0x7fda3c0cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda3959a700 1 -- 172.21.15.5:0/3062576570 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591591817 0 0) 0x7fda24001110 con 0x7fda3c0cde30 2023-03-03T06:24:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda3a59c700 1 -- 172.21.15.5:0/3062576570 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c0cf8a0 con 0x7fda3c15a7b0 2023-03-03T06:24:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda3a59c700 1 --2- 172.21.15.5:0/3062576570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3c15a7b0 0x7fda3c15ab80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0cd970 tx=0x7fda2c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ebb7367ce52bad server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:52.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda3959a700 1 -- 172.21.15.5:0/3062576570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c011830 con 0x7fda3c15a7b0 2023-03-03T06:24:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda3959a700 1 -- 172.21.15.5:0/3062576570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c011990 con 0x7fda3c15a7b0 2023-03-03T06:24:52.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.643+0000 7fda3959a700 1 -- 172.21.15.5:0/3062576570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c011d20 con 0x7fda3c15a7b0 2023-03-03T06:24:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.644+0000 7fda40d40700 1 -- 172.21.15.5:0/3062576570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3c15a7b0 msgr2=0x7fda3c15ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.644+0000 7fda40d40700 1 --2- 172.21.15.5:0/3062576570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3c15a7b0 0x7fda3c15ab80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0cd970 tx=0x7fda2c009b20 comp rx=0 tx=0).stop 2023-03-03T06:24:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.644+0000 7fda40d40700 1 -- 172.21.15.5:0/3062576570 shutdown_connections 2023-03-03T06:24:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.644+0000 7fda40d40700 1 --2- 172.21.15.5:0/3062576570 >> v2:172.21.15.191:3300/0 conn(0x7fda3c06b700 0x7fda3c06bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.644+0000 7fda40d40700 1 --2- 172.21.15.5:0/3062576570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3c15a7b0 0x7fda3c15ab80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.644+0000 7fda40d40700 1 -- 172.21.15.5:0/3062576570 >> 172.21.15.5:0/3062576570 conn(0x7fda3c0cc8d0 msgr2=0x7fda3c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.644+0000 7fda40d40700 1 -- 172.21.15.5:0/3062576570 shutdown_connections 2023-03-03T06:24:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.644+0000 7fda40d40700 1 -- 172.21.15.5:0/3062576570 wait complete. 2023-03-03T06:24:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.645+0000 7fda40d40700 1 Processor -- start 2023-03-03T06:24:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.645+0000 7fda40d40700 1 -- start start 2023-03-03T06:24:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.646+0000 7fda40d40700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda3c06b700 0x7fda3c0c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.646+0000 7fda40d40700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3c0cde30 0x7fda3c1f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.646+0000 7fda40d40700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda3c15a7b0 0x7fda3c1f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.646+0000 7fda40d40700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c157040 con 0x7fda3c0cde30 2023-03-03T06:24:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.646+0000 7fda40d40700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c0c88b0 con 0x7fda3c06b700 2023-03-03T06:24:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.646+0000 7fda40d40700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c156830 con 0x7fda3c15a7b0 2023-03-03T06:24:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.646+0000 7fda39d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3c0cde30 0x7fda3c1f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.646+0000 7fda39d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3c0cde30 0x7fda3c1f3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43438/0 (socket says 172.21.15.5:43438) 2023-03-03T06:24:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.646+0000 7fda39d9b700 1 -- 172.21.15.5:0/881754839 learned_addr learned my addr 172.21.15.5:0/881754839 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.646+0000 7fda3a59c700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda3c06b700 0x7fda3c0c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.646+0000 7fda3ad9d700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda3c15a7b0 0x7fda3c1f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.647+0000 7fda39d9b700 1 -- 172.21.15.5:0/881754839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda3c15a7b0 msgr2=0x7fda3c1f3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.647+0000 7fda39d9b700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda3c15a7b0 0x7fda3c1f3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.647+0000 7fda39d9b700 1 -- 172.21.15.5:0/881754839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda3c06b700 msgr2=0x7fda3c0c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.647+0000 7fda39d9b700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda3c06b700 0x7fda3c0c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.647+0000 7fda39d9b700 1 -- 172.21.15.5:0/881754839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c0094a0 con 0x7fda3c0cde30 2023-03-03T06:24:52.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.647+0000 7fda3a59c700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda3c06b700 0x7fda3c0c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:52.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.647+0000 7fda39d9b700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3c0cde30 0x7fda3c1f3950 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fda2400c550 tx=0x7fda2400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.647+0000 7fda32ffd700 1 -- 172.21.15.5:0/881754839 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24004c80 con 0x7fda3c0cde30 2023-03-03T06:24:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.647+0000 7fda32ffd700 1 -- 172.21.15.5:0/881754839 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda24004e00 con 0x7fda3c0cde30 2023-03-03T06:24:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.647+0000 7fda32ffd700 1 -- 172.21.15.5:0/881754839 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24007310 con 0x7fda3c0cde30 2023-03-03T06:24:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.647+0000 7fda40d40700 1 -- 172.21.15.5:0/881754839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3c0b2d40 con 0x7fda3c0cde30 2023-03-03T06:24:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.647+0000 7fda40d40700 1 -- 172.21.15.5:0/881754839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3c0cfb80 con 0x7fda3c0cde30 2023-03-03T06:24:52.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.648+0000 7fda40d40700 1 -- 172.21.15.5:0/881754839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3c0b3020 con 0x7fda3c0cde30 2023-03-03T06:24:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.648+0000 7fda32ffd700 1 -- 172.21.15.5:0/881754839 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fda2401a020 con 0x7fda3c0cde30 2023-03-03T06:24:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.649+0000 7fda32ffd700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda1c0682f0 0x7fda1c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.649+0000 7fda32ffd700 1 -- 172.21.15.5:0/881754839 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fda24085560 con 0x7fda3c0cde30 2023-03-03T06:24:52.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.649+0000 7fda3a59c700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda1c0682f0 0x7fda1c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.649+0000 7fda3a59c700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda1c0682f0 0x7fda1c06a7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0090b0 tx=0x7fda2c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:52.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.653+0000 7fda32ffd700 1 -- 172.21.15.5:0/881754839 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fda24051fd0 con 0x7fda3c0cde30 2023-03-03T06:24:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.844+0000 7fda40d40700 1 -- 172.21.15.5:0/881754839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda3c0cf380 con 0x7fda3c0cde30 2023-03-03T06:24:52.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.844+0000 7fda32ffd700 1 -- 172.21.15.5:0/881754839 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda3c0cf380 con 0x7fda3c0cde30 2023-03-03T06:24:52.847 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:24:52.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.846+0000 7fda40d40700 1 -- 172.21.15.5:0/881754839 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda1c0682f0 msgr2=0x7fda1c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.846+0000 7fda40d40700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda1c0682f0 0x7fda1c06a7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0090b0 tx=0x7fda2c01c040 comp rx=0 tx=0).stop 2023-03-03T06:24:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.846+0000 7fda40d40700 1 -- 172.21.15.5:0/881754839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3c0cde30 msgr2=0x7fda3c1f3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.846+0000 7fda40d40700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3c0cde30 0x7fda3c1f3950 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fda2400c550 tx=0x7fda2400c910 comp rx=0 tx=0).stop 2023-03-03T06:24:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.846+0000 7fda40d40700 1 -- 172.21.15.5:0/881754839 shutdown_connections 2023-03-03T06:24:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.846+0000 7fda40d40700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda1c0682f0 0x7fda1c06a7a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.846+0000 7fda40d40700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda3c15a7b0 0x7fda3c1f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.846+0000 7fda40d40700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda3c06b700 0x7fda3c0c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.846+0000 7fda40d40700 1 --2- 172.21.15.5:0/881754839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda3c0cde30 0x7fda3c1f3950 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.846+0000 7fda40d40700 1 -- 172.21.15.5:0/881754839 >> 172.21.15.5:0/881754839 conn(0x7fda3c0cc8d0 msgr2=0x7fda3c1e4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.846+0000 7fda40d40700 1 -- 172.21.15.5:0/881754839 shutdown_connections 2023-03-03T06:24:52.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.846+0000 7fda40d40700 1 -- 172.21.15.5:0/881754839 wait complete. 2023-03-03T06:24:52.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-03T06:24:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.983+0000 7f0a77282700 1 Processor -- start 2023-03-03T06:24:52.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.984+0000 7f0a77282700 1 -- start start 2023-03-03T06:24:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a77282700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0a700b1f80 0x7f0a700cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a77282700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a70159bd0 con 0x7f0a700cf3d0 2023-03-03T06:24:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a77282700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a7015d650 con 0x7f0a700cf7a0 2023-03-03T06:24:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a77282700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7015e1d0 con 0x7f0a700b1f80 2023-03-03T06:24:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a7501e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0a700cf3d0 0x7f0a700cb510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33286/0 (socket says 172.21.15.5:33286) 2023-03-03T06:24:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a7501e700 1 -- 172.21.15.5:0/2331880233 learned_addr learned my addr 172.21.15.5:0/2331880233 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a7581f700 1 --2- 172.21.15.5:0/2331880233 >> v2:172.21.15.191:3300/0 conn(0x7f0a700b1f80 0x7f0a700cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320504626 0 0) 0x7f0a6c001110 con 0x7f0a700cf3d0 2023-03-03T06:24:52.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a5c0035b0 con 0x7f0a700cf3d0 2023-03-03T06:24:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1900906272 0 0) 0x7f0a5c0035b0 con 0x7f0a700cf3d0 2023-03-03T06:24:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 >> v2:172.21.15.191:3300/0 conn(0x7f0a700b1f80 msgr2=0x7f0a700cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a63fff700 1 --2- 172.21.15.5:0/2331880233 >> v2:172.21.15.191:3300/0 conn(0x7f0a700b1f80 0x7f0a700cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 >> v1:172.21.15.191:6789/0 conn(0x7f0a700cf7a0 legacy=0x7f0a700b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7015d930 con 0x7f0a700cf3d0 2023-03-03T06:24:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f0a6c001800 con 0x7f0a700cf3d0 2023-03-03T06:24:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.985+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 >> v1:172.21.15.5:6789/0 conn(0x7f0a700cf3d0 legacy=0x7f0a700cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a63fff700 1 --2- 172.21.15.5:0/2331880233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a5c003a70 0x7f0a5c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a63fff700 1 --2- 172.21.15.5:0/2331880233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a5c004850 0x7f0a5c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a63fff700 1 --2- 172.21.15.5:0/2331880233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a5c005250 0x7f0a5c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7015e1d0 con 0x7f0a5c004850 2023-03-03T06:24:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c00c190 con 0x7f0a5c003a70 2023-03-03T06:24:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c00c350 con 0x7f0a5c005250 2023-03-03T06:24:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a7481d700 1 --2- 172.21.15.5:0/2331880233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a5c004850 0x7f0a5c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a7501e700 1 --2- 172.21.15.5:0/2331880233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a5c003a70 0x7f0a5c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a7581f700 1 --2- 172.21.15.5:0/2331880233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a5c005250 0x7f0a5c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a7481d700 1 -- 172.21.15.5:0/2331880233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a5c005250 msgr2=0x7f0a5c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a7481d700 1 --2- 172.21.15.5:0/2331880233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a5c005250 0x7f0a5c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a7481d700 1 -- 172.21.15.5:0/2331880233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a5c003a70 msgr2=0x7f0a5c003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a7481d700 1 --2- 172.21.15.5:0/2331880233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a5c003a70 0x7f0a5c003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a7481d700 1 -- 172.21.15.5:0/2331880233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c0035b0 con 0x7f0a5c004850 2023-03-03T06:24:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a7581f700 1 -- 172.21.15.5:0/2331880233 reap_dead start 2023-03-03T06:24:52.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a7481d700 1 --2- 172.21.15.5:0/2331880233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a5c004850 0x7f0a5c004cc0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0a64007fd0 tx=0x7f0a5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20639f66575dea01 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:52.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a640052d0 con 0x7f0a5c004850 2023-03-03T06:24:52.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a64005470 con 0x7f0a5c004850 2023-03-03T06:24:52.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.986+0000 7f0a63fff700 1 -- 172.21.15.5:0/2331880233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a640038c0 con 0x7f0a5c004850 2023-03-03T06:24:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.987+0000 7f0a77282700 1 -- 172.21.15.5:0/2331880233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a5c004850 msgr2=0x7f0a5c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.987+0000 7f0a77282700 1 --2- 172.21.15.5:0/2331880233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a5c004850 0x7f0a5c004cc0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0a64007fd0 tx=0x7f0a5c005880 comp rx=0 tx=0).stop 2023-03-03T06:24:52.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.987+0000 7f0a77282700 1 -- 172.21.15.5:0/2331880233 shutdown_connections 2023-03-03T06:24:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.987+0000 7f0a77282700 1 --2- 172.21.15.5:0/2331880233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a5c004850 0x7f0a5c004cc0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.987+0000 7f0a77282700 1 -- 172.21.15.5:0/2331880233 >> 172.21.15.5:0/2331880233 conn(0x7f0a7006ea70 msgr2=0x7f0a700cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.987+0000 7f0a77282700 1 -- 172.21.15.5:0/2331880233 shutdown_connections 2023-03-03T06:24:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.987+0000 7f0a77282700 1 -- 172.21.15.5:0/2331880233 wait complete. 2023-03-03T06:24:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.988+0000 7f0a77282700 1 Processor -- start 2023-03-03T06:24:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.988+0000 7f0a77282700 1 -- start start 2023-03-03T06:24:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a77282700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a5c004850 0x7f0a700b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a77282700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015bb00 0x7f0a7006abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a77282700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a7006b100 0x7f0a701f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a77282700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7006b580 con 0x7f0a7015bb00 2023-03-03T06:24:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a77282700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7015ca40 con 0x7f0a7006b100 2023-03-03T06:24:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a77282700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a701f3500 con 0x7f0a5c004850 2023-03-03T06:24:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a7481d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015bb00 0x7f0a7006abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a7481d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015bb00 0x7f0a7006abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43458/0 (socket says 172.21.15.5:43458) 2023-03-03T06:24:52.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a7481d700 1 -- 172.21.15.5:0/542699522 learned_addr learned my addr 172.21.15.5:0/542699522 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a7581f700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a7006b100 0x7f0a701f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a7501e700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a5c004850 0x7f0a700b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a7481d700 1 -- 172.21.15.5:0/542699522 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a5c004850 msgr2=0x7f0a700b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a7481d700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a5c004850 0x7f0a700b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a7481d700 1 -- 172.21.15.5:0/542699522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a7006b100 msgr2=0x7f0a701f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a7481d700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a7006b100 0x7f0a701f25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a7481d700 1 -- 172.21.15.5:0/542699522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7015def0 con 0x7f0a7015bb00 2023-03-03T06:24:52.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a7581f700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a7006b100 0x7f0a701f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a7501e700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a5c004850 0x7f0a700b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.989+0000 7f0a7481d700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015bb00 0x7f0a7006abc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c160 tx=0x7f0a64001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.990+0000 7f0a61ffb700 1 -- 172.21.15.5:0/542699522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64007240 con 0x7f0a7015bb00 2023-03-03T06:24:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.990+0000 7f0a61ffb700 1 -- 172.21.15.5:0/542699522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a640073c0 con 0x7f0a7015bb00 2023-03-03T06:24:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.990+0000 7f0a77282700 1 -- 172.21.15.5:0/542699522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7015dc10 con 0x7f0a7015bb00 2023-03-03T06:24:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.990+0000 7f0a61ffb700 1 -- 172.21.15.5:0/542699522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64007770 con 0x7f0a7015bb00 2023-03-03T06:24:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.990+0000 7f0a77282700 1 -- 172.21.15.5:0/542699522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7015d270 con 0x7f0a7015bb00 2023-03-03T06:24:52.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.991+0000 7f0a77282700 1 -- 172.21.15.5:0/542699522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7015b950 con 0x7f0a7015bb00 2023-03-03T06:24:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.991+0000 7f0a61ffb700 1 -- 172.21.15.5:0/542699522 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0a6402c070 con 0x7f0a7015bb00 2023-03-03T06:24:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.992+0000 7f0a61ffb700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0a540682f0 0x7f0a5406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.992+0000 7f0a61ffb700 1 -- 172.21.15.5:0/542699522 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0a64086440 con 0x7f0a7015bb00 2023-03-03T06:24:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.992+0000 7f0a7501e700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0a540682f0 0x7f0a5406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:53.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.992+0000 7f0a7501e700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0a540682f0 0x7f0a5406a7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0a70075230 tx=0x7f0a6c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:53.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:52.996+0000 7f0a61ffb700 1 -- 172.21.15.5:0/542699522 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0a64052dc0 con 0x7f0a7015bb00 2023-03-03T06:24:53.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.192+0000 7f0a77282700 1 -- 172.21.15.5:0/542699522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0a700b3350 con 0x7f0a7015bb00 2023-03-03T06:24:53.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.192+0000 7f0a61ffb700 1 -- 172.21.15.5:0/542699522 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0a640563e0 con 0x7f0a7015bb00 2023-03-03T06:24:53.195 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:53.195 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-03-03T06:24:53.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:53.196 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-03-03T06:24:53.196 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-03-03T06:24:53.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:24:53.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:24:53.197 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-03-03T06:24:53.197 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-03-03T06:24:53.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:24:53.198 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-03-03T06:24:53.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.194+0000 7f0a77282700 1 -- 172.21.15.5:0/542699522 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0a540682f0 msgr2=0x7f0a5406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.194+0000 7f0a77282700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0a540682f0 0x7f0a5406a7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0a70075230 tx=0x7f0a6c009040 comp rx=0 tx=0).stop 2023-03-03T06:24:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.194+0000 7f0a77282700 1 -- 172.21.15.5:0/542699522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015bb00 msgr2=0x7f0a7006abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.194+0000 7f0a77282700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015bb00 0x7f0a7006abc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c160 tx=0x7f0a64001120 comp rx=0 tx=0).stop 2023-03-03T06:24:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.194+0000 7f0a77282700 1 -- 172.21.15.5:0/542699522 shutdown_connections 2023-03-03T06:24:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.194+0000 7f0a77282700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a7006b100 0x7f0a701f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.194+0000 7f0a77282700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0a540682f0 0x7f0a5406a7a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.194+0000 7f0a77282700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a5c004850 0x7f0a700b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.194+0000 7f0a77282700 1 --2- 172.21.15.5:0/542699522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a7015bb00 0x7f0a7006abc0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.194+0000 7f0a77282700 1 -- 172.21.15.5:0/542699522 >> 172.21.15.5:0/542699522 conn(0x7f0a7006ea70 msgr2=0x7f0a700b53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:53.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.194+0000 7f0a77282700 1 -- 172.21.15.5:0/542699522 shutdown_connections 2023-03-03T06:24:53.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.194+0000 7f0a77282700 1 -- 172.21.15.5:0/542699522 wait complete. 2023-03-03T06:24:53.208 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-03T06:24:53.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-03T06:24:53.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.335+0000 7f86fe4d1700 1 Processor -- start 2023-03-03T06:24:53.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.335+0000 7f86fe4d1700 1 -- start start 2023-03-03T06:24:53.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.336+0000 7f86fe4d1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86f80cbf00 0x7f86f80b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.336+0000 7f86fe4d1700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f80b21e0 con 0x7f86f815a8c0 2023-03-03T06:24:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.336+0000 7f86fe4d1700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f815ac90 con 0x7f86f80b1d80 2023-03-03T06:24:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.336+0000 7f86fe4d1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f80cae60 con 0x7f86f80cbf00 2023-03-03T06:24:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.336+0000 7f86f77fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86f80cbf00 0x7f86f80b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.336+0000 7f86f7fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f86f815a8c0 0x7f86f80ca410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33306/0 (socket says 172.21.15.5:33306) 2023-03-03T06:24:53.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.336+0000 7f86f7fff700 1 -- 172.21.15.5:0/3779086778 learned_addr learned my addr 172.21.15.5:0/3779086778 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.336+0000 7f86f77fe700 1 -- 172.21.15.5:0/3779086778 >> v1:172.21.15.191:6789/0 conn(0x7f86f80b1d80 legacy=0x7f86f80b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.336+0000 7f86f77fe700 1 -- 172.21.15.5:0/3779086778 >> v1:172.21.15.5:6789/0 conn(0x7f86f815a8c0 legacy=0x7f86f80ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.336+0000 7f86f77fe700 1 -- 172.21.15.5:0/3779086778 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f80cb140 con 0x7f86f80cbf00 2023-03-03T06:24:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.336+0000 7f86f6ffd700 1 -- 172.21.15.5:0/3779086778 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27994517 0 0) 0x7f86f80b21e0 con 0x7f86f815a8c0 2023-03-03T06:24:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.336+0000 7f86f77fe700 1 --2- 172.21.15.5:0/3779086778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f80cbf00 0x7f86f80b1840 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009840 tx=0x7f86e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93670664d40feaf0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.337+0000 7f86f6ffd700 1 -- 172.21.15.5:0/3779086778 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8004230 con 0x7f86f80cbf00 2023-03-03T06:24:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.337+0000 7f86f6ffd700 1 -- 172.21.15.5:0/3779086778 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e8004390 con 0x7f86f80cbf00 2023-03-03T06:24:53.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.337+0000 7f86f6ffd700 1 -- 172.21.15.5:0/3779086778 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80036a0 con 0x7f86f80cbf00 2023-03-03T06:24:53.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.337+0000 7f86fe4d1700 1 -- 172.21.15.5:0/3779086778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f80cbf00 msgr2=0x7f86f80b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.337+0000 7f86fe4d1700 1 --2- 172.21.15.5:0/3779086778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f80cbf00 0x7f86f80b1840 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009840 tx=0x7f86e8009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.337+0000 7f86fe4d1700 1 -- 172.21.15.5:0/3779086778 shutdown_connections 2023-03-03T06:24:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.337+0000 7f86fe4d1700 1 --2- 172.21.15.5:0/3779086778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f80cbf00 0x7f86f80b1840 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.337+0000 7f86fe4d1700 1 -- 172.21.15.5:0/3779086778 >> 172.21.15.5:0/3779086778 conn(0x7f86f80cc840 msgr2=0x7f86f80ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.337+0000 7f86fe4d1700 1 -- 172.21.15.5:0/3779086778 shutdown_connections 2023-03-03T06:24:53.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.337+0000 7f86fe4d1700 1 -- 172.21.15.5:0/3779086778 wait complete. 2023-03-03T06:24:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.338+0000 7f86fe4d1700 1 Processor -- start 2023-03-03T06:24:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.339+0000 7f86fe4d1700 1 -- start start 2023-03-03T06:24:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.339+0000 7f86fe4d1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f80b1d80 0x7f86f8153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.339+0000 7f86fe4d1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f80cbf00 0x7f86f80c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.339+0000 7f86fe4d1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8c0 0x7f86f80c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.339+0000 7f86fe4d1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80cf220 con 0x7f86f80b1d80 2023-03-03T06:24:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.339+0000 7f86fe4d1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f8153b60 con 0x7f86f80cbf00 2023-03-03T06:24:53.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.339+0000 7f86fe4d1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80c6170 con 0x7f86f815a8c0 2023-03-03T06:24:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.339+0000 7f86f7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f80b1d80 0x7f86f8153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.339+0000 7f86f7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f80b1d80 0x7f86f8153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43470/0 (socket says 172.21.15.5:43470) 2023-03-03T06:24:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.339+0000 7f86f7fff700 1 -- 172.21.15.5:0/487186830 learned_addr learned my addr 172.21.15.5:0/487186830 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86f77fe700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f80cbf00 0x7f86f80c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86fca6e700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8c0 0x7f86f80c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86f7fff700 1 -- 172.21.15.5:0/487186830 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8c0 msgr2=0x7f86f80c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:53.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86f7fff700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8c0 0x7f86f80c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86f7fff700 1 -- 172.21.15.5:0/487186830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f80cbf00 msgr2=0x7f86f80c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86f7fff700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f80cbf00 0x7f86f80c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86f7fff700 1 -- 172.21.15.5:0/487186830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e80094a0 con 0x7f86f80b1d80 2023-03-03T06:24:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86f77fe700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f80cbf00 0x7f86f80c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86f7fff700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f80b1d80 0x7f86f8153620 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c550 tx=0x7f86ec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86f4ff9700 1 -- 172.21.15.5:0/487186830 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec004c80 con 0x7f86f80b1d80 2023-03-03T06:24:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86f4ff9700 1 -- 172.21.15.5:0/487186830 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec004e00 con 0x7f86f80b1d80 2023-03-03T06:24:53.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86fe4d1700 1 -- 172.21.15.5:0/487186830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f80cb700 con 0x7f86f80b1d80 2023-03-03T06:24:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86f4ff9700 1 -- 172.21.15.5:0/487186830 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec007310 con 0x7f86f80b1d80 2023-03-03T06:24:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.340+0000 7f86fe4d1700 1 -- 172.21.15.5:0/487186830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f80cb420 con 0x7f86f80b1d80 2023-03-03T06:24:53.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.341+0000 7f86fe4d1700 1 -- 172.21.15.5:0/487186830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f80cb9e0 con 0x7f86f80b1d80 2023-03-03T06:24:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.342+0000 7f86f4ff9700 1 -- 172.21.15.5:0/487186830 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f86ec01a020 con 0x7f86f80b1d80 2023-03-03T06:24:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.342+0000 7f86f4ff9700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86e40682f0 0x7f86e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.342+0000 7f86f4ff9700 1 -- 172.21.15.5:0/487186830 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f86ec085690 con 0x7f86f80b1d80 2023-03-03T06:24:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.342+0000 7f86f77fe700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86e40682f0 0x7f86e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:53.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.342+0000 7f86f77fe700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86e40682f0 0x7f86e406a7a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f86e80090b0 tx=0x7f86e8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:53.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.346+0000 7f86f4ff9700 1 -- 172.21.15.5:0/487186830 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f86ec052100 con 0x7f86f80b1d80 2023-03-03T06:24:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.539+0000 7f86fe4d1700 1 -- 172.21.15.5:0/487186830 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f86f804e6e0 con 0x7f86f80b1d80 2023-03-03T06:24:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.610+0000 7f86f4ff9700 1 -- 172.21.15.5:0/487186830 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7f86ec055720 con 0x7f86f80b1d80 2023-03-03T06:24:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.613+0000 7f86fe4d1700 1 -- 172.21.15.5:0/487186830 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86e40682f0 msgr2=0x7f86e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.613+0000 7f86fe4d1700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86e40682f0 0x7f86e406a7a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f86e80090b0 tx=0x7f86e8008030 comp rx=0 tx=0).stop 2023-03-03T06:24:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.613+0000 7f86fe4d1700 1 -- 172.21.15.5:0/487186830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f80b1d80 msgr2=0x7f86f8153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.613+0000 7f86fe4d1700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f80b1d80 0x7f86f8153620 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c550 tx=0x7f86ec00c910 comp rx=0 tx=0).stop 2023-03-03T06:24:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.613+0000 7f86fe4d1700 1 -- 172.21.15.5:0/487186830 shutdown_connections 2023-03-03T06:24:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.613+0000 7f86fe4d1700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86e40682f0 0x7f86e406a7a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.613+0000 7f86fe4d1700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8c0 0x7f86f80c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.613+0000 7f86fe4d1700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f80b1d80 0x7f86f8153620 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.613+0000 7f86fe4d1700 1 --2- 172.21.15.5:0/487186830 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f80cbf00 0x7f86f80c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.613+0000 7f86fe4d1700 1 -- 172.21.15.5:0/487186830 >> 172.21.15.5:0/487186830 conn(0x7f86f80cc840 msgr2=0x7f86f80cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.613+0000 7f86fe4d1700 1 -- 172.21.15.5:0/487186830 shutdown_connections 2023-03-03T06:24:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.613+0000 7f86fe4d1700 1 -- 172.21.15.5:0/487186830 wait complete. 2023-03-03T06:24:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-03-03T06:24:53.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-03-03T06:24:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.760+0000 7f84056c0700 1 Processor -- start 2023-03-03T06:24:53.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.760+0000 7f84056c0700 1 -- start start 2023-03-03T06:24:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.760+0000 7f84056c0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84000b8a80 0x7f84000b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:53.763 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.760+0000 7f84056c0700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f84000b2130 0x7f840006c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.760+0000 7f84056c0700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84000cf980 con 0x7f840006c660 2023-03-03T06:24:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f84056c0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84000cd980 con 0x7f84000b8a80 2023-03-03T06:24:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f84056c0700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840006cae0 con 0x7f84000b2130 2023-03-03T06:24:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f83feffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84000b8a80 0x7f84000b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f83feffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f84000b8a80 0x7f84000b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43478/0 (socket says 172.21.15.5:43478) 2023-03-03T06:24:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f83feffd700 1 -- 172.21.15.5:0/2096161052 learned_addr learned my addr 172.21.15.5:0/2096161052 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:53.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f83fe7fc700 1 --2- 172.21.15.5:0/2096161052 >> v2:172.21.15.191:3300/0 conn(0x7f84000b2130 0x7f840006c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f83feffd700 1 -- 172.21.15.5:0/2096161052 >> v2:172.21.15.191:3300/0 conn(0x7f84000b2130 msgr2=0x7f840006c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f83feffd700 1 --2- 172.21.15.5:0/2096161052 >> v2:172.21.15.191:3300/0 conn(0x7f84000b2130 0x7f840006c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f83feffd700 1 -- 172.21.15.5:0/2096161052 >> v1:172.21.15.191:6789/0 conn(0x7f840006c660 legacy=0x7f840006a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f83feffd700 1 -- 172.21.15.5:0/2096161052 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840015ce70 con 0x7f84000b8a80 2023-03-03T06:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f83feffd700 1 --2- 172.21.15.5:0/2096161052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84000b8a80 0x7f84000b2560 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f84000cea90 tx=0x7f83f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dee15f2fc0e1198 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f83fdffb700 1 -- 172.21.15.5:0/2096161052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f800e070 con 0x7f84000b8a80 2023-03-03T06:24:53.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f83fdffb700 1 -- 172.21.15.5:0/2096161052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f8003a20 con 0x7f84000b8a80 2023-03-03T06:24:53.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.761+0000 7f83fdffb700 1 -- 172.21.15.5:0/2096161052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8003dd0 con 0x7f84000b8a80 2023-03-03T06:24:53.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.762+0000 7f84056c0700 1 -- 172.21.15.5:0/2096161052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84000b8a80 msgr2=0x7f84000b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.762+0000 7f84056c0700 1 --2- 172.21.15.5:0/2096161052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84000b8a80 0x7f84000b2560 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f84000cea90 tx=0x7f83f800b330 comp rx=0 tx=0).stop 2023-03-03T06:24:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.762+0000 7f84056c0700 1 -- 172.21.15.5:0/2096161052 shutdown_connections 2023-03-03T06:24:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.762+0000 7f84056c0700 1 --2- 172.21.15.5:0/2096161052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84000b8a80 0x7f84000b2560 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.762+0000 7f84056c0700 1 --2- 172.21.15.5:0/2096161052 >> v2:172.21.15.191:3300/0 conn(0x7f84000b2130 0x7f840006c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.762+0000 7f84056c0700 1 -- 172.21.15.5:0/2096161052 >> 172.21.15.5:0/2096161052 conn(0x7f84000d0610 msgr2=0x7f84000d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.762+0000 7f84056c0700 1 -- 172.21.15.5:0/2096161052 shutdown_connections 2023-03-03T06:24:53.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.762+0000 7f84056c0700 1 -- 172.21.15.5:0/2096161052 wait complete. 2023-03-03T06:24:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.763+0000 7f84056c0700 1 Processor -- start 2023-03-03T06:24:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.763+0000 7f84056c0700 1 -- start start 2023-03-03T06:24:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f84056c0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f840006c660 0x7f84001f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f84056c0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84000b2130 0x7f8400144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f84056c0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84000b8a80 0x7f84001450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f84056c0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c9930 con 0x7f84000b2130 2023-03-03T06:24:53.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f84056c0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84001f2640 con 0x7f84000b8a80 2023-03-03T06:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f84056c0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c9370 con 0x7f840006c660 2023-03-03T06:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f83fe7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84000b2130 0x7f8400144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f83fe7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84000b2130 0x7f8400144b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43486/0 (socket says 172.21.15.5:43486) 2023-03-03T06:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f83fe7fc700 1 -- 172.21.15.5:0/3201179336 learned_addr learned my addr 172.21.15.5:0/3201179336 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f83ff7fe700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84000b8a80 0x7f84001450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f83feffd700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f840006c660 0x7f84001f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f83fe7fc700 1 -- 172.21.15.5:0/3201179336 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f840006c660 msgr2=0x7f84001f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:53.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f83fe7fc700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f840006c660 0x7f84001f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f83fe7fc700 1 -- 172.21.15.5:0/3201179336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84000b8a80 msgr2=0x7f84001450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f83fe7fc700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84000b8a80 0x7f84001450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f83fe7fc700 1 -- 172.21.15.5:0/3201179336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8009b30 con 0x7f84000b2130 2023-03-03T06:24:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.764+0000 7f83ff7fe700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84000b8a80 0x7f84001450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.765+0000 7f83fe7fc700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84000b2130 0x7f8400144b60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f83e800d800 tx=0x7f83e800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.765+0000 7f83f77fe700 1 -- 172.21.15.5:0/3201179336 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e80125f0 con 0x7f84000b2130 2023-03-03T06:24:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.765+0000 7f83f77fe700 1 -- 172.21.15.5:0/3201179336 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e8012750 con 0x7f84000b2130 2023-03-03T06:24:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.765+0000 7f84056c0700 1 -- 172.21.15.5:0/3201179336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8400161300 con 0x7f84000b2130 2023-03-03T06:24:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.765+0000 7f83f77fe700 1 -- 172.21.15.5:0/3201179336 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e8012b00 con 0x7f84000b2130 2023-03-03T06:24:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.765+0000 7f84056c0700 1 -- 172.21.15.5:0/3201179336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84000cdda0 con 0x7f84000b2130 2023-03-03T06:24:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.766+0000 7f84056c0700 1 -- 172.21.15.5:0/3201179336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84000cf6a0 con 0x7f84000b2130 2023-03-03T06:24:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.766+0000 7f83f77fe700 1 -- 172.21.15.5:0/3201179336 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f83e8012c60 con 0x7f84000b2130 2023-03-03T06:24:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.767+0000 7f83f77fe700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83e00682f0 0x7f83e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.767+0000 7f83f77fe700 1 -- 172.21.15.5:0/3201179336 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f83e8086ae0 con 0x7f84000b2130 2023-03-03T06:24:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.767+0000 7f83feffd700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83e00682f0 0x7f83e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.767+0000 7f83feffd700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83e00682f0 0x7f83e006a7a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f83f8000f80 tx=0x7f83f8009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.771+0000 7f83f77fe700 1 -- 172.21.15.5:0/3201179336 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f83e8053400 con 0x7f84000b2130 2023-03-03T06:24:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:53.963+0000 7f84056c0700 1 -- 172.21.15.5:0/3201179336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f840004e6e0 con 0x7f84000b2130 2023-03-03T06:24:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.615+0000 7f83f77fe700 1 -- 172.21.15.5:0/3201179336 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7f83e8056a20 con 0x7f84000b2130 2023-03-03T06:24:54.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.630+0000 7f84056c0700 1 -- 172.21.15.5:0/3201179336 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83e00682f0 msgr2=0x7f83e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:54.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.630+0000 7f84056c0700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83e00682f0 0x7f83e006a7a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f83f8000f80 tx=0x7f83f8009000 comp rx=0 tx=0).stop 2023-03-03T06:24:54.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.630+0000 7f84056c0700 1 -- 172.21.15.5:0/3201179336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84000b2130 msgr2=0x7f8400144b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:54.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.630+0000 7f84056c0700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84000b2130 0x7f8400144b60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f83e800d800 tx=0x7f83e800db10 comp rx=0 tx=0).stop 2023-03-03T06:24:54.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.631+0000 7f84056c0700 1 -- 172.21.15.5:0/3201179336 shutdown_connections 2023-03-03T06:24:54.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.631+0000 7f84056c0700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84000b8a80 0x7f84001450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:54.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.631+0000 7f84056c0700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83e00682f0 0x7f83e006a7a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:54.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.631+0000 7f84056c0700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f840006c660 0x7f84001f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:54.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.631+0000 7f84056c0700 1 --2- 172.21.15.5:0/3201179336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84000b2130 0x7f8400144b60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:54.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.631+0000 7f84056c0700 1 -- 172.21.15.5:0/3201179336 >> 172.21.15.5:0/3201179336 conn(0x7f84000d0610 msgr2=0x7f840006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:54.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.632+0000 7f84056c0700 1 -- 172.21.15.5:0/3201179336 shutdown_connections 2023-03-03T06:24:54.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.632+0000 7f84056c0700 1 -- 172.21.15.5:0/3201179336 wait complete. 2023-03-03T06:24:54.677 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-03-03T06:24:54.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-03T06:24:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.809+0000 7fdd3fa90700 1 Processor -- start 2023-03-03T06:24:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.809+0000 7fdd3fa90700 1 -- start start 2023-03-03T06:24:54.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3fa90700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdd380cd3e0 0x7fdd380cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:54.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3fa90700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd380b1fe0 0x7fdd380ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:54.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3fa90700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3815e160 con 0x7fdd3815cd40 2023-03-03T06:24:54.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3fa90700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd380cd870 con 0x7fdd380b1fe0 2023-03-03T06:24:54.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3fa90700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3815d110 con 0x7fdd380cd3e0 2023-03-03T06:24:54.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3e02d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd380b1fe0 0x7fdd380ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:54.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3e02d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdd380b1fe0 0x7fdd380ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43496/0 (socket says 172.21.15.5:43496) 2023-03-03T06:24:54.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3e02d700 1 -- 172.21.15.5:0/2716034721 learned_addr learned my addr 172.21.15.5:0/2716034721 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:54.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3d02b700 1 --2- 172.21.15.5:0/2716034721 >> v2:172.21.15.191:3300/0 conn(0x7fdd380cd3e0 0x7fdd380cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:54.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3e02d700 1 -- 172.21.15.5:0/2716034721 >> v2:172.21.15.191:3300/0 conn(0x7fdd380cd3e0 msgr2=0x7fdd380cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:54.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3e02d700 1 --2- 172.21.15.5:0/2716034721 >> v2:172.21.15.191:3300/0 conn(0x7fdd380cd3e0 0x7fdd380cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3e02d700 1 -- 172.21.15.5:0/2716034721 >> v1:172.21.15.191:6789/0 conn(0x7fdd3815cd40 legacy=0x7fdd380b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3e02d700 1 -- 172.21.15.5:0/2716034721 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3815d3c0 con 0x7fdd380b1fe0 2023-03-03T06:24:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3e02d700 1 --2- 172.21.15.5:0/2716034721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd380b1fe0 0x7fdd380ce290 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdd38071b40 tx=0x7fdd3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1af49846f4c7f31 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3c82a700 1 -- 172.21.15.5:0/2716034721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3000e070 con 0x7fdd380b1fe0 2023-03-03T06:24:54.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3c82a700 1 -- 172.21.15.5:0/2716034721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd30003a20 con 0x7fdd380b1fe0 2023-03-03T06:24:54.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.810+0000 7fdd3c82a700 1 -- 172.21.15.5:0/2716034721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd30003dd0 con 0x7fdd380b1fe0 2023-03-03T06:24:54.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.811+0000 7fdd3fa90700 1 -- 172.21.15.5:0/2716034721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd380b1fe0 msgr2=0x7fdd380ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:54.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.811+0000 7fdd3fa90700 1 --2- 172.21.15.5:0/2716034721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd380b1fe0 0x7fdd380ce290 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdd38071b40 tx=0x7fdd3000b330 comp rx=0 tx=0).stop 2023-03-03T06:24:54.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.811+0000 7fdd3fa90700 1 -- 172.21.15.5:0/2716034721 shutdown_connections 2023-03-03T06:24:54.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.811+0000 7fdd3fa90700 1 --2- 172.21.15.5:0/2716034721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd380b1fe0 0x7fdd380ce290 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.811+0000 7fdd3fa90700 1 --2- 172.21.15.5:0/2716034721 >> v2:172.21.15.191:3300/0 conn(0x7fdd380cd3e0 0x7fdd380cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.811+0000 7fdd3fa90700 1 -- 172.21.15.5:0/2716034721 >> 172.21.15.5:0/2716034721 conn(0x7fdd380cc8d0 msgr2=0x7fdd380cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.811+0000 7fdd3fa90700 1 -- 172.21.15.5:0/2716034721 shutdown_connections 2023-03-03T06:24:54.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.811+0000 7fdd3fa90700 1 -- 172.21.15.5:0/2716034721 wait complete. 2023-03-03T06:24:54.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.812+0000 7fdd3fa90700 1 Processor -- start 2023-03-03T06:24:54.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.812+0000 7fdd3fa90700 1 -- start start 2023-03-03T06:24:54.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.813+0000 7fdd3fa90700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd380b1fe0 0x7fdd381e91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:54.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.813+0000 7fdd3fa90700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd380cd3e0 0x7fdd381f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:54.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.813+0000 7fdd3fa90700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd3815cd40 0x7fdd3815bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:54.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.813+0000 7fdd3fa90700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd381e3dd0 con 0x7fdd380b1fe0 2023-03-03T06:24:54.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.813+0000 7fdd3fa90700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd380acb10 con 0x7fdd3815cd40 2023-03-03T06:24:54.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.813+0000 7fdd3fa90700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd380acdf0 con 0x7fdd380cd3e0 2023-03-03T06:24:54.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.813+0000 7fdd3d82c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd380b1fe0 0x7fdd381e91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:54.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.813+0000 7fdd3d82c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd380b1fe0 0x7fdd381e91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43498/0 (socket says 172.21.15.5:43498) 2023-03-03T06:24:54.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.813+0000 7fdd3d82c700 1 -- 172.21.15.5:0/257746035 learned_addr learned my addr 172.21.15.5:0/257746035 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:54.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.813+0000 7fdd3e02d700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd3815cd40 0x7fdd3815bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:54.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.813+0000 7fdd3d02b700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd380cd3e0 0x7fdd381f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:54.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.813+0000 7fdd3d82c700 1 -- 172.21.15.5:0/257746035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd380cd3e0 msgr2=0x7fdd381f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:54.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.814+0000 7fdd3d82c700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd380cd3e0 0x7fdd381f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:54.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.814+0000 7fdd3d82c700 1 -- 172.21.15.5:0/257746035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd3815cd40 msgr2=0x7fdd3815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:54.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.814+0000 7fdd3d82c700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd3815cd40 0x7fdd3815bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:54.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.814+0000 7fdd3d82c700 1 -- 172.21.15.5:0/257746035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd30009b30 con 0x7fdd380b1fe0 2023-03-03T06:24:54.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.814+0000 7fdd3d82c700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd380b1fe0 0x7fdd381e91b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400b4a0 tx=0x7fdd3400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:54.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.814+0000 7fdd2e7fc700 1 -- 172.21.15.5:0/257746035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34011830 con 0x7fdd380b1fe0 2023-03-03T06:24:54.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.814+0000 7fdd2e7fc700 1 -- 172.21.15.5:0/257746035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd34011990 con 0x7fdd380b1fe0 2023-03-03T06:24:54.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.814+0000 7fdd3fa90700 1 -- 172.21.15.5:0/257746035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3815d980 con 0x7fdd380b1fe0 2023-03-03T06:24:54.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.814+0000 7fdd2e7fc700 1 -- 172.21.15.5:0/257746035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34011d40 con 0x7fdd380b1fe0 2023-03-03T06:24:54.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.814+0000 7fdd3fa90700 1 -- 172.21.15.5:0/257746035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3815d6a0 con 0x7fdd380b1fe0 2023-03-03T06:24:54.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.815+0000 7fdd3fa90700 1 -- 172.21.15.5:0/257746035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3815dc60 con 0x7fdd380b1fe0 2023-03-03T06:24:54.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.815+0000 7fdd2e7fc700 1 -- 172.21.15.5:0/257746035 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdd3400f050 con 0x7fdd380b1fe0 2023-03-03T06:24:54.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.816+0000 7fdd2e7fc700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdd1c0682f0 0x7fdd1c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:54.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.816+0000 7fdd2e7fc700 1 -- 172.21.15.5:0/257746035 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6282+0+0 (secure 0 0 0) 0x7fdd34085790 con 0x7fdd380b1fe0 2023-03-03T06:24:54.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.816+0000 7fdd3d02b700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdd1c0682f0 0x7fdd1c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:54.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.817+0000 7fdd3d02b700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdd1c0682f0 0x7fdd1c06a7a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdd381f5bb0 tx=0x7fdd28008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:54.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:54.821+0000 7fdd2e7fc700 1 -- 172.21.15.5:0/257746035 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdd34051f10 con 0x7fdd380b1fe0 2023-03-03T06:24:55.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.061+0000 7fdd3fa90700 1 -- 172.21.15.5:0/257746035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdd3806c170 con 0x7fdd380b1fe0 2023-03-03T06:24:55.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.070+0000 7fdd2e7fc700 1 -- 172.21.15.5:0/257746035 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdd34055530 con 0x7fdd380b1fe0 2023-03-03T06:24:55.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.076+0000 7fdd3fa90700 1 -- 172.21.15.5:0/257746035 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdd1c0682f0 msgr2=0x7fdd1c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.076+0000 7fdd3fa90700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdd1c0682f0 0x7fdd1c06a7a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdd381f5bb0 tx=0x7fdd28008040 comp rx=0 tx=0).stop 2023-03-03T06:24:55.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.076+0000 7fdd3fa90700 1 -- 172.21.15.5:0/257746035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd380b1fe0 msgr2=0x7fdd381e91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.076+0000 7fdd3fa90700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd380b1fe0 0x7fdd381e91b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400b4a0 tx=0x7fdd3400b7b0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.079+0000 7fdd3fa90700 1 -- 172.21.15.5:0/257746035 shutdown_connections 2023-03-03T06:24:55.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.079+0000 7fdd3fa90700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd3815cd40 0x7fdd3815bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.079+0000 7fdd3fa90700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd380b1fe0 0x7fdd381e91b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.079+0000 7fdd3fa90700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdd1c0682f0 0x7fdd1c06a7a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.079+0000 7fdd3fa90700 1 --2- 172.21.15.5:0/257746035 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd380cd3e0 0x7fdd381f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.079+0000 7fdd3fa90700 1 -- 172.21.15.5:0/257746035 >> 172.21.15.5:0/257746035 conn(0x7fdd380cc8d0 msgr2=0x7fdd380afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.079+0000 7fdd3fa90700 1 -- 172.21.15.5:0/257746035 shutdown_connections 2023-03-03T06:24:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.080+0000 7fdd3fa90700 1 -- 172.21.15.5:0/257746035 wait complete. 2023-03-03T06:24:55.088 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 6 and data pool 7 2023-03-03T06:24:55.103 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:55.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.225+0000 7f482c63a700 1 Processor -- start 2023-03-03T06:24:55.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.225+0000 7f482c63a700 1 -- start start 2023-03-03T06:24:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.226+0000 7f482c63a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48240b1fe0 0x7f48240cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.226+0000 7f482c63a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48240cba50 0x7f48240ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.226+0000 7f482c63a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482415d4e0 con 0x7f482415cd40 2023-03-03T06:24:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.226+0000 7f482c63a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482415d7c0 con 0x7f48240b1fe0 2023-03-03T06:24:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.226+0000 7f482c63a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482415daa0 con 0x7f48240cba50 2023-03-03T06:24:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.226+0000 7f4829bd5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48240b1fe0 0x7f48240cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.227+0000 7f4829bd5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f48240b1fe0 0x7f48240cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43522/0 (socket says 172.21.15.5:43522) 2023-03-03T06:24:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.227+0000 7f4829bd5700 1 -- 172.21.15.5:0/3367502431 learned_addr learned my addr 172.21.15.5:0/3367502431 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.227+0000 7f482abd7700 1 --2- 172.21.15.5:0/3367502431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48240cba50 0x7f48240ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.227+0000 7f4829bd5700 1 -- 172.21.15.5:0/3367502431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48240cba50 msgr2=0x7f48240ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:55.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.227+0000 7f4829bd5700 1 --2- 172.21.15.5:0/3367502431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48240cba50 0x7f48240ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.227+0000 7f4829bd5700 1 -- 172.21.15.5:0/3367502431 >> v1:172.21.15.191:6789/0 conn(0x7f482415cd40 legacy=0x7f48240b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.227+0000 7f4829bd5700 1 -- 172.21.15.5:0/3367502431 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482415dd80 con 0x7f48240b1fe0 2023-03-03T06:24:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.227+0000 7f4829bd5700 1 --2- 172.21.15.5:0/3367502431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48240b1fe0 0x7f48240cdf50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4818006fd0 tx=0x7f4818009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadcb02211efb067 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.227+0000 7f48293d4700 1 -- 172.21.15.5:0/3367502431 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4818005e30 con 0x7f48240b1fe0 2023-03-03T06:24:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.227+0000 7f48293d4700 1 -- 172.21.15.5:0/3367502431 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4818004030 con 0x7f48240b1fe0 2023-03-03T06:24:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.227+0000 7f48293d4700 1 -- 172.21.15.5:0/3367502431 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48180043e0 con 0x7f48240b1fe0 2023-03-03T06:24:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.228+0000 7f482c63a700 1 -- 172.21.15.5:0/3367502431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48240b1fe0 msgr2=0x7f48240cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.228+0000 7f482c63a700 1 --2- 172.21.15.5:0/3367502431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48240b1fe0 0x7f48240cdf50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4818006fd0 tx=0x7f4818009bd0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.228+0000 7f482c63a700 1 -- 172.21.15.5:0/3367502431 shutdown_connections 2023-03-03T06:24:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.228+0000 7f482c63a700 1 --2- 172.21.15.5:0/3367502431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48240cba50 0x7f48240ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.228+0000 7f482c63a700 1 --2- 172.21.15.5:0/3367502431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48240b1fe0 0x7f48240cdf50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.228+0000 7f482c63a700 1 -- 172.21.15.5:0/3367502431 >> 172.21.15.5:0/3367502431 conn(0x7f48240cc8d0 msgr2=0x7f48240cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.228+0000 7f482c63a700 1 -- 172.21.15.5:0/3367502431 shutdown_connections 2023-03-03T06:24:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.228+0000 7f482c63a700 1 -- 172.21.15.5:0/3367502431 wait complete. 2023-03-03T06:24:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.229+0000 7f482c63a700 1 Processor -- start 2023-03-03T06:24:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.229+0000 7f482c63a700 1 -- start start 2023-03-03T06:24:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482c63a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48240b1fe0 0x7f482414e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482c63a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48240cba50 0x7f48240b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482c63a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415cd40 0x7f48240c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482c63a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482414e8a0 con 0x7f482415cd40 2023-03-03T06:24:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482c63a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48240b4900 con 0x7f48240b1fe0 2023-03-03T06:24:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482c63a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48240b3860 con 0x7f48240cba50 2023-03-03T06:24:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482abd7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415cd40 0x7f48240c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482abd7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415cd40 0x7f48240c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43530/0 (socket says 172.21.15.5:43530) 2023-03-03T06:24:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482abd7700 1 -- 172.21.15.5:0/121663772 learned_addr learned my addr 172.21.15.5:0/121663772 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f4829bd5700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48240cba50 0x7f48240b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482a3d6700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48240b1fe0 0x7f482414e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482abd7700 1 -- 172.21.15.5:0/121663772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48240cba50 msgr2=0x7f48240b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482abd7700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48240cba50 0x7f48240b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482abd7700 1 -- 172.21.15.5:0/121663772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48240b1fe0 msgr2=0x7f482414e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482abd7700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48240b1fe0 0x7f482414e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482abd7700 1 -- 172.21.15.5:0/121663772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4818009500 con 0x7f482415cd40 2023-03-03T06:24:55.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482a3d6700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48240b1fe0 0x7f482414e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:55.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.230+0000 7f482abd7700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415cd40 0x7f48240c5da0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f481c007e40 tx=0x7f481c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:55.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.231+0000 7f4816ffd700 1 -- 172.21.15.5:0/121663772 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c00ede0 con 0x7f482415cd40 2023-03-03T06:24:55.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.231+0000 7f4816ffd700 1 -- 172.21.15.5:0/121663772 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c014420 con 0x7f482415cd40 2023-03-03T06:24:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.231+0000 7f482c63a700 1 -- 172.21.15.5:0/121663772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48240ca530 con 0x7f482415cd40 2023-03-03T06:24:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.231+0000 7f4816ffd700 1 -- 172.21.15.5:0/121663772 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0147d0 con 0x7f482415cd40 2023-03-03T06:24:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.231+0000 7f482c63a700 1 -- 172.21.15.5:0/121663772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482415e060 con 0x7f482415cd40 2023-03-03T06:24:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.232+0000 7f482c63a700 1 -- 172.21.15.5:0/121663772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482415d110 con 0x7f482415cd40 2023-03-03T06:24:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.232+0000 7f4816ffd700 1 -- 172.21.15.5:0/121663772 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f481c012050 con 0x7f482415cd40 2023-03-03T06:24:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.232+0000 7f4816ffd700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f48080682f0 0x7f480806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.233+0000 7f482a3d6700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f48080682f0 0x7f480806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.233+0000 7f4816ffd700 1 -- 172.21.15.5:0/121663772 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f481c086390 con 0x7f482415cd40 2023-03-03T06:24:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.233+0000 7f482a3d6700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f48080682f0 0x7f480806a7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4820000f60 tx=0x7f4820009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.237+0000 7f4816ffd700 1 -- 172.21.15.5:0/121663772 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f481c052ab0 con 0x7f482415cd40 2023-03-03T06:24:55.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.429+0000 7f482c63a700 1 -- 172.21.15.5:0/121663772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f482404e6e0 con 0x7f482415cd40 2023-03-03T06:24:55.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.430+0000 7f4816ffd700 1 -- 172.21.15.5:0/121663772 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17939 (secure 0 0 0) 0x7f481c0560d0 con 0x7f482415cd40 2023-03-03T06:24:55.433 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:55.433 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:24:55.062833+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:24:53.570801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-03T06:24:53.994714+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.432+0000 7f482c63a700 1 -- 172.21.15.5:0/121663772 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f48080682f0 msgr2=0x7f480806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.432+0000 7f482c63a700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f48080682f0 0x7f480806a7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4820000f60 tx=0x7f4820009040 comp rx=0 tx=0).stop 2023-03-03T06:24:55.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.432+0000 7f482c63a700 1 -- 172.21.15.5:0/121663772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415cd40 msgr2=0x7f48240c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.432+0000 7f482c63a700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415cd40 0x7f48240c5da0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f481c007e40 tx=0x7f481c00e3c0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.432+0000 7f482c63a700 1 -- 172.21.15.5:0/121663772 shutdown_connections 2023-03-03T06:24:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.432+0000 7f482c63a700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f482415cd40 0x7f48240c5da0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.432+0000 7f482c63a700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48240b1fe0 0x7f482414e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.432+0000 7f482c63a700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f48080682f0 0x7f480806a7a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.432+0000 7f482c63a700 1 --2- 172.21.15.5:0/121663772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48240cba50 0x7f48240b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.432+0000 7f482c63a700 1 -- 172.21.15.5:0/121663772 >> 172.21.15.5:0/121663772 conn(0x7f48240cc8d0 msgr2=0x7f48240ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.432+0000 7f482c63a700 1 -- 172.21.15.5:0/121663772 shutdown_connections 2023-03-03T06:24:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.432+0000 7f482c63a700 1 -- 172.21.15.5:0/121663772 wait complete. 2023-03-03T06:24:55.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:55.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.569+0000 7f6835b92700 1 Processor -- start 2023-03-03T06:24:55.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.569+0000 7f6835b92700 1 -- start start 2023-03-03T06:24:55.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.570+0000 7f6835b92700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68300b1f80 0x7f68300cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.570+0000 7f6835b92700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f683006b590 con 0x7f68300af080 2023-03-03T06:24:55.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.570+0000 7f6835b92700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f683006b870 con 0x7f68300af450 2023-03-03T06:24:55.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.570+0000 7f6835b92700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683006bb50 con 0x7f68300b1f80 2023-03-03T06:24:55.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.570+0000 7f682f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68300af080 0x7f68300b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33376/0 (socket says 172.21.15.5:33376) 2023-03-03T06:24:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.570+0000 7f682f7fe700 1 -- 172.21.15.5:0/953056006 learned_addr learned my addr 172.21.15.5:0/953056006 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.570+0000 7f682ffff700 1 --2- 172.21.15.5:0/953056006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68300b1f80 0x7f68300cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.570+0000 7f682e7fc700 1 -- 172.21.15.5:0/953056006 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441235292 0 0) 0x7f683006b590 con 0x7f68300af080 2023-03-03T06:24:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.570+0000 7f682e7fc700 1 -- 172.21.15.5:0/953056006 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f681c0035b0 con 0x7f68300af080 2023-03-03T06:24:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.571+0000 7f682e7fc700 1 -- 172.21.15.5:0/953056006 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614549431 0 0) 0x7f683006b870 con 0x7f68300af450 2023-03-03T06:24:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.571+0000 7f682e7fc700 1 -- 172.21.15.5:0/953056006 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f683006b590 con 0x7f68300af450 2023-03-03T06:24:55.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.571+0000 7f682ffff700 1 -- 172.21.15.5:0/953056006 >> v1:172.21.15.191:6789/0 conn(0x7f68300af450 legacy=0x7f68300cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.571+0000 7f682ffff700 1 -- 172.21.15.5:0/953056006 >> v1:172.21.15.5:6789/0 conn(0x7f68300af080 legacy=0x7f68300b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.571+0000 7f682e7fc700 1 -- 172.21.15.5:0/953056006 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3800343694 0 0) 0x7f681c0035b0 con 0x7f68300af080 2023-03-03T06:24:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.571+0000 7f682ffff700 1 -- 172.21.15.5:0/953056006 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683006be30 con 0x7f68300b1f80 2023-03-03T06:24:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.571+0000 7f682ffff700 1 --2- 172.21.15.5:0/953056006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68300b1f80 0x7f68300cd350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6828009dc0 tx=0x7f682800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b0afdf971500c4 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.571+0000 7f682e7fc700 1 -- 172.21.15.5:0/953056006 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682800e070 con 0x7f68300b1f80 2023-03-03T06:24:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.571+0000 7f682e7fc700 1 -- 172.21.15.5:0/953056006 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6828003a20 con 0x7f68300b1f80 2023-03-03T06:24:55.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.571+0000 7f682e7fc700 1 -- 172.21.15.5:0/953056006 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820001670 con 0x7f68300b1f80 2023-03-03T06:24:55.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.572+0000 7f6835b92700 1 -- 172.21.15.5:0/953056006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68300b1f80 msgr2=0x7f68300cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.572+0000 7f6835b92700 1 --2- 172.21.15.5:0/953056006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68300b1f80 0x7f68300cd350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6828009dc0 tx=0x7f682800b330 comp rx=0 tx=0).stop 2023-03-03T06:24:55.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.572+0000 7f6835b92700 1 -- 172.21.15.5:0/953056006 shutdown_connections 2023-03-03T06:24:55.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.572+0000 7f6835b92700 1 --2- 172.21.15.5:0/953056006 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68300b1f80 0x7f68300cd350 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.572+0000 7f6835b92700 1 -- 172.21.15.5:0/953056006 >> 172.21.15.5:0/953056006 conn(0x7f683006ea70 msgr2=0x7f68300cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:55.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.572+0000 7f6835b92700 1 -- 172.21.15.5:0/953056006 shutdown_connections 2023-03-03T06:24:55.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.572+0000 7f6835b92700 1 -- 172.21.15.5:0/953056006 wait complete. 2023-03-03T06:24:55.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.573+0000 7f6835b92700 1 Processor -- start 2023-03-03T06:24:55.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.573+0000 7f6835b92700 1 -- start start 2023-03-03T06:24:55.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f6835b92700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68300af080 0x7f68300ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f6835b92700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68300af450 0x7f68300c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f6835b92700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68300b1f80 0x7f68300ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f6835b92700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68300c7d10 con 0x7f68300af080 2023-03-03T06:24:55.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f6835b92700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68300acac0 con 0x7f68300b1f80 2023-03-03T06:24:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f6835b92700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68300ac7e0 con 0x7f68300af450 2023-03-03T06:24:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f682f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68300af080 0x7f68300ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f682f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68300af080 0x7f68300ae470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43540/0 (socket says 172.21.15.5:43540) 2023-03-03T06:24:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f682f7fe700 1 -- 172.21.15.5:0/1943616610 learned_addr learned my addr 172.21.15.5:0/1943616610 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f682effd700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68300af450 0x7f68300c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f682ffff700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68300b1f80 0x7f68300ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f682f7fe700 1 -- 172.21.15.5:0/1943616610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68300af450 msgr2=0x7f68300c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f682f7fe700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68300af450 0x7f68300c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f682f7fe700 1 -- 172.21.15.5:0/1943616610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68300b1f80 msgr2=0x7f68300ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f682f7fe700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68300b1f80 0x7f68300ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f682f7fe700 1 -- 172.21.15.5:0/1943616610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6828009a70 con 0x7f68300af080 2023-03-03T06:24:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f682ffff700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68300b1f80 0x7f68300ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f682effd700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68300af450 0x7f68300c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f682f7fe700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68300af080 0x7f68300ae470 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f682000c7a0 tx=0x7f682000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:55.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f6827fff700 1 -- 172.21.15.5:0/1943616610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820007560 con 0x7f68300af080 2023-03-03T06:24:55.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f6827fff700 1 -- 172.21.15.5:0/1943616610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68200076c0 con 0x7f68300af080 2023-03-03T06:24:55.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f6835b92700 1 -- 172.21.15.5:0/1943616610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f683006d370 con 0x7f68300af080 2023-03-03T06:24:55.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f6827fff700 1 -- 172.21.15.5:0/1943616610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820004a70 con 0x7f68300af080 2023-03-03T06:24:55.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.574+0000 7f6835b92700 1 -- 172.21.15.5:0/1943616610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f683006c110 con 0x7f68300af080 2023-03-03T06:24:55.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.576+0000 7f6835b92700 1 -- 172.21.15.5:0/1943616610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683006cb70 con 0x7f68300af080 2023-03-03T06:24:55.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.576+0000 7f6827fff700 1 -- 172.21.15.5:0/1943616610 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f682001a030 con 0x7f68300af080 2023-03-03T06:24:55.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.576+0000 7f6827fff700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6810068320 0x7f681006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.576+0000 7f6827fff700 1 -- 172.21.15.5:0/1943616610 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6820085340 con 0x7f68300af080 2023-03-03T06:24:55.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.576+0000 7f682effd700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6810068320 0x7f681006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.577+0000 7f682effd700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6810068320 0x7f681006a7d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f68300c72e0 tx=0x7f6818009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:55.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.581+0000 7f6827fff700 1 -- 172.21.15.5:0/1943616610 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6820051a00 con 0x7f68300af080 2023-03-03T06:24:55.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.774+0000 7f6835b92700 1 -- 172.21.15.5:0/1943616610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68300c7520 con 0x7f68300af080 2023-03-03T06:24:55.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.775+0000 7f6827fff700 1 -- 172.21.15.5:0/1943616610 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+17939 (secure 0 0 0) 0x7f68300c7520 con 0x7f68300af080 2023-03-03T06:24:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:55.778 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:24:55.062833+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:24:53.570801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-03T06:24:53.994714+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.777+0000 7f6835b92700 1 -- 172.21.15.5:0/1943616610 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6810068320 msgr2=0x7f681006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.777+0000 7f6835b92700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6810068320 0x7f681006a7d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f68300c72e0 tx=0x7f6818009040 comp rx=0 tx=0).stop 2023-03-03T06:24:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.777+0000 7f6835b92700 1 -- 172.21.15.5:0/1943616610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68300af080 msgr2=0x7f68300ae470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.777+0000 7f6835b92700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68300af080 0x7f68300ae470 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f682000c7a0 tx=0x7f682000cb60 comp rx=0 tx=0).stop 2023-03-03T06:24:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.777+0000 7f6835b92700 1 -- 172.21.15.5:0/1943616610 shutdown_connections 2023-03-03T06:24:55.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.777+0000 7f6835b92700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68300b1f80 0x7f68300ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.777+0000 7f6835b92700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68300af080 0x7f68300ae470 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.777+0000 7f6835b92700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6810068320 0x7f681006a7d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.778+0000 7f6835b92700 1 --2- 172.21.15.5:0/1943616610 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68300af450 0x7f68300c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.778+0000 7f6835b92700 1 -- 172.21.15.5:0/1943616610 >> 172.21.15.5:0/1943616610 conn(0x7f683006ea70 msgr2=0x7f68300cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.778+0000 7f6835b92700 1 -- 172.21.15.5:0/1943616610 shutdown_connections 2023-03-03T06:24:55.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.778+0000 7f6835b92700 1 -- 172.21.15.5:0/1943616610 wait complete. 2023-03-03T06:24:55.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-03T06:24:55.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.918+0000 7f21504ae700 1 Processor -- start 2023-03-03T06:24:55.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.918+0000 7f21504ae700 1 -- start start 2023-03-03T06:24:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.919+0000 7f21504ae700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21480cf7c0 0x7f21480cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.919+0000 7f21504ae700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f21480b18d0 0x7f21480b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.919+0000 7f21504ae700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21480cc370 con 0x7f21480cf3f0 2023-03-03T06:24:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.919+0000 7f21504ae700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21480b2290 con 0x7f21480b18d0 2023-03-03T06:24:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.919+0000 7f21504ae700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21480cb760 con 0x7f21480cf7c0 2023-03-03T06:24:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.919+0000 7f214e24a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f21480cf3f0 0x7f214815dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33390/0 (socket says 172.21.15.5:33390) 2023-03-03T06:24:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.919+0000 7f214e24a700 1 -- 172.21.15.5:0/1775918533 learned_addr learned my addr 172.21.15.5:0/1775918533 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.919+0000 7f214da49700 1 --2- 172.21.15.5:0/1775918533 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21480cf7c0 0x7f21480cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.919+0000 7f214ea4b700 1 --2- 172.21.15.5:0/1775918533 >> v2:172.21.15.191:3300/0 conn(0x7f21480b18d0 0x7f21480b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.919+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514119876 0 0) 0x7f21480cc370 con 0x7f21480cf3f0 2023-03-03T06:24:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.919+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21340035b0 con 0x7f21480cf3f0 2023-03-03T06:24:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3795296681 0 0) 0x7f21340035b0 con 0x7f21480cf3f0 2023-03-03T06:24:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21480cf7c0 msgr2=0x7f21480cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 --2- 172.21.15.5:0/1775918533 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21480cf7c0 0x7f21480cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 >> v2:172.21.15.191:3300/0 conn(0x7f21480b18d0 msgr2=0x7f21480b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 --2- 172.21.15.5:0/1775918533 >> v2:172.21.15.191:3300/0 conn(0x7f21480b18d0 0x7f21480b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21480cba40 con 0x7f21480cf3f0 2023-03-03T06:24:55.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f2138001670 con 0x7f21480cf3f0 2023-03-03T06:24:55.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 >> v1:172.21.15.5:6789/0 conn(0x7f21480cf3f0 legacy=0x7f214815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 --2- 172.21.15.5:0/1775918533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2134003a00 0x7f2134003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 --2- 172.21.15.5:0/1775918533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2134004430 0x7f21340048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 --2- 172.21.15.5:0/1775918533 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21480cf7c0 0x7f2134004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21480b2290 con 0x7f2134004430 2023-03-03T06:24:55.926 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21480cb760 con 0x7f2134003a00 2023-03-03T06:24:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213400ba10 con 0x7f21480cf7c0 2023-03-03T06:24:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214da49700 1 --2- 172.21.15.5:0/1775918533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2134004430 0x7f21340048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214e24a700 1 --2- 172.21.15.5:0/1775918533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2134003a00 0x7f2134003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214ea4b700 1 --2- 172.21.15.5:0/1775918533 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21480cf7c0 0x7f2134004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214da49700 1 -- 172.21.15.5:0/1775918533 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21480cf7c0 msgr2=0x7f2134004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214da49700 1 --2- 172.21.15.5:0/1775918533 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21480cf7c0 0x7f2134004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214da49700 1 -- 172.21.15.5:0/1775918533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2134003a00 msgr2=0x7f2134003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214da49700 1 --2- 172.21.15.5:0/1775918533 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2134003a00 0x7f2134003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214da49700 1 -- 172.21.15.5:0/1775918533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340035b0 con 0x7f2134004430 2023-03-03T06:24:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214da49700 1 --2- 172.21.15.5:0/1775918533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2134004430 0x7f21340048f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2144009b60 tx=0x7f2134005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c2918ba6bbce1d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.920+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400e6c0 con 0x7f2134004430 2023-03-03T06:24:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.921+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214400e820 con 0x7f2134004430 2023-03-03T06:24:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.921+0000 7f214d248700 1 -- 172.21.15.5:0/1775918533 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400eb90 con 0x7f2134004430 2023-03-03T06:24:55.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.921+0000 7f21504ae700 1 -- 172.21.15.5:0/1775918533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2134004430 msgr2=0x7f21340048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.921+0000 7f21504ae700 1 --2- 172.21.15.5:0/1775918533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2134004430 0x7f21340048f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2144009b60 tx=0x7f2134005880 comp rx=0 tx=0).stop 2023-03-03T06:24:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.921+0000 7f214ea4b700 1 -- 172.21.15.5:0/1775918533 reap_dead start 2023-03-03T06:24:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.921+0000 7f21504ae700 1 -- 172.21.15.5:0/1775918533 shutdown_connections 2023-03-03T06:24:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.921+0000 7f21504ae700 1 -- 172.21.15.5:0/1775918533 >> 172.21.15.5:0/1775918533 conn(0x7f21480cc8d0 msgr2=0x7f21480cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.921+0000 7f21504ae700 1 -- 172.21.15.5:0/1775918533 shutdown_connections 2023-03-03T06:24:55.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.921+0000 7f21504ae700 1 -- 172.21.15.5:0/1775918533 wait complete. 2023-03-03T06:24:55.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.922+0000 7f21504ae700 1 Processor -- start 2023-03-03T06:24:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.922+0000 7f21504ae700 1 -- start start 2023-03-03T06:24:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.923+0000 7f21504ae700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2134004430 0x7f21481511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.923+0000 7f21504ae700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21481f10b0 0x7f21481f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.923+0000 7f21504ae700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21481f1a60 0x7f21481f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.923+0000 7f21504ae700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21481f2420 con 0x7f2134004430 2023-03-03T06:24:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.923+0000 7f21504ae700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21480c5730 con 0x7f21481f1a60 2023-03-03T06:24:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.923+0000 7f21504ae700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21480c5a10 con 0x7f21481f10b0 2023-03-03T06:24:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.923+0000 7f214e24a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2134004430 0x7f21481511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.923+0000 7f214e24a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2134004430 0x7f21481511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43560/0 (socket says 172.21.15.5:43560) 2023-03-03T06:24:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.923+0000 7f214e24a700 1 -- 172.21.15.5:0/1163010881 learned_addr learned my addr 172.21.15.5:0/1163010881 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:55.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.923+0000 7f214ea4b700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21481f1a60 0x7f21481f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.923+0000 7f214da49700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21481f10b0 0x7f21481f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.924+0000 7f214e24a700 1 -- 172.21.15.5:0/1163010881 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21481f10b0 msgr2=0x7f21481f1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.924+0000 7f214e24a700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21481f10b0 0x7f21481f1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.924+0000 7f214e24a700 1 -- 172.21.15.5:0/1163010881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21481f1a60 msgr2=0x7f21481f1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:55.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.924+0000 7f214e24a700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21481f1a60 0x7f21481f1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.924+0000 7f214e24a700 1 -- 172.21.15.5:0/1163010881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21480cc000 con 0x7f2134004430 2023-03-03T06:24:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.924+0000 7f214e24a700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2134004430 0x7f21481511d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2138001aa0 tx=0x7f21380075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.924+0000 7f213effd700 1 -- 172.21.15.5:0/1163010881 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21380077d0 con 0x7f2134004430 2023-03-03T06:24:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.924+0000 7f213effd700 1 -- 172.21.15.5:0/1163010881 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213800f8a0 con 0x7f2134004430 2023-03-03T06:24:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.924+0000 7f21504ae700 1 -- 172.21.15.5:0/1163010881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21480cbd20 con 0x7f2134004430 2023-03-03T06:24:55.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.924+0000 7f213effd700 1 -- 172.21.15.5:0/1163010881 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213800fc50 con 0x7f2134004430 2023-03-03T06:24:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.924+0000 7f21504ae700 1 -- 172.21.15.5:0/1163010881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21480cd450 con 0x7f2134004430 2023-03-03T06:24:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.925+0000 7f21504ae700 1 -- 172.21.15.5:0/1163010881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214804e6e0 con 0x7f2134004430 2023-03-03T06:24:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.925+0000 7f213effd700 1 -- 172.21.15.5:0/1163010881 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f213800fdb0 con 0x7f2134004430 2023-03-03T06:24:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.926+0000 7f213effd700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f212c0682f0 0x7f212c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:55.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.926+0000 7f213effd700 1 -- 172.21.15.5:0/1163010881 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f21380860b0 con 0x7f2134004430 2023-03-03T06:24:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.926+0000 7f214da49700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f212c0682f0 0x7f212c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.926+0000 7f214da49700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f212c0682f0 0x7f212c06a7a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f21440090b0 tx=0x7f2144008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:55.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:55.930+0000 7f213effd700 1 -- 172.21.15.5:0/1163010881 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f21380526e0 con 0x7f2134004430 2023-03-03T06:24:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:56.170+0000 7f21504ae700 1 -- 172.21.15.5:0/1163010881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f21480ce6f0 con 0x7f2134004430 2023-03-03T06:24:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.082+0000 7f213effd700 1 -- 172.21.15.5:0/1163010881 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2138055d00 con 0x7f2134004430 2023-03-03T06:24:57.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.085+0000 7f21504ae700 1 -- 172.21.15.5:0/1163010881 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f212c0682f0 msgr2=0x7f212c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:57.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.085+0000 7f21504ae700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f212c0682f0 0x7f212c06a7a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f21440090b0 tx=0x7f2144008030 comp rx=0 tx=0).stop 2023-03-03T06:24:57.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.085+0000 7f21504ae700 1 -- 172.21.15.5:0/1163010881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2134004430 msgr2=0x7f21481511d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:57.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.085+0000 7f21504ae700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2134004430 0x7f21481511d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2138001aa0 tx=0x7f21380075f0 comp rx=0 tx=0).stop 2023-03-03T06:24:57.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.085+0000 7f21504ae700 1 -- 172.21.15.5:0/1163010881 shutdown_connections 2023-03-03T06:24:57.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.085+0000 7f21504ae700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21481f1a60 0x7f21481f1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:57.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.085+0000 7f21504ae700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2134004430 0x7f21481511d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:57.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.085+0000 7f21504ae700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f212c0682f0 0x7f212c06a7a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:57.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.085+0000 7f21504ae700 1 --2- 172.21.15.5:0/1163010881 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21481f10b0 0x7f21481f1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:57.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.085+0000 7f21504ae700 1 -- 172.21.15.5:0/1163010881 >> 172.21.15.5:0/1163010881 conn(0x7f21480cc8d0 msgr2=0x7f214815d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:57.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.085+0000 7f21504ae700 1 -- 172.21.15.5:0/1163010881 shutdown_connections 2023-03-03T06:24:57.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.085+0000 7f21504ae700 1 -- 172.21.15.5:0/1163010881 wait complete. 2023-03-03T06:24:57.102 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-03-03T06:24:57.102 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-03T06:24:57.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.235+0000 7f95bfd2d700 1 Processor -- start 2023-03-03T06:24:57.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.236+0000 7f95bfd2d700 1 -- start start 2023-03-03T06:24:57.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bfd2d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f95b80cf3f0 0x7f95b80cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:57.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bfd2d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b80cc370 con 0x7f95b80cf7c0 2023-03-03T06:24:57.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bfd2d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b80cb760 con 0x7f95b80b18d0 2023-03-03T06:24:57.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bfd2d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b80cba40 con 0x7f95b80cf3f0 2023-03-03T06:24:57.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bd2c8700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f95b80cf7c0 0x7f95b815dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33412/0 (socket says 172.21.15.5:33412) 2023-03-03T06:24:57.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bd2c8700 1 -- 172.21.15.5:0/2075969946 learned_addr learned my addr 172.21.15.5:0/2075969946 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:57.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195003298 0 0) 0x7f95b80cc370 con 0x7f95b80cf7c0 2023-03-03T06:24:57.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bdac9700 1 --2- 172.21.15.5:0/2075969946 >> v2:172.21.15.191:3300/0 conn(0x7f95b80cf3f0 0x7f95b80cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:57.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95a40035b0 con 0x7f95b80cf7c0 2023-03-03T06:24:57.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1280416705 0 0) 0x7f95a40035b0 con 0x7f95b80cf7c0 2023-03-03T06:24:57.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 >> v2:172.21.15.191:3300/0 conn(0x7f95b80cf3f0 msgr2=0x7f95b80cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:57.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bcac7700 1 --2- 172.21.15.5:0/2075969946 >> v2:172.21.15.191:3300/0 conn(0x7f95b80cf3f0 0x7f95b80cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:57.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 >> v1:172.21.15.191:6789/0 conn(0x7f95b80b18d0 legacy=0x7f95b80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:57.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b80cbd20 con 0x7f95b80cf7c0 2023-03-03T06:24:57.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f95b4001670 con 0x7f95b80cf7c0 2023-03-03T06:24:57.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.237+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 >> v1:172.21.15.5:6789/0 conn(0x7f95b80cf7c0 legacy=0x7f95b815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:57.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95bcac7700 1 --2- 172.21.15.5:0/2075969946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95a4003a50 0x7f95a4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:57.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95bcac7700 1 --2- 172.21.15.5:0/2075969946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a4004850 0x7f95a4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:57.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95bcac7700 1 --2- 172.21.15.5:0/2075969946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a4005200 0x7f95a400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80cba40 con 0x7f95a4005200 2023-03-03T06:24:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a400c0e0 con 0x7f95a4004850 2023-03-03T06:24:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a400c2a0 con 0x7f95a4003a50 2023-03-03T06:24:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95be2ca700 1 --2- 172.21.15.5:0/2075969946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a4005200 0x7f95a400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95bdac9700 1 --2- 172.21.15.5:0/2075969946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95a4003a50 0x7f95a4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95bd2c8700 1 --2- 172.21.15.5:0/2075969946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a4004850 0x7f95a4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95be2ca700 1 -- 172.21.15.5:0/2075969946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95a4003a50 msgr2=0x7f95a4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:57.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95be2ca700 1 --2- 172.21.15.5:0/2075969946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95a4003a50 0x7f95a4003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95be2ca700 1 -- 172.21.15.5:0/2075969946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a4004850 msgr2=0x7f95a4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95be2ca700 1 --2- 172.21.15.5:0/2075969946 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a4004850 0x7f95a4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95be2ca700 1 -- 172.21.15.5:0/2075969946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40035b0 con 0x7f95a4005200 2023-03-03T06:24:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95bdac9700 1 --2- 172.21.15.5:0/2075969946 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95a4003a50 0x7f95a4003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:24:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95be2ca700 1 -- 172.21.15.5:0/2075969946 reap_dead start 2023-03-03T06:24:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95be2ca700 1 --2- 172.21.15.5:0/2075969946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a4005200 0x7f95a400ba10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c160 tx=0x7f95a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781255df173fb2de server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:57.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0001db0 con 0x7f95a4005200 2023-03-03T06:24:57.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b000cca0 con 0x7f95a4005200 2023-03-03T06:24:57.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.238+0000 7f95bcac7700 1 -- 172.21.15.5:0/2075969946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0003c20 con 0x7f95a4005200 2023-03-03T06:24:57.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.239+0000 7f95bfd2d700 1 -- 172.21.15.5:0/2075969946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a4005200 msgr2=0x7f95a400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:57.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.239+0000 7f95bfd2d700 1 --2- 172.21.15.5:0/2075969946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a4005200 0x7f95a400ba10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c160 tx=0x7f95a4005880 comp rx=0 tx=0).stop 2023-03-03T06:24:57.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.239+0000 7f95bfd2d700 1 -- 172.21.15.5:0/2075969946 shutdown_connections 2023-03-03T06:24:57.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.239+0000 7f95bfd2d700 1 --2- 172.21.15.5:0/2075969946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a4005200 0x7f95a400ba10 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:57.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.239+0000 7f95bfd2d700 1 -- 172.21.15.5:0/2075969946 >> 172.21.15.5:0/2075969946 conn(0x7f95b80cc8d0 msgr2=0x7f95b80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:57.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.239+0000 7f95bfd2d700 1 -- 172.21.15.5:0/2075969946 shutdown_connections 2023-03-03T06:24:57.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.239+0000 7f95bfd2d700 1 -- 172.21.15.5:0/2075969946 wait complete. 2023-03-03T06:24:57.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.240+0000 7f95bfd2d700 1 Processor -- start 2023-03-03T06:24:57.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.240+0000 7f95bfd2d700 1 -- start start 2023-03-03T06:24:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95bfd2d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a4005200 0x7f95b80c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95bfd2d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95b815c090 0x7f95b80c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95bfd2d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b80c43f0 0x7f95b80b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95bfd2d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b815bc70 con 0x7f95b80c43f0 2023-03-03T06:24:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95bfd2d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b815ade0 con 0x7f95a4005200 2023-03-03T06:24:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95bfd2d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80c6040 con 0x7f95b815c090 2023-03-03T06:24:57.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95be2ca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b80c43f0 0x7f95b80b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:57.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95be2ca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b80c43f0 0x7f95b80b4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43584/0 (socket says 172.21.15.5:43584) 2023-03-03T06:24:57.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95be2ca700 1 -- 172.21.15.5:0/721685974 learned_addr learned my addr 172.21.15.5:0/721685974 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:57.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95be2ca700 1 -- 172.21.15.5:0/721685974 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95b815c090 msgr2=0x7f95b80c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:57.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95be2ca700 1 --2- 172.21.15.5:0/721685974 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95b815c090 0x7f95b80c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:57.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95be2ca700 1 -- 172.21.15.5:0/721685974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a4005200 msgr2=0x7f95b80c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:57.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95bdac9700 1 --2- 172.21.15.5:0/721685974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a4005200 0x7f95b80c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:57.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95be2ca700 1 --2- 172.21.15.5:0/721685974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a4005200 0x7f95b80c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:57.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95be2ca700 1 -- 172.21.15.5:0/721685974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b80cd450 con 0x7f95b80c43f0 2023-03-03T06:24:57.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.241+0000 7f95be2ca700 1 --2- 172.21.15.5:0/721685974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b80c43f0 0x7f95b80b4ea0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f95b8070920 tx=0x7f95b00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:57.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.242+0000 7f95ae7fc700 1 -- 172.21.15.5:0/721685974 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0003d50 con 0x7f95b80c43f0 2023-03-03T06:24:57.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.242+0000 7f95ae7fc700 1 -- 172.21.15.5:0/721685974 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b00050d0 con 0x7f95b80c43f0 2023-03-03T06:24:57.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.242+0000 7f95bfd2d700 1 -- 172.21.15.5:0/721685974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b80cc000 con 0x7f95b80c43f0 2023-03-03T06:24:57.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.242+0000 7f95ae7fc700 1 -- 172.21.15.5:0/721685974 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0005480 con 0x7f95b80c43f0 2023-03-03T06:24:57.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.242+0000 7f95bfd2d700 1 -- 172.21.15.5:0/721685974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b80cd5e0 con 0x7f95b80c43f0 2023-03-03T06:24:57.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.243+0000 7f95bfd2d700 1 -- 172.21.15.5:0/721685974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b804e6e0 con 0x7f95b80c43f0 2023-03-03T06:24:57.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.243+0000 7f95ae7fc700 1 -- 172.21.15.5:0/721685974 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f95b002d070 con 0x7f95b80c43f0 2023-03-03T06:24:57.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.243+0000 7f95ae7fc700 1 --2- 172.21.15.5:0/721685974 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f959c0682f0 0x7f959c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:57.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.243+0000 7f95ae7fc700 1 -- 172.21.15.5:0/721685974 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f95b0086d50 con 0x7f95b80c43f0 2023-03-03T06:24:57.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.244+0000 7f95bdac9700 1 --2- 172.21.15.5:0/721685974 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f959c0682f0 0x7f959c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:57.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.244+0000 7f95bdac9700 1 --2- 172.21.15.5:0/721685974 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f959c0682f0 0x7f959c06a7a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f95a80099b0 tx=0x7f95a8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:57.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.248+0000 7f95ae7fc700 1 -- 172.21.15.5:0/721685974 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f95b00533f0 con 0x7f95b80c43f0 2023-03-03T06:24:57.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:57.488+0000 7f95bfd2d700 1 -- 172.21.15.5:0/721685974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f95b8070fb0 con 0x7f95b80c43f0 2023-03-03T06:24:58.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.087+0000 7f95ae7fc700 1 -- 172.21.15.5:0/721685974 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f95b00170c0 con 0x7f95b80c43f0 2023-03-03T06:24:58.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.090+0000 7f95bfd2d700 1 -- 172.21.15.5:0/721685974 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f959c0682f0 msgr2=0x7f959c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.090+0000 7f95bfd2d700 1 --2- 172.21.15.5:0/721685974 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f959c0682f0 0x7f959c06a7a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f95a80099b0 tx=0x7f95a8008040 comp rx=0 tx=0).stop 2023-03-03T06:24:58.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.090+0000 7f95bfd2d700 1 -- 172.21.15.5:0/721685974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b80c43f0 msgr2=0x7f95b80b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.090+0000 7f95bfd2d700 1 --2- 172.21.15.5:0/721685974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b80c43f0 0x7f95b80b4ea0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f95b8070920 tx=0x7f95b00014a0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.090+0000 7f95bfd2d700 1 -- 172.21.15.5:0/721685974 shutdown_connections 2023-03-03T06:24:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.090+0000 7f95bfd2d700 1 --2- 172.21.15.5:0/721685974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95b80c43f0 0x7f95b80b4ea0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.090+0000 7f95bfd2d700 1 --2- 172.21.15.5:0/721685974 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95a4005200 0x7f95b80c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.090+0000 7f95bfd2d700 1 --2- 172.21.15.5:0/721685974 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f959c0682f0 0x7f959c06a7a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.090+0000 7f95bfd2d700 1 --2- 172.21.15.5:0/721685974 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95b815c090 0x7f95b80c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.090+0000 7f95bfd2d700 1 -- 172.21.15.5:0/721685974 >> 172.21.15.5:0/721685974 conn(0x7f95b80cc8d0 msgr2=0x7f95b80ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:58.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.090+0000 7f95bfd2d700 1 -- 172.21.15.5:0/721685974 shutdown_connections 2023-03-03T06:24:58.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.090+0000 7f95bfd2d700 1 -- 172.21.15.5:0/721685974 wait complete. 2023-03-03T06:24:58.107 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-03T06:24:58.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:24:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.237+0000 7f7c96dfa700 1 Processor -- start 2023-03-03T06:24:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.237+0000 7f7c96dfa700 1 -- start start 2023-03-03T06:24:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.238+0000 7f7c96dfa700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c900cd360 0x7f7c900ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.238+0000 7f7c96dfa700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c900cd7d0 con 0x7f7c9015a750 2023-03-03T06:24:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.238+0000 7f7c96dfa700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c900cab70 con 0x7f7c9006b540 2023-03-03T06:24:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.238+0000 7f7c96dfa700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c900cc320 con 0x7f7c900cd360 2023-03-03T06:24:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.238+0000 7f7c8ffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c900cd360 0x7f7c900ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.238+0000 7f7c94b96700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7c9015a750 0x7f7c900cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33430/0 (socket says 172.21.15.5:33430) 2023-03-03T06:24:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.238+0000 7f7c94b96700 1 -- 172.21.15.5:0/2725666939 learned_addr learned my addr 172.21.15.5:0/2725666939 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.238+0000 7f7c8f7fe700 1 -- 172.21.15.5:0/2725666939 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489999228 0 0) 0x7f7c900cd7d0 con 0x7f7c9015a750 2023-03-03T06:24:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.238+0000 7f7c8f7fe700 1 -- 172.21.15.5:0/2725666939 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c800035b0 con 0x7f7c9015a750 2023-03-03T06:24:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.238+0000 7f7c8ffff700 1 -- 172.21.15.5:0/2725666939 >> v1:172.21.15.191:6789/0 conn(0x7f7c9006b540 legacy=0x7f7c900b2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.238+0000 7f7c8ffff700 1 -- 172.21.15.5:0/2725666939 >> v1:172.21.15.5:6789/0 conn(0x7f7c9015a750 legacy=0x7f7c900cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.238+0000 7f7c8ffff700 1 -- 172.21.15.5:0/2725666939 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900cae50 con 0x7f7c900cd360 2023-03-03T06:24:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.239+0000 7f7c8ffff700 1 --2- 172.21.15.5:0/2725666939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c900cd360 0x7f7c900ca440 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c009840 tx=0x7f7c7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0eca63c3d7ccc41 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:58.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.239+0000 7f7c8f7fe700 1 -- 172.21.15.5:0/2725666939 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c011830 con 0x7f7c900cd360 2023-03-03T06:24:58.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.239+0000 7f7c8f7fe700 1 -- 172.21.15.5:0/2725666939 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c011990 con 0x7f7c900cd360 2023-03-03T06:24:58.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.239+0000 7f7c8f7fe700 1 -- 172.21.15.5:0/2725666939 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c011d20 con 0x7f7c900cd360 2023-03-03T06:24:58.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.239+0000 7f7c96dfa700 1 -- 172.21.15.5:0/2725666939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c900cd360 msgr2=0x7f7c900ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.239+0000 7f7c96dfa700 1 --2- 172.21.15.5:0/2725666939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c900cd360 0x7f7c900ca440 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c009840 tx=0x7f7c7c009b50 comp rx=0 tx=0).stop 2023-03-03T06:24:58.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.239+0000 7f7c96dfa700 1 -- 172.21.15.5:0/2725666939 shutdown_connections 2023-03-03T06:24:58.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.239+0000 7f7c96dfa700 1 --2- 172.21.15.5:0/2725666939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c900cd360 0x7f7c900ca440 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.239+0000 7f7c96dfa700 1 -- 172.21.15.5:0/2725666939 >> 172.21.15.5:0/2725666939 conn(0x7f7c9006ea70 msgr2=0x7f7c900cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:58.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.239+0000 7f7c96dfa700 1 -- 172.21.15.5:0/2725666939 shutdown_connections 2023-03-03T06:24:58.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.239+0000 7f7c96dfa700 1 -- 172.21.15.5:0/2725666939 wait complete. 2023-03-03T06:24:58.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.241+0000 7f7c96dfa700 1 Processor -- start 2023-03-03T06:24:58.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.241+0000 7f7c96dfa700 1 -- start start 2023-03-03T06:24:58.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c96dfa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9006b540 0x7f7c9014cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c96dfa700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c900cd360 0x7f7c901f0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c96dfa700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c9015a750 0x7f7c9015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c96dfa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900b3f50 con 0x7f7c9006b540 2023-03-03T06:24:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c96dfa700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900b4130 con 0x7f7c9015a750 2023-03-03T06:24:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c96dfa700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900b4410 con 0x7f7c900cd360 2023-03-03T06:24:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c94b96700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9006b540 0x7f7c9014cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c94b96700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9006b540 0x7f7c9014cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43594/0 (socket says 172.21.15.5:43594) 2023-03-03T06:24:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c94b96700 1 -- 172.21.15.5:0/1285079665 learned_addr learned my addr 172.21.15.5:0/1285079665 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c94b96700 1 -- 172.21.15.5:0/1285079665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c900cd360 msgr2=0x7f7c901f0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c94b96700 1 --2- 172.21.15.5:0/1285079665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c900cd360 0x7f7c901f0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c94b96700 1 -- 172.21.15.5:0/1285079665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c9015a750 msgr2=0x7f7c9015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c95397700 1 --2- 172.21.15.5:0/1285079665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c9015a750 0x7f7c9015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c94b96700 1 --2- 172.21.15.5:0/1285079665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c9015a750 0x7f7c9015adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c94b96700 1 -- 172.21.15.5:0/1285079665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c0094a0 con 0x7f7c9006b540 2023-03-03T06:24:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c94b96700 1 --2- 172.21.15.5:0/1285079665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9006b540 0x7f7c9014cd80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7c84001eb0 tx=0x7f7c8400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c8d7fa700 1 -- 172.21.15.5:0/1285079665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84005d70 con 0x7f7c9006b540 2023-03-03T06:24:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c8d7fa700 1 -- 172.21.15.5:0/1285079665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c840070d0 con 0x7f7c9006b540 2023-03-03T06:24:58.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c8d7fa700 1 -- 172.21.15.5:0/1285079665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84007460 con 0x7f7c9006b540 2023-03-03T06:24:58.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c96dfa700 1 -- 172.21.15.5:0/1285079665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c900cb410 con 0x7f7c9006b540 2023-03-03T06:24:58.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.242+0000 7f7c96dfa700 1 -- 172.21.15.5:0/1285079665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c900cb130 con 0x7f7c9006b540 2023-03-03T06:24:58.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.243+0000 7f7c96dfa700 1 -- 172.21.15.5:0/1285079665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c900cb6f0 con 0x7f7c9006b540 2023-03-03T06:24:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.244+0000 7f7c8d7fa700 1 -- 172.21.15.5:0/1285079665 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7c84019030 con 0x7f7c9006b540 2023-03-03T06:24:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.244+0000 7f7c8d7fa700 1 --2- 172.21.15.5:0/1285079665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c740682f0 0x7f7c7406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.244+0000 7f7c8d7fa700 1 -- 172.21.15.5:0/1285079665 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7c840851d0 con 0x7f7c9006b540 2023-03-03T06:24:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.244+0000 7f7c8ffff700 1 --2- 172.21.15.5:0/1285079665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c740682f0 0x7f7c7406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.245+0000 7f7c8ffff700 1 --2- 172.21.15.5:0/1285079665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c740682f0 0x7f7c7406a7a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7c900b5c00 tx=0x7f7c7c010000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:58.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.248+0000 7f7c8d7fa700 1 -- 172.21.15.5:0/1285079665 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7c840518f0 con 0x7f7c9006b540 2023-03-03T06:24:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.486+0000 7f7c96dfa700 1 -- 172.21.15.5:0/1285079665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c9004e6e0 con 0x7f7c9006b540 2023-03-03T06:24:58.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.486+0000 7f7c8d7fa700 1 -- 172.21.15.5:0/1285079665 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f7c84054f10 con 0x7f7c9006b540 2023-03-03T06:24:58.489 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:58.489 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/1485137346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1485137346},{"type":"v1","addr":"172.21.15.191:6834","nonce":1485137346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4886,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2062075895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2062075895},{"type":"v1","addr":"172.21.15.5:6837","nonce":2062075895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3463336232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":3463336232},{"type":"v1","addr":"172.21.15.191:6835","nonce":3463336232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:24:55.063168+0000","modified":"2023-03-03T06:24:58.081923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5098},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5098":{"gid":5098,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/3094337828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3094337828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3094337828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-03T06:24:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.488+0000 7f7c96dfa700 1 -- 172.21.15.5:0/1285079665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c740682f0 msgr2=0x7f7c7406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.488+0000 7f7c96dfa700 1 --2- 172.21.15.5:0/1285079665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c740682f0 0x7f7c7406a7a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7c900b5c00 tx=0x7f7c7c010000 comp rx=0 tx=0).stop 2023-03-03T06:24:58.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.488+0000 7f7c96dfa700 1 -- 172.21.15.5:0/1285079665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9006b540 msgr2=0x7f7c9014cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.488+0000 7f7c96dfa700 1 --2- 172.21.15.5:0/1285079665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9006b540 0x7f7c9014cd80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7c84001eb0 tx=0x7f7c8400c860 comp rx=0 tx=0).stop 2023-03-03T06:24:58.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.488+0000 7f7c96dfa700 1 -- 172.21.15.5:0/1285079665 shutdown_connections 2023-03-03T06:24:58.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.488+0000 7f7c96dfa700 1 --2- 172.21.15.5:0/1285079665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c9015a750 0x7f7c9015adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.488+0000 7f7c96dfa700 1 --2- 172.21.15.5:0/1285079665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c9006b540 0x7f7c9014cd80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.488+0000 7f7c96dfa700 1 --2- 172.21.15.5:0/1285079665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c740682f0 0x7f7c7406a7a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.488+0000 7f7c96dfa700 1 --2- 172.21.15.5:0/1285079665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c900cd360 0x7f7c901f0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.488+0000 7f7c96dfa700 1 -- 172.21.15.5:0/1285079665 >> 172.21.15.5:0/1285079665 conn(0x7f7c9006ea70 msgr2=0x7f7c90159500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.488+0000 7f7c96dfa700 1 -- 172.21.15.5:0/1285079665 shutdown_connections 2023-03-03T06:24:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.488+0000 7f7c96dfa700 1 -- 172.21.15.5:0/1285079665 wait complete. 2023-03-03T06:24:58.492 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2023-03-03T06:24:58.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:24:58.601 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-03-03T06:24:58.599+0000 7f9157b16700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-03T06:24:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.625+0000 7f17742c4700 1 Processor -- start 2023-03-03T06:24:58.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.625+0000 7f17742c4700 1 -- start start 2023-03-03T06:24:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f17742c4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f176c0b1fe0 0x7f176c0cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f17742c4700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c15d4e0 con 0x7f176c15cd40 2023-03-03T06:24:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f17742c4700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c15d7c0 con 0x7f176c0cba50 2023-03-03T06:24:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f17742c4700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c15daa0 con 0x7f176c0b1fe0 2023-03-03T06:24:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f177185f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f176c0b1fe0 0x7f176c0cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f1772060700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f176c15cd40 0x7f176c0b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33444/0 (socket says 172.21.15.5:33444) 2023-03-03T06:24:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f1772060700 1 -- 172.21.15.5:0/777032827 learned_addr learned my addr 172.21.15.5:0/777032827 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f177185f700 1 -- 172.21.15.5:0/777032827 >> v1:172.21.15.191:6789/0 conn(0x7f176c0cba50 legacy=0x7f176c0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f177185f700 1 -- 172.21.15.5:0/777032827 >> v1:172.21.15.5:6789/0 conn(0x7f176c15cd40 legacy=0x7f176c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f177185f700 1 -- 172.21.15.5:0/777032827 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c15dd80 con 0x7f176c0b1fe0 2023-03-03T06:24:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f177105e700 1 -- 172.21.15.5:0/777032827 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484278150 0 0) 0x7f176c15d4e0 con 0x7f176c15cd40 2023-03-03T06:24:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f177185f700 1 --2- 172.21.15.5:0/777032827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176c0b1fe0 0x7f176c0cdf50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f175c009820 tx=0x7f175c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8f45fede3e1262 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f177105e700 1 -- 172.21.15.5:0/777032827 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c005e30 con 0x7f176c0b1fe0 2023-03-03T06:24:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.626+0000 7f177105e700 1 -- 172.21.15.5:0/777032827 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c004030 con 0x7f176c0b1fe0 2023-03-03T06:24:58.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.627+0000 7f177105e700 1 -- 172.21.15.5:0/777032827 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0043c0 con 0x7f176c0b1fe0 2023-03-03T06:24:58.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.627+0000 7f17742c4700 1 -- 172.21.15.5:0/777032827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176c0b1fe0 msgr2=0x7f176c0cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.627+0000 7f17742c4700 1 --2- 172.21.15.5:0/777032827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176c0b1fe0 0x7f176c0cdf50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f175c009820 tx=0x7f175c009b30 comp rx=0 tx=0).stop 2023-03-03T06:24:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.627+0000 7f17742c4700 1 -- 172.21.15.5:0/777032827 shutdown_connections 2023-03-03T06:24:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.627+0000 7f17742c4700 1 --2- 172.21.15.5:0/777032827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176c0b1fe0 0x7f176c0cdf50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.627+0000 7f17742c4700 1 -- 172.21.15.5:0/777032827 >> 172.21.15.5:0/777032827 conn(0x7f176c0cc8d0 msgr2=0x7f176c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.627+0000 7f17742c4700 1 -- 172.21.15.5:0/777032827 shutdown_connections 2023-03-03T06:24:58.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.627+0000 7f17742c4700 1 -- 172.21.15.5:0/777032827 wait complete. 2023-03-03T06:24:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.628+0000 7f17742c4700 1 Processor -- start 2023-03-03T06:24:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.628+0000 7f17742c4700 1 -- start start 2023-03-03T06:24:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f17742c4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f176c0b1fe0 0x7f176c0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f17742c4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176c0cba50 0x7f176c0c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f17742c4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f176c15cd40 0x7f176c151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f17742c4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0c4b60 con 0x7f176c0cba50 2023-03-03T06:24:58.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f17742c4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0c3f50 con 0x7f176c15cd40 2023-03-03T06:24:58.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f17742c4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0c4230 con 0x7f176c0b1fe0 2023-03-03T06:24:58.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f177185f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176c0cba50 0x7f176c0c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f177185f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176c0cba50 0x7f176c0c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43610/0 (socket says 172.21.15.5:43610) 2023-03-03T06:24:58.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f177185f700 1 -- 172.21.15.5:0/3055342216 learned_addr learned my addr 172.21.15.5:0/3055342216 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:58.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f177185f700 1 -- 172.21.15.5:0/3055342216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f176c0b1fe0 msgr2=0x7f176c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f177185f700 1 --2- 172.21.15.5:0/3055342216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f176c0b1fe0 0x7f176c0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f177185f700 1 -- 172.21.15.5:0/3055342216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f176c15cd40 msgr2=0x7f176c151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f177185f700 1 --2- 172.21.15.5:0/3055342216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f176c15cd40 0x7f176c151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.629+0000 7f177185f700 1 -- 172.21.15.5:0/3055342216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c009430 con 0x7f176c0cba50 2023-03-03T06:24:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.630+0000 7f177185f700 1 --2- 172.21.15.5:0/3055342216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176c0cba50 0x7f176c0c4ff0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f175c000c00 tx=0x7f175c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.630+0000 7f1762ffd700 1 -- 172.21.15.5:0/3055342216 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c011420 con 0x7f176c0cba50 2023-03-03T06:24:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.630+0000 7f1762ffd700 1 -- 172.21.15.5:0/3055342216 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c011580 con 0x7f176c0cba50 2023-03-03T06:24:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.630+0000 7f17742c4700 1 -- 172.21.15.5:0/3055342216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c0ca530 con 0x7f176c0cba50 2023-03-03T06:24:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.630+0000 7f1762ffd700 1 -- 172.21.15.5:0/3055342216 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c011930 con 0x7f176c0cba50 2023-03-03T06:24:58.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.630+0000 7f17742c4700 1 -- 172.21.15.5:0/3055342216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c15e060 con 0x7f176c0cba50 2023-03-03T06:24:58.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.631+0000 7f17742c4700 1 -- 172.21.15.5:0/3055342216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c15d110 con 0x7f176c0cba50 2023-03-03T06:24:58.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.631+0000 7f1762ffd700 1 -- 172.21.15.5:0/3055342216 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f175c00f050 con 0x7f176c0cba50 2023-03-03T06:24:58.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.631+0000 7f1762ffd700 1 --2- 172.21.15.5:0/3055342216 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f17500682f0 0x7f175006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.632+0000 7f1762ffd700 1 -- 172.21.15.5:0/3055342216 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f175c087620 con 0x7f176c0cba50 2023-03-03T06:24:58.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.632+0000 7f1772060700 1 --2- 172.21.15.5:0/3055342216 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f17500682f0 0x7f175006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.632+0000 7f1772060700 1 --2- 172.21.15.5:0/3055342216 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f17500682f0 0x7f175006a7a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1768000c00 tx=0x7f1768007a50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:58.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.636+0000 7f1762ffd700 1 -- 172.21.15.5:0/3055342216 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f175c053d40 con 0x7f176c0cba50 2023-03-03T06:24:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.830+0000 7f17742c4700 1 -- 172.21.15.5:0/3055342216 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f176c0c4ca0 con 0x7f176c0cba50 2023-03-03T06:24:58.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.831+0000 7f1762ffd700 1 -- 172.21.15.5:0/3055342216 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f176c0c4ca0 con 0x7f176c0cba50 2023-03-03T06:24:58.834 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:58.834 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:24:56.064863+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:24:53.570801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-03T06:24:53.994714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:24:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.833+0000 7f17742c4700 1 -- 172.21.15.5:0/3055342216 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f17500682f0 msgr2=0x7f175006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.833+0000 7f17742c4700 1 --2- 172.21.15.5:0/3055342216 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f17500682f0 0x7f175006a7a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1768000c00 tx=0x7f1768007a50 comp rx=0 tx=0).stop 2023-03-03T06:24:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.833+0000 7f17742c4700 1 -- 172.21.15.5:0/3055342216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176c0cba50 msgr2=0x7f176c0c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.833+0000 7f17742c4700 1 --2- 172.21.15.5:0/3055342216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176c0cba50 0x7f176c0c4ff0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f175c000c00 tx=0x7f175c004750 comp rx=0 tx=0).stop 2023-03-03T06:24:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.833+0000 7f17742c4700 1 -- 172.21.15.5:0/3055342216 shutdown_connections 2023-03-03T06:24:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.833+0000 7f17742c4700 1 --2- 172.21.15.5:0/3055342216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f176c15cd40 0x7f176c151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.833+0000 7f17742c4700 1 --2- 172.21.15.5:0/3055342216 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f17500682f0 0x7f175006a7a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.833+0000 7f17742c4700 1 --2- 172.21.15.5:0/3055342216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f176c0b1fe0 0x7f176c0c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.833+0000 7f17742c4700 1 --2- 172.21.15.5:0/3055342216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f176c0cba50 0x7f176c0c4ff0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.833+0000 7f17742c4700 1 -- 172.21.15.5:0/3055342216 >> 172.21.15.5:0/3055342216 conn(0x7f176c0cc8d0 msgr2=0x7f176c0d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.833+0000 7f17742c4700 1 -- 172.21.15.5:0/3055342216 shutdown_connections 2023-03-03T06:24:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.833+0000 7f17742c4700 1 -- 172.21.15.5:0/3055342216 wait complete. 2023-03-03T06:24:58.847 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-03T06:24:58.848 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:24:58.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.970+0000 7f4efe37b700 1 Processor -- start 2023-03-03T06:24:58.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.970+0000 7f4efe37b700 1 -- start start 2023-03-03T06:24:58.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4efe37b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4ef815a7b0 0x7f4ef806b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4efe37b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ef806ba80 0x7f4ef80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4efe37b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef80cf7e0 con 0x7f4ef815ab80 2023-03-03T06:24:58.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4efe37b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef80b3290 con 0x7f4ef815a7b0 2023-03-03T06:24:58.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4efe37b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80b2ca0 con 0x7f4ef806ba80 2023-03-03T06:24:58.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4ef77fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4ef815ab80 0x7f4ef80b36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33460/0 (socket says 172.21.15.5:33460) 2023-03-03T06:24:58.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4ef77fe700 1 -- 172.21.15.5:0/3036472739 learned_addr learned my addr 172.21.15.5:0/3036472739 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:24:58.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4ef7fff700 1 --2- 172.21.15.5:0/3036472739 >> v2:172.21.15.191:3300/0 conn(0x7f4ef815a7b0 0x7f4ef806b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311541826 0 0) 0x7f4ef80cf7e0 con 0x7f4ef815ab80 2023-03-03T06:24:58.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ee40035b0 con 0x7f4ef815ab80 2023-03-03T06:24:58.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4efc918700 1 --2- 172.21.15.5:0/3036472739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ef806ba80 0x7f4ef80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3893912524 0 0) 0x7f4ee40035b0 con 0x7f4ef815ab80 2023-03-03T06:24:58.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ef806ba80 msgr2=0x7f4ef80ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:58.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4ef6ffd700 1 --2- 172.21.15.5:0/3036472739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ef806ba80 0x7f4ef80ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 >> v2:172.21.15.191:3300/0 conn(0x7f4ef815a7b0 msgr2=0x7f4ef806b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:58.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4ef6ffd700 1 --2- 172.21.15.5:0/3036472739 >> v2:172.21.15.191:3300/0 conn(0x7f4ef815a7b0 0x7f4ef806b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80cfac0 con 0x7f4ef815ab80 2023-03-03T06:24:58.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.971+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f4ee00017f0 con 0x7f4ef815ab80 2023-03-03T06:24:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 >> v1:172.21.15.5:6789/0 conn(0x7f4ef815ab80 legacy=0x7f4ef80b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef6ffd700 1 --2- 172.21.15.5:0/3036472739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ee4003a70 0x7f4ee4003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef6ffd700 1 --2- 172.21.15.5:0/3036472739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ef806ba80 0x7f4ee4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef6ffd700 1 --2- 172.21.15.5:0/3036472739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee4004d90 0x7f4ee4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80b3290 con 0x7f4ee4004d90 2023-03-03T06:24:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80b2ca0 con 0x7f4ee4003a70 2023-03-03T06:24:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee400ba90 con 0x7f4ef806ba80 2023-03-03T06:24:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef7fff700 1 --2- 172.21.15.5:0/3036472739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ee4003a70 0x7f4ee4003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4efc918700 1 --2- 172.21.15.5:0/3036472739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee4004d90 0x7f4ee4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef77fe700 1 --2- 172.21.15.5:0/3036472739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ef806ba80 0x7f4ee4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef7fff700 1 -- 172.21.15.5:0/3036472739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ef806ba80 msgr2=0x7f4ee4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef7fff700 1 --2- 172.21.15.5:0/3036472739 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ef806ba80 0x7f4ee4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef7fff700 1 -- 172.21.15.5:0/3036472739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee4004d90 msgr2=0x7f4ee4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef7fff700 1 --2- 172.21.15.5:0/3036472739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee4004d90 0x7f4ee4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef7fff700 1 -- 172.21.15.5:0/3036472739 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee40035b0 con 0x7f4ee4003a70 2023-03-03T06:24:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4efc918700 1 --2- 172.21.15.5:0/3036472739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ee4004d90 0x7f4ee4005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:24:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.972+0000 7f4ef7fff700 1 --2- 172.21.15.5:0/3036472739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ee4003a70 0x7f4ee4003e80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009b90 tx=0x7f4ee4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73cd45e7041d28cd server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.973+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800e6c0 con 0x7f4ee4003a70 2023-03-03T06:24:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.973+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee800e820 con 0x7f4ee4003a70 2023-03-03T06:24:58.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.973+0000 7f4ef6ffd700 1 -- 172.21.15.5:0/3036472739 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800eb90 con 0x7f4ee4003a70 2023-03-03T06:24:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.973+0000 7f4efe37b700 1 -- 172.21.15.5:0/3036472739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ee4003a70 msgr2=0x7f4ee4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.973+0000 7f4efe37b700 1 --2- 172.21.15.5:0/3036472739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ee4003a70 0x7f4ee4003e80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009b90 tx=0x7f4ee4005880 comp rx=0 tx=0).stop 2023-03-03T06:24:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.973+0000 7f4efc918700 1 -- 172.21.15.5:0/3036472739 reap_dead start 2023-03-03T06:24:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.973+0000 7f4efe37b700 1 -- 172.21.15.5:0/3036472739 shutdown_connections 2023-03-03T06:24:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.973+0000 7f4efe37b700 1 -- 172.21.15.5:0/3036472739 >> 172.21.15.5:0/3036472739 conn(0x7f4ef80cc8d0 msgr2=0x7f4ef80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:58.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.973+0000 7f4efe37b700 1 -- 172.21.15.5:0/3036472739 shutdown_connections 2023-03-03T06:24:58.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.973+0000 7f4efe37b700 1 -- 172.21.15.5:0/3036472739 wait complete. 2023-03-03T06:24:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.974+0000 7f4efe37b700 1 Processor -- start 2023-03-03T06:24:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.975+0000 7f4efe37b700 1 -- start start 2023-03-03T06:24:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.975+0000 7f4efe37b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ee4003a70 0x7f4ef81f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.975+0000 7f4efe37b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ef8154d00 0x7f4ef80b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.975+0000 7f4efe37b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8155170 0x7f4ef80b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.975+0000 7f4efe37b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80c7250 con 0x7f4ef8155170 2023-03-03T06:24:58.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.975+0000 7f4efe37b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef81f2390 con 0x7f4ee4003a70 2023-03-03T06:24:58.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.975+0000 7f4efe37b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80cb080 con 0x7f4ef8154d00 2023-03-03T06:24:58.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.975+0000 7f4efc918700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8155170 0x7f4ef80b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.975+0000 7f4efc918700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8155170 0x7f4ef80b13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43632/0 (socket says 172.21.15.5:43632) 2023-03-03T06:24:58.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.975+0000 7f4efc918700 1 -- 172.21.15.5:0/427016134 learned_addr learned my addr 172.21.15.5:0/427016134 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:58.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.975+0000 7f4ef77fe700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ef8154d00 0x7f4ef80b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.975+0000 7f4ef7fff700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ee4003a70 0x7f4ef81f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.976+0000 7f4efc918700 1 -- 172.21.15.5:0/427016134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ef8154d00 msgr2=0x7f4ef80b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.976+0000 7f4efc918700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ef8154d00 0x7f4ef80b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.976+0000 7f4efc918700 1 -- 172.21.15.5:0/427016134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ee4003a70 msgr2=0x7f4ef81f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:58.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.976+0000 7f4efc918700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ee4003a70 0x7f4ef81f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:58.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.976+0000 7f4efc918700 1 -- 172.21.15.5:0/427016134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80cd5b0 con 0x7f4ef8155170 2023-03-03T06:24:58.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.976+0000 7f4efc918700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8155170 0x7f4ef80b13b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4ef815af50 tx=0x7f4ef000f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:58.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.976+0000 7f4ef4ff9700 1 -- 172.21.15.5:0/427016134 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef001c070 con 0x7f4ef8155170 2023-03-03T06:24:58.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.976+0000 7f4ef4ff9700 1 -- 172.21.15.5:0/427016134 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef000f040 con 0x7f4ef8155170 2023-03-03T06:24:58.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.976+0000 7f4efe37b700 1 -- 172.21.15.5:0/427016134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef80b2eb0 con 0x7f4ef8155170 2023-03-03T06:24:58.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.976+0000 7f4ef4ff9700 1 -- 172.21.15.5:0/427016134 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef000e040 con 0x7f4ef8155170 2023-03-03T06:24:58.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.976+0000 7f4efe37b700 1 -- 172.21.15.5:0/427016134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef80cd740 con 0x7f4ef8155170 2023-03-03T06:24:58.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.977+0000 7f4efe37b700 1 -- 172.21.15.5:0/427016134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef804e6e0 con 0x7f4ef8155170 2023-03-03T06:24:58.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.977+0000 7f4ef4ff9700 1 -- 172.21.15.5:0/427016134 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4ef000fd30 con 0x7f4ef8155170 2023-03-03T06:24:58.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.978+0000 7f4ef4ff9700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4ed80682f0 0x7f4ed806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:58.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.978+0000 7f4ef7fff700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4ed80682f0 0x7f4ed806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:58.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.978+0000 7f4ef4ff9700 1 -- 172.21.15.5:0/427016134 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4ef0085e10 con 0x7f4ef8155170 2023-03-03T06:24:58.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.979+0000 7f4ef7fff700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4ed80682f0 0x7f4ed806a7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80090b0 tx=0x7f4ee8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:58.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:58.982+0000 7f4ef4ff9700 1 -- 172.21.15.5:0/427016134 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4ef00524b0 con 0x7f4ef8155170 2023-03-03T06:24:59.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.175+0000 7f4efe37b700 1 -- 172.21.15.5:0/427016134 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ef80b41d0 con 0x7f4ed80682f0 2023-03-03T06:24:59.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.183+0000 7f4ef4ff9700 1 -- 172.21.15.5:0/427016134 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296430 (secure 0 0 0) 0x7f4ef80b41d0 con 0x7f4ed80682f0 2023-03-03T06:24:59.188 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:59.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.186+0000 7f4efe37b700 1 -- 172.21.15.5:0/427016134 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4ed80682f0 msgr2=0x7f4ed806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:59.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.186+0000 7f4efe37b700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4ed80682f0 0x7f4ed806a7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80090b0 tx=0x7f4ee8008030 comp rx=0 tx=0).stop 2023-03-03T06:24:59.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.186+0000 7f4efe37b700 1 -- 172.21.15.5:0/427016134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8155170 msgr2=0x7f4ef80b13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:59.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.186+0000 7f4efe37b700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8155170 0x7f4ef80b13b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4ef815af50 tx=0x7f4ef000f490 comp rx=0 tx=0).stop 2023-03-03T06:24:59.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.186+0000 7f4efe37b700 1 -- 172.21.15.5:0/427016134 shutdown_connections 2023-03-03T06:24:59.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.186+0000 7f4efe37b700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ef8155170 0x7f4ef80b13b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.186+0000 7f4efe37b700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ee4003a70 0x7f4ef81f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.186+0000 7f4efe37b700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4ed80682f0 0x7f4ed806a7a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.186+0000 7f4efe37b700 1 --2- 172.21.15.5:0/427016134 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ef8154d00 0x7f4ef80b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.186+0000 7f4efe37b700 1 -- 172.21.15.5:0/427016134 >> 172.21.15.5:0/427016134 conn(0x7f4ef80cc8d0 msgr2=0x7f4ef81587d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:59.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.186+0000 7f4efe37b700 1 -- 172.21.15.5:0/427016134 shutdown_connections 2023-03-03T06:24:59.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.186+0000 7f4efe37b700 1 -- 172.21.15.5:0/427016134 wait complete. 2023-03-03T06:24:59.192 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:24:59.201 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-03-03T06:24:57.478358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69792,"kb_used_data":4384,"kb_used_omap":0,"kb_used_meta":65344,"kb_avail":754904928,"statfs":{"total":773094113280,"available":773022646272,"internally_reserved":0,"allocated":4489216,"data_stored":2622214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66912256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000653"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-03-03T06:24:47.784715+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:24:47.784715+0000","last_peered":"2023-03-03T06:24:47.784715+0000","last_clean":"2023-03-03T06:24:47.784715+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:24:47.784715+0000","last_undegraded":"2023-03-03T06:24:47.784715+0000","last_fullsized":"2023-03-03T06:24:47.784715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-03-03T06:24:47.891505+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:24:47.891505+0000","last_peered":"2023-03-03T06:24:47.891505+0000","last_clean":"2023-03-03T06:24:47.891505+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:24:47.891505+0000","last_undegraded":"2023-03-03T06:24:47.891505+0000","last_fullsized":"2023-03-03T06:24:47.891505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-03-03T06:24:47.893699+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:24:47.893699+0000","last_peered":"2023-03-03T06:24:47.893699+0000","last_clean":"2023-03-03T06:24:47.893699+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:24:47.893699+0000","last_undegraded":"2023-03-03T06:24:47.893699+0000","last_fullsized":"2023-03-03T06:24:47.893699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":176,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-03-03T06:24:47.890155+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:24:47.890155+0000","last_peered":"2023-03-03T06:24:47.890155+0000","last_clean":"2023-03-03T06:24:47.890155+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:24:47.890155+0000","last_undegraded":"2023-03-03T06:24:47.890155+0000","last_fullsized":"2023-03-03T06:24:47.890155+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-03-03T06:24:47.890158+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:24:47.890158+0000","last_peered":"2023-03-03T06:24:47.890158+0000","last_clean":"2023-03-03T06:24:47.890158+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:24:47.890158+0000","last_undegraded":"2023-03-03T06:24:47.890158+0000","last_fullsized":"2023-03-03T06:24:47.890158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-03-03T06:24:47.890147+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:24:47.890147+0000","last_peered":"2023-03-03T06:24:47.890147+0000","last_clean":"2023-03-03T06:24:47.890147+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:24:47.890147+0000","last_undegraded":"2023-03-03T06:24:47.890147+0000","last_fullsized":"2023-03-03T06:24:47.890147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-03-03T06:24:47.786620+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:24:47.786620+0000","last_peered":"2023-03-03T06:24:47.786620+0000","last_clean":"2023-03-03T06:24:47.786620+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:24:47.786620+0000","last_undegraded":"2023-03-03T06:24:47.786620+0000","last_fullsized":"2023-03-03T06:24:47.786620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-03-03T06:24:47.789140+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:24:47.789140+0000","last_peered":"2023-03-03T06:24:47.789140+0000","last_clean":"2023-03-03T06:24:47.789140+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:24:47.789140+0000","last_undegraded":"2023-03-03T06:24:47.789140+0000","last_fullsized":"2023-03-03T06:24:47.789140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:54.609707+0000","last_change":"2023-03-03T06:24:54.609707+0000","last_active":"2023-03-03T06:24:54.609707+0000","last_peered":"2023-03-03T06:24:54.609707+0000","last_clean":"2023-03-03T06:24:54.609707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:54.609707+0000","last_undegraded":"2023-03-03T06:24:54.609707+0000","last_fullsized":"2023-03-03T06:24:54.609707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:24:53.602540+0000","last_change":"2023-03-03T06:24:53.602540+0000","last_active":"2023-03-03T06:24:53.602540+0000","last_peered":"2023-03-03T06:24:53.602540+0000","last_clean":"2023-03-03T06:24:53.602540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:24:53.602540+0000","last_undegraded":"2023-03-03T06:24:53.602540+0000","last_fullsized":"2023-03-03T06:24:53.602540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-03-03T06:24:47.789946+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:24:47.789946+0000","last_peered":"2023-03-03T06:24:47.789946+0000","last_clean":"2023-03-03T06:24:47.789946+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:24:47.789946+0000","last_undegraded":"2023-03-03T06:24:47.789946+0000","last_fullsized":"2023-03-03T06:24:47.789946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9568,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362272,"statfs":{"total":96636764160,"available":96626966528,"internally_reserved":0,"allocated":1007616,"data_stored":770793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.376}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.63}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8348,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363492,"statfs":{"total":96636764160,"available":96628215808,"internally_reserved":0,"allocated":413696,"data_stored":180425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.377}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.50700000000000001}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.44700000000000001}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9568,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362272,"statfs":{"total":96636764160,"available":96626966528,"internally_reserved":0,"allocated":1007616,"data_stored":770793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.40200000000000002}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.309}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41899999999999998}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.50800000000000001}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.443}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8472,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363368,"statfs":{"total":96636764160,"available":96628088832,"internally_reserved":0,"allocated":409600,"data_stored":179464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.27500000000000002}]},{"osd":3,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.371}]},{"osd":4,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.437},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.499},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.47599999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.54000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8348,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363492,"statfs":{"total":96636764160,"available":96628215808,"internally_reserved":0,"allocated":413696,"data_stored":180425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.254},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.39800000000000002}]},{"osd":1,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":7.4820000000000002,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.33500000000000002}]},{"osd":3,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.32300000000000001}]},{"osd":4,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.501},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.437}]},{"osd":6,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.44600000000000001}]},{"osd":7,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.53500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8476,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363364,"statfs":{"total":96636764160,"available":96628084736,"internally_reserved":0,"allocated":413696,"data_stored":180425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.29499999999999998}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.312}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.34699999999999998}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63100000000000001}]},{"osd":5,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.65000000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.59399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8604,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363236,"statfs":{"total":96636764160,"available":96627953664,"internally_reserved":0,"allocated":413696,"data_stored":180425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.439}]},{"osd":2,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.502},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.39000000000000001}]},{"osd":5,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.65400000000000003}]},{"osd":7,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.67100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8408,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363432,"statfs":{"total":96636764160,"available":96628154368,"internally_reserved":0,"allocated":409600,"data_stored":179464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.627}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.64200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:24:59.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:24:59.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.363+0000 7f254de95700 1 Processor -- start 2023-03-03T06:24:59.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.363+0000 7f254de95700 1 -- start start 2023-03-03T06:24:59.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.364+0000 7f254de95700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f254815cd40 0x7f25480b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:59.368 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.364+0000 7f254de95700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25480cef60 0x7f25480b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.364+0000 7f254de95700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254815d4e0 con 0x7f25480cba50 2023-03-03T06:24:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.364+0000 7f254de95700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254815d7c0 con 0x7f25480cef60 2023-03-03T06:24:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.364+0000 7f254de95700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254815daa0 con 0x7f254815cd40 2023-03-03T06:24:59.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.364+0000 7f2547fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25480cef60 0x7f25480b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:59.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.364+0000 7f2547fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f25480cef60 0x7f25480b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43640/0 (socket says 172.21.15.5:43640) 2023-03-03T06:24:59.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.364+0000 7f2547fff700 1 -- 172.21.15.5:0/1584987385 learned_addr learned my addr 172.21.15.5:0/1584987385 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:59.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.365+0000 7f25477fe700 1 --2- 172.21.15.5:0/1584987385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f254815cd40 0x7f25480b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:59.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.365+0000 7f2547fff700 1 -- 172.21.15.5:0/1584987385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f254815cd40 msgr2=0x7f25480b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:59.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.365+0000 7f2547fff700 1 --2- 172.21.15.5:0/1584987385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f254815cd40 0x7f25480b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.365+0000 7f2547fff700 1 -- 172.21.15.5:0/1584987385 >> v1:172.21.15.191:6789/0 conn(0x7f25480cba50 legacy=0x7f2548160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.365+0000 7f2547fff700 1 -- 172.21.15.5:0/1584987385 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254815dd80 con 0x7f25480cef60 2023-03-03T06:24:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.365+0000 7f2547fff700 1 --2- 172.21.15.5:0/1584987385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25480cef60 0x7f25480b1e10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2540009e50 tx=0x7f254000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310c8b3b98e0674f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.365+0000 7f25467fc700 1 -- 172.21.15.5:0/1584987385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254000e070 con 0x7f25480cef60 2023-03-03T06:24:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.365+0000 7f25467fc700 1 -- 172.21.15.5:0/1584987385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2540003a20 con 0x7f25480cef60 2023-03-03T06:24:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.365+0000 7f25467fc700 1 -- 172.21.15.5:0/1584987385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2540003dd0 con 0x7f25480cef60 2023-03-03T06:24:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.366+0000 7f254de95700 1 -- 172.21.15.5:0/1584987385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25480cef60 msgr2=0x7f25480b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:59.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.366+0000 7f254de95700 1 --2- 172.21.15.5:0/1584987385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25480cef60 0x7f25480b1e10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2540009e50 tx=0x7f254000b330 comp rx=0 tx=0).stop 2023-03-03T06:24:59.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.366+0000 7f254de95700 1 -- 172.21.15.5:0/1584987385 shutdown_connections 2023-03-03T06:24:59.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.366+0000 7f254de95700 1 --2- 172.21.15.5:0/1584987385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25480cef60 0x7f25480b1e10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.366+0000 7f254de95700 1 --2- 172.21.15.5:0/1584987385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f254815cd40 0x7f25480b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.366+0000 7f254de95700 1 -- 172.21.15.5:0/1584987385 >> 172.21.15.5:0/1584987385 conn(0x7f25480cc8d0 msgr2=0x7f25480cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:59.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.366+0000 7f254de95700 1 -- 172.21.15.5:0/1584987385 shutdown_connections 2023-03-03T06:24:59.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.366+0000 7f254de95700 1 -- 172.21.15.5:0/1584987385 wait complete. 2023-03-03T06:24:59.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.367+0000 7f254de95700 1 Processor -- start 2023-03-03T06:24:59.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.367+0000 7f254de95700 1 -- start start 2023-03-03T06:24:59.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f254de95700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25480cba50 0x7f2548151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:59.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f254de95700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25480cef60 0x7f254815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:59.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f254de95700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f254815cd40 0x7f254815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:59.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f254de95700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25481f70f0 con 0x7f25480cef60 2023-03-03T06:24:59.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f254de95700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25480c8020 con 0x7f254815cd40 2023-03-03T06:24:59.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f254de95700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2548152490 con 0x7f25480cba50 2023-03-03T06:24:59.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f2546ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25480cef60 0x7f254815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:59.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f2546ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25480cef60 0x7f254815aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43644/0 (socket says 172.21.15.5:43644) 2023-03-03T06:24:59.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f2546ffd700 1 -- 172.21.15.5:0/3367851059 learned_addr learned my addr 172.21.15.5:0/3367851059 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:59.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f25477fe700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25480cba50 0x7f2548151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:59.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f2547fff700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f254815cd40 0x7f254815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:59.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f2546ffd700 1 -- 172.21.15.5:0/3367851059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25480cba50 msgr2=0x7f2548151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:59.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f2546ffd700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25480cba50 0x7f2548151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f2546ffd700 1 -- 172.21.15.5:0/3367851059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f254815cd40 msgr2=0x7f254815afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:59.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f2546ffd700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f254815cd40 0x7f254815afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f2546ffd700 1 -- 172.21.15.5:0/3367851059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2540009b30 con 0x7f25480cef60 2023-03-03T06:24:59.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.368+0000 7f2546ffd700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25480cef60 0x7f254815aa70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f253c00c4e0 tx=0x7f253c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:59.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.369+0000 7f252ffff700 1 -- 172.21.15.5:0/3367851059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c011790 con 0x7f25480cef60 2023-03-03T06:24:59.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.369+0000 7f252ffff700 1 -- 172.21.15.5:0/3367851059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253c0118f0 con 0x7f25480cef60 2023-03-03T06:24:59.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.369+0000 7f254de95700 1 -- 172.21.15.5:0/3367851059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25480ca530 con 0x7f25480cef60 2023-03-03T06:24:59.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.369+0000 7f252ffff700 1 -- 172.21.15.5:0/3367851059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c011ca0 con 0x7f25480cef60 2023-03-03T06:24:59.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.369+0000 7f254de95700 1 -- 172.21.15.5:0/3367851059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254815e060 con 0x7f25480cef60 2023-03-03T06:24:59.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.370+0000 7f254de95700 1 -- 172.21.15.5:0/3367851059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254815d110 con 0x7f25480cef60 2023-03-03T06:24:59.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.370+0000 7f252ffff700 1 -- 172.21.15.5:0/3367851059 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f253c010050 con 0x7f25480cef60 2023-03-03T06:24:59.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.371+0000 7f252ffff700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f25340682f0 0x7f253406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:59.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.371+0000 7f252ffff700 1 -- 172.21.15.5:0/3367851059 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f253c085690 con 0x7f25480cef60 2023-03-03T06:24:59.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.371+0000 7f25477fe700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f25340682f0 0x7f253406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:59.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.371+0000 7f25477fe700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f25340682f0 0x7f253406a7a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2538006fd0 tx=0x7f2538008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:59.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.375+0000 7f252ffff700 1 -- 172.21.15.5:0/3367851059 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f253c051d50 con 0x7f25480cef60 2023-03-03T06:24:59.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.565+0000 7f254de95700 1 -- 172.21.15.5:0/3367851059 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f254804e6e0 con 0x7f25340682f0 2023-03-03T06:24:59.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.573+0000 7f252ffff700 1 -- 172.21.15.5:0/3367851059 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311167 (secure 0 0 0) 0x7f254804e6e0 con 0x7f25340682f0 2023-03-03T06:24:59.579 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:24:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.576+0000 7f254de95700 1 -- 172.21.15.5:0/3367851059 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f25340682f0 msgr2=0x7f253406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.576+0000 7f254de95700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f25340682f0 0x7f253406a7a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2538006fd0 tx=0x7f2538008040 comp rx=0 tx=0).stop 2023-03-03T06:24:59.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.576+0000 7f254de95700 1 -- 172.21.15.5:0/3367851059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25480cef60 msgr2=0x7f254815aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:59.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.576+0000 7f254de95700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25480cef60 0x7f254815aa70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f253c00c4e0 tx=0x7f253c00c7f0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.577+0000 7f254de95700 1 -- 172.21.15.5:0/3367851059 shutdown_connections 2023-03-03T06:24:59.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.577+0000 7f254de95700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f254815cd40 0x7f254815afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.577+0000 7f254de95700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f25340682f0 0x7f253406a7a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.577+0000 7f254de95700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f25480cba50 0x7f2548151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.577+0000 7f254de95700 1 --2- 172.21.15.5:0/3367851059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25480cef60 0x7f254815aa70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.577+0000 7f254de95700 1 -- 172.21.15.5:0/3367851059 >> 172.21.15.5:0/3367851059 conn(0x7f25480cc8d0 msgr2=0x7f254815f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:59.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.577+0000 7f254de95700 1 -- 172.21.15.5:0/3367851059 shutdown_connections 2023-03-03T06:24:59.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.577+0000 7f254de95700 1 -- 172.21.15.5:0/3367851059 wait complete. 2023-03-03T06:24:59.583 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:24:59.591 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-03-03T06:24:59.478671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71508,"kb_used_data":4820,"kb_used_omap":0,"kb_used_meta":66624,"kb_avail":754903212,"statfs":{"total":773094113280,"available":773020889088,"internally_reserved":0,"allocated":4935680,"data_stored":2842709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68222976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.868682"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707756+0000","last_change":"2023-03-03T06:24:55.089238+0000","last_active":"2023-03-03T06:24:56.707756+0000","last_peered":"2023-03-03T06:24:56.707756+0000","last_clean":"2023-03-03T06:24:56.707756+0000","last_became_active":"2023-03-03T06:24:55.088947+0000","last_became_peered":"2023-03-03T06:24:55.088947+0000","last_unstale":"2023-03-03T06:24:56.707756+0000","last_undegraded":"2023-03-03T06:24:56.707756+0000","last_fullsized":"2023-03-03T06:24:56.707756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:03:47.774571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.311509+0000","last_change":"2023-03-03T06:24:55.101070+0000","last_active":"2023-03-03T06:24:56.311509+0000","last_peered":"2023-03-03T06:24:56.311509+0000","last_clean":"2023-03-03T06:24:56.311509+0000","last_became_active":"2023-03-03T06:24:55.100809+0000","last_became_peered":"2023-03-03T06:24:55.100809+0000","last_unstale":"2023-03-03T06:24:56.311509+0000","last_undegraded":"2023-03-03T06:24:56.311509+0000","last_fullsized":"2023-03-03T06:24:56.311509+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:49:17.172122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076462+0000","last_change":"2023-03-03T06:24:55.078489+0000","last_active":"2023-03-03T06:24:56.076462+0000","last_peered":"2023-03-03T06:24:56.076462+0000","last_clean":"2023-03-03T06:24:56.076462+0000","last_became_active":"2023-03-03T06:24:55.078187+0000","last_became_peered":"2023-03-03T06:24:55.078187+0000","last_unstale":"2023-03-03T06:24:56.076462+0000","last_undegraded":"2023-03-03T06:24:56.076462+0000","last_fullsized":"2023-03-03T06:24:56.076462+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:21:44.481430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707729+0000","last_change":"2023-03-03T06:24:55.085241+0000","last_active":"2023-03-03T06:24:56.707729+0000","last_peered":"2023-03-03T06:24:56.707729+0000","last_clean":"2023-03-03T06:24:56.707729+0000","last_became_active":"2023-03-03T06:24:55.084980+0000","last_became_peered":"2023-03-03T06:24:55.084980+0000","last_unstale":"2023-03-03T06:24:56.707729+0000","last_undegraded":"2023-03-03T06:24:56.707729+0000","last_fullsized":"2023-03-03T06:24:56.707729+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:50:11.212549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.311338+0000","last_change":"2023-03-03T06:24:55.101156+0000","last_active":"2023-03-03T06:24:56.311338+0000","last_peered":"2023-03-03T06:24:56.311338+0000","last_clean":"2023-03-03T06:24:56.311338+0000","last_became_active":"2023-03-03T06:24:55.100869+0000","last_became_peered":"2023-03-03T06:24:55.100869+0000","last_unstale":"2023-03-03T06:24:56.311338+0000","last_undegraded":"2023-03-03T06:24:56.311338+0000","last_fullsized":"2023-03-03T06:24:56.311338+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:37:55.230562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076629+0000","last_change":"2023-03-03T06:24:55.088429+0000","last_active":"2023-03-03T06:24:56.076629+0000","last_peered":"2023-03-03T06:24:56.076629+0000","last_clean":"2023-03-03T06:24:56.076629+0000","last_became_active":"2023-03-03T06:24:55.086682+0000","last_became_peered":"2023-03-03T06:24:55.086682+0000","last_unstale":"2023-03-03T06:24:56.076629+0000","last_undegraded":"2023-03-03T06:24:56.076629+0000","last_fullsized":"2023-03-03T06:24:56.076629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:34:06.708494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707195+0000","last_change":"2023-03-03T06:24:55.094861+0000","last_active":"2023-03-03T06:24:56.707195+0000","last_peered":"2023-03-03T06:24:56.707195+0000","last_clean":"2023-03-03T06:24:56.707195+0000","last_became_active":"2023-03-03T06:24:55.094560+0000","last_became_peered":"2023-03-03T06:24:55.094560+0000","last_unstale":"2023-03-03T06:24:56.707195+0000","last_undegraded":"2023-03-03T06:24:56.707195+0000","last_fullsized":"2023-03-03T06:24:56.707195+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:42:12.105830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.706933+0000","last_change":"2023-03-03T06:24:55.098688+0000","last_active":"2023-03-03T06:24:56.706933+0000","last_peered":"2023-03-03T06:24:56.706933+0000","last_clean":"2023-03-03T06:24:56.706933+0000","last_became_active":"2023-03-03T06:24:55.098447+0000","last_became_peered":"2023-03-03T06:24:55.098447+0000","last_unstale":"2023-03-03T06:24:56.706933+0000","last_undegraded":"2023-03-03T06:24:56.706933+0000","last_fullsized":"2023-03-03T06:24:56.706933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:36:18.927173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707656+0000","last_change":"2023-03-03T06:24:55.086075+0000","last_active":"2023-03-03T06:24:56.707656+0000","last_peered":"2023-03-03T06:24:56.707656+0000","last_clean":"2023-03-03T06:24:56.707656+0000","last_became_active":"2023-03-03T06:24:55.085837+0000","last_became_peered":"2023-03-03T06:24:55.085837+0000","last_unstale":"2023-03-03T06:24:56.707656+0000","last_undegraded":"2023-03-03T06:24:56.707656+0000","last_fullsized":"2023-03-03T06:24:56.707656+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:14:57.567536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707588+0000","last_change":"2023-03-03T06:24:55.097982+0000","last_active":"2023-03-03T06:24:56.707588+0000","last_peered":"2023-03-03T06:24:56.707588+0000","last_clean":"2023-03-03T06:24:56.707588+0000","last_became_active":"2023-03-03T06:24:55.097722+0000","last_became_peered":"2023-03-03T06:24:55.097722+0000","last_unstale":"2023-03-03T06:24:56.707588+0000","last_undegraded":"2023-03-03T06:24:56.707588+0000","last_fullsized":"2023-03-03T06:24:56.707588+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:38:38.773414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707679+0000","last_change":"2023-03-03T06:24:55.086207+0000","last_active":"2023-03-03T06:24:56.707679+0000","last_peered":"2023-03-03T06:24:56.707679+0000","last_clean":"2023-03-03T06:24:56.707679+0000","last_became_active":"2023-03-03T06:24:55.085931+0000","last_became_peered":"2023-03-03T06:24:55.085931+0000","last_unstale":"2023-03-03T06:24:56.707679+0000","last_undegraded":"2023-03-03T06:24:56.707679+0000","last_fullsized":"2023-03-03T06:24:56.707679+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:02.920859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.311487+0000","last_change":"2023-03-03T06:24:55.080383+0000","last_active":"2023-03-03T06:24:56.311487+0000","last_peered":"2023-03-03T06:24:56.311487+0000","last_clean":"2023-03-03T06:24:56.311487+0000","last_became_active":"2023-03-03T06:24:55.080109+0000","last_became_peered":"2023-03-03T06:24:55.080109+0000","last_unstale":"2023-03-03T06:24:56.311487+0000","last_undegraded":"2023-03-03T06:24:56.311487+0000","last_fullsized":"2023-03-03T06:24:56.311487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:22:28.545031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.706821+0000","last_change":"2023-03-03T06:24:55.096998+0000","last_active":"2023-03-03T06:24:56.706821+0000","last_peered":"2023-03-03T06:24:56.706821+0000","last_clean":"2023-03-03T06:24:56.706821+0000","last_became_active":"2023-03-03T06:24:55.096753+0000","last_became_peered":"2023-03-03T06:24:55.096753+0000","last_unstale":"2023-03-03T06:24:56.706821+0000","last_undegraded":"2023-03-03T06:24:56.706821+0000","last_fullsized":"2023-03-03T06:24:56.706821+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:51:01.296571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707184+0000","last_change":"2023-03-03T06:24:55.093879+0000","last_active":"2023-03-03T06:24:56.707184+0000","last_peered":"2023-03-03T06:24:56.707184+0000","last_clean":"2023-03-03T06:24:56.707184+0000","last_became_active":"2023-03-03T06:24:55.085993+0000","last_became_peered":"2023-03-03T06:24:55.085993+0000","last_unstale":"2023-03-03T06:24:56.707184+0000","last_undegraded":"2023-03-03T06:24:56.707184+0000","last_fullsized":"2023-03-03T06:24:56.707184+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:59:53.445975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076388+0000","last_change":"2023-03-03T06:24:55.089145+0000","last_active":"2023-03-03T06:24:56.076388+0000","last_peered":"2023-03-03T06:24:56.076388+0000","last_clean":"2023-03-03T06:24:56.076388+0000","last_became_active":"2023-03-03T06:24:55.086973+0000","last_became_peered":"2023-03-03T06:24:55.086973+0000","last_unstale":"2023-03-03T06:24:56.076388+0000","last_undegraded":"2023-03-03T06:24:56.076388+0000","last_fullsized":"2023-03-03T06:24:56.076388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:37:27.640262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.706998+0000","last_change":"2023-03-03T06:24:55.086424+0000","last_active":"2023-03-03T06:24:56.706998+0000","last_peered":"2023-03-03T06:24:56.706998+0000","last_clean":"2023-03-03T06:24:56.706998+0000","last_became_active":"2023-03-03T06:24:55.086065+0000","last_became_peered":"2023-03-03T06:24:55.086065+0000","last_unstale":"2023-03-03T06:24:56.706998+0000","last_undegraded":"2023-03-03T06:24:56.706998+0000","last_fullsized":"2023-03-03T06:24:56.706998+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:12.906507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076825+0000","last_change":"2023-03-03T06:24:55.077263+0000","last_active":"2023-03-03T06:24:56.076825+0000","last_peered":"2023-03-03T06:24:56.076825+0000","last_clean":"2023-03-03T06:24:56.076825+0000","last_became_active":"2023-03-03T06:24:55.076386+0000","last_became_peered":"2023-03-03T06:24:55.076386+0000","last_unstale":"2023-03-03T06:24:56.076825+0000","last_undegraded":"2023-03-03T06:24:56.076825+0000","last_fullsized":"2023-03-03T06:24:56.076825+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:34:06.708494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076848+0000","last_change":"2023-03-03T06:24:55.087374+0000","last_active":"2023-03-03T06:24:56.076848+0000","last_peered":"2023-03-03T06:24:56.076848+0000","last_clean":"2023-03-03T06:24:56.076848+0000","last_became_active":"2023-03-03T06:24:55.087098+0000","last_became_peered":"2023-03-03T06:24:55.087098+0000","last_unstale":"2023-03-03T06:24:56.076848+0000","last_undegraded":"2023-03-03T06:24:56.076848+0000","last_fullsized":"2023-03-03T06:24:56.076848+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:58:33.242195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707330+0000","last_change":"2023-03-03T06:24:55.100487+0000","last_active":"2023-03-03T06:24:56.707330+0000","last_peered":"2023-03-03T06:24:56.707330+0000","last_clean":"2023-03-03T06:24:56.707330+0000","last_became_active":"2023-03-03T06:24:55.100243+0000","last_became_peered":"2023-03-03T06:24:55.100243+0000","last_unstale":"2023-03-03T06:24:56.707330+0000","last_undegraded":"2023-03-03T06:24:56.707330+0000","last_fullsized":"2023-03-03T06:24:56.707330+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:48:29.128508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.706876+0000","last_change":"2023-03-03T06:24:55.101313+0000","last_active":"2023-03-03T06:24:56.706876+0000","last_peered":"2023-03-03T06:24:56.706876+0000","last_clean":"2023-03-03T06:24:56.706876+0000","last_became_active":"2023-03-03T06:24:55.101005+0000","last_became_peered":"2023-03-03T06:24:55.101005+0000","last_unstale":"2023-03-03T06:24:56.706876+0000","last_undegraded":"2023-03-03T06:24:56.706876+0000","last_fullsized":"2023-03-03T06:24:56.706876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:53:04.068342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076503+0000","last_change":"2023-03-03T06:24:55.096462+0000","last_active":"2023-03-03T06:24:56.076503+0000","last_peered":"2023-03-03T06:24:56.076503+0000","last_clean":"2023-03-03T06:24:56.076503+0000","last_became_active":"2023-03-03T06:24:55.089830+0000","last_became_peered":"2023-03-03T06:24:55.089830+0000","last_unstale":"2023-03-03T06:24:56.076503+0000","last_undegraded":"2023-03-03T06:24:56.076503+0000","last_fullsized":"2023-03-03T06:24:56.076503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:38:38.773414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707239+0000","last_change":"2023-03-03T06:24:55.094225+0000","last_active":"2023-03-03T06:24:56.707239+0000","last_peered":"2023-03-03T06:24:56.707239+0000","last_clean":"2023-03-03T06:24:56.707239+0000","last_became_active":"2023-03-03T06:24:55.085637+0000","last_became_peered":"2023-03-03T06:24:55.085637+0000","last_unstale":"2023-03-03T06:24:56.707239+0000","last_undegraded":"2023-03-03T06:24:56.707239+0000","last_fullsized":"2023-03-03T06:24:56.707239+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:10:12.240309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707885+0000","last_change":"2023-03-03T06:24:55.085893+0000","last_active":"2023-03-03T06:24:56.707885+0000","last_peered":"2023-03-03T06:24:56.707885+0000","last_clean":"2023-03-03T06:24:56.707885+0000","last_became_active":"2023-03-03T06:24:55.085488+0000","last_became_peered":"2023-03-03T06:24:55.085488+0000","last_unstale":"2023-03-03T06:24:56.707885+0000","last_undegraded":"2023-03-03T06:24:56.707885+0000","last_fullsized":"2023-03-03T06:24:56.707885+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:03:39.937166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707033+0000","last_change":"2023-03-03T06:24:55.089709+0000","last_active":"2023-03-03T06:24:56.707033+0000","last_peered":"2023-03-03T06:24:56.707033+0000","last_clean":"2023-03-03T06:24:56.707033+0000","last_became_active":"2023-03-03T06:24:55.089402+0000","last_became_peered":"2023-03-03T06:24:55.089402+0000","last_unstale":"2023-03-03T06:24:56.707033+0000","last_undegraded":"2023-03-03T06:24:56.707033+0000","last_fullsized":"2023-03-03T06:24:56.707033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:56:46.318037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707487+0000","last_change":"2023-03-03T06:24:55.088702+0000","last_active":"2023-03-03T06:24:56.707487+0000","last_peered":"2023-03-03T06:24:56.707487+0000","last_clean":"2023-03-03T06:24:56.707487+0000","last_became_active":"2023-03-03T06:24:55.086176+0000","last_became_peered":"2023-03-03T06:24:55.086176+0000","last_unstale":"2023-03-03T06:24:56.707487+0000","last_undegraded":"2023-03-03T06:24:56.707487+0000","last_fullsized":"2023-03-03T06:24:56.707487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:45:49.677873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707385+0000","last_change":"2023-03-03T06:24:55.087938+0000","last_active":"2023-03-03T06:24:56.707385+0000","last_peered":"2023-03-03T06:24:56.707385+0000","last_clean":"2023-03-03T06:24:56.707385+0000","last_became_active":"2023-03-03T06:24:55.087661+0000","last_became_peered":"2023-03-03T06:24:55.087661+0000","last_unstale":"2023-03-03T06:24:56.707385+0000","last_undegraded":"2023-03-03T06:24:56.707385+0000","last_fullsized":"2023-03-03T06:24:56.707385+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:04:34.559885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076709+0000","last_change":"2023-03-03T06:24:55.075693+0000","last_active":"2023-03-03T06:24:56.076709+0000","last_peered":"2023-03-03T06:24:56.076709+0000","last_clean":"2023-03-03T06:24:56.076709+0000","last_became_active":"2023-03-03T06:24:55.075384+0000","last_became_peered":"2023-03-03T06:24:55.075384+0000","last_unstale":"2023-03-03T06:24:56.076709+0000","last_undegraded":"2023-03-03T06:24:56.076709+0000","last_fullsized":"2023-03-03T06:24:56.076709+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:37:27.640262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.311298+0000","last_change":"2023-03-03T06:24:55.080262+0000","last_active":"2023-03-03T06:24:56.311298+0000","last_peered":"2023-03-03T06:24:56.311298+0000","last_clean":"2023-03-03T06:24:56.311298+0000","last_became_active":"2023-03-03T06:24:55.079754+0000","last_became_peered":"2023-03-03T06:24:55.079754+0000","last_unstale":"2023-03-03T06:24:56.311298+0000","last_undegraded":"2023-03-03T06:24:56.311298+0000","last_fullsized":"2023-03-03T06:24:56.311298+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:23:28.992587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707631+0000","last_change":"2023-03-03T06:24:55.084467+0000","last_active":"2023-03-03T06:24:56.707631+0000","last_peered":"2023-03-03T06:24:56.707631+0000","last_clean":"2023-03-03T06:24:56.707631+0000","last_became_active":"2023-03-03T06:24:55.084150+0000","last_became_peered":"2023-03-03T06:24:55.084150+0000","last_unstale":"2023-03-03T06:24:56.707631+0000","last_undegraded":"2023-03-03T06:24:56.707631+0000","last_fullsized":"2023-03-03T06:24:56.707631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:51:01.296571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076374+0000","last_change":"2023-03-03T06:24:55.082460+0000","last_active":"2023-03-03T06:24:56.076374+0000","last_peered":"2023-03-03T06:24:56.076374+0000","last_clean":"2023-03-03T06:24:56.076374+0000","last_became_active":"2023-03-03T06:24:55.082195+0000","last_became_peered":"2023-03-03T06:24:55.082195+0000","last_unstale":"2023-03-03T06:24:56.076374+0000","last_undegraded":"2023-03-03T06:24:56.076374+0000","last_fullsized":"2023-03-03T06:24:56.076374+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:10:35.746778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076400+0000","last_change":"2023-03-03T06:24:55.083329+0000","last_active":"2023-03-03T06:24:56.076400+0000","last_peered":"2023-03-03T06:24:56.076400+0000","last_clean":"2023-03-03T06:24:56.076400+0000","last_became_active":"2023-03-03T06:24:55.083042+0000","last_became_peered":"2023-03-03T06:24:55.083042+0000","last_unstale":"2023-03-03T06:24:56.076400+0000","last_undegraded":"2023-03-03T06:24:56.076400+0000","last_fullsized":"2023-03-03T06:24:56.076400+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:02.920859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.706760+0000","last_change":"2023-03-03T06:24:55.081627+0000","last_active":"2023-03-03T06:24:56.706760+0000","last_peered":"2023-03-03T06:24:56.706760+0000","last_clean":"2023-03-03T06:24:56.706760+0000","last_became_active":"2023-03-03T06:24:55.081328+0000","last_became_peered":"2023-03-03T06:24:55.081328+0000","last_unstale":"2023-03-03T06:24:56.706760+0000","last_undegraded":"2023-03-03T06:24:56.706760+0000","last_fullsized":"2023-03-03T06:24:56.706760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:05:49.487479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.073844+0000","last_change":"2023-03-03T06:24:55.088128+0000","last_active":"2023-03-03T06:24:56.073844+0000","last_peered":"2023-03-03T06:24:56.073844+0000","last_clean":"2023-03-03T06:24:56.073844+0000","last_became_active":"2023-03-03T06:24:55.087750+0000","last_became_peered":"2023-03-03T06:24:55.087750+0000","last_unstale":"2023-03-03T06:24:56.073844+0000","last_undegraded":"2023-03-03T06:24:56.073844+0000","last_fullsized":"2023-03-03T06:24:56.073844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:08:00.317722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.077324+0000","last_change":"2023-03-03T06:24:54.636970+0000","last_active":"2023-03-03T06:24:56.077324+0000","last_peered":"2023-03-03T06:24:56.077324+0000","last_clean":"2023-03-03T06:24:56.077324+0000","last_became_active":"2023-03-03T06:24:54.636631+0000","last_became_peered":"2023-03-03T06:24:54.636631+0000","last_unstale":"2023-03-03T06:24:56.077324+0000","last_undegraded":"2023-03-03T06:24:56.077324+0000","last_fullsized":"2023-03-03T06:24:56.077324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:09:55.033043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707497+0000","last_change":"2023-03-03T06:24:55.084798+0000","last_active":"2023-03-03T06:24:56.707497+0000","last_peered":"2023-03-03T06:24:56.707497+0000","last_clean":"2023-03-03T06:24:56.707497+0000","last_became_active":"2023-03-03T06:24:55.084182+0000","last_became_peered":"2023-03-03T06:24:55.084182+0000","last_unstale":"2023-03-03T06:24:56.707497+0000","last_undegraded":"2023-03-03T06:24:56.707497+0000","last_fullsized":"2023-03-03T06:24:56.707497+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:53:04.068342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.077010+0000","last_change":"2023-03-03T06:24:54.632298+0000","last_active":"2023-03-03T06:24:56.077010+0000","last_peered":"2023-03-03T06:24:56.077010+0000","last_clean":"2023-03-03T06:24:56.077010+0000","last_became_active":"2023-03-03T06:24:54.631815+0000","last_became_peered":"2023-03-03T06:24:54.631815+0000","last_unstale":"2023-03-03T06:24:56.077010+0000","last_undegraded":"2023-03-03T06:24:56.077010+0000","last_fullsized":"2023-03-03T06:24:56.077010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:49:16.164956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.311362+0000","last_change":"2023-03-03T06:24:55.090788+0000","last_active":"2023-03-03T06:24:56.311362+0000","last_peered":"2023-03-03T06:24:56.311362+0000","last_clean":"2023-03-03T06:24:56.311362+0000","last_became_active":"2023-03-03T06:24:55.090509+0000","last_became_peered":"2023-03-03T06:24:55.090509+0000","last_unstale":"2023-03-03T06:24:56.311362+0000","last_undegraded":"2023-03-03T06:24:56.311362+0000","last_fullsized":"2023-03-03T06:24:56.311362+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:47:18.577602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.074053+0000","last_change":"2023-03-03T06:24:54.625022+0000","last_active":"2023-03-03T06:24:56.074053+0000","last_peered":"2023-03-03T06:24:56.074053+0000","last_clean":"2023-03-03T06:24:56.074053+0000","last_became_active":"2023-03-03T06:24:54.624750+0000","last_became_peered":"2023-03-03T06:24:54.624750+0000","last_unstale":"2023-03-03T06:24:56.074053+0000","last_undegraded":"2023-03-03T06:24:56.074053+0000","last_fullsized":"2023-03-03T06:24:56.074053+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:51:00.289405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.074016+0000","last_change":"2023-03-03T06:24:55.088315+0000","last_active":"2023-03-03T06:24:56.074016+0000","last_peered":"2023-03-03T06:24:56.074016+0000","last_clean":"2023-03-03T06:24:56.074016+0000","last_became_active":"2023-03-03T06:24:55.084331+0000","last_became_peered":"2023-03-03T06:24:55.084331+0000","last_unstale":"2023-03-03T06:24:56.074016+0000","last_undegraded":"2023-03-03T06:24:56.074016+0000","last_fullsized":"2023-03-03T06:24:56.074016+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:49:57.050421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.708081+0000","last_change":"2023-03-03T06:24:54.638996+0000","last_active":"2023-03-03T06:24:56.708081+0000","last_peered":"2023-03-03T06:24:56.708081+0000","last_clean":"2023-03-03T06:24:56.708081+0000","last_became_active":"2023-03-03T06:24:54.638700+0000","last_became_peered":"2023-03-03T06:24:54.638700+0000","last_unstale":"2023-03-03T06:24:56.708081+0000","last_undegraded":"2023-03-03T06:24:56.708081+0000","last_fullsized":"2023-03-03T06:24:56.708081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:05:44.461603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076408+0000","last_change":"2023-03-03T06:24:55.081779+0000","last_active":"2023-03-03T06:24:56.076408+0000","last_peered":"2023-03-03T06:24:56.076408+0000","last_clean":"2023-03-03T06:24:56.076408+0000","last_became_active":"2023-03-03T06:24:55.081455+0000","last_became_peered":"2023-03-03T06:24:55.081455+0000","last_unstale":"2023-03-03T06:24:56.076408+0000","last_undegraded":"2023-03-03T06:24:56.076408+0000","last_fullsized":"2023-03-03T06:24:56.076408+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:47:05.361594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076569+0000","last_change":"2023-03-03T06:24:54.638953+0000","last_active":"2023-03-03T06:24:56.076569+0000","last_peered":"2023-03-03T06:24:56.076569+0000","last_clean":"2023-03-03T06:24:56.076569+0000","last_became_active":"2023-03-03T06:24:54.638632+0000","last_became_peered":"2023-03-03T06:24:54.638632+0000","last_unstale":"2023-03-03T06:24:56.076569+0000","last_undegraded":"2023-03-03T06:24:56.076569+0000","last_fullsized":"2023-03-03T06:24:56.076569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:46:38.690319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707601+0000","last_change":"2023-03-03T06:24:55.098754+0000","last_active":"2023-03-03T06:24:56.707601+0000","last_peered":"2023-03-03T06:24:56.707601+0000","last_clean":"2023-03-03T06:24:56.707601+0000","last_became_active":"2023-03-03T06:24:55.093802+0000","last_became_peered":"2023-03-03T06:24:55.093802+0000","last_unstale":"2023-03-03T06:24:56.707601+0000","last_undegraded":"2023-03-03T06:24:56.707601+0000","last_fullsized":"2023-03-03T06:24:56.707601+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:26:58.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076505+0000","last_change":"2023-03-03T06:24:54.629541+0000","last_active":"2023-03-03T06:24:56.076505+0000","last_peered":"2023-03-03T06:24:56.076505+0000","last_clean":"2023-03-03T06:24:56.076505+0000","last_became_active":"2023-03-03T06:24:54.629289+0000","last_became_peered":"2023-03-03T06:24:54.629289+0000","last_unstale":"2023-03-03T06:24:56.076505+0000","last_undegraded":"2023-03-03T06:24:56.076505+0000","last_fullsized":"2023-03-03T06:24:56.076505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:06:53.330716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707048+0000","last_change":"2023-03-03T06:24:55.098979+0000","last_active":"2023-03-03T06:24:56.707048+0000","last_peered":"2023-03-03T06:24:56.707048+0000","last_clean":"2023-03-03T06:24:56.707048+0000","last_became_active":"2023-03-03T06:24:55.097511+0000","last_became_peered":"2023-03-03T06:24:55.097511+0000","last_unstale":"2023-03-03T06:24:56.707048+0000","last_undegraded":"2023-03-03T06:24:56.707048+0000","last_fullsized":"2023-03-03T06:24:56.707048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:40:16.824580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.311155+0000","last_change":"2023-03-03T06:24:54.628490+0000","last_active":"2023-03-03T06:24:56.311155+0000","last_peered":"2023-03-03T06:24:56.311155+0000","last_clean":"2023-03-03T06:24:56.311155+0000","last_became_active":"2023-03-03T06:24:54.628179+0000","last_became_peered":"2023-03-03T06:24:54.628179+0000","last_unstale":"2023-03-03T06:24:56.311155+0000","last_undegraded":"2023-03-03T06:24:56.311155+0000","last_fullsized":"2023-03-03T06:24:56.311155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:01:42.363326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707788+0000","last_change":"2023-03-03T06:24:55.086098+0000","last_active":"2023-03-03T06:24:56.707788+0000","last_peered":"2023-03-03T06:24:56.707788+0000","last_clean":"2023-03-03T06:24:56.707788+0000","last_became_active":"2023-03-03T06:24:55.085648+0000","last_became_peered":"2023-03-03T06:24:55.085648+0000","last_unstale":"2023-03-03T06:24:56.707788+0000","last_undegraded":"2023-03-03T06:24:56.707788+0000","last_fullsized":"2023-03-03T06:24:56.707788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:05:45.468769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707734+0000","last_change":"2023-03-03T06:24:54.628997+0000","last_active":"2023-03-03T06:24:56.707734+0000","last_peered":"2023-03-03T06:24:56.707734+0000","last_clean":"2023-03-03T06:24:56.707734+0000","last_became_active":"2023-03-03T06:24:54.628669+0000","last_became_peered":"2023-03-03T06:24:54.628669+0000","last_unstale":"2023-03-03T06:24:56.707734+0000","last_undegraded":"2023-03-03T06:24:56.707734+0000","last_fullsized":"2023-03-03T06:24:56.707734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:47:23.675286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076982+0000","last_change":"2023-03-03T06:24:55.088685+0000","last_active":"2023-03-03T06:24:56.076982+0000","last_peered":"2023-03-03T06:24:56.076982+0000","last_clean":"2023-03-03T06:24:56.076982+0000","last_became_active":"2023-03-03T06:24:55.088406+0000","last_became_peered":"2023-03-03T06:24:55.088406+0000","last_unstale":"2023-03-03T06:24:56.076982+0000","last_undegraded":"2023-03-03T06:24:56.076982+0000","last_fullsized":"2023-03-03T06:24:56.076982+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:58:40.314153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076975+0000","last_change":"2023-03-03T06:24:54.627065+0000","last_active":"2023-03-03T06:24:56.076975+0000","last_peered":"2023-03-03T06:24:56.076975+0000","last_clean":"2023-03-03T06:24:56.076975+0000","last_became_active":"2023-03-03T06:24:54.626644+0000","last_became_peered":"2023-03-03T06:24:54.626644+0000","last_unstale":"2023-03-03T06:24:56.076975+0000","last_undegraded":"2023-03-03T06:24:56.076975+0000","last_fullsized":"2023-03-03T06:24:56.076975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:47:17.570436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707815+0000","last_change":"2023-03-03T06:24:55.085296+0000","last_active":"2023-03-03T06:24:56.707815+0000","last_peered":"2023-03-03T06:24:56.707815+0000","last_clean":"2023-03-03T06:24:56.707815+0000","last_became_active":"2023-03-03T06:24:55.085033+0000","last_became_peered":"2023-03-03T06:24:55.085033+0000","last_unstale":"2023-03-03T06:24:56.707815+0000","last_undegraded":"2023-03-03T06:24:56.707815+0000","last_fullsized":"2023-03-03T06:24:56.707815+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:58.112440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707700+0000","last_change":"2023-03-03T06:24:54.634528+0000","last_active":"2023-03-03T06:24:56.707700+0000","last_peered":"2023-03-03T06:24:56.707700+0000","last_clean":"2023-03-03T06:24:56.707700+0000","last_became_active":"2023-03-03T06:24:54.634250+0000","last_became_peered":"2023-03-03T06:24:54.634250+0000","last_unstale":"2023-03-03T06:24:56.707700+0000","last_undegraded":"2023-03-03T06:24:56.707700+0000","last_fullsized":"2023-03-03T06:24:56.707700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:48:23.987745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076607+0000","last_change":"2023-03-03T06:24:55.089884+0000","last_active":"2023-03-03T06:24:56.076607+0000","last_peered":"2023-03-03T06:24:56.076607+0000","last_clean":"2023-03-03T06:24:56.076607+0000","last_became_active":"2023-03-03T06:24:55.089560+0000","last_became_peered":"2023-03-03T06:24:55.089560+0000","last_unstale":"2023-03-03T06:24:56.076607+0000","last_undegraded":"2023-03-03T06:24:56.076607+0000","last_fullsized":"2023-03-03T06:24:56.076607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:50:11.212549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707341+0000","last_change":"2023-03-03T06:24:54.638001+0000","last_active":"2023-03-03T06:24:56.707341+0000","last_peered":"2023-03-03T06:24:56.707341+0000","last_clean":"2023-03-03T06:24:56.707341+0000","last_became_active":"2023-03-03T06:24:54.637744+0000","last_became_peered":"2023-03-03T06:24:54.637744+0000","last_unstale":"2023-03-03T06:24:56.707341+0000","last_undegraded":"2023-03-03T06:24:56.707341+0000","last_fullsized":"2023-03-03T06:24:56.707341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:49:56.043255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707197+0000","last_change":"2023-03-03T06:24:55.095072+0000","last_active":"2023-03-03T06:24:56.707197+0000","last_peered":"2023-03-03T06:24:56.707197+0000","last_clean":"2023-03-03T06:24:56.707197+0000","last_became_active":"2023-03-03T06:24:55.094563+0000","last_became_peered":"2023-03-03T06:24:55.094563+0000","last_unstale":"2023-03-03T06:24:56.707197+0000","last_undegraded":"2023-03-03T06:24:56.707197+0000","last_fullsized":"2023-03-03T06:24:56.707197+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:22:28.545031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'6","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707099+0000","last_change":"2023-03-03T06:24:54.631820+0000","last_active":"2023-03-03T06:24:56.707099+0000","last_peered":"2023-03-03T06:24:56.707099+0000","last_clean":"2023-03-03T06:24:56.707099+0000","last_became_active":"2023-03-03T06:24:54.631505+0000","last_became_peered":"2023-03-03T06:24:54.631505+0000","last_unstale":"2023-03-03T06:24:56.707099+0000","last_undegraded":"2023-03-03T06:24:56.707099+0000","last_fullsized":"2023-03-03T06:24:56.707099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:07:01.931021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707205+0000","last_change":"2023-03-03T06:24:55.087658+0000","last_active":"2023-03-03T06:24:56.707205+0000","last_peered":"2023-03-03T06:24:56.707205+0000","last_clean":"2023-03-03T06:24:56.707205+0000","last_became_active":"2023-03-03T06:24:55.087371+0000","last_became_peered":"2023-03-03T06:24:55.087371+0000","last_unstale":"2023-03-03T06:24:56.707205+0000","last_undegraded":"2023-03-03T06:24:56.707205+0000","last_fullsized":"2023-03-03T06:24:56.707205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:02.025738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076678+0000","last_change":"2023-03-03T06:24:54.637183+0000","last_active":"2023-03-03T06:24:56.076678+0000","last_peered":"2023-03-03T06:24:56.076678+0000","last_clean":"2023-03-03T06:24:56.076678+0000","last_became_active":"2023-03-03T06:24:54.636770+0000","last_became_peered":"2023-03-03T06:24:54.636770+0000","last_unstale":"2023-03-03T06:24:56.076678+0000","last_undegraded":"2023-03-03T06:24:56.076678+0000","last_fullsized":"2023-03-03T06:24:56.076678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:42:11.098664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707400+0000","last_change":"2023-03-03T06:24:55.091980+0000","last_active":"2023-03-03T06:24:56.707400+0000","last_peered":"2023-03-03T06:24:56.707400+0000","last_clean":"2023-03-03T06:24:56.707400+0000","last_became_active":"2023-03-03T06:24:55.091703+0000","last_became_peered":"2023-03-03T06:24:55.091703+0000","last_unstale":"2023-03-03T06:24:56.707400+0000","last_undegraded":"2023-03-03T06:24:56.707400+0000","last_fullsized":"2023-03-03T06:24:56.707400+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:37:27.640262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707875+0000","last_change":"2023-03-03T06:24:54.638114+0000","last_active":"2023-03-03T06:24:56.707875+0000","last_peered":"2023-03-03T06:24:56.707875+0000","last_clean":"2023-03-03T06:24:56.707875+0000","last_became_active":"2023-03-03T06:24:54.637832+0000","last_became_peered":"2023-03-03T06:24:54.637832+0000","last_unstale":"2023-03-03T06:24:56.707875+0000","last_undegraded":"2023-03-03T06:24:56.707875+0000","last_fullsized":"2023-03-03T06:24:56.707875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:18:43.486455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076370+0000","last_change":"2023-03-03T06:24:55.085803+0000","last_active":"2023-03-03T06:24:56.076370+0000","last_peered":"2023-03-03T06:24:56.076370+0000","last_clean":"2023-03-03T06:24:56.076370+0000","last_became_active":"2023-03-03T06:24:55.083611+0000","last_became_peered":"2023-03-03T06:24:55.083611+0000","last_unstale":"2023-03-03T06:24:56.076370+0000","last_undegraded":"2023-03-03T06:24:56.076370+0000","last_fullsized":"2023-03-03T06:24:56.076370+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:47:05.361594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076531+0000","last_change":"2023-03-03T06:24:54.632103+0000","last_active":"2023-03-03T06:24:56.076531+0000","last_peered":"2023-03-03T06:24:56.076531+0000","last_clean":"2023-03-03T06:24:56.076531+0000","last_became_active":"2023-03-03T06:24:54.631816+0000","last_became_peered":"2023-03-03T06:24:54.631816+0000","last_unstale":"2023-03-03T06:24:56.076531+0000","last_undegraded":"2023-03-03T06:24:56.076531+0000","last_fullsized":"2023-03-03T06:24:56.076531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:03:46.767404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707301+0000","last_change":"2023-03-03T06:24:55.085476+0000","last_active":"2023-03-03T06:24:56.707301+0000","last_peered":"2023-03-03T06:24:56.707301+0000","last_clean":"2023-03-03T06:24:56.707301+0000","last_became_active":"2023-03-03T06:24:55.085189+0000","last_became_peered":"2023-03-03T06:24:55.085189+0000","last_unstale":"2023-03-03T06:24:56.707301+0000","last_undegraded":"2023-03-03T06:24:56.707301+0000","last_fullsized":"2023-03-03T06:24:56.707301+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:09:56.040209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'8","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707358+0000","last_change":"2023-03-03T06:24:54.629063+0000","last_active":"2023-03-03T06:24:56.707358+0000","last_peered":"2023-03-03T06:24:56.707358+0000","last_clean":"2023-03-03T06:24:56.707358+0000","last_became_active":"2023-03-03T06:24:54.628712+0000","last_became_peered":"2023-03-03T06:24:54.628712+0000","last_unstale":"2023-03-03T06:24:56.707358+0000","last_undegraded":"2023-03-03T06:24:56.707358+0000","last_fullsized":"2023-03-03T06:24:56.707358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:49:56.043255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707505+0000","last_change":"2023-03-03T06:24:55.084066+0000","last_active":"2023-03-03T06:24:56.707505+0000","last_peered":"2023-03-03T06:24:56.707505+0000","last_clean":"2023-03-03T06:24:56.707505+0000","last_became_active":"2023-03-03T06:24:55.083795+0000","last_became_peered":"2023-03-03T06:24:55.083795+0000","last_unstale":"2023-03-03T06:24:56.707505+0000","last_undegraded":"2023-03-03T06:24:56.707505+0000","last_fullsized":"2023-03-03T06:24:56.707505+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:25:55.057283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707936+0000","last_change":"2023-03-03T06:24:54.635066+0000","last_active":"2023-03-03T06:24:56.707936+0000","last_peered":"2023-03-03T06:24:56.707936+0000","last_clean":"2023-03-03T06:24:56.707936+0000","last_became_active":"2023-03-03T06:24:54.634784+0000","last_became_peered":"2023-03-03T06:24:54.634784+0000","last_unstale":"2023-03-03T06:24:56.707936+0000","last_undegraded":"2023-03-03T06:24:56.707936+0000","last_fullsized":"2023-03-03T06:24:56.707936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:09:03.607845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707787+0000","last_change":"2023-03-03T06:24:55.094401+0000","last_active":"2023-03-03T06:24:56.707787+0000","last_peered":"2023-03-03T06:24:56.707787+0000","last_clean":"2023-03-03T06:24:56.707787+0000","last_became_active":"2023-03-03T06:24:55.094110+0000","last_became_peered":"2023-03-03T06:24:55.094110+0000","last_unstale":"2023-03-03T06:24:56.707787+0000","last_undegraded":"2023-03-03T06:24:56.707787+0000","last_fullsized":"2023-03-03T06:24:56.707787+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:03.796517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076862+0000","last_change":"2023-03-03T06:24:54.628809+0000","last_active":"2023-03-03T06:24:56.076862+0000","last_peered":"2023-03-03T06:24:56.076862+0000","last_clean":"2023-03-03T06:24:56.076862+0000","last_became_active":"2023-03-03T06:24:54.628544+0000","last_became_peered":"2023-03-03T06:24:54.628544+0000","last_unstale":"2023-03-03T06:24:56.076862+0000","last_undegraded":"2023-03-03T06:24:56.076862+0000","last_fullsized":"2023-03-03T06:24:56.076862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:26:57.520634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707303+0000","last_change":"2023-03-03T06:24:55.090736+0000","last_active":"2023-03-03T06:24:56.707303+0000","last_peered":"2023-03-03T06:24:56.707303+0000","last_clean":"2023-03-03T06:24:56.707303+0000","last_became_active":"2023-03-03T06:24:55.090468+0000","last_became_peered":"2023-03-03T06:24:55.090468+0000","last_unstale":"2023-03-03T06:24:56.707303+0000","last_undegraded":"2023-03-03T06:24:56.707303+0000","last_fullsized":"2023-03-03T06:24:56.707303+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:18:44.493621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.311446+0000","last_change":"2023-03-03T06:24:54.628569+0000","last_active":"2023-03-03T06:24:56.311446+0000","last_peered":"2023-03-03T06:24:56.311446+0000","last_clean":"2023-03-03T06:24:56.311446+0000","last_became_active":"2023-03-03T06:24:54.628303+0000","last_became_peered":"2023-03-03T06:24:54.628303+0000","last_unstale":"2023-03-03T06:24:56.311446+0000","last_undegraded":"2023-03-03T06:24:56.311446+0000","last_fullsized":"2023-03-03T06:24:56.311446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:46:06.276411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707500+0000","last_change":"2023-03-03T06:24:55.090267+0000","last_active":"2023-03-03T06:24:56.707500+0000","last_peered":"2023-03-03T06:24:56.707500+0000","last_clean":"2023-03-03T06:24:56.707500+0000","last_became_active":"2023-03-03T06:24:55.089974+0000","last_became_peered":"2023-03-03T06:24:55.089974+0000","last_unstale":"2023-03-03T06:24:56.707500+0000","last_undegraded":"2023-03-03T06:24:56.707500+0000","last_fullsized":"2023-03-03T06:24:56.707500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:04:34.559885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076867+0000","last_change":"2023-03-03T06:24:54.636690+0000","last_active":"2023-03-03T06:24:56.076867+0000","last_peered":"2023-03-03T06:24:56.076867+0000","last_clean":"2023-03-03T06:24:56.076867+0000","last_became_active":"2023-03-03T06:24:54.636396+0000","last_became_peered":"2023-03-03T06:24:54.636396+0000","last_unstale":"2023-03-03T06:24:56.076867+0000","last_undegraded":"2023-03-03T06:24:56.076867+0000","last_fullsized":"2023-03-03T06:24:56.076867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:56:59.345603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076463+0000","last_change":"2023-03-03T06:24:55.089214+0000","last_active":"2023-03-03T06:24:56.076463+0000","last_peered":"2023-03-03T06:24:56.076463+0000","last_clean":"2023-03-03T06:24:56.076463+0000","last_became_active":"2023-03-03T06:24:55.088911+0000","last_became_peered":"2023-03-03T06:24:55.088911+0000","last_unstale":"2023-03-03T06:24:56.076463+0000","last_undegraded":"2023-03-03T06:24:56.076463+0000","last_fullsized":"2023-03-03T06:24:56.076463+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:21:44.481430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076701+0000","last_change":"2023-03-03T06:24:54.637279+0000","last_active":"2023-03-03T06:24:56.076701+0000","last_peered":"2023-03-03T06:24:56.076701+0000","last_clean":"2023-03-03T06:24:56.076701+0000","last_became_active":"2023-03-03T06:24:54.636989+0000","last_became_peered":"2023-03-03T06:24:54.636989+0000","last_unstale":"2023-03-03T06:24:56.076701+0000","last_undegraded":"2023-03-03T06:24:56.076701+0000","last_fullsized":"2023-03-03T06:24:56.076701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:22:27.537865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.074094+0000","last_change":"2023-03-03T06:24:55.081604+0000","last_active":"2023-03-03T06:24:56.074094+0000","last_peered":"2023-03-03T06:24:56.074094+0000","last_clean":"2023-03-03T06:24:56.074094+0000","last_became_active":"2023-03-03T06:24:55.080974+0000","last_became_peered":"2023-03-03T06:24:55.080974+0000","last_unstale":"2023-03-03T06:24:56.074094+0000","last_undegraded":"2023-03-03T06:24:56.074094+0000","last_fullsized":"2023-03-03T06:24:56.074094+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:47:24.682452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.311190+0000","last_change":"2023-03-03T06:24:54.626477+0000","last_active":"2023-03-03T06:24:56.311190+0000","last_peered":"2023-03-03T06:24:56.311190+0000","last_clean":"2023-03-03T06:24:56.311190+0000","last_became_active":"2023-03-03T06:24:54.626168+0000","last_became_peered":"2023-03-03T06:24:54.626168+0000","last_unstale":"2023-03-03T06:24:56.311190+0000","last_undegraded":"2023-03-03T06:24:56.311190+0000","last_fullsized":"2023-03-03T06:24:56.311190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:07:59.310556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.706718+0000","last_change":"2023-03-03T06:24:55.093004+0000","last_active":"2023-03-03T06:24:56.706718+0000","last_peered":"2023-03-03T06:24:56.706718+0000","last_clean":"2023-03-03T06:24:56.706718+0000","last_became_active":"2023-03-03T06:24:55.092765+0000","last_became_peered":"2023-03-03T06:24:55.092765+0000","last_unstale":"2023-03-03T06:24:56.706718+0000","last_undegraded":"2023-03-03T06:24:56.706718+0000","last_fullsized":"2023-03-03T06:24:56.706718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:12.906507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.706809+0000","last_change":"2023-03-03T06:24:54.635324+0000","last_active":"2023-03-03T06:24:56.706809+0000","last_peered":"2023-03-03T06:24:56.706809+0000","last_clean":"2023-03-03T06:24:56.706809+0000","last_became_active":"2023-03-03T06:24:54.635055+0000","last_became_peered":"2023-03-03T06:24:54.635055+0000","last_unstale":"2023-03-03T06:24:56.706809+0000","last_undegraded":"2023-03-03T06:24:56.706809+0000","last_fullsized":"2023-03-03T06:24:56.706809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:07:59.310556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707059+0000","last_change":"2023-03-03T06:24:55.091660+0000","last_active":"2023-03-03T06:24:56.707059+0000","last_peered":"2023-03-03T06:24:56.707059+0000","last_clean":"2023-03-03T06:24:56.707059+0000","last_became_active":"2023-03-03T06:24:55.085984+0000","last_became_peered":"2023-03-03T06:24:55.085984+0000","last_unstale":"2023-03-03T06:24:56.707059+0000","last_undegraded":"2023-03-03T06:24:56.707059+0000","last_fullsized":"2023-03-03T06:24:56.707059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:06:54.337882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.706927+0000","last_change":"2023-03-03T06:24:54.638856+0000","last_active":"2023-03-03T06:24:56.706927+0000","last_peered":"2023-03-03T06:24:56.706927+0000","last_clean":"2023-03-03T06:24:56.706927+0000","last_became_active":"2023-03-03T06:24:54.638221+0000","last_became_peered":"2023-03-03T06:24:54.638221+0000","last_unstale":"2023-03-03T06:24:56.706927+0000","last_undegraded":"2023-03-03T06:24:56.706927+0000","last_fullsized":"2023-03-03T06:24:56.706927+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:48:28.121342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076612+0000","last_change":"2023-03-03T06:24:55.084593+0000","last_active":"2023-03-03T06:24:56.076612+0000","last_peered":"2023-03-03T06:24:56.076612+0000","last_clean":"2023-03-03T06:24:56.076612+0000","last_became_active":"2023-03-03T06:24:55.083420+0000","last_became_peered":"2023-03-03T06:24:55.083420+0000","last_unstale":"2023-03-03T06:24:56.076612+0000","last_undegraded":"2023-03-03T06:24:56.076612+0000","last_fullsized":"2023-03-03T06:24:56.076612+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:14:57.567536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076482+0000","last_change":"2023-03-03T06:24:54.632915+0000","last_active":"2023-03-03T06:24:56.076482+0000","last_peered":"2023-03-03T06:24:56.076482+0000","last_clean":"2023-03-03T06:24:56.076482+0000","last_became_active":"2023-03-03T06:24:54.632688+0000","last_became_peered":"2023-03-03T06:24:54.632688+0000","last_unstale":"2023-03-03T06:24:56.076482+0000","last_undegraded":"2023-03-03T06:24:56.076482+0000","last_fullsized":"2023-03-03T06:24:56.076482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:23:27.985421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-03-03T06:24:55.069243+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:24:55.069243+0000","last_peered":"2023-03-03T06:24:55.069243+0000","last_clean":"2023-03-03T06:24:55.069243+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:24:55.069243+0000","last_undegraded":"2023-03-03T06:24:55.069243+0000","last_fullsized":"2023-03-03T06:24:55.069243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076586+0000","last_change":"2023-03-03T06:24:55.083080+0000","last_active":"2023-03-03T06:24:56.076586+0000","last_peered":"2023-03-03T06:24:56.076586+0000","last_clean":"2023-03-03T06:24:56.076586+0000","last_became_active":"2023-03-03T06:24:55.082481+0000","last_became_peered":"2023-03-03T06:24:55.082481+0000","last_unstale":"2023-03-03T06:24:56.076586+0000","last_undegraded":"2023-03-03T06:24:56.076586+0000","last_fullsized":"2023-03-03T06:24:56.076586+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:36:18.927173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707677+0000","last_change":"2023-03-03T06:24:54.639070+0000","last_active":"2023-03-03T06:24:56.707677+0000","last_peered":"2023-03-03T06:24:56.707677+0000","last_clean":"2023-03-03T06:24:56.707677+0000","last_became_active":"2023-03-03T06:24:54.637739+0000","last_became_peered":"2023-03-03T06:24:54.637739+0000","last_unstale":"2023-03-03T06:24:56.707677+0000","last_undegraded":"2023-03-03T06:24:56.707677+0000","last_fullsized":"2023-03-03T06:24:56.707677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:03:38.930000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-03-03T06:24:55.070553+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:24:55.070553+0000","last_peered":"2023-03-03T06:24:55.070553+0000","last_clean":"2023-03-03T06:24:55.070553+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:24:55.070553+0000","last_undegraded":"2023-03-03T06:24:55.070553+0000","last_fullsized":"2023-03-03T06:24:55.070553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707321+0000","last_change":"2023-03-03T06:24:55.085060+0000","last_active":"2023-03-03T06:24:56.707321+0000","last_peered":"2023-03-03T06:24:56.707321+0000","last_clean":"2023-03-03T06:24:56.707321+0000","last_became_active":"2023-03-03T06:24:55.084790+0000","last_became_peered":"2023-03-03T06:24:55.084790+0000","last_unstale":"2023-03-03T06:24:56.707321+0000","last_undegraded":"2023-03-03T06:24:56.707321+0000","last_fullsized":"2023-03-03T06:24:56.707321+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:57:00.352769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.073718+0000","last_change":"2023-03-03T06:24:54.628510+0000","last_active":"2023-03-03T06:24:56.073718+0000","last_peered":"2023-03-03T06:24:56.073718+0000","last_clean":"2023-03-03T06:24:56.073718+0000","last_became_active":"2023-03-03T06:24:54.628216+0000","last_became_peered":"2023-03-03T06:24:54.628216+0000","last_unstale":"2023-03-03T06:24:56.073718+0000","last_undegraded":"2023-03-03T06:24:56.073718+0000","last_fullsized":"2023-03-03T06:24:56.073718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:18:43.486455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-03-03T06:24:55.066913+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:24:55.066913+0000","last_peered":"2023-03-03T06:24:55.066913+0000","last_clean":"2023-03-03T06:24:55.066913+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:24:55.066913+0000","last_undegraded":"2023-03-03T06:24:55.066913+0000","last_fullsized":"2023-03-03T06:24:55.066913+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-03-03T06:24:55.075793+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:24:55.075793+0000","last_peered":"2023-03-03T06:24:55.075793+0000","last_clean":"2023-03-03T06:24:55.075793+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:24:55.075793+0000","last_undegraded":"2023-03-03T06:24:55.075793+0000","last_fullsized":"2023-03-03T06:24:55.075793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707732+0000","last_change":"2023-03-03T06:24:55.093192+0000","last_active":"2023-03-03T06:24:56.707732+0000","last_peered":"2023-03-03T06:24:56.707732+0000","last_clean":"2023-03-03T06:24:56.707732+0000","last_became_active":"2023-03-03T06:24:55.092384+0000","last_became_peered":"2023-03-03T06:24:55.092384+0000","last_unstale":"2023-03-03T06:24:56.707732+0000","last_undegraded":"2023-03-03T06:24:56.707732+0000","last_fullsized":"2023-03-03T06:24:56.707732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:34:06.708494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707431+0000","last_change":"2023-03-03T06:24:54.638719+0000","last_active":"2023-03-03T06:24:56.707431+0000","last_peered":"2023-03-03T06:24:56.707431+0000","last_clean":"2023-03-03T06:24:56.707431+0000","last_became_active":"2023-03-03T06:24:54.638179+0000","last_became_peered":"2023-03-03T06:24:54.638179+0000","last_unstale":"2023-03-03T06:24:56.707431+0000","last_undegraded":"2023-03-03T06:24:56.707431+0000","last_fullsized":"2023-03-03T06:24:56.707431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:56:45.310871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-03-03T06:24:55.080017+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:24:55.080017+0000","last_peered":"2023-03-03T06:24:55.080017+0000","last_clean":"2023-03-03T06:24:55.080017+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:24:55.080017+0000","last_undegraded":"2023-03-03T06:24:55.080017+0000","last_fullsized":"2023-03-03T06:24:55.080017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707625+0000","last_change":"2023-03-03T06:24:55.092012+0000","last_active":"2023-03-03T06:24:56.707625+0000","last_peered":"2023-03-03T06:24:56.707625+0000","last_clean":"2023-03-03T06:24:56.707625+0000","last_became_active":"2023-03-03T06:24:55.091753+0000","last_became_peered":"2023-03-03T06:24:55.091753+0000","last_unstale":"2023-03-03T06:24:56.707625+0000","last_undegraded":"2023-03-03T06:24:56.707625+0000","last_fullsized":"2023-03-03T06:24:56.707625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:47:05.361594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.311598+0000","last_change":"2023-03-03T06:24:54.632575+0000","last_active":"2023-03-03T06:24:56.311598+0000","last_peered":"2023-03-03T06:24:56.311598+0000","last_clean":"2023-03-03T06:24:56.311598+0000","last_became_active":"2023-03-03T06:24:54.632317+0000","last_became_peered":"2023-03-03T06:24:54.632317+0000","last_unstale":"2023-03-03T06:24:56.311598+0000","last_undegraded":"2023-03-03T06:24:56.311598+0000","last_fullsized":"2023-03-03T06:24:56.311598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:48:23.987745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-03-03T06:24:55.075709+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:24:55.075709+0000","last_peered":"2023-03-03T06:24:55.075709+0000","last_clean":"2023-03-03T06:24:55.075709+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:24:55.075709+0000","last_undegraded":"2023-03-03T06:24:55.075709+0000","last_fullsized":"2023-03-03T06:24:55.075709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707645+0000","last_change":"2023-03-03T06:24:55.100216+0000","last_active":"2023-03-03T06:24:56.707645+0000","last_peered":"2023-03-03T06:24:56.707645+0000","last_clean":"2023-03-03T06:24:56.707645+0000","last_became_active":"2023-03-03T06:24:55.099953+0000","last_became_peered":"2023-03-03T06:24:55.099953+0000","last_unstale":"2023-03-03T06:24:56.707645+0000","last_undegraded":"2023-03-03T06:24:56.707645+0000","last_fullsized":"2023-03-03T06:24:56.707645+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:08:19.955001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076794+0000","last_change":"2023-03-03T06:24:54.632725+0000","last_active":"2023-03-03T06:24:56.076794+0000","last_peered":"2023-03-03T06:24:56.076794+0000","last_clean":"2023-03-03T06:24:56.076794+0000","last_became_active":"2023-03-03T06:24:54.632451+0000","last_became_peered":"2023-03-03T06:24:54.632451+0000","last_unstale":"2023-03-03T06:24:56.076794+0000","last_undegraded":"2023-03-03T06:24:56.076794+0000","last_fullsized":"2023-03-03T06:24:56.076794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:11:57.105273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-03-03T06:24:55.071008+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:24:55.071008+0000","last_peered":"2023-03-03T06:24:55.071008+0000","last_clean":"2023-03-03T06:24:55.071008+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:24:55.071008+0000","last_undegraded":"2023-03-03T06:24:55.071008+0000","last_fullsized":"2023-03-03T06:24:55.071008+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.311177+0000","last_change":"2023-03-03T06:24:55.081924+0000","last_active":"2023-03-03T06:24:56.311177+0000","last_peered":"2023-03-03T06:24:56.311177+0000","last_clean":"2023-03-03T06:24:56.311177+0000","last_became_active":"2023-03-03T06:24:55.081624+0000","last_became_peered":"2023-03-03T06:24:55.081624+0000","last_unstale":"2023-03-03T06:24:56.311177+0000","last_undegraded":"2023-03-03T06:24:56.311177+0000","last_fullsized":"2023-03-03T06:24:56.311177+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:46:39.697485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.073725+0000","last_change":"2023-03-03T06:24:54.633164+0000","last_active":"2023-03-03T06:24:56.073725+0000","last_peered":"2023-03-03T06:24:56.073725+0000","last_clean":"2023-03-03T06:24:56.073725+0000","last_became_active":"2023-03-03T06:24:54.632843+0000","last_became_peered":"2023-03-03T06:24:54.632843+0000","last_unstale":"2023-03-03T06:24:56.073725+0000","last_undegraded":"2023-03-03T06:24:56.073725+0000","last_fullsized":"2023-03-03T06:24:56.073725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:01.018572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-03-03T06:24:55.078366+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:24:55.078366+0000","last_peered":"2023-03-03T06:24:55.078366+0000","last_clean":"2023-03-03T06:24:55.078366+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:24:55.078366+0000","last_undegraded":"2023-03-03T06:24:55.078366+0000","last_fullsized":"2023-03-03T06:24:55.078366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.076348+0000","last_change":"2023-03-03T06:24:55.091744+0000","last_active":"2023-03-03T06:24:56.076348+0000","last_peered":"2023-03-03T06:24:56.076348+0000","last_clean":"2023-03-03T06:24:56.076348+0000","last_became_active":"2023-03-03T06:24:55.091077+0000","last_became_peered":"2023-03-03T06:24:55.091077+0000","last_unstale":"2023-03-03T06:24:56.076348+0000","last_undegraded":"2023-03-03T06:24:56.076348+0000","last_fullsized":"2023-03-03T06:24:56.076348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:54.609707+0000","last_clean_scrub_stamp":"2023-03-03T06:24:54.609707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:13:29.244226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-03-03T06:24:56.707469+0000","last_change":"2023-03-03T06:24:54.632572+0000","last_active":"2023-03-03T06:24:56.707469+0000","last_peered":"2023-03-03T06:24:56.707469+0000","last_clean":"2023-03-03T06:24:56.707469+0000","last_became_active":"2023-03-03T06:24:54.632311+0000","last_became_peered":"2023-03-03T06:24:54.632311+0000","last_unstale":"2023-03-03T06:24:56.707469+0000","last_undegraded":"2023-03-03T06:24:56.707469+0000","last_fullsized":"2023-03-03T06:24:56.707469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:24:53.602540+0000","last_clean_scrub_stamp":"2023-03-03T06:24:53.602540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:03:38.930000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-03-03T06:24:55.078607+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:24:55.078607+0000","last_peered":"2023-03-03T06:24:55.078607+0000","last_clean":"2023-03-03T06:24:55.078607+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:24:55.078607+0000","last_undegraded":"2023-03-03T06:24:55.078607+0000","last_fullsized":"2023-03-03T06:24:55.078607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9736,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362104,"statfs":{"total":96636764160,"available":96626794496,"internally_reserved":0,"allocated":1048576,"data_stored":791761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.379}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48599999999999999}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52800000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8596,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363244,"statfs":{"total":96636764160,"available":96627961856,"internally_reserved":0,"allocated":471040,"data_stored":208932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.433}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.68400000000000005}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57299999999999995}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.622}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.751}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9748,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362092,"statfs":{"total":96636764160,"available":96626782208,"internally_reserved":0,"allocated":1060864,"data_stored":798714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.375},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.45000000000000001}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.5}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.59299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8716,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363124,"statfs":{"total":96636764160,"available":96627838976,"internally_reserved":0,"allocated":462848,"data_stored":207349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.29299999999999998}]},{"osd":3,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.311},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.68999999999999995}]},{"osd":7,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.63500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8540,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363300,"statfs":{"total":96636764160,"available":96628019200,"internally_reserved":0,"allocated":479232,"data_stored":209846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.248}]},{"osd":1,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":7.4820000000000002,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.32000000000000001}]},{"osd":3,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.29399999999999998}]},{"osd":4,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.623}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8728,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363112,"statfs":{"total":96636764160,"available":96627826688,"internally_reserved":0,"allocated":475136,"data_stored":208898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.62},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.629},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.56799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8792,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363048,"statfs":{"total":96636764160,"available":96627761152,"internally_reserved":0,"allocated":475136,"data_stored":209824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.73399999999999999}]},{"osd":1,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.55200000000000005}]},{"osd":2,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.75800000000000001}]},{"osd":3,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38800000000000001}]},{"osd":6,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.44},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41799999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.498}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8652,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363188,"statfs":{"total":96636764160,"available":96627904512,"internally_reserved":0,"allocated":462848,"data_stored":207385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.622}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.73099999999999998}]},{"osd":3,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67800000000000005}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.441}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.52600000000000002}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.495}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:24:59.599 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-03T06:24:59.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-03-03T06:24:59.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.761+0000 7f0c727f2700 1 Processor -- start 2023-03-03T06:24:59.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.761+0000 7f0c727f2700 1 -- start start 2023-03-03T06:24:59.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.762+0000 7f0c727f2700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0c6c0cd090 0x7f0c6c0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:59.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.762+0000 7f0c727f2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0c6c0b17b0 0x7f0c6c0b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:59.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.762+0000 7f0c727f2700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6c0cddb0 con 0x7f0c6c0cb430 2023-03-03T06:24:59.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.762+0000 7f0c727f2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6c15cd70 con 0x7f0c6c0b17b0 2023-03-03T06:24:59.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.762+0000 7f0c727f2700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6c0cebf0 con 0x7f0c6c0cd090 2023-03-03T06:24:59.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.762+0000 7f0c70d8f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0c6c0b17b0 0x7f0c6c0b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:59.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.762+0000 7f0c70d8f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0c6c0b17b0 0x7f0c6c0b1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43654/0 (socket says 172.21.15.5:43654) 2023-03-03T06:24:59.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.762+0000 7f0c70d8f700 1 -- 172.21.15.5:0/930540536 learned_addr learned my addr 172.21.15.5:0/930540536 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:59.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.762+0000 7f0c6b7fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0c6c0cd090 0x7f0c6c0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:59.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.762+0000 7f0c70d8f700 1 -- 172.21.15.5:0/930540536 >> v2:172.21.15.191:3300/0 conn(0x7f0c6c0cd090 msgr2=0x7f0c6c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:24:59.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.762+0000 7f0c70d8f700 1 --2- 172.21.15.5:0/930540536 >> v2:172.21.15.191:3300/0 conn(0x7f0c6c0cd090 0x7f0c6c0cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.762+0000 7f0c70d8f700 1 -- 172.21.15.5:0/930540536 >> v1:172.21.15.191:6789/0 conn(0x7f0c6c0cb430 legacy=0x7f0c6c0cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:59.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.762+0000 7f0c70d8f700 1 -- 172.21.15.5:0/930540536 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c0b2150 con 0x7f0c6c0b17b0 2023-03-03T06:24:59.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.763+0000 7f0c70d8f700 1 --2- 172.21.15.5:0/930540536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6c0b17b0 0x7f0c6c0b1c10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009e50 tx=0x7f0c6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4d353cdc9266ec server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:59.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.763+0000 7f0c6affd700 1 -- 172.21.15.5:0/930540536 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6400e070 con 0x7f0c6c0b17b0 2023-03-03T06:24:59.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.763+0000 7f0c6affd700 1 -- 172.21.15.5:0/930540536 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6400b8d0 con 0x7f0c6c0b17b0 2023-03-03T06:24:59.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.763+0000 7f0c6affd700 1 -- 172.21.15.5:0/930540536 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6400bc80 con 0x7f0c6c0b17b0 2023-03-03T06:24:59.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.763+0000 7f0c727f2700 1 -- 172.21.15.5:0/930540536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6c0b17b0 msgr2=0x7f0c6c0b1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:59.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.763+0000 7f0c727f2700 1 --2- 172.21.15.5:0/930540536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6c0b17b0 0x7f0c6c0b1c10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009e50 tx=0x7f0c6400b330 comp rx=0 tx=0).stop 2023-03-03T06:24:59.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.763+0000 7f0c727f2700 1 -- 172.21.15.5:0/930540536 shutdown_connections 2023-03-03T06:24:59.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.763+0000 7f0c727f2700 1 --2- 172.21.15.5:0/930540536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6c0b17b0 0x7f0c6c0b1c10 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.763+0000 7f0c727f2700 1 --2- 172.21.15.5:0/930540536 >> v2:172.21.15.191:3300/0 conn(0x7f0c6c0cd090 0x7f0c6c0cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.763+0000 7f0c727f2700 1 -- 172.21.15.5:0/930540536 >> 172.21.15.5:0/930540536 conn(0x7f0c6c0d09c0 msgr2=0x7f0c6c0cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:24:59.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.763+0000 7f0c727f2700 1 -- 172.21.15.5:0/930540536 shutdown_connections 2023-03-03T06:24:59.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.763+0000 7f0c727f2700 1 -- 172.21.15.5:0/930540536 wait complete. 2023-03-03T06:24:59.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.765+0000 7f0c727f2700 1 Processor -- start 2023-03-03T06:24:59.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.765+0000 7f0c727f2700 1 -- start start 2023-03-03T06:24:59.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c727f2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c6c0b17b0 0x7f0c6c156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:59.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c727f2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c6c0cb430 0x7f0c6c06b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:59.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c727f2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6c0cd090 0x7f0c6c06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:59.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c727f2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0b3490 con 0x7f0c6c0cd090 2023-03-03T06:24:59.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c727f2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0ac790 con 0x7f0c6c0cb430 2023-03-03T06:24:59.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c727f2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0b2b60 con 0x7f0c6c0b17b0 2023-03-03T06:24:59.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c70d8f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6c0cd090 0x7f0c6c06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:59.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c70d8f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6c0cd090 0x7f0c6c06b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43660/0 (socket says 172.21.15.5:43660) 2023-03-03T06:24:59.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c70d8f700 1 -- 172.21.15.5:0/2069671082 learned_addr learned my addr 172.21.15.5:0/2069671082 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:24:59.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c6b7fe700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c6c0cb430 0x7f0c6c06b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:59.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c6bfff700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c6c0b17b0 0x7f0c6c156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:59.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c70d8f700 1 -- 172.21.15.5:0/2069671082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c6c0b17b0 msgr2=0x7f0c6c156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:59.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c70d8f700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c6c0b17b0 0x7f0c6c156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c70d8f700 1 -- 172.21.15.5:0/2069671082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c6c0cb430 msgr2=0x7f0c6c06b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:24:59.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c70d8f700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c6c0cb430 0x7f0c6c06b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:24:59.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c70d8f700 1 -- 172.21.15.5:0/2069671082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c64009b30 con 0x7f0c6c0cd090 2023-03-03T06:24:59.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c6b7fe700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c6c0cb430 0x7f0c6c06b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:59.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c6bfff700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c6c0b17b0 0x7f0c6c156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:24:59.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c70d8f700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6c0cd090 0x7f0c6c06b7e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0715c0 tx=0x7f0c64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:59.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c68ff9700 1 -- 172.21.15.5:0/2069671082 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c640092e0 con 0x7f0c6c0cd090 2023-03-03T06:24:59.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c68ff9700 1 -- 172.21.15.5:0/2069671082 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c64004960 con 0x7f0c6c0cd090 2023-03-03T06:24:59.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c727f2700 1 -- 172.21.15.5:0/2069671082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6c0cdfe0 con 0x7f0c6c0cd090 2023-03-03T06:24:59.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c68ff9700 1 -- 172.21.15.5:0/2069671082 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6401b670 con 0x7f0c6c0cd090 2023-03-03T06:24:59.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.766+0000 7f0c727f2700 1 -- 172.21.15.5:0/2069671082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6c0cb800 con 0x7f0c6c0cd090 2023-03-03T06:24:59.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.767+0000 7f0c727f2700 1 -- 172.21.15.5:0/2069671082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6c0ce2c0 con 0x7f0c6c0cd090 2023-03-03T06:24:59.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.768+0000 7f0c68ff9700 1 -- 172.21.15.5:0/2069671082 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0c6402b070 con 0x7f0c6c0cd090 2023-03-03T06:24:59.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.768+0000 7f0c68ff9700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0c580682f0 0x7f0c5806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:24:59.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.768+0000 7f0c68ff9700 1 -- 172.21.15.5:0/2069671082 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0c640875f0 con 0x7f0c6c0cd090 2023-03-03T06:24:59.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.768+0000 7f0c6bfff700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0c580682f0 0x7f0c5806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:24:59.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.769+0000 7f0c6bfff700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0c580682f0 0x7f0c5806a7a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c001670 tx=0x7f0c5c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:24:59.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:24:59.773+0000 7f0c68ff9700 1 -- 172.21.15.5:0/2069671082 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0c64053d10 con 0x7f0c6c0cd090 2023-03-03T06:25:00.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.044+0000 7f0c727f2700 1 -- 172.21.15.5:0/2069671082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f0c6c04e6e0 con 0x7f0c6c0cd090 2023-03-03T06:25:00.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.048+0000 7f0c68ff9700 1 -- 172.21.15.5:0/2069671082 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0c64057330 con 0x7f0c6c0cd090 2023-03-03T06:25:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.050+0000 7f0c727f2700 1 -- 172.21.15.5:0/2069671082 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0c580682f0 msgr2=0x7f0c5806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.050+0000 7f0c727f2700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0c580682f0 0x7f0c5806a7a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c001670 tx=0x7f0c5c009040 comp rx=0 tx=0).stop 2023-03-03T06:25:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.050+0000 7f0c727f2700 1 -- 172.21.15.5:0/2069671082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6c0cd090 msgr2=0x7f0c6c06b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:00.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.050+0000 7f0c727f2700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6c0cd090 0x7f0c6c06b7e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0715c0 tx=0x7f0c64004ad0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.050+0000 7f0c727f2700 1 -- 172.21.15.5:0/2069671082 shutdown_connections 2023-03-03T06:25:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.050+0000 7f0c727f2700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c6c0cd090 0x7f0c6c06b7e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.050+0000 7f0c727f2700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0c580682f0 0x7f0c5806a7a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.050+0000 7f0c727f2700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c6c0b17b0 0x7f0c6c156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.050+0000 7f0c727f2700 1 --2- 172.21.15.5:0/2069671082 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c6c0cb430 0x7f0c6c06b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.050+0000 7f0c727f2700 1 -- 172.21.15.5:0/2069671082 >> 172.21.15.5:0/2069671082 conn(0x7f0c6c0d09c0 msgr2=0x7f0c6c15c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:00.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.050+0000 7f0c727f2700 1 -- 172.21.15.5:0/2069671082 shutdown_connections 2023-03-03T06:25:00.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.050+0000 7f0c727f2700 1 -- 172.21.15.5:0/2069671082 wait complete. 2023-03-03T06:25:00.054 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-03-03T06:25:00.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.187+0000 7f690eb1e700 1 Processor -- start 2023-03-03T06:25:00.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.187+0000 7f690eb1e700 1 -- start start 2023-03-03T06:25:00.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.188+0000 7f690eb1e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f69080af280 0x7f69080cac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.188+0000 7f690eb1e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6908160f60 con 0x7f690815d850 2023-03-03T06:25:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.188+0000 7f690eb1e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6908160630 con 0x7f69080cb180 2023-03-03T06:25:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.188+0000 7f690eb1e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690815dc70 con 0x7f69080af280 2023-03-03T06:25:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.188+0000 7f690d0bb700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f690815d850 0x7f69080ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33510/0 (socket says 172.21.15.5:33510) 2023-03-03T06:25:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.188+0000 7f690d0bb700 1 -- 172.21.15.5:0/3773458508 learned_addr learned my addr 172.21.15.5:0/3773458508 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:00.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906076007 0 0) 0x7f6908160f60 con 0x7f690815d850 2023-03-03T06:25:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f690c8ba700 1 --2- 172.21.15.5:0/3773458508 >> v2:172.21.15.191:3300/0 conn(0x7f69080af280 0x7f69080cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68f80035b0 con 0x7f690815d850 2023-03-03T06:25:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 991115544 0 0) 0x7f68f80035b0 con 0x7f690815d850 2023-03-03T06:25:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 >> v2:172.21.15.191:3300/0 conn(0x7f69080af280 msgr2=0x7f69080cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 --2- 172.21.15.5:0/3773458508 >> v2:172.21.15.191:3300/0 conn(0x7f69080af280 0x7f69080cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 >> v1:172.21.15.191:6789/0 conn(0x7f69080cb180 legacy=0x7f690815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:00.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6908160910 con 0x7f690815d850 2023-03-03T06:25:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f69000019f0 con 0x7f690815d850 2023-03-03T06:25:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 >> v1:172.21.15.5:6789/0 conn(0x7f690815d850 legacy=0x7f69080ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 --2- 172.21.15.5:0/3773458508 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f8003a70 0x7f68f8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 --2- 172.21.15.5:0/3773458508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f8004850 0x7f68f8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 --2- 172.21.15.5:0/3773458508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f8005250 0x7f68f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690815dc70 con 0x7f68f8004850 2023-03-03T06:25:00.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f800c190 con 0x7f68f8005250 2023-03-03T06:25:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f800c350 con 0x7f68f8003a70 2023-03-03T06:25:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f6907fff700 1 --2- 172.21.15.5:0/3773458508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f8004850 0x7f68f8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f690c8ba700 1 --2- 172.21.15.5:0/3773458508 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f8003a70 0x7f68f8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f690d0bb700 1 --2- 172.21.15.5:0/3773458508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f8005250 0x7f68f800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f6907fff700 1 -- 172.21.15.5:0/3773458508 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f8003a70 msgr2=0x7f68f8003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f6907fff700 1 --2- 172.21.15.5:0/3773458508 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f8003a70 0x7f68f8003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f6907fff700 1 -- 172.21.15.5:0/3773458508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f8005250 msgr2=0x7f68f800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f6907fff700 1 --2- 172.21.15.5:0/3773458508 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f8005250 0x7f68f800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f6907fff700 1 -- 172.21.15.5:0/3773458508 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f80035b0 con 0x7f68f8004850 2023-03-03T06:25:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.189+0000 7f690d0bb700 1 -- 172.21.15.5:0/3773458508 reap_dead start 2023-03-03T06:25:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.190+0000 7f6907fff700 1 --2- 172.21.15.5:0/3773458508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f8004850 0x7f68f8004cc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f68f4007fd0 tx=0x7f68f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ac1232f30db08c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.190+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f40012f0 con 0x7f68f8004850 2023-03-03T06:25:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.190+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f4005310 con 0x7f68f8004850 2023-03-03T06:25:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.190+0000 7f69077fe700 1 -- 172.21.15.5:0/3773458508 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4006860 con 0x7f68f8004850 2023-03-03T06:25:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.190+0000 7f690eb1e700 1 -- 172.21.15.5:0/3773458508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f8004850 msgr2=0x7f68f8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.190+0000 7f690eb1e700 1 --2- 172.21.15.5:0/3773458508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f8004850 0x7f68f8004cc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f68f4007fd0 tx=0x7f68f8005880 comp rx=0 tx=0).stop 2023-03-03T06:25:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.190+0000 7f690eb1e700 1 -- 172.21.15.5:0/3773458508 shutdown_connections 2023-03-03T06:25:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.190+0000 7f690eb1e700 1 --2- 172.21.15.5:0/3773458508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f8004850 0x7f68f8004cc0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.190+0000 7f690eb1e700 1 -- 172.21.15.5:0/3773458508 >> 172.21.15.5:0/3773458508 conn(0x7f69080cfd00 msgr2=0x7f69080d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.190+0000 7f690eb1e700 1 -- 172.21.15.5:0/3773458508 shutdown_connections 2023-03-03T06:25:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.190+0000 7f690eb1e700 1 -- 172.21.15.5:0/3773458508 wait complete. 2023-03-03T06:25:00.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.192+0000 7f690eb1e700 1 Processor -- start 2023-03-03T06:25:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.192+0000 7f690eb1e700 1 -- start start 2023-03-03T06:25:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.193+0000 7f690eb1e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f8004850 0x7f690806be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.193+0000 7f690eb1e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69080c5e10 0x7f69080c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.193+0000 7f690eb1e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69080c38a0 0x7f69080c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.193+0000 7f690eb1e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69081f5740 con 0x7f68f8004850 2023-03-03T06:25:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.193+0000 7f690eb1e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69080c67c0 con 0x7f69080c38a0 2023-03-03T06:25:00.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.193+0000 7f690eb1e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69081f5990 con 0x7f69080c5e10 2023-03-03T06:25:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.193+0000 7f690c8ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f8004850 0x7f690806be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.193+0000 7f690c8ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f8004850 0x7f690806be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43676/0 (socket says 172.21.15.5:43676) 2023-03-03T06:25:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.193+0000 7f690c8ba700 1 -- 172.21.15.5:0/2991121603 learned_addr learned my addr 172.21.15.5:0/2991121603 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.194+0000 7f6907fff700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69080c5e10 0x7f69080c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.194+0000 7f690c8ba700 1 -- 172.21.15.5:0/2991121603 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69080c5e10 msgr2=0x7f69080c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.194+0000 7f690d0bb700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69080c38a0 0x7f69080c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:00.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.194+0000 7f690c8ba700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69080c5e10 0x7f69080c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.194+0000 7f690c8ba700 1 -- 172.21.15.5:0/2991121603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69080c38a0 msgr2=0x7f69080c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.194+0000 7f690c8ba700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69080c38a0 0x7f69080c3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.194+0000 7f690c8ba700 1 -- 172.21.15.5:0/2991121603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69080cac40 con 0x7f68f8004850 2023-03-03T06:25:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.194+0000 7f690c8ba700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f8004850 0x7f690806be00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0119d0 tx=0x7f68fc011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.194+0000 7f69057fa700 1 -- 172.21.15.5:0/2991121603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc009630 con 0x7f68f8004850 2023-03-03T06:25:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.194+0000 7f69057fa700 1 -- 172.21.15.5:0/2991121603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc004240 con 0x7f68f8004850 2023-03-03T06:25:00.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.194+0000 7f69057fa700 1 -- 172.21.15.5:0/2991121603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc00f730 con 0x7f68f8004850 2023-03-03T06:25:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.194+0000 7f690eb1e700 1 -- 172.21.15.5:0/2991121603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6908160bf0 con 0x7f68f8004850 2023-03-03T06:25:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.194+0000 7f690eb1e700 1 -- 172.21.15.5:0/2991121603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69080cadd0 con 0x7f68f8004850 2023-03-03T06:25:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.195+0000 7f690eb1e700 1 -- 172.21.15.5:0/2991121603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690804e6e0 con 0x7f68f8004850 2023-03-03T06:25:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.195+0000 7f69057fa700 1 -- 172.21.15.5:0/2991121603 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f68fc025070 con 0x7f68f8004850 2023-03-03T06:25:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.196+0000 7f69057fa700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f68ec0682f0 0x7f68ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.196+0000 7f69057fa700 1 -- 172.21.15.5:0/2991121603 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f68fc086280 con 0x7f68f8004850 2023-03-03T06:25:00.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.196+0000 7f6907fff700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f68ec0682f0 0x7f68ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:00.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.196+0000 7f6907fff700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f68ec0682f0 0x7f68ec06a7a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f68f4007fd0 tx=0x7f68f4011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:00.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.200+0000 7f69057fa700 1 -- 172.21.15.5:0/2991121603 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f68fc052940 con 0x7f68f8004850 2023-03-03T06:25:00.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.434+0000 7f690eb1e700 1 -- 172.21.15.5:0/2991121603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69080b5c80 con 0x7f68f8004850 2023-03-03T06:25:00.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.435+0000 7f69057fa700 1 -- 172.21.15.5:0/2991121603 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f68fc055f60 con 0x7f68f8004850 2023-03-03T06:25:00.437 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:00.437 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/1485137346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1485137346},{"type":"v1","addr":"172.21.15.191:6834","nonce":1485137346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4886,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2062075895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2062075895},{"type":"v1","addr":"172.21.15.5:6837","nonce":2062075895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3463336232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":3463336232},{"type":"v1","addr":"172.21.15.191:6835","nonce":3463336232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:24:55.063168+0000","modified":"2023-03-03T06:24:58.081923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5098},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5098":{"gid":5098,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/3094337828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3094337828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3094337828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-03T06:25:00.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.436+0000 7f690eb1e700 1 -- 172.21.15.5:0/2991121603 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f68ec0682f0 msgr2=0x7f68ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:00.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.437+0000 7f690eb1e700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f68ec0682f0 0x7f68ec06a7a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f68f4007fd0 tx=0x7f68f4011000 comp rx=0 tx=0).stop 2023-03-03T06:25:00.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.437+0000 7f690eb1e700 1 -- 172.21.15.5:0/2991121603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f8004850 msgr2=0x7f690806be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:00.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.437+0000 7f690eb1e700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f8004850 0x7f690806be00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0119d0 tx=0x7f68fc011d90 comp rx=0 tx=0).stop 2023-03-03T06:25:00.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.437+0000 7f690eb1e700 1 -- 172.21.15.5:0/2991121603 shutdown_connections 2023-03-03T06:25:00.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.437+0000 7f690eb1e700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69080c38a0 0x7f69080c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.437+0000 7f690eb1e700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f8004850 0x7f690806be00 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.437+0000 7f690eb1e700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f68ec0682f0 0x7f68ec06a7a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.437+0000 7f690eb1e700 1 --2- 172.21.15.5:0/2991121603 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f69080c5e10 0x7f69080c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.437+0000 7f690eb1e700 1 -- 172.21.15.5:0/2991121603 >> 172.21.15.5:0/2991121603 conn(0x7f69080cfd00 msgr2=0x7f69080cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:00.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.437+0000 7f690eb1e700 1 -- 172.21.15.5:0/2991121603 shutdown_connections 2023-03-03T06:25:00.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.437+0000 7f690eb1e700 1 -- 172.21.15.5:0/2991121603 wait complete. 2023-03-03T06:25:00.441 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2023-03-03T06:25:00.853 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-03T06:24:55.063168+0000', 'modified': '2023-03-03T06:24:58.081923+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5098}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5098': {'gid': 5098, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6836/3094337828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6835', 'nonce': 3094337828}, {'type': 'v1', 'addr': '172.21.15.5:6836', 'nonce': 3094337828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-03T06:25:00.854 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-03T06:25:00.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-03-03T06:25:00.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.983+0000 7fad09830700 1 Processor -- start 2023-03-03T06:25:00.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.983+0000 7fad09830700 1 -- start start 2023-03-03T06:25:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.984+0000 7fad09830700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fad0406c830 0x7fad04160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.984+0000 7fad09830700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad040cf2a0 0x7fad040d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.984+0000 7fad09830700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad040d2e10 con 0x7fad040b8a40 2023-03-03T06:25:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.984+0000 7fad09830700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad04161490 con 0x7fad0406c830 2023-03-03T06:25:00.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.984+0000 7fad09830700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad040cd8d0 con 0x7fad040cf2a0 2023-03-03T06:25:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.984+0000 7fad027fc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fad0406c830 0x7fad04160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.984+0000 7fad037fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad040cf2a0 0x7fad040d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.984+0000 7fad027fc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fad0406c830 0x7fad04160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:44046/0 (socket says 172.21.15.5:44046) 2023-03-03T06:25:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.984+0000 7fad037fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad040cf2a0 0x7fad040d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:41766/0 (socket says 172.21.15.5:41766) 2023-03-03T06:25:00.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.984+0000 7fad027fc700 1 -- 172.21.15.5:0/3159085794 learned_addr learned my addr 172.21.15.5:0/3159085794 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.984+0000 7fad02ffd700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fad040b8a40 0x7fad0406c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:48054/0 (socket says 172.21.15.5:48054) 2023-03-03T06:25:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.985+0000 7fad037fe700 1 -- 172.21.15.5:0/3159085794 >> v2:172.21.15.191:3300/0 conn(0x7fad0406c830 msgr2=0x7fad04160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.985+0000 7fad037fe700 1 --2- 172.21.15.5:0/3159085794 >> v2:172.21.15.191:3300/0 conn(0x7fad0406c830 0x7fad04160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.985+0000 7fad037fe700 1 -- 172.21.15.5:0/3159085794 >> v1:172.21.15.191:6789/0 conn(0x7fad040b8a40 legacy=0x7fad0406c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.985+0000 7fad037fe700 1 -- 172.21.15.5:0/3159085794 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040d2520 con 0x7fad040cf2a0 2023-03-03T06:25:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.985+0000 7fad027fc700 1 --2- 172.21.15.5:0/3159085794 >> v2:172.21.15.191:3300/0 conn(0x7fad0406c830 0x7fad04160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:00.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.985+0000 7fad037fe700 1 --2- 172.21.15.5:0/3159085794 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad040cf2a0 0x7fad040d0c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facfc009d90 tx=0x7facfc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f354e982ca1d7c8 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:00.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.985+0000 7fad01ffb700 1 -- 172.21.15.5:0/3159085794 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00e070 con 0x7fad040cf2a0 2023-03-03T06:25:00.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.985+0000 7fad01ffb700 1 -- 172.21.15.5:0/3159085794 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc00bb20 con 0x7fad040cf2a0 2023-03-03T06:25:00.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.985+0000 7fad01ffb700 1 -- 172.21.15.5:0/3159085794 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc012430 con 0x7fad040cf2a0 2023-03-03T06:25:00.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.986+0000 7fad09830700 1 -- 172.21.15.5:0/3159085794 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad040cf2a0 msgr2=0x7fad040d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.986+0000 7fad09830700 1 --2- 172.21.15.5:0/3159085794 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad040cf2a0 0x7fad040d0c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facfc009d90 tx=0x7facfc00b330 comp rx=0 tx=0).stop 2023-03-03T06:25:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.986+0000 7fad09830700 1 -- 172.21.15.5:0/3159085794 shutdown_connections 2023-03-03T06:25:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.986+0000 7fad09830700 1 --2- 172.21.15.5:0/3159085794 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad040cf2a0 0x7fad040d0c20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.986+0000 7fad09830700 1 --2- 172.21.15.5:0/3159085794 >> v2:172.21.15.191:3300/0 conn(0x7fad0406c830 0x7fad04160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.986+0000 7fad09830700 1 -- 172.21.15.5:0/3159085794 >> 172.21.15.5:0/3159085794 conn(0x7fad040d05d0 msgr2=0x7fad040d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:00.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.986+0000 7fad09830700 1 -- 172.21.15.5:0/3159085794 shutdown_connections 2023-03-03T06:25:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.986+0000 7fad09830700 1 -- 172.21.15.5:0/3159085794 wait complete. 2023-03-03T06:25:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.987+0000 7fad09830700 1 Processor -- start 2023-03-03T06:25:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.987+0000 7fad09830700 1 -- start start 2023-03-03T06:25:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad09830700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad0406c830 0x7fad040c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad09830700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad040b8a40 0x7fad040b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad09830700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad040cf2a0 0x7fad040cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad09830700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad040c87d0 con 0x7fad0406c830 2023-03-03T06:25:00.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad09830700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad040c8ab0 con 0x7fad040b8a40 2023-03-03T06:25:00.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad09830700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad040c8d90 con 0x7fad040cf2a0 2023-03-03T06:25:00.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad02ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad0406c830 0x7fad040c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:00.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad02ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad0406c830 0x7fad040c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43690/0 (socket says 172.21.15.5:43690) 2023-03-03T06:25:00.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad02ffd700 1 -- 172.21.15.5:0/4140101762 learned_addr learned my addr 172.21.15.5:0/4140101762 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:00.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad037fe700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad040cf2a0 0x7fad040cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:00.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad027fc700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad040b8a40 0x7fad040b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:00.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad02ffd700 1 -- 172.21.15.5:0/4140101762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad040cf2a0 msgr2=0x7fad040cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:00.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad02ffd700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad040cf2a0 0x7fad040cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad02ffd700 1 -- 172.21.15.5:0/4140101762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad040b8a40 msgr2=0x7fad040b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:00.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad02ffd700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad040b8a40 0x7fad040b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:00.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad02ffd700 1 -- 172.21.15.5:0/4140101762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf4009550 con 0x7fad0406c830 2023-03-03T06:25:00.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad027fc700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad040b8a40 0x7fad040b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:00.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad037fe700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad040cf2a0 0x7fad040cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:00.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.988+0000 7fad02ffd700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad0406c830 0x7fad040c9870 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7facf800c520 tx=0x7facf800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:00.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.989+0000 7facebfff700 1 -- 172.21.15.5:0/4140101762 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8005cb0 con 0x7fad0406c830 2023-03-03T06:25:00.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.989+0000 7facebfff700 1 -- 172.21.15.5:0/4140101762 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf8005e10 con 0x7fad0406c830 2023-03-03T06:25:00.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.989+0000 7fad09830700 1 -- 172.21.15.5:0/4140101762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc009a70 con 0x7fad0406c830 2023-03-03T06:25:00.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.989+0000 7facebfff700 1 -- 172.21.15.5:0/4140101762 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf80072d0 con 0x7fad0406c830 2023-03-03T06:25:00.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.989+0000 7fad09830700 1 -- 172.21.15.5:0/4140101762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad040d2850 con 0x7fad0406c830 2023-03-03T06:25:00.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.990+0000 7facebfff700 1 -- 172.21.15.5:0/4140101762 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7facf8019030 con 0x7fad0406c830 2023-03-03T06:25:00.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.990+0000 7facebfff700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7facf00682f0 0x7facf006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:00.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.991+0000 7facebfff700 1 -- 172.21.15.5:0/4140101762 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7facf8084ec0 con 0x7fad0406c830 2023-03-03T06:25:00.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.991+0000 7fad027fc700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7facf00682f0 0x7facf006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.991+0000 7fad027fc700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7facf00682f0 0x7facf006a7a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fad0415bf60 tx=0x7facf4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:01.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.993+0000 7fad159b9b80 1 Processor -- start 2023-03-03T06:25:01.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.993+0000 7fad159b9b80 1 -- start start 2023-03-03T06:25:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.993+0000 7fad159b9b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef91d70 0x55d59ef731f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.993+0000 7fad159b9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 0x55d59ef92140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.993+0000 7fad159b9b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef9cc20 0x55d59ef9d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad159b9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d59ee5cbc0 con 0x55d59ef702e0 2023-03-03T06:25:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad159b9b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d59eecb350 con 0x55d59ef91d70 2023-03-03T06:25:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad159b9b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d59eec4880 con 0x55d59ef9cc20 2023-03-03T06:25:01.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad027fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 0x55d59ef92140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad027fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 0x55d59ef92140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43700/0 (socket says 172.21.15.5:43700) 2023-03-03T06:25:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad027fc700 1 -- 172.21.15.5:0/2950833093 learned_addr learned my addr 172.21.15.5:0/2950833093 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad037fe700 1 --2- 172.21.15.5:0/2950833093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef9cc20 0x55d59ef9d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad02ffd700 1 --2- 172.21.15.5:0/2950833093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef91d70 0x55d59ef731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad027fc700 1 -- 172.21.15.5:0/2950833093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef9cc20 msgr2=0x55d59ef9d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad027fc700 1 --2- 172.21.15.5:0/2950833093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef9cc20 0x55d59ef9d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad027fc700 1 -- 172.21.15.5:0/2950833093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef91d70 msgr2=0x55d59ef731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad027fc700 1 --2- 172.21.15.5:0/2950833093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef91d70 0x55d59ef731f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad027fc700 1 -- 172.21.15.5:0/2950833093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d59ed465e0 con 0x55d59ef702e0 2023-03-03T06:25:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad037fe700 1 --2- 172.21.15.5:0/2950833093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef9cc20 0x55d59ef9d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad02ffd700 1 --2- 172.21.15.5:0/2950833093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef91d70 0x55d59ef731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7fad027fc700 1 --2- 172.21.15.5:0/2950833093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 0x55d59ef92140 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7facf4010ba0 tx=0x7facf4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1c498a6fd0d7a6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7face97fa700 1 -- 172.21.15.5:0/2950833093 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4015c90 con 0x55d59ef702e0 2023-03-03T06:25:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7face97fa700 1 -- 172.21.15.5:0/2950833093 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf401a070 con 0x55d59ef702e0 2023-03-03T06:25:01.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.994+0000 7face97fa700 1 -- 172.21.15.5:0/2950833093 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4021440 con 0x55d59ef702e0 2023-03-03T06:25:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.995+0000 7fad159b9b80 1 -- 172.21.15.5:0/2950833093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 msgr2=0x55d59ef92140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.995+0000 7fad159b9b80 1 --2- 172.21.15.5:0/2950833093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 0x55d59ef92140 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7facf4010ba0 tx=0x7facf4013000 comp rx=0 tx=0).stop 2023-03-03T06:25:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.995+0000 7fad159b9b80 1 -- 172.21.15.5:0/2950833093 shutdown_connections 2023-03-03T06:25:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.995+0000 7fad159b9b80 1 --2- 172.21.15.5:0/2950833093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef9cc20 0x55d59ef9d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.995+0000 7fad159b9b80 1 --2- 172.21.15.5:0/2950833093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef91d70 0x55d59ef731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.995+0000 7fad159b9b80 1 --2- 172.21.15.5:0/2950833093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 0x55d59ef92140 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.995+0000 7fad159b9b80 1 -- 172.21.15.5:0/2950833093 >> 172.21.15.5:0/2950833093 conn(0x55d59ef67720 msgr2=0x55d59ef6cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.995+0000 7fad159b9b80 1 -- 172.21.15.5:0/2950833093 shutdown_connections 2023-03-03T06:25:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.995+0000 7fad159b9b80 1 -- 172.21.15.5:0/2950833093 wait complete. 2023-03-03T06:25:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.996+0000 7fad159b9b80 1 -- start start 2023-03-03T06:25:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.996+0000 7fad159b9b80 1 Processor -- start 2023-03-03T06:25:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.996+0000 7fad159b9b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef702e0 0x55d59efaecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.996+0000 7fad159b9b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef91d70 0x55d59ef6ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.996+0000 7fad159b9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 0x55d59ef6f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.996+0000 7fad159b9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d59ed488d0 con 0x55d59ef9cc20 2023-03-03T06:25:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.996+0000 7fad159b9b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d59ef925a0 con 0x55d59ef702e0 2023-03-03T06:25:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.996+0000 7fad159b9b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d59efaf5f0 con 0x55d59ef91d70 2023-03-03T06:25:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad159b9b80 10 client.0 _ll_register_callbacks cb 0x55d59ee62630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T06:25:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad037fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 0x55d59ef6f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad037fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 0x55d59ef6f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43708/0 (socket says 172.21.15.5:43708) 2023-03-03T06:25:01.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad037fe700 1 -- 172.21.15.5:0/3582803530 learned_addr learned my addr 172.21.15.5:0/3582803530 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad02ffd700 1 --2- 172.21.15.5:0/3582803530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef702e0 0x55d59efaecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad027fc700 1 --2- 172.21.15.5:0/3582803530 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef91d70 0x55d59ef6ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad037fe700 1 -- 172.21.15.5:0/3582803530 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef91d70 msgr2=0x55d59ef6ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad037fe700 1 --2- 172.21.15.5:0/3582803530 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef91d70 0x55d59ef6ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad037fe700 1 -- 172.21.15.5:0/3582803530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef702e0 msgr2=0x55d59efaecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad037fe700 1 --2- 172.21.15.5:0/3582803530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef702e0 0x55d59efaecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad037fe700 1 -- 172.21.15.5:0/3582803530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf400e050 con 0x55d59ef9cc20 2023-03-03T06:25:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad037fe700 1 --2- 172.21.15.5:0/3582803530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 0x55d59ef6f010 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fad040cda10 tx=0x7facfc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c788735d807d8eb0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7face27fc700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-03-03T06:25:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7face27fc700 1 -- 172.21.15.5:0/3582803530 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc012da0 con 0x55d59ef9cc20 2023-03-03T06:25:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7face27fc700 1 -- 172.21.15.5:0/3582803530 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7facfc023070 con 0x55d59ef9cc20 2023-03-03T06:25:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad159b9b80 1 -- 172.21.15.5:0/3582803530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d59ee92140 con 0x55d59ef9cc20 2023-03-03T06:25:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7face27fc700 1 -- 172.21.15.5:0/3582803530 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7facfc0098f0 con 0x55d59ef9cc20 2023-03-03T06:25:01.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad159b9b80 10 client.5517 fetch_fsmap learned FSMap version 17 2023-03-03T06:25:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.997+0000 7fad159b9b80 1 -- 172.21.15.5:0/3582803530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d59ecf2d90 con 0x55d59ef9cc20 2023-03-03T06:25:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.998+0000 7face27fc700 1 -- 172.21.15.5:0/3582803530 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d59ee92140 con 0x55d59ef9cc20 2023-03-03T06:25:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.998+0000 7face27fc700 1 -- 172.21.15.5:0/3582803530 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 17) v1 ==== 3106+0+0 (secure 0 0 0) 0x7facfc004040 con 0x55d59ef9cc20 2023-03-03T06:25:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.998+0000 7fad159b9b80 10 client.5517 fetch_fsmap finished waiting for FSMap version 17 2023-03-03T06:25:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.998+0000 7fad159b9b80 10 client.5517 resolve_mds: resolved name 'a' to daemon mds.a 2023-03-03T06:25:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.998+0000 7fad159b9b80 20 client.5517 populate_metadata read hostname 'smithi005' 2023-03-03T06:25:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.998+0000 7fad159b9b80 1 --2- 172.21.15.5:0/3582803530 >> [v2:172.21.15.5:6835/3094337828,v1:172.21.15.5:6836/3094337828] conn(0x55d59efb1550 0x55d59efb2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.998+0000 7fad159b9b80 4 client.5517 mds_command: new command op to 5098 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-03T06:25:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.998+0000 7fad159b9b80 1 -- 172.21.15.5:0/3582803530 --> [v2:172.21.15.5:6835/3094337828,v1:172.21.15.5:6836/3094337828] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d59ed48f10 con 0x55d59efb1550 2023-03-03T06:25:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.998+0000 7fad02ffd700 1 --2- 172.21.15.5:0/3582803530 >> [v2:172.21.15.5:6835/3094337828,v1:172.21.15.5:6836/3094337828] conn(0x55d59efb1550 0x55d59efb2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.998+0000 7face27fc700 10 client.5517 ms_handle_connect on v2:172.21.15.5:6835/3094337828 2023-03-03T06:25:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.998+0000 7fad02ffd700 1 --2- 172.21.15.5:0/3582803530 >> [v2:172.21.15.5:6835/3094337828,v1:172.21.15.5:6836/3094337828] conn(0x55d59efb1550 0x55d59efb2250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42bcb13359399ccb server_cookie=42c3bf99f7a27b99 in_seq=0 out_seq=0 2023-03-03T06:25:01.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7face27fc700 1 -- 172.21.15.5:0/3582803530 <== mds.0 v2:172.21.15.5:6835/3094337828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55d59ed48f10 con 0x55d59efb1550 2023-03-03T06:25:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7face27fc700 10 client.5517 handle_command_reply: tid=0 2023-03-03T06:25:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7fad159b9b80 1 client.5517 shutdown 2023-03-03T06:25:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7fad159b9b80 1 -- 172.21.15.5:0/3582803530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 msgr2=0x55d59ef6f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7fad159b9b80 1 --2- 172.21.15.5:0/3582803530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 0x55d59ef6f010 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fad040cda10 tx=0x7facfc004b40 comp rx=0 tx=0).stop 2023-03-03T06:25:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7fad159b9b80 1 -- 172.21.15.5:0/3582803530 shutdown_connections 2023-03-03T06:25:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7fad159b9b80 1 --2- 172.21.15.5:0/3582803530 >> [v2:172.21.15.5:6835/3094337828,v1:172.21.15.5:6836/3094337828] conn(0x55d59efb1550 0x55d59efb2250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7fad159b9b80 1 --2- 172.21.15.5:0/3582803530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 0x55d59ef6f010 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7fad159b9b80 1 --2- 172.21.15.5:0/3582803530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef702e0 0x55d59efaecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7face27fc700 0 client.5517 ms_handle_reset on v2:172.21.15.5:6835/3094337828 2023-03-03T06:25:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7fad159b9b80 1 --2- 172.21.15.5:0/3582803530 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef91d70 0x55d59ef6ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7fad159b9b80 1 -- 172.21.15.5:0/3582803530 >> 172.21.15.5:0/3582803530 conn(0x55d59ef67720 msgr2=0x55d59ef955c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7fad159b9b80 1 -- 172.21.15.5:0/3582803530 shutdown_connections 2023-03-03T06:25:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7fad159b9b80 1 -- 172.21.15.5:0/3582803530 wait complete. 2023-03-03T06:25:01.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:00.999+0000 7fad159b9b80 20 client.5517 trim_cache size 0 max 16384 2023-03-03T06:25:01.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.017+0000 7fad159b9b80 1 Processor -- start 2023-03-03T06:25:01.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.017+0000 7fad159b9b80 1 -- start start 2023-03-03T06:25:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad159b9b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef702e0 0x55d59ef6cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad159b9b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef91d70 0x55d59efb7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad159b9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 0x55d59efb80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad159b9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d59ef724a0 con 0x55d59ef9cc20 2023-03-03T06:25:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad159b9b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d59ef94830 con 0x55d59ef702e0 2023-03-03T06:25:01.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad159b9b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d59ef95760 con 0x55d59ef91d70 2023-03-03T06:25:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad037fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 0x55d59efb80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad037fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 0x55d59efb80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43716/0 (socket says 172.21.15.5:43716) 2023-03-03T06:25:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad037fe700 1 -- 172.21.15.5:0/3489083488 learned_addr learned my addr 172.21.15.5:0/3489083488 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad027fc700 1 --2- 172.21.15.5:0/3489083488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef91d70 0x55d59efb7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad02ffd700 1 --2- 172.21.15.5:0/3489083488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef702e0 0x55d59ef6cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad037fe700 1 -- 172.21.15.5:0/3489083488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef91d70 msgr2=0x55d59efb7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:01.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad037fe700 1 --2- 172.21.15.5:0/3489083488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef91d70 0x55d59efb7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad037fe700 1 -- 172.21.15.5:0/3489083488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef702e0 msgr2=0x55d59ef6cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:01.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.018+0000 7fad037fe700 1 --2- 172.21.15.5:0/3489083488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef702e0 0x55d59ef6cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.019+0000 7fad037fe700 1 -- 172.21.15.5:0/3489083488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d59ee8b140 con 0x55d59ef9cc20 2023-03-03T06:25:01.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.019+0000 7fad037fe700 1 --2- 172.21.15.5:0/3489083488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 0x55d59efb80b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7facfc00d010 tx=0x7facfc01f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b02296f69d67346 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:01.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.019+0000 7face9ffb700 1 -- 172.21.15.5:0/3489083488 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00e070 con 0x55d59ef9cc20 2023-03-03T06:25:01.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.019+0000 7face9ffb700 1 -- 172.21.15.5:0/3489083488 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc021070 con 0x55d59ef9cc20 2023-03-03T06:25:01.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.019+0000 7face9ffb700 1 -- 172.21.15.5:0/3489083488 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc004940 con 0x55d59ef9cc20 2023-03-03T06:25:01.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.019+0000 7fad159b9b80 1 -- 172.21.15.5:0/3489083488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 msgr2=0x55d59efb80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:01.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.019+0000 7fad159b9b80 1 --2- 172.21.15.5:0/3489083488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 0x55d59efb80b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7facfc00d010 tx=0x7facfc01f070 comp rx=0 tx=0).stop 2023-03-03T06:25:01.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.019+0000 7fad159b9b80 1 -- 172.21.15.5:0/3489083488 shutdown_connections 2023-03-03T06:25:01.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.019+0000 7fad159b9b80 1 --2- 172.21.15.5:0/3489083488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef9cc20 0x55d59efb80b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.019+0000 7fad159b9b80 1 --2- 172.21.15.5:0/3489083488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef702e0 0x55d59ef6cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.019+0000 7fad159b9b80 1 --2- 172.21.15.5:0/3489083488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef91d70 0x55d59efb7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.019+0000 7fad159b9b80 1 -- 172.21.15.5:0/3489083488 >> 172.21.15.5:0/3489083488 conn(0x55d59ef67720 msgr2=0x55d59ef729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:01.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.020+0000 7fad159b9b80 1 -- 172.21.15.5:0/3489083488 shutdown_connections 2023-03-03T06:25:01.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.020+0000 7fad159b9b80 1 -- 172.21.15.5:0/3489083488 wait complete. 2023-03-03T06:25:01.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.020+0000 7fad159b9b80 1 -- start start 2023-03-03T06:25:01.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.020+0000 7fad159b9b80 1 Processor -- start 2023-03-03T06:25:01.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad159b9b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 0x55d59ef97d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad159b9b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef91d70 0x55d59efb7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad159b9b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef9cc20 0x55d59efb80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad159b9b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d59ef6bc70 con 0x55d59ef702e0 2023-03-03T06:25:01.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad159b9b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d59ef6dab0 con 0x55d59ef91d70 2023-03-03T06:25:01.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad159b9b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d59ef6e2c0 con 0x55d59ef9cc20 2023-03-03T06:25:01.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad159b9b80 10 client.0 _ll_register_callbacks cb 0x55d59ee62630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T06:25:01.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad02ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 0x55d59ef97d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad02ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 0x55d59ef97d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43718/0 (socket says 172.21.15.5:43718) 2023-03-03T06:25:01.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad02ffd700 1 -- 172.21.15.5:0/2733327542 learned_addr learned my addr 172.21.15.5:0/2733327542 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:01.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad027fc700 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef91d70 0x55d59efb7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad037fe700 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef9cc20 0x55d59efb80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad02ffd700 1 -- 172.21.15.5:0/2733327542 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef9cc20 msgr2=0x55d59efb80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad02ffd700 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef9cc20 0x55d59efb80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad02ffd700 1 -- 172.21.15.5:0/2733327542 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef91d70 msgr2=0x55d59efb7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad02ffd700 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef91d70 0x55d59efb7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad02ffd700 1 -- 172.21.15.5:0/2733327542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d59ecf2d90 con 0x55d59ef702e0 2023-03-03T06:25:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad027fc700 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef91d70 0x55d59efb7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad037fe700 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef9cc20 0x55d59efb80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:01.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7fad02ffd700 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 0x55d59ef97d30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7facf800cce0 tx=0x7facf8054b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42c6d0f10a99d76 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:01.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.021+0000 7face27fc700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-03-03T06:25:01.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7face27fc700 1 -- 172.21.15.5:0/2733327542 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8051140 con 0x55d59ef702e0 2023-03-03T06:25:01.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7face27fc700 1 -- 172.21.15.5:0/2733327542 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7facf80512a0 con 0x55d59ef702e0 2023-03-03T06:25:01.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7fad159b9b80 1 -- 172.21.15.5:0/2733327542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d59ee82160 con 0x55d59ef702e0 2023-03-03T06:25:01.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7face27fc700 1 -- 172.21.15.5:0/2733327542 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7facf8051460 con 0x55d59ef702e0 2023-03-03T06:25:01.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7fad159b9b80 10 client.5523 fetch_fsmap learned FSMap version 17 2023-03-03T06:25:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7fad159b9b80 1 -- 172.21.15.5:0/2733327542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d59ed19200 con 0x55d59ef702e0 2023-03-03T06:25:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7face27fc700 1 -- 172.21.15.5:0/2733327542 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d59ee82160 con 0x55d59ef702e0 2023-03-03T06:25:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7face27fc700 1 -- 172.21.15.5:0/2733327542 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 17) v1 ==== 3106+0+0 (secure 0 0 0) 0x7facf80542b0 con 0x55d59ef702e0 2023-03-03T06:25:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7fad159b9b80 10 client.5523 fetch_fsmap finished waiting for FSMap version 17 2023-03-03T06:25:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7fad159b9b80 10 client.5523 resolve_mds: resolved name 'a' to daemon mds.a 2023-03-03T06:25:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7fad159b9b80 20 client.5523 populate_metadata read hostname 'smithi005' 2023-03-03T06:25:01.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7fad159b9b80 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.5:6835/3094337828,v1:172.21.15.5:6836/3094337828] conn(0x55d59ef91370 0x55d59ef91740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7fad159b9b80 4 client.5523 mds_command: new command op to 5098 tid=0[{"prefix": "status"}] 2023-03-03T06:25:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7fad159b9b80 1 -- 172.21.15.5:0/2733327542 --> [v2:172.21.15.5:6835/3094337828,v1:172.21.15.5:6836/3094337828] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d59ee6c170 con 0x55d59ef91370 2023-03-03T06:25:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7fad027fc700 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.5:6835/3094337828,v1:172.21.15.5:6836/3094337828] conn(0x55d59ef91370 0x55d59ef91740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7face27fc700 10 client.5523 ms_handle_connect on v2:172.21.15.5:6835/3094337828 2023-03-03T06:25:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.022+0000 7fad027fc700 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.5:6835/3094337828,v1:172.21.15.5:6836/3094337828] conn(0x55d59ef91370 0x55d59ef91740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=817d74a1a0f4ab8d server_cookie=c7a0d8ef03845f58 in_seq=0 out_seq=0 2023-03-03T06:25:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7face27fc700 1 -- 172.21.15.5:0/2733327542 <== mds.0 v2:172.21.15.5:6835/3094337828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55d59ee6c170 con 0x55d59ef91370 2023-03-03T06:25:01.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7face27fc700 10 client.5523 handle_command_reply: tid=0 2023-03-03T06:25:01.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad159b9b80 1 client.5523 shutdown 2023-03-03T06:25:01.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad159b9b80 1 -- 172.21.15.5:0/2733327542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 msgr2=0x55d59ef97d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:01.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad159b9b80 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 0x55d59ef97d30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7facf800cce0 tx=0x7facf8054b20 comp rx=0 tx=0).stop 2023-03-03T06:25:01.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad159b9b80 1 -- 172.21.15.5:0/2733327542 shutdown_connections 2023-03-03T06:25:01.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad159b9b80 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.5:6835/3094337828,v1:172.21.15.5:6836/3094337828] conn(0x55d59ef91370 0x55d59ef91740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad159b9b80 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d59ef9cc20 0x55d59efb80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7face27fc700 0 client.5523 ms_handle_reset on v2:172.21.15.5:6835/3094337828 2023-03-03T06:25:01.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad159b9b80 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d59ef702e0 0x55d59ef97d30 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad159b9b80 1 --2- 172.21.15.5:0/2733327542 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d59ef91d70 0x55d59efb7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad159b9b80 1 -- 172.21.15.5:0/2733327542 >> 172.21.15.5:0/2733327542 conn(0x55d59ef67720 msgr2=0x55d59efc62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:01.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad159b9b80 1 -- 172.21.15.5:0/2733327542 shutdown_connections 2023-03-03T06:25:01.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad159b9b80 1 -- 172.21.15.5:0/2733327542 wait complete. 2023-03-03T06:25:01.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad159b9b80 20 client.5523 trim_cache size 0 max 16384 2023-03-03T06:25:01.037 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-03-03T06:25:01.037 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6", 2023-03-03T06:25:01.037 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-03-03T06:25:01.038 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5098, 2023-03-03T06:25:01.038 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-03-03T06:25:01.038 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-03-03T06:25:01.038 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-03-03T06:25:01.038 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.9585653870000002, 2023-03-03T06:25:01.038 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 17, 2023-03-03T06:25:01.038 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 40, 2023-03-03T06:25:01.038 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 40, 2023-03-03T06:25:01.039 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 13.265388041 2023-03-03T06:25:01.039 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-03-03T06:25:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad09830700 1 -- 172.21.15.5:0/4140101762 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7facf00682f0 msgr2=0x7facf006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad09830700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7facf00682f0 0x7facf006a7a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fad0415bf60 tx=0x7facf4008040 comp rx=0 tx=0).stop 2023-03-03T06:25:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad09830700 1 -- 172.21.15.5:0/4140101762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad0406c830 msgr2=0x7fad040c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:01.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad09830700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad0406c830 0x7fad040c9870 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7facf800c520 tx=0x7facf800c8e0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad09830700 1 -- 172.21.15.5:0/4140101762 shutdown_connections 2023-03-03T06:25:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad09830700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7facf00682f0 0x7facf006a7a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad09830700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad040cf2a0 0x7fad040cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad09830700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad0406c830 0x7fad040c9870 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad09830700 1 --2- 172.21.15.5:0/4140101762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad040b8a40 0x7fad040b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.023+0000 7fad09830700 1 -- 172.21.15.5:0/4140101762 >> 172.21.15.5:0/4140101762 conn(0x7fad040d05d0 msgr2=0x7fad040b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:01.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.024+0000 7fad09830700 1 -- 172.21.15.5:0/4140101762 shutdown_connections 2023-03-03T06:25:01.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.024+0000 7fad09830700 1 -- 172.21.15.5:0/4140101762 wait complete. 2023-03-03T06:25:01.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-03T06:25:01.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.165+0000 7f9f5a974700 1 Processor -- start 2023-03-03T06:25:01.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.165+0000 7f9f5a974700 1 -- start start 2023-03-03T06:25:01.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.166+0000 7f9f5a974700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f5415cd40 0x7f9f540b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.166+0000 7f9f5a974700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f540cba50 0x7f9f540b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.166+0000 7f9f5a974700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5415d4e0 con 0x7f9f540cd3e0 2023-03-03T06:25:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.166+0000 7f9f5a974700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5415d7c0 con 0x7f9f540cba50 2023-03-03T06:25:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.166+0000 7f9f5a974700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5415daa0 con 0x7f9f5415cd40 2023-03-03T06:25:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.166+0000 7f9f537fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f540cba50 0x7f9f540b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.166+0000 7f9f537fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9f540cba50 0x7f9f540b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43726/0 (socket says 172.21.15.5:43726) 2023-03-03T06:25:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.166+0000 7f9f537fe700 1 -- 172.21.15.5:0/703892925 learned_addr learned my addr 172.21.15.5:0/703892925 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.166+0000 7f9f53fff700 1 --2- 172.21.15.5:0/703892925 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f5415cd40 0x7f9f540b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.166+0000 7f9f537fe700 1 -- 172.21.15.5:0/703892925 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f5415cd40 msgr2=0x7f9f540b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:01.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.166+0000 7f9f537fe700 1 --2- 172.21.15.5:0/703892925 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f5415cd40 0x7f9f540b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.166+0000 7f9f537fe700 1 -- 172.21.15.5:0/703892925 >> v1:172.21.15.191:6789/0 conn(0x7f9f540cd3e0 legacy=0x7f9f54160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:01.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.166+0000 7f9f537fe700 1 -- 172.21.15.5:0/703892925 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5415dd80 con 0x7f9f540cba50 2023-03-03T06:25:01.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.167+0000 7f9f537fe700 1 --2- 172.21.15.5:0/703892925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f540cba50 0x7f9f540b1e10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c006fd0 tx=0x7f9f3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04f60d51581be9c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:01.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.167+0000 7f9f52ffd700 1 -- 172.21.15.5:0/703892925 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c005e30 con 0x7f9f540cba50 2023-03-03T06:25:01.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.167+0000 7f9f52ffd700 1 -- 172.21.15.5:0/703892925 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c004030 con 0x7f9f540cba50 2023-03-03T06:25:01.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.167+0000 7f9f52ffd700 1 -- 172.21.15.5:0/703892925 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0043e0 con 0x7f9f540cba50 2023-03-03T06:25:01.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.167+0000 7f9f5a974700 1 -- 172.21.15.5:0/703892925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f540cba50 msgr2=0x7f9f540b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:01.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.167+0000 7f9f5a974700 1 --2- 172.21.15.5:0/703892925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f540cba50 0x7f9f540b1e10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c006fd0 tx=0x7f9f3c009bd0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.167+0000 7f9f5a974700 1 -- 172.21.15.5:0/703892925 shutdown_connections 2023-03-03T06:25:01.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.167+0000 7f9f5a974700 1 --2- 172.21.15.5:0/703892925 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f5415cd40 0x7f9f540b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.167+0000 7f9f5a974700 1 --2- 172.21.15.5:0/703892925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f540cba50 0x7f9f540b1e10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.167+0000 7f9f5a974700 1 -- 172.21.15.5:0/703892925 >> 172.21.15.5:0/703892925 conn(0x7f9f540cc8d0 msgr2=0x7f9f540cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.167+0000 7f9f5a974700 1 -- 172.21.15.5:0/703892925 shutdown_connections 2023-03-03T06:25:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.167+0000 7f9f5a974700 1 -- 172.21.15.5:0/703892925 wait complete. 2023-03-03T06:25:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.169+0000 7f9f5a974700 1 Processor -- start 2023-03-03T06:25:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.169+0000 7f9f5a974700 1 -- start start 2023-03-03T06:25:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f5a974700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f540cba50 0x7f9f540c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f5a974700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f540cd3e0 0x7f9f540b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f5a974700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f5415cd40 0x7f9f540b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f5a974700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f540c5120 con 0x7f9f540cd3e0 2023-03-03T06:25:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f5a974700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f54156700 con 0x7f9f540cba50 2023-03-03T06:25:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f5a974700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f540c65f0 con 0x7f9f5415cd40 2023-03-03T06:25:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f537fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f540cd3e0 0x7f9f540b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f537fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f540cd3e0 0x7f9f540b3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43734/0 (socket says 172.21.15.5:43734) 2023-03-03T06:25:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f537fe700 1 -- 172.21.15.5:0/1910439690 learned_addr learned my addr 172.21.15.5:0/1910439690 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f53fff700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f540cba50 0x7f9f540c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f58f11700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f5415cd40 0x7f9f540b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f537fe700 1 -- 172.21.15.5:0/1910439690 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f5415cd40 msgr2=0x7f9f540b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f537fe700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f5415cd40 0x7f9f540b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f537fe700 1 -- 172.21.15.5:0/1910439690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f540cba50 msgr2=0x7f9f540c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f537fe700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f540cba50 0x7f9f540c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f537fe700 1 -- 172.21.15.5:0/1910439690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c009500 con 0x7f9f540cd3e0 2023-03-03T06:25:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f53fff700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f540cba50 0x7f9f540c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:01.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f537fe700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f540cd3e0 0x7f9f540b3dc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009c10 tx=0x7f9f3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f50ff9700 1 -- 172.21.15.5:0/1910439690 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c003d90 con 0x7f9f540cd3e0 2023-03-03T06:25:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f50ff9700 1 -- 172.21.15.5:0/1910439690 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c011420 con 0x7f9f540cd3e0 2023-03-03T06:25:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f5a974700 1 -- 172.21.15.5:0/1910439690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f540ca530 con 0x7f9f540cd3e0 2023-03-03T06:25:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f50ff9700 1 -- 172.21.15.5:0/1910439690 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0117d0 con 0x7f9f540cd3e0 2023-03-03T06:25:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.170+0000 7f9f5a974700 1 -- 172.21.15.5:0/1910439690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5415e060 con 0x7f9f540cd3e0 2023-03-03T06:25:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.171+0000 7f9f5a974700 1 -- 172.21.15.5:0/1910439690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5415d110 con 0x7f9f540cd3e0 2023-03-03T06:25:01.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.172+0000 7f9f50ff9700 1 -- 172.21.15.5:0/1910439690 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9f3c02c070 con 0x7f9f540cd3e0 2023-03-03T06:25:01.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.172+0000 7f9f50ff9700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9f340682f0 0x7f9f3406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:01.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.172+0000 7f9f50ff9700 1 -- 172.21.15.5:0/1910439690 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9f3c086fe0 con 0x7f9f540cd3e0 2023-03-03T06:25:01.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.172+0000 7f9f53fff700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9f340682f0 0x7f9f3406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:01.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.173+0000 7f9f53fff700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9f340682f0 0x7f9f3406a7a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400ba70 tx=0x7f9f44008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:01.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.177+0000 7f9f50ff9700 1 -- 172.21.15.5:0/1910439690 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9f3c0b85e0 con 0x7f9f540cd3e0 2023-03-03T06:25:01.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.412+0000 7f9f5a974700 1 -- 172.21.15.5:0/1910439690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9f540c6f00 con 0x7f9f540cd3e0 2023-03-03T06:25:01.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.412+0000 7f9f50ff9700 1 -- 172.21.15.5:0/1910439690 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9f3c016060 con 0x7f9f540cd3e0 2023-03-03T06:25:01.415 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-03T06:25:01.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.414+0000 7f9f5a974700 1 -- 172.21.15.5:0/1910439690 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9f340682f0 msgr2=0x7f9f3406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.414+0000 7f9f5a974700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9f340682f0 0x7f9f3406a7a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400ba70 tx=0x7f9f44008040 comp rx=0 tx=0).stop 2023-03-03T06:25:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.414+0000 7f9f5a974700 1 -- 172.21.15.5:0/1910439690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f540cd3e0 msgr2=0x7f9f540b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.414+0000 7f9f5a974700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f540cd3e0 0x7f9f540b3dc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009c10 tx=0x7f9f3c004750 comp rx=0 tx=0).stop 2023-03-03T06:25:01.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.414+0000 7f9f5a974700 1 -- 172.21.15.5:0/1910439690 shutdown_connections 2023-03-03T06:25:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.414+0000 7f9f5a974700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9f340682f0 0x7f9f3406a7a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.414+0000 7f9f5a974700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9f5415cd40 0x7f9f540b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.414+0000 7f9f5a974700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f540cba50 0x7f9f540c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.414+0000 7f9f5a974700 1 --2- 172.21.15.5:0/1910439690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f540cd3e0 0x7f9f540b3dc0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.414+0000 7f9f5a974700 1 -- 172.21.15.5:0/1910439690 >> 172.21.15.5:0/1910439690 conn(0x7f9f540cc8d0 msgr2=0x7f9f5406b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.414+0000 7f9f5a974700 1 -- 172.21.15.5:0/1910439690 shutdown_connections 2023-03-03T06:25:01.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:01.415+0000 7f9f5a974700 1 -- 172.21.15.5:0/1910439690 wait complete. 2023-03-03T06:25:01.429 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-03-03T06:25:01.429 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-03T06:25:01.429 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-03-03T06:25:01.430 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-03T06:25:01.430 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-03T06:25:01.430 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-03-03T06:25:01.431 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-03-03T06:25:01.431 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-03T06:25:01.431 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:25:01.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:01.432 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-03-03T06:25:01.449 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T06:25:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T06:25:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T06:25:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-03-03T06:25:01.450 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:01.451 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:25:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-03-03T06:25:01.451 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:25:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-03-03T06:25:01.451 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-03T06:25:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:25:01.451 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-03-03T06:25:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42442sec preferred_lft 42442sec 2023-03-03T06:25:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-03-03T06:25:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:01.452 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:25:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:25:01.452 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-03T06:25:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 6a:b3:10:0c:df:06 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:25:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-03-03T06:25:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::3415:96ff:fe7c:a178/64 scope link 2023-03-03T06:25:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:01.453 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-03T06:25:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 76:7c:c4:80:40:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-03T06:25:01.453 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::747c:c4ff:fe80:40be/64 scope link 2023-03-03T06:25:01.454 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:01.454 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-03T06:25:01.454 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 6a:b3:10:0c:df:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-03-03T06:25:01.454 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::68b3:10ff:fe0c:df06/64 scope link 2023-03-03T06:25:01.454 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:01.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:01.455 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-03T06:25:01.516 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-03-03T06:25:01.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:01.517 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-03-03T06:25:01.575 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-03-03T06:25:01.575 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-03T06:25:01.576 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-03-03T06:25:01.576 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-03-03T06:25:01.576 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-03T06:25:01.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:01.577 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:25:01.577 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:25:01.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-03-03T06:25:01.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-03-03T06:25:01.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-03-03T06:25:01.578 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:25:01.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:01.684 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-03-03T06:25:01.701 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-03-03T06:25:01.701 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-03-03T06:25:01.701 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:25:01.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:01.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-03-03T06:25:01.768 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:25:01.769 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-03T06:25:01.827 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:25:01.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:25:01.828 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-03T06:25:01.885 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-03-03T06:25:01.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:01.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:25:01.971 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:25:01.972 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:25:02.001 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:25:02.002 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:25:02.002 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:25:02.002 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:25:02.002 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:25:02.002 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:25:02.002 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:25:02.003 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:25:02.076 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:25:02.076 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:25:02.076 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:25:02.077 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:25:02.077 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:25:02.077 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:25:02.077 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:25:02.077 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:25:02.077 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790" 2023-03-03T06:25:02.078 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2023-03-03T06:25:02.078 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6" will pass to kernel 2023-03-03T06:25:02.079 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-03T06:25:02.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:02.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-03T06:25:02.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:02.109 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:25:02.190 INFO:teuthology.orchestra.run.smithi005.stdout:client4988 2023-03-03T06:25:02.190 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:25:02.191 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:02.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create snap-test-pool 2023-03-03T06:25:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.412+0000 7f344e910700 1 Processor -- start 2023-03-03T06:25:02.414 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.412+0000 7f344e910700 1 -- start start 2023-03-03T06:25:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f344e910700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34480b1f50 0x7f34480b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f344e910700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344806bcd0 con 0x7f34480b56d0 2023-03-03T06:25:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f344e910700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344806cce0 con 0x7f34481597d0 2023-03-03T06:25:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f344e910700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344806bf20 con 0x7f34480b1f50 2023-03-03T06:25:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f344cead700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f34480b56d0 0x7f34480cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33590/0 (socket says 172.21.15.5:33590) 2023-03-03T06:25:02.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f344cead700 1 -- 172.21.15.5:0/3847120878 learned_addr learned my addr 172.21.15.5:0/3847120878 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:02.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f34477fe700 1 --2- 172.21.15.5:0/3847120878 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34480b1f50 0x7f34480b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:02.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609833193 0 0) 0x7f344806bcd0 con 0x7f34480b56d0 2023-03-03T06:25:02.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34300035b0 con 0x7f34480b56d0 2023-03-03T06:25:02.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2999225520 0 0) 0x7f34300035b0 con 0x7f34480b56d0 2023-03-03T06:25:02.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34480b1f50 msgr2=0x7f34480b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:02.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 --2- 172.21.15.5:0/3847120878 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34480b1f50 0x7f34480b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:02.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 >> v1:172.21.15.191:6789/0 conn(0x7f34481597d0 legacy=0x7f34480b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:02.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344806c200 con 0x7f34480b56d0 2023-03-03T06:25:02.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f34400019f0 con 0x7f34480b56d0 2023-03-03T06:25:02.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 >> v1:172.21.15.5:6789/0 conn(0x7f34480b56d0 legacy=0x7f34480cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:02.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 --2- 172.21.15.5:0/3847120878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3430003a30 0x7f3430003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:02.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 --2- 172.21.15.5:0/3847120878 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34480b1f50 0x7f3430004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:02.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 --2- 172.21.15.5:0/3847120878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3430004d90 0x7f3430005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:02.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344806bf20 con 0x7f3430004d90 2023-03-03T06:25:02.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343000bac0 con 0x7f3430003a30 2023-03-03T06:25:02.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343000bc50 con 0x7f34480b1f50 2023-03-03T06:25:02.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.413+0000 7f344cead700 1 --2- 172.21.15.5:0/3847120878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3430004d90 0x7f3430005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:02.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.414+0000 7f3447fff700 1 --2- 172.21.15.5:0/3847120878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3430003a30 0x7f3430003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:02.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.414+0000 7f34477fe700 1 --2- 172.21.15.5:0/3847120878 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34480b1f50 0x7f3430004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:02.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.414+0000 7f344cead700 1 -- 172.21.15.5:0/3847120878 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34480b1f50 msgr2=0x7f3430004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:02.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.414+0000 7f344cead700 1 --2- 172.21.15.5:0/3847120878 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34480b1f50 0x7f3430004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:02.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.414+0000 7f344cead700 1 -- 172.21.15.5:0/3847120878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3430003a30 msgr2=0x7f3430003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:02.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.414+0000 7f344cead700 1 --2- 172.21.15.5:0/3847120878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3430003a30 0x7f3430003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:02.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.414+0000 7f344cead700 1 -- 172.21.15.5:0/3847120878 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34300035b0 con 0x7f3430004d90 2023-03-03T06:25:02.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.414+0000 7f344cead700 1 --2- 172.21.15.5:0/3847120878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3430004d90 0x7f3430005200 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f344000a830 tx=0x7f3430005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2fe43691a29a17 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:02.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.414+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344000a2f0 con 0x7f3430004d90 2023-03-03T06:25:02.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.414+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3440012620 con 0x7f3430004d90 2023-03-03T06:25:02.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.414+0000 7f3446ffd700 1 -- 172.21.15.5:0/3847120878 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34400129d0 con 0x7f3430004d90 2023-03-03T06:25:02.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.415+0000 7f344e910700 1 -- 172.21.15.5:0/3847120878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3430004d90 msgr2=0x7f3430005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:02.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.415+0000 7f344e910700 1 --2- 172.21.15.5:0/3847120878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3430004d90 0x7f3430005200 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f344000a830 tx=0x7f3430005880 comp rx=0 tx=0).stop 2023-03-03T06:25:02.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.415+0000 7f344cead700 1 -- 172.21.15.5:0/3847120878 reap_dead start 2023-03-03T06:25:02.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.415+0000 7f344e910700 1 -- 172.21.15.5:0/3847120878 shutdown_connections 2023-03-03T06:25:02.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.415+0000 7f344e910700 1 -- 172.21.15.5:0/3847120878 >> 172.21.15.5:0/3847120878 conn(0x7f34480cc840 msgr2=0x7f34480ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:02.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.415+0000 7f344e910700 1 -- 172.21.15.5:0/3847120878 shutdown_connections 2023-03-03T06:25:02.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.415+0000 7f344e910700 1 -- 172.21.15.5:0/3847120878 wait complete. 2023-03-03T06:25:02.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.416+0000 7f344e910700 1 Processor -- start 2023-03-03T06:25:02.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.416+0000 7f344e910700 1 -- start start 2023-03-03T06:25:02.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f344e910700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34481e63f0 0x7f3448152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:02.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f344e910700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3448152d60 0x7f344814d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:02.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f344e910700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34481e67c0 0x7f344814d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:02.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f344e910700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34480b3840 con 0x7f34481e63f0 2023-03-03T06:25:02.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f344e910700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34480b3b20 con 0x7f3448152d60 2023-03-03T06:25:02.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f344e910700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3448159f90 con 0x7f34481e67c0 2023-03-03T06:25:02.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f3447fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34481e63f0 0x7f3448152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:02.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f3447fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34481e63f0 0x7f3448152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43756/0 (socket says 172.21.15.5:43756) 2023-03-03T06:25:02.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f3447fff700 1 -- 172.21.15.5:0/976555221 learned_addr learned my addr 172.21.15.5:0/976555221 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:02.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f344cead700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34481e67c0 0x7f344814d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:02.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f34477fe700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3448152d60 0x7f344814d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:02.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f3447fff700 1 -- 172.21.15.5:0/976555221 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34481e67c0 msgr2=0x7f344814d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:02.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f3447fff700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34481e67c0 0x7f344814d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f3447fff700 1 -- 172.21.15.5:0/976555221 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3448152d60 msgr2=0x7f344814d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f3447fff700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3448152d60 0x7f344814d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.417+0000 7f3447fff700 1 -- 172.21.15.5:0/976555221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344806c7c0 con 0x7f34481e63f0 2023-03-03T06:25:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.418+0000 7f3447fff700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34481e63f0 0x7f3448152820 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f343800f7f0 tx=0x7f343800fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.418+0000 7f3444ff9700 1 -- 172.21.15.5:0/976555221 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34380013a0 con 0x7f34481e63f0 2023-03-03T06:25:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.418+0000 7f3444ff9700 1 -- 172.21.15.5:0/976555221 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34380052e0 con 0x7f34481e63f0 2023-03-03T06:25:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.418+0000 7f344e910700 1 -- 172.21.15.5:0/976555221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344806c4e0 con 0x7f34481e63f0 2023-03-03T06:25:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.418+0000 7f3444ff9700 1 -- 172.21.15.5:0/976555221 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3438003680 con 0x7f34481e63f0 2023-03-03T06:25:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.418+0000 7f344e910700 1 -- 172.21.15.5:0/976555221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3448159ba0 con 0x7f34481e63f0 2023-03-03T06:25:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.419+0000 7f344e910700 1 -- 172.21.15.5:0/976555221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3448159df0 con 0x7f34481e63f0 2023-03-03T06:25:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.419+0000 7f3444ff9700 1 -- 172.21.15.5:0/976555221 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f34380037e0 con 0x7f34481e63f0 2023-03-03T06:25:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.420+0000 7f3444ff9700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f34340682f0 0x7f343406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.420+0000 7f3444ff9700 1 -- 172.21.15.5:0/976555221 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3438085b70 con 0x7f34481e63f0 2023-03-03T06:25:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.420+0000 7f34477fe700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f34340682f0 0x7f343406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:02.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.420+0000 7f34477fe700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f34340682f0 0x7f343406a7a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f34480b2340 tx=0x7f343c009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:02.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.424+0000 7f3444ff9700 1 -- 172.21.15.5:0/976555221 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3448159df0 con 0x7f34481e63f0 2023-03-03T06:25:02.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:02.616+0000 7f344e910700 1 -- 172.21.15.5:0/976555221 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "snap-test-pool"} v 0) v1 -- 0x7f3448159df0 con 0x7f34481e63f0 2023-03-03T06:25:03.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.422+0000 7f3444ff9700 1 -- 172.21.15.5:0/976555221 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "snap-test-pool"}]=0 pool 'snap-test-pool' created v41) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3448159df0 con 0x7f34481e63f0 2023-03-03T06:25:03.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.427+0000 7f344e910700 1 -- 172.21.15.5:0/976555221 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f34340682f0 msgr2=0x7f343406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:03.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.427+0000 7f344e910700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f34340682f0 0x7f343406a7a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f34480b2340 tx=0x7f343c009210 comp rx=0 tx=0).stop 2023-03-03T06:25:03.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.427+0000 7f344e910700 1 -- 172.21.15.5:0/976555221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34481e63f0 msgr2=0x7f3448152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:03.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.427+0000 7f344e910700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34481e63f0 0x7f3448152820 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f343800f7f0 tx=0x7f343800fb00 comp rx=0 tx=0).stop 2023-03-03T06:25:03.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.427+0000 7f344e910700 1 -- 172.21.15.5:0/976555221 shutdown_connections 2023-03-03T06:25:03.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.427+0000 7f344e910700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f34340682f0 0x7f343406a7a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:03.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.427+0000 7f344e910700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34481e67c0 0x7f344814d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:03.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.427+0000 7f344e910700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34481e63f0 0x7f3448152820 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:03.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.427+0000 7f344e910700 1 --2- 172.21.15.5:0/976555221 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3448152d60 0x7f344814d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:03.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.427+0000 7f344e910700 1 -- 172.21.15.5:0/976555221 >> 172.21.15.5:0/976555221 conn(0x7f34480cc840 msgr2=0x7f3448156350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:03.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.428+0000 7f344e910700 1 -- 172.21.15.5:0/976555221 shutdown_connections 2023-03-03T06:25:03.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.429+0000 7f344e910700 1 -- 172.21.15.5:0/976555221 wait complete. 2023-03-03T06:25:03.432 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'snap-test-pool' created 2023-03-03T06:25:03.447 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool mksnap snap3 2023-03-03T06:25:03.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.493+0000 7f5772d7f080 1 Processor -- start 2023-03-03T06:25:03.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.493+0000 7f5772d7f080 1 -- start start 2023-03-03T06:25:03.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5772d7f080 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5758002300 0x563eb9b10b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:03.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5772d7f080 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563eb9b37520 0x563eb9b25950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:03.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5772d7f080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563eb9b0d0b0 0x563eb9b24a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5772d7f080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563eb9a9d000 con 0x563eb9b0d0b0 2023-03-03T06:25:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5772d7f080 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563eb9a2ffe0 con 0x7f5758002300 2023-03-03T06:25:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5772d7f080 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x563eb9c56930 con 0x563eb9b37520 2023-03-03T06:25:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5769683700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563eb9b0d0b0 0x563eb9b24a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5769683700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563eb9b0d0b0 0x563eb9b24a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43776/0 (socket says 172.21.15.5:43776) 2023-03-03T06:25:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5769683700 1 -- 172.21.15.5:0/1542672678 learned_addr learned my addr 172.21.15.5:0/1542672678 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5768e82700 1 --2- 172.21.15.5:0/1542672678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5758002300 0x563eb9b10b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5763fff700 1 --2- 172.21.15.5:0/1542672678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563eb9b37520 0x563eb9b25950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5769683700 1 -- 172.21.15.5:0/1542672678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563eb9b37520 msgr2=0x563eb9b25950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5769683700 1 --2- 172.21.15.5:0/1542672678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563eb9b37520 0x563eb9b25950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5769683700 1 -- 172.21.15.5:0/1542672678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5758002300 msgr2=0x563eb9b10b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5769683700 1 --2- 172.21.15.5:0/1542672678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5758002300 0x563eb9b10b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5769683700 1 -- 172.21.15.5:0/1542672678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563eb9a48360 con 0x563eb9b0d0b0 2023-03-03T06:25:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.494+0000 7f5769683700 1 --2- 172.21.15.5:0/1542672678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563eb9b0d0b0 0x563eb9b24a40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x563eb9afa1c0 tx=0x7f5764001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48cb012cec7b6f2 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.495+0000 7f5762ffd700 1 -- 172.21.15.5:0/1542672678 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764006a20 con 0x563eb9b0d0b0 2023-03-03T06:25:03.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.495+0000 7f5762ffd700 1 -- 172.21.15.5:0/1542672678 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5764006b80 con 0x563eb9b0d0b0 2023-03-03T06:25:03.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.495+0000 7f5762ffd700 1 -- 172.21.15.5:0/1542672678 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764003450 con 0x563eb9b0d0b0 2023-03-03T06:25:03.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.495+0000 7f5772d7f080 1 -- 172.21.15.5:0/1542672678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563eb9b0d0b0 msgr2=0x563eb9b24a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:03.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.495+0000 7f5772d7f080 1 --2- 172.21.15.5:0/1542672678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563eb9b0d0b0 0x563eb9b24a40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x563eb9afa1c0 tx=0x7f5764001bd0 comp rx=0 tx=0).stop 2023-03-03T06:25:03.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.495+0000 7f5772d7f080 1 -- 172.21.15.5:0/1542672678 shutdown_connections 2023-03-03T06:25:03.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.495+0000 7f5772d7f080 1 --2- 172.21.15.5:0/1542672678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563eb9b0d0b0 0x563eb9b24a40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:03.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.495+0000 7f5772d7f080 1 --2- 172.21.15.5:0/1542672678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5758002300 0x563eb9b10b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:03.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.495+0000 7f5772d7f080 1 --2- 172.21.15.5:0/1542672678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563eb9b37520 0x563eb9b25950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:03.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.495+0000 7f5772d7f080 1 -- 172.21.15.5:0/1542672678 >> 172.21.15.5:0/1542672678 conn(0x563eb9b408e0 msgr2=0x563eb9b3ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:03.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.495+0000 7f5772d7f080 1 -- 172.21.15.5:0/1542672678 shutdown_connections 2023-03-03T06:25:03.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.495+0000 7f5772d7f080 1 -- 172.21.15.5:0/1542672678 wait complete. 2023-03-03T06:25:03.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.496+0000 7f5772d7f080 1 Processor -- start 2023-03-03T06:25:03.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.496+0000 7f5772d7f080 1 -- start start 2023-03-03T06:25:03.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5772d7f080 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563eb9b0d0b0 0x563eb9b3aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:03.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5772d7f080 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563eb9b37520 0x563eb9c51090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:03.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5772d7f080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5758002300 0x563eb9c544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:03.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5772d7f080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x563eb9b3b530 con 0x7f5758002300 2023-03-03T06:25:03.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5772d7f080 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563eb9c539d0 con 0x563eb9b0d0b0 2023-03-03T06:25:03.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5772d7f080 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x563eb9c53cb0 con 0x563eb9b37520 2023-03-03T06:25:03.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5769683700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5758002300 0x563eb9c544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:03.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5769683700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5758002300 0x563eb9c544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43784/0 (socket says 172.21.15.5:43784) 2023-03-03T06:25:03.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5769683700 1 -- 172.21.15.5:0/169212174 learned_addr learned my addr 172.21.15.5:0/169212174 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:03.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5768e82700 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563eb9b0d0b0 0x563eb9b3aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:03.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5763fff700 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563eb9b37520 0x563eb9c51090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:03.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5769683700 1 -- 172.21.15.5:0/169212174 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563eb9b37520 msgr2=0x563eb9c51090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:03.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5769683700 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563eb9b37520 0x563eb9c51090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:03.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5769683700 1 -- 172.21.15.5:0/169212174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563eb9b0d0b0 msgr2=0x563eb9b3aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:03.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5769683700 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563eb9b0d0b0 0x563eb9b3aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:03.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5769683700 1 -- 172.21.15.5:0/169212174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563eb9a48120 con 0x7f5758002300 2023-03-03T06:25:03.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5769683700 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5758002300 0x563eb9c544b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5764002230 tx=0x563eb9af8e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:03.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5761ffb700 1 -- 172.21.15.5:0/169212174 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764023030 con 0x7f5758002300 2023-03-03T06:25:03.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5761ffb700 1 -- 172.21.15.5:0/169212174 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576401d840 con 0x7f5758002300 2023-03-03T06:25:03.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5772d7f080 1 -- 172.21.15.5:0/169212174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563eb9b3c200 con 0x7f5758002300 2023-03-03T06:25:03.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5761ffb700 1 -- 172.21.15.5:0/169212174 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764006a20 con 0x7f5758002300 2023-03-03T06:25:03.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.497+0000 7f5772d7f080 1 -- 172.21.15.5:0/169212174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563eb9a3b830 con 0x7f5758002300 2023-03-03T06:25:03.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.499+0000 7f5761ffb700 1 -- 172.21.15.5:0/169212174 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f576401dbf0 con 0x7f5758002300 2023-03-03T06:25:03.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.500+0000 7f5761ffb700 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f574c066c10 0x7f574c0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:03.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.500+0000 7f5761ffb700 1 -- 172.21.15.5:0/169212174 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5764024070 con 0x7f5758002300 2023-03-03T06:25:03.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.500+0000 7f5768e82700 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f574c066c10 0x7f574c0690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:03.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.500+0000 7f5772d7f080 1 -- 172.21.15.5:0/169212174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- pool_op(create snap pool 8 tid 1 name snap3 v0) v4 -- 0x563eb9aa67c0 con 0x7f5758002300 2023-03-03T06:25:03.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:03.500+0000 7f5768e82700 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f574c066c10 0x7f574c0690c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5754000c00 tx=0x7f5754009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.426+0000 7f5761ffb700 1 -- 172.21.15.5:0/169212174 <== mon.0 v2:172.21.15.5:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v42) v1 ==== 43+0+0 (secure 0 0 0) 0x7f5764018080 con 0x7f5758002300 2023-03-03T06:25:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.426+0000 7f5761ffb700 1 -- 172.21.15.5:0/169212174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=42}) v3 -- 0x7f574c06fff0 con 0x7f5758002300 2023-03-03T06:25:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.427+0000 7f5761ffb700 1 -- 172.21.15.5:0/169212174 <== mon.0 v2:172.21.15.5:3300/0 7 ==== osd_map(42..42 src has 1..42) v4 ==== 710+0+0 (secure 0 0 0) 0x7f576401b300 con 0x7f5758002300 2023-03-03T06:25:04.430 INFO:teuthology.orchestra.run.smithi005.stdout:created pool snap-test-pool snap snap3 2023-03-03T06:25:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.428+0000 7f5772d7f080 1 -- 172.21.15.5:0/169212174 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f574c066c10 msgr2=0x7f574c0690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.428+0000 7f5772d7f080 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f574c066c10 0x7f574c0690c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5754000c00 tx=0x7f5754009000 comp rx=0 tx=0).stop 2023-03-03T06:25:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.428+0000 7f5772d7f080 1 -- 172.21.15.5:0/169212174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5758002300 msgr2=0x563eb9c544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.428+0000 7f5772d7f080 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5758002300 0x563eb9c544b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5764002230 tx=0x563eb9af8e00 comp rx=0 tx=0).stop 2023-03-03T06:25:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.428+0000 7f5772d7f080 1 -- 172.21.15.5:0/169212174 shutdown_connections 2023-03-03T06:25:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.428+0000 7f5772d7f080 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5758002300 0x563eb9c544b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.428+0000 7f5772d7f080 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563eb9b0d0b0 0x563eb9b3aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.428+0000 7f5772d7f080 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f574c066c10 0x7f574c0690c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.428+0000 7f5772d7f080 1 --2- 172.21.15.5:0/169212174 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563eb9b37520 0x563eb9c51090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.428+0000 7f5772d7f080 1 -- 172.21.15.5:0/169212174 >> 172.21.15.5:0/169212174 conn(0x563eb9b408e0 msgr2=0x563eb9b3ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.428+0000 7f5772d7f080 1 -- 172.21.15.5:0/169212174 shutdown_connections 2023-03-03T06:25:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.428+0000 7f5772d7f080 1 -- 172.21.15.5:0/169212174 wait complete. 2023-03-03T06:25:04.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs snap-test-pool 2023-03-03T06:25:04.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.572+0000 7f21f3c05700 1 Processor -- start 2023-03-03T06:25:04.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.573+0000 7f21f3c05700 1 -- start start 2023-03-03T06:25:04.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.573+0000 7f21f3c05700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21ec06d580 0x7f21ec0ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:04.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.573+0000 7f21f3c05700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21ec0c9b00 0x7f21ec06d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:04.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.573+0000 7f21f3c05700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ec0ca7f0 con 0x7f21ec160dc0 2023-03-03T06:25:04.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.573+0000 7f21f3c05700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ec160930 con 0x7f21ec06d580 2023-03-03T06:25:04.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.573+0000 7f21f3c05700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec0c9f70 con 0x7f21ec0c9b00 2023-03-03T06:25:04.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.574+0000 7f21f19a1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21ec06d580 0x7f21ec0ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:04.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.574+0000 7f21f19a1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21ec06d580 0x7f21ec0ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43788/0 (socket says 172.21.15.5:43788) 2023-03-03T06:25:04.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.574+0000 7f21f19a1700 1 -- 172.21.15.5:0/217264441 learned_addr learned my addr 172.21.15.5:0/217264441 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:04.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.574+0000 7f21f11a0700 1 --2- 172.21.15.5:0/217264441 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21ec0c9b00 0x7f21ec06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:04.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.574+0000 7f21f19a1700 1 -- 172.21.15.5:0/217264441 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21ec0c9b00 msgr2=0x7f21ec06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:04.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.574+0000 7f21f19a1700 1 --2- 172.21.15.5:0/217264441 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21ec0c9b00 0x7f21ec06d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.574+0000 7f21f19a1700 1 -- 172.21.15.5:0/217264441 >> v1:172.21.15.191:6789/0 conn(0x7f21ec160dc0 legacy=0x7f21ec0714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:04.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.574+0000 7f21f19a1700 1 -- 172.21.15.5:0/217264441 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec06de90 con 0x7f21ec06d580 2023-03-03T06:25:04.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.574+0000 7f21f11a0700 1 --2- 172.21.15.5:0/217264441 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21ec0c9b00 0x7f21ec06d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:04.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.574+0000 7f21f19a1700 1 --2- 172.21.15.5:0/217264441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ec06d580 0x7f21ec0ce050 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0098f0 tx=0x7f21dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34fe8b5f931cfda server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:04.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.574+0000 7f21f099f700 1 -- 172.21.15.5:0/217264441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc004230 con 0x7f21ec06d580 2023-03-03T06:25:04.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.574+0000 7f21f099f700 1 -- 172.21.15.5:0/217264441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc004390 con 0x7f21ec06d580 2023-03-03T06:25:04.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.574+0000 7f21f099f700 1 -- 172.21.15.5:0/217264441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0036a0 con 0x7f21ec06d580 2023-03-03T06:25:04.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.575+0000 7f21f3c05700 1 -- 172.21.15.5:0/217264441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ec06d580 msgr2=0x7f21ec0ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:04.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.575+0000 7f21f3c05700 1 --2- 172.21.15.5:0/217264441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ec06d580 0x7f21ec0ce050 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0098f0 tx=0x7f21dc009c00 comp rx=0 tx=0).stop 2023-03-03T06:25:04.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.575+0000 7f21f3c05700 1 -- 172.21.15.5:0/217264441 shutdown_connections 2023-03-03T06:25:04.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.575+0000 7f21f3c05700 1 --2- 172.21.15.5:0/217264441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ec06d580 0x7f21ec0ce050 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.575+0000 7f21f3c05700 1 --2- 172.21.15.5:0/217264441 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21ec0c9b00 0x7f21ec06d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.575+0000 7f21f3c05700 1 -- 172.21.15.5:0/217264441 >> 172.21.15.5:0/217264441 conn(0x7f21ec0cf4b0 msgr2=0x7f21ec0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:04.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.575+0000 7f21f3c05700 1 -- 172.21.15.5:0/217264441 shutdown_connections 2023-03-03T06:25:04.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.575+0000 7f21f3c05700 1 -- 172.21.15.5:0/217264441 wait complete. 2023-03-03T06:25:04.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.576+0000 7f21f3c05700 1 Processor -- start 2023-03-03T06:25:04.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.576+0000 7f21f3c05700 1 -- start start 2023-03-03T06:25:04.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f3c05700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21ec06d580 0x7f21ec157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:04.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f3c05700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ec0c9b00 0x7f21ec0b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:04.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f3c05700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21ec160dc0 0x7f21ec0b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:04.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f3c05700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec1f25b0 con 0x7f21ec0c9b00 2023-03-03T06:25:04.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f3c05700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec0c8080 con 0x7f21ec06d580 2023-03-03T06:25:04.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f3c05700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ec157f80 con 0x7f21ec160dc0 2023-03-03T06:25:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f11a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ec0c9b00 0x7f21ec0b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f11a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ec0c9b00 0x7f21ec0b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43796/0 (socket says 172.21.15.5:43796) 2023-03-03T06:25:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f11a0700 1 -- 172.21.15.5:0/927966656 learned_addr learned my addr 172.21.15.5:0/927966656 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f21a2700 1 --2- 172.21.15.5:0/927966656 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21ec160dc0 0x7f21ec0b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f19a1700 1 --2- 172.21.15.5:0/927966656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21ec06d580 0x7f21ec157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f11a0700 1 -- 172.21.15.5:0/927966656 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21ec160dc0 msgr2=0x7f21ec0b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f11a0700 1 --2- 172.21.15.5:0/927966656 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21ec160dc0 0x7f21ec0b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f11a0700 1 -- 172.21.15.5:0/927966656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21ec06d580 msgr2=0x7f21ec157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f11a0700 1 --2- 172.21.15.5:0/927966656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21ec06d580 0x7f21ec157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f11a0700 1 -- 172.21.15.5:0/927966656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc009550 con 0x7f21ec0c9b00 2023-03-03T06:25:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.577+0000 7f21f11a0700 1 --2- 172.21.15.5:0/927966656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21ec0c9b00 0x7f21ec0b4050 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f21e800c7f0 tx=0x7f21e800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.578+0000 7f21e27fc700 1 -- 172.21.15.5:0/927966656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8011800 con 0x7f21ec0c9b00 2023-03-03T06:25:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.578+0000 7f21e27fc700 1 -- 172.21.15.5:0/927966656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e8011960 con 0x7f21ec0c9b00 2023-03-03T06:25:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.578+0000 7f21f3c05700 1 -- 172.21.15.5:0/927966656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ec0ca510 con 0x7f21ec0c9b00 2023-03-03T06:25:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.578+0000 7f21e27fc700 1 -- 172.21.15.5:0/927966656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8011d10 con 0x7f21ec0c9b00 2023-03-03T06:25:04.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.578+0000 7f21f3c05700 1 -- 172.21.15.5:0/927966656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ec0ca230 con 0x7f21ec0c9b00 2023-03-03T06:25:04.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.579+0000 7f21f3c05700 1 -- 172.21.15.5:0/927966656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ec1605c0 con 0x7f21ec0c9b00 2023-03-03T06:25:04.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.579+0000 7f21e27fc700 1 -- 172.21.15.5:0/927966656 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f21e8021070 con 0x7f21ec0c9b00 2023-03-03T06:25:04.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.580+0000 7f21e27fc700 1 --2- 172.21.15.5:0/927966656 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f21d00682f0 0x7f21d006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:04.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.580+0000 7f21e27fc700 1 -- 172.21.15.5:0/927966656 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6774+0+0 (secure 0 0 0) 0x7f21e8085e60 con 0x7f21ec0c9b00 2023-03-03T06:25:04.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.580+0000 7f21f19a1700 1 --2- 172.21.15.5:0/927966656 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f21d00682f0 0x7f21d006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:04.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.580+0000 7f21f19a1700 1 --2- 172.21.15.5:0/927966656 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f21d00682f0 0x7f21d006a7a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009130 tx=0x7f21dc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:04.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.584+0000 7f21e27fc700 1 -- 172.21.15.5:0/927966656 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f21e80523f0 con 0x7f21ec0c9b00 2023-03-03T06:25:04.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.827+0000 7f21f3c05700 1 -- 172.21.15.5:0/927966656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"} v 0) v1 -- 0x7f21ec04e6e0 con 0x7f21ec0c9b00 2023-03-03T06:25:04.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.827+0000 7f21e27fc700 1 -- 172.21.15.5:0/927966656 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"}]=-95 pool(8) already has mon-managed snaps; can't attach pool to fs v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f21e8055a10 con 0x7f21ec0c9b00 2023-03-03T06:25:04.830 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENOTSUP: pool(8) already has mon-managed snaps; can't attach pool to fs 2023-03-03T06:25:04.834 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-03-03T06:25:04.834 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool rmsnap snap3 2023-03-03T06:25:04.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.876+0000 7f33ffba8080 1 Processor -- start 2023-03-03T06:25:04.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.876+0000 7f33ffba8080 1 -- start start 2023-03-03T06:25:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33ffba8080 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d851694470 0x55d8517680d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33ffba8080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8516c3480 0x55d8516c0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33ffba8080 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8516c3a40 0x55d8516be150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33ffba8080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8515cdfe0 con 0x55d8516c3480 2023-03-03T06:25:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33ffba8080 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d851769510 con 0x55d8516c3a40 2023-03-03T06:25:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33ffba8080 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d851680c50 con 0x55d851694470 2023-03-03T06:25:04.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33f54aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8516c3480 0x55d8516c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33f54aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8516c3480 0x55d8516c0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43810/0 (socket says 172.21.15.5:43810) 2023-03-03T06:25:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33f54aa700 1 -- 172.21.15.5:0/3590335736 learned_addr learned my addr 172.21.15.5:0/3590335736 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33f64ac700 1 --2- 172.21.15.5:0/3590335736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8516c3a40 0x55d8516be150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33f5cab700 1 --2- 172.21.15.5:0/3590335736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d851694470 0x55d8517680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33f54aa700 1 -- 172.21.15.5:0/3590335736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d851694470 msgr2=0x55d8517680d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33f54aa700 1 --2- 172.21.15.5:0/3590335736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d851694470 0x55d8517680d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33f54aa700 1 -- 172.21.15.5:0/3590335736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8516c3a40 msgr2=0x55d8516be150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33f54aa700 1 --2- 172.21.15.5:0/3590335736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8516c3a40 0x55d8516be150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33f54aa700 1 -- 172.21.15.5:0/3590335736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e8005de0 con 0x55d8516c3480 2023-03-03T06:25:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33f64ac700 1 --2- 172.21.15.5:0/3590335736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8516c3a40 0x55d8516be150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33f54aa700 1 --2- 172.21.15.5:0/3590335736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8516c3480 0x55d8516c0510 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00a7a0 tx=0x7f33ec00aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae99832906895d3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33e7fff700 1 -- 172.21.15.5:0/3590335736 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00f070 con 0x55d8516c3480 2023-03-03T06:25:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33e7fff700 1 -- 172.21.15.5:0/3590335736 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec008580 con 0x55d8516c3480 2023-03-03T06:25:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.877+0000 7f33e7fff700 1 -- 172.21.15.5:0/3590335736 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0088f0 con 0x55d8516c3480 2023-03-03T06:25:04.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.878+0000 7f33ffba8080 1 -- 172.21.15.5:0/3590335736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8516c3480 msgr2=0x55d8516c0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.878+0000 7f33ffba8080 1 --2- 172.21.15.5:0/3590335736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8516c3480 0x55d8516c0510 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00a7a0 tx=0x7f33ec00aab0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.878+0000 7f33ffba8080 1 -- 172.21.15.5:0/3590335736 shutdown_connections 2023-03-03T06:25:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.878+0000 7f33ffba8080 1 --2- 172.21.15.5:0/3590335736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8516c3a40 0x55d8516be150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.878+0000 7f33ffba8080 1 --2- 172.21.15.5:0/3590335736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d851694470 0x55d8517680d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.878+0000 7f33ffba8080 1 --2- 172.21.15.5:0/3590335736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8516c3480 0x55d8516c0510 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.878+0000 7f33ffba8080 1 -- 172.21.15.5:0/3590335736 >> 172.21.15.5:0/3590335736 conn(0x55d8516de060 msgr2=0x55d8516c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:04.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.878+0000 7f33ffba8080 1 -- 172.21.15.5:0/3590335736 shutdown_connections 2023-03-03T06:25:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.878+0000 7f33ffba8080 1 -- 172.21.15.5:0/3590335736 wait complete. 2023-03-03T06:25:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.878+0000 7f33ffba8080 1 Processor -- start 2023-03-03T06:25:04.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.879+0000 7f33ffba8080 1 -- start start 2023-03-03T06:25:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.879+0000 7f33ffba8080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d851694470 0x55d851765d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.879+0000 7f33ffba8080 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8516c3480 0x55d8516c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.879+0000 7f33ffba8080 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8516c3a40 0x55d8516c2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.879+0000 7f33ffba8080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d851766d40 con 0x55d851694470 2023-03-03T06:25:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.879+0000 7f33ffba8080 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d851766280 con 0x55d8516c3480 2023-03-03T06:25:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.879+0000 7f33ffba8080 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d851691700 con 0x55d8516c3a40 2023-03-03T06:25:04.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.879+0000 7f33f5cab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d851694470 0x55d851765d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.879+0000 7f33f5cab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d851694470 0x55d851765d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43816/0 (socket says 172.21.15.5:43816) 2023-03-03T06:25:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.879+0000 7f33f5cab700 1 -- 172.21.15.5:0/123910819 learned_addr learned my addr 172.21.15.5:0/123910819 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.879+0000 7f33f54aa700 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8516c3480 0x55d8516c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.879+0000 7f33f64ac700 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8516c3a40 0x55d8516c2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.880+0000 7f33f5cab700 1 -- 172.21.15.5:0/123910819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8516c3a40 msgr2=0x55d8516c2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.880+0000 7f33f5cab700 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8516c3a40 0x55d8516c2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.880+0000 7f33f5cab700 1 -- 172.21.15.5:0/123910819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8516c3480 msgr2=0x55d8516c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.880+0000 7f33f5cab700 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8516c3480 0x55d8516c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.880+0000 7f33f5cab700 1 -- 172.21.15.5:0/123910819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec00a420 con 0x55d851694470 2023-03-03T06:25:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.880+0000 7f33f64ac700 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8516c3a40 0x55d8516c2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.880+0000 7f33f5cab700 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d851694470 0x55d851765d40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f33e8012000 tx=0x7f33e8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.880+0000 7f33e6ffd700 1 -- 172.21.15.5:0/123910819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8008670 con 0x55d851694470 2023-03-03T06:25:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.880+0000 7f33e6ffd700 1 -- 172.21.15.5:0/123910819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e80055a0 con 0x55d851694470 2023-03-03T06:25:04.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.880+0000 7f33ffba8080 1 -- 172.21.15.5:0/123910819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d8515e6120 con 0x55d851694470 2023-03-03T06:25:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.880+0000 7f33e6ffd700 1 -- 172.21.15.5:0/123910819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e801d850 con 0x55d851694470 2023-03-03T06:25:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.880+0000 7f33ffba8080 1 -- 172.21.15.5:0/123910819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8515d9830 con 0x55d851694470 2023-03-03T06:25:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.881+0000 7f33e6ffd700 1 -- 172.21.15.5:0/123910819 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f33e802d070 con 0x55d851694470 2023-03-03T06:25:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.882+0000 7f33e6ffd700 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f33d8066c10 0x7f33d80690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.882+0000 7f33e6ffd700 1 -- 172.21.15.5:0/123910819 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6774+0+0 (secure 0 0 0) 0x7f33e8085c80 con 0x55d851694470 2023-03-03T06:25:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.882+0000 7f33f54aa700 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f33d8066c10 0x7f33d80690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.882+0000 7f33ffba8080 1 -- 172.21.15.5:0/123910819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- pool_op(delete snap pool 8 tid 1 name snap3 v0) v4 -- 0x55d8516447c0 con 0x55d851694470 2023-03-03T06:25:04.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:04.882+0000 7f33f54aa700 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f33d8066c10 0x7f33d80690c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55d8516bd300 tx=0x7f33ec012000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:05.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.431+0000 7f33e6ffd700 1 -- 172.21.15.5:0/123910819 <== mon.0 v2:172.21.15.5:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v43) v1 ==== 43+0+0 (secure 0 0 0) 0x7f33e802b080 con 0x55d851694470 2023-03-03T06:25:05.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.431+0000 7f33e6ffd700 1 -- 172.21.15.5:0/123910819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=43}) v3 -- 0x7f33d8070050 con 0x55d851694470 2023-03-03T06:25:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.434+0000 7f33e6ffd700 1 -- 172.21.15.5:0/123910819 <== mon.0 v2:172.21.15.5:3300/0 7 ==== osd_map(43..43 src has 1..43) v4 ==== 643+0+0 (secure 0 0 0) 0x7f33e805dee0 con 0x55d851694470 2023-03-03T06:25:05.436 INFO:teuthology.orchestra.run.smithi005.stdout:removed pool snap-test-pool snap snap3 2023-03-03T06:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.434+0000 7f33ffba8080 1 -- 172.21.15.5:0/123910819 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f33d8066c10 msgr2=0x7f33d80690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.434+0000 7f33ffba8080 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f33d8066c10 0x7f33d80690c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55d8516bd300 tx=0x7f33ec012000 comp rx=0 tx=0).stop 2023-03-03T06:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.434+0000 7f33ffba8080 1 -- 172.21.15.5:0/123910819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d851694470 msgr2=0x55d851765d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:05.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.434+0000 7f33ffba8080 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d851694470 0x55d851765d40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f33e8012000 tx=0x7f33e8002fb0 comp rx=0 tx=0).stop 2023-03-03T06:25:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.434+0000 7f33ffba8080 1 -- 172.21.15.5:0/123910819 shutdown_connections 2023-03-03T06:25:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.434+0000 7f33ffba8080 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f33d8066c10 0x7f33d80690c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.434+0000 7f33ffba8080 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d8516c3a40 0x55d8516c2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.434+0000 7f33ffba8080 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d851694470 0x55d851765d40 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.434+0000 7f33ffba8080 1 --2- 172.21.15.5:0/123910819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d8516c3480 0x55d8516c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.434+0000 7f33ffba8080 1 -- 172.21.15.5:0/123910819 >> 172.21.15.5:0/123910819 conn(0x55d8516de060 msgr2=0x55d8516bf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:05.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.434+0000 7f33ffba8080 1 -- 172.21.15.5:0/123910819 shutdown_connections 2023-03-03T06:25:05.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.434+0000 7f33ffba8080 1 -- 172.21.15.5:0/123910819 wait complete. 2023-03-03T06:25:05.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete snap-test-pool 2023-03-03T06:25:05.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.572+0000 7f39bd63b700 1 Processor -- start 2023-03-03T06:25:05.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.572+0000 7f39bd63b700 1 -- start start 2023-03-03T06:25:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.573+0000 7f39bd63b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39b80cd500 0x7f39b815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:05.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.573+0000 7f39bd63b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39b80b1fe0 0x7f39b80cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:05.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.573+0000 7f39bd63b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b80cc5d0 con 0x7f39b80b55b0 2023-03-03T06:25:05.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.573+0000 7f39bd63b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b815e290 con 0x7f39b80b1fe0 2023-03-03T06:25:05.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.573+0000 7f39bd63b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8159c30 con 0x7f39b80cd500 2023-03-03T06:25:05.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.573+0000 7f39b77fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f39b80b1fe0 0x7f39b80cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:05.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.573+0000 7f39b6ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f39b80b55b0 0x7f39b80b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33664/0 (socket says 172.21.15.5:33664) 2023-03-03T06:25:05.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.573+0000 7f39b6ffd700 1 -- 172.21.15.5:0/3295268166 learned_addr learned my addr 172.21.15.5:0/3295268166 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:05.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.573+0000 7f39b67fc700 1 --2- 172.21.15.5:0/3295268166 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39b80cd500 0x7f39b815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:05.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.574+0000 7f39b77fe700 1 -- 172.21.15.5:0/3295268166 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39b80cd500 msgr2=0x7f39b815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:05.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.574+0000 7f39b77fe700 1 --2- 172.21.15.5:0/3295268166 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39b80cd500 0x7f39b815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:05.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.574+0000 7f39b77fe700 1 -- 172.21.15.5:0/3295268166 >> v1:172.21.15.5:6789/0 conn(0x7f39b80b55b0 legacy=0x7f39b80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:05.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.574+0000 7f39b5ffb700 1 -- 172.21.15.5:0/3295268166 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636142886 0 0) 0x7f39b80cc5d0 con 0x7f39b80b55b0 2023-03-03T06:25:05.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.574+0000 7f39b77fe700 1 -- 172.21.15.5:0/3295268166 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b80b5980 con 0x7f39b80b1fe0 2023-03-03T06:25:05.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.574+0000 7f39b77fe700 1 --2- 172.21.15.5:0/3295268166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39b80b1fe0 0x7f39b80cdf90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009d90 tx=0x7f39b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b9a18c1b560ca0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:05.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.574+0000 7f39b5ffb700 1 -- 172.21.15.5:0/3295268166 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b000e070 con 0x7f39b80b1fe0 2023-03-03T06:25:05.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.574+0000 7f39b5ffb700 1 -- 172.21.15.5:0/3295268166 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b000bb20 con 0x7f39b80b1fe0 2023-03-03T06:25:05.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.574+0000 7f39b5ffb700 1 -- 172.21.15.5:0/3295268166 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0012430 con 0x7f39b80b1fe0 2023-03-03T06:25:05.579 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.575+0000 7f39bd63b700 1 -- 172.21.15.5:0/3295268166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39b80b1fe0 msgr2=0x7f39b80cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:05.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.575+0000 7f39bd63b700 1 --2- 172.21.15.5:0/3295268166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39b80b1fe0 0x7f39b80cdf90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009d90 tx=0x7f39b000b330 comp rx=0 tx=0).stop 2023-03-03T06:25:05.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.575+0000 7f39bd63b700 1 -- 172.21.15.5:0/3295268166 shutdown_connections 2023-03-03T06:25:05.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.575+0000 7f39bd63b700 1 --2- 172.21.15.5:0/3295268166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39b80b1fe0 0x7f39b80cdf90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:05.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.575+0000 7f39bd63b700 1 --2- 172.21.15.5:0/3295268166 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39b80cd500 0x7f39b815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:05.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.575+0000 7f39bd63b700 1 -- 172.21.15.5:0/3295268166 >> 172.21.15.5:0/3295268166 conn(0x7f39b80cc8d0 msgr2=0x7f39b80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:05.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.575+0000 7f39bd63b700 1 -- 172.21.15.5:0/3295268166 shutdown_connections 2023-03-03T06:25:05.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.575+0000 7f39bd63b700 1 -- 172.21.15.5:0/3295268166 wait complete. 2023-03-03T06:25:05.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.576+0000 7f39bd63b700 1 Processor -- start 2023-03-03T06:25:05.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.576+0000 7f39bd63b700 1 -- start start 2023-03-03T06:25:05.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39bd63b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39b80b1fe0 0x7f39b8156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:05.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39bd63b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39b80b55b0 0x7f39b80adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:05.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39bd63b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39b80cd500 0x7f39b80ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:05.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39bd63b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b81f2590 con 0x7f39b80cd500 2023-03-03T06:25:05.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39bd63b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b81f27d0 con 0x7f39b80b1fe0 2023-03-03T06:25:05.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39bd63b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b81f2ab0 con 0x7f39b80b55b0 2023-03-03T06:25:05.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39b80cd500 0x7f39b80ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:05.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39b77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39b80cd500 0x7f39b80ae3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43832/0 (socket says 172.21.15.5:43832) 2023-03-03T06:25:05.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39b77fe700 1 -- 172.21.15.5:0/3770625470 learned_addr learned my addr 172.21.15.5:0/3770625470 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:05.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39b67fc700 1 --2- 172.21.15.5:0/3770625470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39b80b55b0 0x7f39b80adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:05.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39b6ffd700 1 --2- 172.21.15.5:0/3770625470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39b80b1fe0 0x7f39b8156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39b77fe700 1 -- 172.21.15.5:0/3770625470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39b80b55b0 msgr2=0x7f39b80adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39b77fe700 1 --2- 172.21.15.5:0/3770625470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39b80b55b0 0x7f39b80adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39b77fe700 1 -- 172.21.15.5:0/3770625470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39b80b1fe0 msgr2=0x7f39b8156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.577+0000 7f39b77fe700 1 --2- 172.21.15.5:0/3770625470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f39b80b1fe0 0x7f39b8156830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.578+0000 7f39b77fe700 1 -- 172.21.15.5:0/3770625470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b0009a70 con 0x7f39b80cd500 2023-03-03T06:25:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.578+0000 7f39b67fc700 1 --2- 172.21.15.5:0/3770625470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f39b80b55b0 0x7f39b80adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.578+0000 7f39b77fe700 1 --2- 172.21.15.5:0/3770625470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39b80cd500 0x7f39b80ae3f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f39b0013000 tx=0x7f39b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:05.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.578+0000 7f399f7fe700 1 -- 172.21.15.5:0/3770625470 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0012430 con 0x7f39b80cd500 2023-03-03T06:25:05.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.578+0000 7f399f7fe700 1 -- 172.21.15.5:0/3770625470 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b0020070 con 0x7f39b80cd500 2023-03-03T06:25:05.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.578+0000 7f399f7fe700 1 -- 172.21.15.5:0/3770625470 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0004280 con 0x7f39b80cd500 2023-03-03T06:25:05.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.578+0000 7f39bd63b700 1 -- 172.21.15.5:0/3770625470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b80cbca0 con 0x7f39b80cd500 2023-03-03T06:25:05.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.578+0000 7f39bd63b700 1 -- 172.21.15.5:0/3770625470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b80cb9c0 con 0x7f39b80cd500 2023-03-03T06:25:05.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.579+0000 7f39bd63b700 1 -- 172.21.15.5:0/3770625470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b80cbf80 con 0x7f39b80cd500 2023-03-03T06:25:05.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.579+0000 7f399f7fe700 1 -- 172.21.15.5:0/3770625470 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f39b002e070 con 0x7f39b80cd500 2023-03-03T06:25:05.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.580+0000 7f399f7fe700 1 --2- 172.21.15.5:0/3770625470 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f39a40682f0 0x7f39a406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:05.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.580+0000 7f399f7fe700 1 -- 172.21.15.5:0/3770625470 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f39b0022070 con 0x7f39b80cd500 2023-03-03T06:25:05.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.580+0000 7f39b6ffd700 1 --2- 172.21.15.5:0/3770625470 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f39a40682f0 0x7f39a406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:05.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.580+0000 7f39b6ffd700 1 --2- 172.21.15.5:0/3770625470 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f39a40682f0 0x7f39a406a7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f39ac000f60 tx=0x7f39ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:05.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.584+0000 7f399f7fe700 1 -- 172.21.15.5:0/3770625470 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f39b0054230 con 0x7f39b80cd500 2023-03-03T06:25:05.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.777+0000 7f39bd63b700 1 -- 172.21.15.5:0/3770625470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "snap-test-pool"} v 0) v1 -- 0x7f39b804e6e0 con 0x7f39b80cd500 2023-03-03T06:25:05.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:05.778+0000 7f399f7fe700 1 -- 172.21.15.5:0/3770625470 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "snap-test-pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v43) v1 ==== 296+0+0 (secure 0 0 0) 0x7f39b0057850 con 0x7f39b80cd500 2023-03-03T06:25:05.781 INFO:teuthology.orchestra.run.smithi005.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-03-03T06:25:05.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T06:25:05.785 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-03-03T06:25:05.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:25:05.834 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:25:05.881 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-03-03T06:25:05.882 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:25:05.882 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:05.900 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:25:05.900 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:05.957 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:06.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.119+0000 7f61380b3700 1 Processor -- start 2023-03-03T06:25:06.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.120+0000 7f61380b3700 1 -- start start 2023-03-03T06:25:06.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.120+0000 7f61380b3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f61300cb710 0x7f61300cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.120+0000 7f61380b3700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f61300cff20 0x7f61300b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f61380b3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61300cbae0 0x7f61300b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f61380b3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61300cd820 con 0x7f61300cb710 2023-03-03T06:25:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f61380b3700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f613015f2a0 con 0x7f61300cff20 2023-03-03T06:25:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f61380b3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61300cf550 con 0x7f61300cbae0 2023-03-03T06:25:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f6135e4f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f61300cb710 0x7f61300cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f6135e4f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f61300cb710 0x7f61300cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43836/0 (socket says 172.21.15.5:43836) 2023-03-03T06:25:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f6135e4f700 1 -- 172.21.15.5:0/3620171013 learned_addr learned my addr 172.21.15.5:0/3620171013 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:06.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f6136650700 1 --2- 172.21.15.5:0/3620171013 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61300cbae0 0x7f61300b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f6135e4f700 1 -- 172.21.15.5:0/3620171013 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61300cbae0 msgr2=0x7f61300b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f6135e4f700 1 --2- 172.21.15.5:0/3620171013 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61300cbae0 0x7f61300b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f6135e4f700 1 -- 172.21.15.5:0/3620171013 >> v2:172.21.15.191:3300/0 conn(0x7f61300cff20 msgr2=0x7f61300b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f613564e700 1 --2- 172.21.15.5:0/3620171013 >> v2:172.21.15.191:3300/0 conn(0x7f61300cff20 0x7f61300b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f6135e4f700 1 --2- 172.21.15.5:0/3620171013 >> v2:172.21.15.191:3300/0 conn(0x7f61300cff20 0x7f61300b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f6135e4f700 1 -- 172.21.15.5:0/3620171013 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613015efc0 con 0x7f61300cb710 2023-03-03T06:25:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f6135e4f700 1 --2- 172.21.15.5:0/3620171013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61300cb710 0x7f61300cf9e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f61300ce9d0 tx=0x7f612c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a4649fcf05041a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f6134e4d700 1 -- 172.21.15.5:0/3620171013 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c00b870 con 0x7f61300cb710 2023-03-03T06:25:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f6134e4d700 1 -- 172.21.15.5:0/3620171013 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c00b9d0 con 0x7f61300cb710 2023-03-03T06:25:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.121+0000 7f6134e4d700 1 -- 172.21.15.5:0/3620171013 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c00bd60 con 0x7f61300cb710 2023-03-03T06:25:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.122+0000 7f61380b3700 1 -- 172.21.15.5:0/3620171013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61300cb710 msgr2=0x7f61300cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.122+0000 7f61380b3700 1 --2- 172.21.15.5:0/3620171013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61300cb710 0x7f61300cf9e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f61300ce9d0 tx=0x7f612c009bd0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.122+0000 7f61380b3700 1 -- 172.21.15.5:0/3620171013 shutdown_connections 2023-03-03T06:25:06.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.122+0000 7f61380b3700 1 --2- 172.21.15.5:0/3620171013 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61300cbae0 0x7f61300b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.122+0000 7f61380b3700 1 --2- 172.21.15.5:0/3620171013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61300cb710 0x7f61300cf9e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.122+0000 7f61380b3700 1 --2- 172.21.15.5:0/3620171013 >> v2:172.21.15.191:3300/0 conn(0x7f61300cff20 0x7f61300b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.122+0000 7f61380b3700 1 -- 172.21.15.5:0/3620171013 >> 172.21.15.5:0/3620171013 conn(0x7f6130070050 msgr2=0x7f6130070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:06.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.122+0000 7f61380b3700 1 -- 172.21.15.5:0/3620171013 shutdown_connections 2023-03-03T06:25:06.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.122+0000 7f61380b3700 1 -- 172.21.15.5:0/3620171013 wait complete. 2023-03-03T06:25:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.123+0000 7f61380b3700 1 Processor -- start 2023-03-03T06:25:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.123+0000 7f61380b3700 1 -- start start 2023-03-03T06:25:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f61380b3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61300cb710 0x7f6130149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f61380b3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61300cbae0 0x7f61300b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f61380b3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61300cff20 0x7f61301463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.131 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f61380b3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61300c7610 con 0x7f61300cbae0 2023-03-03T06:25:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f61380b3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6130149fd0 con 0x7f61300cff20 2023-03-03T06:25:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f61380b3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61301f3cb0 con 0x7f61300cb710 2023-03-03T06:25:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f613564e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61300cbae0 0x7f61300b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f613564e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61300cbae0 0x7f61300b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43844/0 (socket says 172.21.15.5:43844) 2023-03-03T06:25:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f613564e700 1 -- 172.21.15.5:0/1265511408 learned_addr learned my addr 172.21.15.5:0/1265511408 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f6135e4f700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61300cb710 0x7f6130149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f6136650700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61300cff20 0x7f61301463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f613564e700 1 -- 172.21.15.5:0/1265511408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61300cb710 msgr2=0x7f6130149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f613564e700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61300cb710 0x7f6130149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f613564e700 1 -- 172.21.15.5:0/1265511408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61300cff20 msgr2=0x7f61301463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f613564e700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61300cff20 0x7f61301463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f613564e700 1 -- 172.21.15.5:0/1265511408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c009550 con 0x7f61300cbae0 2023-03-03T06:25:06.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.124+0000 7f6136650700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61300cff20 0x7f61301463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.125+0000 7f613564e700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61300cbae0 0x7f61300b2d70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f612400c7f0 tx=0x7f612400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.125+0000 7f61227fc700 1 -- 172.21.15.5:0/1265511408 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124011800 con 0x7f61300cbae0 2023-03-03T06:25:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.125+0000 7f61227fc700 1 -- 172.21.15.5:0/1265511408 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6124011960 con 0x7f61300cbae0 2023-03-03T06:25:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.125+0000 7f61380b3700 1 -- 172.21.15.5:0/1265511408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61300cf1e0 con 0x7f61300cbae0 2023-03-03T06:25:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.125+0000 7f61227fc700 1 -- 172.21.15.5:0/1265511408 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124011cf0 con 0x7f61300cbae0 2023-03-03T06:25:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.125+0000 7f61380b3700 1 -- 172.21.15.5:0/1265511408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61300cef00 con 0x7f61300cbae0 2023-03-03T06:25:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.126+0000 7f61380b3700 1 -- 172.21.15.5:0/1265511408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613015e3b0 con 0x7f61300cbae0 2023-03-03T06:25:06.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.126+0000 7f61227fc700 1 -- 172.21.15.5:0/1265511408 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6124021070 con 0x7f61300cbae0 2023-03-03T06:25:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.126+0000 7f61227fc700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61140682f0 0x7f611406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.127+0000 7f61227fc700 1 -- 172.21.15.5:0/1265511408 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f6124085d80 con 0x7f61300cbae0 2023-03-03T06:25:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.127+0000 7f6135e4f700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61140682f0 0x7f611406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.127+0000 7f6135e4f700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61140682f0 0x7f611406a7a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f612c000c00 tx=0x7f612c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:06.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.131+0000 7f61227fc700 1 -- 172.21.15.5:0/1265511408 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6124052300 con 0x7f61300cbae0 2023-03-03T06:25:06.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.327+0000 7f61380b3700 1 -- 172.21.15.5:0/1265511408 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f613004e6e0 con 0x7f61300cbae0 2023-03-03T06:25:06.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.328+0000 7f61227fc700 1 -- 172.21.15.5:0/1265511408 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+19761 (secure 0 0 0) 0x7f6124087090 con 0x7f61300cbae0 2023-03-03T06:25:06.330 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:06.331 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":43,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:05.425306+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:24:53.570801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-03T06:24:53.994714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.330+0000 7f61380b3700 1 -- 172.21.15.5:0/1265511408 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61140682f0 msgr2=0x7f611406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.330+0000 7f61380b3700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61140682f0 0x7f611406a7a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f612c000c00 tx=0x7f612c008030 comp rx=0 tx=0).stop 2023-03-03T06:25:06.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.330+0000 7f61380b3700 1 -- 172.21.15.5:0/1265511408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61300cbae0 msgr2=0x7f61300b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.330+0000 7f61380b3700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61300cbae0 0x7f61300b2d70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f612400c7f0 tx=0x7f612400cbb0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.330+0000 7f61380b3700 1 -- 172.21.15.5:0/1265511408 shutdown_connections 2023-03-03T06:25:06.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.330+0000 7f61380b3700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61300cff20 0x7f61301463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.330+0000 7f61380b3700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61140682f0 0x7f611406a7a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.333 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.330+0000 7f61380b3700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61300cb710 0x7f6130149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.330+0000 7f61380b3700 1 --2- 172.21.15.5:0/1265511408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61300cbae0 0x7f61300b2d70 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.330+0000 7f61380b3700 1 -- 172.21.15.5:0/1265511408 >> 172.21.15.5:0/1265511408 conn(0x7f6130070050 msgr2=0x7f6130070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:06.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.330+0000 7f61380b3700 1 -- 172.21.15.5:0/1265511408 shutdown_connections 2023-03-03T06:25:06.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.330+0000 7f61380b3700 1 -- 172.21.15.5:0/1265511408 wait complete. 2023-03-03T06:25:06.344 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:24:53.570801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:24:53.994714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'snap-test-pool', 'create_time': '2023-03-03T06:25:02.648527+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T06:25:06.345 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:25:06.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.472+0000 7f58538ad700 1 Processor -- start 2023-03-03T06:25:06.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.473+0000 7f58538ad700 1 -- start start 2023-03-03T06:25:06.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.473+0000 7f58538ad700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f584c0cd3e0 0x7f584c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.473+0000 7f58538ad700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f584c0b1fe0 0x7f584c0ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.473+0000 7f58538ad700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c15e160 con 0x7f584c15cd40 2023-03-03T06:25:06.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.473+0000 7f58538ad700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584c0cd870 con 0x7f584c0cd3e0 2023-03-03T06:25:06.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.473+0000 7f58538ad700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584c15d110 con 0x7f584c0b1fe0 2023-03-03T06:25:06.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.474+0000 7f5850e48700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f584c0cd3e0 0x7f584c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.474+0000 7f5851649700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f584c15cd40 0x7f584c0b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33692/0 (socket says 172.21.15.5:33692) 2023-03-03T06:25:06.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.474+0000 7f5851649700 1 -- 172.21.15.5:0/2679466271 learned_addr learned my addr 172.21.15.5:0/2679466271 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.474+0000 7f5851e4a700 1 --2- 172.21.15.5:0/2679466271 >> v2:172.21.15.191:3300/0 conn(0x7f584c0b1fe0 0x7f584c0ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.474+0000 7f5850e48700 1 -- 172.21.15.5:0/2679466271 >> v2:172.21.15.191:3300/0 conn(0x7f584c0b1fe0 msgr2=0x7f584c0ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.474+0000 7f5850e48700 1 --2- 172.21.15.5:0/2679466271 >> v2:172.21.15.191:3300/0 conn(0x7f584c0b1fe0 0x7f584c0ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.474+0000 7f5850e48700 1 -- 172.21.15.5:0/2679466271 >> v1:172.21.15.5:6789/0 conn(0x7f584c15cd40 legacy=0x7f584c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.474+0000 7f583ffff700 1 -- 172.21.15.5:0/2679466271 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233930670 0 0) 0x7f584c15e160 con 0x7f584c15cd40 2023-03-03T06:25:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.474+0000 7f5850e48700 1 -- 172.21.15.5:0/2679466271 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c15d3c0 con 0x7f584c0cd3e0 2023-03-03T06:25:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.474+0000 7f5850e48700 1 --2- 172.21.15.5:0/2679466271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cd3e0 0x7f584c0cdd50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f584c068620 tx=0x7f5840009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f17f1effdbf62c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.474+0000 7f583ffff700 1 -- 172.21.15.5:0/2679466271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840011830 con 0x7f584c0cd3e0 2023-03-03T06:25:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.474+0000 7f583ffff700 1 -- 172.21.15.5:0/2679466271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5840011990 con 0x7f584c0cd3e0 2023-03-03T06:25:06.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.474+0000 7f583ffff700 1 -- 172.21.15.5:0/2679466271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840011d20 con 0x7f584c0cd3e0 2023-03-03T06:25:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.475+0000 7f58538ad700 1 -- 172.21.15.5:0/2679466271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cd3e0 msgr2=0x7f584c0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.475+0000 7f58538ad700 1 --2- 172.21.15.5:0/2679466271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cd3e0 0x7f584c0cdd50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f584c068620 tx=0x7f5840009b20 comp rx=0 tx=0).stop 2023-03-03T06:25:06.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.475+0000 7f58538ad700 1 -- 172.21.15.5:0/2679466271 shutdown_connections 2023-03-03T06:25:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.475+0000 7f58538ad700 1 --2- 172.21.15.5:0/2679466271 >> v2:172.21.15.191:3300/0 conn(0x7f584c0b1fe0 0x7f584c0ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.475+0000 7f58538ad700 1 --2- 172.21.15.5:0/2679466271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cd3e0 0x7f584c0cdd50 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.475+0000 7f58538ad700 1 -- 172.21.15.5:0/2679466271 >> 172.21.15.5:0/2679466271 conn(0x7f584c0cc8d0 msgr2=0x7f584c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.475+0000 7f58538ad700 1 -- 172.21.15.5:0/2679466271 shutdown_connections 2023-03-03T06:25:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.475+0000 7f58538ad700 1 -- 172.21.15.5:0/2679466271 wait complete. 2023-03-03T06:25:06.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.476+0000 7f58538ad700 1 Processor -- start 2023-03-03T06:25:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.477+0000 7f58538ad700 1 -- start start 2023-03-03T06:25:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.477+0000 7f58538ad700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f584c0b1fe0 0x7f584c0c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f58538ad700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cd3e0 0x7f584c0ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f58538ad700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584c15cd40 0x7f584c1f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f58538ad700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0c8120 con 0x7f584c0cd3e0 2023-03-03T06:25:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f58538ad700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0ae9d0 con 0x7f584c0b1fe0 2023-03-03T06:25:06.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f58538ad700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0c8370 con 0x7f584c15cd40 2023-03-03T06:25:06.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f5850e48700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cd3e0 0x7f584c0ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f5850e48700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cd3e0 0x7f584c0ae490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43858/0 (socket says 172.21.15.5:43858) 2023-03-03T06:25:06.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f5850e48700 1 -- 172.21.15.5:0/3073488715 learned_addr learned my addr 172.21.15.5:0/3073488715 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:06.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f5851649700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f584c0b1fe0 0x7f584c0c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f5851e4a700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584c15cd40 0x7f584c1f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f5850e48700 1 -- 172.21.15.5:0/3073488715 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584c15cd40 msgr2=0x7f584c1f2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f5850e48700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584c15cd40 0x7f584c1f2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f5850e48700 1 -- 172.21.15.5:0/3073488715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f584c0b1fe0 msgr2=0x7f584c0c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f5850e48700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f584c0b1fe0 0x7f584c0c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f5850e48700 1 -- 172.21.15.5:0/3073488715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58400094a0 con 0x7f584c0cd3e0 2023-03-03T06:25:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f5850e48700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cd3e0 0x7f584c0ae490 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f58400090b0 tx=0x7f5840004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f583dffb700 1 -- 172.21.15.5:0/3073488715 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58400038a0 con 0x7f584c0cd3e0 2023-03-03T06:25:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f583dffb700 1 -- 172.21.15.5:0/3073488715 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584001f070 con 0x7f584c0cd3e0 2023-03-03T06:25:06.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f58538ad700 1 -- 172.21.15.5:0/3073488715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584c15d980 con 0x7f584c0cd3e0 2023-03-03T06:25:06.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.478+0000 7f583dffb700 1 -- 172.21.15.5:0/3073488715 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840003c20 con 0x7f584c0cd3e0 2023-03-03T06:25:06.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.479+0000 7f58538ad700 1 -- 172.21.15.5:0/3073488715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c15d6a0 con 0x7f584c0cd3e0 2023-03-03T06:25:06.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.479+0000 7f58538ad700 1 -- 172.21.15.5:0/3073488715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584c15dc60 con 0x7f584c0cd3e0 2023-03-03T06:25:06.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.480+0000 7f583dffb700 1 -- 172.21.15.5:0/3073488715 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f584000f050 con 0x7f584c0cd3e0 2023-03-03T06:25:06.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.480+0000 7f583dffb700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f58300682f0 0x7f583006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.480+0000 7f583dffb700 1 -- 172.21.15.5:0/3073488715 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f5840021070 con 0x7f584c0cd3e0 2023-03-03T06:25:06.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.480+0000 7f5851649700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f58300682f0 0x7f583006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.481+0000 7f5851649700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f58300682f0 0x7f583006a7a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5848000f60 tx=0x7f5848007c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:06.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.485+0000 7f583dffb700 1 -- 172.21.15.5:0/3073488715 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5840053eb0 con 0x7f584c0cd3e0 2023-03-03T06:25:06.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.676+0000 7f58538ad700 1 -- 172.21.15.5:0/3073488715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f584c04e6e0 con 0x7f584c0cd3e0 2023-03-03T06:25:06.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.676+0000 7f583dffb700 1 -- 172.21.15.5:0/3073488715 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f58400574d0 con 0x7f584c0cd3e0 2023-03-03T06:25:06.679 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:25:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.678+0000 7f58538ad700 1 -- 172.21.15.5:0/3073488715 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f58300682f0 msgr2=0x7f583006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.678+0000 7f58538ad700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f58300682f0 0x7f583006a7a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5848000f60 tx=0x7f5848007c90 comp rx=0 tx=0).stop 2023-03-03T06:25:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.678+0000 7f58538ad700 1 -- 172.21.15.5:0/3073488715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cd3e0 msgr2=0x7f584c0ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.678+0000 7f58538ad700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cd3e0 0x7f584c0ae490 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f58400090b0 tx=0x7f5840004750 comp rx=0 tx=0).stop 2023-03-03T06:25:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.679+0000 7f58538ad700 1 -- 172.21.15.5:0/3073488715 shutdown_connections 2023-03-03T06:25:06.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.679+0000 7f58538ad700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f58300682f0 0x7f583006a7a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.679+0000 7f58538ad700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584c15cd40 0x7f584c1f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.679+0000 7f58538ad700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f584c0b1fe0 0x7f584c0c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.679+0000 7f58538ad700 1 --2- 172.21.15.5:0/3073488715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f584c0cd3e0 0x7f584c0ae490 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.679+0000 7f58538ad700 1 -- 172.21.15.5:0/3073488715 >> 172.21.15.5:0/3073488715 conn(0x7f584c0cc8d0 msgr2=0x7f584c0cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.679+0000 7f58538ad700 1 -- 172.21.15.5:0/3073488715 shutdown_connections 2023-03-03T06:25:06.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.679+0000 7f58538ad700 1 -- 172.21.15.5:0/3073488715 wait complete. 2023-03-03T06:25:06.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:25:06.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.818+0000 7f6e7fcc7700 1 Processor -- start 2023-03-03T06:25:06.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.818+0000 7f6e7fcc7700 1 -- start start 2023-03-03T06:25:06.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.819+0000 7f6e7fcc7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e78158f30 0x7f6e780cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.819+0000 7f6e7fcc7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7815d740 con 0x7f6e7806d580 2023-03-03T06:25:06.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.819+0000 7f6e7fcc7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7815c850 con 0x7f6e780cd5c0 2023-03-03T06:25:06.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.819+0000 7f6e7fcc7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7815cb30 con 0x7f6e78158f30 2023-03-03T06:25:06.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.819+0000 7f6e7da63700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6e7806d580 0x7f6e7806d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33706/0 (socket says 172.21.15.5:33706) 2023-03-03T06:25:06.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.819+0000 7f6e7da63700 1 -- 172.21.15.5:0/3993782713 learned_addr learned my addr 172.21.15.5:0/3993782713 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:06.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.819+0000 7f6e7d262700 1 --2- 172.21.15.5:0/3993782713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e78158f30 0x7f6e780cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.819+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801988533 0 0) 0x7f6e7815d740 con 0x7f6e7806d580 2023-03-03T06:25:06.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.819+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e640035b0 con 0x7f6e7806d580 2023-03-03T06:25:06.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1189154982 0 0) 0x7f6e640035b0 con 0x7f6e7806d580 2023-03-03T06:25:06.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e78158f30 msgr2=0x7f6e780cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:06.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 --2- 172.21.15.5:0/3993782713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e78158f30 0x7f6e780cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 >> v1:172.21.15.191:6789/0 conn(0x7f6e780cd5c0 legacy=0x7f6e780ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7815ce10 con 0x7f6e7806d580 2023-03-03T06:25:06.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f6e68001670 con 0x7f6e7806d580 2023-03-03T06:25:06.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 >> v1:172.21.15.5:6789/0 conn(0x7f6e7806d580 legacy=0x7f6e7806d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 --2- 172.21.15.5:0/3993782713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e64003a30 0x7f6e64003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 --2- 172.21.15.5:0/3993782713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e78158f30 0x7f6e64004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 --2- 172.21.15.5:0/3993782713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e64004d90 0x7f6e64005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7815cb30 con 0x7f6e64004d90 2023-03-03T06:25:06.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6400bb20 con 0x7f6e64003a30 2023-03-03T06:25:06.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6400bce0 con 0x7f6e78158f30 2023-03-03T06:25:06.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7e264700 1 --2- 172.21.15.5:0/3993782713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e64004d90 0x7f6e64005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7da63700 1 --2- 172.21.15.5:0/3993782713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e64003a30 0x7f6e64003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7d262700 1 --2- 172.21.15.5:0/3993782713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e78158f30 0x7f6e64004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7e264700 1 -- 172.21.15.5:0/3993782713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e78158f30 msgr2=0x7f6e64004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7e264700 1 --2- 172.21.15.5:0/3993782713 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e78158f30 0x7f6e64004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7e264700 1 -- 172.21.15.5:0/3993782713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e64003a30 msgr2=0x7f6e64003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7e264700 1 --2- 172.21.15.5:0/3993782713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e64003a30 0x7f6e64003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7e264700 1 -- 172.21.15.5:0/3993782713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e640035b0 con 0x7f6e64004d90 2023-03-03T06:25:06.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7e264700 1 --2- 172.21.15.5:0/3993782713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e64004d90 0x7f6e64005200 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000c160 tx=0x7f6e64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317db31f20ff5a06 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:06.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70001db0 con 0x7f6e64004d90 2023-03-03T06:25:06.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7000cca0 con 0x7f6e64004d90 2023-03-03T06:25:06.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.820+0000 7f6e7ca61700 1 -- 172.21.15.5:0/3993782713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70003c40 con 0x7f6e64004d90 2023-03-03T06:25:06.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.821+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/3993782713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e64004d90 msgr2=0x7f6e64005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.821+0000 7f6e7fcc7700 1 --2- 172.21.15.5:0/3993782713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e64004d90 0x7f6e64005200 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000c160 tx=0x7f6e64005880 comp rx=0 tx=0).stop 2023-03-03T06:25:06.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.821+0000 7f6e7e264700 1 -- 172.21.15.5:0/3993782713 reap_dead start 2023-03-03T06:25:06.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.821+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/3993782713 shutdown_connections 2023-03-03T06:25:06.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.821+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/3993782713 >> 172.21.15.5:0/3993782713 conn(0x7f6e780cf4b0 msgr2=0x7f6e780cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:06.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.821+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/3993782713 shutdown_connections 2023-03-03T06:25:06.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.821+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/3993782713 wait complete. 2023-03-03T06:25:06.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.822+0000 7f6e7fcc7700 1 Processor -- start 2023-03-03T06:25:06.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.822+0000 7f6e7fcc7700 1 -- start start 2023-03-03T06:25:06.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.823+0000 7f6e7fcc7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e78149270 0x7f6e781f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.823+0000 7f6e7fcc7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e7815aed0 0x7f6e7815b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.823+0000 7f6e7fcc7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e780b22e0 0x7f6e780b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.823+0000 7f6e7fcc7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780ac9a0 con 0x7f6e780b22e0 2023-03-03T06:25:06.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.823+0000 7f6e7fcc7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e781f2550 con 0x7f6e78149270 2023-03-03T06:25:06.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.823+0000 7f6e7fcc7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7815b880 con 0x7f6e7815aed0 2023-03-03T06:25:06.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.823+0000 7f6e7e264700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e780b22e0 0x7f6e780b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.823+0000 7f6e7e264700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e780b22e0 0x7f6e780b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43880/0 (socket says 172.21.15.5:43880) 2023-03-03T06:25:06.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.823+0000 7f6e7e264700 1 -- 172.21.15.5:0/2934542742 learned_addr learned my addr 172.21.15.5:0/2934542742 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:06.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.823+0000 7f6e7da63700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e78149270 0x7f6e781f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.823+0000 7f6e7d262700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e7815aed0 0x7f6e7815b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.824+0000 7f6e7e264700 1 -- 172.21.15.5:0/2934542742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e7815aed0 msgr2=0x7f6e7815b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.824+0000 7f6e7e264700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e7815aed0 0x7f6e7815b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.824+0000 7f6e7e264700 1 -- 172.21.15.5:0/2934542742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e78149270 msgr2=0x7f6e781f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:06.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.824+0000 7f6e7e264700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e78149270 0x7f6e781f30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:06.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.824+0000 7f6e7e264700 1 -- 172.21.15.5:0/2934542742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7815d3d0 con 0x7f6e780b22e0 2023-03-03T06:25:06.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.824+0000 7f6e7e264700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e780b22e0 0x7f6e780b2760 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6e70004000 tx=0x7f6e700014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:06.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.824+0000 7f6e6e7fc700 1 -- 172.21.15.5:0/2934542742 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70003e10 con 0x7f6e780b22e0 2023-03-03T06:25:06.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.824+0000 7f6e6e7fc700 1 -- 172.21.15.5:0/2934542742 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e700050d0 con 0x7f6e780b22e0 2023-03-03T06:25:06.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.824+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/2934542742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7815d0f0 con 0x7f6e780b22e0 2023-03-03T06:25:06.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.824+0000 7f6e6e7fc700 1 -- 172.21.15.5:0/2934542742 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70005480 con 0x7f6e780b22e0 2023-03-03T06:25:06.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.824+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/2934542742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7806b0d0 con 0x7f6e780b22e0 2023-03-03T06:25:06.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.825+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/2934542742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e781f3600 con 0x7f6e780b22e0 2023-03-03T06:25:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.825+0000 7f6e6e7fc700 1 -- 172.21.15.5:0/2934542742 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6e70010050 con 0x7f6e780b22e0 2023-03-03T06:25:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.826+0000 7f6e6e7fc700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6e5c0682f0 0x7f6e5c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.826+0000 7f6e6e7fc700 1 -- 172.21.15.5:0/2934542742 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f6e70086790 con 0x7f6e780b22e0 2023-03-03T06:25:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.826+0000 7f6e7da63700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6e5c0682f0 0x7f6e5c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.826+0000 7f6e7da63700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6e5c0682f0 0x7f6e5c06a7a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6e7815ba20 tx=0x7f6e68009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:06.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:06.830+0000 7f6e6e7fc700 1 -- 172.21.15.5:0/2934542742 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6e70052ce0 con 0x7f6e780b22e0 2023-03-03T06:25:07.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.022+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/2934542742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e7804e6e0 con 0x7f6e780b22e0 2023-03-03T06:25:07.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.023+0000 7f6e6e7fc700 1 -- 172.21.15.5:0/2934542742 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e70056300 con 0x7f6e780b22e0 2023-03-03T06:25:07.025 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:25:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.024+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/2934542742 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6e5c0682f0 msgr2=0x7f6e5c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.024+0000 7f6e7fcc7700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6e5c0682f0 0x7f6e5c06a7a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6e7815ba20 tx=0x7f6e68009040 comp rx=0 tx=0).stop 2023-03-03T06:25:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.024+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/2934542742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e780b22e0 msgr2=0x7f6e780b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.024+0000 7f6e7fcc7700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e780b22e0 0x7f6e780b2760 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6e70004000 tx=0x7f6e700014a0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.024+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/2934542742 shutdown_connections 2023-03-03T06:25:07.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.025+0000 7f6e7fcc7700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e780b22e0 0x7f6e780b2760 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.025+0000 7f6e7fcc7700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e78149270 0x7f6e781f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.025+0000 7f6e7fcc7700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6e5c0682f0 0x7f6e5c06a7a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.025+0000 7f6e7fcc7700 1 --2- 172.21.15.5:0/2934542742 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e7815aed0 0x7f6e7815b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.025+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/2934542742 >> 172.21.15.5:0/2934542742 conn(0x7f6e780cf4b0 msgr2=0x7f6e780ce6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.025+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/2934542742 shutdown_connections 2023-03-03T06:25:07.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.025+0000 7f6e7fcc7700 1 -- 172.21.15.5:0/2934542742 wait complete. 2023-03-03T06:25:07.039 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:25:07.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.165+0000 7f86fe045700 1 Processor -- start 2023-03-03T06:25:07.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.165+0000 7f86fe045700 1 -- start start 2023-03-03T06:25:07.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86fe045700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8d0 0x7f86f80cb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86fe045700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86f806d580 0x7f86f806da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86fe045700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f80c9f70 con 0x7f86f815e230 2023-03-03T06:25:07.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86fe045700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f806df40 con 0x7f86f806d580 2023-03-03T06:25:07.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86fe045700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80b2a10 con 0x7f86f815a8d0 2023-03-03T06:25:07.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86f7fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f86f806d580 0x7f86f806da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86f6ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f86f815e230 0x7f86f80b2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33726/0 (socket says 172.21.15.5:33726) 2023-03-03T06:25:07.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86f6ffd700 1 -- 172.21.15.5:0/1758142558 learned_addr learned my addr 172.21.15.5:0/1758142558 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:07.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86f77fe700 1 --2- 172.21.15.5:0/1758142558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8d0 0x7f86f80cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86f7fff700 1 -- 172.21.15.5:0/1758142558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8d0 msgr2=0x7f86f80cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:07.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86f7fff700 1 --2- 172.21.15.5:0/1758142558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8d0 0x7f86f80cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86f7fff700 1 -- 172.21.15.5:0/1758142558 >> v1:172.21.15.5:6789/0 conn(0x7f86f815e230 legacy=0x7f86f80b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86f67fc700 1 -- 172.21.15.5:0/1758142558 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486969837 0 0) 0x7f86f80c9f70 con 0x7f86f815e230 2023-03-03T06:25:07.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86f7fff700 1 -- 172.21.15.5:0/1758142558 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f815e7a0 con 0x7f86f806d580 2023-03-03T06:25:07.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86f7fff700 1 --2- 172.21.15.5:0/1758142558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f806d580 0x7f86f806da00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009d90 tx=0x7f86f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187012cdea053444 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:07.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.166+0000 7f86f67fc700 1 -- 172.21.15.5:0/1758142558 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f000e070 con 0x7f86f806d580 2023-03-03T06:25:07.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.167+0000 7f86f67fc700 1 -- 172.21.15.5:0/1758142558 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f000bbd0 con 0x7f86f806d580 2023-03-03T06:25:07.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.167+0000 7f86f67fc700 1 -- 172.21.15.5:0/1758142558 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f0012430 con 0x7f86f806d580 2023-03-03T06:25:07.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.167+0000 7f86fe045700 1 -- 172.21.15.5:0/1758142558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f806d580 msgr2=0x7f86f806da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.167+0000 7f86fe045700 1 --2- 172.21.15.5:0/1758142558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f806d580 0x7f86f806da00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009d90 tx=0x7f86f000b330 comp rx=0 tx=0).stop 2023-03-03T06:25:07.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.167+0000 7f86fe045700 1 -- 172.21.15.5:0/1758142558 shutdown_connections 2023-03-03T06:25:07.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.167+0000 7f86fe045700 1 --2- 172.21.15.5:0/1758142558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f806d580 0x7f86f806da00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.167+0000 7f86fe045700 1 --2- 172.21.15.5:0/1758142558 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8d0 0x7f86f80cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.167+0000 7f86fe045700 1 -- 172.21.15.5:0/1758142558 >> 172.21.15.5:0/1758142558 conn(0x7f86f80cf4b0 msgr2=0x7f86f80cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:07.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.167+0000 7f86fe045700 1 -- 172.21.15.5:0/1758142558 shutdown_connections 2023-03-03T06:25:07.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.167+0000 7f86fe045700 1 -- 172.21.15.5:0/1758142558 wait complete. 2023-03-03T06:25:07.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.168+0000 7f86fe045700 1 Processor -- start 2023-03-03T06:25:07.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.169+0000 7f86fe045700 1 -- start start 2023-03-03T06:25:07.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.169+0000 7f86fe045700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f806d580 0x7f86f8154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.169+0000 7f86fe045700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8d0 0x7f86f815d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.169+0000 7f86fe045700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f815e230 0x7f86f80b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.169+0000 7f86fe045700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80cdf50 con 0x7f86f806d580 2023-03-03T06:25:07.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.169+0000 7f86fe045700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f8154c70 con 0x7f86f815e230 2023-03-03T06:25:07.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.169+0000 7f86fe045700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80cd080 con 0x7f86f815a8d0 2023-03-03T06:25:07.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.169+0000 7f86f77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f806d580 0x7f86f8154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.169+0000 7f86f77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f806d580 0x7f86f8154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43892/0 (socket says 172.21.15.5:43892) 2023-03-03T06:25:07.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.169+0000 7f86f77fe700 1 -- 172.21.15.5:0/958500708 learned_addr learned my addr 172.21.15.5:0/958500708 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:07.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.170+0000 7f86f7fff700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f815e230 0x7f86f80b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.170+0000 7f86f6ffd700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8d0 0x7f86f815d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.170+0000 7f86f77fe700 1 -- 172.21.15.5:0/958500708 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8d0 msgr2=0x7f86f815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.170+0000 7f86f77fe700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8d0 0x7f86f815d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.170+0000 7f86f77fe700 1 -- 172.21.15.5:0/958500708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f815e230 msgr2=0x7f86f80b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.170+0000 7f86f77fe700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f815e230 0x7f86f80b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.170+0000 7f86f77fe700 1 -- 172.21.15.5:0/958500708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f0009a70 con 0x7f86f806d580 2023-03-03T06:25:07.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.170+0000 7f86f77fe700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f806d580 0x7f86f8154730 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c7f0 tx=0x7f86ec00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:07.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.170+0000 7f86dffff700 1 -- 172.21.15.5:0/958500708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec004220 con 0x7f86f806d580 2023-03-03T06:25:07.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.170+0000 7f86dffff700 1 -- 172.21.15.5:0/958500708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec004380 con 0x7f86f806d580 2023-03-03T06:25:07.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.170+0000 7f86fe045700 1 -- 172.21.15.5:0/958500708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f815ed60 con 0x7f86f806d580 2023-03-03T06:25:07.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.170+0000 7f86dffff700 1 -- 172.21.15.5:0/958500708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0036a0 con 0x7f86f806d580 2023-03-03T06:25:07.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.170+0000 7f86fe045700 1 -- 172.21.15.5:0/958500708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f815ea80 con 0x7f86f806d580 2023-03-03T06:25:07.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.171+0000 7f86fe045700 1 -- 172.21.15.5:0/958500708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f815f040 con 0x7f86f806d580 2023-03-03T06:25:07.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.171+0000 7f86dffff700 1 -- 172.21.15.5:0/958500708 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f86ec020070 con 0x7f86f806d580 2023-03-03T06:25:07.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.172+0000 7f86dffff700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86e40682f0 0x7f86e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.172+0000 7f86dffff700 1 -- 172.21.15.5:0/958500708 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f86ec085970 con 0x7f86f806d580 2023-03-03T06:25:07.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.172+0000 7f86f6ffd700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86e40682f0 0x7f86e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.172+0000 7f86f6ffd700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86e40682f0 0x7f86e406a7a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f86f81555c0 tx=0x7f86e8007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:07.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.176+0000 7f86dffff700 1 -- 172.21.15.5:0/958500708 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f86ec051ef0 con 0x7f86f806d580 2023-03-03T06:25:07.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.368+0000 7f86fe045700 1 -- 172.21.15.5:0/958500708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86f804e6e0 con 0x7f86f806d580 2023-03-03T06:25:07.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.368+0000 7f86dffff700 1 -- 172.21.15.5:0/958500708 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86ec055510 con 0x7f86f806d580 2023-03-03T06:25:07.372 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:25:07.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.370+0000 7f86fe045700 1 -- 172.21.15.5:0/958500708 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86e40682f0 msgr2=0x7f86e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.370+0000 7f86fe045700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86e40682f0 0x7f86e406a7a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f86f81555c0 tx=0x7f86e8007de0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.370+0000 7f86fe045700 1 -- 172.21.15.5:0/958500708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f806d580 msgr2=0x7f86f8154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.370+0000 7f86fe045700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f806d580 0x7f86f8154730 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c7f0 tx=0x7f86ec00cb00 comp rx=0 tx=0).stop 2023-03-03T06:25:07.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.370+0000 7f86fe045700 1 -- 172.21.15.5:0/958500708 shutdown_connections 2023-03-03T06:25:07.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.370+0000 7f86fe045700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86f815e230 0x7f86f80b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.370+0000 7f86fe045700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86f806d580 0x7f86f8154730 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.370+0000 7f86fe045700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86e40682f0 0x7f86e406a7a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.370+0000 7f86fe045700 1 --2- 172.21.15.5:0/958500708 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86f815a8d0 0x7f86f815d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.371+0000 7f86fe045700 1 -- 172.21.15.5:0/958500708 >> 172.21.15.5:0/958500708 conn(0x7f86f80cf4b0 msgr2=0x7f86f80b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:07.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.371+0000 7f86fe045700 1 -- 172.21.15.5:0/958500708 shutdown_connections 2023-03-03T06:25:07.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.371+0000 7f86fe045700 1 -- 172.21.15.5:0/958500708 wait complete. 2023-03-03T06:25:07.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:25:07.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.513+0000 7f7da1022700 1 Processor -- start 2023-03-03T06:25:07.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.513+0000 7f7da1022700 1 -- start start 2023-03-03T06:25:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7da1022700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d9c0ce050 0x7f7d9c0c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7da1022700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9c0ca7f0 con 0x7f7d9c06d580 2023-03-03T06:25:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7da1022700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9c160930 con 0x7f7d9c160dc0 2023-03-03T06:25:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7da1022700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0ca040 con 0x7f7d9c0ce050 2023-03-03T06:25:07.518 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d9ad9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7d9c06d580 0x7f7d9c06d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33740/0 (socket says 172.21.15.5:33740) 2023-03-03T06:25:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d9ad9d700 1 -- 172.21.15.5:0/662956244 learned_addr learned my addr 172.21.15.5:0/662956244 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105266538 0 0) 0x7f7d90001110 con 0x7f7d9c06d580 2023-03-03T06:25:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d840035b0 con 0x7f7d9c06d580 2023-03-03T06:25:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d9a59c700 1 --2- 172.21.15.5:0/662956244 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d9c0ce050 0x7f7d9c0c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2229159593 0 0) 0x7f7d840035b0 con 0x7f7d9c06d580 2023-03-03T06:25:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d9c0ce050 msgr2=0x7f7d9c0c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 --2- 172.21.15.5:0/662956244 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d9c0ce050 0x7f7d9c0c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 >> v1:172.21.15.191:6789/0 conn(0x7f7d9c160dc0 legacy=0x7f7d9c15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0ce4c0 con 0x7f7d9c06d580 2023-03-03T06:25:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f7d90001800 con 0x7f7d9c06d580 2023-03-03T06:25:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 >> v1:172.21.15.5:6789/0 conn(0x7f7d9c06d580 legacy=0x7f7d9c06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 --2- 172.21.15.5:0/662956244 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d9c0ce050 0x7f7d84003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 --2- 172.21.15.5:0/662956244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d84003fb0 0x7f7d84004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 --2- 172.21.15.5:0/662956244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d84004d90 0x7f7d84005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8400bba0 con 0x7f7d84004d90 2023-03-03T06:25:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8400bce0 con 0x7f7d84003fb0 2023-03-03T06:25:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.514+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8400bea0 con 0x7f7d9c0ce050 2023-03-03T06:25:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.515+0000 7f7d9b59e700 1 --2- 172.21.15.5:0/662956244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d84004d90 0x7f7d84005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.515+0000 7f7d9ad9d700 1 --2- 172.21.15.5:0/662956244 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d9c0ce050 0x7f7d84003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.515+0000 7f7d9a59c700 1 --2- 172.21.15.5:0/662956244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d84003fb0 0x7f7d84004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.515+0000 7f7d9b59e700 1 -- 172.21.15.5:0/662956244 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d9c0ce050 msgr2=0x7f7d84003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.515+0000 7f7d9b59e700 1 --2- 172.21.15.5:0/662956244 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d9c0ce050 0x7f7d84003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.515+0000 7f7d9b59e700 1 -- 172.21.15.5:0/662956244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d84003fb0 msgr2=0x7f7d84004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.515+0000 7f7d9b59e700 1 --2- 172.21.15.5:0/662956244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d84003fb0 0x7f7d84004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.515+0000 7f7d9b59e700 1 -- 172.21.15.5:0/662956244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d840035b0 con 0x7f7d84004d90 2023-03-03T06:25:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.515+0000 7f7d9b59e700 1 --2- 172.21.15.5:0/662956244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d84004d90 0x7f7d84005200 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400c210 tx=0x7f7d84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89df1ef707ab80 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.515+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94001df0 con 0x7f7d84004d90 2023-03-03T06:25:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.515+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9400cd70 con 0x7f7d84004d90 2023-03-03T06:25:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.515+0000 7f7d99d9b700 1 -- 172.21.15.5:0/662956244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94003c40 con 0x7f7d84004d90 2023-03-03T06:25:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.516+0000 7f7da1022700 1 -- 172.21.15.5:0/662956244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d84004d90 msgr2=0x7f7d84005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.516+0000 7f7da1022700 1 --2- 172.21.15.5:0/662956244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d84004d90 0x7f7d84005200 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400c210 tx=0x7f7d84005880 comp rx=0 tx=0).stop 2023-03-03T06:25:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.516+0000 7f7d9b59e700 1 -- 172.21.15.5:0/662956244 reap_dead start 2023-03-03T06:25:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.516+0000 7f7da1022700 1 -- 172.21.15.5:0/662956244 shutdown_connections 2023-03-03T06:25:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.516+0000 7f7da1022700 1 -- 172.21.15.5:0/662956244 >> 172.21.15.5:0/662956244 conn(0x7f7d9c0cf4b0 msgr2=0x7f7d9c0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.516+0000 7f7da1022700 1 -- 172.21.15.5:0/662956244 shutdown_connections 2023-03-03T06:25:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.516+0000 7f7da1022700 1 -- 172.21.15.5:0/662956244 wait complete. 2023-03-03T06:25:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.518+0000 7f7da1022700 1 Processor -- start 2023-03-03T06:25:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.518+0000 7f7da1022700 1 -- start start 2023-03-03T06:25:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7da1022700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d9c157330 0x7f7d9c157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7da1022700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d9c0ae5c0 0x7f7d9c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7da1022700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d9c0ab8d0 0x7f7d9c15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7da1022700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0abdd0 con 0x7f7d9c0ae5c0 2023-03-03T06:25:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7da1022700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0ac0b0 con 0x7f7d9c0ab8d0 2023-03-03T06:25:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7da1022700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0ac390 con 0x7f7d9c157330 2023-03-03T06:25:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d9a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d9c0ae5c0 0x7f7d9c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d9a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d9c0ae5c0 0x7f7d9c15ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43912/0 (socket says 172.21.15.5:43912) 2023-03-03T06:25:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d9a59c700 1 -- 172.21.15.5:0/1798771864 learned_addr learned my addr 172.21.15.5:0/1798771864 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:07.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d9ad9d700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d9c157330 0x7f7d9c157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d9b59e700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d9c0ab8d0 0x7f7d9c15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d9a59c700 1 -- 172.21.15.5:0/1798771864 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d9c157330 msgr2=0x7f7d9c157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d9a59c700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d9c157330 0x7f7d9c157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d9a59c700 1 -- 172.21.15.5:0/1798771864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d9c0ab8d0 msgr2=0x7f7d9c15b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d9a59c700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d9c0ab8d0 0x7f7d9c15b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d9a59c700 1 -- 172.21.15.5:0/1798771864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0ca510 con 0x7f7d9c0ae5c0 2023-03-03T06:25:07.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d9b59e700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d9c0ab8d0 0x7f7d9c15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d9a59c700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d9c0ae5c0 0x7f7d9c15ae00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c011aa0 tx=0x7f7d8c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d837fe700 1 -- 172.21.15.5:0/1798771864 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c00f8c0 con 0x7f7d9c0ae5c0 2023-03-03T06:25:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7d837fe700 1 -- 172.21.15.5:0/1798771864 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8c00fa20 con 0x7f7d9c0ae5c0 2023-03-03T06:25:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.519+0000 7f7da1022700 1 -- 172.21.15.5:0/1798771864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c0ca230 con 0x7f7d9c0ae5c0 2023-03-03T06:25:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.520+0000 7f7d837fe700 1 -- 172.21.15.5:0/1798771864 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c00fdd0 con 0x7f7d9c0ae5c0 2023-03-03T06:25:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.520+0000 7f7da1022700 1 -- 172.21.15.5:0/1798771864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9c1605c0 con 0x7f7d9c0ae5c0 2023-03-03T06:25:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.520+0000 7f7da1022700 1 -- 172.21.15.5:0/1798771864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9c0cb230 con 0x7f7d9c0ae5c0 2023-03-03T06:25:07.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.521+0000 7f7d837fe700 1 -- 172.21.15.5:0/1798771864 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7d8c014440 con 0x7f7d9c0ae5c0 2023-03-03T06:25:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.521+0000 7f7d837fe700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7d880682f0 0x7f7d8806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.521+0000 7f7d837fe700 1 -- 172.21.15.5:0/1798771864 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f7d8c086810 con 0x7f7d9c0ae5c0 2023-03-03T06:25:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.521+0000 7f7d9ad9d700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7d880682f0 0x7f7d8806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.522+0000 7f7d9ad9d700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7d880682f0 0x7f7d8806a7a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c157f30 tx=0x7f7d900012e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:07.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.526+0000 7f7d837fe700 1 -- 172.21.15.5:0/1798771864 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7d8c052df0 con 0x7f7d9c0ae5c0 2023-03-03T06:25:07.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.719+0000 7f7da1022700 1 -- 172.21.15.5:0/1798771864 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7d9c04e6e0 con 0x7f7d9c0ae5c0 2023-03-03T06:25:07.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.720+0000 7f7d837fe700 1 -- 172.21.15.5:0/1798771864 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7d8c056410 con 0x7f7d9c0ae5c0 2023-03-03T06:25:07.722 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:25:07.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.722+0000 7f7da1022700 1 -- 172.21.15.5:0/1798771864 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7d880682f0 msgr2=0x7f7d8806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.722+0000 7f7da1022700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7d880682f0 0x7f7d8806a7a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c157f30 tx=0x7f7d900012e0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.722+0000 7f7da1022700 1 -- 172.21.15.5:0/1798771864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d9c0ae5c0 msgr2=0x7f7d9c15ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.722+0000 7f7da1022700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d9c0ae5c0 0x7f7d9c15ae00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c011aa0 tx=0x7f7d8c011e60 comp rx=0 tx=0).stop 2023-03-03T06:25:07.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.722+0000 7f7da1022700 1 -- 172.21.15.5:0/1798771864 shutdown_connections 2023-03-03T06:25:07.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.722+0000 7f7da1022700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d9c0ab8d0 0x7f7d9c15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.722+0000 7f7da1022700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7d880682f0 0x7f7d8806a7a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.722+0000 7f7da1022700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d9c157330 0x7f7d9c157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.722+0000 7f7da1022700 1 --2- 172.21.15.5:0/1798771864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d9c0ae5c0 0x7f7d9c15ae00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.722+0000 7f7da1022700 1 -- 172.21.15.5:0/1798771864 >> 172.21.15.5:0/1798771864 conn(0x7f7d9c0cf4b0 msgr2=0x7f7d9c06a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:07.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.722+0000 7f7da1022700 1 -- 172.21.15.5:0/1798771864 shutdown_connections 2023-03-03T06:25:07.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.722+0000 7f7da1022700 1 -- 172.21.15.5:0/1798771864 wait complete. 2023-03-03T06:25:07.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-03-03T06:25:07.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.862+0000 7f217f5cf700 1 Processor -- start 2023-03-03T06:25:07.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.862+0000 7f217f5cf700 1 -- start start 2023-03-03T06:25:07.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.863+0000 7f217f5cf700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2178159660 0x7f21780cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.863+0000 7f217f5cf700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f217806c230 0x7f21780cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.863+0000 7f217f5cf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21780714c0 0x7f2178071940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.863+0000 7f217f5cf700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2178071e80 con 0x7f21780714c0 2023-03-03T06:25:07.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.863+0000 7f217f5cf700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21780cab30 con 0x7f217806c230 2023-03-03T06:25:07.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.863+0000 7f217f5cf700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217806bda0 con 0x7f2178159660 2023-03-03T06:25:07.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.863+0000 7f217db6c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21780714c0 0x7f2178071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.863+0000 7f217db6c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f21780714c0 0x7f2178071940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43922/0 (socket says 172.21.15.5:43922) 2023-03-03T06:25:07.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.863+0000 7f217db6c700 1 -- 172.21.15.5:0/1840571808 learned_addr learned my addr 172.21.15.5:0/1840571808 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:07.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.864+0000 7f217cb6a700 1 --2- 172.21.15.5:0/1840571808 >> v2:172.21.15.191:3300/0 conn(0x7f217806c230 0x7f21780cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.864+0000 7f217d36b700 1 --2- 172.21.15.5:0/1840571808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2178159660 0x7f21780cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.864+0000 7f217db6c700 1 -- 172.21.15.5:0/1840571808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2178159660 msgr2=0x7f21780cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:07.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.864+0000 7f217db6c700 1 --2- 172.21.15.5:0/1840571808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2178159660 0x7f21780cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.864+0000 7f217db6c700 1 -- 172.21.15.5:0/1840571808 >> v2:172.21.15.191:3300/0 conn(0x7f217806c230 msgr2=0x7f21780cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:07.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.864+0000 7f217db6c700 1 --2- 172.21.15.5:0/1840571808 >> v2:172.21.15.191:3300/0 conn(0x7f217806c230 0x7f21780cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.864+0000 7f217db6c700 1 -- 172.21.15.5:0/1840571808 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780cb8c0 con 0x7f21780714c0 2023-03-03T06:25:07.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.864+0000 7f217cb6a700 1 --2- 172.21.15.5:0/1840571808 >> v2:172.21.15.191:3300/0 conn(0x7f217806c230 0x7f21780cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:07.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.864+0000 7f217db6c700 1 --2- 172.21.15.5:0/1840571808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21780714c0 0x7f2178071940 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f217806e710 tx=0x7f217000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a144fe9ceee320 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:07.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.864+0000 7f216bfff700 1 -- 172.21.15.5:0/1840571808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217000bbc0 con 0x7f21780714c0 2023-03-03T06:25:07.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.864+0000 7f216bfff700 1 -- 172.21.15.5:0/1840571808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217000bd20 con 0x7f21780714c0 2023-03-03T06:25:07.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.864+0000 7f216bfff700 1 -- 172.21.15.5:0/1840571808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21700116a0 con 0x7f21780714c0 2023-03-03T06:25:07.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.865+0000 7f217f5cf700 1 -- 172.21.15.5:0/1840571808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21780714c0 msgr2=0x7f2178071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.865+0000 7f217f5cf700 1 --2- 172.21.15.5:0/1840571808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21780714c0 0x7f2178071940 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f217806e710 tx=0x7f217000b330 comp rx=0 tx=0).stop 2023-03-03T06:25:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.865+0000 7f217f5cf700 1 -- 172.21.15.5:0/1840571808 shutdown_connections 2023-03-03T06:25:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.865+0000 7f217f5cf700 1 --2- 172.21.15.5:0/1840571808 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2178159660 0x7f21780cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.865+0000 7f217f5cf700 1 --2- 172.21.15.5:0/1840571808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21780714c0 0x7f2178071940 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.865+0000 7f217f5cf700 1 --2- 172.21.15.5:0/1840571808 >> v2:172.21.15.191:3300/0 conn(0x7f217806c230 0x7f21780cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.865+0000 7f217f5cf700 1 -- 172.21.15.5:0/1840571808 >> 172.21.15.5:0/1840571808 conn(0x7f21780cf4b0 msgr2=0x7f21780cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.865+0000 7f217f5cf700 1 -- 172.21.15.5:0/1840571808 shutdown_connections 2023-03-03T06:25:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.865+0000 7f217f5cf700 1 -- 172.21.15.5:0/1840571808 wait complete. 2023-03-03T06:25:07.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.866+0000 7f217f5cf700 1 Processor -- start 2023-03-03T06:25:07.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.866+0000 7f217f5cf700 1 -- start start 2023-03-03T06:25:07.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217f5cf700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f217806c230 0x7f21780b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217f5cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21780714c0 0x7f21781f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217f5cf700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2178159660 0x7f21780aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217f5cf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21780b5390 con 0x7f21780714c0 2023-03-03T06:25:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217f5cf700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21780afaa0 con 0x7f2178159660 2023-03-03T06:25:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217f5cf700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2178154110 con 0x7f217806c230 2023-03-03T06:25:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217cb6a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21780714c0 0x7f21781f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217cb6a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21780714c0 0x7f21781f1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43926/0 (socket says 172.21.15.5:43926) 2023-03-03T06:25:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217cb6a700 1 -- 172.21.15.5:0/3212043249 learned_addr learned my addr 172.21.15.5:0/3212043249 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217db6c700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2178159660 0x7f21780aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217d36b700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f217806c230 0x7f21780b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217cb6a700 1 -- 172.21.15.5:0/3212043249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f217806c230 msgr2=0x7f21780b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217cb6a700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f217806c230 0x7f21780b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217cb6a700 1 -- 172.21.15.5:0/3212043249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2178159660 msgr2=0x7f21780aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217cb6a700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2178159660 0x7f21780aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217cb6a700 1 -- 172.21.15.5:0/3212043249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2170009b30 con 0x7f21780714c0 2023-03-03T06:25:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217db6c700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2178159660 0x7f21780aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f217cb6a700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21780714c0 0x7f21781f1790 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f217400d830 tx=0x7f217400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f2169ffb700 1 -- 172.21.15.5:0/3212043249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174004030 con 0x7f21780714c0 2023-03-03T06:25:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.867+0000 7f2169ffb700 1 -- 172.21.15.5:0/3212043249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174004190 con 0x7f21780714c0 2023-03-03T06:25:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.868+0000 7f2169ffb700 1 -- 172.21.15.5:0/3212043249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174004520 con 0x7f21780714c0 2023-03-03T06:25:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.868+0000 7f217f5cf700 1 -- 172.21.15.5:0/3212043249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2178159a30 con 0x7f21780714c0 2023-03-03T06:25:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.868+0000 7f217f5cf700 1 -- 172.21.15.5:0/3212043249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217806b1d0 con 0x7f21780714c0 2023-03-03T06:25:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.869+0000 7f217f5cf700 1 -- 172.21.15.5:0/3212043249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217806b470 con 0x7f21780714c0 2023-03-03T06:25:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.869+0000 7f2169ffb700 1 -- 172.21.15.5:0/3212043249 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f217401a020 con 0x7f21780714c0 2023-03-03T06:25:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.869+0000 7f2169ffb700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f215c0682f0 0x7f215c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.869+0000 7f2169ffb700 1 -- 172.21.15.5:0/3212043249 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f21740863b0 con 0x7f21780714c0 2023-03-03T06:25:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.870+0000 7f217d36b700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f215c0682f0 0x7f215c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:07.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.870+0000 7f217d36b700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f215c0682f0 0x7f215c06a7a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f21780c54c0 tx=0x7f216c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:07.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:07.874+0000 7f2169ffb700 1 -- 172.21.15.5:0/3212043249 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2174052930 con 0x7f21780714c0 2023-03-03T06:25:08.068 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.066+0000 7f217f5cf700 1 -- 172.21.15.5:0/3212043249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f21780b0080 con 0x7f21780714c0 2023-03-03T06:25:08.069 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.066+0000 7f2169ffb700 1 -- 172.21.15.5:0/3212043249 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v43) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2174055f50 con 0x7f21780714c0 2023-03-03T06:25:08.069 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:25:08.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.069+0000 7f217f5cf700 1 -- 172.21.15.5:0/3212043249 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f215c0682f0 msgr2=0x7f215c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:08.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.069+0000 7f217f5cf700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f215c0682f0 0x7f215c06a7a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f21780c54c0 tx=0x7f216c008040 comp rx=0 tx=0).stop 2023-03-03T06:25:08.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.069+0000 7f217f5cf700 1 -- 172.21.15.5:0/3212043249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21780714c0 msgr2=0x7f21781f1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:08.071 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.069+0000 7f217f5cf700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21780714c0 0x7f21781f1790 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f217400d830 tx=0x7f217400dbf0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.069+0000 7f217f5cf700 1 -- 172.21.15.5:0/3212043249 shutdown_connections 2023-03-03T06:25:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.069+0000 7f217f5cf700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2178159660 0x7f21780aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.069+0000 7f217f5cf700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f215c0682f0 0x7f215c06a7a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.069+0000 7f217f5cf700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f217806c230 0x7f21780b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.069+0000 7f217f5cf700 1 --2- 172.21.15.5:0/3212043249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21780714c0 0x7f21781f1790 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.069+0000 7f217f5cf700 1 -- 172.21.15.5:0/3212043249 >> 172.21.15.5:0/3212043249 conn(0x7f21780cf4b0 msgr2=0x7f21780c4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.069+0000 7f217f5cf700 1 -- 172.21.15.5:0/3212043249 shutdown_connections 2023-03-03T06:25:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.069+0000 7f217f5cf700 1 -- 172.21.15.5:0/3212043249 wait complete. 2023-03-03T06:25:08.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-03T06:25:08.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.208+0000 7f112c15f700 1 Processor -- start 2023-03-03T06:25:08.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.208+0000 7f112c15f700 1 -- start start 2023-03-03T06:25:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.209+0000 7f112c15f700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f112415cd40 0x7f11240b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.209+0000 7f112c15f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11240cef60 0x7f11240b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.209+0000 7f112c15f700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112415d4e0 con 0x7f11240cba50 2023-03-03T06:25:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.209+0000 7f112c15f700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112415d7c0 con 0x7f112415cd40 2023-03-03T06:25:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.209+0000 7f112c15f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112415daa0 con 0x7f11240cef60 2023-03-03T06:25:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.209+0000 7f112a6fc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11240cef60 0x7f11240b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.209+0000 7f1129efb700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f112415cd40 0x7f11240b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.210+0000 7f1129efb700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f112415cd40 0x7f11240b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:44292/0 (socket says 172.21.15.5:44292) 2023-03-03T06:25:08.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.210+0000 7f1129efb700 1 -- 172.21.15.5:0/368612625 learned_addr learned my addr 172.21.15.5:0/368612625 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.210+0000 7f112a6fc700 1 -- 172.21.15.5:0/368612625 >> v2:172.21.15.191:3300/0 conn(0x7f112415cd40 msgr2=0x7f11240b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.210+0000 7f112a6fc700 1 --2- 172.21.15.5:0/368612625 >> v2:172.21.15.191:3300/0 conn(0x7f112415cd40 0x7f11240b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.210+0000 7f112a6fc700 1 -- 172.21.15.5:0/368612625 >> v1:172.21.15.191:6789/0 conn(0x7f11240cba50 legacy=0x7f1124160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.210+0000 7f112a6fc700 1 -- 172.21.15.5:0/368612625 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112415dd80 con 0x7f11240cef60 2023-03-03T06:25:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.210+0000 7f1128ef9700 1 -- 172.21.15.5:0/368612625 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319585788 0 0) 0x7f112415d4e0 con 0x7f11240cba50 2023-03-03T06:25:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.210+0000 7f1129efb700 1 --2- 172.21.15.5:0/368612625 >> v2:172.21.15.191:3300/0 conn(0x7f112415cd40 0x7f11240b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:08.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.210+0000 7f112a6fc700 1 --2- 172.21.15.5:0/368612625 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11240cef60 0x7f11240b1e10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f111c009d90 tx=0x7f111c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75c42672ea61b749 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.210+0000 7f1128ef9700 1 -- 172.21.15.5:0/368612625 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c00e070 con 0x7f11240cef60 2023-03-03T06:25:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.210+0000 7f1128ef9700 1 -- 172.21.15.5:0/368612625 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c00bb20 con 0x7f11240cef60 2023-03-03T06:25:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.210+0000 7f1128ef9700 1 -- 172.21.15.5:0/368612625 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c012430 con 0x7f11240cef60 2023-03-03T06:25:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.211+0000 7f112c15f700 1 -- 172.21.15.5:0/368612625 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11240cef60 msgr2=0x7f11240b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.211+0000 7f112c15f700 1 --2- 172.21.15.5:0/368612625 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11240cef60 0x7f11240b1e10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f111c009d90 tx=0x7f111c00b330 comp rx=0 tx=0).stop 2023-03-03T06:25:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.211+0000 7f112c15f700 1 -- 172.21.15.5:0/368612625 shutdown_connections 2023-03-03T06:25:08.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.211+0000 7f112c15f700 1 --2- 172.21.15.5:0/368612625 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11240cef60 0x7f11240b1e10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.211+0000 7f112c15f700 1 --2- 172.21.15.5:0/368612625 >> v2:172.21.15.191:3300/0 conn(0x7f112415cd40 0x7f11240b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.211+0000 7f112c15f700 1 -- 172.21.15.5:0/368612625 >> 172.21.15.5:0/368612625 conn(0x7f11240cc8d0 msgr2=0x7f11240cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.211+0000 7f112c15f700 1 -- 172.21.15.5:0/368612625 shutdown_connections 2023-03-03T06:25:08.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.211+0000 7f112c15f700 1 -- 172.21.15.5:0/368612625 wait complete. 2023-03-03T06:25:08.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.212+0000 7f112c15f700 1 Processor -- start 2023-03-03T06:25:08.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.212+0000 7f112c15f700 1 -- start start 2023-03-03T06:25:08.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f112c15f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11240cba50 0x7f11240b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f112c15f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11240cef60 0x7f1124154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f112c15f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f112415cd40 0x7f1124154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f112c15f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11240aca70 con 0x7f11240cba50 2023-03-03T06:25:08.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f112c15f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11240acd50 con 0x7f11240cef60 2023-03-03T06:25:08.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f112c15f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11240ad030 con 0x7f112415cd40 2023-03-03T06:25:08.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f1129efb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11240cba50 0x7f11240b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f1129efb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11240cba50 0x7f11240b1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43938/0 (socket says 172.21.15.5:43938) 2023-03-03T06:25:08.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f1129efb700 1 -- 172.21.15.5:0/1599123761 learned_addr learned my addr 172.21.15.5:0/1599123761 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:08.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f112a6fc700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f112415cd40 0x7f1124154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f11296fa700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11240cef60 0x7f1124154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f1129efb700 1 -- 172.21.15.5:0/1599123761 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f112415cd40 msgr2=0x7f1124154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:08.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f1129efb700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f112415cd40 0x7f1124154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f1129efb700 1 -- 172.21.15.5:0/1599123761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11240cef60 msgr2=0x7f1124154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:08.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f1129efb700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11240cef60 0x7f1124154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f1129efb700 1 -- 172.21.15.5:0/1599123761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1114009550 con 0x7f11240cba50 2023-03-03T06:25:08.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f11296fa700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11240cef60 0x7f1124154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.213+0000 7f112a6fc700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f112415cd40 0x7f1124154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.214+0000 7f1129efb700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11240cba50 0x7f11240b1700 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f111400e9b0 tx=0x7f111400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.214+0000 7f111a7fc700 1 -- 172.21.15.5:0/1599123761 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111400c850 con 0x7f11240cba50 2023-03-03T06:25:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.214+0000 7f111a7fc700 1 -- 172.21.15.5:0/1599123761 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111400c9b0 con 0x7f11240cba50 2023-03-03T06:25:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.214+0000 7f111a7fc700 1 -- 172.21.15.5:0/1599123761 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111400cd20 con 0x7f11240cba50 2023-03-03T06:25:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.214+0000 7f112c15f700 1 -- 172.21.15.5:0/1599123761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c009a70 con 0x7f11240cba50 2023-03-03T06:25:08.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.214+0000 7f112c15f700 1 -- 172.21.15.5:0/1599123761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11240ca530 con 0x7f11240cba50 2023-03-03T06:25:08.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.215+0000 7f112c15f700 1 -- 172.21.15.5:0/1599123761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f112415e060 con 0x7f11240cba50 2023-03-03T06:25:08.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.215+0000 7f111a7fc700 1 -- 172.21.15.5:0/1599123761 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1114019030 con 0x7f11240cba50 2023-03-03T06:25:08.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.216+0000 7f111a7fc700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f11080682f0 0x7f110806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.216+0000 7f111a7fc700 1 -- 172.21.15.5:0/1599123761 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f1114085f70 con 0x7f11240cba50 2023-03-03T06:25:08.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.216+0000 7f11296fa700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f11080682f0 0x7f110806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.216+0000 7f11296fa700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f11080682f0 0x7f110806a7a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f112406aec0 tx=0x7f1120009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:08.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.220+0000 7f111a7fc700 1 -- 172.21.15.5:0/1599123761 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f11140524f0 con 0x7f11240cba50 2023-03-03T06:25:08.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.426+0000 7f112c15f700 1 -- 172.21.15.5:0/1599123761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f11240ad960 con 0x7f11240cba50 2023-03-03T06:25:08.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.426+0000 7f111a7fc700 1 -- 172.21.15.5:0/1599123761 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1114021080 con 0x7f11240cba50 2023-03-03T06:25:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.428+0000 7f112c15f700 1 -- 172.21.15.5:0/1599123761 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f11080682f0 msgr2=0x7f110806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.428+0000 7f112c15f700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f11080682f0 0x7f110806a7a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f112406aec0 tx=0x7f1120009040 comp rx=0 tx=0).stop 2023-03-03T06:25:08.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.428+0000 7f112c15f700 1 -- 172.21.15.5:0/1599123761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11240cba50 msgr2=0x7f11240b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.428+0000 7f112c15f700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11240cba50 0x7f11240b1700 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f111400e9b0 tx=0x7f111400ed70 comp rx=0 tx=0).stop 2023-03-03T06:25:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.428+0000 7f112c15f700 1 -- 172.21.15.5:0/1599123761 shutdown_connections 2023-03-03T06:25:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.428+0000 7f112c15f700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f11080682f0 0x7f110806a7a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.428+0000 7f112c15f700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f112415cd40 0x7f1124154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.428+0000 7f112c15f700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11240cba50 0x7f11240b1700 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.428+0000 7f112c15f700 1 --2- 172.21.15.5:0/1599123761 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11240cef60 0x7f1124154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.428+0000 7f112c15f700 1 -- 172.21.15.5:0/1599123761 >> 172.21.15.5:0/1599123761 conn(0x7f11240cc8d0 msgr2=0x7f11240aea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:08.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.428+0000 7f112c15f700 1 -- 172.21.15.5:0/1599123761 shutdown_connections 2023-03-03T06:25:08.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.428+0000 7f112c15f700 1 -- 172.21.15.5:0/1599123761 wait complete. 2023-03-03T06:25:08.433 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-03-03T06:25:08.443 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-03-03T06:25:08.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:08.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-03-03T06:25:08.483 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-03-03T06:25:08.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:08.484 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-03-03T06:25:08.540 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:25:08.541 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:08.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-03-03T06:25:08.562 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:25:08.562 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:08.598 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287360k,nr_inodes=4071840,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19712 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-03-03T06:25:08.598 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:25:08.599 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:08.620 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-03-03T06:25:08.621 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.760+0000 7f7ca4cb9700 1 Processor -- start 2023-03-03T06:25:08.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.760+0000 7f7ca4cb9700 1 -- start start 2023-03-03T06:25:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.761+0000 7f7ca4cb9700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7ca015a7b0 0x7f7ca006b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.761+0000 7f7ca4cb9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca006ba80 0x7f7ca00ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.761+0000 7f7ca4cb9700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00cf7e0 con 0x7f7ca015ab80 2023-03-03T06:25:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.761+0000 7f7ca4cb9700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca00b3290 con 0x7f7ca015a7b0 2023-03-03T06:25:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.761+0000 7f7ca4cb9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00b2ca0 con 0x7f7ca006ba80 2023-03-03T06:25:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.761+0000 7f7c9dd9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7ca015ab80 0x7f7ca00b36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33788/0 (socket says 172.21.15.5:33788) 2023-03-03T06:25:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.761+0000 7f7c9dd9b700 1 -- 172.21.15.5:0/1501092312 learned_addr learned my addr 172.21.15.5:0/1501092312 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.761+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050399209 0 0) 0x7f7ca00cf7e0 con 0x7f7ca015ab80 2023-03-03T06:25:08.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.761+0000 7f7c9e59c700 1 --2- 172.21.15.5:0/1501092312 >> v2:172.21.15.191:3300/0 conn(0x7f7ca015a7b0 0x7f7ca006b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.761+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c880035b0 con 0x7f7ca015ab80 2023-03-03T06:25:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.761+0000 7f7c9ed9d700 1 --2- 172.21.15.5:0/1501092312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca006ba80 0x7f7ca00ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3698400442 0 0) 0x7f7c880035b0 con 0x7f7ca015ab80 2023-03-03T06:25:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca006ba80 msgr2=0x7f7ca00ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 --2- 172.21.15.5:0/1501092312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca006ba80 0x7f7ca00ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 >> v2:172.21.15.191:3300/0 conn(0x7f7ca015a7b0 msgr2=0x7f7ca006b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 --2- 172.21.15.5:0/1501092312 >> v2:172.21.15.191:3300/0 conn(0x7f7ca015a7b0 0x7f7ca006b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00cfac0 con 0x7f7ca015ab80 2023-03-03T06:25:08.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f7c900017f0 con 0x7f7ca015ab80 2023-03-03T06:25:08.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 >> v1:172.21.15.5:6789/0 conn(0x7f7ca015ab80 legacy=0x7f7ca00b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:08.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 --2- 172.21.15.5:0/1501092312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c88003a70 0x7f7c88003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 --2- 172.21.15.5:0/1501092312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c88004850 0x7f7c88004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 --2- 172.21.15.5:0/1501092312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca006ba80 0x7f7c88005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00b3290 con 0x7f7c88003a70 2023-03-03T06:25:08.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00b2ca0 con 0x7f7c88004850 2023-03-03T06:25:08.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8800ba90 con 0x7f7ca006ba80 2023-03-03T06:25:08.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9e59c700 1 --2- 172.21.15.5:0/1501092312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c88003a70 0x7f7c88003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9dd9b700 1 --2- 172.21.15.5:0/1501092312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c88004850 0x7f7c88004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9ed9d700 1 --2- 172.21.15.5:0/1501092312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca006ba80 0x7f7c88005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9e59c700 1 -- 172.21.15.5:0/1501092312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca006ba80 msgr2=0x7f7c88005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:08.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9e59c700 1 --2- 172.21.15.5:0/1501092312 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca006ba80 0x7f7c88005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9e59c700 1 -- 172.21.15.5:0/1501092312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c88004850 msgr2=0x7f7c88004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:08.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9e59c700 1 --2- 172.21.15.5:0/1501092312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c88004850 0x7f7c88004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9e59c700 1 -- 172.21.15.5:0/1501092312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c880035b0 con 0x7f7c88003a70 2023-03-03T06:25:08.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.762+0000 7f7c9e59c700 1 --2- 172.21.15.5:0/1501092312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c88003a70 0x7f7c88003e80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009b60 tx=0x7f7c88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc33121b290a6ec0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:08.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.763+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400e6c0 con 0x7f7c88003a70 2023-03-03T06:25:08.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.763+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9400e820 con 0x7f7c88003a70 2023-03-03T06:25:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.763+0000 7f7c9d59a700 1 -- 172.21.15.5:0/1501092312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400eb90 con 0x7f7c88003a70 2023-03-03T06:25:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.763+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1501092312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c88003a70 msgr2=0x7f7c88003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.763+0000 7f7ca4cb9700 1 --2- 172.21.15.5:0/1501092312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c88003a70 0x7f7c88003e80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009b60 tx=0x7f7c88005880 comp rx=0 tx=0).stop 2023-03-03T06:25:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.763+0000 7f7c9ed9d700 1 -- 172.21.15.5:0/1501092312 reap_dead start 2023-03-03T06:25:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.763+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1501092312 shutdown_connections 2023-03-03T06:25:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.763+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1501092312 >> 172.21.15.5:0/1501092312 conn(0x7f7ca00cc8d0 msgr2=0x7f7ca00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:08.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.763+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1501092312 shutdown_connections 2023-03-03T06:25:08.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.763+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1501092312 wait complete. 2023-03-03T06:25:08.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.765+0000 7f7ca4cb9700 1 Processor -- start 2023-03-03T06:25:08.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.765+0000 7f7ca4cb9700 1 -- start start 2023-03-03T06:25:08.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.765+0000 7f7ca4cb9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c88003a70 0x7f7ca015d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.765+0000 7f7ca4cb9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca00c6f20 0x7f7ca00c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.765+0000 7f7ca4cb9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca00c7390 0x7f7ca00c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.765+0000 7f7ca4cb9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00b51b0 con 0x7f7ca00c7390 2023-03-03T06:25:08.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.765+0000 7f7ca4cb9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00c9d80 con 0x7f7c88003a70 2023-03-03T06:25:08.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.765+0000 7f7ca4cb9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00c7c60 con 0x7f7ca00c6f20 2023-03-03T06:25:08.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.765+0000 7f7c9ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca00c7390 0x7f7ca00c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.765+0000 7f7c9ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca00c7390 0x7f7ca00c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43962/0 (socket says 172.21.15.5:43962) 2023-03-03T06:25:08.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7c9ed9d700 1 -- 172.21.15.5:0/1042243797 learned_addr learned my addr 172.21.15.5:0/1042243797 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:08.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7c9dd9b700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca00c6f20 0x7f7ca00c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7c9ed9d700 1 -- 172.21.15.5:0/1042243797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca00c6f20 msgr2=0x7f7ca00c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7c9ed9d700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca00c6f20 0x7f7ca00c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7c9ed9d700 1 -- 172.21.15.5:0/1042243797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c88003a70 msgr2=0x7f7ca015d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7c9ed9d700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c88003a70 0x7f7ca015d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7c9ed9d700 1 -- 172.21.15.5:0/1042243797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00cd5b0 con 0x7f7ca00c7390 2023-03-03T06:25:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7c9dd9b700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca00c6f20 0x7f7ca00c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7c9ed9d700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca00c7390 0x7f7ca00c9840 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7c98011bf0 tx=0x7f7c9800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7c8effd700 1 -- 172.21.15.5:0/1042243797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9800e040 con 0x7f7ca00c7390 2023-03-03T06:25:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7c8effd700 1 -- 172.21.15.5:0/1042243797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9800f040 con 0x7f7ca00c7390 2023-03-03T06:25:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1042243797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca00b2eb0 con 0x7f7ca00c7390 2023-03-03T06:25:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7c8effd700 1 -- 172.21.15.5:0/1042243797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9800fe50 con 0x7f7ca00c7390 2023-03-03T06:25:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.766+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1042243797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca00cd740 con 0x7f7ca00c7390 2023-03-03T06:25:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.767+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1042243797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca00c6530 con 0x7f7ca00c7390 2023-03-03T06:25:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.768+0000 7f7c8effd700 1 -- 172.21.15.5:0/1042243797 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7c98015430 con 0x7f7ca00c7390 2023-03-03T06:25:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.768+0000 7f7c8effd700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c800682f0 0x7f7c8006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:08.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.768+0000 7f7c8effd700 1 -- 172.21.15.5:0/1042243797 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f7c980869d0 con 0x7f7ca00c7390 2023-03-03T06:25:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.768+0000 7f7c9e59c700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c800682f0 0x7f7c8006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.769+0000 7f7c9e59c700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c800682f0 0x7f7c8006a7a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c94000c00 tx=0x7f7c94013000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:08.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:08.772+0000 7f7c8effd700 1 -- 172.21.15.5:0/1042243797 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7c98052ef0 con 0x7f7ca00c7390 2023-03-03T06:25:09.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.006+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1042243797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ca00b52f0 con 0x7f7ca00c7390 2023-03-03T06:25:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.007+0000 7f7c8effd700 1 -- 172.21.15.5:0/1042243797 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f7c98056510 con 0x7f7ca00c7390 2023-03-03T06:25:09.009 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:09.009 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/1485137346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1485137346},{"type":"v1","addr":"172.21.15.191:6834","nonce":1485137346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4886,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2062075895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2062075895},{"type":"v1","addr":"172.21.15.5:6837","nonce":2062075895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3463336232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":3463336232},{"type":"v1","addr":"172.21.15.191:6835","nonce":3463336232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:24:55.063168+0000","modified":"2023-03-03T06:24:58.081923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5098},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5098":{"gid":5098,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/3094337828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3094337828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3094337828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-03T06:25:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.009+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1042243797 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c800682f0 msgr2=0x7f7c8006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.009+0000 7f7ca4cb9700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c800682f0 0x7f7c8006a7a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c94000c00 tx=0x7f7c94013000 comp rx=0 tx=0).stop 2023-03-03T06:25:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.009+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1042243797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca00c7390 msgr2=0x7f7ca00c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.009+0000 7f7ca4cb9700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca00c7390 0x7f7ca00c9840 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7c98011bf0 tx=0x7f7c9800f1b0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.009+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1042243797 shutdown_connections 2023-03-03T06:25:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.009+0000 7f7ca4cb9700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ca00c7390 0x7f7ca00c9840 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.009+0000 7f7ca4cb9700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c88003a70 0x7f7ca015d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.009+0000 7f7ca4cb9700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c800682f0 0x7f7c8006a7a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.009+0000 7f7ca4cb9700 1 --2- 172.21.15.5:0/1042243797 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7ca00c6f20 0x7f7ca00c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.009+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1042243797 >> 172.21.15.5:0/1042243797 conn(0x7f7ca00cc8d0 msgr2=0x7f7ca0156400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.009+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1042243797 shutdown_connections 2023-03-03T06:25:09.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.009+0000 7f7ca4cb9700 1 -- 172.21.15.5:0/1042243797 wait complete. 2023-03-03T06:25:09.013 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2023-03-03T06:25:09.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:09.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.146+0000 7f0803f87700 1 Processor -- start 2023-03-03T06:25:09.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.146+0000 7f0803f87700 1 -- start start 2023-03-03T06:25:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0803f87700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07fc15cd40 0x7f07fc0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0803f87700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07fc0cef60 0x7f07fc0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0803f87700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07fc15d4e0 con 0x7f07fc0cba50 2023-03-03T06:25:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0803f87700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07fc15d7c0 con 0x7f07fc15cd40 2023-03-03T06:25:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0803f87700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc15daa0 con 0x7f07fc0cef60 2023-03-03T06:25:09.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0801d23700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07fc15cd40 0x7f07fc0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0801d23700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07fc15cd40 0x7f07fc0b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43966/0 (socket says 172.21.15.5:43966) 2023-03-03T06:25:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0801d23700 1 -- 172.21.15.5:0/4261431341 learned_addr learned my addr 172.21.15.5:0/4261431341 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0802524700 1 --2- 172.21.15.5:0/4261431341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07fc0cef60 0x7f07fc0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0801d23700 1 -- 172.21.15.5:0/4261431341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07fc0cef60 msgr2=0x7f07fc0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0801d23700 1 --2- 172.21.15.5:0/4261431341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07fc0cef60 0x7f07fc0b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0801d23700 1 -- 172.21.15.5:0/4261431341 >> v1:172.21.15.191:6789/0 conn(0x7f07fc0cba50 legacy=0x7f07fc160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:09.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0801d23700 1 -- 172.21.15.5:0/4261431341 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc15dd80 con 0x7f07fc15cd40 2023-03-03T06:25:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.147+0000 7f0801d23700 1 --2- 172.21.15.5:0/4261431341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07fc15cd40 0x7f07fc0b18d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0098f0 tx=0x7f07ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cb9a7246e395a2 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.148+0000 7f0800d21700 1 -- 172.21.15.5:0/4261431341 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec004230 con 0x7f07fc15cd40 2023-03-03T06:25:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.148+0000 7f0800d21700 1 -- 172.21.15.5:0/4261431341 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec004390 con 0x7f07fc15cd40 2023-03-03T06:25:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.148+0000 7f0800d21700 1 -- 172.21.15.5:0/4261431341 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0036a0 con 0x7f07fc15cd40 2023-03-03T06:25:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.148+0000 7f0803f87700 1 -- 172.21.15.5:0/4261431341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07fc15cd40 msgr2=0x7f07fc0b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.148+0000 7f0803f87700 1 --2- 172.21.15.5:0/4261431341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07fc15cd40 0x7f07fc0b18d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0098f0 tx=0x7f07ec009c00 comp rx=0 tx=0).stop 2023-03-03T06:25:09.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.148+0000 7f0803f87700 1 -- 172.21.15.5:0/4261431341 shutdown_connections 2023-03-03T06:25:09.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.148+0000 7f0803f87700 1 --2- 172.21.15.5:0/4261431341 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07fc0cef60 0x7f07fc0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.148+0000 7f0803f87700 1 --2- 172.21.15.5:0/4261431341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07fc15cd40 0x7f07fc0b18d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.148+0000 7f0803f87700 1 -- 172.21.15.5:0/4261431341 >> 172.21.15.5:0/4261431341 conn(0x7f07fc0cc8d0 msgr2=0x7f07fc0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.148+0000 7f0803f87700 1 -- 172.21.15.5:0/4261431341 shutdown_connections 2023-03-03T06:25:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.148+0000 7f0803f87700 1 -- 172.21.15.5:0/4261431341 wait complete. 2023-03-03T06:25:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.149+0000 7f0803f87700 1 Processor -- start 2023-03-03T06:25:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.150+0000 7f0803f87700 1 -- start start 2023-03-03T06:25:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.150+0000 7f0803f87700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07fc0cba50 0x7f07fc0c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.150+0000 7f0803f87700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07fc0cef60 0x7f07fc0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.150+0000 7f0803f87700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07fc15cd40 0x7f07fc14e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.150+0000 7f0803f87700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc0c5770 con 0x7f07fc0cef60 2023-03-03T06:25:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.150+0000 7f0803f87700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc0c67d0 con 0x7f07fc15cd40 2023-03-03T06:25:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.150+0000 7f0803f87700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc0c54b0 con 0x7f07fc0cba50 2023-03-03T06:25:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.150+0000 7f0801522700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07fc0cef60 0x7f07fc0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.150+0000 7f0801522700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07fc0cef60 0x7f07fc0c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43974/0 (socket says 172.21.15.5:43974) 2023-03-03T06:25:09.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.150+0000 7f0801522700 1 -- 172.21.15.5:0/727207452 learned_addr learned my addr 172.21.15.5:0/727207452 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.150+0000 7f0801d23700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07fc0cba50 0x7f07fc0c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.150+0000 7f0802524700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07fc15cd40 0x7f07fc14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.151+0000 7f0801522700 1 -- 172.21.15.5:0/727207452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07fc0cba50 msgr2=0x7f07fc0c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.151+0000 7f0801522700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07fc0cba50 0x7f07fc0c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.151+0000 7f0801522700 1 -- 172.21.15.5:0/727207452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07fc15cd40 msgr2=0x7f07fc14e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.151+0000 7f0801522700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07fc15cd40 0x7f07fc14e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.151+0000 7f0801522700 1 -- 172.21.15.5:0/727207452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec009550 con 0x7f07fc0cef60 2023-03-03T06:25:09.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.151+0000 7f0801522700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07fc0cef60 0x7f07fc0c4f70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f07f800c480 tx=0x7f07f800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:09.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.151+0000 7f07f27fc700 1 -- 172.21.15.5:0/727207452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f80054e0 con 0x7f07fc0cef60 2023-03-03T06:25:09.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.151+0000 7f07f27fc700 1 -- 172.21.15.5:0/727207452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f800ce90 con 0x7f07fc0cef60 2023-03-03T06:25:09.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.151+0000 7f07f27fc700 1 -- 172.21.15.5:0/727207452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8003910 con 0x7f07fc0cef60 2023-03-03T06:25:09.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.151+0000 7f0803f87700 1 -- 172.21.15.5:0/727207452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07fc0ca530 con 0x7f07fc0cef60 2023-03-03T06:25:09.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.151+0000 7f0803f87700 1 -- 172.21.15.5:0/727207452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07fc15e060 con 0x7f07fc0cef60 2023-03-03T06:25:09.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.152+0000 7f0803f87700 1 -- 172.21.15.5:0/727207452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07fc15d110 con 0x7f07fc0cef60 2023-03-03T06:25:09.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.153+0000 7f07f27fc700 1 -- 172.21.15.5:0/727207452 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f07f8010070 con 0x7f07fc0cef60 2023-03-03T06:25:09.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.153+0000 7f07f27fc700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f07e00682f0 0x7f07e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.153+0000 7f07f27fc700 1 -- 172.21.15.5:0/727207452 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f07f8084e40 con 0x7f07fc0cef60 2023-03-03T06:25:09.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.153+0000 7f0801d23700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f07e00682f0 0x7f07e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.153+0000 7f0801d23700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f07e00682f0 0x7f07e006a7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009130 tx=0x7f07ec008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:09.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.157+0000 7f07f27fc700 1 -- 172.21.15.5:0/727207452 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f07f80513c0 con 0x7f07fc0cef60 2023-03-03T06:25:09.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.353+0000 7f0803f87700 1 -- 172.21.15.5:0/727207452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07fc04e6e0 con 0x7f07fc0cef60 2023-03-03T06:25:09.356 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.354+0000 7f07f27fc700 1 -- 172.21.15.5:0/727207452 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+19761 (secure 0 0 0) 0x7f07f80549e0 con 0x7f07fc0cef60 2023-03-03T06:25:09.357 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:09.357 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":43,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:05.425306+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:24:53.570801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-03T06:24:53.994714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:09.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.357+0000 7f0803f87700 1 -- 172.21.15.5:0/727207452 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f07e00682f0 msgr2=0x7f07e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.357+0000 7f0803f87700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f07e00682f0 0x7f07e006a7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009130 tx=0x7f07ec008030 comp rx=0 tx=0).stop 2023-03-03T06:25:09.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.357+0000 7f0803f87700 1 -- 172.21.15.5:0/727207452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07fc0cef60 msgr2=0x7f07fc0c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.357+0000 7f0803f87700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07fc0cef60 0x7f07fc0c4f70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f07f800c480 tx=0x7f07f800c790 comp rx=0 tx=0).stop 2023-03-03T06:25:09.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.357+0000 7f0803f87700 1 -- 172.21.15.5:0/727207452 shutdown_connections 2023-03-03T06:25:09.359 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.357+0000 7f0803f87700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07fc15cd40 0x7f07fc14e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.357+0000 7f0803f87700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f07e00682f0 0x7f07e006a7a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.357+0000 7f0803f87700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07fc0cba50 0x7f07fc0c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.357+0000 7f0803f87700 1 --2- 172.21.15.5:0/727207452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07fc0cef60 0x7f07fc0c4f70 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.357+0000 7f0803f87700 1 -- 172.21.15.5:0/727207452 >> 172.21.15.5:0/727207452 conn(0x7f07fc0cc8d0 msgr2=0x7f07fc15e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:09.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.357+0000 7f0803f87700 1 -- 172.21.15.5:0/727207452 shutdown_connections 2023-03-03T06:25:09.360 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.357+0000 7f0803f87700 1 -- 172.21.15.5:0/727207452 wait complete. 2023-03-03T06:25:09.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:24:53.570801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:24:53.994714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'snap-test-pool', 'create_time': '2023-03-03T06:25:02.648527+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T06:25:09.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:25:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.497+0000 7f3644c3d700 1 Processor -- start 2023-03-03T06:25:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.497+0000 7f3644c3d700 1 -- start start 2023-03-03T06:25:09.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.498+0000 7f3644c3d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36400ceb80 0x7f364006d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.498+0000 7f3644c3d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f364015d6b0 0x7f36400c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.498+0000 7f3644c3d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364015dcd0 con 0x7f364006dbe0 2023-03-03T06:25:09.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.498+0000 7f3644c3d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36400cef50 con 0x7f364015d6b0 2023-03-03T06:25:09.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.498+0000 7f3644c3d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364006e050 con 0x7f36400ceb80 2023-03-03T06:25:09.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.498+0000 7f363ed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f364015d6b0 0x7f36400c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.498+0000 7f363ed9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f364015d6b0 0x7f36400c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43984/0 (socket says 172.21.15.5:43984) 2023-03-03T06:25:09.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.498+0000 7f363ed9d700 1 -- 172.21.15.5:0/2703912082 learned_addr learned my addr 172.21.15.5:0/2703912082 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:09.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.498+0000 7f363e59c700 1 --2- 172.21.15.5:0/2703912082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36400ceb80 0x7f364006d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f363ed9d700 1 -- 172.21.15.5:0/2703912082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36400ceb80 msgr2=0x7f364006d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:09.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f363ed9d700 1 --2- 172.21.15.5:0/2703912082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36400ceb80 0x7f364006d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f363ed9d700 1 -- 172.21.15.5:0/2703912082 >> v1:172.21.15.191:6789/0 conn(0x7f364006dbe0 legacy=0x7f364015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f363ed9d700 1 -- 172.21.15.5:0/2703912082 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364015cba0 con 0x7f364015d6b0 2023-03-03T06:25:09.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f363ed9d700 1 --2- 172.21.15.5:0/2703912082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364015d6b0 0x7f36400c9a90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3638009e50 tx=0x7f363800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05efd5d771e8592 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:09.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f363d59a700 1 -- 172.21.15.5:0/2703912082 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363800e070 con 0x7f364015d6b0 2023-03-03T06:25:09.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f363d59a700 1 -- 172.21.15.5:0/2703912082 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363800b9c0 con 0x7f364015d6b0 2023-03-03T06:25:09.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f363d59a700 1 -- 172.21.15.5:0/2703912082 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363800bd70 con 0x7f364015d6b0 2023-03-03T06:25:09.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f3644c3d700 1 -- 172.21.15.5:0/2703912082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364015d6b0 msgr2=0x7f36400c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f3644c3d700 1 --2- 172.21.15.5:0/2703912082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364015d6b0 0x7f36400c9a90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3638009e50 tx=0x7f363800b330 comp rx=0 tx=0).stop 2023-03-03T06:25:09.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f3644c3d700 1 -- 172.21.15.5:0/2703912082 shutdown_connections 2023-03-03T06:25:09.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f3644c3d700 1 --2- 172.21.15.5:0/2703912082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364015d6b0 0x7f36400c9a90 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f3644c3d700 1 --2- 172.21.15.5:0/2703912082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36400ceb80 0x7f364006d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.499+0000 7f3644c3d700 1 -- 172.21.15.5:0/2703912082 >> 172.21.15.5:0/2703912082 conn(0x7f36400b1c60 msgr2=0x7f36400cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:09.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.500+0000 7f3644c3d700 1 -- 172.21.15.5:0/2703912082 shutdown_connections 2023-03-03T06:25:09.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.500+0000 7f3644c3d700 1 -- 172.21.15.5:0/2703912082 wait complete. 2023-03-03T06:25:09.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.501+0000 7f3644c3d700 1 Processor -- start 2023-03-03T06:25:09.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.501+0000 7f3644c3d700 1 -- start start 2023-03-03T06:25:09.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f3644c3d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364006dbe0 0x7f36400ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f3644c3d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36400ceb80 0x7f364015ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f3644c3d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f364015d6b0 0x7f36400b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f3644c3d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36400ae880 con 0x7f364006dbe0 2023-03-03T06:25:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f3644c3d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36400b4440 con 0x7f364015d6b0 2023-03-03T06:25:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f3644c3d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36400b4690 con 0x7f36400ceb80 2023-03-03T06:25:09.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f363e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364006dbe0 0x7f36400ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f363e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364006dbe0 0x7f36400ae340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43986/0 (socket says 172.21.15.5:43986) 2023-03-03T06:25:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f363e59c700 1 -- 172.21.15.5:0/1229591745 learned_addr learned my addr 172.21.15.5:0/1229591745 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f363ed9d700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f364015d6b0 0x7f36400b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f363dd9b700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36400ceb80 0x7f364015ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f363e59c700 1 -- 172.21.15.5:0/1229591745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36400ceb80 msgr2=0x7f364015ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f363e59c700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36400ceb80 0x7f364015ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f363e59c700 1 -- 172.21.15.5:0/1229591745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f364015d6b0 msgr2=0x7f36400b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f363e59c700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f364015d6b0 0x7f36400b22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f363e59c700 1 -- 172.21.15.5:0/1229591745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3638009b30 con 0x7f364006dbe0 2023-03-03T06:25:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f363e59c700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364006dbe0 0x7f36400ae340 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f363400e810 tx=0x7f363400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f362effd700 1 -- 172.21.15.5:0/1229591745 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3634013610 con 0x7f364006dbe0 2023-03-03T06:25:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f362effd700 1 -- 172.21.15.5:0/1229591745 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3634013770 con 0x7f364006dbe0 2023-03-03T06:25:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.502+0000 7f362effd700 1 -- 172.21.15.5:0/1229591745 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3634013b20 con 0x7f364006dbe0 2023-03-03T06:25:09.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.503+0000 7f3644c3d700 1 -- 172.21.15.5:0/1229591745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3640160400 con 0x7f364006dbe0 2023-03-03T06:25:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.503+0000 7f3644c3d700 1 -- 172.21.15.5:0/1229591745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36401611c0 con 0x7f364006dbe0 2023-03-03T06:25:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.503+0000 7f3644c3d700 1 -- 172.21.15.5:0/1229591745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36401606e0 con 0x7f364006dbe0 2023-03-03T06:25:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.504+0000 7f362effd700 1 -- 172.21.15.5:0/1229591745 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3634023070 con 0x7f364006dbe0 2023-03-03T06:25:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.504+0000 7f362effd700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f36200682f0 0x7f362006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.504+0000 7f362effd700 1 -- 172.21.15.5:0/1229591745 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f3634085cc0 con 0x7f364006dbe0 2023-03-03T06:25:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.504+0000 7f363dd9b700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f36200682f0 0x7f362006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.505+0000 7f363dd9b700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f36200682f0 0x7f362006a7a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3630000f60 tx=0x7f3630009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.509+0000 7f362effd700 1 -- 172.21.15.5:0/1229591745 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f36340521c0 con 0x7f364006dbe0 2023-03-03T06:25:09.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.703+0000 7f3644c3d700 1 -- 172.21.15.5:0/1229591745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f364004e6e0 con 0x7f364006dbe0 2023-03-03T06:25:09.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.703+0000 7f362effd700 1 -- 172.21.15.5:0/1229591745 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f36340557e0 con 0x7f364006dbe0 2023-03-03T06:25:09.706 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:25:09.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.705+0000 7f3644c3d700 1 -- 172.21.15.5:0/1229591745 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f36200682f0 msgr2=0x7f362006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.705+0000 7f3644c3d700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f36200682f0 0x7f362006a7a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3630000f60 tx=0x7f3630009040 comp rx=0 tx=0).stop 2023-03-03T06:25:09.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.705+0000 7f3644c3d700 1 -- 172.21.15.5:0/1229591745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364006dbe0 msgr2=0x7f36400ae340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.705+0000 7f3644c3d700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364006dbe0 0x7f36400ae340 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f363400e810 tx=0x7f363400ebd0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.705+0000 7f3644c3d700 1 -- 172.21.15.5:0/1229591745 shutdown_connections 2023-03-03T06:25:09.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.705+0000 7f3644c3d700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f364015d6b0 0x7f36400b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.705+0000 7f3644c3d700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f364006dbe0 0x7f36400ae340 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.705+0000 7f3644c3d700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f36200682f0 0x7f362006a7a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.705+0000 7f3644c3d700 1 --2- 172.21.15.5:0/1229591745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36400ceb80 0x7f364015ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.706+0000 7f3644c3d700 1 -- 172.21.15.5:0/1229591745 >> 172.21.15.5:0/1229591745 conn(0x7f36400b1c60 msgr2=0x7f364015e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:09.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.706+0000 7f3644c3d700 1 -- 172.21.15.5:0/1229591745 shutdown_connections 2023-03-03T06:25:09.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.706+0000 7f3644c3d700 1 -- 172.21.15.5:0/1229591745 wait complete. 2023-03-03T06:25:09.720 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:25:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.846+0000 7f594282f700 1 Processor -- start 2023-03-03T06:25:09.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.846+0000 7f594282f700 1 -- start start 2023-03-03T06:25:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.847+0000 7f594282f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f593c06d580 0x7f593c06d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.847+0000 7f594282f700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f593c0ca470 0x7f593c0ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.847+0000 7f594282f700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c15d740 con 0x7f593c158f30 2023-03-03T06:25:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.847+0000 7f594282f700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c06de90 con 0x7f593c06d580 2023-03-03T06:25:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.847+0000 7f594282f700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c15c850 con 0x7f593c0ca470 2023-03-03T06:25:09.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.847+0000 7f593bfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f593c06d580 0x7f593c06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.847+0000 7f593bfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f593c06d580 0x7f593c06d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43994/0 (socket says 172.21.15.5:43994) 2023-03-03T06:25:09.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.847+0000 7f593bfff700 1 -- 172.21.15.5:0/1186998566 learned_addr learned my addr 172.21.15.5:0/1186998566 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:09.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f5940dcc700 1 --2- 172.21.15.5:0/1186998566 >> v2:172.21.15.191:3300/0 conn(0x7f593c0ca470 0x7f593c0ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f593bfff700 1 -- 172.21.15.5:0/1186998566 >> v2:172.21.15.191:3300/0 conn(0x7f593c0ca470 msgr2=0x7f593c0ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:09.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f593bfff700 1 --2- 172.21.15.5:0/1186998566 >> v2:172.21.15.191:3300/0 conn(0x7f593c0ca470 0x7f593c0ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f593bfff700 1 -- 172.21.15.5:0/1186998566 >> v1:172.21.15.191:6789/0 conn(0x7f593c158f30 legacy=0x7f593c0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:09.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f593bfff700 1 -- 172.21.15.5:0/1186998566 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c15cb30 con 0x7f593c06d580 2023-03-03T06:25:09.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f593bfff700 1 --2- 172.21.15.5:0/1186998566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c06d580 0x7f593c06d950 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f593c06cf00 tx=0x7f5924009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34037351cd03045b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:09.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f593affd700 1 -- 172.21.15.5:0/1186998566 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924004230 con 0x7f593c06d580 2023-03-03T06:25:09.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f593affd700 1 -- 172.21.15.5:0/1186998566 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5924004390 con 0x7f593c06d580 2023-03-03T06:25:09.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f593affd700 1 -- 172.21.15.5:0/1186998566 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59240036a0 con 0x7f593c06d580 2023-03-03T06:25:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f594282f700 1 -- 172.21.15.5:0/1186998566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c06d580 msgr2=0x7f593c06d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.854 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f594282f700 1 --2- 172.21.15.5:0/1186998566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c06d580 0x7f593c06d950 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f593c06cf00 tx=0x7f5924009bd0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f594282f700 1 -- 172.21.15.5:0/1186998566 shutdown_connections 2023-03-03T06:25:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f594282f700 1 --2- 172.21.15.5:0/1186998566 >> v2:172.21.15.191:3300/0 conn(0x7f593c0ca470 0x7f593c0ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f594282f700 1 --2- 172.21.15.5:0/1186998566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c06d580 0x7f593c06d950 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f594282f700 1 -- 172.21.15.5:0/1186998566 >> 172.21.15.5:0/1186998566 conn(0x7f593c0cf4b0 msgr2=0x7f593c0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f594282f700 1 -- 172.21.15.5:0/1186998566 shutdown_connections 2023-03-03T06:25:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.848+0000 7f594282f700 1 -- 172.21.15.5:0/1186998566 wait complete. 2023-03-03T06:25:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.850+0000 7f594282f700 1 Processor -- start 2023-03-03T06:25:09.855 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.850+0000 7f594282f700 1 -- start start 2023-03-03T06:25:09.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.851+0000 7f594282f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f593c06d580 0x7f593c1509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.851+0000 7f594282f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0ca470 0x7f593c0c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.851+0000 7f594282f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f593c158f30 0x7f593c0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.851+0000 7f594282f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0c8da0 con 0x7f593c0ca470 2023-03-03T06:25:09.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.851+0000 7f594282f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0c8190 con 0x7f593c06d580 2023-03-03T06:25:09.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.851+0000 7f594282f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0c8470 con 0x7f593c158f30 2023-03-03T06:25:09.856 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.851+0000 7f593b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0ca470 0x7f593c0c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.851+0000 7f593b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0ca470 0x7f593c0c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44002/0 (socket says 172.21.15.5:44002) 2023-03-03T06:25:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.851+0000 7f593b7fe700 1 -- 172.21.15.5:0/3926712203 learned_addr learned my addr 172.21.15.5:0/3926712203 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.851+0000 7f593bfff700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f593c06d580 0x7f593c1509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.851+0000 7f5940dcc700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f593c158f30 0x7f593c0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.852+0000 7f593b7fe700 1 -- 172.21.15.5:0/3926712203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f593c158f30 msgr2=0x7f593c0b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.852+0000 7f593b7fe700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f593c158f30 0x7f593c0b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.857 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.852+0000 7f593b7fe700 1 -- 172.21.15.5:0/3926712203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f593c06d580 msgr2=0x7f593c1509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.852+0000 7f593b7fe700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f593c06d580 0x7f593c1509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.852+0000 7f593b7fe700 1 -- 172.21.15.5:0/3926712203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5924009550 con 0x7f593c0ca470 2023-03-03T06:25:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.852+0000 7f593b7fe700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0ca470 0x7f593c0c7230 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f592c00c4a0 tx=0x7f592c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.852+0000 7f5938ff9700 1 -- 172.21.15.5:0/3926712203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c0054e0 con 0x7f593c0ca470 2023-03-03T06:25:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.852+0000 7f5938ff9700 1 -- 172.21.15.5:0/3926712203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c003680 con 0x7f593c0ca470 2023-03-03T06:25:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.852+0000 7f594282f700 1 -- 172.21.15.5:0/3926712203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c15d0f0 con 0x7f593c0ca470 2023-03-03T06:25:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.852+0000 7f5938ff9700 1 -- 172.21.15.5:0/3926712203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c003a10 con 0x7f593c0ca470 2023-03-03T06:25:09.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.852+0000 7f594282f700 1 -- 172.21.15.5:0/3926712203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c15ce10 con 0x7f593c0ca470 2023-03-03T06:25:09.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.853+0000 7f594282f700 1 -- 172.21.15.5:0/3926712203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c15d3d0 con 0x7f593c0ca470 2023-03-03T06:25:09.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.853+0000 7f5938ff9700 1 -- 172.21.15.5:0/3926712203 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f592c019030 con 0x7f593c0ca470 2023-03-03T06:25:09.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.854+0000 7f5938ff9700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f591c0682f0 0x7f591c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:09.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.854+0000 7f5938ff9700 1 -- 172.21.15.5:0/3926712203 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f592c085150 con 0x7f593c0ca470 2023-03-03T06:25:09.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.854+0000 7f593bfff700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f591c0682f0 0x7f591c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:09.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.854+0000 7f593bfff700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f591c0682f0 0x7f591c06a7a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5924009130 tx=0x7f5924008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:09.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:09.858+0000 7f5938ff9700 1 -- 172.21.15.5:0/3926712203 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f592c04b5e0 con 0x7f593c0ca470 2023-03-03T06:25:10.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.051+0000 7f594282f700 1 -- 172.21.15.5:0/3926712203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f593c04e6e0 con 0x7f593c0ca470 2023-03-03T06:25:10.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.052+0000 7f5938ff9700 1 -- 172.21.15.5:0/3926712203 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f592c0170a0 con 0x7f593c0ca470 2023-03-03T06:25:10.054 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:25:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.053+0000 7f594282f700 1 -- 172.21.15.5:0/3926712203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f591c0682f0 msgr2=0x7f591c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.053+0000 7f594282f700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f591c0682f0 0x7f591c06a7a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5924009130 tx=0x7f5924008030 comp rx=0 tx=0).stop 2023-03-03T06:25:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.053+0000 7f594282f700 1 -- 172.21.15.5:0/3926712203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0ca470 msgr2=0x7f593c0c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.053+0000 7f594282f700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0ca470 0x7f593c0c7230 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f592c00c4a0 tx=0x7f592c00c7b0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.054+0000 7f594282f700 1 -- 172.21.15.5:0/3926712203 shutdown_connections 2023-03-03T06:25:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.054+0000 7f594282f700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f591c0682f0 0x7f591c06a7a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.054+0000 7f594282f700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f593c158f30 0x7f593c0b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.054+0000 7f594282f700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f593c06d580 0x7f593c1509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.054+0000 7f594282f700 1 --2- 172.21.15.5:0/3926712203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593c0ca470 0x7f593c0c7230 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.054+0000 7f594282f700 1 -- 172.21.15.5:0/3926712203 >> 172.21.15.5:0/3926712203 conn(0x7f593c0cf4b0 msgr2=0x7f593c0af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:10.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.054+0000 7f594282f700 1 -- 172.21.15.5:0/3926712203 shutdown_connections 2023-03-03T06:25:10.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.054+0000 7f594282f700 1 -- 172.21.15.5:0/3926712203 wait complete. 2023-03-03T06:25:10.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:25:10.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.193+0000 7f1f265ce700 1 Processor -- start 2023-03-03T06:25:10.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.193+0000 7f1f265ce700 1 -- start start 2023-03-03T06:25:10.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.194+0000 7f1f265ce700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f2015a830 0x7f1f200cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.194+0000 7f1f265ce700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1f200b01a0 0x7f1f200cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.194+0000 7f1f265ce700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f200d16a0 con 0x7f1f2015a460 2023-03-03T06:25:10.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.194+0000 7f1f265ce700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f200cb4a0 con 0x7f1f200b01a0 2023-03-03T06:25:10.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.194+0000 7f1f265ce700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f200cbc70 con 0x7f1f2015a830 2023-03-03T06:25:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.194+0000 7f1f24b6b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1f200b01a0 0x7f1f200cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.194+0000 7f1f1f7fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f2015a830 0x7f1f200cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.194+0000 7f1f1ffff700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f1f2015a460 0x7f1f200cd110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:48378/0 (socket says 172.21.15.5:48378) 2023-03-03T06:25:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.194+0000 7f1f24b6b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1f200b01a0 0x7f1f200cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:44372/0 (socket says 172.21.15.5:44372) 2023-03-03T06:25:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.194+0000 7f1f1ffff700 1 -- 172.21.15.5:0/1092886676 learned_addr learned my addr 172.21.15.5:0/1092886676 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.194+0000 7f1f1f7fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f2015a830 0x7f1f200cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:42088/0 (socket says 172.21.15.5:42088) 2023-03-03T06:25:10.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f1f7fe700 1 -- 172.21.15.5:0/1092886676 >> v2:172.21.15.191:3300/0 conn(0x7f1f200b01a0 msgr2=0x7f1f200cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f1f7fe700 1 --2- 172.21.15.5:0/1092886676 >> v2:172.21.15.191:3300/0 conn(0x7f1f200b01a0 0x7f1f200cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f1f7fe700 1 -- 172.21.15.5:0/1092886676 >> v1:172.21.15.191:6789/0 conn(0x7f1f2015a460 legacy=0x7f1f200cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f1effd700 1 -- 172.21.15.5:0/1092886676 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828732881 0 0) 0x7f1f200d16a0 con 0x7f1f2015a460 2023-03-03T06:25:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f1f7fe700 1 -- 172.21.15.5:0/1092886676 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f200cb6b0 con 0x7f1f2015a830 2023-03-03T06:25:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f24b6b700 1 --2- 172.21.15.5:0/1092886676 >> v2:172.21.15.191:3300/0 conn(0x7f1f200b01a0 0x7f1f200cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f1f7fe700 1 --2- 172.21.15.5:0/1092886676 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f2015a830 0x7f1f200cd860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009840 tx=0x7f1f10009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a0fa7a68b510603 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f1effd700 1 -- 172.21.15.5:0/1092886676 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10011830 con 0x7f1f2015a830 2023-03-03T06:25:10.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f1effd700 1 -- 172.21.15.5:0/1092886676 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f10011990 con 0x7f1f2015a830 2023-03-03T06:25:10.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f1effd700 1 -- 172.21.15.5:0/1092886676 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10011d20 con 0x7f1f2015a830 2023-03-03T06:25:10.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f265ce700 1 -- 172.21.15.5:0/1092886676 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f2015a830 msgr2=0x7f1f200cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f265ce700 1 --2- 172.21.15.5:0/1092886676 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f2015a830 0x7f1f200cd860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009840 tx=0x7f1f10009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:10.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f265ce700 1 -- 172.21.15.5:0/1092886676 shutdown_connections 2023-03-03T06:25:10.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f265ce700 1 --2- 172.21.15.5:0/1092886676 >> v2:172.21.15.191:3300/0 conn(0x7f1f200b01a0 0x7f1f200cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f265ce700 1 --2- 172.21.15.5:0/1092886676 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f2015a830 0x7f1f200cd860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.195+0000 7f1f265ce700 1 -- 172.21.15.5:0/1092886676 >> 172.21.15.5:0/1092886676 conn(0x7f1f2006f3c0 msgr2=0x7f1f2006f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:10.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.196+0000 7f1f265ce700 1 -- 172.21.15.5:0/1092886676 shutdown_connections 2023-03-03T06:25:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.196+0000 7f1f265ce700 1 -- 172.21.15.5:0/1092886676 wait complete. 2023-03-03T06:25:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.197+0000 7f1f265ce700 1 Processor -- start 2023-03-03T06:25:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.197+0000 7f1f265ce700 1 -- start start 2023-03-03T06:25:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f265ce700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f200b01a0 0x7f1f200b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f265ce700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f2015a460 0x7f1f200c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f265ce700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2015a830 0x7f1f200c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f265ce700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f20150e50 con 0x7f1f2015a830 2023-03-03T06:25:10.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f265ce700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2015deb0 con 0x7f1f2015a460 2023-03-03T06:25:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f265ce700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2015ca70 con 0x7f1f200b01a0 2023-03-03T06:25:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f24b6b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2015a830 0x7f1f200c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f24b6b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2015a830 0x7f1f200c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44018/0 (socket says 172.21.15.5:44018) 2023-03-03T06:25:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f24b6b700 1 -- 172.21.15.5:0/1824107170 learned_addr learned my addr 172.21.15.5:0/1824107170 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f1f7fe700 1 --2- 172.21.15.5:0/1824107170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f2015a460 0x7f1f200c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f24b6b700 1 -- 172.21.15.5:0/1824107170 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f200b01a0 msgr2=0x7f1f200b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f24b6b700 1 --2- 172.21.15.5:0/1824107170 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f200b01a0 0x7f1f200b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f24b6b700 1 -- 172.21.15.5:0/1824107170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f2015a460 msgr2=0x7f1f200c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f24b6b700 1 --2- 172.21.15.5:0/1824107170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f2015a460 0x7f1f200c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f24b6b700 1 -- 172.21.15.5:0/1824107170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f18009a70 con 0x7f1f2015a830 2023-03-03T06:25:10.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f24b6b700 1 --2- 172.21.15.5:0/1824107170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2015a830 0x7f1f200c7350 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800efc0 tx=0x7f1f1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:10.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.198+0000 7f1f1cff9700 1 -- 172.21.15.5:0/1824107170 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1800cb40 con 0x7f1f2015a830 2023-03-03T06:25:10.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.199+0000 7f1f1cff9700 1 -- 172.21.15.5:0/1824107170 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1800f040 con 0x7f1f2015a830 2023-03-03T06:25:10.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.199+0000 7f1f265ce700 1 -- 172.21.15.5:0/1824107170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f100094a0 con 0x7f1f2015a830 2023-03-03T06:25:10.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.199+0000 7f1f1cff9700 1 -- 172.21.15.5:0/1824107170 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f18003a20 con 0x7f1f2015a830 2023-03-03T06:25:10.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.199+0000 7f1f265ce700 1 -- 172.21.15.5:0/1824107170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f200d1940 con 0x7f1f2015a830 2023-03-03T06:25:10.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.200+0000 7f1f265ce700 1 -- 172.21.15.5:0/1824107170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f200cb990 con 0x7f1f2015a830 2023-03-03T06:25:10.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.200+0000 7f1f1cff9700 1 -- 172.21.15.5:0/1824107170 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1f18014480 con 0x7f1f2015a830 2023-03-03T06:25:10.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.201+0000 7f1f1cff9700 1 --2- 172.21.15.5:0/1824107170 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1f000682f0 0x7f1f0006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.201+0000 7f1f1cff9700 1 -- 172.21.15.5:0/1824107170 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f1f18086a20 con 0x7f1f2015a830 2023-03-03T06:25:10.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.201+0000 7f1f1ffff700 1 --2- 172.21.15.5:0/1824107170 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1f000682f0 0x7f1f0006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.201+0000 7f1f1ffff700 1 --2- 172.21.15.5:0/1824107170 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1f000682f0 0x7f1f0006a7a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1f080011e0 tx=0x7f1f080079b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:10.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.205+0000 7f1f1cff9700 1 -- 172.21.15.5:0/1824107170 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1f18052f40 con 0x7f1f2015a830 2023-03-03T06:25:10.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.399+0000 7f1f265ce700 1 -- 172.21.15.5:0/1824107170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f200cea20 con 0x7f1f2015a830 2023-03-03T06:25:10.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.400+0000 7f1f1cff9700 1 -- 172.21.15.5:0/1824107170 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f18009d70 con 0x7f1f2015a830 2023-03-03T06:25:10.402 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:25:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.402+0000 7f1f265ce700 1 -- 172.21.15.5:0/1824107170 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1f000682f0 msgr2=0x7f1f0006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.402+0000 7f1f265ce700 1 --2- 172.21.15.5:0/1824107170 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1f000682f0 0x7f1f0006a7a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1f080011e0 tx=0x7f1f080079b0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.402+0000 7f1f265ce700 1 -- 172.21.15.5:0/1824107170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2015a830 msgr2=0x7f1f200c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.402+0000 7f1f265ce700 1 --2- 172.21.15.5:0/1824107170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2015a830 0x7f1f200c7350 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800efc0 tx=0x7f1f1800c3a0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.402+0000 7f1f265ce700 1 -- 172.21.15.5:0/1824107170 shutdown_connections 2023-03-03T06:25:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.402+0000 7f1f265ce700 1 --2- 172.21.15.5:0/1824107170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f2015a830 0x7f1f200c7350 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.402+0000 7f1f265ce700 1 --2- 172.21.15.5:0/1824107170 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1f000682f0 0x7f1f0006a7a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.402+0000 7f1f265ce700 1 --2- 172.21.15.5:0/1824107170 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1f200b01a0 0x7f1f200b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.402+0000 7f1f265ce700 1 --2- 172.21.15.5:0/1824107170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1f2015a460 0x7f1f200c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.402+0000 7f1f265ce700 1 -- 172.21.15.5:0/1824107170 >> 172.21.15.5:0/1824107170 conn(0x7f1f2006f3c0 msgr2=0x7f1f200cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.402+0000 7f1f265ce700 1 -- 172.21.15.5:0/1824107170 shutdown_connections 2023-03-03T06:25:10.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.402+0000 7f1f265ce700 1 -- 172.21.15.5:0/1824107170 wait complete. 2023-03-03T06:25:10.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:25:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.543+0000 7f63d1c4e700 1 Processor -- start 2023-03-03T06:25:10.545 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.543+0000 7f63d1c4e700 1 -- start start 2023-03-03T06:25:10.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.543+0000 7f63d1c4e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63cc15a7b0 0x7f63cc15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.543+0000 7f63d1c4e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f63cc0cde30 0x7f63cc0cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.543+0000 7f63d1c4e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63cc0cf5c0 con 0x7f63cc06b700 2023-03-03T06:25:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.543+0000 7f63d1c4e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63cc0cf8a0 con 0x7f63cc15a7b0 2023-03-03T06:25:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.543+0000 7f63d1c4e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63cc0cfb80 con 0x7f63cc0cde30 2023-03-03T06:25:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63cb7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f63cc15a7b0 0x7f63cc15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63cbfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f63cc06b700 0x7f63cc06bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33864/0 (socket says 172.21.15.5:33864) 2023-03-03T06:25:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63cbfff700 1 -- 172.21.15.5:0/4133434342 learned_addr learned my addr 172.21.15.5:0/4133434342 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63cb7fe700 1 -- 172.21.15.5:0/4133434342 >> v2:172.21.15.191:3300/0 conn(0x7f63cc0cde30 msgr2=0x7f63cc0cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:10.547 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63caffd700 1 --2- 172.21.15.5:0/4133434342 >> v2:172.21.15.191:3300/0 conn(0x7f63cc0cde30 0x7f63cc0cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63cb7fe700 1 --2- 172.21.15.5:0/4133434342 >> v2:172.21.15.191:3300/0 conn(0x7f63cc0cde30 0x7f63cc0cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63cb7fe700 1 -- 172.21.15.5:0/4133434342 >> v1:172.21.15.5:6789/0 conn(0x7f63cc06b700 legacy=0x7f63cc06bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63cb7fe700 1 -- 172.21.15.5:0/4133434342 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc0b2d40 con 0x7f63cc15a7b0 2023-03-03T06:25:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63ca7fc700 1 -- 172.21.15.5:0/4133434342 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514319480 0 0) 0x7f63cc0cf5c0 con 0x7f63cc06b700 2023-03-03T06:25:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63caffd700 1 --2- 172.21.15.5:0/4133434342 >> v2:172.21.15.191:3300/0 conn(0x7f63cc0cde30 0x7f63cc0cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63cb7fe700 1 --2- 172.21.15.5:0/4133434342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63cc15a7b0 0x7f63cc15ab80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0cc750 tx=0x7f63bc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9087bab03bc666ab server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63ca7fc700 1 -- 172.21.15.5:0/4133434342 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc011830 con 0x7f63cc15a7b0 2023-03-03T06:25:10.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63ca7fc700 1 -- 172.21.15.5:0/4133434342 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63bc011990 con 0x7f63cc15a7b0 2023-03-03T06:25:10.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.544+0000 7f63ca7fc700 1 -- 172.21.15.5:0/4133434342 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc011d20 con 0x7f63cc15a7b0 2023-03-03T06:25:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.545+0000 7f63d1c4e700 1 -- 172.21.15.5:0/4133434342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63cc15a7b0 msgr2=0x7f63cc15ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.545+0000 7f63d1c4e700 1 --2- 172.21.15.5:0/4133434342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63cc15a7b0 0x7f63cc15ab80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0cc750 tx=0x7f63bc009b20 comp rx=0 tx=0).stop 2023-03-03T06:25:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.545+0000 7f63d1c4e700 1 -- 172.21.15.5:0/4133434342 shutdown_connections 2023-03-03T06:25:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.545+0000 7f63d1c4e700 1 --2- 172.21.15.5:0/4133434342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63cc15a7b0 0x7f63cc15ab80 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.545+0000 7f63d1c4e700 1 --2- 172.21.15.5:0/4133434342 >> v2:172.21.15.191:3300/0 conn(0x7f63cc0cde30 0x7f63cc0cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.545+0000 7f63d1c4e700 1 -- 172.21.15.5:0/4133434342 >> 172.21.15.5:0/4133434342 conn(0x7f63cc0cc8d0 msgr2=0x7f63cc0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.545+0000 7f63d1c4e700 1 -- 172.21.15.5:0/4133434342 shutdown_connections 2023-03-03T06:25:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.545+0000 7f63d1c4e700 1 -- 172.21.15.5:0/4133434342 wait complete. 2023-03-03T06:25:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.546+0000 7f63d1c4e700 1 Processor -- start 2023-03-03T06:25:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.546+0000 7f63d1c4e700 1 -- start start 2023-03-03T06:25:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63d1c4e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63cc06b700 0x7f63cc153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63d1c4e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63cc0cde30 0x7f63cc1e1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63d1c4e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63cc15a7b0 0x7f63cc1e35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63d1c4e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc1e3140 con 0x7f63cc06b700 2023-03-03T06:25:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63d1c4e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc153a80 con 0x7f63cc0cde30 2023-03-03T06:25:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63d1c4e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc1e2530 con 0x7f63cc15a7b0 2023-03-03T06:25:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63cb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63cc06b700 0x7f63cc153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63cb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63cc06b700 0x7f63cc153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44026/0 (socket says 172.21.15.5:44026) 2023-03-03T06:25:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63cb7fe700 1 -- 172.21.15.5:0/280601248 learned_addr learned my addr 172.21.15.5:0/280601248 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63caffd700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63cc0cde30 0x7f63cc1e1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63cbfff700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63cc15a7b0 0x7f63cc1e35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63cb7fe700 1 -- 172.21.15.5:0/280601248 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63cc15a7b0 msgr2=0x7f63cc1e35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63cb7fe700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63cc15a7b0 0x7f63cc1e35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63cb7fe700 1 -- 172.21.15.5:0/280601248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63cc0cde30 msgr2=0x7f63cc1e1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63cb7fe700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63cc0cde30 0x7f63cc1e1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63cb7fe700 1 -- 172.21.15.5:0/280601248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc0094a0 con 0x7f63cc06b700 2023-03-03T06:25:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63cbfff700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63cc15a7b0 0x7f63cc1e35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.547+0000 7f63caffd700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63cc0cde30 0x7f63cc1e1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:10.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.548+0000 7f63cb7fe700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63cc06b700 0x7f63cc153540 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f63bc014040 tx=0x7f63bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.548+0000 7f63c3fff700 1 -- 172.21.15.5:0/280601248 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0038a0 con 0x7f63cc06b700 2023-03-03T06:25:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.548+0000 7f63c3fff700 1 -- 172.21.15.5:0/280601248 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63bc01e070 con 0x7f63cc06b700 2023-03-03T06:25:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.548+0000 7f63d1c4e700 1 -- 172.21.15.5:0/280601248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63cc0cf1b0 con 0x7f63cc06b700 2023-03-03T06:25:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.548+0000 7f63c3fff700 1 -- 172.21.15.5:0/280601248 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc003c40 con 0x7f63cc06b700 2023-03-03T06:25:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.548+0000 7f63d1c4e700 1 -- 172.21.15.5:0/280601248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63cc0b3020 con 0x7f63cc06b700 2023-03-03T06:25:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.549+0000 7f63d1c4e700 1 -- 172.21.15.5:0/280601248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63cc0cf340 con 0x7f63cc06b700 2023-03-03T06:25:10.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.549+0000 7f63c3fff700 1 -- 172.21.15.5:0/280601248 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f63bc00f050 con 0x7f63cc06b700 2023-03-03T06:25:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.549+0000 7f63c3fff700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f63ac0682f0 0x7f63ac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.550+0000 7f63c3fff700 1 -- 172.21.15.5:0/280601248 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f63bc087170 con 0x7f63cc06b700 2023-03-03T06:25:10.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.550+0000 7f63caffd700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f63ac0682f0 0x7f63ac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.550+0000 7f63caffd700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f63ac0682f0 0x7f63ac06a7a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f63cc1f31b0 tx=0x7f63b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:10.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.554+0000 7f63c3fff700 1 -- 172.21.15.5:0/280601248 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f63bc0536f0 con 0x7f63cc06b700 2023-03-03T06:25:10.749 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.747+0000 7f63d1c4e700 1 -- 172.21.15.5:0/280601248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63cc04e6e0 con 0x7f63cc06b700 2023-03-03T06:25:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.748+0000 7f63c3fff700 1 -- 172.21.15.5:0/280601248 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f63bc0150a0 con 0x7f63cc06b700 2023-03-03T06:25:10.750 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:25:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.750+0000 7f63d1c4e700 1 -- 172.21.15.5:0/280601248 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f63ac0682f0 msgr2=0x7f63ac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.750+0000 7f63d1c4e700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f63ac0682f0 0x7f63ac06a7a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f63cc1f31b0 tx=0x7f63b4008040 comp rx=0 tx=0).stop 2023-03-03T06:25:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.750+0000 7f63d1c4e700 1 -- 172.21.15.5:0/280601248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63cc06b700 msgr2=0x7f63cc153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.750+0000 7f63d1c4e700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63cc06b700 0x7f63cc153540 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f63bc014040 tx=0x7f63bc004750 comp rx=0 tx=0).stop 2023-03-03T06:25:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.750+0000 7f63d1c4e700 1 -- 172.21.15.5:0/280601248 shutdown_connections 2023-03-03T06:25:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.750+0000 7f63d1c4e700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f63ac0682f0 0x7f63ac06a7a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.750+0000 7f63d1c4e700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f63cc15a7b0 0x7f63cc1e35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.750+0000 7f63d1c4e700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63cc06b700 0x7f63cc153540 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.750+0000 7f63d1c4e700 1 --2- 172.21.15.5:0/280601248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f63cc0cde30 0x7f63cc1e1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.750+0000 7f63d1c4e700 1 -- 172.21.15.5:0/280601248 >> 172.21.15.5:0/280601248 conn(0x7f63cc0cc8d0 msgr2=0x7f63cc0b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.750+0000 7f63d1c4e700 1 -- 172.21.15.5:0/280601248 shutdown_connections 2023-03-03T06:25:10.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.750+0000 7f63d1c4e700 1 -- 172.21.15.5:0/280601248 wait complete. 2023-03-03T06:25:10.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-03-03T06:25:10.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.890+0000 7f61fb460700 1 Processor -- start 2023-03-03T06:25:10.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.890+0000 7f61fb460700 1 -- start start 2023-03-03T06:25:10.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61fb460700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f61f415c8a0 0x7f61f40cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61fb460700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f61f415dbf0 0x7f61f406c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61fb460700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f40cdd80 con 0x7f61f415cc70 2023-03-03T06:25:10.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61fb460700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f415d110 con 0x7f61f415dbf0 2023-03-03T06:25:10.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61fb460700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f415d3f0 con 0x7f61f415c8a0 2023-03-03T06:25:10.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61f99fd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f61f415dbf0 0x7f61f406c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61f99fd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f61f415dbf0 0x7f61f406c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44036/0 (socket says 172.21.15.5:44036) 2023-03-03T06:25:10.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61f99fd700 1 -- 172.21.15.5:0/3754681355 learned_addr learned my addr 172.21.15.5:0/3754681355 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:10.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61f91fc700 1 --2- 172.21.15.5:0/3754681355 >> v2:172.21.15.191:3300/0 conn(0x7f61f415c8a0 0x7f61f40cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61f99fd700 1 -- 172.21.15.5:0/3754681355 >> v2:172.21.15.191:3300/0 conn(0x7f61f415c8a0 msgr2=0x7f61f40cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:10.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61f99fd700 1 --2- 172.21.15.5:0/3754681355 >> v2:172.21.15.191:3300/0 conn(0x7f61f415c8a0 0x7f61f40cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61f99fd700 1 -- 172.21.15.5:0/3754681355 >> v1:172.21.15.191:6789/0 conn(0x7f61f415cc70 legacy=0x7f61f4160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61f99fd700 1 -- 172.21.15.5:0/3754681355 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f415d6d0 con 0x7f61f415dbf0 2023-03-03T06:25:10.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61f91fc700 1 --2- 172.21.15.5:0/3754681355 >> v2:172.21.15.191:3300/0 conn(0x7f61f415c8a0 0x7f61f40cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:10.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.891+0000 7f61f99fd700 1 --2- 172.21.15.5:0/3754681355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f415dbf0 0x7f61f406c2e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f61f408c2b0 tx=0x7f61ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee0a71d6276d58a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:10.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.892+0000 7f61ebfff700 1 -- 172.21.15.5:0/3754681355 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec00e070 con 0x7f61f415dbf0 2023-03-03T06:25:10.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.892+0000 7f61ebfff700 1 -- 172.21.15.5:0/3754681355 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec00b9c0 con 0x7f61f415dbf0 2023-03-03T06:25:10.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.892+0000 7f61ebfff700 1 -- 172.21.15.5:0/3754681355 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec00bd70 con 0x7f61f415dbf0 2023-03-03T06:25:10.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.892+0000 7f61fb460700 1 -- 172.21.15.5:0/3754681355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f415dbf0 msgr2=0x7f61f406c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.892+0000 7f61fb460700 1 --2- 172.21.15.5:0/3754681355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f415dbf0 0x7f61f406c2e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f61f408c2b0 tx=0x7f61ec00b330 comp rx=0 tx=0).stop 2023-03-03T06:25:10.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.892+0000 7f61fb460700 1 -- 172.21.15.5:0/3754681355 shutdown_connections 2023-03-03T06:25:10.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.892+0000 7f61fb460700 1 --2- 172.21.15.5:0/3754681355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f415dbf0 0x7f61f406c2e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.892+0000 7f61fb460700 1 --2- 172.21.15.5:0/3754681355 >> v2:172.21.15.191:3300/0 conn(0x7f61f415c8a0 0x7f61f40cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.892+0000 7f61fb460700 1 -- 172.21.15.5:0/3754681355 >> 172.21.15.5:0/3754681355 conn(0x7f61f40d0820 msgr2=0x7f61f40d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:10.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.892+0000 7f61fb460700 1 -- 172.21.15.5:0/3754681355 shutdown_connections 2023-03-03T06:25:10.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.892+0000 7f61fb460700 1 -- 172.21.15.5:0/3754681355 wait complete. 2023-03-03T06:25:10.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.893+0000 7f61fb460700 1 Processor -- start 2023-03-03T06:25:10.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.894+0000 7f61fb460700 1 -- start start 2023-03-03T06:25:10.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.894+0000 7f61fb460700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61f415c8a0 0x7f61f40b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.894+0000 7f61fb460700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f415cc70 0x7f61f40b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.894+0000 7f61fb460700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61f415dbf0 0x7f61f4152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.894+0000 7f61fb460700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40b77c0 con 0x7f61f415cc70 2023-03-03T06:25:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.894+0000 7f61fb460700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40b4500 con 0x7f61f415dbf0 2023-03-03T06:25:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.894+0000 7f61fb460700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40b47e0 con 0x7f61f415c8a0 2023-03-03T06:25:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61f89fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f415cc70 0x7f61f40b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61f91fc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61f415c8a0 0x7f61f40b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61f89fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f415cc70 0x7f61f40b7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44040/0 (socket says 172.21.15.5:44040) 2023-03-03T06:25:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61f89fb700 1 -- 172.21.15.5:0/3163776608 learned_addr learned my addr 172.21.15.5:0/3163776608 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61f99fd700 1 --2- 172.21.15.5:0/3163776608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61f415dbf0 0x7f61f4152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61f89fb700 1 -- 172.21.15.5:0/3163776608 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61f415c8a0 msgr2=0x7f61f40b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61f89fb700 1 --2- 172.21.15.5:0/3163776608 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61f415c8a0 0x7f61f40b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61f89fb700 1 -- 172.21.15.5:0/3163776608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61f415dbf0 msgr2=0x7f61f4152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61f89fb700 1 --2- 172.21.15.5:0/3163776608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61f415dbf0 0x7f61f4152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:10.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61f89fb700 1 -- 172.21.15.5:0/3163776608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec009b30 con 0x7f61f415cc70 2023-03-03T06:25:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61f89fb700 1 --2- 172.21.15.5:0/3163776608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f415cc70 0x7f61f40b7280 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f61e400c4b0 tx=0x7f61e400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61e9ffb700 1 -- 172.21.15.5:0/3163776608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e40052d0 con 0x7f61f415cc70 2023-03-03T06:25:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61e9ffb700 1 -- 172.21.15.5:0/3163776608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e4005430 con 0x7f61f415cc70 2023-03-03T06:25:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61e9ffb700 1 -- 172.21.15.5:0/3163776608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e40038c0 con 0x7f61f415cc70 2023-03-03T06:25:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61fb460700 1 -- 172.21.15.5:0/3163776608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f406c820 con 0x7f61f415cc70 2023-03-03T06:25:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.895+0000 7f61fb460700 1 -- 172.21.15.5:0/3163776608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f40ce060 con 0x7f61f415cc70 2023-03-03T06:25:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.896+0000 7f61fb460700 1 -- 172.21.15.5:0/3163776608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f406c9b0 con 0x7f61f415cc70 2023-03-03T06:25:10.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.897+0000 7f61e9ffb700 1 -- 172.21.15.5:0/3163776608 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f61e4019030 con 0x7f61f415cc70 2023-03-03T06:25:10.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.897+0000 7f61e9ffb700 1 --2- 172.21.15.5:0/3163776608 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61d80682f0 0x7f61d806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:10.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.897+0000 7f61e9ffb700 1 -- 172.21.15.5:0/3163776608 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f61e4085140 con 0x7f61f415cc70 2023-03-03T06:25:10.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.897+0000 7f61f91fc700 1 --2- 172.21.15.5:0/3163776608 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61d80682f0 0x7f61d806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:10.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.897+0000 7f61f91fc700 1 --2- 172.21.15.5:0/3163776608 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61d80682f0 0x7f61d806a7a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f61f40d2a50 tx=0x7f61f0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:10.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:10.901+0000 7f61e9ffb700 1 -- 172.21.15.5:0/3163776608 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f61e40516c0 con 0x7f61f415cc70 2023-03-03T06:25:11.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.094+0000 7f61fb460700 1 -- 172.21.15.5:0/3163776608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f61f404e6e0 con 0x7f61f415cc70 2023-03-03T06:25:11.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.095+0000 7f61e9ffb700 1 -- 172.21.15.5:0/3163776608 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v43) v1 ==== 103+0+11 (secure 0 0 0) 0x7f61e4054ce0 con 0x7f61f415cc70 2023-03-03T06:25:11.097 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:25:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.097+0000 7f61fb460700 1 -- 172.21.15.5:0/3163776608 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61d80682f0 msgr2=0x7f61d806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.097+0000 7f61fb460700 1 --2- 172.21.15.5:0/3163776608 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61d80682f0 0x7f61d806a7a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f61f40d2a50 tx=0x7f61f0008040 comp rx=0 tx=0).stop 2023-03-03T06:25:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.097+0000 7f61fb460700 1 -- 172.21.15.5:0/3163776608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f415cc70 msgr2=0x7f61f40b7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.097+0000 7f61fb460700 1 --2- 172.21.15.5:0/3163776608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f415cc70 0x7f61f40b7280 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f61e400c4b0 tx=0x7f61e400c7c0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.097+0000 7f61fb460700 1 -- 172.21.15.5:0/3163776608 shutdown_connections 2023-03-03T06:25:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.097+0000 7f61fb460700 1 --2- 172.21.15.5:0/3163776608 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61f415dbf0 0x7f61f4152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.097+0000 7f61fb460700 1 --2- 172.21.15.5:0/3163776608 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61d80682f0 0x7f61d806a7a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.097+0000 7f61fb460700 1 --2- 172.21.15.5:0/3163776608 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61f415c8a0 0x7f61f40b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.097+0000 7f61fb460700 1 --2- 172.21.15.5:0/3163776608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61f415cc70 0x7f61f40b7280 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.097+0000 7f61fb460700 1 -- 172.21.15.5:0/3163776608 >> 172.21.15.5:0/3163776608 conn(0x7f61f40d0820 msgr2=0x7f61f4158640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.097+0000 7f61fb460700 1 -- 172.21.15.5:0/3163776608 shutdown_connections 2023-03-03T06:25:11.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.097+0000 7f61fb460700 1 -- 172.21.15.5:0/3163776608 wait complete. 2023-03-03T06:25:11.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.233+0000 7f47cb4e0700 1 Processor -- start 2023-03-03T06:25:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.234+0000 7f47cb4e0700 1 -- start start 2023-03-03T06:25:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.234+0000 7f47cb4e0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47c40cba50 0x7f47c40ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.234+0000 7f47cb4e0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c415d4e0 con 0x7f47c415cd40 2023-03-03T06:25:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.234+0000 7f47cb4e0700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c415d7c0 con 0x7f47c40b1fe0 2023-03-03T06:25:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.234+0000 7f47cb4e0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c415daa0 con 0x7f47c40cba50 2023-03-03T06:25:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.235+0000 7f47c9a7d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f47c40cba50 0x7f47c40ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.235+0000 7f47c927c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f47c415cd40 0x7f47c40b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33888/0 (socket says 172.21.15.5:33888) 2023-03-03T06:25:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.235+0000 7f47c927c700 1 -- 172.21.15.5:0/4000027190 learned_addr learned my addr 172.21.15.5:0/4000027190 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.235+0000 7f47b7fff700 1 -- 172.21.15.5:0/4000027190 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522446448 0 0) 0x7f47c415d4e0 con 0x7f47c415cd40 2023-03-03T06:25:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.235+0000 7f47b7fff700 1 -- 172.21.15.5:0/4000027190 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b00035b0 con 0x7f47c415cd40 2023-03-03T06:25:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.235+0000 7f47c9a7d700 1 -- 172.21.15.5:0/4000027190 >> v1:172.21.15.191:6789/0 conn(0x7f47c40b1fe0 legacy=0x7f47c40cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.235+0000 7f47c9a7d700 1 -- 172.21.15.5:0/4000027190 >> v1:172.21.15.5:6789/0 conn(0x7f47c415cd40 legacy=0x7f47c40b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.235+0000 7f47c9a7d700 1 -- 172.21.15.5:0/4000027190 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c415dd80 con 0x7f47c40cba50 2023-03-03T06:25:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.235+0000 7f47c9a7d700 1 --2- 172.21.15.5:0/4000027190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c40cba50 0x7f47c40ce660 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009d90 tx=0x7f47bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c649fecc2ec966da server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.235+0000 7f47b7fff700 1 -- 172.21.15.5:0/4000027190 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc00e070 con 0x7f47c40cba50 2023-03-03T06:25:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.235+0000 7f47b7fff700 1 -- 172.21.15.5:0/4000027190 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc00bb20 con 0x7f47c40cba50 2023-03-03T06:25:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.235+0000 7f47b7fff700 1 -- 172.21.15.5:0/4000027190 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc012430 con 0x7f47c40cba50 2023-03-03T06:25:11.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.236+0000 7f47cb4e0700 1 -- 172.21.15.5:0/4000027190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c40cba50 msgr2=0x7f47c40ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.236+0000 7f47cb4e0700 1 --2- 172.21.15.5:0/4000027190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c40cba50 0x7f47c40ce660 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009d90 tx=0x7f47bc00b330 comp rx=0 tx=0).stop 2023-03-03T06:25:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.236+0000 7f47cb4e0700 1 -- 172.21.15.5:0/4000027190 shutdown_connections 2023-03-03T06:25:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.236+0000 7f47cb4e0700 1 --2- 172.21.15.5:0/4000027190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c40cba50 0x7f47c40ce660 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.236+0000 7f47cb4e0700 1 -- 172.21.15.5:0/4000027190 >> 172.21.15.5:0/4000027190 conn(0x7f47c40cc8d0 msgr2=0x7f47c40cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.236+0000 7f47cb4e0700 1 -- 172.21.15.5:0/4000027190 shutdown_connections 2023-03-03T06:25:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.236+0000 7f47cb4e0700 1 -- 172.21.15.5:0/4000027190 wait complete. 2023-03-03T06:25:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.237+0000 7f47cb4e0700 1 Processor -- start 2023-03-03T06:25:11.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.237+0000 7f47cb4e0700 1 -- start start 2023-03-03T06:25:11.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47cb4e0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47c40b1fe0 0x7f47c4154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47cb4e0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c40cba50 0x7f47c40c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47cb4e0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f47c415cd40 0x7f47c41f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47cb4e0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c41f3d30 con 0x7f47c40cba50 2023-03-03T06:25:11.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47cb4e0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c40c9ee0 con 0x7f47c40b1fe0 2023-03-03T06:25:11.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47cb4e0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c40b3fb0 con 0x7f47c415cd40 2023-03-03T06:25:11.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47c8a7b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c40cba50 0x7f47c40c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47c8a7b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c40cba50 0x7f47c40c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44054/0 (socket says 172.21.15.5:44054) 2023-03-03T06:25:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47c8a7b700 1 -- 172.21.15.5:0/761848943 learned_addr learned my addr 172.21.15.5:0/761848943 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47c8a7b700 1 -- 172.21.15.5:0/761848943 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f47c415cd40 msgr2=0x7f47c41f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47c8a7b700 1 --2- 172.21.15.5:0/761848943 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f47c415cd40 0x7f47c41f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47c8a7b700 1 -- 172.21.15.5:0/761848943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47c40b1fe0 msgr2=0x7f47c4154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47c8a7b700 1 --2- 172.21.15.5:0/761848943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47c40b1fe0 0x7f47c4154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47c8a7b700 1 -- 172.21.15.5:0/761848943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc009a70 con 0x7f47c40cba50 2023-03-03T06:25:11.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.238+0000 7f47c8a7b700 1 --2- 172.21.15.5:0/761848943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c40cba50 0x7f47c40c9870 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f47c000c500 tx=0x7f47c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.239+0000 7f47b5ffb700 1 -- 172.21.15.5:0/761848943 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c00052d0 con 0x7f47c40cba50 2023-03-03T06:25:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.239+0000 7f47b5ffb700 1 -- 172.21.15.5:0/761848943 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c0005450 con 0x7f47c40cba50 2023-03-03T06:25:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.239+0000 7f47cb4e0700 1 -- 172.21.15.5:0/761848943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c40ca530 con 0x7f47c40cba50 2023-03-03T06:25:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.239+0000 7f47b5ffb700 1 -- 172.21.15.5:0/761848943 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c0003910 con 0x7f47c40cba50 2023-03-03T06:25:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.239+0000 7f47cb4e0700 1 -- 172.21.15.5:0/761848943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c415e060 con 0x7f47c40cba50 2023-03-03T06:25:11.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.240+0000 7f47cb4e0700 1 -- 172.21.15.5:0/761848943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c415d110 con 0x7f47c40cba50 2023-03-03T06:25:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.240+0000 7f47b5ffb700 1 -- 172.21.15.5:0/761848943 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f47c0019030 con 0x7f47c40cba50 2023-03-03T06:25:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.240+0000 7f47b5ffb700 1 --2- 172.21.15.5:0/761848943 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f47a80682f0 0x7f47a806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.240+0000 7f47b5ffb700 1 -- 172.21.15.5:0/761848943 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6791+0+0 (secure 0 0 0) 0x7f47c0085340 con 0x7f47c40cba50 2023-03-03T06:25:11.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.241+0000 7f47c927c700 1 --2- 172.21.15.5:0/761848943 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f47a80682f0 0x7f47a806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.241+0000 7f47c927c700 1 --2- 172.21.15.5:0/761848943 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f47a80682f0 0x7f47a806a7a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f47b8001610 tx=0x7f47b80079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:11.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.245+0000 7f47b5ffb700 1 -- 172.21.15.5:0/761848943 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f47c00518c0 con 0x7f47c40cba50 2023-03-03T06:25:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.485+0000 7f47cb4e0700 1 -- 172.21.15.5:0/761848943 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47c40cc480 con 0x7f47c40cba50 2023-03-03T06:25:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.485+0000 7f47b5ffb700 1 -- 172.21.15.5:0/761848943 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f47c0054ee0 con 0x7f47c40cba50 2023-03-03T06:25:11.488 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:11.488 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/1485137346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1485137346},{"type":"v1","addr":"172.21.15.191:6834","nonce":1485137346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4886,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2062075895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2062075895},{"type":"v1","addr":"172.21.15.5:6837","nonce":2062075895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3463336232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":3463336232},{"type":"v1","addr":"172.21.15.191:6835","nonce":3463336232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:24:55.063168+0000","modified":"2023-03-03T06:24:58.081923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5098},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5098":{"gid":5098,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/3094337828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3094337828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3094337828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-03T06:25:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.488+0000 7f47cb4e0700 1 -- 172.21.15.5:0/761848943 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f47a80682f0 msgr2=0x7f47a806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.488+0000 7f47cb4e0700 1 --2- 172.21.15.5:0/761848943 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f47a80682f0 0x7f47a806a7a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f47b8001610 tx=0x7f47b80079c0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.488+0000 7f47cb4e0700 1 -- 172.21.15.5:0/761848943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c40cba50 msgr2=0x7f47c40c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.488+0000 7f47cb4e0700 1 --2- 172.21.15.5:0/761848943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c40cba50 0x7f47c40c9870 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f47c000c500 tx=0x7f47c000c8c0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.488+0000 7f47cb4e0700 1 -- 172.21.15.5:0/761848943 shutdown_connections 2023-03-03T06:25:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.488+0000 7f47cb4e0700 1 --2- 172.21.15.5:0/761848943 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f47a80682f0 0x7f47a806a7a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.488+0000 7f47cb4e0700 1 --2- 172.21.15.5:0/761848943 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f47c415cd40 0x7f47c41f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.488+0000 7f47cb4e0700 1 --2- 172.21.15.5:0/761848943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47c40b1fe0 0x7f47c4154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.488+0000 7f47cb4e0700 1 --2- 172.21.15.5:0/761848943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47c40cba50 0x7f47c40c9870 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.488+0000 7f47cb4e0700 1 -- 172.21.15.5:0/761848943 >> 172.21.15.5:0/761848943 conn(0x7f47c40cc8d0 msgr2=0x7f47c40cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.488+0000 7f47cb4e0700 1 -- 172.21.15.5:0/761848943 shutdown_connections 2023-03-03T06:25:11.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.488+0000 7f47cb4e0700 1 -- 172.21.15.5:0/761848943 wait complete. 2023-03-03T06:25:11.492 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2023-03-03T06:25:11.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:11.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.624+0000 7f617110e700 1 Processor -- start 2023-03-03T06:25:11.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.625+0000 7f617110e700 1 -- start start 2023-03-03T06:25:11.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f617110e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f616c1573f0 0x7f616c15d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f617110e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c1577c0 con 0x7f616c0b18d0 2023-03-03T06:25:11.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f617110e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c159e60 con 0x7f616c0cc1a0 2023-03-03T06:25:11.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f617110e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c0cd790 con 0x7f616c1573f0 2023-03-03T06:25:11.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f616b59e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f616c0b18d0 0x7f616c0b1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33906/0 (socket says 172.21.15.5:33906) 2023-03-03T06:25:11.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f616b59e700 1 -- 172.21.15.5:0/740662122 learned_addr learned my addr 172.21.15.5:0/740662122 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376503348 0 0) 0x7f616c1577c0 con 0x7f616c0b18d0 2023-03-03T06:25:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f616ad9d700 1 --2- 172.21.15.5:0/740662122 >> v2:172.21.15.191:3300/0 conn(0x7f616c1573f0 0x7f616c15d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61580035b0 con 0x7f616c0b18d0 2023-03-03T06:25:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 941156279 0 0) 0x7f61580035b0 con 0x7f616c0b18d0 2023-03-03T06:25:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 >> v2:172.21.15.191:3300/0 conn(0x7f616c1573f0 msgr2=0x7f616c15d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:11.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f6169d9b700 1 --2- 172.21.15.5:0/740662122 >> v2:172.21.15.191:3300/0 conn(0x7f616c1573f0 0x7f616c15d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 >> v1:172.21.15.191:6789/0 conn(0x7f616c0cc1a0 legacy=0x7f616c0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0ce460 con 0x7f616c0b18d0 2023-03-03T06:25:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f61640019f0 con 0x7f616c0b18d0 2023-03-03T06:25:11.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 >> v1:172.21.15.5:6789/0 conn(0x7f616c0b18d0 legacy=0x7f616c0b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f6169d9b700 1 --2- 172.21.15.5:0/740662122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6158003a70 0x7f6158003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f6169d9b700 1 --2- 172.21.15.5:0/740662122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158004850 0x7f6158004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f6169d9b700 1 --2- 172.21.15.5:0/740662122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6158005200 0x7f615800dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.626+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0cd790 con 0x7f6158004850 2023-03-03T06:25:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615800e2f0 con 0x7f6158003a70 2023-03-03T06:25:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615800e4b0 con 0x7f6158005200 2023-03-03T06:25:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f616a59c700 1 --2- 172.21.15.5:0/740662122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158004850 0x7f6158004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f616ad9d700 1 --2- 172.21.15.5:0/740662122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6158003a70 0x7f6158003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f616b59e700 1 --2- 172.21.15.5:0/740662122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6158005200 0x7f615800dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f616a59c700 1 -- 172.21.15.5:0/740662122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6158005200 msgr2=0x7f615800dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:11.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f616a59c700 1 --2- 172.21.15.5:0/740662122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6158005200 0x7f615800dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f616a59c700 1 -- 172.21.15.5:0/740662122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6158003a70 msgr2=0x7f6158003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f616a59c700 1 --2- 172.21.15.5:0/740662122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6158003a70 0x7f6158003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f616a59c700 1 -- 172.21.15.5:0/740662122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61580035b0 con 0x7f6158004850 2023-03-03T06:25:11.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f616b59e700 1 --2- 172.21.15.5:0/740662122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6158005200 0x7f615800dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f616b59e700 1 -- 172.21.15.5:0/740662122 reap_dead start 2023-03-03T06:25:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f616a59c700 1 --2- 172.21.15.5:0/740662122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158004850 0x7f6158004cc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6154001860 tx=0x7f6158005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79eda9d4dc9cdbe2 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154001320 con 0x7f6158004850 2023-03-03T06:25:11.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6154005310 con 0x7f6158004850 2023-03-03T06:25:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.627+0000 7f6169d9b700 1 -- 172.21.15.5:0/740662122 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61540068b0 con 0x7f6158004850 2023-03-03T06:25:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.628+0000 7f617110e700 1 -- 172.21.15.5:0/740662122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158004850 msgr2=0x7f6158004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.628+0000 7f617110e700 1 --2- 172.21.15.5:0/740662122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158004850 0x7f6158004cc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6154001860 tx=0x7f6158005880 comp rx=0 tx=0).stop 2023-03-03T06:25:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.628+0000 7f617110e700 1 -- 172.21.15.5:0/740662122 shutdown_connections 2023-03-03T06:25:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.628+0000 7f617110e700 1 --2- 172.21.15.5:0/740662122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158004850 0x7f6158004cc0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.628+0000 7f617110e700 1 -- 172.21.15.5:0/740662122 >> 172.21.15.5:0/740662122 conn(0x7f616c0cc8d0 msgr2=0x7f616c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:11.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.628+0000 7f617110e700 1 -- 172.21.15.5:0/740662122 shutdown_connections 2023-03-03T06:25:11.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.628+0000 7f617110e700 1 -- 172.21.15.5:0/740662122 wait complete. 2023-03-03T06:25:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.630+0000 7f617110e700 1 Processor -- start 2023-03-03T06:25:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.630+0000 7f617110e700 1 -- start start 2023-03-03T06:25:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f617110e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158004850 0x7f616c154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f617110e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f616c1548a0 0x7f616c0c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f617110e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f616c0c5c80 0x7f616c0c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f617110e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0ca2d0 con 0x7f6158004850 2023-03-03T06:25:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f617110e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c154740 con 0x7f616c0c5c80 2023-03-03T06:25:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f617110e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c1551b0 con 0x7f616c1548a0 2023-03-03T06:25:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f616ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158004850 0x7f616c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f616ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158004850 0x7f616c154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44072/0 (socket says 172.21.15.5:44072) 2023-03-03T06:25:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f616ad9d700 1 -- 172.21.15.5:0/1236653555 learned_addr learned my addr 172.21.15.5:0/1236653555 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:11.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f616b59e700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f616c0c5c80 0x7f616c0c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f616a59c700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f616c1548a0 0x7f616c0c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f616ad9d700 1 -- 172.21.15.5:0/1236653555 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f616c1548a0 msgr2=0x7f616c0c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f616ad9d700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f616c1548a0 0x7f616c0c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f616ad9d700 1 -- 172.21.15.5:0/1236653555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f616c0c5c80 msgr2=0x7f616c0c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f616ad9d700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f616c0c5c80 0x7f616c0c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f616ad9d700 1 -- 172.21.15.5:0/1236653555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c15dbe0 con 0x7f6158004850 2023-03-03T06:25:11.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f616ad9d700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158004850 0x7f616c154200 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f615c011ad0 tx=0x7f615c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f61637fe700 1 -- 172.21.15.5:0/1236653555 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c00f9a0 con 0x7f6158004850 2023-03-03T06:25:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f61637fe700 1 -- 172.21.15.5:0/1236653555 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c00fb00 con 0x7f6158004850 2023-03-03T06:25:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.631+0000 7f617110e700 1 -- 172.21.15.5:0/1236653555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c15d900 con 0x7f6158004850 2023-03-03T06:25:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.632+0000 7f61637fe700 1 -- 172.21.15.5:0/1236653555 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c00feb0 con 0x7f6158004850 2023-03-03T06:25:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.632+0000 7f617110e700 1 -- 172.21.15.5:0/1236653555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c15dec0 con 0x7f6158004850 2023-03-03T06:25:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.633+0000 7f617110e700 1 -- 172.21.15.5:0/1236653555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c0c4730 con 0x7f6158004850 2023-03-03T06:25:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.633+0000 7f61637fe700 1 -- 172.21.15.5:0/1236653555 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f615c014440 con 0x7f6158004850 2023-03-03T06:25:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.633+0000 7f61637fe700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f614c0682f0 0x7f614c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.633+0000 7f61637fe700 1 -- 172.21.15.5:0/1236653555 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6763+0+0 (secure 0 0 0) 0x7f615c0867f0 con 0x7f6158004850 2023-03-03T06:25:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.633+0000 7f616a59c700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f614c0682f0 0x7f614c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.634+0000 7f616a59c700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f614c0682f0 0x7f614c06a7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6154001860 tx=0x7f6154009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:11.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.637+0000 7f61637fe700 1 -- 172.21.15.5:0/1236653555 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f615c052d30 con 0x7f6158004850 2023-03-03T06:25:11.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.834+0000 7f617110e700 1 -- 172.21.15.5:0/1236653555 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f616c070810 con 0x7f6158004850 2023-03-03T06:25:11.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.835+0000 7f61637fe700 1 -- 172.21.15.5:0/1236653555 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+19718 (secure 0 0 0) 0x7f615c056350 con 0x7f6158004850 2023-03-03T06:25:11.838 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:11.838 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":44,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:11.406998+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:24:53.570801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-03T06:24:53.994714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":8,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:11.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.837+0000 7f617110e700 1 -- 172.21.15.5:0/1236653555 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f614c0682f0 msgr2=0x7f614c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.837+0000 7f617110e700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f614c0682f0 0x7f614c06a7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6154001860 tx=0x7f6154009030 comp rx=0 tx=0).stop 2023-03-03T06:25:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.837+0000 7f617110e700 1 -- 172.21.15.5:0/1236653555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158004850 msgr2=0x7f616c154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.837+0000 7f617110e700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158004850 0x7f616c154200 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f615c011ad0 tx=0x7f615c011e90 comp rx=0 tx=0).stop 2023-03-03T06:25:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.838+0000 7f617110e700 1 -- 172.21.15.5:0/1236653555 shutdown_connections 2023-03-03T06:25:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.838+0000 7f617110e700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f616c0c5c80 0x7f616c0c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.838+0000 7f617110e700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6158004850 0x7f616c154200 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.838+0000 7f617110e700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f614c0682f0 0x7f614c06a7a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.838+0000 7f617110e700 1 --2- 172.21.15.5:0/1236653555 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f616c1548a0 0x7f616c0c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.838+0000 7f617110e700 1 -- 172.21.15.5:0/1236653555 >> 172.21.15.5:0/1236653555 conn(0x7f616c0cc8d0 msgr2=0x7f616c06abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.838+0000 7f617110e700 1 -- 172.21.15.5:0/1236653555 shutdown_connections 2023-03-03T06:25:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.838+0000 7f617110e700 1 -- 172.21.15.5:0/1236653555 wait complete. 2023-03-03T06:25:11.852 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-03-03T06:25:11.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.975+0000 7f6c6064d700 1 Processor -- start 2023-03-03T06:25:11.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.975+0000 7f6c6064d700 1 -- start start 2023-03-03T06:25:11.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.976+0000 7f6c6064d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c5815a850 0x7f6c580b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.976+0000 7f6c6064d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c580cbcd0 con 0x7f6c580cb4a0 2023-03-03T06:25:11.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.976+0000 7f6c6064d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c580cb9f0 con 0x7f6c5815a480 2023-03-03T06:25:11.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.976+0000 7f6c6064d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c580cf2a0 con 0x7f6c5815a850 2023-03-03T06:25:11.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.976+0000 7f6c5dbe8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6c5815a850 0x7f6c580b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.976+0000 7f6c5ebea700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6c580cb4a0 0x7f6c580cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33926/0 (socket says 172.21.15.5:33926) 2023-03-03T06:25:11.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.976+0000 7f6c5ebea700 1 -- 172.21.15.5:0/695407982 learned_addr learned my addr 172.21.15.5:0/695407982 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:11.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.976+0000 7f6c5dbe8700 1 --2- 172.21.15.5:0/695407982 >> v2:172.21.15.5:3300/0 conn(0x7f6c5815a850 0x7f6c580b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44082/0 (socket says 172.21.15.5:44082) 2023-03-03T06:25:11.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.976+0000 7f6c5dbe8700 1 -- 172.21.15.5:0/695407982 >> v1:172.21.15.191:6789/0 conn(0x7f6c5815a480 legacy=0x7f6c580d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:11.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.976+0000 7f6c5dbe8700 1 -- 172.21.15.5:0/695407982 >> v1:172.21.15.5:6789/0 conn(0x7f6c580cb4a0 legacy=0x7f6c580cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.976+0000 7f6c5d3e7700 1 -- 172.21.15.5:0/695407982 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282094055 0 0) 0x7f6c580cbcd0 con 0x7f6c580cb4a0 2023-03-03T06:25:11.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.976+0000 7f6c5dbe8700 1 -- 172.21.15.5:0/695407982 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c580cebe0 con 0x7f6c5815a850 2023-03-03T06:25:11.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.976+0000 7f6c5dbe8700 1 --2- 172.21.15.5:0/695407982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5815a850 0x7f6c580b3ca0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009870 tx=0x7f6c54009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2632091aa7bce9 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:11.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.977+0000 7f6c5d3e7700 1 -- 172.21.15.5:0/695407982 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54004230 con 0x7f6c5815a850 2023-03-03T06:25:11.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.977+0000 7f6c5d3e7700 1 -- 172.21.15.5:0/695407982 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c54004390 con 0x7f6c5815a850 2023-03-03T06:25:11.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.977+0000 7f6c5d3e7700 1 -- 172.21.15.5:0/695407982 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c540036a0 con 0x7f6c5815a850 2023-03-03T06:25:11.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.977+0000 7f6c6064d700 1 -- 172.21.15.5:0/695407982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5815a850 msgr2=0x7f6c580b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.977+0000 7f6c6064d700 1 --2- 172.21.15.5:0/695407982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5815a850 0x7f6c580b3ca0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009870 tx=0x7f6c54009b80 comp rx=0 tx=0).stop 2023-03-03T06:25:11.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.977+0000 7f6c6064d700 1 -- 172.21.15.5:0/695407982 shutdown_connections 2023-03-03T06:25:11.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.977+0000 7f6c6064d700 1 --2- 172.21.15.5:0/695407982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5815a850 0x7f6c580b3ca0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.977+0000 7f6c6064d700 1 -- 172.21.15.5:0/695407982 >> 172.21.15.5:0/695407982 conn(0x7f6c5806f3c0 msgr2=0x7f6c5806f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:11.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.977+0000 7f6c6064d700 1 -- 172.21.15.5:0/695407982 shutdown_connections 2023-03-03T06:25:11.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.977+0000 7f6c6064d700 1 -- 172.21.15.5:0/695407982 wait complete. 2023-03-03T06:25:11.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.979+0000 7f6c6064d700 1 Processor -- start 2023-03-03T06:25:11.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.979+0000 7f6c6064d700 1 -- start start 2023-03-03T06:25:11.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.979+0000 7f6c6064d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c580cb4a0 0x7f6c5806c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.979+0000 7f6c6064d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c5815a480 0x7f6c580b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.979+0000 7f6c6064d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5815a850 0x7f6c580ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.979+0000 7f6c6064d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c581f2ec0 con 0x7f6c5815a850 2023-03-03T06:25:11.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.979+0000 7f6c6064d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5806d860 con 0x7f6c5815a480 2023-03-03T06:25:11.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.979+0000 7f6c6064d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c581f2be0 con 0x7f6c580cb4a0 2023-03-03T06:25:11.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c5ebea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5815a850 0x7f6c580ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c5ebea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5815a850 0x7f6c580ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44090/0 (socket says 172.21.15.5:44090) 2023-03-03T06:25:11.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c5ebea700 1 -- 172.21.15.5:0/3163755980 learned_addr learned my addr 172.21.15.5:0/3163755980 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:11.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c5dbe8700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c5815a480 0x7f6c580b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c5e3e9700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c580cb4a0 0x7f6c5806c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c5ebea700 1 -- 172.21.15.5:0/3163755980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c580cb4a0 msgr2=0x7f6c5806c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c5ebea700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c580cb4a0 0x7f6c5806c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c5ebea700 1 -- 172.21.15.5:0/3163755980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c5815a480 msgr2=0x7f6c580b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:11.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c5ebea700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c5815a480 0x7f6c580b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:11.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c5ebea700 1 -- 172.21.15.5:0/3163755980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540094a0 con 0x7f6c5815a850 2023-03-03T06:25:11.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c5e3e9700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c580cb4a0 0x7f6c5806c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:11.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c5dbe8700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c5815a480 0x7f6c580b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:11.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c5ebea700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5815a850 0x7f6c580ca0f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000cc70 tx=0x7f6c5000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:11.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c4effd700 1 -- 172.21.15.5:0/3163755980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5000ad80 con 0x7f6c5815a850 2023-03-03T06:25:11.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c4effd700 1 -- 172.21.15.5:0/3163755980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5000ce70 con 0x7f6c5815a850 2023-03-03T06:25:11.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c6064d700 1 -- 172.21.15.5:0/3163755980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c580cfdd0 con 0x7f6c5815a850 2023-03-03T06:25:11.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c4effd700 1 -- 172.21.15.5:0/3163755980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c500072f0 con 0x7f6c5815a850 2023-03-03T06:25:11.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.980+0000 7f6c6064d700 1 -- 172.21.15.5:0/3163755980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c580ceec0 con 0x7f6c5815a850 2023-03-03T06:25:11.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.981+0000 7f6c6064d700 1 -- 172.21.15.5:0/3163755980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c580cff60 con 0x7f6c5815a850 2023-03-03T06:25:11.988 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.982+0000 7f6c4effd700 1 -- 172.21.15.5:0/3163755980 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6c5001a030 con 0x7f6c5815a850 2023-03-03T06:25:11.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.982+0000 7f6c4effd700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6c3c0682f0 0x7f6c3c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:11.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.982+0000 7f6c4effd700 1 -- 172.21.15.5:0/3163755980 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6763+0+0 (secure 0 0 0) 0x7f6c50085d10 con 0x7f6c5815a850 2023-03-03T06:25:11.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.982+0000 7f6c5e3e9700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6c3c0682f0 0x7f6c3c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:11.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.982+0000 7f6c5e3e9700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6c3c0682f0 0x7f6c3c06a7a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6c480017d0 tx=0x7f6c48009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:11.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:11.986+0000 7f6c4effd700 1 -- 172.21.15.5:0/3163755980 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6c500522b0 con 0x7f6c5815a850 2023-03-03T06:25:12.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.221+0000 7f6c6064d700 1 -- 172.21.15.5:0/3163755980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c5804e6e0 con 0x7f6c5815a850 2023-03-03T06:25:12.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.222+0000 7f6c4effd700 1 -- 172.21.15.5:0/3163755980 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4648 (secure 0 0 0) 0x7f6c50018090 con 0x7f6c5815a850 2023-03-03T06:25:12.230 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:12.230 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/1485137346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1485137346},{"type":"v1","addr":"172.21.15.191:6834","nonce":1485137346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4886,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2062075895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2062075895},{"type":"v1","addr":"172.21.15.5:6837","nonce":2062075895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3463336232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":3463336232},{"type":"v1","addr":"172.21.15.191:6835","nonce":3463336232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:24:55.063168+0000","modified":"2023-03-03T06:24:58.081923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5098},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5098":{"gid":5098,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/3094337828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3094337828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3094337828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-03T06:25:12.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.224+0000 7f6c6064d700 1 -- 172.21.15.5:0/3163755980 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6c3c0682f0 msgr2=0x7f6c3c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:12.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.224+0000 7f6c6064d700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6c3c0682f0 0x7f6c3c06a7a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6c480017d0 tx=0x7f6c48009040 comp rx=0 tx=0).stop 2023-03-03T06:25:12.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.224+0000 7f6c6064d700 1 -- 172.21.15.5:0/3163755980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5815a850 msgr2=0x7f6c580ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:12.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.224+0000 7f6c6064d700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5815a850 0x7f6c580ca0f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000cc70 tx=0x7f6c5000a340 comp rx=0 tx=0).stop 2023-03-03T06:25:12.231 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.224+0000 7f6c6064d700 1 -- 172.21.15.5:0/3163755980 shutdown_connections 2023-03-03T06:25:12.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.224+0000 7f6c6064d700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5815a850 0x7f6c580ca0f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.224+0000 7f6c6064d700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6c3c0682f0 0x7f6c3c06a7a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.224+0000 7f6c6064d700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6c580cb4a0 0x7f6c5806c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.224+0000 7f6c6064d700 1 --2- 172.21.15.5:0/3163755980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6c5815a480 0x7f6c580b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.224+0000 7f6c6064d700 1 -- 172.21.15.5:0/3163755980 >> 172.21.15.5:0/3163755980 conn(0x7f6c5806f3c0 msgr2=0x7f6c5815d520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:12.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.224+0000 7f6c6064d700 1 -- 172.21.15.5:0/3163755980 shutdown_connections 2023-03-03T06:25:12.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.224+0000 7f6c6064d700 1 -- 172.21.15.5:0/3163755980 wait complete. 2023-03-03T06:25:12.232 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2023-03-03T06:25:12.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.361+0000 7efe821a8700 1 Processor -- start 2023-03-03T06:25:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.361+0000 7efe821a8700 1 -- start start 2023-03-03T06:25:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe821a8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe7c0af450 0x7efe7c0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:12.364 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe821a8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe7c0b1f80 0x7efe7c0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe821a8700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7c06b590 con 0x7efe7c0af080 2023-03-03T06:25:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe821a8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7c06b870 con 0x7efe7c0af450 2023-03-03T06:25:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe821a8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c06bb50 con 0x7efe7c0b1f80 2023-03-03T06:25:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe7affd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe7c0af450 0x7efe7c0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe7b7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7efe7c0af080 0x7efe7c0b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33936/0 (socket says 172.21.15.5:33936) 2023-03-03T06:25:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe7b7fe700 1 -- 172.21.15.5:0/3213363602 learned_addr learned my addr 172.21.15.5:0/3213363602 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:12.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe7bfff700 1 --2- 172.21.15.5:0/3213363602 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe7c0b1f80 0x7efe7c0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:12.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe7affd700 1 -- 172.21.15.5:0/3213363602 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe7c0b1f80 msgr2=0x7efe7c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:12.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe7affd700 1 --2- 172.21.15.5:0/3213363602 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe7c0b1f80 0x7efe7c0cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe7affd700 1 -- 172.21.15.5:0/3213363602 >> v1:172.21.15.5:6789/0 conn(0x7efe7c0af080 legacy=0x7efe7c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:12.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe7affd700 1 -- 172.21.15.5:0/3213363602 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c06be30 con 0x7efe7c0af450 2023-03-03T06:25:12.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe7a7fc700 1 -- 172.21.15.5:0/3213363602 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293667431 0 0) 0x7efe7c06b590 con 0x7efe7c0af080 2023-03-03T06:25:12.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe7affd700 1 --2- 172.21.15.5:0/3213363602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe7c0af450 0x7efe7c0cd350 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efe70009840 tx=0x7efe70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32523eeaa1f8e633 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:12.366 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe7a7fc700 1 -- 172.21.15.5:0/3213363602 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70011830 con 0x7efe7c0af450 2023-03-03T06:25:12.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe7a7fc700 1 -- 172.21.15.5:0/3213363602 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70011990 con 0x7efe7c0af450 2023-03-03T06:25:12.367 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.362+0000 7efe7a7fc700 1 -- 172.21.15.5:0/3213363602 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70011d20 con 0x7efe7c0af450 2023-03-03T06:25:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.363+0000 7efe821a8700 1 -- 172.21.15.5:0/3213363602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe7c0af450 msgr2=0x7efe7c0cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.363+0000 7efe821a8700 1 --2- 172.21.15.5:0/3213363602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe7c0af450 0x7efe7c0cd350 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efe70009840 tx=0x7efe70009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.363+0000 7efe821a8700 1 -- 172.21.15.5:0/3213363602 shutdown_connections 2023-03-03T06:25:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.363+0000 7efe821a8700 1 --2- 172.21.15.5:0/3213363602 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe7c0b1f80 0x7efe7c0cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.369 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.363+0000 7efe821a8700 1 --2- 172.21.15.5:0/3213363602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe7c0af450 0x7efe7c0cd350 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.363+0000 7efe821a8700 1 -- 172.21.15.5:0/3213363602 >> 172.21.15.5:0/3213363602 conn(0x7efe7c06ea70 msgr2=0x7efe7c0cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.363+0000 7efe821a8700 1 -- 172.21.15.5:0/3213363602 shutdown_connections 2023-03-03T06:25:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.363+0000 7efe821a8700 1 -- 172.21.15.5:0/3213363602 wait complete. 2023-03-03T06:25:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.364+0000 7efe821a8700 1 Processor -- start 2023-03-03T06:25:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.364+0000 7efe821a8700 1 -- start start 2023-03-03T06:25:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.365+0000 7efe821a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe7c0af080 0x7efe7c152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.365+0000 7efe821a8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe7c0af450 0x7efe7c1f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:12.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.365+0000 7efe821a8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe7c0b1f80 0x7efe7c15f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.365+0000 7efe821a8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c0c4ad0 con 0x7efe7c0af080 2023-03-03T06:25:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.365+0000 7efe821a8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c1f3170 con 0x7efe7c0b1f80 2023-03-03T06:25:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.365+0000 7efe821a8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c0c3ec0 con 0x7efe7c0af450 2023-03-03T06:25:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.365+0000 7efe7b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe7c0af080 0x7efe7c152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.365+0000 7efe7b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe7c0af080 0x7efe7c152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44100/0 (socket says 172.21.15.5:44100) 2023-03-03T06:25:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.365+0000 7efe7b7fe700 1 -- 172.21.15.5:0/3236996544 learned_addr learned my addr 172.21.15.5:0/3236996544 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:12.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.365+0000 7efe7bfff700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe7c0b1f80 0x7efe7c15f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.365+0000 7efe7affd700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe7c0af450 0x7efe7c1f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.365+0000 7efe7b7fe700 1 -- 172.21.15.5:0/3236996544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe7c0af450 msgr2=0x7efe7c1f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.365+0000 7efe7b7fe700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe7c0af450 0x7efe7c1f2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.366+0000 7efe7b7fe700 1 -- 172.21.15.5:0/3236996544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe7c0b1f80 msgr2=0x7efe7c15f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.366+0000 7efe7b7fe700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe7c0b1f80 0x7efe7c15f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.366+0000 7efe7b7fe700 1 -- 172.21.15.5:0/3236996544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe700094a0 con 0x7efe7c0af080 2023-03-03T06:25:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.366+0000 7efe7bfff700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe7c0b1f80 0x7efe7c15f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:12.372 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.366+0000 7efe7affd700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe7c0af450 0x7efe7c1f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.366+0000 7efe7b7fe700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe7c0af080 0x7efe7c152560 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0011e0 tx=0x7efe6c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.366+0000 7efe63fff700 1 -- 172.21.15.5:0/3236996544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c004c80 con 0x7efe7c0af080 2023-03-03T06:25:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.366+0000 7efe63fff700 1 -- 172.21.15.5:0/3236996544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c004e00 con 0x7efe7c0af080 2023-03-03T06:25:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.366+0000 7efe821a8700 1 -- 172.21.15.5:0/3236996544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7c06d370 con 0x7efe7c0af080 2023-03-03T06:25:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.366+0000 7efe63fff700 1 -- 172.21.15.5:0/3236996544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c007310 con 0x7efe7c0af080 2023-03-03T06:25:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.366+0000 7efe821a8700 1 -- 172.21.15.5:0/3236996544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7c06c110 con 0x7efe7c0af080 2023-03-03T06:25:12.373 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.367+0000 7efe821a8700 1 -- 172.21.15.5:0/3236996544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7c06cb70 con 0x7efe7c0af080 2023-03-03T06:25:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.367+0000 7efe63fff700 1 -- 172.21.15.5:0/3236996544 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7efe6c01a020 con 0x7efe7c0af080 2023-03-03T06:25:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.368+0000 7efe63fff700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe680682f0 0x7efe6806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:12.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.368+0000 7efe63fff700 1 -- 172.21.15.5:0/3236996544 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6763+0+0 (secure 0 0 0) 0x7efe6c085bf0 con 0x7efe7c0af080 2023-03-03T06:25:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.368+0000 7efe7affd700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe680682f0 0x7efe6806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.368+0000 7efe7affd700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe680682f0 0x7efe6806a7a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0701e0 tx=0x7efe70008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:12.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.372+0000 7efe63fff700 1 -- 172.21.15.5:0/3236996544 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7efe6c0521c0 con 0x7efe7c0af080 2023-03-03T06:25:12.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.614+0000 7efe821a8700 1 -- 172.21.15.5:0/3236996544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe7c04e6e0 con 0x7efe7c0af080 2023-03-03T06:25:12.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.615+0000 7efe63fff700 1 -- 172.21.15.5:0/3236996544 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4648 (secure 0 0 0) 0x7efe6c0557e0 con 0x7efe7c0af080 2023-03-03T06:25:12.617 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:12.618 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/1485137346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1485137346},{"type":"v1","addr":"172.21.15.191:6834","nonce":1485137346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4886,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2062075895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2062075895},{"type":"v1","addr":"172.21.15.5:6837","nonce":2062075895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3463336232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":3463336232},{"type":"v1","addr":"172.21.15.191:6835","nonce":3463336232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:24:55.063168+0000","modified":"2023-03-03T06:24:58.081923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5098},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5098":{"gid":5098,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6836/3094337828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3094337828},{"type":"v1","addr":"172.21.15.5:6836","nonce":3094337828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-03-03T06:25:12.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.617+0000 7efe821a8700 1 -- 172.21.15.5:0/3236996544 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe680682f0 msgr2=0x7efe6806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:12.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.617+0000 7efe821a8700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe680682f0 0x7efe6806a7a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0701e0 tx=0x7efe70008030 comp rx=0 tx=0).stop 2023-03-03T06:25:12.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.617+0000 7efe821a8700 1 -- 172.21.15.5:0/3236996544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe7c0af080 msgr2=0x7efe7c152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:12.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.617+0000 7efe821a8700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe7c0af080 0x7efe7c152560 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0011e0 tx=0x7efe6c00cae0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.617+0000 7efe821a8700 1 -- 172.21.15.5:0/3236996544 shutdown_connections 2023-03-03T06:25:12.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.617+0000 7efe821a8700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe7c0b1f80 0x7efe7c15f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.617+0000 7efe821a8700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe7c0af080 0x7efe7c152560 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.617+0000 7efe821a8700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe680682f0 0x7efe6806a7a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.617+0000 7efe821a8700 1 --2- 172.21.15.5:0/3236996544 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe7c0af450 0x7efe7c1f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.617+0000 7efe821a8700 1 -- 172.21.15.5:0/3236996544 >> 172.21.15.5:0/3236996544 conn(0x7efe7c06ea70 msgr2=0x7efe7c15b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:12.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.617+0000 7efe821a8700 1 -- 172.21.15.5:0/3236996544 shutdown_connections 2023-03-03T06:25:12.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.617+0000 7efe821a8700 1 -- 172.21.15.5:0/3236996544 wait complete. 2023-03-03T06:25:12.621 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2023-03-03T06:25:12.631 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:12.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.754+0000 7fe89e7af700 1 Processor -- start 2023-03-03T06:25:12.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.754+0000 7fe89e7af700 1 -- start start 2023-03-03T06:25:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.755+0000 7fe89e7af700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe89815cd40 0x7fe8980b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.755+0000 7fe89e7af700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8980cba50 0x7fe8980b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.755+0000 7fe89e7af700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89815d4e0 con 0x7fe8980cd3e0 2023-03-03T06:25:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.755+0000 7fe89e7af700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89815d7c0 con 0x7fe89815cd40 2023-03-03T06:25:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.755+0000 7fe89e7af700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89815daa0 con 0x7fe8980cba50 2023-03-03T06:25:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.755+0000 7fe897fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe89815cd40 0x7fe8980b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:12.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.755+0000 7fe897fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe89815cd40 0x7fe8980b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44108/0 (socket says 172.21.15.5:44108) 2023-03-03T06:25:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.755+0000 7fe897fff700 1 -- 172.21.15.5:0/2287755436 learned_addr learned my addr 172.21.15.5:0/2287755436 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.756+0000 7fe897fff700 1 -- 172.21.15.5:0/2287755436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8980cba50 msgr2=0x7fe8980b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.756+0000 7fe8977fe700 1 --2- 172.21.15.5:0/2287755436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8980cba50 0x7fe8980b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.756+0000 7fe897fff700 1 --2- 172.21.15.5:0/2287755436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8980cba50 0x7fe8980b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.756+0000 7fe897fff700 1 -- 172.21.15.5:0/2287755436 >> v1:172.21.15.191:6789/0 conn(0x7fe8980cd3e0 legacy=0x7fe898160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.756+0000 7fe897fff700 1 -- 172.21.15.5:0/2287755436 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89815dd80 con 0x7fe89815cd40 2023-03-03T06:25:12.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.756+0000 7fe8977fe700 1 --2- 172.21.15.5:0/2287755436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8980cba50 0x7fe8980b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.756+0000 7fe897fff700 1 --2- 172.21.15.5:0/2287755436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe89815cd40 0x7fe8980b18d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe8880098f0 tx=0x7fe888009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3346f10224719 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.756+0000 7fe896ffd700 1 -- 172.21.15.5:0/2287755436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888004230 con 0x7fe89815cd40 2023-03-03T06:25:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.756+0000 7fe896ffd700 1 -- 172.21.15.5:0/2287755436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe888004390 con 0x7fe89815cd40 2023-03-03T06:25:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.756+0000 7fe896ffd700 1 -- 172.21.15.5:0/2287755436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8880036a0 con 0x7fe89815cd40 2023-03-03T06:25:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.757+0000 7fe89e7af700 1 -- 172.21.15.5:0/2287755436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe89815cd40 msgr2=0x7fe8980b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.757+0000 7fe89e7af700 1 --2- 172.21.15.5:0/2287755436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe89815cd40 0x7fe8980b18d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe8880098f0 tx=0x7fe888009c00 comp rx=0 tx=0).stop 2023-03-03T06:25:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.757+0000 7fe89e7af700 1 -- 172.21.15.5:0/2287755436 shutdown_connections 2023-03-03T06:25:12.761 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.757+0000 7fe89e7af700 1 --2- 172.21.15.5:0/2287755436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe89815cd40 0x7fe8980b18d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.757+0000 7fe89e7af700 1 --2- 172.21.15.5:0/2287755436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe8980cba50 0x7fe8980b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.757+0000 7fe89e7af700 1 -- 172.21.15.5:0/2287755436 >> 172.21.15.5:0/2287755436 conn(0x7fe8980cc8d0 msgr2=0x7fe8980cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.757+0000 7fe89e7af700 1 -- 172.21.15.5:0/2287755436 shutdown_connections 2023-03-03T06:25:12.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.757+0000 7fe89e7af700 1 -- 172.21.15.5:0/2287755436 wait complete. 2023-03-03T06:25:12.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.758+0000 7fe89e7af700 1 Processor -- start 2023-03-03T06:25:12.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.758+0000 7fe89e7af700 1 -- start start 2023-03-03T06:25:12.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe89e7af700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8980cba50 0x7fe8980c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:12.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe89e7af700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8980cd3e0 0x7fe89814c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe89e7af700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe89815cd40 0x7fe8980ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe89e7af700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980b5ba0 con 0x7fe8980cd3e0 2023-03-03T06:25:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe89e7af700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980ae6c0 con 0x7fe8980cba50 2023-03-03T06:25:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe89e7af700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980ce410 con 0x7fe89815cd40 2023-03-03T06:25:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe8977fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8980cd3e0 0x7fe89814c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe8977fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8980cd3e0 0x7fe89814c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44116/0 (socket says 172.21.15.5:44116) 2023-03-03T06:25:12.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe8977fe700 1 -- 172.21.15.5:0/3840960874 learned_addr learned my addr 172.21.15.5:0/3840960874 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe897fff700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8980cba50 0x7fe8980c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe89cd4c700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe89815cd40 0x7fe8980ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe8977fe700 1 -- 172.21.15.5:0/3840960874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe89815cd40 msgr2=0x7fe8980ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe8977fe700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe89815cd40 0x7fe8980ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe8977fe700 1 -- 172.21.15.5:0/3840960874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8980cba50 msgr2=0x7fe8980c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe8977fe700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8980cba50 0x7fe8980c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe8977fe700 1 -- 172.21.15.5:0/3840960874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe888009550 con 0x7fe8980cd3e0 2023-03-03T06:25:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe89cd4c700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe89815cd40 0x7fe8980ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe897fff700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8980cba50 0x7fe8980c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.759+0000 7fe8977fe700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8980cd3e0 0x7fe89814c9d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c7f0 tx=0x7fe88000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.760+0000 7fe894ff9700 1 -- 172.21.15.5:0/3840960874 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880005c20 con 0x7fe8980cd3e0 2023-03-03T06:25:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.760+0000 7fe894ff9700 1 -- 172.21.15.5:0/3840960874 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe880005d80 con 0x7fe8980cd3e0 2023-03-03T06:25:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.760+0000 7fe89e7af700 1 -- 172.21.15.5:0/3840960874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8980ca530 con 0x7fe8980cd3e0 2023-03-03T06:25:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.760+0000 7fe894ff9700 1 -- 172.21.15.5:0/3840960874 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880011820 con 0x7fe8980cd3e0 2023-03-03T06:25:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.760+0000 7fe89e7af700 1 -- 172.21.15.5:0/3840960874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89815e060 con 0x7fe8980cd3e0 2023-03-03T06:25:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.761+0000 7fe89e7af700 1 -- 172.21.15.5:0/3840960874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89815d110 con 0x7fe8980cd3e0 2023-03-03T06:25:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.761+0000 7fe894ff9700 1 -- 172.21.15.5:0/3840960874 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe880020070 con 0x7fe8980cd3e0 2023-03-03T06:25:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.761+0000 7fe894ff9700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe8780682f0 0x7fe87806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.762+0000 7fe894ff9700 1 -- 172.21.15.5:0/3840960874 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6763+0+0 (secure 0 0 0) 0x7fe880086140 con 0x7fe8980cd3e0 2023-03-03T06:25:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.762+0000 7fe897fff700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe8780682f0 0x7fe87806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.762+0000 7fe897fff700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe8780682f0 0x7fe87806a7a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe888009130 tx=0x7fe888008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:12.769 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.766+0000 7fe894ff9700 1 -- 172.21.15.5:0/3840960874 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe8800526e0 con 0x7fe8980cd3e0 2023-03-03T06:25:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.958+0000 7fe89e7af700 1 -- 172.21.15.5:0/3840960874 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe89804e6e0 con 0x7fe8980cd3e0 2023-03-03T06:25:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.960+0000 7fe894ff9700 1 -- 172.21.15.5:0/3840960874 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+19718 (secure 0 0 0) 0x7fe880055d00 con 0x7fe8980cd3e0 2023-03-03T06:25:12.964 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:12.964 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":44,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:11.406998+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:24:53.570801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-03-03T06:24:53.994714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":8,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.962+0000 7fe89e7af700 1 -- 172.21.15.5:0/3840960874 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe8780682f0 msgr2=0x7fe87806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.962+0000 7fe89e7af700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe8780682f0 0x7fe87806a7a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe888009130 tx=0x7fe888008030 comp rx=0 tx=0).stop 2023-03-03T06:25:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.962+0000 7fe89e7af700 1 -- 172.21.15.5:0/3840960874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8980cd3e0 msgr2=0x7fe89814c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.962+0000 7fe89e7af700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8980cd3e0 0x7fe89814c9d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c7f0 tx=0x7fe88000cbb0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.962+0000 7fe89e7af700 1 -- 172.21.15.5:0/3840960874 shutdown_connections 2023-03-03T06:25:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.962+0000 7fe89e7af700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe8780682f0 0x7fe87806a7a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.962+0000 7fe89e7af700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe89815cd40 0x7fe8980ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.962+0000 7fe89e7af700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe8980cba50 0x7fe8980c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.962+0000 7fe89e7af700 1 --2- 172.21.15.5:0/3840960874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8980cd3e0 0x7fe89814c9d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.962+0000 7fe89e7af700 1 -- 172.21.15.5:0/3840960874 >> 172.21.15.5:0/3840960874 conn(0x7fe8980cc8d0 msgr2=0x7fe8980b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.962+0000 7fe89e7af700 1 -- 172.21.15.5:0/3840960874 shutdown_connections 2023-03-03T06:25:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:12.962+0000 7fe89e7af700 1 -- 172.21.15.5:0/3840960874 wait complete. 2023-03-03T06:25:12.976 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-03-03T06:25:13.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.100+0000 7f17e8aca700 1 Processor -- start 2023-03-03T06:25:13.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.100+0000 7f17e8aca700 1 -- start start 2023-03-03T06:25:13.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.101+0000 7f17e8aca700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17e4159730 0x7f17e415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:13.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.101+0000 7f17e8aca700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e415aa90 con 0x7f17e40714c0 2023-03-03T06:25:13.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.101+0000 7f17e8aca700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e415a220 con 0x7f17e40cec00 2023-03-03T06:25:13.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.101+0000 7f17e8aca700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e415a4d0 con 0x7f17e4159730 2023-03-03T06:25:13.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.101+0000 7f17e259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f17e4159730 0x7f17e415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:13.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.101+0000 7f17e2d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f17e40714c0 0x7f17e40c9b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33968/0 (socket says 172.21.15.5:33968) 2023-03-03T06:25:13.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.101+0000 7f17e2d9d700 1 -- 172.21.15.5:0/3023800302 learned_addr learned my addr 172.21.15.5:0/3023800302 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:13.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.101+0000 7f17e259c700 1 -- 172.21.15.5:0/3023800302 >> v1:172.21.15.191:6789/0 conn(0x7f17e40cec00 legacy=0x7f17e4159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:13.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.101+0000 7f17e259c700 1 -- 172.21.15.5:0/3023800302 >> v1:172.21.15.5:6789/0 conn(0x7f17e40714c0 legacy=0x7f17e40c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:13.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.101+0000 7f17e259c700 1 -- 172.21.15.5:0/3023800302 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e415a7b0 con 0x7f17e4159730 2023-03-03T06:25:13.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.101+0000 7f17e159a700 1 -- 172.21.15.5:0/3023800302 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506067078 0 0) 0x7f17e415aa90 con 0x7f17e40714c0 2023-03-03T06:25:13.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.101+0000 7f17e259c700 1 --2- 172.21.15.5:0/3023800302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17e4159730 0x7f17e415d9f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f17d4009840 tx=0x7f17d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6579af669a2ad2a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:13.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.101+0000 7f17e159a700 1 -- 172.21.15.5:0/3023800302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4004230 con 0x7f17e4159730 2023-03-03T06:25:13.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.102+0000 7f17e159a700 1 -- 172.21.15.5:0/3023800302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d4004390 con 0x7f17e4159730 2023-03-03T06:25:13.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.102+0000 7f17e159a700 1 -- 172.21.15.5:0/3023800302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d40036a0 con 0x7f17e4159730 2023-03-03T06:25:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.102+0000 7f17e8aca700 1 -- 172.21.15.5:0/3023800302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17e4159730 msgr2=0x7f17e415d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:13.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.102+0000 7f17e8aca700 1 --2- 172.21.15.5:0/3023800302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17e4159730 0x7f17e415d9f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f17d4009840 tx=0x7f17d4009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.102+0000 7f17e8aca700 1 -- 172.21.15.5:0/3023800302 shutdown_connections 2023-03-03T06:25:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.102+0000 7f17e8aca700 1 --2- 172.21.15.5:0/3023800302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17e4159730 0x7f17e415d9f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.102+0000 7f17e8aca700 1 -- 172.21.15.5:0/3023800302 >> 172.21.15.5:0/3023800302 conn(0x7f17e40cf4b0 msgr2=0x7f17e40cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.102+0000 7f17e8aca700 1 -- 172.21.15.5:0/3023800302 shutdown_connections 2023-03-03T06:25:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.102+0000 7f17e8aca700 1 -- 172.21.15.5:0/3023800302 wait complete. 2023-03-03T06:25:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.104+0000 7f17e8aca700 1 Processor -- start 2023-03-03T06:25:13.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.104+0000 7f17e8aca700 1 -- start start 2023-03-03T06:25:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e8aca700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17e40714c0 0x7f17e40c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e8aca700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17e40cec00 0x7f17e40b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e8aca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17e4142b90 0x7f17e41404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e8aca700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e40c8fc0 con 0x7f17e4142b90 2023-03-03T06:25:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e8aca700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e40b26c0 con 0x7f17e40714c0 2023-03-03T06:25:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e8aca700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e40b29a0 con 0x7f17e40cec00 2023-03-03T06:25:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17e4142b90 0x7f17e41404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17e4142b90 0x7f17e41404a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44132/0 (socket says 172.21.15.5:44132) 2023-03-03T06:25:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e2d9d700 1 -- 172.21.15.5:0/385114283 learned_addr learned my addr 172.21.15.5:0/385114283 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e259c700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17e40714c0 0x7f17e40c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e1d9b700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17e40cec00 0x7f17e40b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e2d9d700 1 -- 172.21.15.5:0/385114283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17e40cec00 msgr2=0x7f17e40b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:13.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e2d9d700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17e40cec00 0x7f17e40b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e2d9d700 1 -- 172.21.15.5:0/385114283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17e40714c0 msgr2=0x7f17e40c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e2d9d700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17e40714c0 0x7f17e40c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e2d9d700 1 -- 172.21.15.5:0/385114283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d40094a0 con 0x7f17e4142b90 2023-03-03T06:25:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e259c700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17e40714c0 0x7f17e40c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e1d9b700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17e40cec00 0x7f17e40b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.105+0000 7f17e2d9d700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17e4142b90 0x7f17e41404a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00cb60 tx=0x7f17dc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.106+0000 7f17d2ffd700 1 -- 172.21.15.5:0/385114283 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00ab50 con 0x7f17e4142b90 2023-03-03T06:25:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.106+0000 7f17d2ffd700 1 -- 172.21.15.5:0/385114283 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc00acb0 con 0x7f17e4142b90 2023-03-03T06:25:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.106+0000 7f17e8aca700 1 -- 172.21.15.5:0/385114283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e415d4d0 con 0x7f17e4142b90 2023-03-03T06:25:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.106+0000 7f17d2ffd700 1 -- 172.21.15.5:0/385114283 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc007310 con 0x7f17e4142b90 2023-03-03T06:25:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.106+0000 7f17e8aca700 1 -- 172.21.15.5:0/385114283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e415d1f0 con 0x7f17e4142b90 2023-03-03T06:25:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.107+0000 7f17e8aca700 1 -- 172.21.15.5:0/385114283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e415df30 con 0x7f17e4142b90 2023-03-03T06:25:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.107+0000 7f17d2ffd700 1 -- 172.21.15.5:0/385114283 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f17dc01a030 con 0x7f17e4142b90 2023-03-03T06:25:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.107+0000 7f17d2ffd700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f17c40682f0 0x7f17c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.108+0000 7f17d2ffd700 1 -- 172.21.15.5:0/385114283 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6763+0+0 (secure 0 0 0) 0x7f17dc085c00 con 0x7f17e4142b90 2023-03-03T06:25:13.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.108+0000 7f17e259c700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f17c40682f0 0x7f17c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:13.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.108+0000 7f17e259c700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f17c40682f0 0x7f17c406a7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f17d40090b0 tx=0x7f17d4013040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:13.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.112+0000 7f17d2ffd700 1 -- 172.21.15.5:0/385114283 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f17dc08b020 con 0x7f17e4142b90 2023-03-03T06:25:13.355 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.353+0000 7f17e8aca700 1 -- 172.21.15.5:0/385114283 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f17e4159e50 con 0x7f17e4142b90 2023-03-03T06:25:13.454 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T06:25:13.452+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-03-03T06:25:13.462 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.460+0000 7f17d2ffd700 1 -- 172.21.15.5:0/385114283 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f17dc018090 con 0x7f17e4142b90 2023-03-03T06:25:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.462+0000 7f17e8aca700 1 -- 172.21.15.5:0/385114283 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f17c40682f0 msgr2=0x7f17c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.462+0000 7f17e8aca700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f17c40682f0 0x7f17c406a7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f17d40090b0 tx=0x7f17d4013040 comp rx=0 tx=0).stop 2023-03-03T06:25:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.462+0000 7f17e8aca700 1 -- 172.21.15.5:0/385114283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17e4142b90 msgr2=0x7f17e41404a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:13.464 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.462+0000 7f17e8aca700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17e4142b90 0x7f17e41404a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00cb60 tx=0x7f17dc00cf20 comp rx=0 tx=0).stop 2023-03-03T06:25:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.462+0000 7f17e8aca700 1 -- 172.21.15.5:0/385114283 shutdown_connections 2023-03-03T06:25:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.462+0000 7f17e8aca700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17e4142b90 0x7f17e41404a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.462+0000 7f17e8aca700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f17e40714c0 0x7f17e40c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.462+0000 7f17e8aca700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f17c40682f0 0x7f17c406a7a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.462+0000 7f17e8aca700 1 --2- 172.21.15.5:0/385114283 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f17e40cec00 0x7f17e40b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.462+0000 7f17e8aca700 1 -- 172.21.15.5:0/385114283 >> 172.21.15.5:0/385114283 conn(0x7f17e40cf4b0 msgr2=0x7f17e415a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:13.465 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.462+0000 7f17e8aca700 1 -- 172.21.15.5:0/385114283 shutdown_connections 2023-03-03T06:25:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.462+0000 7f17e8aca700 1 -- 172.21.15.5:0/385114283 wait complete. 2023-03-03T06:25:13.466 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-03-03T06:25:13.466 INFO:tasks.ceph.mds.a.smithi005.stderr: -2778> 2023-03-03T06:24:58.599+0000 7f9157b16700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-03T06:25:13.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-03-03T06:25:13.497 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-03-03T06:25:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.604+0000 7f0561303700 1 Processor -- start 2023-03-03T06:25:13.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.604+0000 7f0561303700 1 -- start start 2023-03-03T06:25:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f0561303700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f055c06bab0 0x7f055c0cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f0561303700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f055c06c120 0x7f055c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f0561303700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c0d2d60 con 0x7f055c0b8720 2023-03-03T06:25:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f0561303700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c06cae0 con 0x7f055c06c120 2023-03-03T06:25:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f0561303700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0cdd90 con 0x7f055c06bab0 2023-03-03T06:25:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f055b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f055c06c120 0x7f055c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f055affd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f055c0b8720 0x7f055c160d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33996/0 (socket says 172.21.15.5:33996) 2023-03-03T06:25:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f055b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f055c06c120 0x7f055c06c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44158/0 (socket says 172.21.15.5:44158) 2023-03-03T06:25:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f055affd700 1 -- 172.21.15.5:0/3471950349 learned_addr learned my addr 172.21.15.5:0/3471950349 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f055a7fc700 1 --2- 172.21.15.5:0/3471950349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f055c06bab0 0x7f055c0cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f055b7fe700 1 -- 172.21.15.5:0/3471950349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f055c06bab0 msgr2=0x7f055c0cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f055b7fe700 1 --2- 172.21.15.5:0/3471950349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f055c06bab0 0x7f055c0cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f055b7fe700 1 -- 172.21.15.5:0/3471950349 >> v1:172.21.15.5:6789/0 conn(0x7f055c0b8720 legacy=0x7f055c160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f055b7fe700 1 -- 172.21.15.5:0/3471950349 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c0cf400 con 0x7f055c06c120 2023-03-03T06:25:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.605+0000 7f0559ffb700 1 -- 172.21.15.5:0/3471950349 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692027523 0 0) 0x7f055c0d2d60 con 0x7f055c0b8720 2023-03-03T06:25:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.606+0000 7f055a7fc700 1 --2- 172.21.15.5:0/3471950349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f055c06bab0 0x7f055c0cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.606+0000 7f055b7fe700 1 --2- 172.21.15.5:0/3471950349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055c06c120 0x7f055c06c5a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0554009d90 tx=0x7f055400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6e868a32cd26e5 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.606+0000 7f0559ffb700 1 -- 172.21.15.5:0/3471950349 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400e070 con 0x7f055c06c120 2023-03-03T06:25:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.606+0000 7f0559ffb700 1 -- 172.21.15.5:0/3471950349 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055400bbd0 con 0x7f055c06c120 2023-03-03T06:25:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.606+0000 7f0559ffb700 1 -- 172.21.15.5:0/3471950349 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554012430 con 0x7f055c06c120 2023-03-03T06:25:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.606+0000 7f0561303700 1 -- 172.21.15.5:0/3471950349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055c06c120 msgr2=0x7f055c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.606+0000 7f0561303700 1 --2- 172.21.15.5:0/3471950349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055c06c120 0x7f055c06c5a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0554009d90 tx=0x7f055400b330 comp rx=0 tx=0).stop 2023-03-03T06:25:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.606+0000 7f0561303700 1 -- 172.21.15.5:0/3471950349 shutdown_connections 2023-03-03T06:25:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.606+0000 7f0561303700 1 --2- 172.21.15.5:0/3471950349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055c06c120 0x7f055c06c5a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.606+0000 7f0561303700 1 --2- 172.21.15.5:0/3471950349 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f055c06bab0 0x7f055c0cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.606+0000 7f0561303700 1 -- 172.21.15.5:0/3471950349 >> 172.21.15.5:0/3471950349 conn(0x7f055c0d0590 msgr2=0x7f055c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.606+0000 7f0561303700 1 -- 172.21.15.5:0/3471950349 shutdown_connections 2023-03-03T06:25:13.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.606+0000 7f0561303700 1 -- 172.21.15.5:0/3471950349 wait complete. 2023-03-03T06:25:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.608+0000 7f0561303700 1 Processor -- start 2023-03-03T06:25:13.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.608+0000 7f0561303700 1 -- start start 2023-03-03T06:25:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.608+0000 7f0561303700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f055c06bab0 0x7f055c150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.608+0000 7f0561303700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055c06c120 0x7f055c0b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.608+0000 7f0561303700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f055c0b8720 0x7f055c158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.608+0000 7f0561303700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0b4df0 con 0x7f055c06c120 2023-03-03T06:25:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f0561303700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0cca50 con 0x7f055c0b8720 2023-03-03T06:25:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f0561303700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0b4b10 con 0x7f055c06bab0 2023-03-03T06:25:13.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f055a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055c06c120 0x7f055c0b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:13.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f055a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055c06c120 0x7f055c0b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44162/0 (socket says 172.21.15.5:44162) 2023-03-03T06:25:13.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f055a7fc700 1 -- 172.21.15.5:0/3891381685 learned_addr learned my addr 172.21.15.5:0/3891381685 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:13.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f055affd700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f055c06bab0 0x7f055c150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:13.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f055b7fe700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f055c0b8720 0x7f055c158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:13.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f055a7fc700 1 -- 172.21.15.5:0/3891381685 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f055c06bab0 msgr2=0x7f055c150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:13.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f055a7fc700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f055c06bab0 0x7f055c150cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:13.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f055a7fc700 1 -- 172.21.15.5:0/3891381685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f055c0b8720 msgr2=0x7f055c158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:13.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f055a7fc700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f055c0b8720 0x7f055c158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:13.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f055a7fc700 1 -- 172.21.15.5:0/3891381685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554009a70 con 0x7f055c06c120 2023-03-03T06:25:13.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f055a7fc700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055c06c120 0x7f055c0b4090 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f054c00c7f0 tx=0x7f054c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:13.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f05437fe700 1 -- 172.21.15.5:0/3891381685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c011800 con 0x7f055c06c120 2023-03-03T06:25:13.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f05437fe700 1 -- 172.21.15.5:0/3891381685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c011960 con 0x7f055c06c120 2023-03-03T06:25:13.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f05437fe700 1 -- 172.21.15.5:0/3891381685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c011d10 con 0x7f055c06c120 2023-03-03T06:25:13.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f0561303700 1 -- 172.21.15.5:0/3891381685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c0d29f0 con 0x7f055c06c120 2023-03-03T06:25:13.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.609+0000 7f0561303700 1 -- 172.21.15.5:0/3891381685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c0cf6e0 con 0x7f055c06c120 2023-03-03T06:25:13.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.610+0000 7f0561303700 1 -- 172.21.15.5:0/3891381685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c0b8af0 con 0x7f055c06c120 2023-03-03T06:25:13.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.611+0000 7f05437fe700 1 -- 172.21.15.5:0/3891381685 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f054c021070 con 0x7f055c06c120 2023-03-03T06:25:13.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.611+0000 7f05437fe700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f05480682f0 0x7f054806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:13.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.611+0000 7f05437fe700 1 -- 172.21.15.5:0/3891381685 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f054c085e10 con 0x7f055c06c120 2023-03-03T06:25:13.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.611+0000 7f055affd700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f05480682f0 0x7f054806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:13.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.612+0000 7f055affd700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f05480682f0 0x7f054806a7a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0550000f60 tx=0x7f0550009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:13.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.615+0000 7f05437fe700 1 -- 172.21.15.5:0/3891381685 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f054c052370 con 0x7f055c06c120 2023-03-03T06:25:13.859 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:13.857+0000 7f0561303700 1 -- 172.21.15.5:0/3891381685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f055c0ca120 con 0x7f055c06c120 2023-03-03T06:25:14.463 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.461+0000 7f05437fe700 1 -- 172.21.15.5:0/3891381685 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f055c0ca120 con 0x7f055c06c120 2023-03-03T06:25:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.464+0000 7f0561303700 1 -- 172.21.15.5:0/3891381685 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f05480682f0 msgr2=0x7f054806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.464+0000 7f0561303700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f05480682f0 0x7f054806a7a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0550000f60 tx=0x7f0550009040 comp rx=0 tx=0).stop 2023-03-03T06:25:14.466 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.464+0000 7f0561303700 1 -- 172.21.15.5:0/3891381685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055c06c120 msgr2=0x7f055c0b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.464+0000 7f0561303700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055c06c120 0x7f055c0b4090 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f054c00c7f0 tx=0x7f054c00cbb0 comp rx=0 tx=0).stop 2023-03-03T06:25:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.466+0000 7f0561303700 1 -- 172.21.15.5:0/3891381685 shutdown_connections 2023-03-03T06:25:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.466+0000 7f0561303700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f055c0b8720 0x7f055c158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.466+0000 7f0561303700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f05480682f0 0x7f054806a7a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.466+0000 7f0561303700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f055c06bab0 0x7f055c150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.466+0000 7f0561303700 1 --2- 172.21.15.5:0/3891381685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f055c06c120 0x7f055c0b4090 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:14.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.466+0000 7f0561303700 1 -- 172.21.15.5:0/3891381685 >> 172.21.15.5:0/3891381685 conn(0x7f055c0d0590 msgr2=0x7f055c15a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.466+0000 7f0561303700 1 -- 172.21.15.5:0/3891381685 shutdown_connections 2023-03-03T06:25:14.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.466+0000 7f0561303700 1 -- 172.21.15.5:0/3891381685 wait complete. 2023-03-03T06:25:14.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-03-03T06:25:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.657+0000 7fadd8452700 1 Processor -- start 2023-03-03T06:25:14.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.657+0000 7fadd8452700 1 -- start start 2023-03-03T06:25:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.658+0000 7fadd8452700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadd00cb580 0x7fadd00cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.658+0000 7fadd8452700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fadd00b2250 0x7fadd006b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.658+0000 7fadd8452700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd00cd990 con 0x7fadd00af110 2023-03-03T06:25:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.658+0000 7fadd8452700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd00cdf50 con 0x7fadd00cb580 2023-03-03T06:25:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.658+0000 7fadd8452700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd00cf3f0 con 0x7fadd00b2250 2023-03-03T06:25:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.658+0000 7fadd59ed700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadd00cb580 0x7fadd00cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.658+0000 7fadd59ed700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fadd00cb580 0x7fadd00cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44172/0 (socket says 172.21.15.5:44172) 2023-03-03T06:25:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.658+0000 7fadd59ed700 1 -- 172.21.15.5:0/2218135945 learned_addr learned my addr 172.21.15.5:0/2218135945 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.658+0000 7fadd69ef700 1 --2- 172.21.15.5:0/2218135945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fadd00b2250 0x7fadd006b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.659+0000 7fadd59ed700 1 -- 172.21.15.5:0/2218135945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fadd00b2250 msgr2=0x7fadd006b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.659+0000 7fadd59ed700 1 --2- 172.21.15.5:0/2218135945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fadd00b2250 0x7fadd006b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.659+0000 7fadd59ed700 1 -- 172.21.15.5:0/2218135945 >> v1:172.21.15.191:6789/0 conn(0x7fadd00af110 legacy=0x7fadd00cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.659+0000 7fadd59ed700 1 -- 172.21.15.5:0/2218135945 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd00cf690 con 0x7fadd00cb580 2023-03-03T06:25:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.659+0000 7fadd59ed700 1 --2- 172.21.15.5:0/2218135945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd00cb580 0x7fadd00cd350 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0098f0 tx=0x7fadcc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8707f3ae1b9d6d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.659+0000 7fadd51ec700 1 -- 172.21.15.5:0/2218135945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00b8a0 con 0x7fadd00cb580 2023-03-03T06:25:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.659+0000 7fadd51ec700 1 -- 172.21.15.5:0/2218135945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc00ba00 con 0x7fadd00cb580 2023-03-03T06:25:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.659+0000 7fadd51ec700 1 -- 172.21.15.5:0/2218135945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00bd90 con 0x7fadd00cb580 2023-03-03T06:25:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.659+0000 7fadd8452700 1 -- 172.21.15.5:0/2218135945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd00cb580 msgr2=0x7fadd00cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.659+0000 7fadd8452700 1 --2- 172.21.15.5:0/2218135945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd00cb580 0x7fadd00cd350 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0098f0 tx=0x7fadcc009c00 comp rx=0 tx=0).stop 2023-03-03T06:25:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.660+0000 7fadd8452700 1 -- 172.21.15.5:0/2218135945 shutdown_connections 2023-03-03T06:25:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.660+0000 7fadd8452700 1 --2- 172.21.15.5:0/2218135945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fadd00b2250 0x7fadd006b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.660+0000 7fadd8452700 1 --2- 172.21.15.5:0/2218135945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd00cb580 0x7fadd00cd350 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.660+0000 7fadd8452700 1 -- 172.21.15.5:0/2218135945 >> 172.21.15.5:0/2218135945 conn(0x7fadd00cc840 msgr2=0x7fadd00ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.660+0000 7fadd8452700 1 -- 172.21.15.5:0/2218135945 shutdown_connections 2023-03-03T06:25:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.660+0000 7fadd8452700 1 -- 172.21.15.5:0/2218135945 wait complete. 2023-03-03T06:25:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.661+0000 7fadd8452700 1 Processor -- start 2023-03-03T06:25:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.661+0000 7fadd8452700 1 -- start start 2023-03-03T06:25:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.662+0000 7fadd8452700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fadd00af110 0x7fadd00ad720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.662+0000 7fadd8452700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadd00b2250 0x7fadd0152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.662+0000 7fadd8452700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd00cb580 0x7fadd0151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.662+0000 7fadd8452700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd01e6330 con 0x7fadd00cb580 2023-03-03T06:25:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.662+0000 7fadd8452700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd015d600 con 0x7fadd00b2250 2023-03-03T06:25:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.662+0000 7fadd8452700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd015d8e0 con 0x7fadd00af110 2023-03-03T06:25:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.662+0000 7fadd69ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd00cb580 0x7fadd0151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.662+0000 7fadd69ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd00cb580 0x7fadd0151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44178/0 (socket says 172.21.15.5:44178) 2023-03-03T06:25:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.662+0000 7fadd69ef700 1 -- 172.21.15.5:0/225211448 learned_addr learned my addr 172.21.15.5:0/225211448 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.663+0000 7fadd59ed700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadd00b2250 0x7fadd0152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.663+0000 7fadd61ee700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fadd00af110 0x7fadd00ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.663+0000 7fadd69ef700 1 -- 172.21.15.5:0/225211448 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fadd00af110 msgr2=0x7fadd00ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.663+0000 7fadd69ef700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fadd00af110 0x7fadd00ad720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.663+0000 7fadd69ef700 1 -- 172.21.15.5:0/225211448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadd00b2250 msgr2=0x7fadd0152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.663+0000 7fadd69ef700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadd00b2250 0x7fadd0152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.663+0000 7fadd69ef700 1 -- 172.21.15.5:0/225211448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc009550 con 0x7fadd00cb580 2023-03-03T06:25:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.663+0000 7fadd69ef700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd00cb580 0x7fadd0151540 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fadc8007e40 tx=0x7fadc800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.663+0000 7fadc6ffd700 1 -- 172.21.15.5:0/225211448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800ed30 con 0x7fadd00cb580 2023-03-03T06:25:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.663+0000 7fadc6ffd700 1 -- 172.21.15.5:0/225211448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc8014420 con 0x7fadd00cb580 2023-03-03T06:25:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.663+0000 7fadd8452700 1 -- 172.21.15.5:0/225211448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd00cdbe0 con 0x7fadd00cb580 2023-03-03T06:25:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.663+0000 7fadc6ffd700 1 -- 172.21.15.5:0/225211448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc80147d0 con 0x7fadd00cb580 2023-03-03T06:25:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.663+0000 7fadd8452700 1 -- 172.21.15.5:0/225211448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd006c850 con 0x7fadd00cb580 2023-03-03T06:25:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.664+0000 7fadd8452700 1 -- 172.21.15.5:0/225211448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd006d3d0 con 0x7fadd00cb580 2023-03-03T06:25:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.665+0000 7fadc6ffd700 1 -- 172.21.15.5:0/225211448 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fadc8012050 con 0x7fadd00cb580 2023-03-03T06:25:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.665+0000 7fadc6ffd700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fadb40682f0 0x7fadb406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.665+0000 7fadc6ffd700 1 -- 172.21.15.5:0/225211448 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6821+0+0 (secure 0 0 0) 0x7fadc80865d0 con 0x7fadd00cb580 2023-03-03T06:25:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.665+0000 7fadd61ee700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fadb40682f0 0x7fadb406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.665+0000 7fadd61ee700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fadb40682f0 0x7fadb406a7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fadc0007fd0 tx=0x7fadc0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.669+0000 7fadc6ffd700 1 -- 172.21.15.5:0/225211448 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fadc8052ab0 con 0x7fadd00cb580 2023-03-03T06:25:14.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:14.862+0000 7fadd8452700 1 -- 172.21.15.5:0/225211448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fadd004e6e0 con 0x7fadd00cb580 2023-03-03T06:25:15.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.465+0000 7fadc6ffd700 1 -- 172.21.15.5:0/225211448 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) v1 ==== 181+0+0 (secure 0 0 0) 0x7fadc80560d0 con 0x7fadd00cb580 2023-03-03T06:25:15.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.468+0000 7fadd8452700 1 -- 172.21.15.5:0/225211448 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fadb40682f0 msgr2=0x7fadb406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:15.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.468+0000 7fadd8452700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fadb40682f0 0x7fadb406a7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fadc0007fd0 tx=0x7fadc0009040 comp rx=0 tx=0).stop 2023-03-03T06:25:15.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.468+0000 7fadd8452700 1 -- 172.21.15.5:0/225211448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd00cb580 msgr2=0x7fadd0151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:15.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.468+0000 7fadd8452700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd00cb580 0x7fadd0151540 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fadc8007e40 tx=0x7fadc800e3c0 comp rx=0 tx=0).stop 2023-03-03T06:25:15.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.468+0000 7fadd8452700 1 -- 172.21.15.5:0/225211448 shutdown_connections 2023-03-03T06:25:15.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.469+0000 7fadd8452700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadd00cb580 0x7fadd0151540 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:15.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.469+0000 7fadd8452700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fadb40682f0 0x7fadb406a7a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:15.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.469+0000 7fadd8452700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fadd00af110 0x7fadd00ad720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:15.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.469+0000 7fadd8452700 1 --2- 172.21.15.5:0/225211448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fadd00b2250 0x7fadd0152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:15.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.469+0000 7fadd8452700 1 -- 172.21.15.5:0/225211448 >> 172.21.15.5:0/225211448 conn(0x7fadd00cc840 msgr2=0x7fadd00c6750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:15.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.469+0000 7fadd8452700 1 -- 172.21.15.5:0/225211448 shutdown_connections 2023-03-03T06:25:15.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.469+0000 7fadd8452700 1 -- 172.21.15.5:0/225211448 wait complete. 2023-03-03T06:25:15.473 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-03-03T06:25:15.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-03-03T06:25:15.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.617+0000 7f84a2a7e700 1 Processor -- start 2023-03-03T06:25:15.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.617+0000 7f84a2a7e700 1 -- start start 2023-03-03T06:25:15.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.618+0000 7f84a2a7e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f849c15a530 0x7f849c15a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:15.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.618+0000 7f84a2a7e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849c06e1b0 con 0x7f849c15ae40 2023-03-03T06:25:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.618+0000 7f84a2a7e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849c15b3a0 con 0x7f849c0cb690 2023-03-03T06:25:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.618+0000 7f84a2a7e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c15e410 con 0x7f849c15a530 2023-03-03T06:25:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.618+0000 7f849bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f849c15ae40 0x7f849c0c9db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34030/0 (socket says 172.21.15.5:34030) 2023-03-03T06:25:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.618+0000 7f849bfff700 1 -- 172.21.15.5:0/3460369092 learned_addr learned my addr 172.21.15.5:0/3460369092 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f84a081a700 1 --2- 172.21.15.5:0/3460369092 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f849c15a530 0x7f849c15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284839259 0 0) 0x7f849c06e1b0 con 0x7f849c15ae40 2023-03-03T06:25:15.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f848c0035b0 con 0x7f849c15ae40 2023-03-03T06:25:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1263005451 0 0) 0x7f848c0035b0 con 0x7f849c15ae40 2023-03-03T06:25:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f849c15a530 msgr2=0x7f849c15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 --2- 172.21.15.5:0/3460369092 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f849c15a530 0x7f849c15a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 >> v1:172.21.15.191:6789/0 conn(0x7f849c0cb690 legacy=0x7f849c15e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c15b680 con 0x7f849c15ae40 2023-03-03T06:25:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f8488001670 con 0x7f849c15ae40 2023-03-03T06:25:15.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 >> v1:172.21.15.5:6789/0 conn(0x7f849c15ae40 legacy=0x7f849c0c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 --2- 172.21.15.5:0/3460369092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f848c003a30 0x7f848c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 --2- 172.21.15.5:0/3460369092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f848c004850 0x7f848c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 --2- 172.21.15.5:0/3460369092 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f849c15a530 0x7f848c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c15e410 con 0x7f848c003a30 2023-03-03T06:25:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c00bac0 con 0x7f848c004850 2023-03-03T06:25:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c00bc50 con 0x7f849c15a530 2023-03-03T06:25:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f84a081a700 1 --2- 172.21.15.5:0/3460369092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f848c003a30 0x7f848c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:15.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f849bfff700 1 --2- 172.21.15.5:0/3460369092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f848c004850 0x7f848c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f84a101b700 1 --2- 172.21.15.5:0/3460369092 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f849c15a530 0x7f848c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f84a081a700 1 -- 172.21.15.5:0/3460369092 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f849c15a530 msgr2=0x7f848c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f84a081a700 1 --2- 172.21.15.5:0/3460369092 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f849c15a530 0x7f848c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f84a081a700 1 -- 172.21.15.5:0/3460369092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f848c004850 msgr2=0x7f848c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f84a081a700 1 --2- 172.21.15.5:0/3460369092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f848c004850 0x7f848c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.619+0000 7f84a081a700 1 -- 172.21.15.5:0/3460369092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c0035b0 con 0x7f848c003a30 2023-03-03T06:25:15.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.620+0000 7f84a081a700 1 --2- 172.21.15.5:0/3460369092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f848c003a30 0x7f848c003e40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8490009b60 tx=0x7f848c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb91263c9e896449 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.620+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849000e6c0 con 0x7f848c003a30 2023-03-03T06:25:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.620+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849000e820 con 0x7f848c003a30 2023-03-03T06:25:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.620+0000 7f849b7fe700 1 -- 172.21.15.5:0/3460369092 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849000eb90 con 0x7f848c003a30 2023-03-03T06:25:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.620+0000 7f84a2a7e700 1 -- 172.21.15.5:0/3460369092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f848c003a30 msgr2=0x7f848c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.620+0000 7f84a2a7e700 1 --2- 172.21.15.5:0/3460369092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f848c003a30 0x7f848c003e40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8490009b60 tx=0x7f848c005880 comp rx=0 tx=0).stop 2023-03-03T06:25:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.620+0000 7f84a101b700 1 -- 172.21.15.5:0/3460369092 reap_dead start 2023-03-03T06:25:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.620+0000 7f84a2a7e700 1 -- 172.21.15.5:0/3460369092 shutdown_connections 2023-03-03T06:25:15.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.620+0000 7f84a2a7e700 1 -- 172.21.15.5:0/3460369092 >> 172.21.15.5:0/3460369092 conn(0x7f849c0b1bd0 msgr2=0x7f849c0cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:15.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.620+0000 7f84a2a7e700 1 -- 172.21.15.5:0/3460369092 shutdown_connections 2023-03-03T06:25:15.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.620+0000 7f84a2a7e700 1 -- 172.21.15.5:0/3460369092 wait complete. 2023-03-03T06:25:15.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.622+0000 7f84a2a7e700 1 Processor -- start 2023-03-03T06:25:15.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.622+0000 7f84a2a7e700 1 -- start start 2023-03-03T06:25:15.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.623+0000 7f84a2a7e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f848c003a30 0x7f849c1e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:15.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.623+0000 7f84a2a7e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f849c1e51a0 0x7f849c156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:15.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.623+0000 7f84a2a7e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f849c157e00 0x7f849c1589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:15.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.623+0000 7f84a2a7e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c1e6240 con 0x7f849c157e00 2023-03-03T06:25:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.623+0000 7f84a2a7e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c1e5630 con 0x7f848c003a30 2023-03-03T06:25:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.623+0000 7f84a2a7e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c1e5910 con 0x7f849c1e51a0 2023-03-03T06:25:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.623+0000 7f84a101b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f849c157e00 0x7f849c1589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.623+0000 7f84a101b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f849c157e00 0x7f849c1589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44200/0 (socket says 172.21.15.5:44200) 2023-03-03T06:25:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.623+0000 7f84a101b700 1 -- 172.21.15.5:0/1400101973 learned_addr learned my addr 172.21.15.5:0/1400101973 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.623+0000 7f84a081a700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f848c003a30 0x7f849c1e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.623+0000 7f849bfff700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f849c1e51a0 0x7f849c156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:15.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.624+0000 7f84a101b700 1 -- 172.21.15.5:0/1400101973 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f849c1e51a0 msgr2=0x7f849c156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.624+0000 7f84a101b700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f849c1e51a0 0x7f849c156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.624+0000 7f84a101b700 1 -- 172.21.15.5:0/1400101973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f848c003a30 msgr2=0x7f849c1e66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.624+0000 7f84a101b700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f848c003a30 0x7f849c1e66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.624+0000 7f84a101b700 1 -- 172.21.15.5:0/1400101973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c0ca4c0 con 0x7f849c157e00 2023-03-03T06:25:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.624+0000 7f84a101b700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f849c157e00 0x7f849c1589f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8494000f80 tx=0x7f849400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.624+0000 7f84997fa700 1 -- 172.21.15.5:0/1400101973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494003c10 con 0x7f849c157e00 2023-03-03T06:25:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.624+0000 7f84997fa700 1 -- 172.21.15.5:0/1400101973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8494003d70 con 0x7f849c157e00 2023-03-03T06:25:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.624+0000 7f84a2a7e700 1 -- 172.21.15.5:0/1400101973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849c15b960 con 0x7f849c157e00 2023-03-03T06:25:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.624+0000 7f84997fa700 1 -- 172.21.15.5:0/1400101973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494005310 con 0x7f849c157e00 2023-03-03T06:25:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.624+0000 7f84a2a7e700 1 -- 172.21.15.5:0/1400101973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849c15ef40 con 0x7f849c157e00 2023-03-03T06:25:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.625+0000 7f84a2a7e700 1 -- 172.21.15.5:0/1400101973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849c0b06b0 con 0x7f849c157e00 2023-03-03T06:25:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.626+0000 7f84997fa700 1 -- 172.21.15.5:0/1400101973 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8494005470 con 0x7f849c157e00 2023-03-03T06:25:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.626+0000 7f84997fa700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f84800682f0 0x7f848006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.626+0000 7f84997fa700 1 -- 172.21.15.5:0/1400101973 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6383+0+0 (secure 0 0 0) 0x7f8494085e70 con 0x7f849c157e00 2023-03-03T06:25:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.626+0000 7f84a081a700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f84800682f0 0x7f848006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:15.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.627+0000 7f84a081a700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f84800682f0 0x7f848006a7a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f84900090b0 tx=0x7f8490008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:15.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.634+0000 7f84997fa700 1 -- 172.21.15.5:0/1400101973 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8494052530 con 0x7f849c157e00 2023-03-03T06:25:15.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:15.835+0000 7f84a2a7e700 1 -- 172.21.15.5:0/1400101973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f849c1e6380 con 0x7f849c157e00 2023-03-03T06:25:16.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.467+0000 7f84997fa700 1 -- 172.21.15.5:0/1400101973 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) v1 ==== 169+0+0 (secure 0 0 0) 0x7f849c1e6380 con 0x7f849c157e00 2023-03-03T06:25:16.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.470+0000 7f84a2a7e700 1 -- 172.21.15.5:0/1400101973 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f84800682f0 msgr2=0x7f848006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:16.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.470+0000 7f84a2a7e700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f84800682f0 0x7f848006a7a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f84900090b0 tx=0x7f8490008030 comp rx=0 tx=0).stop 2023-03-03T06:25:16.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.470+0000 7f84a2a7e700 1 -- 172.21.15.5:0/1400101973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f849c157e00 msgr2=0x7f849c1589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:16.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.470+0000 7f84a2a7e700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f849c157e00 0x7f849c1589f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8494000f80 tx=0x7f849400edd0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.470+0000 7f84a2a7e700 1 -- 172.21.15.5:0/1400101973 shutdown_connections 2023-03-03T06:25:16.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.470+0000 7f84a2a7e700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f849c157e00 0x7f849c1589f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.470+0000 7f84a2a7e700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f848c003a30 0x7f849c1e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.470+0000 7f84a2a7e700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f84800682f0 0x7f848006a7a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.470+0000 7f84a2a7e700 1 --2- 172.21.15.5:0/1400101973 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f849c1e51a0 0x7f849c156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.470+0000 7f84a2a7e700 1 -- 172.21.15.5:0/1400101973 >> 172.21.15.5:0/1400101973 conn(0x7f849c0b1bd0 msgr2=0x7f849c0af700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:16.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.470+0000 7f84a2a7e700 1 -- 172.21.15.5:0/1400101973 shutdown_connections 2023-03-03T06:25:16.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.470+0000 7f84a2a7e700 1 -- 172.21.15.5:0/1400101973 wait complete. 2023-03-03T06:25:16.475 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-03-03T06:25:16.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-03-03T06:25:16.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.623+0000 7f27a51e9700 1 Processor -- start 2023-03-03T06:25:16.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.623+0000 7f27a51e9700 1 -- start start 2023-03-03T06:25:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.624+0000 7f27a51e9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27a006bab0 0x7f27a00cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.624+0000 7f27a51e9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27a006c120 0x7f27a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.624+0000 7f27a51e9700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a00d2d60 con 0x7f27a00b8720 2023-03-03T06:25:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.624+0000 7f27a51e9700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a006cae0 con 0x7f27a006bab0 2023-03-03T06:25:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.624+0000 7f27a51e9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00cdd90 con 0x7f27a006c120 2023-03-03T06:25:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.624+0000 7f279e59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27a006bab0 0x7f27a00cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.624+0000 7f279e59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f27a006bab0 0x7f27a00cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44206/0 (socket says 172.21.15.5:44206) 2023-03-03T06:25:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.624+0000 7f279e59c700 1 -- 172.21.15.5:0/2772115363 learned_addr learned my addr 172.21.15.5:0/2772115363 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.624+0000 7f279f59e700 1 --2- 172.21.15.5:0/2772115363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27a006c120 0x7f27a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.624+0000 7f279e59c700 1 -- 172.21.15.5:0/2772115363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27a006c120 msgr2=0x7f27a006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.624+0000 7f279e59c700 1 --2- 172.21.15.5:0/2772115363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27a006c120 0x7f27a006c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.624+0000 7f279e59c700 1 -- 172.21.15.5:0/2772115363 >> v1:172.21.15.191:6789/0 conn(0x7f27a00b8720 legacy=0x7f27a0160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:16.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.624+0000 7f279e59c700 1 -- 172.21.15.5:0/2772115363 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a00cf400 con 0x7f27a006bab0 2023-03-03T06:25:16.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.625+0000 7f279e59c700 1 --2- 172.21.15.5:0/2772115363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a006bab0 0x7f27a00cd850 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f27940098f0 tx=0x7f2794009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3155b43d1e030d3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:16.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.625+0000 7f279dd9b700 1 -- 172.21.15.5:0/2772115363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279400b8a0 con 0x7f27a006bab0 2023-03-03T06:25:16.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.625+0000 7f279dd9b700 1 -- 172.21.15.5:0/2772115363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279400ba00 con 0x7f27a006bab0 2023-03-03T06:25:16.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.625+0000 7f279dd9b700 1 -- 172.21.15.5:0/2772115363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279400bd90 con 0x7f27a006bab0 2023-03-03T06:25:16.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.625+0000 7f27a51e9700 1 -- 172.21.15.5:0/2772115363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a006bab0 msgr2=0x7f27a00cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:16.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.625+0000 7f27a51e9700 1 --2- 172.21.15.5:0/2772115363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a006bab0 0x7f27a00cd850 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f27940098f0 tx=0x7f2794009c00 comp rx=0 tx=0).stop 2023-03-03T06:25:16.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.625+0000 7f27a51e9700 1 -- 172.21.15.5:0/2772115363 shutdown_connections 2023-03-03T06:25:16.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.625+0000 7f27a51e9700 1 --2- 172.21.15.5:0/2772115363 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27a006c120 0x7f27a006c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.625+0000 7f27a51e9700 1 --2- 172.21.15.5:0/2772115363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a006bab0 0x7f27a00cd850 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.625+0000 7f27a51e9700 1 -- 172.21.15.5:0/2772115363 >> 172.21.15.5:0/2772115363 conn(0x7f27a00d0590 msgr2=0x7f27a00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.625+0000 7f27a51e9700 1 -- 172.21.15.5:0/2772115363 shutdown_connections 2023-03-03T06:25:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.625+0000 7f27a51e9700 1 -- 172.21.15.5:0/2772115363 wait complete. 2023-03-03T06:25:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.627+0000 7f27a51e9700 1 Processor -- start 2023-03-03T06:25:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.627+0000 7f27a51e9700 1 -- start start 2023-03-03T06:25:16.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f27a51e9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27a006bab0 0x7f27a0153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f27a51e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a006c120 0x7f27a00cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f27a51e9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a00b8720 0x7f27a0157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f27a51e9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0158430 con 0x7f27a006c120 2023-03-03T06:25:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f27a51e9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00cb950 con 0x7f27a00b8720 2023-03-03T06:25:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f27a51e9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0158670 con 0x7f27a006bab0 2023-03-03T06:25:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f279e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a006c120 0x7f27a00cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:16.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f279e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a006c120 0x7f27a00cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44212/0 (socket says 172.21.15.5:44212) 2023-03-03T06:25:16.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f279e59c700 1 -- 172.21.15.5:0/3243142372 learned_addr learned my addr 172.21.15.5:0/3243142372 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:16.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f279f59e700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a00b8720 0x7f27a0157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:16.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f279ed9d700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27a006bab0 0x7f27a0153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:16.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f279e59c700 1 -- 172.21.15.5:0/3243142372 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27a006bab0 msgr2=0x7f27a0153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:16.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f279e59c700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27a006bab0 0x7f27a0153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f279e59c700 1 -- 172.21.15.5:0/3243142372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a00b8720 msgr2=0x7f27a0157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:16.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f279e59c700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a00b8720 0x7f27a0157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f279e59c700 1 -- 172.21.15.5:0/3243142372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2794009550 con 0x7f27a006c120 2023-03-03T06:25:16.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f279f59e700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a00b8720 0x7f27a0157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:16.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f279e59c700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a006c120 0x7f27a00cacc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2794009c40 tx=0x7f2794004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:16.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f27877fe700 1 -- 172.21.15.5:0/3243142372 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27940036a0 con 0x7f27a006c120 2023-03-03T06:25:16.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.628+0000 7f27877fe700 1 -- 172.21.15.5:0/3243142372 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279401e070 con 0x7f27a006c120 2023-03-03T06:25:16.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.629+0000 7f27a51e9700 1 -- 172.21.15.5:0/3243142372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a00d29f0 con 0x7f27a006c120 2023-03-03T06:25:16.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.629+0000 7f27877fe700 1 -- 172.21.15.5:0/3243142372 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794003a60 con 0x7f27a006c120 2023-03-03T06:25:16.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.629+0000 7f27a51e9700 1 -- 172.21.15.5:0/3243142372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a00cf6e0 con 0x7f27a006c120 2023-03-03T06:25:16.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.629+0000 7f27a51e9700 1 -- 172.21.15.5:0/3243142372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a00b8af0 con 0x7f27a006c120 2023-03-03T06:25:16.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.630+0000 7f27877fe700 1 -- 172.21.15.5:0/3243142372 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f279400f050 con 0x7f27a006c120 2023-03-03T06:25:16.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.630+0000 7f27877fe700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f278c0682f0 0x7f278c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.630+0000 7f27877fe700 1 -- 172.21.15.5:0/3243142372 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f2794020070 con 0x7f27a006c120 2023-03-03T06:25:16.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.630+0000 7f279ed9d700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f278c0682f0 0x7f278c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:16.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.631+0000 7f279ed9d700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f278c0682f0 0x7f278c06a7a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2790000f60 tx=0x7f2790009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:16.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.635+0000 7f27877fe700 1 -- 172.21.15.5:0/3243142372 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2794053940 con 0x7f27a006c120 2023-03-03T06:25:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.843+0000 7f27a51e9700 1 -- 172.21.15.5:0/3243142372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f27a00cbae0 con 0x7f27a006c120 2023-03-03T06:25:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.846+0000 7f27877fe700 1 -- 172.21.15.5:0/3243142372 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2794056f60 con 0x7f27a006c120 2023-03-03T06:25:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.848+0000 7f27a51e9700 1 -- 172.21.15.5:0/3243142372 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f278c0682f0 msgr2=0x7f278c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:16.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.848+0000 7f27a51e9700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f278c0682f0 0x7f278c06a7a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2790000f60 tx=0x7f2790009040 comp rx=0 tx=0).stop 2023-03-03T06:25:16.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.848+0000 7f27a51e9700 1 -- 172.21.15.5:0/3243142372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a006c120 msgr2=0x7f27a00cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:16.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.848+0000 7f27a51e9700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a006c120 0x7f27a00cacc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2794009c40 tx=0x7f2794004750 comp rx=0 tx=0).stop 2023-03-03T06:25:16.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.848+0000 7f27a51e9700 1 -- 172.21.15.5:0/3243142372 shutdown_connections 2023-03-03T06:25:16.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.848+0000 7f27a51e9700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f27a00b8720 0x7f27a0157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.851 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.848+0000 7f27a51e9700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f278c0682f0 0x7f278c06a7a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.848+0000 7f27a51e9700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f27a006bab0 0x7f27a0153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.848+0000 7f27a51e9700 1 --2- 172.21.15.5:0/3243142372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27a006c120 0x7f27a00cacc0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.848+0000 7f27a51e9700 1 -- 172.21.15.5:0/3243142372 >> 172.21.15.5:0/3243142372 conn(0x7f27a00d0590 msgr2=0x7f27a015c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:16.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.848+0000 7f27a51e9700 1 -- 172.21.15.5:0/3243142372 shutdown_connections 2023-03-03T06:25:16.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.848+0000 7f27a51e9700 1 -- 172.21.15.5:0/3243142372 wait complete. 2023-03-03T06:25:16.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-03-03T06:25:16.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.985+0000 7f1100010700 1 Processor -- start 2023-03-03T06:25:16.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.985+0000 7f1100010700 1 -- start start 2023-03-03T06:25:16.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.986+0000 7f1100010700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10f8159550 0x7f10f815dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.986+0000 7f1100010700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f10f80cebc0 0x7f10f80cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.986+0000 7f1100010700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f806e3f0 con 0x7f10f806d1b0 2023-03-03T06:25:16.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.986+0000 7f1100010700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f80cf580 con 0x7f10f80cebc0 2023-03-03T06:25:16.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.986+0000 7f1100010700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f806e6d0 con 0x7f10f8159550 2023-03-03T06:25:16.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.986+0000 7f10fd5ab700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f10f806d1b0 0x7f10f806dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34060/0 (socket says 172.21.15.5:34060) 2023-03-03T06:25:16.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.986+0000 7f10fd5ab700 1 -- 172.21.15.5:0/485048439 learned_addr learned my addr 172.21.15.5:0/485048439 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:16.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.986+0000 7f10fe5ad700 1 --2- 172.21.15.5:0/485048439 >> v2:172.21.15.191:3300/0 conn(0x7f10f80cebc0 0x7f10f80cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:16.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.986+0000 7f10fddac700 1 --2- 172.21.15.5:0/485048439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10f8159550 0x7f10f815dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:16.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.986+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611238197 0 0) 0x7f10f806e3f0 con 0x7f10f806d1b0 2023-03-03T06:25:16.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.986+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10e40035b0 con 0x7f10f806d1b0 2023-03-03T06:25:16.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3062143599 0 0) 0x7f10e40035b0 con 0x7f10f806d1b0 2023-03-03T06:25:16.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10f8159550 msgr2=0x7f10f815dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:16.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 --2- 172.21.15.5:0/485048439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10f8159550 0x7f10f815dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 >> v2:172.21.15.191:3300/0 conn(0x7f10f80cebc0 msgr2=0x7f10f80cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:16.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 --2- 172.21.15.5:0/485048439 >> v2:172.21.15.191:3300/0 conn(0x7f10f80cebc0 0x7f10f80cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f806c6d0 con 0x7f10f806d1b0 2023-03-03T06:25:16.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f10f4001670 con 0x7f10f806d1b0 2023-03-03T06:25:16.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fe5ad700 1 --2- 172.21.15.5:0/485048439 >> v2:172.21.15.191:3300/0 conn(0x7f10f80cebc0 0x7f10f80cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:16.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 >> v1:172.21.15.5:6789/0 conn(0x7f10f806d1b0 legacy=0x7f10f806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:16.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 --2- 172.21.15.5:0/485048439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10f8159550 0x7f10e4003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 --2- 172.21.15.5:0/485048439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e4004040 0x7f10e4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 --2- 172.21.15.5:0/485048439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e4004d90 0x7f10e4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f80cf580 con 0x7f10e4004d90 2023-03-03T06:25:16.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f806e6d0 con 0x7f10e4004040 2023-03-03T06:25:16.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e400ba60 con 0x7f10f8159550 2023-03-03T06:25:16.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fe5ad700 1 --2- 172.21.15.5:0/485048439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e4004d90 0x7f10e4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:16.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fddac700 1 --2- 172.21.15.5:0/485048439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10f8159550 0x7f10e4003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:16.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fd5ab700 1 --2- 172.21.15.5:0/485048439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e4004040 0x7f10e4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:16.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fe5ad700 1 -- 172.21.15.5:0/485048439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10f8159550 msgr2=0x7f10e4003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:16.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fe5ad700 1 --2- 172.21.15.5:0/485048439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10f8159550 0x7f10e4003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fe5ad700 1 -- 172.21.15.5:0/485048439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e4004040 msgr2=0x7f10e4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:16.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fe5ad700 1 --2- 172.21.15.5:0/485048439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e4004040 0x7f10e4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:16.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fe5ad700 1 -- 172.21.15.5:0/485048439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e40035b0 con 0x7f10e4004d90 2023-03-03T06:25:16.994 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.987+0000 7f10fe5ad700 1 --2- 172.21.15.5:0/485048439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e4004d90 0x7f10e4005200 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f10f000e380 tx=0x7f10e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3effe826a9c5d432 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.988+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f000ee20 con 0x7f10e4004d90 2023-03-03T06:25:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.988+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f000f040 con 0x7f10e4004d90 2023-03-03T06:25:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.988+0000 7f10fcdaa700 1 -- 172.21.15.5:0/485048439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f00146a0 con 0x7f10e4004d90 2023-03-03T06:25:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.988+0000 7f1100010700 1 -- 172.21.15.5:0/485048439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e4004d90 msgr2=0x7f10e4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.988+0000 7f1100010700 1 --2- 172.21.15.5:0/485048439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e4004d90 0x7f10e4005200 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f10f000e380 tx=0x7f10e4005880 comp rx=0 tx=0).stop 2023-03-03T06:25:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.988+0000 7f10fe5ad700 1 -- 172.21.15.5:0/485048439 reap_dead start 2023-03-03T06:25:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.988+0000 7f1100010700 1 -- 172.21.15.5:0/485048439 shutdown_connections 2023-03-03T06:25:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.988+0000 7f1100010700 1 -- 172.21.15.5:0/485048439 >> 172.21.15.5:0/485048439 conn(0x7f10f80cfd00 msgr2=0x7f10f80d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:16.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.988+0000 7f1100010700 1 -- 172.21.15.5:0/485048439 shutdown_connections 2023-03-03T06:25:16.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.988+0000 7f1100010700 1 -- 172.21.15.5:0/485048439 wait complete. 2023-03-03T06:25:16.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.989+0000 7f1100010700 1 Processor -- start 2023-03-03T06:25:16.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.989+0000 7f1100010700 1 -- start start 2023-03-03T06:25:16.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.990+0000 7f1100010700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e4004d90 0x7f10f8151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.990+0000 7f1100010700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10f806abc0 0x7f10f806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.990+0000 7f1100010700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f815c080 0x7f10f815c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.990+0000 7f1100010700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f815d8e0 con 0x7f10f815c080 2023-03-03T06:25:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.990+0000 7f1100010700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f806b570 con 0x7f10e4004d90 2023-03-03T06:25:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.990+0000 7f1100010700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f8159c50 con 0x7f10f806abc0 2023-03-03T06:25:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.990+0000 7f10fe5ad700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f815c080 0x7f10f815c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:16.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.990+0000 7f10fe5ad700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f815c080 0x7f10f815c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44234/0 (socket says 172.21.15.5:44234) 2023-03-03T06:25:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.990+0000 7f10fe5ad700 1 -- 172.21.15.5:0/542811522 learned_addr learned my addr 172.21.15.5:0/542811522 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.990+0000 7f10fddac700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e4004d90 0x7f10f8151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.990+0000 7f10fd5ab700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10f806abc0 0x7f10f806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.991+0000 7f10fe5ad700 1 -- 172.21.15.5:0/542811522 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10f806abc0 msgr2=0x7f10f806b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.991+0000 7f10fe5ad700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10f806abc0 0x7f10f806b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:17.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.991+0000 7f10fe5ad700 1 -- 172.21.15.5:0/542811522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e4004d90 msgr2=0x7f10f8151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.991+0000 7f10fe5ad700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e4004d90 0x7f10f8151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.991+0000 7f10fe5ad700 1 -- 172.21.15.5:0/542811522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f806cc90 con 0x7f10f815c080 2023-03-03T06:25:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.991+0000 7f10fe5ad700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f815c080 0x7f10f815c4f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f10f0016000 tx=0x7f10f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.991+0000 7f10ee7fc700 1 -- 172.21.15.5:0/542811522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f00043e0 con 0x7f10f815c080 2023-03-03T06:25:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.991+0000 7f10ee7fc700 1 -- 172.21.15.5:0/542811522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f0004540 con 0x7f10f815c080 2023-03-03T06:25:17.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.991+0000 7f1100010700 1 -- 172.21.15.5:0/542811522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f806c9b0 con 0x7f10f815c080 2023-03-03T06:25:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.991+0000 7f10ee7fc700 1 -- 172.21.15.5:0/542811522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f00048f0 con 0x7f10f815c080 2023-03-03T06:25:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.991+0000 7f1100010700 1 -- 172.21.15.5:0/542811522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f806d600 con 0x7f10f815c080 2023-03-03T06:25:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.992+0000 7f1100010700 1 -- 172.21.15.5:0/542811522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f815ca30 con 0x7f10f815c080 2023-03-03T06:25:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.992+0000 7f10ee7fc700 1 -- 172.21.15.5:0/542811522 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f10f0014480 con 0x7f10f815c080 2023-03-03T06:25:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.993+0000 7f10ee7fc700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f10dc0682f0 0x7f10dc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.993+0000 7f10ee7fc700 1 -- 172.21.15.5:0/542811522 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f10f0087a40 con 0x7f10f815c080 2023-03-03T06:25:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.993+0000 7f10fddac700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f10dc0682f0 0x7f10dc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:17.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.993+0000 7f10fddac700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f10dc0682f0 0x7f10dc06a7a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009c60 tx=0x7f10e8009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:17.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:16.997+0000 7f10ee7fc700 1 -- 172.21.15.5:0/542811522 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f10f0054290 con 0x7f10f815c080 2023-03-03T06:25:17.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.269+0000 7f1100010700 1 -- 172.21.15.5:0/542811522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7f10f806d840 con 0x7f10f815c080 2023-03-03T06:25:17.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:25:17.373 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:25:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.477+0000 7f10ee7fc700 1 -- 172.21.15.5:0/542811522 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v112) v1 ==== 173+0+0 (secure 0 0 0) 0x7f10f00578b0 con 0x7f10f815c080 2023-03-03T06:25:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.479+0000 7f1100010700 1 -- 172.21.15.5:0/542811522 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f10dc0682f0 msgr2=0x7f10dc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.479+0000 7f1100010700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f10dc0682f0 0x7f10dc06a7a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009c60 tx=0x7f10e8009210 comp rx=0 tx=0).stop 2023-03-03T06:25:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.479+0000 7f1100010700 1 -- 172.21.15.5:0/542811522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f815c080 msgr2=0x7f10f815c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.479+0000 7f1100010700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f815c080 0x7f10f815c4f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f10f0016000 tx=0x7f10f0009750 comp rx=0 tx=0).stop 2023-03-03T06:25:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.479+0000 7f1100010700 1 -- 172.21.15.5:0/542811522 shutdown_connections 2023-03-03T06:25:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.479+0000 7f1100010700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10f815c080 0x7f10f815c4f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.479+0000 7f1100010700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10e4004d90 0x7f10f8151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.479+0000 7f1100010700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f10dc0682f0 0x7f10dc06a7a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.479+0000 7f1100010700 1 --2- 172.21.15.5:0/542811522 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10f806abc0 0x7f10f806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.479+0000 7f1100010700 1 -- 172.21.15.5:0/542811522 >> 172.21.15.5:0/542811522 conn(0x7f10f80cfd00 msgr2=0x7f10f80d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.479+0000 7f1100010700 1 -- 172.21.15.5:0/542811522 shutdown_connections 2023-03-03T06:25:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.479+0000 7f1100010700 1 -- 172.21.15.5:0/542811522 wait complete. 2023-03-03T06:25:17.493 INFO:tasks.cephfs_test_runner:test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) ... ok 2023-03-03T06:25:17.494 INFO:tasks.cephfs_test_runner:Starting test: test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-03-03T06:25:17.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-03-03T06:25:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.618+0000 7fd31de67700 1 Processor -- start 2023-03-03T06:25:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.618+0000 7fd31de67700 1 -- start start 2023-03-03T06:25:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.618+0000 7fd31de67700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd31806c830 0x7fd318160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.618+0000 7fd31de67700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd3180cf2a0 0x7fd3180d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.618+0000 7fd31de67700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3180d2e10 con 0x7fd3180b8a40 2023-03-03T06:25:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.618+0000 7fd31de67700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd318161490 con 0x7fd31806c830 2023-03-03T06:25:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.618+0000 7fd31de67700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3180cd8d0 con 0x7fd3180cf2a0 2023-03-03T06:25:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd316ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd31806c830 0x7fd318160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd316ffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd31806c830 0x7fd318160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44240/0 (socket says 172.21.15.5:44240) 2023-03-03T06:25:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd316ffd700 1 -- 172.21.15.5:0/2995017340 learned_addr learned my addr 172.21.15.5:0/2995017340 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd3177fe700 1 --1- 172.21.15.5:0/2995017340 >> v1:172.21.15.5:6789/0 conn(0x7fd3180b8a40 0x7fd31806c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34080/0 (socket says 172.21.15.5:34080) 2023-03-03T06:25:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd316ffd700 1 -- 172.21.15.5:0/2995017340 >> v2:172.21.15.191:3300/0 conn(0x7fd3180cf2a0 msgr2=0x7fd3180d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd317fff700 1 --2- 172.21.15.5:0/2995017340 >> v2:172.21.15.191:3300/0 conn(0x7fd3180cf2a0 0x7fd3180d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd316ffd700 1 --2- 172.21.15.5:0/2995017340 >> v2:172.21.15.191:3300/0 conn(0x7fd3180cf2a0 0x7fd3180d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd316ffd700 1 -- 172.21.15.5:0/2995017340 >> v1:172.21.15.5:6789/0 conn(0x7fd3180b8a40 legacy=0x7fd31806c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd3167fc700 1 -- 172.21.15.5:0/2995017340 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206521529 0 0) 0x7fd308001110 con 0x7fd3180b8a40 2023-03-03T06:25:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd316ffd700 1 -- 172.21.15.5:0/2995017340 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3180d2520 con 0x7fd31806c830 2023-03-03T06:25:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd317fff700 1 --2- 172.21.15.5:0/2995017340 >> v2:172.21.15.191:3300/0 conn(0x7fd3180cf2a0 0x7fd3180d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd316ffd700 1 --2- 172.21.15.5:0/2995017340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31806c830 0x7fd318160f50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd3180b8e10 tx=0x7fd30c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b8052d47db42c0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd3167fc700 1 -- 172.21.15.5:0/2995017340 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c00b870 con 0x7fd31806c830 2023-03-03T06:25:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd3167fc700 1 -- 172.21.15.5:0/2995017340 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c00b9d0 con 0x7fd31806c830 2023-03-03T06:25:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.619+0000 7fd3167fc700 1 -- 172.21.15.5:0/2995017340 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c00bd60 con 0x7fd31806c830 2023-03-03T06:25:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.620+0000 7fd31de67700 1 -- 172.21.15.5:0/2995017340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31806c830 msgr2=0x7fd318160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.620+0000 7fd31de67700 1 --2- 172.21.15.5:0/2995017340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31806c830 0x7fd318160f50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd3180b8e10 tx=0x7fd30c009bd0 comp rx=0 tx=0).stop 2023-03-03T06:25:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.620+0000 7fd31de67700 1 -- 172.21.15.5:0/2995017340 shutdown_connections 2023-03-03T06:25:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.620+0000 7fd31de67700 1 --2- 172.21.15.5:0/2995017340 >> v2:172.21.15.191:3300/0 conn(0x7fd3180cf2a0 0x7fd3180d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.620+0000 7fd31de67700 1 --2- 172.21.15.5:0/2995017340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31806c830 0x7fd318160f50 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.620+0000 7fd31de67700 1 -- 172.21.15.5:0/2995017340 >> 172.21.15.5:0/2995017340 conn(0x7fd3180d05d0 msgr2=0x7fd3180d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.620+0000 7fd31de67700 1 -- 172.21.15.5:0/2995017340 shutdown_connections 2023-03-03T06:25:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.620+0000 7fd31de67700 1 -- 172.21.15.5:0/2995017340 wait complete. 2023-03-03T06:25:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.621+0000 7fd31de67700 1 Processor -- start 2023-03-03T06:25:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.621+0000 7fd31de67700 1 -- start start 2023-03-03T06:25:17.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd31de67700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd31806c830 0x7fd31815d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:17.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd31de67700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3180b8a40 0x7fd318160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:17.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd31de67700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3180cf2a0 0x7fd3181607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:17.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd31de67700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31815d440 con 0x7fd3180b8a40 2023-03-03T06:25:17.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd31de67700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3181f2c40 con 0x7fd3180cf2a0 2023-03-03T06:25:17.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd31de67700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3181f2f20 con 0x7fd31806c830 2023-03-03T06:25:17.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd316ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3180b8a40 0x7fd318160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd316ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3180b8a40 0x7fd318160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44246/0 (socket says 172.21.15.5:44246) 2023-03-03T06:25:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd316ffd700 1 -- 172.21.15.5:0/3991641325 learned_addr learned my addr 172.21.15.5:0/3991641325 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd317fff700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3180cf2a0 0x7fd3181607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd3177fe700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd31806c830 0x7fd31815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd316ffd700 1 -- 172.21.15.5:0/3991641325 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd31806c830 msgr2=0x7fd31815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd316ffd700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd31806c830 0x7fd31815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:17.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd316ffd700 1 -- 172.21.15.5:0/3991641325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3180cf2a0 msgr2=0x7fd3181607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:17.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd316ffd700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3180cf2a0 0x7fd3181607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:17.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd316ffd700 1 -- 172.21.15.5:0/3991641325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c009550 con 0x7fd3180b8a40 2023-03-03T06:25:17.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.622+0000 7fd317fff700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3180cf2a0 0x7fd3181607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:17.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.623+0000 7fd316ffd700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3180b8a40 0x7fd318160280 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd30c000c00 tx=0x7fd30c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:17.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.623+0000 7fd2fffff700 1 -- 172.21.15.5:0/3991641325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c004520 con 0x7fd3180b8a40 2023-03-03T06:25:17.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.623+0000 7fd2fffff700 1 -- 172.21.15.5:0/3991641325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c01e070 con 0x7fd3180b8a40 2023-03-03T06:25:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.623+0000 7fd31de67700 1 -- 172.21.15.5:0/3991641325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3180d2850 con 0x7fd3180b8a40 2023-03-03T06:25:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.623+0000 7fd2fffff700 1 -- 172.21.15.5:0/3991641325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c012900 con 0x7fd3180b8a40 2023-03-03T06:25:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.623+0000 7fd31de67700 1 -- 172.21.15.5:0/3991641325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31815ce30 con 0x7fd3180b8a40 2023-03-03T06:25:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.624+0000 7fd31de67700 1 -- 172.21.15.5:0/3991641325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3180d2b30 con 0x7fd3180b8a40 2023-03-03T06:25:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.624+0000 7fd2fffff700 1 -- 172.21.15.5:0/3991641325 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd30c00f050 con 0x7fd3180b8a40 2023-03-03T06:25:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.625+0000 7fd2fffff700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd3040682f0 0x7fd30406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:17.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.625+0000 7fd3177fe700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd3040682f0 0x7fd30406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.625+0000 7fd2fffff700 1 -- 172.21.15.5:0/3991641325 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fd30c020070 con 0x7fd3180b8a40 2023-03-03T06:25:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.625+0000 7fd3177fe700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd3040682f0 0x7fd30406a7a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd308000f60 tx=0x7fd308007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:17.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.629+0000 7fd2fffff700 1 -- 172.21.15.5:0/3991641325 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd30c053c20 con 0x7fd3180b8a40 2023-03-03T06:25:17.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:17.900+0000 7fd31de67700 1 -- 172.21.15.5:0/3991641325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7fd31815d580 con 0x7fd3180b8a40 2023-03-03T06:25:18.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.479+0000 7fd2fffff700 1 -- 172.21.15.5:0/3991641325 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v113) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd31815d580 con 0x7fd3180b8a40 2023-03-03T06:25:18.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.481+0000 7fd31de67700 1 -- 172.21.15.5:0/3991641325 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd3040682f0 msgr2=0x7fd30406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:18.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.481+0000 7fd31de67700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd3040682f0 0x7fd30406a7a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd308000f60 tx=0x7fd308007a40 comp rx=0 tx=0).stop 2023-03-03T06:25:18.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.481+0000 7fd31de67700 1 -- 172.21.15.5:0/3991641325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3180b8a40 msgr2=0x7fd318160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:18.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.481+0000 7fd31de67700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3180b8a40 0x7fd318160280 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd30c000c00 tx=0x7fd30c004750 comp rx=0 tx=0).stop 2023-03-03T06:25:18.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.481+0000 7fd31de67700 1 -- 172.21.15.5:0/3991641325 shutdown_connections 2023-03-03T06:25:18.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.481+0000 7fd31de67700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3180cf2a0 0x7fd3181607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.481+0000 7fd31de67700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd3040682f0 0x7fd30406a7a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.481+0000 7fd31de67700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd31806c830 0x7fd31815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.481+0000 7fd31de67700 1 --2- 172.21.15.5:0/3991641325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3180b8a40 0x7fd318160280 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.481+0000 7fd31de67700 1 -- 172.21.15.5:0/3991641325 >> 172.21.15.5:0/3991641325 conn(0x7fd3180d05d0 msgr2=0x7fd31806cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.482+0000 7fd31de67700 1 -- 172.21.15.5:0/3991641325 shutdown_connections 2023-03-03T06:25:18.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.482+0000 7fd31de67700 1 -- 172.21.15.5:0/3991641325 wait complete. 2023-03-03T06:25:18.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-03-03T06:25:18.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.636+0000 7f4df0365700 1 Processor -- start 2023-03-03T06:25:18.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.636+0000 7f4df0365700 1 -- start start 2023-03-03T06:25:18.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4df0365700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4de806d560 0x7f4de8159c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:18.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4df0365700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4de80ca1d0 0x7f4de80ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:18.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4df0365700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de815c900 con 0x7f4de80cb7b0 2023-03-03T06:25:18.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4df0365700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de815a1b0 con 0x7f4de806d560 2023-03-03T06:25:18.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4df0365700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de815cbe0 con 0x7f4de80ca1d0 2023-03-03T06:25:18.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4dee101700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4de806d560 0x7f4de8159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:18.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4dee101700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4de806d560 0x7f4de8159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44252/0 (socket says 172.21.15.5:44252) 2023-03-03T06:25:18.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4dee101700 1 -- 172.21.15.5:0/1562228898 learned_addr learned my addr 172.21.15.5:0/1562228898 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4dee902700 1 --2- 172.21.15.5:0/1562228898 >> v2:172.21.15.191:3300/0 conn(0x7f4de80ca1d0 0x7f4de80ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4dee101700 1 -- 172.21.15.5:0/1562228898 >> v2:172.21.15.191:3300/0 conn(0x7f4de80ca1d0 msgr2=0x7f4de80ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4dee101700 1 --2- 172.21.15.5:0/1562228898 >> v2:172.21.15.191:3300/0 conn(0x7f4de80ca1d0 0x7f4de80ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4dee101700 1 -- 172.21.15.5:0/1562228898 >> v1:172.21.15.191:6789/0 conn(0x7f4de80cb7b0 legacy=0x7f4de806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4dee101700 1 -- 172.21.15.5:0/1562228898 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de815cec0 con 0x7f4de806d560 2023-03-03T06:25:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4dee101700 1 --2- 172.21.15.5:0/1562228898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de806d560 0x7f4de8159c70 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4de80c9a80 tx=0x7f4de4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b5ca5f4f1d6e14 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.637+0000 7f4ded0ff700 1 -- 172.21.15.5:0/1562228898 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4010800 con 0x7f4de806d560 2023-03-03T06:25:18.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.638+0000 7f4ded0ff700 1 -- 172.21.15.5:0/1562228898 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de4010960 con 0x7f4de806d560 2023-03-03T06:25:18.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.638+0000 7f4ded0ff700 1 -- 172.21.15.5:0/1562228898 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4010cf0 con 0x7f4de806d560 2023-03-03T06:25:18.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.638+0000 7f4df0365700 1 -- 172.21.15.5:0/1562228898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de806d560 msgr2=0x7f4de8159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:18.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.638+0000 7f4df0365700 1 --2- 172.21.15.5:0/1562228898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de806d560 0x7f4de8159c70 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4de80c9a80 tx=0x7f4de4009bd0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.638+0000 7f4df0365700 1 -- 172.21.15.5:0/1562228898 shutdown_connections 2023-03-03T06:25:18.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.638+0000 7f4df0365700 1 --2- 172.21.15.5:0/1562228898 >> v2:172.21.15.191:3300/0 conn(0x7f4de80ca1d0 0x7f4de80ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.638+0000 7f4df0365700 1 --2- 172.21.15.5:0/1562228898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de806d560 0x7f4de8159c70 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.638+0000 7f4df0365700 1 -- 172.21.15.5:0/1562228898 >> 172.21.15.5:0/1562228898 conn(0x7f4de80b1bd0 msgr2=0x7f4de80cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:18.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.638+0000 7f4df0365700 1 -- 172.21.15.5:0/1562228898 shutdown_connections 2023-03-03T06:25:18.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.638+0000 7f4df0365700 1 -- 172.21.15.5:0/1562228898 wait complete. 2023-03-03T06:25:18.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.640+0000 7f4df0365700 1 Processor -- start 2023-03-03T06:25:18.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.640+0000 7f4df0365700 1 -- start start 2023-03-03T06:25:18.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4df0365700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de806d560 0x7f4de8151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:18.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4df0365700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de80ca1d0 0x7f4de8157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:18.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4df0365700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de80cb7b0 0x7f4de80b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:18.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4df0365700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de81583d0 con 0x7f4de80cb7b0 2023-03-03T06:25:18.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4df0365700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de815a390 con 0x7f4de806d560 2023-03-03T06:25:18.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4df0365700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de815a670 con 0x7f4de80ca1d0 2023-03-03T06:25:18.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4dee902700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de80cb7b0 0x7f4de80b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:18.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4dee902700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de80cb7b0 0x7f4de80b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44260/0 (socket says 172.21.15.5:44260) 2023-03-03T06:25:18.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4dee902700 1 -- 172.21.15.5:0/1178680188 learned_addr learned my addr 172.21.15.5:0/1178680188 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:18.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4ded900700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de80ca1d0 0x7f4de8157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:18.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4dee101700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de806d560 0x7f4de8151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:18.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4dee902700 1 -- 172.21.15.5:0/1178680188 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de80ca1d0 msgr2=0x7f4de8157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:18.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4dee902700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de80ca1d0 0x7f4de8157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4dee902700 1 -- 172.21.15.5:0/1178680188 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de806d560 msgr2=0x7f4de8151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:18.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4dee902700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de806d560 0x7f4de8151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.641+0000 7f4dee902700 1 -- 172.21.15.5:0/1178680188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4009550 con 0x7f4de80cb7b0 2023-03-03T06:25:18.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.642+0000 7f4dee902700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de80cb7b0 0x7f4de80b3730 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4de000efc0 tx=0x7f4de000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:18.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.642+0000 7f4ddeffd700 1 -- 172.21.15.5:0/1178680188 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de0009ea0 con 0x7f4de80cb7b0 2023-03-03T06:25:18.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.642+0000 7f4ddeffd700 1 -- 172.21.15.5:0/1178680188 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de000f040 con 0x7f4de80cb7b0 2023-03-03T06:25:18.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.642+0000 7f4ddeffd700 1 -- 172.21.15.5:0/1178680188 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000ced0 con 0x7f4de80cb7b0 2023-03-03T06:25:18.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.642+0000 7f4df0365700 1 -- 172.21.15.5:0/1178680188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de815d480 con 0x7f4de80cb7b0 2023-03-03T06:25:18.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.642+0000 7f4df0365700 1 -- 172.21.15.5:0/1178680188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de815d1a0 con 0x7f4de80cb7b0 2023-03-03T06:25:18.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.643+0000 7f4df0365700 1 -- 172.21.15.5:0/1178680188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de8158f40 con 0x7f4de80cb7b0 2023-03-03T06:25:18.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.643+0000 7f4ddeffd700 1 -- 172.21.15.5:0/1178680188 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4de0014480 con 0x7f4de80cb7b0 2023-03-03T06:25:18.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.643+0000 7f4ddeffd700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4dcc0682f0 0x7f4dcc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:18.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.643+0000 7f4ddeffd700 1 -- 172.21.15.5:0/1178680188 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f4de0086560 con 0x7f4de80cb7b0 2023-03-03T06:25:18.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.644+0000 7f4dee101700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4dcc0682f0 0x7f4dcc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:18.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.644+0000 7f4dee101700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4dcc0682f0 0x7f4dcc06a7a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009c10 tx=0x7f4de401b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:18.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.648+0000 7f4ddeffd700 1 -- 172.21.15.5:0/1178680188 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4de0052db0 con 0x7f4de80cb7b0 2023-03-03T06:25:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.841+0000 7f4df0365700 1 -- 172.21.15.5:0/1178680188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4de815ab30 con 0x7f4de80cb7b0 2023-03-03T06:25:18.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.845+0000 7f4ddeffd700 1 -- 172.21.15.5:0/1178680188 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v13)=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4de00563d0 con 0x7f4de80cb7b0 2023-03-03T06:25:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.847+0000 7f4df0365700 1 -- 172.21.15.5:0/1178680188 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4dcc0682f0 msgr2=0x7f4dcc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.847+0000 7f4df0365700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4dcc0682f0 0x7f4dcc06a7a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009c10 tx=0x7f4de401b040 comp rx=0 tx=0).stop 2023-03-03T06:25:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.847+0000 7f4df0365700 1 -- 172.21.15.5:0/1178680188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de80cb7b0 msgr2=0x7f4de80b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.847+0000 7f4df0365700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de80cb7b0 0x7f4de80b3730 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4de000efc0 tx=0x7f4de000c3a0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.847+0000 7f4df0365700 1 -- 172.21.15.5:0/1178680188 shutdown_connections 2023-03-03T06:25:18.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.847+0000 7f4df0365700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de80cb7b0 0x7f4de80b3730 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.847+0000 7f4df0365700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4de806d560 0x7f4de8151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.847+0000 7f4df0365700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4dcc0682f0 0x7f4dcc06a7a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.847+0000 7f4df0365700 1 --2- 172.21.15.5:0/1178680188 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4de80ca1d0 0x7f4de8157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:18.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.847+0000 7f4df0365700 1 -- 172.21.15.5:0/1178680188 >> 172.21.15.5:0/1178680188 conn(0x7f4de80b1bd0 msgr2=0x7f4de80cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:18.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.847+0000 7f4df0365700 1 -- 172.21.15.5:0/1178680188 shutdown_connections 2023-03-03T06:25:18.850 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:18.847+0000 7f4df0365700 1 -- 172.21.15.5:0/1178680188 wait complete. 2023-03-03T06:25:18.861 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-03-03T06:25:18.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:25:18.906 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:25:18.951 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-03-03T06:25:18.952 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:25:18.952 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:18.969 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287360k,nr_inodes=4071840,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19712 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-03-03T06:25:18.970 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:25:18.970 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:18.989 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-03-03T06:25:18.990 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:25:18.990 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:19.026 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287360k,nr_inodes=4071840,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19712 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-03-03T06:25:19.027 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:25:19.027 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:19.048 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-03-03T06:25:19.049 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-03-03T06:25:19.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.189+0000 7fc461f0c700 1 Processor -- start 2023-03-03T06:25:19.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.189+0000 7fc461f0c700 1 -- start start 2023-03-03T06:25:19.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.190+0000 7fc461f0c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc45c15a480 0x7fc45c0d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:19.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.190+0000 7fc461f0c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc45c0cb4a0 0x7fc45c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:19.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.190+0000 7fc461f0c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45c0cbcd0 con 0x7fc45c15a850 2023-03-03T06:25:19.195 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.190+0000 7fc461f0c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45c0cf2a0 con 0x7fc45c15a480 2023-03-03T06:25:19.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.190+0000 7fc461f0c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c0cb9f0 con 0x7fc45c0cb4a0 2023-03-03T06:25:19.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.190+0000 7fc45b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc45c15a480 0x7fc45c0d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:19.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.190+0000 7fc45affd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc45c15a850 0x7fc45c0b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34108/0 (socket says 172.21.15.5:34108) 2023-03-03T06:25:19.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.190+0000 7fc45affd700 1 -- 172.21.15.5:0/632277317 learned_addr learned my addr 172.21.15.5:0/632277317 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:19.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.191+0000 7fc45bfff700 1 --2- 172.21.15.5:0/632277317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc45c0cb4a0 0x7fc45c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:19.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.191+0000 7fc45b7fe700 1 -- 172.21.15.5:0/632277317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc45c0cb4a0 msgr2=0x7fc45c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:19.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.191+0000 7fc45b7fe700 1 --2- 172.21.15.5:0/632277317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc45c0cb4a0 0x7fc45c0cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:19.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.191+0000 7fc45b7fe700 1 -- 172.21.15.5:0/632277317 >> v1:172.21.15.5:6789/0 conn(0x7fc45c15a850 legacy=0x7fc45c0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:19.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.191+0000 7fc45b7fe700 1 -- 172.21.15.5:0/632277317 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c0cebe0 con 0x7fc45c15a480 2023-03-03T06:25:19.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.191+0000 7fc45a7fc700 1 -- 172.21.15.5:0/632277317 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22442823 0 0) 0x7fc45c0cbcd0 con 0x7fc45c15a850 2023-03-03T06:25:19.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.191+0000 7fc45b7fe700 1 --2- 172.21.15.5:0/632277317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc45c15a480 0x7fc45c0d1600 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009870 tx=0x7fc44c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857c56cab65d0a80 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:19.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.191+0000 7fc45a7fc700 1 -- 172.21.15.5:0/632277317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c011830 con 0x7fc45c15a480 2023-03-03T06:25:19.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.191+0000 7fc45a7fc700 1 -- 172.21.15.5:0/632277317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c011990 con 0x7fc45c15a480 2023-03-03T06:25:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.191+0000 7fc45a7fc700 1 -- 172.21.15.5:0/632277317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c011d20 con 0x7fc45c15a480 2023-03-03T06:25:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.191+0000 7fc461f0c700 1 -- 172.21.15.5:0/632277317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc45c15a480 msgr2=0x7fc45c0d1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.191+0000 7fc461f0c700 1 --2- 172.21.15.5:0/632277317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc45c15a480 0x7fc45c0d1600 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009870 tx=0x7fc44c009b80 comp rx=0 tx=0).stop 2023-03-03T06:25:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.192+0000 7fc461f0c700 1 -- 172.21.15.5:0/632277317 shutdown_connections 2023-03-03T06:25:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.192+0000 7fc461f0c700 1 --2- 172.21.15.5:0/632277317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc45c0cb4a0 0x7fc45c0cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.192+0000 7fc461f0c700 1 --2- 172.21.15.5:0/632277317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc45c15a480 0x7fc45c0d1600 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.192+0000 7fc461f0c700 1 -- 172.21.15.5:0/632277317 >> 172.21.15.5:0/632277317 conn(0x7fc45c06f3c0 msgr2=0x7fc45c06f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:19.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.192+0000 7fc461f0c700 1 -- 172.21.15.5:0/632277317 shutdown_connections 2023-03-03T06:25:19.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.192+0000 7fc461f0c700 1 -- 172.21.15.5:0/632277317 wait complete. 2023-03-03T06:25:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.193+0000 7fc461f0c700 1 Processor -- start 2023-03-03T06:25:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.193+0000 7fc461f0c700 1 -- start start 2023-03-03T06:25:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc461f0c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc45c0cb4a0 0x7fc45c150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc461f0c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc45c15a480 0x7fc45c147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc461f0c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc45c15a850 0x7fc45c156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:19.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc461f0c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c153fd0 con 0x7fc45c15a850 2023-03-03T06:25:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc461f0c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c153400 con 0x7fc45c0cb4a0 2023-03-03T06:25:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc461f0c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c1536a0 con 0x7fc45c15a480 2023-03-03T06:25:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc45bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc45c15a850 0x7fc45c156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc45bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc45c15a850 0x7fc45c156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44274/0 (socket says 172.21.15.5:44274) 2023-03-03T06:25:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc45bfff700 1 -- 172.21.15.5:0/60018436 learned_addr learned my addr 172.21.15.5:0/60018436 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc45affd700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc45c15a480 0x7fc45c147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:19.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc45b7fe700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc45c0cb4a0 0x7fc45c150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc45bfff700 1 -- 172.21.15.5:0/60018436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc45c15a480 msgr2=0x7fc45c147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc45bfff700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc45c15a480 0x7fc45c147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc45bfff700 1 -- 172.21.15.5:0/60018436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc45c0cb4a0 msgr2=0x7fc45c150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc45bfff700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc45c0cb4a0 0x7fc45c150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc45bfff700 1 -- 172.21.15.5:0/60018436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c0094a0 con 0x7fc45c15a850 2023-03-03T06:25:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc45bfff700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc45c15a850 0x7fc45c156fc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc454009fd0 tx=0x7fc45400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:19.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc453fff700 1 -- 172.21.15.5:0/60018436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45400ede0 con 0x7fc45c15a850 2023-03-03T06:25:19.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc453fff700 1 -- 172.21.15.5:0/60018436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc454014420 con 0x7fc45c15a850 2023-03-03T06:25:19.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc461f0c700 1 -- 172.21.15.5:0/60018436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45c0b43b0 con 0x7fc45c15a850 2023-03-03T06:25:19.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.194+0000 7fc453fff700 1 -- 172.21.15.5:0/60018436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4540147d0 con 0x7fc45c15a850 2023-03-03T06:25:19.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.195+0000 7fc461f0c700 1 -- 172.21.15.5:0/60018436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c0ceec0 con 0x7fc45c15a850 2023-03-03T06:25:19.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.195+0000 7fc461f0c700 1 -- 172.21.15.5:0/60018436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45c066840 con 0x7fc45c15a850 2023-03-03T06:25:19.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.196+0000 7fc453fff700 1 -- 172.21.15.5:0/60018436 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc454012050 con 0x7fc45c15a850 2023-03-03T06:25:19.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.196+0000 7fc453fff700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc43c0682f0 0x7fc43c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:19.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.196+0000 7fc453fff700 1 -- 172.21.15.5:0/60018436 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fc454086290 con 0x7fc45c15a850 2023-03-03T06:25:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.196+0000 7fc45b7fe700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc43c0682f0 0x7fc43c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.197+0000 7fc45b7fe700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc43c0682f0 0x7fc43c06a7a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0090b0 tx=0x7fc44c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.201+0000 7fc453fff700 1 -- 172.21.15.5:0/60018436 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc45c066840 con 0x7fc45c15a850 2023-03-03T06:25:19.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.442+0000 7fc461f0c700 1 -- 172.21.15.5:0/60018436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc45c066840 con 0x7fc45c15a850 2023-03-03T06:25:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.442+0000 7fc453fff700 1 -- 172.21.15.5:0/60018436 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fc45c066840 con 0x7fc45c15a850 2023-03-03T06:25:19.445 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:19.445 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/1485137346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1485137346},{"type":"v1","addr":"172.21.15.191:6834","nonce":1485137346}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4886,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2062075895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2062075895},{"type":"v1","addr":"172.21.15.5:6837","nonce":2062075895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/3463336232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":3463336232},{"type":"v1","addr":"172.21.15.191:6835","nonce":3463336232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/4201803696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":4201803696},{"type":"v1","addr":"172.21.15.5:6836","nonce":4201803696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-03-03T06:25:19.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.444+0000 7fc461f0c700 1 -- 172.21.15.5:0/60018436 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc43c0682f0 msgr2=0x7fc43c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:19.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.444+0000 7fc461f0c700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc43c0682f0 0x7fc43c06a7a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0090b0 tx=0x7fc44c008030 comp rx=0 tx=0).stop 2023-03-03T06:25:19.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.444+0000 7fc461f0c700 1 -- 172.21.15.5:0/60018436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc45c15a850 msgr2=0x7fc45c156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:19.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.444+0000 7fc461f0c700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc45c15a850 0x7fc45c156fc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc454009fd0 tx=0x7fc45400e3c0 comp rx=0 tx=0).stop 2023-03-03T06:25:19.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.444+0000 7fc461f0c700 1 -- 172.21.15.5:0/60018436 shutdown_connections 2023-03-03T06:25:19.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.444+0000 7fc461f0c700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc45c15a850 0x7fc45c156fc0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:19.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.444+0000 7fc461f0c700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc45c0cb4a0 0x7fc45c150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.444+0000 7fc461f0c700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc43c0682f0 0x7fc43c06a7a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.444+0000 7fc461f0c700 1 --2- 172.21.15.5:0/60018436 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc45c15a480 0x7fc45c147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.444+0000 7fc461f0c700 1 -- 172.21.15.5:0/60018436 >> 172.21.15.5:0/60018436 conn(0x7fc45c06f3c0 msgr2=0x7fc45c06f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.444+0000 7fc461f0c700 1 -- 172.21.15.5:0/60018436 shutdown_connections 2023-03-03T06:25:19.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.444+0000 7fc461f0c700 1 -- 172.21.15.5:0/60018436 wait complete. 2023-03-03T06:25:19.449 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 19 2023-03-03T06:25:19.459 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-03T06:25:19.459 INFO:tasks.ceph.mds.a:Stopping old one... 2023-03-03T06:25:19.460 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-03-03T06:25:19.460 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:25:19.460 INFO:tasks.ceph.mds.c:Restarting daemon 2023-03-03T06:25:19.461 INFO:tasks.ceph.mds.c:Stopping old one... 2023-03-03T06:25:19.461 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-03-03T06:25:19.461 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:25:19.461 INFO:tasks.ceph.mds.b:Restarting daemon 2023-03-03T06:25:19.461 INFO:tasks.ceph.mds.b:Stopping old one... 2023-03-03T06:25:19.462 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-03-03T06:25:19.462 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:25:19.462 INFO:tasks.ceph.mds.d:Restarting daemon 2023-03-03T06:25:19.462 INFO:tasks.ceph.mds.d:Stopping old one... 2023-03-03T06:25:19.463 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-03-03T06:25:19.463 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:25:19.469 INFO:tasks.ceph.mds.a:Stopped 2023-03-03T06:25:19.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-03T06:25:19.471 INFO:tasks.ceph.mds.c:Stopped 2023-03-03T06:25:19.471 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-03-03T06:25:19.473 INFO:tasks.ceph.mds.b:Stopped 2023-03-03T06:25:19.473 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-03-03T06:25:19.474 INFO:tasks.ceph.mds.d:Stopped 2023-03-03T06:25:19.474 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-03-03T06:25:19.512 INFO:tasks.ceph.mds.a:Started 2023-03-03T06:25:19.513 DEBUG:teuthology.parallel:result is None 2023-03-03T06:25:19.514 INFO:tasks.ceph.mds.c:Started 2023-03-03T06:25:19.514 DEBUG:teuthology.parallel:result is None 2023-03-03T06:25:19.515 INFO:tasks.ceph.mds.b:Started 2023-03-03T06:25:19.515 DEBUG:teuthology.parallel:result is None 2023-03-03T06:25:19.516 INFO:tasks.ceph.mds.d:Started 2023-03-03T06:25:19.516 DEBUG:teuthology.parallel:result is None 2023-03-03T06:25:19.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-03-03T06:25:19.594 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-03-03T06:25:19.594 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-03-03T06:25:19.600 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-03-03T06:25:19.601 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-03-03T06:25:19.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.650+0000 7f74d21a1700 1 Processor -- start 2023-03-03T06:25:19.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.650+0000 7f74d21a1700 1 -- start start 2023-03-03T06:25:19.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.651+0000 7f74d21a1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74cc0b1f80 0x7f74cc0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.651+0000 7f74d21a1700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74cc06b590 con 0x7f74cc0af450 2023-03-03T06:25:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.651+0000 7f74d21a1700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74cc06b870 con 0x7f74cc0af080 2023-03-03T06:25:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.651+0000 7f74d21a1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74cc06bb50 con 0x7f74cc0b1f80 2023-03-03T06:25:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.651+0000 7f74cbfff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f74cc0b1f80 0x7f74cc0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.651+0000 7f74caffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f74cc0af450 0x7f74cc0cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34146/0 (socket says 172.21.15.5:34146) 2023-03-03T06:25:19.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.651+0000 7f74caffd700 1 -- 172.21.15.5:0/1081601913 learned_addr learned my addr 172.21.15.5:0/1081601913 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.651+0000 7f74cbfff700 1 -- 172.21.15.5:0/1081601913 >> v1:172.21.15.191:6789/0 conn(0x7f74cc0af080 legacy=0x7f74cc0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.651+0000 7f74cbfff700 1 -- 172.21.15.5:0/1081601913 >> v1:172.21.15.5:6789/0 conn(0x7f74cc0af450 legacy=0x7f74cc0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.651+0000 7f74ca7fc700 1 -- 172.21.15.5:0/1081601913 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18006449 0 0) 0x7f74cc06b590 con 0x7f74cc0af450 2023-03-03T06:25:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.651+0000 7f74cbfff700 1 -- 172.21.15.5:0/1081601913 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc06be30 con 0x7f74cc0b1f80 2023-03-03T06:25:19.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.652+0000 7f74cbfff700 1 --2- 172.21.15.5:0/1081601913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc0b1f80 0x7f74cc0cd350 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009d90 tx=0x7f74c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fadd4d97c2fc2d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:19.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.652+0000 7f74ca7fc700 1 -- 172.21.15.5:0/1081601913 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c400e070 con 0x7f74cc0b1f80 2023-03-03T06:25:19.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.652+0000 7f74ca7fc700 1 -- 172.21.15.5:0/1081601913 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c400bb90 con 0x7f74cc0b1f80 2023-03-03T06:25:19.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.652+0000 7f74ca7fc700 1 -- 172.21.15.5:0/1081601913 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c4003a20 con 0x7f74cc0b1f80 2023-03-03T06:25:19.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.652+0000 7f74d21a1700 1 -- 172.21.15.5:0/1081601913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc0b1f80 msgr2=0x7f74cc0cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:19.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.652+0000 7f74d21a1700 1 --2- 172.21.15.5:0/1081601913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc0b1f80 0x7f74cc0cd350 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009d90 tx=0x7f74c400b330 comp rx=0 tx=0).stop 2023-03-03T06:25:19.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.652+0000 7f74d21a1700 1 -- 172.21.15.5:0/1081601913 shutdown_connections 2023-03-03T06:25:19.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.652+0000 7f74d21a1700 1 --2- 172.21.15.5:0/1081601913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc0b1f80 0x7f74cc0cd350 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:19.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.652+0000 7f74d21a1700 1 -- 172.21.15.5:0/1081601913 >> 172.21.15.5:0/1081601913 conn(0x7f74cc06ea70 msgr2=0x7f74cc0cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:19.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.652+0000 7f74d21a1700 1 -- 172.21.15.5:0/1081601913 shutdown_connections 2023-03-03T06:25:19.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.652+0000 7f74d21a1700 1 -- 172.21.15.5:0/1081601913 wait complete. 2023-03-03T06:25:19.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.653+0000 7f74d21a1700 1 Processor -- start 2023-03-03T06:25:19.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.654+0000 7f74d21a1700 1 -- start start 2023-03-03T06:25:19.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.654+0000 7f74d21a1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc0af080 0x7f74cc15e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:19.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.654+0000 7f74d21a1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74cc0af450 0x7f74cc156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:19.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.654+0000 7f74d21a1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74cc0b1f80 0x7f74cc0c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:19.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.654+0000 7f74d21a1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc0ad9b0 con 0x7f74cc0af080 2023-03-03T06:25:19.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.654+0000 7f74d21a1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc15e590 con 0x7f74cc0af450 2023-03-03T06:25:19.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.654+0000 7f74d21a1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc15f400 con 0x7f74cc0b1f80 2023-03-03T06:25:19.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.654+0000 7f74cb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc0af080 0x7f74cc15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:19.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74cb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc0af080 0x7f74cc15e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44308/0 (socket says 172.21.15.5:44308) 2023-03-03T06:25:19.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74cb7fe700 1 -- 172.21.15.5:0/2964933588 learned_addr learned my addr 172.21.15.5:0/2964933588 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:19.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74caffd700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74cc0af450 0x7f74cc156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:19.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74cbfff700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74cc0b1f80 0x7f74cc0c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:19.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74cb7fe700 1 -- 172.21.15.5:0/2964933588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74cc0b1f80 msgr2=0x7f74cc0c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:19.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74cb7fe700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74cc0b1f80 0x7f74cc0c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:19.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74cb7fe700 1 -- 172.21.15.5:0/2964933588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74cc0af450 msgr2=0x7f74cc156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:19.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74cb7fe700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74cc0af450 0x7f74cc156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:19.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74cb7fe700 1 -- 172.21.15.5:0/2964933588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c4009a70 con 0x7f74cc0af080 2023-03-03T06:25:19.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74caffd700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74cc0af450 0x7f74cc156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:19.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74cbfff700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74cc0b1f80 0x7f74cc0c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:19.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74cb7fe700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc0af080 0x7f74cc15e050 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f74c000c4a0 tx=0x7f74c000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:19.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74b3fff700 1 -- 172.21.15.5:0/2964933588 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c00054e0 con 0x7f74cc0af080 2023-03-03T06:25:19.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74b3fff700 1 -- 172.21.15.5:0/2964933588 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c0003680 con 0x7f74cc0af080 2023-03-03T06:25:19.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74d21a1700 1 -- 172.21.15.5:0/2964933588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74cc06d370 con 0x7f74cc0af080 2023-03-03T06:25:19.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74b3fff700 1 -- 172.21.15.5:0/2964933588 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0003a30 con 0x7f74cc0af080 2023-03-03T06:25:19.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.655+0000 7f74d21a1700 1 -- 172.21.15.5:0/2964933588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc06c110 con 0x7f74cc0af080 2023-03-03T06:25:19.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.656+0000 7f74d21a1700 1 -- 172.21.15.5:0/2964933588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc06cb70 con 0x7f74cc0af080 2023-03-03T06:25:19.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.657+0000 7f74b3fff700 1 -- 172.21.15.5:0/2964933588 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f74c0019030 con 0x7f74cc0af080 2023-03-03T06:25:19.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.657+0000 7f74b3fff700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f74b80682f0 0x7f74b806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:19.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.657+0000 7f74b3fff700 1 -- 172.21.15.5:0/2964933588 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f74c0085030 con 0x7f74cc0af080 2023-03-03T06:25:19.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.657+0000 7f74caffd700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f74b80682f0 0x7f74b806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:19.665 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.658+0000 7f74caffd700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f74b80682f0 0x7f74b806a7a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0add50 tx=0x7f74bc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:19.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.662+0000 7f74b3fff700 1 -- 172.21.15.5:0/2964933588 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f74c00518e0 con 0x7f74cc0af080 2023-03-03T06:25:19.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:19.874+0000 7f74d21a1700 1 -- 172.21.15.5:0/2964933588 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f74cc0c77b0 con 0x7f74cc0af080 2023-03-03T06:25:20.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.642+0000 7f74b3fff700 1 -- 172.21.15.5:0/2964933588 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v52) v1 ==== 97+0+0 (secure 0 0 0) 0x7f74c0017080 con 0x7f74cc0af080 2023-03-03T06:25:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.645+0000 7f74d21a1700 1 -- 172.21.15.5:0/2964933588 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f74b80682f0 msgr2=0x7f74b806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.645+0000 7f74d21a1700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f74b80682f0 0x7f74b806a7a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0add50 tx=0x7f74bc009040 comp rx=0 tx=0).stop 2023-03-03T06:25:20.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.645+0000 7f74d21a1700 1 -- 172.21.15.5:0/2964933588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc0af080 msgr2=0x7f74cc15e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.645+0000 7f74d21a1700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc0af080 0x7f74cc15e050 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f74c000c4a0 tx=0x7f74c000c860 comp rx=0 tx=0).stop 2023-03-03T06:25:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.645+0000 7f74d21a1700 1 -- 172.21.15.5:0/2964933588 shutdown_connections 2023-03-03T06:25:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.645+0000 7f74d21a1700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f74b80682f0 0x7f74b806a7a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.645+0000 7f74d21a1700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74cc0b1f80 0x7f74cc0c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.645+0000 7f74d21a1700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74cc0af080 0x7f74cc15e050 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.645+0000 7f74d21a1700 1 --2- 172.21.15.5:0/2964933588 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f74cc0af450 0x7f74cc156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:20.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.645+0000 7f74d21a1700 1 -- 172.21.15.5:0/2964933588 >> 172.21.15.5:0/2964933588 conn(0x7f74cc06ea70 msgr2=0x7f74cc0cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.645+0000 7f74d21a1700 1 -- 172.21.15.5:0/2964933588 shutdown_connections 2023-03-03T06:25:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.645+0000 7f74d21a1700 1 -- 172.21.15.5:0/2964933588 wait complete. 2023-03-03T06:25:20.649 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-03-03T06:25:20.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-03-03T06:25:20.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.796+0000 7ff89675d700 1 Processor -- start 2023-03-03T06:25:20.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.796+0000 7ff89675d700 1 -- start start 2023-03-03T06:25:20.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.797+0000 7ff89675d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff89015a7d0 0x7ff8900c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:20.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.797+0000 7ff89675d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8900cb690 0x7ff89015ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:20.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.797+0000 7ff89675d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89015e580 con 0x7ff89015ef50 2023-03-03T06:25:20.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.797+0000 7ff89675d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8900ca710 con 0x7ff8900cb690 2023-03-03T06:25:20.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.797+0000 7ff89675d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900ca9f0 con 0x7ff89015a7d0 2023-03-03T06:25:20.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.797+0000 7ff88f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8900cb690 0x7ff89015ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:20.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.797+0000 7ff88f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff8900cb690 0x7ff89015ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44322/0 (socket says 172.21.15.5:44322) 2023-03-03T06:25:20.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.797+0000 7ff88f7fe700 1 -- 172.21.15.5:0/1026915016 learned_addr learned my addr 172.21.15.5:0/1026915016 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:20.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.798+0000 7ff88ffff700 1 --2- 172.21.15.5:0/1026915016 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff89015a7d0 0x7ff8900c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:20.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.798+0000 7ff88f7fe700 1 -- 172.21.15.5:0/1026915016 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff89015a7d0 msgr2=0x7ff8900c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:20.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.798+0000 7ff88f7fe700 1 --2- 172.21.15.5:0/1026915016 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff89015a7d0 0x7ff8900c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:20.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.798+0000 7ff88f7fe700 1 -- 172.21.15.5:0/1026915016 >> v1:172.21.15.191:6789/0 conn(0x7ff89015ef50 legacy=0x7ff89006a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:20.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.798+0000 7ff88f7fe700 1 -- 172.21.15.5:0/1026915016 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8900cacd0 con 0x7ff8900cb690 2023-03-03T06:25:20.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.798+0000 7ff88f7fe700 1 --2- 172.21.15.5:0/1026915016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900cb690 0x7ff89015ea10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff8800098f0 tx=0x7ff880009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9888d2559b30f538 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:20.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.798+0000 7ff88effd700 1 -- 172.21.15.5:0/1026915016 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88000b8a0 con 0x7ff8900cb690 2023-03-03T06:25:20.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.798+0000 7ff88effd700 1 -- 172.21.15.5:0/1026915016 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88000ba00 con 0x7ff8900cb690 2023-03-03T06:25:20.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.798+0000 7ff88effd700 1 -- 172.21.15.5:0/1026915016 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88000bd90 con 0x7ff8900cb690 2023-03-03T06:25:20.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.799+0000 7ff89675d700 1 -- 172.21.15.5:0/1026915016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900cb690 msgr2=0x7ff89015ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:20.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.799+0000 7ff89675d700 1 --2- 172.21.15.5:0/1026915016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900cb690 0x7ff89015ea10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff8800098f0 tx=0x7ff880009c00 comp rx=0 tx=0).stop 2023-03-03T06:25:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.799+0000 7ff89675d700 1 -- 172.21.15.5:0/1026915016 shutdown_connections 2023-03-03T06:25:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.799+0000 7ff89675d700 1 --2- 172.21.15.5:0/1026915016 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff89015a7d0 0x7ff8900c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.799+0000 7ff89675d700 1 --2- 172.21.15.5:0/1026915016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8900cb690 0x7ff89015ea10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.799+0000 7ff89675d700 1 -- 172.21.15.5:0/1026915016 >> 172.21.15.5:0/1026915016 conn(0x7ff8900cf4b0 msgr2=0x7ff8900cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.799+0000 7ff89675d700 1 -- 172.21.15.5:0/1026915016 shutdown_connections 2023-03-03T06:25:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.799+0000 7ff89675d700 1 -- 172.21.15.5:0/1026915016 wait complete. 2023-03-03T06:25:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.800+0000 7ff89675d700 1 Processor -- start 2023-03-03T06:25:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.800+0000 7ff89675d700 1 -- start start 2023-03-03T06:25:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff89675d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8900cb690 0x7ff8901f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff89675d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff89015a7d0 0x7ff8900c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff89675d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015ef50 0x7ff8900c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff89675d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900c3aa0 con 0x7ff89015ef50 2023-03-03T06:25:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff89675d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900c4ef0 con 0x7ff8900cb690 2023-03-03T06:25:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff89675d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8900c5190 con 0x7ff89015a7d0 2023-03-03T06:25:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff894cfa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015ef50 0x7ff8900c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff894cfa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015ef50 0x7ff8900c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44328/0 (socket says 172.21.15.5:44328) 2023-03-03T06:25:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff894cfa700 1 -- 172.21.15.5:0/43780885 learned_addr learned my addr 172.21.15.5:0/43780885 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff88ffff700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8900cb690 0x7ff8901f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff88f7fe700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff89015a7d0 0x7ff8900c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff894cfa700 1 -- 172.21.15.5:0/43780885 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff89015a7d0 msgr2=0x7ff8900c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff894cfa700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff89015a7d0 0x7ff8900c2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff894cfa700 1 -- 172.21.15.5:0/43780885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8900cb690 msgr2=0x7ff8901f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff894cfa700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8900cb690 0x7ff8901f3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff894cfa700 1 -- 172.21.15.5:0/43780885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff880009550 con 0x7ff89015ef50 2023-03-03T06:25:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.801+0000 7ff894cfa700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015ef50 0x7ff8900c8750 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff88800cb50 tx=0x7ff88800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.802+0000 7ff88cff9700 1 -- 172.21.15.5:0/43780885 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888003c00 con 0x7ff89015ef50 2023-03-03T06:25:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.802+0000 7ff88cff9700 1 -- 172.21.15.5:0/43780885 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff888003d60 con 0x7ff89015ef50 2023-03-03T06:25:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.802+0000 7ff89675d700 1 -- 172.21.15.5:0/43780885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8900ca400 con 0x7ff89015ef50 2023-03-03T06:25:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.802+0000 7ff88cff9700 1 -- 172.21.15.5:0/43780885 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88800ab70 con 0x7ff89015ef50 2023-03-03T06:25:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.802+0000 7ff89675d700 1 -- 172.21.15.5:0/43780885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89015e210 con 0x7ff89015ef50 2023-03-03T06:25:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.803+0000 7ff89675d700 1 -- 172.21.15.5:0/43780885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89006aa40 con 0x7ff89015ef50 2023-03-03T06:25:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.803+0000 7ff88cff9700 1 -- 172.21.15.5:0/43780885 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff888010050 con 0x7ff89015ef50 2023-03-03T06:25:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.804+0000 7ff88cff9700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff8700682f0 0x7ff87006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.804+0000 7ff88cff9700 1 -- 172.21.15.5:0/43780885 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5883+0+0 (secure 0 0 0) 0x7ff888085aa0 con 0x7ff89015ef50 2023-03-03T06:25:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.804+0000 7ff88ffff700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff8700682f0 0x7ff87006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.804+0000 7ff88ffff700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff8700682f0 0x7ff87006a7a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff8900c3e00 tx=0x7ff878008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:20.808+0000 7ff88cff9700 1 -- 172.21.15.5:0/43780885 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff8880523b0 con 0x7ff89015ef50 2023-03-03T06:25:21.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.081+0000 7ff89675d700 1 -- 172.21.15.5:0/43780885 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff89004e6e0 con 0x7ff89015ef50 2023-03-03T06:25:21.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.081+0000 7ff88cff9700 1 -- 172.21.15.5:0/43780885 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5298 (secure 0 0 0) 0x7ff8880559d0 con 0x7ff89015ef50 2023-03-03T06:25:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:21.084 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-03-03T06:25:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-03-03T06:25:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-03-03T06:25:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkziqmKRAARZXnnbV545/aKwJvt9QAgw==", 2023-03-03T06:25:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:25:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:25:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-03-03T06:25:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkYP9KNhAA/yyEBoBn/eJ8/6mufuiznQ==", 2023-03-03T06:25:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:25:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:25:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-03-03T06:25:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFk23MbMRAA1E6lR036GpHdLG9WAVzE2A==", 2023-03-03T06:25:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:25:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:25:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-03-03T06:25:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFkQYUSAhAAt9Hj4Yq5VW5NJENi11Gsag==", 2023-03-03T06:25:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:25:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:25:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-03-03T06:25:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7kgFkiS2tKRAAuYbICLnn3CQtdepNk9uG7Q==", 2023-03-03T06:25:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-03-03T06:25:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA+kgFkpDf4KBAA77yBycaKiSFdrCP9F0C5IA==", 2023-03-03T06:25:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-03-03T06:25:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBkgFk/OK7JxAAQFCaUo0b/+8gDkgP1Ifqwg==", 2023-03-03T06:25:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-03-03T06:25:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEkgFkhcBFJxAA3Q62rulwQRz9/VZeV938sg==", 2023-03-03T06:25:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-03-03T06:25:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKkgFkHSO9KBAATkFiqiMet/gmDP9rNTozLA==", 2023-03-03T06:25:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-03-03T06:25:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBNkgFkOUmVJxAA4gVwSp2IhnyXKPt+72wXOw==", 2023-03-03T06:25:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-03-03T06:25:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBQkgFkBHsSJxAA0kN0Sob1BvksDKPj4e/yTA==", 2023-03-03T06:25:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-03-03T06:25:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBTkgFkusR5JhAAsvEY2m5hImRjdFSqtEFVBw==", 2023-03-03T06:25:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-03-03T06:25:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFkkZyRBhAA/Q44zwMnP6p4QwYJUCk0Ow==", 2023-03-03T06:25:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-03-03T06:25:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw pool=cephfs_data" 2023-03-03T06:25:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-03-03T06:25:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFke8dHDRAA5tXiSg31lHzCfcffU+ycDw==", 2023-03-03T06:25:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-03-03T06:25:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-03-03T06:25:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-03-03T06:25:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-03-03T06:25:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFk6W3zCRAAMk0SzOs1po/kkiSR41EAbA==", 2023-03-03T06:25:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-03-03T06:25:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-03-03T06:25:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-03-03T06:25:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-03-03T06:25:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFk4NGTEBAAQne/fOUfeZe1sWAZXnJ5Cw==", 2023-03-03T06:25:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-03-03T06:25:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-03-03T06:25:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-03-03T06:25:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-03-03T06:25:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkrhMlDBAAIRxVSXIMLiI0L4p+Odt4AA==", 2023-03-03T06:25:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-03-03T06:25:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:25:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:25:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-03-03T06:25:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkRHQbJhAAq2ZAqxUiXeNQLLcfaVvj7g==", 2023-03-03T06:25:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-03-03T06:25:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-03-03T06:25:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-03-03T06:25:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFktxgZIhAAsvbF/OzJf4OZ7a85LkWKtw==", 2023-03-03T06:25:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-03-03T06:25:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-03-03T06:25:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-03-03T06:25:21.108 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-03-03T06:25:21.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.083+0000 7ff89675d700 1 -- 172.21.15.5:0/43780885 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff8700682f0 msgr2=0x7ff87006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.083+0000 7ff89675d700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff8700682f0 0x7ff87006a7a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff8900c3e00 tx=0x7ff878008040 comp rx=0 tx=0).stop 2023-03-03T06:25:21.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.083+0000 7ff89675d700 1 -- 172.21.15.5:0/43780885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015ef50 msgr2=0x7ff8900c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.083+0000 7ff89675d700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015ef50 0x7ff8900c8750 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff88800cb50 tx=0x7ff88800cf10 comp rx=0 tx=0).stop 2023-03-03T06:25:21.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.083+0000 7ff89675d700 1 -- 172.21.15.5:0/43780885 shutdown_connections 2023-03-03T06:25:21.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.083+0000 7ff89675d700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff89015ef50 0x7ff8900c8750 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.083+0000 7ff89675d700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8900cb690 0x7ff8901f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.083+0000 7ff89675d700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff8700682f0 0x7ff87006a7a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.083+0000 7ff89675d700 1 --2- 172.21.15.5:0/43780885 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff89015a7d0 0x7ff8900c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.083+0000 7ff89675d700 1 -- 172.21.15.5:0/43780885 >> 172.21.15.5:0/43780885 conn(0x7ff8900cf4b0 msgr2=0x7ff89006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:21.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.083+0000 7ff89675d700 1 -- 172.21.15.5:0/43780885 shutdown_connections 2023-03-03T06:25:21.110 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.083+0000 7ff89675d700 1 -- 172.21.15.5:0/43780885 wait complete. 2023-03-03T06:25:21.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:21.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.234+0000 7f1c48415700 1 Processor -- start 2023-03-03T06:25:21.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.234+0000 7f1c48415700 1 -- start start 2023-03-03T06:25:21.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.235+0000 7f1c48415700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1c401573f0 0x7f1c4015d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.235+0000 7f1c48415700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c400b18d0 0x7f1c400b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.235+0000 7f1c48415700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c401577c0 con 0x7f1c400cc1a0 2023-03-03T06:25:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.235+0000 7f1c48415700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c400cd790 con 0x7f1c401573f0 2023-03-03T06:25:21.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.235+0000 7f1c48415700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40159e60 con 0x7f1c400b18d0 2023-03-03T06:25:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.235+0000 7f1c459b0700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1c400cc1a0 0x7f1c400cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34176/0 (socket says 172.21.15.5:34176) 2023-03-03T06:25:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.235+0000 7f1c459b0700 1 -- 172.21.15.5:0/3697747688 learned_addr learned my addr 172.21.15.5:0/3697747688 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c469b2700 1 --2- 172.21.15.5:0/3697747688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c400b18d0 0x7f1c400b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c461b1700 1 --2- 172.21.15.5:0/3697747688 >> v2:172.21.15.191:3300/0 conn(0x7f1c401573f0 0x7f1c4015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920562920 0 0) 0x7f1c401577c0 con 0x7f1c400cc1a0 2023-03-03T06:25:21.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c2c0035b0 con 0x7f1c400cc1a0 2023-03-03T06:25:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321593278 0 0) 0x7f1c2c0035b0 con 0x7f1c400cc1a0 2023-03-03T06:25:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c400b18d0 msgr2=0x7f1c400b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 --2- 172.21.15.5:0/3697747688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c400b18d0 0x7f1c400b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 >> v2:172.21.15.191:3300/0 conn(0x7f1c401573f0 msgr2=0x7f1c4015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 --2- 172.21.15.5:0/3697747688 >> v2:172.21.15.191:3300/0 conn(0x7f1c401573f0 0x7f1c4015d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c400b2250 con 0x7f1c400cc1a0 2023-03-03T06:25:21.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f1c3c0017f0 con 0x7f1c400cc1a0 2023-03-03T06:25:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 >> v1:172.21.15.5:6789/0 conn(0x7f1c400cc1a0 legacy=0x7f1c400cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 --2- 172.21.15.5:0/3697747688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c400b18d0 0x7f1c2c003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 --2- 172.21.15.5:0/3697747688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c2c003ff0 0x7f1c2c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 --2- 172.21.15.5:0/3697747688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2c004d90 0x7f1c2c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400cd790 con 0x7f1c2c004d90 2023-03-03T06:25:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40159e60 con 0x7f1c2c003ff0 2023-03-03T06:25:21.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c00ba10 con 0x7f1c400b18d0 2023-03-03T06:25:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c461b1700 1 --2- 172.21.15.5:0/3697747688 >> v2:172.21.15.191:3300/0 conn(0x7f1c401573f0 0x7f1c4015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c469b2700 1 --2- 172.21.15.5:0/3697747688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2c004d90 0x7f1c2c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c459b0700 1 --2- 172.21.15.5:0/3697747688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c2c003ff0 0x7f1c2c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.236+0000 7f1c461b1700 1 --2- 172.21.15.5:0/3697747688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c400b18d0 0x7f1c2c003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c469b2700 1 -- 172.21.15.5:0/3697747688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c400b18d0 msgr2=0x7f1c2c003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c469b2700 1 --2- 172.21.15.5:0/3697747688 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c400b18d0 0x7f1c2c003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c469b2700 1 -- 172.21.15.5:0/3697747688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c2c003ff0 msgr2=0x7f1c2c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c469b2700 1 --2- 172.21.15.5:0/3697747688 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c2c003ff0 0x7f1c2c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c469b2700 1 -- 172.21.15.5:0/3697747688 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c0035b0 con 0x7f1c2c004d90 2023-03-03T06:25:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c469b2700 1 --2- 172.21.15.5:0/3697747688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2c004d90 0x7f1c2c005200 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800e170 tx=0x7f1c2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e971383a6a83f200 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3800ec90 con 0x7f1c2c004d90 2023-03-03T06:25:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3800f040 con 0x7f1c2c004d90 2023-03-03T06:25:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c451af700 1 -- 172.21.15.5:0/3697747688 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38014480 con 0x7f1c2c004d90 2023-03-03T06:25:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c48415700 1 -- 172.21.15.5:0/3697747688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2c004d90 msgr2=0x7f1c2c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c48415700 1 --2- 172.21.15.5:0/3697747688 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c2c004d90 0x7f1c2c005200 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800e170 tx=0x7f1c2c005880 comp rx=0 tx=0).stop 2023-03-03T06:25:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c469b2700 1 -- 172.21.15.5:0/3697747688 reap_dead start 2023-03-03T06:25:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c48415700 1 -- 172.21.15.5:0/3697747688 shutdown_connections 2023-03-03T06:25:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.237+0000 7f1c48415700 1 -- 172.21.15.5:0/3697747688 >> 172.21.15.5:0/3697747688 conn(0x7f1c400cc8d0 msgr2=0x7f1c400cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.238+0000 7f1c48415700 1 -- 172.21.15.5:0/3697747688 shutdown_connections 2023-03-03T06:25:21.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.238+0000 7f1c48415700 1 -- 172.21.15.5:0/3697747688 wait complete. 2023-03-03T06:25:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.239+0000 7f1c48415700 1 Processor -- start 2023-03-03T06:25:21.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.239+0000 7f1c48415700 1 -- start start 2023-03-03T06:25:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c48415700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c2c004d90 0x7f1c401f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c48415700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c40149bb0 0x7f1c40149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c48415700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c400c8600 0x7f1c400b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c48415700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400c3980 con 0x7f1c400c8600 2023-03-03T06:25:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c48415700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400c6fb0 con 0x7f1c2c004d90 2023-03-03T06:25:21.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c48415700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c401f0720 con 0x7f1c40149bb0 2023-03-03T06:25:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c469b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c400c8600 0x7f1c400b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c469b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c400c8600 0x7f1c400b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44348/0 (socket says 172.21.15.5:44348) 2023-03-03T06:25:21.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c469b2700 1 -- 172.21.15.5:0/1355332730 learned_addr learned my addr 172.21.15.5:0/1355332730 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c461b1700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c2c004d90 0x7f1c401f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c459b0700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c40149bb0 0x7f1c40149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c469b2700 1 -- 172.21.15.5:0/1355332730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c40149bb0 msgr2=0x7f1c40149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c469b2700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c40149bb0 0x7f1c40149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c469b2700 1 -- 172.21.15.5:0/1355332730 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c2c004d90 msgr2=0x7f1c401f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c469b2700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c2c004d90 0x7f1c401f0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c469b2700 1 -- 172.21.15.5:0/1355332730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4015d900 con 0x7f1c400c8600 2023-03-03T06:25:21.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c469b2700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c400c8600 0x7f1c400b4e90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1c38016000 tx=0x7f1c38009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:21.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c36ffd700 1 -- 172.21.15.5:0/1355332730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38007000 con 0x7f1c400c8600 2023-03-03T06:25:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c36ffd700 1 -- 172.21.15.5:0/1355332730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c38004470 con 0x7f1c400c8600 2023-03-03T06:25:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c48415700 1 -- 172.21.15.5:0/1355332730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c400ce460 con 0x7f1c400c8600 2023-03-03T06:25:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c36ffd700 1 -- 172.21.15.5:0/1355332730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38004860 con 0x7f1c400c8600 2023-03-03T06:25:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.240+0000 7f1c48415700 1 -- 172.21.15.5:0/1355332730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4015dbe0 con 0x7f1c400c8600 2023-03-03T06:25:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.241+0000 7f1c48415700 1 -- 172.21.15.5:0/1355332730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c400c7250 con 0x7f1c400c8600 2023-03-03T06:25:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.242+0000 7f1c36ffd700 1 -- 172.21.15.5:0/1355332730 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1c38014480 con 0x7f1c400c8600 2023-03-03T06:25:21.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.242+0000 7f1c36ffd700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1c240682f0 0x7f1c2406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.242+0000 7f1c36ffd700 1 -- 172.21.15.5:0/1355332730 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5883+0+0 (secure 0 0 0) 0x7f1c38087bd0 con 0x7f1c400c8600 2023-03-03T06:25:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.242+0000 7f1c461b1700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1c240682f0 0x7f1c2406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.243+0000 7f1c461b1700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1c240682f0 0x7f1c2406a7a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009cc0 tx=0x7f1c30008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:21.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.247+0000 7f1c36ffd700 1 -- 172.21.15.5:0/1355332730 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1c38054480 con 0x7f1c400c8600 2023-03-03T06:25:21.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.438+0000 7f1c48415700 1 -- 172.21.15.5:0/1355332730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c4004e6e0 con 0x7f1c400c8600 2023-03-03T06:25:21.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.440+0000 7f1c36ffd700 1 -- 172.21.15.5:0/1355332730 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16019 (secure 0 0 0) 0x7f1c38057aa0 con 0x7f1c400c8600 2023-03-03T06:25:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:21.442 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":52,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:20.639189+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:21.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.442+0000 7f1c48415700 1 -- 172.21.15.5:0/1355332730 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1c240682f0 msgr2=0x7f1c2406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.442+0000 7f1c48415700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1c240682f0 0x7f1c2406a7a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009cc0 tx=0x7f1c30008040 comp rx=0 tx=0).stop 2023-03-03T06:25:21.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.442+0000 7f1c48415700 1 -- 172.21.15.5:0/1355332730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c400c8600 msgr2=0x7f1c400b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.442+0000 7f1c48415700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c400c8600 0x7f1c400b4e90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1c38016000 tx=0x7f1c38009750 comp rx=0 tx=0).stop 2023-03-03T06:25:21.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.442+0000 7f1c48415700 1 -- 172.21.15.5:0/1355332730 shutdown_connections 2023-03-03T06:25:21.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.442+0000 7f1c48415700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c400c8600 0x7f1c400b4e90 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.442+0000 7f1c48415700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1c2c004d90 0x7f1c401f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.442+0000 7f1c48415700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1c240682f0 0x7f1c2406a7a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.442+0000 7f1c48415700 1 --2- 172.21.15.5:0/1355332730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1c40149bb0 0x7f1c40149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.442+0000 7f1c48415700 1 -- 172.21.15.5:0/1355332730 >> 172.21.15.5:0/1355332730 conn(0x7f1c400cc8d0 msgr2=0x7f1c4015d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:21.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.442+0000 7f1c48415700 1 -- 172.21.15.5:0/1355332730 shutdown_connections 2023-03-03T06:25:21.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.442+0000 7f1c48415700 1 -- 172.21.15.5:0/1355332730 wait complete. 2023-03-03T06:25:21.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'snap-test-pool', 'create_time': '2023-03-03T06:25:02.648527+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T06:25:21.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:25:21.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.585+0000 7fc4c0e19700 1 Processor -- start 2023-03-03T06:25:21.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.585+0000 7fc4c0e19700 1 -- start start 2023-03-03T06:25:21.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4c0e19700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc4bc0b8720 0x7fc4bc06bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4c0e19700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc4bc0cd850 0x7fc4bc160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4c0e19700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc0d2d60 con 0x7fc4bc06c120 2023-03-03T06:25:21.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4c0e19700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc1612d0 con 0x7fc4bc0b8720 2023-03-03T06:25:21.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4c0e19700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc0cf400 con 0x7fc4bc0cd850 2023-03-03T06:25:21.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4ba59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc4bc0b8720 0x7fc4bc06bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4bad9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc4bc06c120 0x7fc4bc0d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34196/0 (socket says 172.21.15.5:34196) 2023-03-03T06:25:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4bad9d700 1 -- 172.21.15.5:0/669018231 learned_addr learned my addr 172.21.15.5:0/669018231 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4b9d9b700 1 --2- 172.21.15.5:0/669018231 >> v2:172.21.15.191:3300/0 conn(0x7fc4bc0cd850 0x7fc4bc160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4ba59c700 1 -- 172.21.15.5:0/669018231 >> v2:172.21.15.191:3300/0 conn(0x7fc4bc0cd850 msgr2=0x7fc4bc160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4ba59c700 1 --2- 172.21.15.5:0/669018231 >> v2:172.21.15.191:3300/0 conn(0x7fc4bc0cd850 0x7fc4bc160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4ba59c700 1 -- 172.21.15.5:0/669018231 >> v1:172.21.15.5:6789/0 conn(0x7fc4bc06c120 legacy=0x7fc4bc0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4b959a700 1 -- 172.21.15.5:0/669018231 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562646332 0 0) 0x7fc4bc0d2d60 con 0x7fc4bc06c120 2023-03-03T06:25:21.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.586+0000 7fc4ba59c700 1 -- 172.21.15.5:0/669018231 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0cf6e0 con 0x7fc4bc0b8720 2023-03-03T06:25:21.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.587+0000 7fc4ba59c700 1 --2- 172.21.15.5:0/669018231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0b8720 0x7fc4bc06bab0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc06b860 tx=0x7fc4ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d66f8bab125187 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:21.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.587+0000 7fc4b959a700 1 -- 172.21.15.5:0/669018231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00e070 con 0x7fc4bc0b8720 2023-03-03T06:25:21.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.587+0000 7fc4b959a700 1 -- 172.21.15.5:0/669018231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac00bbd0 con 0x7fc4bc0b8720 2023-03-03T06:25:21.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.587+0000 7fc4b959a700 1 -- 172.21.15.5:0/669018231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac012430 con 0x7fc4bc0b8720 2023-03-03T06:25:21.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.587+0000 7fc4c0e19700 1 -- 172.21.15.5:0/669018231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0b8720 msgr2=0x7fc4bc06bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.587+0000 7fc4c0e19700 1 --2- 172.21.15.5:0/669018231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0b8720 0x7fc4bc06bab0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc06b860 tx=0x7fc4ac00b330 comp rx=0 tx=0).stop 2023-03-03T06:25:21.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.587+0000 7fc4c0e19700 1 -- 172.21.15.5:0/669018231 shutdown_connections 2023-03-03T06:25:21.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.587+0000 7fc4c0e19700 1 --2- 172.21.15.5:0/669018231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0b8720 0x7fc4bc06bab0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.587+0000 7fc4c0e19700 1 --2- 172.21.15.5:0/669018231 >> v2:172.21.15.191:3300/0 conn(0x7fc4bc0cd850 0x7fc4bc160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.587+0000 7fc4c0e19700 1 -- 172.21.15.5:0/669018231 >> 172.21.15.5:0/669018231 conn(0x7fc4bc0d0590 msgr2=0x7fc4bc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:21.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.587+0000 7fc4c0e19700 1 -- 172.21.15.5:0/669018231 shutdown_connections 2023-03-03T06:25:21.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.587+0000 7fc4c0e19700 1 -- 172.21.15.5:0/669018231 wait complete. 2023-03-03T06:25:21.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.589+0000 7fc4c0e19700 1 Processor -- start 2023-03-03T06:25:21.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.589+0000 7fc4c0e19700 1 -- start start 2023-03-03T06:25:21.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.590+0000 7fc4c0e19700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc06c120 0x7fc4bc14b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.590+0000 7fc4c0e19700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4bc0b8720 0x7fc4bc0cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.590+0000 7fc4c0e19700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0cd850 0x7fc4bc0ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.590+0000 7fc4c0e19700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc14ba00 con 0x7fc4bc0cd850 2023-03-03T06:25:21.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.590+0000 7fc4c0e19700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0caf00 con 0x7fc4bc0b8720 2023-03-03T06:25:21.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.590+0000 7fc4c0e19700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0cb1e0 con 0x7fc4bc06c120 2023-03-03T06:25:21.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.590+0000 7fc4bad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0cd850 0x7fc4bc0ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.590+0000 7fc4bad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0cd850 0x7fc4bc0ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44360/0 (socket says 172.21.15.5:44360) 2023-03-03T06:25:21.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.590+0000 7fc4bad9d700 1 -- 172.21.15.5:0/978123483 learned_addr learned my addr 172.21.15.5:0/978123483 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:21.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.590+0000 7fc4b9d9b700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4bc0b8720 0x7fc4bc0cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.591+0000 7fc4ba59c700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc06c120 0x7fc4bc14b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.591+0000 7fc4bad9d700 1 -- 172.21.15.5:0/978123483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc06c120 msgr2=0x7fc4bc14b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.591+0000 7fc4bad9d700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc06c120 0x7fc4bc14b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.591+0000 7fc4bad9d700 1 -- 172.21.15.5:0/978123483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4bc0b8720 msgr2=0x7fc4bc0cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.591+0000 7fc4bad9d700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4bc0b8720 0x7fc4bc0cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.591+0000 7fc4bad9d700 1 -- 172.21.15.5:0/978123483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac009a70 con 0x7fc4bc0cd850 2023-03-03T06:25:21.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.591+0000 7fc4ba59c700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc06c120 0x7fc4bc14b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:21.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.591+0000 7fc4bad9d700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0cd850 0x7fc4bc0ccb10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400c480 tx=0x7fc4b400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:21.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.591+0000 7fc4b2ffd700 1 -- 172.21.15.5:0/978123483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4004c80 con 0x7fc4bc0cd850 2023-03-03T06:25:21.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.591+0000 7fc4b2ffd700 1 -- 172.21.15.5:0/978123483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b4004e00 con 0x7fc4bc0cd850 2023-03-03T06:25:21.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.591+0000 7fc4c0e19700 1 -- 172.21.15.5:0/978123483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc0cdcc0 con 0x7fc4bc0cd850 2023-03-03T06:25:21.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.591+0000 7fc4b2ffd700 1 -- 172.21.15.5:0/978123483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4007310 con 0x7fc4bc0cd850 2023-03-03T06:25:21.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.591+0000 7fc4c0e19700 1 -- 172.21.15.5:0/978123483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc0d29f0 con 0x7fc4bc0cd850 2023-03-03T06:25:21.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.592+0000 7fc4c0e19700 1 -- 172.21.15.5:0/978123483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc0b8af0 con 0x7fc4bc0cd850 2023-03-03T06:25:21.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.592+0000 7fc4b2ffd700 1 -- 172.21.15.5:0/978123483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc4b401a020 con 0x7fc4bc0cd850 2023-03-03T06:25:21.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.593+0000 7fc4b2ffd700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc49c0682f0 0x7fc49c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.593+0000 7fc4b2ffd700 1 -- 172.21.15.5:0/978123483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5883+0+0 (secure 0 0 0) 0x7fc4b4085660 con 0x7fc4bc0cd850 2023-03-03T06:25:21.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.593+0000 7fc4ba59c700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc49c0682f0 0x7fc49c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.593+0000 7fc4ba59c700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc49c0682f0 0x7fc49c06a7a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac014040 tx=0x7fc4ac011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:21.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.597+0000 7fc4b2ffd700 1 -- 172.21.15.5:0/978123483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc4b4051f70 con 0x7fc4bc0cd850 2023-03-03T06:25:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.790+0000 7fc4c0e19700 1 -- 172.21.15.5:0/978123483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc4bc04e6e0 con 0x7fc4bc0cd850 2023-03-03T06:25:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.790+0000 7fc4b2ffd700 1 -- 172.21.15.5:0/978123483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc4b4055590 con 0x7fc4bc0cd850 2023-03-03T06:25:21.793 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:25:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.792+0000 7fc4c0e19700 1 -- 172.21.15.5:0/978123483 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc49c0682f0 msgr2=0x7fc49c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.792+0000 7fc4c0e19700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc49c0682f0 0x7fc49c06a7a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac014040 tx=0x7fc4ac011000 comp rx=0 tx=0).stop 2023-03-03T06:25:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.792+0000 7fc4c0e19700 1 -- 172.21.15.5:0/978123483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0cd850 msgr2=0x7fc4bc0ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.792+0000 7fc4c0e19700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0cd850 0x7fc4bc0ccb10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400c480 tx=0x7fc4b400c790 comp rx=0 tx=0).stop 2023-03-03T06:25:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.792+0000 7fc4c0e19700 1 -- 172.21.15.5:0/978123483 shutdown_connections 2023-03-03T06:25:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.792+0000 7fc4c0e19700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4bc0cd850 0x7fc4bc0ccb10 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.792+0000 7fc4c0e19700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc49c0682f0 0x7fc49c06a7a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.792+0000 7fc4c0e19700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc4bc06c120 0x7fc4bc14b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.792+0000 7fc4c0e19700 1 --2- 172.21.15.5:0/978123483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc4bc0b8720 0x7fc4bc0cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.792+0000 7fc4c0e19700 1 -- 172.21.15.5:0/978123483 >> 172.21.15.5:0/978123483 conn(0x7fc4bc0d0590 msgr2=0x7fc4bc0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.793+0000 7fc4c0e19700 1 -- 172.21.15.5:0/978123483 shutdown_connections 2023-03-03T06:25:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.793+0000 7fc4c0e19700 1 -- 172.21.15.5:0/978123483 wait complete. 2023-03-03T06:25:21.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:25:21.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.932+0000 7fde05ba2700 1 Processor -- start 2023-03-03T06:25:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.932+0000 7fde05ba2700 1 -- start start 2023-03-03T06:25:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.933+0000 7fde05ba2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde0015ff40 0x7fde00070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.933+0000 7fde05ba2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde00070bd0 0x7fde000ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.933+0000 7fde05ba2700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fde000ced20 0x7fde001603a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.933+0000 7fde05ba2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0006c110 con 0x7fde00070bd0 2023-03-03T06:25:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.933+0000 7fde05ba2700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde000b1690 con 0x7fde000ced20 2023-03-03T06:25:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.933+0000 7fde05ba2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde00071020 con 0x7fde0015ff40 2023-03-03T06:25:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.933+0000 7fddfffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde00070bd0 0x7fde000ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.933+0000 7fddfffff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fde00070bd0 0x7fde000ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44364/0 (socket says 172.21.15.5:44364) 2023-03-03T06:25:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.933+0000 7fddfffff700 1 -- 172.21.15.5:0/205797820 learned_addr learned my addr 172.21.15.5:0/205797820 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fde053a1700 1 --2- 172.21.15.5:0/205797820 >> v2:172.21.15.191:3300/0 conn(0x7fde000ced20 0x7fde001603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fddfffff700 1 -- 172.21.15.5:0/205797820 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde0015ff40 msgr2=0x7fde00070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fde04ba0700 1 --2- 172.21.15.5:0/205797820 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde0015ff40 0x7fde00070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fddfffff700 1 --2- 172.21.15.5:0/205797820 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde0015ff40 0x7fde00070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fddfffff700 1 -- 172.21.15.5:0/205797820 >> v2:172.21.15.191:3300/0 conn(0x7fde000ced20 msgr2=0x7fde001603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fddfffff700 1 --2- 172.21.15.5:0/205797820 >> v2:172.21.15.191:3300/0 conn(0x7fde000ced20 0x7fde001603a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fddfffff700 1 -- 172.21.15.5:0/205797820 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde000b0ba0 con 0x7fde00070bd0 2023-03-03T06:25:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fde053a1700 1 --2- 172.21.15.5:0/205797820 >> v2:172.21.15.191:3300/0 conn(0x7fde000ced20 0x7fde001603a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fddfffff700 1 --2- 172.21.15.5:0/205797820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde00070bd0 0x7fde000ce7e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fde000d1790 tx=0x7fddec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06da7bf1c8d02f7 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fddff7fe700 1 -- 172.21.15.5:0/205797820 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec00b870 con 0x7fde00070bd0 2023-03-03T06:25:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fddff7fe700 1 -- 172.21.15.5:0/205797820 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec00b9d0 con 0x7fde00070bd0 2023-03-03T06:25:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fddff7fe700 1 -- 172.21.15.5:0/205797820 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec00bd60 con 0x7fde00070bd0 2023-03-03T06:25:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fde05ba2700 1 -- 172.21.15.5:0/205797820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde00070bd0 msgr2=0x7fde000ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.934+0000 7fde05ba2700 1 --2- 172.21.15.5:0/205797820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde00070bd0 0x7fde000ce7e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fde000d1790 tx=0x7fddec009bd0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.935+0000 7fde05ba2700 1 -- 172.21.15.5:0/205797820 shutdown_connections 2023-03-03T06:25:21.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.935+0000 7fde05ba2700 1 --2- 172.21.15.5:0/205797820 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde0015ff40 0x7fde00070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.935+0000 7fde05ba2700 1 --2- 172.21.15.5:0/205797820 >> v2:172.21.15.191:3300/0 conn(0x7fde000ced20 0x7fde001603a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.935+0000 7fde05ba2700 1 --2- 172.21.15.5:0/205797820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde00070bd0 0x7fde000ce7e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.935+0000 7fde05ba2700 1 -- 172.21.15.5:0/205797820 >> 172.21.15.5:0/205797820 conn(0x7fde000d0c10 msgr2=0x7fde000d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:21.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.935+0000 7fde05ba2700 1 -- 172.21.15.5:0/205797820 shutdown_connections 2023-03-03T06:25:21.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.935+0000 7fde05ba2700 1 -- 172.21.15.5:0/205797820 wait complete. 2023-03-03T06:25:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.936+0000 7fde05ba2700 1 Processor -- start 2023-03-03T06:25:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.936+0000 7fde05ba2700 1 -- start start 2023-03-03T06:25:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fde05ba2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde00070bd0 0x7fde000c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fde05ba2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde000ced20 0x7fde0006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fde05ba2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde0015ff40 0x7fde0006e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fde05ba2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde000ca2f0 con 0x7fde000ced20 2023-03-03T06:25:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fde05ba2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde000c8850 con 0x7fde00070bd0 2023-03-03T06:25:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fde05ba2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde000c8b30 con 0x7fde0015ff40 2023-03-03T06:25:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fddfffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde000ced20 0x7fde0006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fddfffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde000ced20 0x7fde0006e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44372/0 (socket says 172.21.15.5:44372) 2023-03-03T06:25:21.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fddfffff700 1 -- 172.21.15.5:0/1190787251 learned_addr learned my addr 172.21.15.5:0/1190787251 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:21.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fde04ba0700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde00070bd0 0x7fde000c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fde053a1700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde0015ff40 0x7fde0006e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fddfffff700 1 -- 172.21.15.5:0/1190787251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde0015ff40 msgr2=0x7fde0006e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fddfffff700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde0015ff40 0x7fde0006e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fddfffff700 1 -- 172.21.15.5:0/1190787251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde00070bd0 msgr2=0x7fde000c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:21.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fddfffff700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde00070bd0 0x7fde000c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:21.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fddfffff700 1 -- 172.21.15.5:0/1190787251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec009550 con 0x7fde000ced20 2023-03-03T06:25:21.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fde04ba0700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde00070bd0 0x7fde000c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:21.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fde053a1700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde0015ff40 0x7fde0006e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:21.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fddfffff700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde000ced20 0x7fde0006e3c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fde0006b3a0 tx=0x7fddec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:21.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fddfd7fa700 1 -- 172.21.15.5:0/1190787251 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec004310 con 0x7fde000ced20 2023-03-03T06:25:21.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fddfd7fa700 1 -- 172.21.15.5:0/1190787251 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec01f070 con 0x7fde000ced20 2023-03-03T06:25:21.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fddfd7fa700 1 -- 172.21.15.5:0/1190787251 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0036a0 con 0x7fde000ced20 2023-03-03T06:25:21.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.937+0000 7fde05ba2700 1 -- 172.21.15.5:0/1190787251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde000b0df0 con 0x7fde000ced20 2023-03-03T06:25:21.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.938+0000 7fde05ba2700 1 -- 172.21.15.5:0/1190787251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde000cf1a0 con 0x7fde000ced20 2023-03-03T06:25:21.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.938+0000 7fde05ba2700 1 -- 172.21.15.5:0/1190787251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde000b10d0 con 0x7fde000ced20 2023-03-03T06:25:21.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.939+0000 7fddfd7fa700 1 -- 172.21.15.5:0/1190787251 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fddec02a020 con 0x7fde000ced20 2023-03-03T06:25:21.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.939+0000 7fddfd7fa700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdde40682f0 0x7fdde406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:21.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.939+0000 7fddfd7fa700 1 -- 172.21.15.5:0/1190787251 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5883+0+0 (secure 0 0 0) 0x7fddec087220 con 0x7fde000ced20 2023-03-03T06:25:21.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.939+0000 7fde04ba0700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdde40682f0 0x7fdde406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:21.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.940+0000 7fde04ba0700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdde40682f0 0x7fdde406a7a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fddf4006fd0 tx=0x7fddf4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:21.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:21.943+0000 7fddfd7fa700 1 -- 172.21.15.5:0/1190787251 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fddec053b30 con 0x7fde000ced20 2023-03-03T06:25:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.135+0000 7fde05ba2700 1 -- 172.21.15.5:0/1190787251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde00074300 con 0x7fde000ced20 2023-03-03T06:25:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.135+0000 7fddfd7fa700 1 -- 172.21.15.5:0/1190787251 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7fddec057150 con 0x7fde000ced20 2023-03-03T06:25:22.137 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:25:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.137+0000 7fde05ba2700 1 -- 172.21.15.5:0/1190787251 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdde40682f0 msgr2=0x7fdde406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.137+0000 7fde05ba2700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdde40682f0 0x7fdde406a7a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fddf4006fd0 tx=0x7fddf4008040 comp rx=0 tx=0).stop 2023-03-03T06:25:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.137+0000 7fde05ba2700 1 -- 172.21.15.5:0/1190787251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde000ced20 msgr2=0x7fde0006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.137+0000 7fde05ba2700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde000ced20 0x7fde0006e3c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fde0006b3a0 tx=0x7fddec004750 comp rx=0 tx=0).stop 2023-03-03T06:25:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.137+0000 7fde05ba2700 1 -- 172.21.15.5:0/1190787251 shutdown_connections 2023-03-03T06:25:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.137+0000 7fde05ba2700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdde40682f0 0x7fdde406a7a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.137+0000 7fde05ba2700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde0015ff40 0x7fde0006e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.137+0000 7fde05ba2700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde00070bd0 0x7fde000c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.137+0000 7fde05ba2700 1 --2- 172.21.15.5:0/1190787251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde000ced20 0x7fde0006e3c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.137+0000 7fde05ba2700 1 -- 172.21.15.5:0/1190787251 >> 172.21.15.5:0/1190787251 conn(0x7fde000d0c10 msgr2=0x7fde000c6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.137+0000 7fde05ba2700 1 -- 172.21.15.5:0/1190787251 shutdown_connections 2023-03-03T06:25:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.137+0000 7fde05ba2700 1 -- 172.21.15.5:0/1190787251 wait complete. 2023-03-03T06:25:22.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-03-03T06:25:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.278+0000 7ff979e66700 1 Processor -- start 2023-03-03T06:25:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.278+0000 7ff979e66700 1 -- start start 2023-03-03T06:25:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff979e66700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff97415cd40 0x7ff9740b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff979e66700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff9740cd3e0 0x7ff9740b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff979e66700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9740cb9d0 0x7ff974160720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff979e66700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9740cd870 con 0x7ff9740cb9d0 2023-03-03T06:25:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff979e66700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97415e160 con 0x7ff9740cd3e0 2023-03-03T06:25:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff979e66700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97415d110 con 0x7ff97415cd40 2023-03-03T06:25:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff973fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9740cb9d0 0x7ff974160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff973fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff9740cb9d0 0x7ff974160720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44382/0 (socket says 172.21.15.5:44382) 2023-03-03T06:25:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff973fff700 1 -- 172.21.15.5:0/3592039499 learned_addr learned my addr 172.21.15.5:0/3592039499 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff972ffd700 1 --2- 172.21.15.5:0/3592039499 >> v2:172.21.15.191:3300/0 conn(0x7ff9740cd3e0 0x7ff9740b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff9737fe700 1 --2- 172.21.15.5:0/3592039499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff97415cd40 0x7ff9740b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff973fff700 1 -- 172.21.15.5:0/3592039499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff97415cd40 msgr2=0x7ff9740b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff973fff700 1 --2- 172.21.15.5:0/3592039499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff97415cd40 0x7ff9740b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff973fff700 1 -- 172.21.15.5:0/3592039499 >> v2:172.21.15.191:3300/0 conn(0x7ff9740cd3e0 msgr2=0x7ff9740b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff973fff700 1 --2- 172.21.15.5:0/3592039499 >> v2:172.21.15.191:3300/0 conn(0x7ff9740cd3e0 0x7ff9740b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff973fff700 1 -- 172.21.15.5:0/3592039499 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97415d3c0 con 0x7ff9740cb9d0 2023-03-03T06:25:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff9737fe700 1 --2- 172.21.15.5:0/3592039499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff97415cd40 0x7ff9740b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff972ffd700 1 --2- 172.21.15.5:0/3592039499 >> v2:172.21.15.191:3300/0 conn(0x7ff9740cd3e0 0x7ff9740b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.279+0000 7ff973fff700 1 --2- 172.21.15.5:0/3592039499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9740cb9d0 0x7ff974160720 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff974068700 tx=0x7ff96c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a74190b0e73f9f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.280+0000 7ff9727fc700 1 -- 172.21.15.5:0/3592039499 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c00e070 con 0x7ff9740cb9d0 2023-03-03T06:25:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.280+0000 7ff9727fc700 1 -- 172.21.15.5:0/3592039499 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c00b9c0 con 0x7ff9740cb9d0 2023-03-03T06:25:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.280+0000 7ff9727fc700 1 -- 172.21.15.5:0/3592039499 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c00bd70 con 0x7ff9740cb9d0 2023-03-03T06:25:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.280+0000 7ff979e66700 1 -- 172.21.15.5:0/3592039499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9740cb9d0 msgr2=0x7ff974160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.280+0000 7ff979e66700 1 --2- 172.21.15.5:0/3592039499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9740cb9d0 0x7ff974160720 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff974068700 tx=0x7ff96c00b330 comp rx=0 tx=0).stop 2023-03-03T06:25:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.280+0000 7ff979e66700 1 -- 172.21.15.5:0/3592039499 shutdown_connections 2023-03-03T06:25:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.280+0000 7ff979e66700 1 --2- 172.21.15.5:0/3592039499 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff97415cd40 0x7ff9740b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.280+0000 7ff979e66700 1 --2- 172.21.15.5:0/3592039499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9740cb9d0 0x7ff974160720 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.280+0000 7ff979e66700 1 --2- 172.21.15.5:0/3592039499 >> v2:172.21.15.191:3300/0 conn(0x7ff9740cd3e0 0x7ff9740b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.280+0000 7ff979e66700 1 -- 172.21.15.5:0/3592039499 >> 172.21.15.5:0/3592039499 conn(0x7ff9740cc8d0 msgr2=0x7ff9740cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.280+0000 7ff979e66700 1 -- 172.21.15.5:0/3592039499 shutdown_connections 2023-03-03T06:25:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.280+0000 7ff979e66700 1 -- 172.21.15.5:0/3592039499 wait complete. 2023-03-03T06:25:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.281+0000 7ff979e66700 1 Processor -- start 2023-03-03T06:25:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.282+0000 7ff979e66700 1 -- start start 2023-03-03T06:25:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.282+0000 7ff979e66700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9740cb9d0 0x7ff9740b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.282+0000 7ff979e66700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9740cd3e0 0x7ff97414ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.282+0000 7ff979e66700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff97415cd40 0x7ff9741504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.282+0000 7ff979e66700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9740c5370 con 0x7ff9740cd3e0 2023-03-03T06:25:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.282+0000 7ff979e66700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9740c4760 con 0x7ff97415cd40 2023-03-03T06:25:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.282+0000 7ff979e66700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9740c4a40 con 0x7ff9740cb9d0 2023-03-03T06:25:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.282+0000 7ff972ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9740cd3e0 0x7ff97414ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.282+0000 7ff972ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9740cd3e0 0x7ff97414ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44386/0 (socket says 172.21.15.5:44386) 2023-03-03T06:25:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.282+0000 7ff972ffd700 1 -- 172.21.15.5:0/3677275343 learned_addr learned my addr 172.21.15.5:0/3677275343 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.283+0000 7ff9737fe700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9740cb9d0 0x7ff9740b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.283+0000 7ff973fff700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff97415cd40 0x7ff9741504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.283+0000 7ff972ffd700 1 -- 172.21.15.5:0/3677275343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9740cb9d0 msgr2=0x7ff9740b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.283+0000 7ff972ffd700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9740cb9d0 0x7ff9740b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.283+0000 7ff972ffd700 1 -- 172.21.15.5:0/3677275343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff97415cd40 msgr2=0x7ff9741504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.283+0000 7ff972ffd700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff97415cd40 0x7ff9741504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.283+0000 7ff972ffd700 1 -- 172.21.15.5:0/3677275343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c009b30 con 0x7ff9740cd3e0 2023-03-03T06:25:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.283+0000 7ff972ffd700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9740cd3e0 0x7ff97414ffb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00c7f0 tx=0x7ff95c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.283+0000 7ff96bfff700 1 -- 172.21.15.5:0/3677275343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c011800 con 0x7ff9740cd3e0 2023-03-03T06:25:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.283+0000 7ff96bfff700 1 -- 172.21.15.5:0/3677275343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c011960 con 0x7ff9740cd3e0 2023-03-03T06:25:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.283+0000 7ff979e66700 1 -- 172.21.15.5:0/3677275343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97415d980 con 0x7ff9740cd3e0 2023-03-03T06:25:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.283+0000 7ff96bfff700 1 -- 172.21.15.5:0/3677275343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c011d10 con 0x7ff9740cd3e0 2023-03-03T06:25:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.283+0000 7ff979e66700 1 -- 172.21.15.5:0/3677275343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97415d6a0 con 0x7ff9740cd3e0 2023-03-03T06:25:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.284+0000 7ff979e66700 1 -- 172.21.15.5:0/3677275343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97415dc60 con 0x7ff9740cd3e0 2023-03-03T06:25:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.284+0000 7ff96bfff700 1 -- 172.21.15.5:0/3677275343 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff95c021070 con 0x7ff9740cd3e0 2023-03-03T06:25:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.285+0000 7ff96bfff700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff9540682f0 0x7ff95406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.285+0000 7ff96bfff700 1 -- 172.21.15.5:0/3677275343 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5883+0+0 (secure 0 0 0) 0x7ff95c085a30 con 0x7ff9740cd3e0 2023-03-03T06:25:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.285+0000 7ff9737fe700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff9540682f0 0x7ff95406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.285+0000 7ff9737fe700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff9540682f0 0x7ff95406a7a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff964006fd0 tx=0x7ff964008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.289+0000 7ff96bfff700 1 -- 172.21.15.5:0/3677275343 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff95c0522e0 con 0x7ff9740cd3e0 2023-03-03T06:25:22.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.481+0000 7ff979e66700 1 -- 172.21.15.5:0/3677275343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7ff9740c7620 con 0x7ff9740cd3e0 2023-03-03T06:25:22.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.481+0000 7ff96bfff700 1 -- 172.21.15.5:0/3677275343 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v52) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff95c01f0a0 con 0x7ff9740cd3e0 2023-03-03T06:25:22.484 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:25:22.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.483+0000 7ff979e66700 1 -- 172.21.15.5:0/3677275343 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff9540682f0 msgr2=0x7ff95406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.483+0000 7ff979e66700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff9540682f0 0x7ff95406a7a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff964006fd0 tx=0x7ff964008040 comp rx=0 tx=0).stop 2023-03-03T06:25:22.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.483+0000 7ff979e66700 1 -- 172.21.15.5:0/3677275343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9740cd3e0 msgr2=0x7ff97414ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.483+0000 7ff979e66700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9740cd3e0 0x7ff97414ffb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00c7f0 tx=0x7ff95c00cbb0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.484+0000 7ff979e66700 1 -- 172.21.15.5:0/3677275343 shutdown_connections 2023-03-03T06:25:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.484+0000 7ff979e66700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff97415cd40 0x7ff9741504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.484+0000 7ff979e66700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff9540682f0 0x7ff95406a7a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.484+0000 7ff979e66700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9740cb9d0 0x7ff9740b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.484+0000 7ff979e66700 1 --2- 172.21.15.5:0/3677275343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9740cd3e0 0x7ff97414ffb0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.484+0000 7ff979e66700 1 -- 172.21.15.5:0/3677275343 >> 172.21.15.5:0/3677275343 conn(0x7ff9740cc8d0 msgr2=0x7ff9740cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:22.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.484+0000 7ff979e66700 1 -- 172.21.15.5:0/3677275343 shutdown_connections 2023-03-03T06:25:22.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.484+0000 7ff979e66700 1 -- 172.21.15.5:0/3677275343 wait complete. 2023-03-03T06:25:22.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-03T06:25:22.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.621+0000 7fb1d5ed1700 1 Processor -- start 2023-03-03T06:25:22.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.621+0000 7fb1d5ed1700 1 -- start start 2023-03-03T06:25:22.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1d5ed1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1d01573f0 0x7fb1d015d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1d5ed1700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb1d00b18d0 0x7fb1d00b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1d5ed1700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d01577c0 con 0x7fb1d00cc1a0 2023-03-03T06:25:22.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1d5ed1700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d00cd790 con 0x7fb1d00b18d0 2023-03-03T06:25:22.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1d5ed1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d0159e60 con 0x7fb1d01573f0 2023-03-03T06:25:22.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1ceffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb1d00cc1a0 0x7fb1d00cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34234/0 (socket says 172.21.15.5:34234) 2023-03-03T06:25:22.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1ceffd700 1 -- 172.21.15.5:0/1693534986 learned_addr learned my addr 172.21.15.5:0/1693534986 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:22.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1cffff700 1 --2- 172.21.15.5:0/1693534986 >> v2:172.21.15.191:3300/0 conn(0x7fb1d00b18d0 0x7fb1d00b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1cf7fe700 1 --2- 172.21.15.5:0/1693534986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1d01573f0 0x7fb1d015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047836592 0 0) 0x7fb1d01577c0 con 0x7fb1d00cc1a0 2023-03-03T06:25:22.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1bc0035b0 con 0x7fb1d00cc1a0 2023-03-03T06:25:22.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3214082379 0 0) 0x7fb1bc0035b0 con 0x7fb1d00cc1a0 2023-03-03T06:25:22.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1d01573f0 msgr2=0x7fb1d015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:22.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1ce7fc700 1 --2- 172.21.15.5:0/1693534986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1d01573f0 0x7fb1d015d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 >> v2:172.21.15.191:3300/0 conn(0x7fb1d00b18d0 msgr2=0x7fb1d00b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:22.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1ce7fc700 1 --2- 172.21.15.5:0/1693534986 >> v2:172.21.15.191:3300/0 conn(0x7fb1d00b18d0 0x7fb1d00b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00b2270 con 0x7fb1d00cc1a0 2023-03-03T06:25:22.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fb1b80017f0 con 0x7fb1d00cc1a0 2023-03-03T06:25:22.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 >> v1:172.21.15.5:6789/0 conn(0x7fb1d00cc1a0 legacy=0x7fb1d00cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.622+0000 7fb1ce7fc700 1 --2- 172.21.15.5:0/1693534986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1d01573f0 0x7fb1bc003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1ce7fc700 1 --2- 172.21.15.5:0/1693534986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1bc003ff0 0x7fb1bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1ce7fc700 1 --2- 172.21.15.5:0/1693534986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc004d90 0x7fb1bc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00cd790 con 0x7fb1bc004d90 2023-03-03T06:25:22.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d0159e60 con 0x7fb1bc003ff0 2023-03-03T06:25:22.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc00dc20 con 0x7fb1d01573f0 2023-03-03T06:25:22.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1cffff700 1 --2- 172.21.15.5:0/1693534986 >> v2:172.21.15.191:3300/0 conn(0x7fb1d00b18d0 0x7fb1d00b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:22.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1cffff700 1 --2- 172.21.15.5:0/1693534986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc004d90 0x7fb1bc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1cf7fe700 1 --2- 172.21.15.5:0/1693534986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1d01573f0 0x7fb1bc003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1ceffd700 1 --2- 172.21.15.5:0/1693534986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1bc003ff0 0x7fb1bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1cffff700 1 -- 172.21.15.5:0/1693534986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1d01573f0 msgr2=0x7fb1bc003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:22.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1cffff700 1 --2- 172.21.15.5:0/1693534986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1d01573f0 0x7fb1bc003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1cffff700 1 -- 172.21.15.5:0/1693534986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1bc003ff0 msgr2=0x7fb1bc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:22.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1cffff700 1 --2- 172.21.15.5:0/1693534986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1bc003ff0 0x7fb1bc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1cffff700 1 -- 172.21.15.5:0/1693534986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc0035b0 con 0x7fb1bc004d90 2023-03-03T06:25:22.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1ceffd700 1 --2- 172.21.15.5:0/1693534986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1bc003ff0 0x7fb1bc004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:22.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1cffff700 1 --2- 172.21.15.5:0/1693534986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc004d90 0x7fb1bc005200 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800e380 tx=0x7fb1bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e11ff5366dcefba server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:22.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c800ee40 con 0x7fb1bc004d90 2023-03-03T06:25:22.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c800f040 con 0x7fb1bc004d90 2023-03-03T06:25:22.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.623+0000 7fb1ce7fc700 1 -- 172.21.15.5:0/1693534986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8003c40 con 0x7fb1bc004d90 2023-03-03T06:25:22.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.624+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/1693534986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc004d90 msgr2=0x7fb1bc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.624+0000 7fb1d5ed1700 1 --2- 172.21.15.5:0/1693534986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1bc004d90 0x7fb1bc005200 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800e380 tx=0x7fb1bc005880 comp rx=0 tx=0).stop 2023-03-03T06:25:22.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.624+0000 7fb1cffff700 1 -- 172.21.15.5:0/1693534986 reap_dead start 2023-03-03T06:25:22.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.624+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/1693534986 shutdown_connections 2023-03-03T06:25:22.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.624+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/1693534986 >> 172.21.15.5:0/1693534986 conn(0x7fb1d00cc8d0 msgr2=0x7fb1d00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:22.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.624+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/1693534986 shutdown_connections 2023-03-03T06:25:22.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.624+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/1693534986 wait complete. 2023-03-03T06:25:22.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.625+0000 7fb1d5ed1700 1 Processor -- start 2023-03-03T06:25:22.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.626+0000 7fb1d5ed1700 1 -- start start 2023-03-03T06:25:22.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.626+0000 7fb1d5ed1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1d0144050 0x7fb1d00c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1d5ed1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1d00c4300 0x7fb1d006bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1d5ed1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1d006c450 0x7fb1d00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1d5ed1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d006c8c0 con 0x7fb1d00c4300 2023-03-03T06:25:22.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1d5ed1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00c8400 con 0x7fb1d006c450 2023-03-03T06:25:22.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1d5ed1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00c4770 con 0x7fb1d0144050 2023-03-03T06:25:22.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1ceffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1d00c4300 0x7fb1d006bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1ceffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1d00c4300 0x7fb1d006bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44406/0 (socket says 172.21.15.5:44406) 2023-03-03T06:25:22.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1ceffd700 1 -- 172.21.15.5:0/3126422304 learned_addr learned my addr 172.21.15.5:0/3126422304 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:22.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1cffff700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1d006c450 0x7fb1d00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1cf7fe700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1d0144050 0x7fb1d00c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1ceffd700 1 -- 172.21.15.5:0/3126422304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1d0144050 msgr2=0x7fb1d00c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1ceffd700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1d0144050 0x7fb1d00c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1ceffd700 1 -- 172.21.15.5:0/3126422304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1d006c450 msgr2=0x7fb1d00b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1ceffd700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1d006c450 0x7fb1d00b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1ceffd700 1 -- 172.21.15.5:0/3126422304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00cc610 con 0x7fb1d00c4300 2023-03-03T06:25:22.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1cffff700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1d006c450 0x7fb1d00b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:22.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1ceffd700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1d00c4300 0x7fb1d006bf10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800e820 tx=0x7fb1b800ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1c7fff700 1 -- 172.21.15.5:0/3126422304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80072e0 con 0x7fb1d00c4300 2023-03-03T06:25:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1c7fff700 1 -- 172.21.15.5:0/3126422304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b8007440 con 0x7fb1d00c4300 2023-03-03T06:25:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/3126422304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d00ce460 con 0x7fb1d00c4300 2023-03-03T06:25:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1c7fff700 1 -- 172.21.15.5:0/3126422304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8005830 con 0x7fb1d00c4300 2023-03-03T06:25:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.627+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/3126422304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d015d900 con 0x7fb1d00c4300 2023-03-03T06:25:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.628+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/3126422304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d00cacb0 con 0x7fb1d00c4300 2023-03-03T06:25:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.629+0000 7fb1c7fff700 1 -- 172.21.15.5:0/3126422304 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb1b8005990 con 0x7fb1d00c4300 2023-03-03T06:25:22.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.629+0000 7fb1c7fff700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb1b0068320 0x7fb1b006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.629+0000 7fb1c7fff700 1 -- 172.21.15.5:0/3126422304 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5883+0+0 (secure 0 0 0) 0x7fb1b8085bd0 con 0x7fb1d00c4300 2023-03-03T06:25:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.629+0000 7fb1cf7fe700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb1b0068320 0x7fb1b006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.630+0000 7fb1cf7fe700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb1b0068320 0x7fb1b006a7d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009aa0 tx=0x7fb1c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:22.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.633+0000 7fb1c7fff700 1 -- 172.21.15.5:0/3126422304 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb1b80524e0 con 0x7fb1d00c4300 2023-03-03T06:25:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.827+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/3126422304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb1d004e6e0 con 0x7fb1d00c4300 2023-03-03T06:25:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.828+0000 7fb1c7fff700 1 -- 172.21.15.5:0/3126422304 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v52) v1 ==== 84+0+198 (secure 0 0 0) 0x7fb1b8055b00 con 0x7fb1d00c4300 2023-03-03T06:25:22.830 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:22.830 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-03-03T06:25:22.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:22.831 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-03-03T06:25:22.831 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-03-03T06:25:22.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:22.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:22.831 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-03-03T06:25:22.831 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-03-03T06:25:22.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:22.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:22.832 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 8, 2023-03-03T06:25:22.832 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "snap-test-pool" 2023-03-03T06:25:22.832 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:22.832 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-03-03T06:25:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.830+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/3126422304 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb1b0068320 msgr2=0x7fb1b006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.830+0000 7fb1d5ed1700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb1b0068320 0x7fb1b006a7d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009aa0 tx=0x7fb1c0008040 comp rx=0 tx=0).stop 2023-03-03T06:25:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.830+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/3126422304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1d00c4300 msgr2=0x7fb1d006bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.830+0000 7fb1d5ed1700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1d00c4300 0x7fb1d006bf10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800e820 tx=0x7fb1b800ebe0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.830+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/3126422304 shutdown_connections 2023-03-03T06:25:22.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.830+0000 7fb1d5ed1700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb1d006c450 0x7fb1d00b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.830+0000 7fb1d5ed1700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb1b0068320 0x7fb1b006a7d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.830+0000 7fb1d5ed1700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb1d0144050 0x7fb1d00c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.830+0000 7fb1d5ed1700 1 --2- 172.21.15.5:0/3126422304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1d00c4300 0x7fb1d006bf10 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.830+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/3126422304 >> 172.21.15.5:0/3126422304 conn(0x7fb1d00cc8d0 msgr2=0x7fb1d00ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:22.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.830+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/3126422304 shutdown_connections 2023-03-03T06:25:22.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.830+0000 7fb1d5ed1700 1 -- 172.21.15.5:0/3126422304 wait complete. 2023-03-03T06:25:22.844 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-03T06:25:22.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-03T06:25:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.971+0000 7f7c0fe15700 1 Processor -- start 2023-03-03T06:25:22.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.971+0000 7f7c0fe15700 1 -- start start 2023-03-03T06:25:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.972+0000 7f7c0fe15700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c0815c8a0 0x7f7c080cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.972+0000 7f7c0fe15700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7c080cf100 0x7f7c080cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.972+0000 7f7c0fe15700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c080cbb60 con 0x7f7c08160df0 2023-03-03T06:25:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.972+0000 7f7c0fe15700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0815cc70 con 0x7f7c0815c8a0 2023-03-03T06:25:22.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.972+0000 7f7c0fe15700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c080ce1b0 con 0x7f7c080cf100 2023-03-03T06:25:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.972+0000 7f7c0dbb1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c0815c8a0 0x7f7c080cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.972+0000 7f7c0dbb1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7c0815c8a0 0x7f7c080cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44412/0 (socket says 172.21.15.5:44412) 2023-03-03T06:25:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.972+0000 7f7c0dbb1700 1 -- 172.21.15.5:0/2423860694 learned_addr learned my addr 172.21.15.5:0/2423860694 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.972+0000 7f7c0e3b2700 1 --2- 172.21.15.5:0/2423860694 >> v2:172.21.15.191:3300/0 conn(0x7f7c080cf100 0x7f7c080cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0dbb1700 1 -- 172.21.15.5:0/2423860694 >> v2:172.21.15.191:3300/0 conn(0x7f7c080cf100 msgr2=0x7f7c080cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0dbb1700 1 --2- 172.21.15.5:0/2423860694 >> v2:172.21.15.191:3300/0 conn(0x7f7c080cf100 0x7f7c080cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0dbb1700 1 -- 172.21.15.5:0/2423860694 >> v1:172.21.15.191:6789/0 conn(0x7f7c08160df0 legacy=0x7f7c080ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:22.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0dbb1700 1 -- 172.21.15.5:0/2423860694 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c080cded0 con 0x7f7c0815c8a0 2023-03-03T06:25:22.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0dbb1700 1 --2- 172.21.15.5:0/2423860694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0815c8a0 0x7f7c080cd7d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7c080cf4d0 tx=0x7f7bf8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1312dd2f2aa351cd server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:22.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0cbaf700 1 -- 172.21.15.5:0/2423860694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8004230 con 0x7f7c0815c8a0 2023-03-03T06:25:22.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0cbaf700 1 -- 172.21.15.5:0/2423860694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf8004390 con 0x7f7c0815c8a0 2023-03-03T06:25:22.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0cbaf700 1 -- 172.21.15.5:0/2423860694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf80036a0 con 0x7f7c0815c8a0 2023-03-03T06:25:22.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2423860694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0815c8a0 msgr2=0x7f7c080cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0fe15700 1 --2- 172.21.15.5:0/2423860694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0815c8a0 0x7f7c080cd7d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7c080cf4d0 tx=0x7f7bf8009bd0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2423860694 shutdown_connections 2023-03-03T06:25:22.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0fe15700 1 --2- 172.21.15.5:0/2423860694 >> v2:172.21.15.191:3300/0 conn(0x7f7c080cf100 0x7f7c080cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0fe15700 1 --2- 172.21.15.5:0/2423860694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c0815c8a0 0x7f7c080cd7d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.973+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2423860694 >> 172.21.15.5:0/2423860694 conn(0x7f7c0806f3c0 msgr2=0x7f7c0806f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:22.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.974+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2423860694 shutdown_connections 2023-03-03T06:25:22.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.974+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2423860694 wait complete. 2023-03-03T06:25:22.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.975+0000 7f7c0fe15700 1 Processor -- start 2023-03-03T06:25:22.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.975+0000 7f7c0fe15700 1 -- start start 2023-03-03T06:25:22.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.975+0000 7f7c0fe15700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c080cf100 0x7f7c081f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.975+0000 7f7c0fe15700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c0815c8a0 0x7f7c0815bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.975+0000 7f7c0fe15700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c08160df0 0x7f7c081f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.975+0000 7f7c0fe15700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c081f66a0 con 0x7f7c08160df0 2023-03-03T06:25:22.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.975+0000 7f7c0fe15700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0815c100 con 0x7f7c080cf100 2023-03-03T06:25:22.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.975+0000 7f7c0fe15700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c081f1fd0 con 0x7f7c0815c8a0 2023-03-03T06:25:22.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7c0e3b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c08160df0 0x7f7c081f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7c0e3b2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c08160df0 0x7f7c081f1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44422/0 (socket says 172.21.15.5:44422) 2023-03-03T06:25:22.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7c0e3b2700 1 -- 172.21.15.5:0/2436397945 learned_addr learned my addr 172.21.15.5:0/2436397945 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:22.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7c0d3b0700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c0815c8a0 0x7f7c0815bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7c0dbb1700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c080cf100 0x7f7c081f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7c0e3b2700 1 -- 172.21.15.5:0/2436397945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c0815c8a0 msgr2=0x7f7c0815bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7c0e3b2700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c0815c8a0 0x7f7c0815bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7c0e3b2700 1 -- 172.21.15.5:0/2436397945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c080cf100 msgr2=0x7f7c081f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:22.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7c0e3b2700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c080cf100 0x7f7c081f5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:22.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7c0e3b2700 1 -- 172.21.15.5:0/2436397945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8009550 con 0x7f7c08160df0 2023-03-03T06:25:22.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7c0e3b2700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c08160df0 0x7f7c081f1a90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7c00007d80 tx=0x7f7c0000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:22.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7bfe7fc700 1 -- 172.21.15.5:0/2436397945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0000ede0 con 0x7f7c08160df0 2023-03-03T06:25:22.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7bfe7fc700 1 -- 172.21.15.5:0/2436397945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c00014420 con 0x7f7c08160df0 2023-03-03T06:25:22.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2436397945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c080cb7f0 con 0x7f7c08160df0 2023-03-03T06:25:22.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7bfe7fc700 1 -- 172.21.15.5:0/2436397945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000147d0 con 0x7f7c08160df0 2023-03-03T06:25:22.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.976+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2436397945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c080cb510 con 0x7f7c08160df0 2023-03-03T06:25:22.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.977+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2436397945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c08161260 con 0x7f7c08160df0 2023-03-03T06:25:22.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.978+0000 7f7bfe7fc700 1 -- 172.21.15.5:0/2436397945 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7c00012050 con 0x7f7c08160df0 2023-03-03T06:25:22.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.978+0000 7f7bfe7fc700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7bec0682f0 0x7f7bec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:22.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.978+0000 7f7bfe7fc700 1 -- 172.21.15.5:0/2436397945 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5883+0+0 (secure 0 0 0) 0x7f7c00086220 con 0x7f7c08160df0 2023-03-03T06:25:22.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.978+0000 7f7c0dbb1700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7bec0682f0 0x7f7bec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:22.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.978+0000 7f7c0dbb1700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7bec0682f0 0x7f7bec06a7a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009130 tx=0x7f7bf8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:22.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:22.982+0000 7f7bfe7fc700 1 -- 172.21.15.5:0/2436397945 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7c00052b30 con 0x7f7c08160df0 2023-03-03T06:25:23.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.174+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2436397945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7c0804e6e0 con 0x7f7c08160df0 2023-03-03T06:25:23.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.491+0000 7f7bfe7fc700 1 -- 172.21.15.5:0/2436397945 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7c00056150 con 0x7f7c08160df0 2023-03-03T06:25:23.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.493+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2436397945 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7bec0682f0 msgr2=0x7f7bec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.493+0000 7f7c0fe15700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7bec0682f0 0x7f7bec06a7a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009130 tx=0x7f7bf8008030 comp rx=0 tx=0).stop 2023-03-03T06:25:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.493+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2436397945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c08160df0 msgr2=0x7f7c081f1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.493+0000 7f7c0fe15700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c08160df0 0x7f7c081f1a90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7c00007d80 tx=0x7f7c0000e3c0 comp rx=0 tx=0).stop 2023-03-03T06:25:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.493+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2436397945 shutdown_connections 2023-03-03T06:25:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.493+0000 7f7c0fe15700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c08160df0 0x7f7c081f1a90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.493+0000 7f7c0fe15700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c080cf100 0x7f7c081f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.493+0000 7f7c0fe15700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7bec0682f0 0x7f7bec06a7a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:23.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.493+0000 7f7c0fe15700 1 --2- 172.21.15.5:0/2436397945 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c0815c8a0 0x7f7c0815bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:23.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.493+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2436397945 >> 172.21.15.5:0/2436397945 conn(0x7f7c0806f3c0 msgr2=0x7f7c08070620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:23.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.494+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2436397945 shutdown_connections 2023-03-03T06:25:23.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.494+0000 7f7c0fe15700 1 -- 172.21.15.5:0/2436397945 wait complete. 2023-03-03T06:25:23.498 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-03-03T06:25:23.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-03-03T06:25:23.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.645+0000 7f73c87a4700 1 Processor -- start 2023-03-03T06:25:23.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.645+0000 7f73c87a4700 1 -- start start 2023-03-03T06:25:23.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c87a4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73c00af0e0 0x7f73c00cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:23.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c87a4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73c00cd350 0x7f73c00cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:23.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c87a4700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f73c00cded0 0x7f73c006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:23.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c87a4700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c00cd830 con 0x7f73c00cd350 2023-03-03T06:25:23.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c87a4700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c00cbc50 con 0x7f73c00cded0 2023-03-03T06:25:23.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c87a4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c015ce00 con 0x7f73c00af0e0 2023-03-03T06:25:23.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c5d3f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73c00cd350 0x7f73c00cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:23.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c5d3f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f73c00cd350 0x7f73c00cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44426/0 (socket says 172.21.15.5:44426) 2023-03-03T06:25:23.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c5d3f700 1 -- 172.21.15.5:0/1876657970 learned_addr learned my addr 172.21.15.5:0/1876657970 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:23.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c6d41700 1 --2- 172.21.15.5:0/1876657970 >> v2:172.21.15.191:3300/0 conn(0x7f73c00cded0 0x7f73c006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:23.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c6540700 1 --2- 172.21.15.5:0/1876657970 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73c00af0e0 0x7f73c00cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:23.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c5d3f700 1 -- 172.21.15.5:0/1876657970 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73c00af0e0 msgr2=0x7f73c00cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:23.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c5d3f700 1 --2- 172.21.15.5:0/1876657970 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73c00af0e0 0x7f73c00cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:23.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c5d3f700 1 -- 172.21.15.5:0/1876657970 >> v2:172.21.15.191:3300/0 conn(0x7f73c00cded0 msgr2=0x7f73c006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:23.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c5d3f700 1 --2- 172.21.15.5:0/1876657970 >> v2:172.21.15.191:3300/0 conn(0x7f73c00cded0 0x7f73c006c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:23.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c5d3f700 1 -- 172.21.15.5:0/1876657970 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c006b460 con 0x7f73c00cd350 2023-03-03T06:25:23.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.646+0000 7f73c6d41700 1 --2- 172.21.15.5:0/1876657970 >> v2:172.21.15.191:3300/0 conn(0x7f73c00cded0 0x7f73c006c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.647+0000 7f73c5d3f700 1 --2- 172.21.15.5:0/1876657970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c00cd350 0x7f73c00cd990 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f73c0161520 tx=0x7f73bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90722133a7fd5318 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.647+0000 7f73c553e700 1 -- 172.21.15.5:0/1876657970 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00b860 con 0x7f73c00cd350 2023-03-03T06:25:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.647+0000 7f73c553e700 1 -- 172.21.15.5:0/1876657970 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc00b9c0 con 0x7f73c00cd350 2023-03-03T06:25:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.647+0000 7f73c553e700 1 -- 172.21.15.5:0/1876657970 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00bd50 con 0x7f73c00cd350 2023-03-03T06:25:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.647+0000 7f73c87a4700 1 -- 172.21.15.5:0/1876657970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c00cd350 msgr2=0x7f73c00cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.647+0000 7f73c87a4700 1 --2- 172.21.15.5:0/1876657970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c00cd350 0x7f73c00cd990 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f73c0161520 tx=0x7f73bc009c00 comp rx=0 tx=0).stop 2023-03-03T06:25:23.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.647+0000 7f73c87a4700 1 -- 172.21.15.5:0/1876657970 shutdown_connections 2023-03-03T06:25:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.647+0000 7f73c87a4700 1 --2- 172.21.15.5:0/1876657970 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73c00af0e0 0x7f73c00cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.647+0000 7f73c87a4700 1 --2- 172.21.15.5:0/1876657970 >> v2:172.21.15.191:3300/0 conn(0x7f73c00cded0 0x7f73c006c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.647+0000 7f73c87a4700 1 --2- 172.21.15.5:0/1876657970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c00cd350 0x7f73c00cd990 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.647+0000 7f73c87a4700 1 -- 172.21.15.5:0/1876657970 >> 172.21.15.5:0/1876657970 conn(0x7f73c00cc840 msgr2=0x7f73c00ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.647+0000 7f73c87a4700 1 -- 172.21.15.5:0/1876657970 shutdown_connections 2023-03-03T06:25:23.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.647+0000 7f73c87a4700 1 -- 172.21.15.5:0/1876657970 wait complete. 2023-03-03T06:25:23.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.649+0000 7f73c87a4700 1 Processor -- start 2023-03-03T06:25:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.649+0000 7f73c87a4700 1 -- start start 2023-03-03T06:25:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.649+0000 7f73c87a4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73c00af0e0 0x7f73c01572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.649+0000 7f73c87a4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73c00cd350 0x7f73c00c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.649+0000 7f73c87a4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c00cded0 0x7f73c00c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.649+0000 7f73c87a4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c00ac3a0 con 0x7f73c00cded0 2023-03-03T06:25:23.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.649+0000 7f73c87a4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c01577f0 con 0x7f73c00cd350 2023-03-03T06:25:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.649+0000 7f73c87a4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c00b53b0 con 0x7f73c00af0e0 2023-03-03T06:25:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73c6d41700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c00cded0 0x7f73c00c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73c6540700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73c00af0e0 0x7f73c01572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73c6d41700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c00cded0 0x7f73c00c4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44436/0 (socket says 172.21.15.5:44436) 2023-03-03T06:25:23.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73c6d41700 1 -- 172.21.15.5:0/3351183370 learned_addr learned my addr 172.21.15.5:0/3351183370 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:23.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73c5d3f700 1 --2- 172.21.15.5:0/3351183370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73c00cd350 0x7f73c00c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:23.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73c6d41700 1 -- 172.21.15.5:0/3351183370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73c00af0e0 msgr2=0x7f73c01572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:23.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73c6d41700 1 --2- 172.21.15.5:0/3351183370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73c00af0e0 0x7f73c01572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:23.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73c6d41700 1 -- 172.21.15.5:0/3351183370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73c00cd350 msgr2=0x7f73c00c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73c6d41700 1 --2- 172.21.15.5:0/3351183370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73c00cd350 0x7f73c00c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73c6d41700 1 -- 172.21.15.5:0/3351183370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc009550 con 0x7f73c00cded0 2023-03-03T06:25:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73c6d41700 1 --2- 172.21.15.5:0/3351183370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c00cded0 0x7f73c00c4d40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f73b800ccf0 tx=0x7f73b800a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73b6ffd700 1 -- 172.21.15.5:0/3351183370 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b800ad50 con 0x7f73c00cded0 2023-03-03T06:25:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73b6ffd700 1 -- 172.21.15.5:0/3351183370 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b800f480 con 0x7f73c00cded0 2023-03-03T06:25:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73b6ffd700 1 -- 172.21.15.5:0/3351183370 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b800f830 con 0x7f73c00cded0 2023-03-03T06:25:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73c87a4700 1 -- 172.21.15.5:0/3351183370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c006b6e0 con 0x7f73c00cded0 2023-03-03T06:25:23.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.650+0000 7f73c87a4700 1 -- 172.21.15.5:0/3351183370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c00af4b0 con 0x7f73c00cded0 2023-03-03T06:25:23.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.651+0000 7f73c87a4700 1 -- 172.21.15.5:0/3351183370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c006b9c0 con 0x7f73c00cded0 2023-03-03T06:25:23.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.652+0000 7f73b6ffd700 1 -- 172.21.15.5:0/3351183370 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f73b8009030 con 0x7f73c00cded0 2023-03-03T06:25:23.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.652+0000 7f73b6ffd700 1 --2- 172.21.15.5:0/3351183370 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f73a40682f0 0x7f73a406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:23.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.653+0000 7f73c6540700 1 --2- 172.21.15.5:0/3351183370 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f73a40682f0 0x7f73a406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:23.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.653+0000 7f73b6ffd700 1 -- 172.21.15.5:0/3351183370 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6253+0+0 (secure 0 0 0) 0x7f73b8086620 con 0x7f73c00cded0 2023-03-03T06:25:23.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.653+0000 7f73c6540700 1 --2- 172.21.15.5:0/3351183370 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f73a40682f0 0x7f73a406a7a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f73c00c6e40 tx=0x7f73b0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:23.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.657+0000 7f73b6ffd700 1 -- 172.21.15.5:0/3351183370 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f73b8052c70 con 0x7f73c00cded0 2023-03-03T06:25:23.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:23.851+0000 7f73c87a4700 1 -- 172.21.15.5:0/3351183370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f73c00ac4e0 con 0x7f73c00cded0 2023-03-03T06:25:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.498+0000 7f73b6ffd700 1 -- 172.21.15.5:0/3351183370 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v54) v1 ==== 170+0+0 (secure 0 0 0) 0x7f73c00ac4e0 con 0x7f73c00cded0 2023-03-03T06:25:24.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.502+0000 7f73c87a4700 1 -- 172.21.15.5:0/3351183370 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f73a40682f0 msgr2=0x7f73a406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:24.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.502+0000 7f73c87a4700 1 --2- 172.21.15.5:0/3351183370 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f73a40682f0 0x7f73a406a7a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f73c00c6e40 tx=0x7f73b0008040 comp rx=0 tx=0).stop 2023-03-03T06:25:24.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.502+0000 7f73c87a4700 1 -- 172.21.15.5:0/3351183370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c00cded0 msgr2=0x7f73c00c4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:24.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.502+0000 7f73c87a4700 1 --2- 172.21.15.5:0/3351183370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c00cded0 0x7f73c00c4d40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f73b800ccf0 tx=0x7f73b800a280 comp rx=0 tx=0).stop 2023-03-03T06:25:24.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.503+0000 7f73c87a4700 1 -- 172.21.15.5:0/3351183370 shutdown_connections 2023-03-03T06:25:24.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.503+0000 7f73c87a4700 1 --2- 172.21.15.5:0/3351183370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c00cded0 0x7f73c00c4d40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:24.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.503+0000 7f73c87a4700 1 --2- 172.21.15.5:0/3351183370 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f73a40682f0 0x7f73a406a7a0 secure :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f73c00c6e40 tx=0x7f73b0008040 comp rx=0 tx=0).stop 2023-03-03T06:25:24.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.503+0000 7f73c87a4700 1 --2- 172.21.15.5:0/3351183370 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f73c00af0e0 0x7f73c01572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:24.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.503+0000 7f73c87a4700 1 --2- 172.21.15.5:0/3351183370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73c00cd350 0x7f73c00c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:24.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.503+0000 7f73c87a4700 1 -- 172.21.15.5:0/3351183370 >> 172.21.15.5:0/3351183370 conn(0x7f73c00cc840 msgr2=0x7f73c00ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:24.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.503+0000 7f73c87a4700 1 -- 172.21.15.5:0/3351183370 shutdown_connections 2023-03-03T06:25:24.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.504+0000 7f73c87a4700 1 -- 172.21.15.5:0/3351183370 wait complete. 2023-03-03T06:25:24.508 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-03-03T06:25:24.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-03T06:25:24.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.661+0000 7f6d7a3b0700 1 Processor -- start 2023-03-03T06:25:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.661+0000 7f6d7a3b0700 1 -- start start 2023-03-03T06:25:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.662+0000 7f6d7a3b0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d7415cd40 0x7f6d7406cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.662+0000 7f6d7a3b0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d740cb050 0x7f6d740cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.662+0000 7f6d7a3b0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d740cb990 con 0x7f6d740b1960 2023-03-03T06:25:24.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.662+0000 7f6d7a3b0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d7415d110 con 0x7f6d7415cd40 2023-03-03T06:25:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.662+0000 7f6d7a3b0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7406bf10 con 0x7f6d740cb050 2023-03-03T06:25:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.662+0000 7f6d737fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f6d740b1960 0x7f6d7406b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34282/0 (socket says 172.21.15.5:34282) 2023-03-03T06:25:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.662+0000 7f6d73fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6d7415cd40 0x7f6d7406cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.662+0000 7f6d737fe700 1 -- 172.21.15.5:0/3587631770 learned_addr learned my addr 172.21.15.5:0/3587631770 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.663+0000 7f6d7894d700 1 --2- 172.21.15.5:0/3587631770 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d740cb050 0x7f6d740cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:24.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.663+0000 7f6d72ffd700 1 -- 172.21.15.5:0/3587631770 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247160108 0 0) 0x7f6d740cb990 con 0x7f6d740b1960 2023-03-03T06:25:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.663+0000 7f6d72ffd700 1 -- 172.21.15.5:0/3587631770 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d600035b0 con 0x7f6d740b1960 2023-03-03T06:25:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.663+0000 7f6d73fff700 1 -- 172.21.15.5:0/3587631770 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d740cb050 msgr2=0x7f6d740cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.663+0000 7f6d73fff700 1 --2- 172.21.15.5:0/3587631770 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d740cb050 0x7f6d740cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.663+0000 7f6d73fff700 1 -- 172.21.15.5:0/3587631770 >> v1:172.21.15.5:6789/0 conn(0x7f6d740b1960 legacy=0x7f6d7406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.663+0000 7f6d73fff700 1 -- 172.21.15.5:0/3587631770 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7406c1f0 con 0x7f6d7415cd40 2023-03-03T06:25:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.663+0000 7f6d73fff700 1 --2- 172.21.15.5:0/3587631770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d7415cd40 0x7f6d7406cfb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009840 tx=0x7f6d64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a0da37642b3d7f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.663+0000 7f6d72ffd700 1 -- 172.21.15.5:0/3587631770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64011830 con 0x7f6d7415cd40 2023-03-03T06:25:24.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.663+0000 7f6d72ffd700 1 -- 172.21.15.5:0/3587631770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d64011990 con 0x7f6d7415cd40 2023-03-03T06:25:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.663+0000 7f6d72ffd700 1 -- 172.21.15.5:0/3587631770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64011d20 con 0x7f6d7415cd40 2023-03-03T06:25:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.664+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/3587631770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d7415cd40 msgr2=0x7f6d7406cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.664+0000 7f6d7a3b0700 1 --2- 172.21.15.5:0/3587631770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d7415cd40 0x7f6d7406cfb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009840 tx=0x7f6d64009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.664+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/3587631770 shutdown_connections 2023-03-03T06:25:24.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.664+0000 7f6d7a3b0700 1 --2- 172.21.15.5:0/3587631770 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d740cb050 0x7f6d740cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.664+0000 7f6d7a3b0700 1 --2- 172.21.15.5:0/3587631770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d7415cd40 0x7f6d7406cfb0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.664+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/3587631770 >> 172.21.15.5:0/3587631770 conn(0x7f6d740cc8d0 msgr2=0x7f6d740cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.664+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/3587631770 shutdown_connections 2023-03-03T06:25:24.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.664+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/3587631770 wait complete. 2023-03-03T06:25:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.665+0000 7f6d7a3b0700 1 Processor -- start 2023-03-03T06:25:24.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.665+0000 7f6d7a3b0700 1 -- start start 2023-03-03T06:25:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7a3b0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d740b1960 0x7f6d740c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7a3b0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d740cb050 0x7f6d740c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7a3b0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d7415cd40 0x7f6d740b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7a3b0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740b5630 con 0x7f6d7415cd40 2023-03-03T06:25:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7a3b0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740b5880 con 0x7f6d740b1960 2023-03-03T06:25:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7a3b0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740b5b60 con 0x7f6d740cb050 2023-03-03T06:25:24.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7894d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d7415cd40 0x7f6d740b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7894d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d7415cd40 0x7f6d740b3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44450/0 (socket says 172.21.15.5:44450) 2023-03-03T06:25:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7894d700 1 -- 172.21.15.5:0/1065773709 learned_addr learned my addr 172.21.15.5:0/1065773709 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d737fe700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d740cb050 0x7f6d740c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d73fff700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d740b1960 0x7f6d740c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7894d700 1 -- 172.21.15.5:0/1065773709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d740cb050 msgr2=0x7f6d740c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7894d700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d740cb050 0x7f6d740c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7894d700 1 -- 172.21.15.5:0/1065773709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d740b1960 msgr2=0x7f6d740c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:24.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7894d700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d740b1960 0x7f6d740c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7894d700 1 -- 172.21.15.5:0/1065773709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d640094a0 con 0x7f6d7415cd40 2023-03-03T06:25:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d73fff700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d740b1960 0x7f6d740c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d737fe700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d740cb050 0x7f6d740c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.666+0000 7f6d7894d700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d7415cd40 0x7f6d740b3970 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00efc0 tx=0x7f6d6c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.667+0000 7f6d70ff9700 1 -- 172.21.15.5:0/1065773709 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c00cd40 con 0x7f6d7415cd40 2023-03-03T06:25:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.667+0000 7f6d70ff9700 1 -- 172.21.15.5:0/1065773709 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c00f040 con 0x7f6d7415cd40 2023-03-03T06:25:24.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.667+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/1065773709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d7406c7b0 con 0x7f6d7415cd40 2023-03-03T06:25:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.667+0000 7f6d70ff9700 1 -- 172.21.15.5:0/1065773709 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0146c0 con 0x7f6d7415cd40 2023-03-03T06:25:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.667+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/1065773709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7406c4d0 con 0x7f6d7415cd40 2023-03-03T06:25:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.668+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/1065773709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d7406ca90 con 0x7f6d7415cd40 2023-03-03T06:25:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.668+0000 7f6d70ff9700 1 -- 172.21.15.5:0/1065773709 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6d6c014820 con 0x7f6d7415cd40 2023-03-03T06:25:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.669+0000 7f6d70ff9700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6d540682f0 0x7f6d5406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.669+0000 7f6d70ff9700 1 -- 172.21.15.5:0/1065773709 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6635+0+0 (secure 0 0 0) 0x7f6d6c086d30 con 0x7f6d7415cd40 2023-03-03T06:25:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.669+0000 7f6d73fff700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6d540682f0 0x7f6d5406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:24.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.669+0000 7f6d73fff700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6d540682f0 0x7f6d5406a7a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6d64000c00 tx=0x7f6d6401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:24.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.673+0000 7f6d70ff9700 1 -- 172.21.15.5:0/1065773709 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6d6c053260 con 0x7f6d7415cd40 2023-03-03T06:25:24.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.914+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/1065773709 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6d7404e6e0 con 0x7f6d7415cd40 2023-03-03T06:25:24.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.918+0000 7f6d70ff9700 1 -- 172.21.15.5:0/1065773709 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v21) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6d6c0180c0 con 0x7f6d7415cd40 2023-03-03T06:25:24.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.926+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/1065773709 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6d540682f0 msgr2=0x7f6d5406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:24.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.926+0000 7f6d7a3b0700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6d540682f0 0x7f6d5406a7a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6d64000c00 tx=0x7f6d6401c040 comp rx=0 tx=0).stop 2023-03-03T06:25:24.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.926+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/1065773709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d7415cd40 msgr2=0x7f6d740b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:24.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.926+0000 7f6d7a3b0700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d7415cd40 0x7f6d740b3970 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00efc0 tx=0x7f6d6c00c3a0 comp rx=0 tx=0).stop 2023-03-03T06:25:24.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.926+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/1065773709 shutdown_connections 2023-03-03T06:25:24.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.926+0000 7f6d7a3b0700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6d7415cd40 0x7f6d740b3970 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:24.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.926+0000 7f6d7a3b0700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6d740b1960 0x7f6d740c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:24.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.926+0000 7f6d7a3b0700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6d540682f0 0x7f6d5406a7a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:24.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.926+0000 7f6d7a3b0700 1 --2- 172.21.15.5:0/1065773709 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6d740cb050 0x7f6d740c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:24.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.926+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/1065773709 >> 172.21.15.5:0/1065773709 conn(0x7f6d740cc8d0 msgr2=0x7f6d7415c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:24.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.927+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/1065773709 shutdown_connections 2023-03-03T06:25:24.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:24.927+0000 7f6d7a3b0700 1 -- 172.21.15.5:0/1065773709 wait complete. 2023-03-03T06:25:24.934 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 9 and data pool 10 2023-03-03T06:25:24.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.075+0000 7f8b79f1d700 1 Processor -- start 2023-03-03T06:25:25.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.075+0000 7f8b79f1d700 1 -- start start 2023-03-03T06:25:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b79f1d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b7415cd40 0x7f8b740b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b79f1d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8b740cba50 0x7f8b740b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b79f1d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7415d4e0 con 0x7f8b740cd3e0 2023-03-03T06:25:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b79f1d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7415d7c0 con 0x7f8b7415cd40 2023-03-03T06:25:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b79f1d700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7415daa0 con 0x7f8b740cba50 2023-03-03T06:25:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b737fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8b7415cd40 0x7f8b740b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b73fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f8b740cd3e0 0x7f8b74160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34298/0 (socket says 172.21.15.5:34298) 2023-03-03T06:25:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b73fff700 1 -- 172.21.15.5:0/1573497961 learned_addr learned my addr 172.21.15.5:0/1573497961 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:25.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b72ffd700 1 --2- 172.21.15.5:0/1573497961 >> v2:172.21.15.191:3300/0 conn(0x7f8b740cba50 0x7f8b740b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b737fe700 1 -- 172.21.15.5:0/1573497961 >> v2:172.21.15.191:3300/0 conn(0x7f8b740cba50 msgr2=0x7f8b740b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:25.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b737fe700 1 --2- 172.21.15.5:0/1573497961 >> v2:172.21.15.191:3300/0 conn(0x7f8b740cba50 0x7f8b740b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b737fe700 1 -- 172.21.15.5:0/1573497961 >> v1:172.21.15.5:6789/0 conn(0x7f8b740cd3e0 legacy=0x7f8b74160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b727fc700 1 -- 172.21.15.5:0/1573497961 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534034854 0 0) 0x7f8b7415d4e0 con 0x7f8b740cd3e0 2023-03-03T06:25:25.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.076+0000 7f8b737fe700 1 -- 172.21.15.5:0/1573497961 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7415dd80 con 0x7f8b7415cd40 2023-03-03T06:25:25.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.077+0000 7f8b737fe700 1 --2- 172.21.15.5:0/1573497961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7415cd40 0x7f8b740b18d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8b740c6ed0 tx=0x7f8b5c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819609d9bc6b75d6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:25.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.077+0000 7f8b727fc700 1 -- 172.21.15.5:0/1573497961 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c011830 con 0x7f8b7415cd40 2023-03-03T06:25:25.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.077+0000 7f8b727fc700 1 -- 172.21.15.5:0/1573497961 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c011990 con 0x7f8b7415cd40 2023-03-03T06:25:25.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.077+0000 7f8b727fc700 1 -- 172.21.15.5:0/1573497961 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c011d20 con 0x7f8b7415cd40 2023-03-03T06:25:25.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.077+0000 7f8b79f1d700 1 -- 172.21.15.5:0/1573497961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7415cd40 msgr2=0x7f8b740b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.077+0000 7f8b79f1d700 1 --2- 172.21.15.5:0/1573497961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7415cd40 0x7f8b740b18d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8b740c6ed0 tx=0x7f8b5c009b20 comp rx=0 tx=0).stop 2023-03-03T06:25:25.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.077+0000 7f8b79f1d700 1 -- 172.21.15.5:0/1573497961 shutdown_connections 2023-03-03T06:25:25.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.077+0000 7f8b79f1d700 1 --2- 172.21.15.5:0/1573497961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b7415cd40 0x7f8b740b18d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.077+0000 7f8b79f1d700 1 --2- 172.21.15.5:0/1573497961 >> v2:172.21.15.191:3300/0 conn(0x7f8b740cba50 0x7f8b740b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.077+0000 7f8b79f1d700 1 -- 172.21.15.5:0/1573497961 >> 172.21.15.5:0/1573497961 conn(0x7f8b740cc8d0 msgr2=0x7f8b740cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:25.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.077+0000 7f8b79f1d700 1 -- 172.21.15.5:0/1573497961 shutdown_connections 2023-03-03T06:25:25.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.077+0000 7f8b79f1d700 1 -- 172.21.15.5:0/1573497961 wait complete. 2023-03-03T06:25:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.079+0000 7f8b79f1d700 1 Processor -- start 2023-03-03T06:25:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.079+0000 7f8b79f1d700 1 -- start start 2023-03-03T06:25:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.079+0000 7f8b79f1d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b740cba50 0x7f8b740b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.079+0000 7f8b79f1d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b740cd3e0 0x7f8b74154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.079+0000 7f8b79f1d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b7415cd40 0x7f8b740cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.079+0000 7f8b79f1d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b741551e0 con 0x7f8b740cd3e0 2023-03-03T06:25:25.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.079+0000 7f8b79f1d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b740ce610 con 0x7f8b740cba50 2023-03-03T06:25:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.079+0000 7f8b79f1d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b740ce8f0 con 0x7f8b7415cd40 2023-03-03T06:25:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b72ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b740cd3e0 0x7f8b74154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b72ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b740cd3e0 0x7f8b74154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44460/0 (socket says 172.21.15.5:44460) 2023-03-03T06:25:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b72ffd700 1 -- 172.21.15.5:0/464196452 learned_addr learned my addr 172.21.15.5:0/464196452 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b737fe700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b740cba50 0x7f8b740b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b73fff700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b7415cd40 0x7f8b740cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b72ffd700 1 -- 172.21.15.5:0/464196452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b7415cd40 msgr2=0x7f8b740cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b72ffd700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b7415cd40 0x7f8b740cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b72ffd700 1 -- 172.21.15.5:0/464196452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b740cba50 msgr2=0x7f8b740b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b72ffd700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b740cba50 0x7f8b740b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b72ffd700 1 -- 172.21.15.5:0/464196452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c0094a0 con 0x7f8b740cd3e0 2023-03-03T06:25:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b72ffd700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b740cd3e0 0x7f8b74154ca0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400c7f0 tx=0x7f8b6400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b6bfff700 1 -- 172.21.15.5:0/464196452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64004230 con 0x7f8b740cd3e0 2023-03-03T06:25:25.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b6bfff700 1 -- 172.21.15.5:0/464196452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b64004390 con 0x7f8b740cd3e0 2023-03-03T06:25:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b79f1d700 1 -- 172.21.15.5:0/464196452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b740ca530 con 0x7f8b740cd3e0 2023-03-03T06:25:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b6bfff700 1 -- 172.21.15.5:0/464196452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b640036e0 con 0x7f8b740cd3e0 2023-03-03T06:25:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.080+0000 7f8b79f1d700 1 -- 172.21.15.5:0/464196452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7415e060 con 0x7f8b740cd3e0 2023-03-03T06:25:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.081+0000 7f8b79f1d700 1 -- 172.21.15.5:0/464196452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7415d110 con 0x7f8b740cd3e0 2023-03-03T06:25:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.082+0000 7f8b6bfff700 1 -- 172.21.15.5:0/464196452 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8b64020070 con 0x7f8b740cd3e0 2023-03-03T06:25:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.082+0000 7f8b6bfff700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8b540682f0 0x7f8b5406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.082+0000 7f8b6bfff700 1 -- 172.21.15.5:0/464196452 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8b64085af0 con 0x7f8b740cd3e0 2023-03-03T06:25:25.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.082+0000 7f8b737fe700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8b540682f0 0x7f8b5406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.083+0000 7f8b737fe700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8b540682f0 0x7f8b5406a7a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0090b0 tx=0x7f8b5c01c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:25.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.086+0000 7f8b6bfff700 1 -- 172.21.15.5:0/464196452 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8b640520b0 con 0x7f8b740cd3e0 2023-03-03T06:25:25.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.282+0000 7f8b79f1d700 1 -- 172.21.15.5:0/464196452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b7404e6e0 con 0x7f8b740cd3e0 2023-03-03T06:25:25.285 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.283+0000 7f8b6bfff700 1 -- 172.21.15.5:0/464196452 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+19686 (secure 0 0 0) 0x7f8b6401e090 con 0x7f8b740cd3e0 2023-03-03T06:25:25.286 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:25.286 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:24.915774+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:23.205830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:23.882328+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:25.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.285+0000 7f8b79f1d700 1 -- 172.21.15.5:0/464196452 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8b540682f0 msgr2=0x7f8b5406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.285+0000 7f8b79f1d700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8b540682f0 0x7f8b5406a7a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0090b0 tx=0x7f8b5c01c040 comp rx=0 tx=0).stop 2023-03-03T06:25:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.285+0000 7f8b79f1d700 1 -- 172.21.15.5:0/464196452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b740cd3e0 msgr2=0x7f8b74154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.285+0000 7f8b79f1d700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b740cd3e0 0x7f8b74154ca0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8b6400c7f0 tx=0x7f8b6400cb00 comp rx=0 tx=0).stop 2023-03-03T06:25:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.285+0000 7f8b79f1d700 1 -- 172.21.15.5:0/464196452 shutdown_connections 2023-03-03T06:25:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.285+0000 7f8b79f1d700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8b540682f0 0x7f8b5406a7a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.285+0000 7f8b79f1d700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8b7415cd40 0x7f8b740cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.285+0000 7f8b79f1d700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b740cba50 0x7f8b740b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.285+0000 7f8b79f1d700 1 --2- 172.21.15.5:0/464196452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b740cd3e0 0x7f8b74154ca0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.285+0000 7f8b79f1d700 1 -- 172.21.15.5:0/464196452 >> 172.21.15.5:0/464196452 conn(0x7f8b740cc8d0 msgr2=0x7f8b740af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.285+0000 7f8b79f1d700 1 -- 172.21.15.5:0/464196452 shutdown_connections 2023-03-03T06:25:25.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.285+0000 7f8b79f1d700 1 -- 172.21.15.5:0/464196452 wait complete. 2023-03-03T06:25:25.300 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:25.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.422+0000 7f714d31a700 1 Processor -- start 2023-03-03T06:25:25.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.422+0000 7f714d31a700 1 -- start start 2023-03-03T06:25:25.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f714d31a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f71480b8a40 0x7f7148160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f714d31a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f714806c830 0x7f71480d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f714d31a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71480d2e10 con 0x7f71480cf2a0 2023-03-03T06:25:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f714d31a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7148161490 con 0x7f714806c830 2023-03-03T06:25:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f714d31a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71480cd8d0 con 0x7f71480b8a40 2023-03-03T06:25:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f71477fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f714806c830 0x7f71480d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f71477fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f714806c830 0x7f71480d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44470/0 (socket says 172.21.15.5:44470) 2023-03-03T06:25:25.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f71477fe700 1 -- 172.21.15.5:0/3042766127 learned_addr learned my addr 172.21.15.5:0/3042766127 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f7146ffd700 1 --2- 172.21.15.5:0/3042766127 >> v2:172.21.15.191:3300/0 conn(0x7f71480b8a40 0x7f7148160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f71477fe700 1 -- 172.21.15.5:0/3042766127 >> v2:172.21.15.191:3300/0 conn(0x7f71480b8a40 msgr2=0x7f7148160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f71477fe700 1 --2- 172.21.15.5:0/3042766127 >> v2:172.21.15.191:3300/0 conn(0x7f71480b8a40 0x7f7148160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f71477fe700 1 -- 172.21.15.5:0/3042766127 >> v1:172.21.15.191:6789/0 conn(0x7f71480cf2a0 legacy=0x7f714806c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f71477fe700 1 -- 172.21.15.5:0/3042766127 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71480d2520 con 0x7f714806c830 2023-03-03T06:25:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f7146ffd700 1 --2- 172.21.15.5:0/3042766127 >> v2:172.21.15.191:3300/0 conn(0x7f71480b8a40 0x7f7148160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.423+0000 7f71477fe700 1 --2- 172.21.15.5:0/3042766127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f714806c830 0x7f71480d0c20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f71480b5bf0 tx=0x7f714000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83669184781f3021 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.424+0000 7f7145ffb700 1 -- 172.21.15.5:0/3042766127 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714000e070 con 0x7f714806c830 2023-03-03T06:25:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.424+0000 7f7145ffb700 1 -- 172.21.15.5:0/3042766127 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140003a20 con 0x7f714806c830 2023-03-03T06:25:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.424+0000 7f7145ffb700 1 -- 172.21.15.5:0/3042766127 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140003dd0 con 0x7f714806c830 2023-03-03T06:25:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.424+0000 7f714d31a700 1 -- 172.21.15.5:0/3042766127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f714806c830 msgr2=0x7f71480d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.424+0000 7f714d31a700 1 --2- 172.21.15.5:0/3042766127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f714806c830 0x7f71480d0c20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f71480b5bf0 tx=0x7f714000b330 comp rx=0 tx=0).stop 2023-03-03T06:25:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.424+0000 7f714d31a700 1 -- 172.21.15.5:0/3042766127 shutdown_connections 2023-03-03T06:25:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.424+0000 7f714d31a700 1 --2- 172.21.15.5:0/3042766127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f714806c830 0x7f71480d0c20 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.424+0000 7f714d31a700 1 --2- 172.21.15.5:0/3042766127 >> v2:172.21.15.191:3300/0 conn(0x7f71480b8a40 0x7f7148160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.424+0000 7f714d31a700 1 -- 172.21.15.5:0/3042766127 >> 172.21.15.5:0/3042766127 conn(0x7f71480d05d0 msgr2=0x7f71480d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.424+0000 7f714d31a700 1 -- 172.21.15.5:0/3042766127 shutdown_connections 2023-03-03T06:25:25.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.424+0000 7f714d31a700 1 -- 172.21.15.5:0/3042766127 wait complete. 2023-03-03T06:25:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.426+0000 7f714d31a700 1 Processor -- start 2023-03-03T06:25:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.426+0000 7f714d31a700 1 -- start start 2023-03-03T06:25:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.426+0000 7f714d31a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f714806c830 0x7f71480ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.426+0000 7f714d31a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71480b8a40 0x7f71480b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.426+0000 7f714d31a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71480cf2a0 0x7f71480b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.426+0000 7f714d31a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71480cb1f0 con 0x7f71480b8a40 2023-03-03T06:25:25.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.426+0000 7f714d31a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71481f29d0 con 0x7f71480cf2a0 2023-03-03T06:25:25.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.426+0000 7f714d31a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71481f2100 con 0x7f714806c830 2023-03-03T06:25:25.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.426+0000 7f71467fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71480b8a40 0x7f71480b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.426+0000 7f71467fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71480b8a40 0x7f71480b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44472/0 (socket says 172.21.15.5:44472) 2023-03-03T06:25:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.426+0000 7f71467fc700 1 -- 172.21.15.5:0/905998782 learned_addr learned my addr 172.21.15.5:0/905998782 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.427+0000 7f71477fe700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71480cf2a0 0x7f71480b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.427+0000 7f7146ffd700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f714806c830 0x7f71480ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.427+0000 7f71467fc700 1 -- 172.21.15.5:0/905998782 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f714806c830 msgr2=0x7f71480ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.427+0000 7f71467fc700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f714806c830 0x7f71480ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.427+0000 7f71467fc700 1 -- 172.21.15.5:0/905998782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71480cf2a0 msgr2=0x7f71480b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.427+0000 7f71467fc700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71480cf2a0 0x7f71480b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.427+0000 7f71467fc700 1 -- 172.21.15.5:0/905998782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7140009b30 con 0x7f71480b8a40 2023-03-03T06:25:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.427+0000 7f71467fc700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71480b8a40 0x7f71480b3bd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f713c00c4d0 tx=0x7f713c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.427+0000 7f712f7fe700 1 -- 172.21.15.5:0/905998782 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c011790 con 0x7f71480b8a40 2023-03-03T06:25:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.427+0000 7f712f7fe700 1 -- 172.21.15.5:0/905998782 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c0118f0 con 0x7f71480b8a40 2023-03-03T06:25:25.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.427+0000 7f714d31a700 1 -- 172.21.15.5:0/905998782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71480d2850 con 0x7f71480b8a40 2023-03-03T06:25:25.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.427+0000 7f712f7fe700 1 -- 172.21.15.5:0/905998782 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c011ca0 con 0x7f71480b8a40 2023-03-03T06:25:25.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.427+0000 7f714d31a700 1 -- 172.21.15.5:0/905998782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714815ce30 con 0x7f71480b8a40 2023-03-03T06:25:25.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.428+0000 7f714d31a700 1 -- 172.21.15.5:0/905998782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71480d2b30 con 0x7f71480b8a40 2023-03-03T06:25:25.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.428+0000 7f712f7fe700 1 -- 172.21.15.5:0/905998782 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f713c010050 con 0x7f71480b8a40 2023-03-03T06:25:25.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.429+0000 7f712f7fe700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f71340682f0 0x7f713406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.429+0000 7f712f7fe700 1 -- 172.21.15.5:0/905998782 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f713c085ad0 con 0x7f71480b8a40 2023-03-03T06:25:25.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.429+0000 7f7146ffd700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f71340682f0 0x7f713406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.429+0000 7f7146ffd700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f71340682f0 0x7f713406a7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7138006fd0 tx=0x7f7138008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:25.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.433+0000 7f712f7fe700 1 -- 172.21.15.5:0/905998782 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f713c052090 con 0x7f71480b8a40 2023-03-03T06:25:25.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.628+0000 7f714d31a700 1 -- 172.21.15.5:0/905998782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f714804e6e0 con 0x7f71480b8a40 2023-03-03T06:25:25.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.629+0000 7f712f7fe700 1 -- 172.21.15.5:0/905998782 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+19686 (secure 0 0 0) 0x7f713c0556b0 con 0x7f71480b8a40 2023-03-03T06:25:25.632 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:25.632 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":55,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:24.915774+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:23.205830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:23.882328+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.631+0000 7f714d31a700 1 -- 172.21.15.5:0/905998782 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f71340682f0 msgr2=0x7f713406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.631+0000 7f714d31a700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f71340682f0 0x7f713406a7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7138006fd0 tx=0x7f7138008040 comp rx=0 tx=0).stop 2023-03-03T06:25:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.631+0000 7f714d31a700 1 -- 172.21.15.5:0/905998782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71480b8a40 msgr2=0x7f71480b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.631+0000 7f714d31a700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71480b8a40 0x7f71480b3bd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f713c00c4d0 tx=0x7f713c00c7e0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.632+0000 7f714d31a700 1 -- 172.21.15.5:0/905998782 shutdown_connections 2023-03-03T06:25:25.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.632+0000 7f714d31a700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71480cf2a0 0x7f71480b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.632+0000 7f714d31a700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f71340682f0 0x7f713406a7a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.632+0000 7f714d31a700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f714806c830 0x7f71480ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.632+0000 7f714d31a700 1 --2- 172.21.15.5:0/905998782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71480b8a40 0x7f71480b3bd0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.632+0000 7f714d31a700 1 -- 172.21.15.5:0/905998782 >> 172.21.15.5:0/905998782 conn(0x7f71480d05d0 msgr2=0x7f71480b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.632+0000 7f714d31a700 1 -- 172.21.15.5:0/905998782 shutdown_connections 2023-03-03T06:25:25.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.632+0000 7f714d31a700 1 -- 172.21.15.5:0/905998782 wait complete. 2023-03-03T06:25:25.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-03T06:25:25.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.773+0000 7fbccddc6700 1 Processor -- start 2023-03-03T06:25:25.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.773+0000 7fbccddc6700 1 -- start start 2023-03-03T06:25:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.774+0000 7fbccddc6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbcc815e230 0x7fbcc80b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.774+0000 7fbccddc6700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc80c9f70 con 0x7fbcc806d580 2023-03-03T06:25:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.774+0000 7fbccddc6700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc815e7a0 con 0x7fbcc815a8d0 2023-03-03T06:25:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.774+0000 7fbccddc6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc815ea80 con 0x7fbcc815e230 2023-03-03T06:25:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.774+0000 7fbcc7fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbcc806d580 0x7fbcc80ca400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34324/0 (socket says 172.21.15.5:34324) 2023-03-03T06:25:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.774+0000 7fbcc7fff700 1 -- 172.21.15.5:0/2066199097 learned_addr learned my addr 172.21.15.5:0/2066199097 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.774+0000 7fbcc6ffd700 1 --2- 172.21.15.5:0/2066199097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbcc815e230 0x7fbcc80b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.774+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574087861 0 0) 0x7fbcc80c9f70 con 0x7fbcc806d580 2023-03-03T06:25:25.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.774+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcb00035b0 con 0x7fbcc806d580 2023-03-03T06:25:25.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.774+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4044144940 0 0) 0x7fbcb00035b0 con 0x7fbcc806d580 2023-03-03T06:25:25.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.774+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbcc815e230 msgr2=0x7fbcc80b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:25.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.774+0000 7fbcc67fc700 1 --2- 172.21.15.5:0/2066199097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbcc815e230 0x7fbcc80b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.774+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 >> v1:172.21.15.191:6789/0 conn(0x7fbcc815a8d0 legacy=0x7fbcc80cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc815ed60 con 0x7fbcc806d580 2023-03-03T06:25:25.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fbcc00019f0 con 0x7fbcc806d580 2023-03-03T06:25:25.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 >> v1:172.21.15.5:6789/0 conn(0x7fbcc806d580 legacy=0x7fbcc80ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc67fc700 1 --2- 172.21.15.5:0/2066199097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb0003a30 0x7fbcb0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc67fc700 1 --2- 172.21.15.5:0/2066199097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb0004850 0x7fbcb0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc67fc700 1 --2- 172.21.15.5:0/2066199097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbcc815e230 0x7fbcb0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc815ea80 con 0x7fbcb0004850 2023-03-03T06:25:25.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb000bb10 con 0x7fbcb0003a30 2023-03-03T06:25:25.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb000bcd0 con 0x7fbcc815e230 2023-03-03T06:25:25.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc6ffd700 1 --2- 172.21.15.5:0/2066199097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb0004850 0x7fbcb0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc77fe700 1 --2- 172.21.15.5:0/2066199097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb0003a30 0x7fbcb0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc7fff700 1 --2- 172.21.15.5:0/2066199097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbcc815e230 0x7fbcb0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc6ffd700 1 -- 172.21.15.5:0/2066199097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbcc815e230 msgr2=0x7fbcb0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:25.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc6ffd700 1 --2- 172.21.15.5:0/2066199097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbcc815e230 0x7fbcb0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc6ffd700 1 -- 172.21.15.5:0/2066199097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb0003a30 msgr2=0x7fbcb0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:25.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc6ffd700 1 --2- 172.21.15.5:0/2066199097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb0003a30 0x7fbcb0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc6ffd700 1 -- 172.21.15.5:0/2066199097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb00035b0 con 0x7fbcb0004850 2023-03-03T06:25:25.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc6ffd700 1 --2- 172.21.15.5:0/2066199097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb0004850 0x7fbcb0004cc0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009b60 tx=0x7fbcb0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9025d537070d264d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:25.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb800e6c0 con 0x7fbcb0004850 2023-03-03T06:25:25.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb800e820 con 0x7fbcb0004850 2023-03-03T06:25:25.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.775+0000 7fbcc67fc700 1 -- 172.21.15.5:0/2066199097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb800eb90 con 0x7fbcb0004850 2023-03-03T06:25:25.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.776+0000 7fbccddc6700 1 -- 172.21.15.5:0/2066199097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb0004850 msgr2=0x7fbcb0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.776+0000 7fbccddc6700 1 --2- 172.21.15.5:0/2066199097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb0004850 0x7fbcb0004cc0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009b60 tx=0x7fbcb0005880 comp rx=0 tx=0).stop 2023-03-03T06:25:25.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.776+0000 7fbcc7fff700 1 -- 172.21.15.5:0/2066199097 reap_dead start 2023-03-03T06:25:25.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.776+0000 7fbccddc6700 1 -- 172.21.15.5:0/2066199097 shutdown_connections 2023-03-03T06:25:25.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.776+0000 7fbccddc6700 1 -- 172.21.15.5:0/2066199097 >> 172.21.15.5:0/2066199097 conn(0x7fbcc80cf4b0 msgr2=0x7fbcc80cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:25.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.776+0000 7fbccddc6700 1 -- 172.21.15.5:0/2066199097 shutdown_connections 2023-03-03T06:25:25.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.776+0000 7fbccddc6700 1 -- 172.21.15.5:0/2066199097 wait complete. 2023-03-03T06:25:25.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.777+0000 7fbccddc6700 1 Processor -- start 2023-03-03T06:25:25.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.777+0000 7fbccddc6700 1 -- start start 2023-03-03T06:25:25.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.778+0000 7fbccddc6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb0004850 0x7fbcc8151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.778+0000 7fbccddc6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc80acd10 0x7fbcc80ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.778+0000 7fbccddc6700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbcc80ce6f0 0x7fbcc80ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.778+0000 7fbccddc6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc80ade00 con 0x7fbcc80acd10 2023-03-03T06:25:25.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.778+0000 7fbccddc6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc80cf0b0 con 0x7fbcb0004850 2023-03-03T06:25:25.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.778+0000 7fbccddc6700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc8152160 con 0x7fbcc80ce6f0 2023-03-03T06:25:25.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.778+0000 7fbcc6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc80acd10 0x7fbcc80ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.778+0000 7fbcc6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc80acd10 0x7fbcc80ac2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44492/0 (socket says 172.21.15.5:44492) 2023-03-03T06:25:25.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.778+0000 7fbcc6ffd700 1 -- 172.21.15.5:0/1877200890 learned_addr learned my addr 172.21.15.5:0/1877200890 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:25.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.778+0000 7fbcc7fff700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbcc80ce6f0 0x7fbcc80ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.778+0000 7fbcc77fe700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb0004850 0x7fbcc8151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.779+0000 7fbcc6ffd700 1 -- 172.21.15.5:0/1877200890 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbcc80ce6f0 msgr2=0x7fbcc80ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.779+0000 7fbcc6ffd700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbcc80ce6f0 0x7fbcc80ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.779+0000 7fbcc6ffd700 1 -- 172.21.15.5:0/1877200890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb0004850 msgr2=0x7fbcc8151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:25.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.779+0000 7fbcc6ffd700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb0004850 0x7fbcc8151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:25.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.779+0000 7fbcc6ffd700 1 -- 172.21.15.5:0/1877200890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc80cab10 con 0x7fbcc80acd10 2023-03-03T06:25:25.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.779+0000 7fbcc6ffd700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc80acd10 0x7fbcc80ac2e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000bae0 tx=0x7fbcb80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:25.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.779+0000 7fbcaffff700 1 -- 172.21.15.5:0/1877200890 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb800e6c0 con 0x7fbcc80acd10 2023-03-03T06:25:25.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.779+0000 7fbcaffff700 1 -- 172.21.15.5:0/1877200890 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb8003ab0 con 0x7fbcc80acd10 2023-03-03T06:25:25.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.779+0000 7fbccddc6700 1 -- 172.21.15.5:0/1877200890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc815f040 con 0x7fbcc80acd10 2023-03-03T06:25:25.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.779+0000 7fbcaffff700 1 -- 172.21.15.5:0/1877200890 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8003e60 con 0x7fbcc80acd10 2023-03-03T06:25:25.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.779+0000 7fbccddc6700 1 -- 172.21.15.5:0/1877200890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc80caca0 con 0x7fbcc80acd10 2023-03-03T06:25:25.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.780+0000 7fbccddc6700 1 -- 172.21.15.5:0/1877200890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc804e6e0 con 0x7fbcc80acd10 2023-03-03T06:25:25.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.780+0000 7fbcaffff700 1 -- 172.21.15.5:0/1877200890 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbcb8025070 con 0x7fbcc80acd10 2023-03-03T06:25:25.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.781+0000 7fbcaffff700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbcb40682f0 0x7fbcb406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:25.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.781+0000 7fbcaffff700 1 -- 172.21.15.5:0/1877200890 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbcb8087840 con 0x7fbcc80acd10 2023-03-03T06:25:25.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.781+0000 7fbcc77fe700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbcb40682f0 0x7fbcb406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:25.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.781+0000 7fbcc77fe700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbcb40682f0 0x7fbcb406a7a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80ca440 tx=0x7fbcbc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:25.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:25.785+0000 7fbcaffff700 1 -- 172.21.15.5:0/1877200890 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbcb8053eb0 con 0x7fbcc80acd10 2023-03-03T06:25:26.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.028+0000 7fbccddc6700 1 -- 172.21.15.5:0/1877200890 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbcc80ae7f0 con 0x7fbcc80acd10 2023-03-03T06:25:26.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.929+0000 7fbcaffff700 1 -- 172.21.15.5:0/1877200890 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbcb80574d0 con 0x7fbcc80acd10 2023-03-03T06:25:26.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.931+0000 7fbccddc6700 1 -- 172.21.15.5:0/1877200890 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbcb40682f0 msgr2=0x7fbcb406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:26.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.931+0000 7fbccddc6700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbcb40682f0 0x7fbcb406a7a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80ca440 tx=0x7fbcbc009040 comp rx=0 tx=0).stop 2023-03-03T06:25:26.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.931+0000 7fbccddc6700 1 -- 172.21.15.5:0/1877200890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc80acd10 msgr2=0x7fbcc80ac2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:26.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.931+0000 7fbccddc6700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc80acd10 0x7fbcc80ac2e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000bae0 tx=0x7fbcb80047c0 comp rx=0 tx=0).stop 2023-03-03T06:25:26.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.931+0000 7fbccddc6700 1 -- 172.21.15.5:0/1877200890 shutdown_connections 2023-03-03T06:25:26.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.931+0000 7fbccddc6700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbcb40682f0 0x7fbcb406a7a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:26.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.931+0000 7fbccddc6700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbcc80ce6f0 0x7fbcc80ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:26.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.931+0000 7fbccddc6700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbcb0004850 0x7fbcc8151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:26.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.931+0000 7fbccddc6700 1 --2- 172.21.15.5:0/1877200890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc80acd10 0x7fbcc80ac2e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:26.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.932+0000 7fbccddc6700 1 -- 172.21.15.5:0/1877200890 >> 172.21.15.5:0/1877200890 conn(0x7fbcc80cf4b0 msgr2=0x7fbcc80aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:26.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.932+0000 7fbccddc6700 1 -- 172.21.15.5:0/1877200890 shutdown_connections 2023-03-03T06:25:26.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:26.932+0000 7fbccddc6700 1 -- 172.21.15.5:0/1877200890 wait complete. 2023-03-03T06:25:26.948 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-03-03T06:25:26.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-03T06:25:27.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.081+0000 7fdcaa4da700 1 Processor -- start 2023-03-03T06:25:27.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.081+0000 7fdcaa4da700 1 -- start start 2023-03-03T06:25:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.082+0000 7fdcaa4da700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdca415a410 0x7fdca40d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.082+0000 7fdcaa4da700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cd890 0x7fdca40cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.082+0000 7fdcaa4da700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca40cb4a0 con 0x7fdca415a7e0 2023-03-03T06:25:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.082+0000 7fdcaa4da700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca40cebe0 con 0x7fdca415a410 2023-03-03T06:25:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.082+0000 7fdcaa4da700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40cb6f0 con 0x7fdca40cd890 2023-03-03T06:25:27.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.082+0000 7fdca37fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdca415a7e0 0x7fdca40cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34340/0 (socket says 172.21.15.5:34340) 2023-03-03T06:25:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.082+0000 7fdca37fe700 1 -- 172.21.15.5:0/1204316689 learned_addr learned my addr 172.21.15.5:0/1204316689 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca8a77700 1 --2- 172.21.15.5:0/1204316689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cd890 0x7fdca40cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234303975 0 0) 0x7fdca40cb4a0 con 0x7fdca415a7e0 2023-03-03T06:25:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca3fff700 1 --2- 172.21.15.5:0/1204316689 >> v2:172.21.15.191:3300/0 conn(0x7fdca415a410 0x7fdca40d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc900035b0 con 0x7fdca415a7e0 2023-03-03T06:25:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 81998116 0 0) 0x7fdc900035b0 con 0x7fdca415a7e0 2023-03-03T06:25:27.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cd890 msgr2=0x7fdca40cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 --2- 172.21.15.5:0/1204316689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cd890 0x7fdca40cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 >> v2:172.21.15.191:3300/0 conn(0x7fdca415a410 msgr2=0x7fdca40d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 --2- 172.21.15.5:0/1204316689 >> v2:172.21.15.191:3300/0 conn(0x7fdca415a410 0x7fdca40d1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca40cb9d0 con 0x7fdca415a7e0 2023-03-03T06:25:27.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fdc8c001670 con 0x7fdca415a7e0 2023-03-03T06:25:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 >> v1:172.21.15.5:6789/0 conn(0x7fdca415a7e0 legacy=0x7fdca40cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 --2- 172.21.15.5:0/1204316689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc90003a00 0x7fdc90003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 --2- 172.21.15.5:0/1204316689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc90004850 0x7fdc90004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:27.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 --2- 172.21.15.5:0/1204316689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cd890 0x7fdc90005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40cebe0 con 0x7fdc90003a00 2023-03-03T06:25:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40cb6f0 con 0x7fdc90004850 2023-03-03T06:25:27.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9000ba40 con 0x7fdca40cd890 2023-03-03T06:25:27.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca3fff700 1 --2- 172.21.15.5:0/1204316689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc90003a00 0x7fdc90003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:27.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca37fe700 1 --2- 172.21.15.5:0/1204316689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc90004850 0x7fdc90004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:27.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca8a77700 1 --2- 172.21.15.5:0/1204316689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cd890 0x7fdc90005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:27.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca3fff700 1 -- 172.21.15.5:0/1204316689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cd890 msgr2=0x7fdc90005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:27.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca3fff700 1 --2- 172.21.15.5:0/1204316689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdca40cd890 0x7fdc90005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:27.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca3fff700 1 -- 172.21.15.5:0/1204316689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc90004850 msgr2=0x7fdc90004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:27.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca3fff700 1 --2- 172.21.15.5:0/1204316689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc90004850 0x7fdc90004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:27.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.083+0000 7fdca3fff700 1 -- 172.21.15.5:0/1204316689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc900035b0 con 0x7fdc90003a00 2023-03-03T06:25:27.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.084+0000 7fdca3fff700 1 --2- 172.21.15.5:0/1204316689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc90003a00 0x7fdc90003e10 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009b60 tx=0x7fdc90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d2646ee038a0e2 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:27.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.084+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9400e6c0 con 0x7fdc90003a00 2023-03-03T06:25:27.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.084+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9400e820 con 0x7fdc90003a00 2023-03-03T06:25:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.084+0000 7fdca2ffd700 1 -- 172.21.15.5:0/1204316689 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9400eb90 con 0x7fdc90003a00 2023-03-03T06:25:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.084+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1204316689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc90003a00 msgr2=0x7fdc90003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:27.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.084+0000 7fdcaa4da700 1 --2- 172.21.15.5:0/1204316689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdc90003a00 0x7fdc90003e10 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009b60 tx=0x7fdc90005880 comp rx=0 tx=0).stop 2023-03-03T06:25:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.084+0000 7fdca8a77700 1 -- 172.21.15.5:0/1204316689 reap_dead start 2023-03-03T06:25:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.084+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1204316689 shutdown_connections 2023-03-03T06:25:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.084+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1204316689 >> 172.21.15.5:0/1204316689 conn(0x7fdca406f3c0 msgr2=0x7fdca406f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:27.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.084+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1204316689 shutdown_connections 2023-03-03T06:25:27.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.084+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1204316689 wait complete. 2023-03-03T06:25:27.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.085+0000 7fdcaa4da700 1 Processor -- start 2023-03-03T06:25:27.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.086+0000 7fdcaa4da700 1 -- start start 2023-03-03T06:25:27.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.086+0000 7fdcaa4da700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc90003a00 0x7fdca40af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:27.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.086+0000 7fdcaa4da700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdca415abe0 0x7fdca40b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.086+0000 7fdcaa4da700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca415b050 0x7fdca40b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.086+0000 7fdcaa4da700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41507e0 con 0x7fdca415b050 2023-03-03T06:25:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.086+0000 7fdcaa4da700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca406c160 con 0x7fdca415abe0 2023-03-03T06:25:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.086+0000 7fdcaa4da700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca406c440 con 0x7fdc90003a00 2023-03-03T06:25:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca8a77700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca415b050 0x7fdca40b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca8a77700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca415b050 0x7fdca40b4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44514/0 (socket says 172.21.15.5:44514) 2023-03-03T06:25:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca8a77700 1 -- 172.21.15.5:0/1132718983 learned_addr learned my addr 172.21.15.5:0/1132718983 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca37fe700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdca415abe0 0x7fdca40b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca3fff700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc90003a00 0x7fdca40af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca8a77700 1 -- 172.21.15.5:0/1132718983 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc90003a00 msgr2=0x7fdca40af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca8a77700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc90003a00 0x7fdca40af190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:27.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca8a77700 1 -- 172.21.15.5:0/1132718983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdca415abe0 msgr2=0x7fdca40b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:27.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca8a77700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdca415abe0 0x7fdca40b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:27.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca8a77700 1 -- 172.21.15.5:0/1132718983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca40cdd10 con 0x7fdca415b050 2023-03-03T06:25:27.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca37fe700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdca415abe0 0x7fdca40b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:27.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca8a77700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca415b050 0x7fdca40b4b40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdca40b6fc0 tx=0x7fdc9c0114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:27.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca0ff9700 1 -- 172.21.15.5:0/1132718983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00e070 con 0x7fdca415b050 2023-03-03T06:25:27.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca0ff9700 1 -- 172.21.15.5:0/1132718983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c003c30 con 0x7fdca415b050 2023-03-03T06:25:27.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1132718983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca40cbcb0 con 0x7fdca415b050 2023-03-03T06:25:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdca0ff9700 1 -- 172.21.15.5:0/1132718983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c003e20 con 0x7fdca415b050 2023-03-03T06:25:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.087+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1132718983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca40cdea0 con 0x7fdca415b050 2023-03-03T06:25:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.088+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1132718983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca406cd70 con 0x7fdca415b050 2023-03-03T06:25:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.089+0000 7fdca0ff9700 1 -- 172.21.15.5:0/1132718983 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdc9c011a10 con 0x7fdca415b050 2023-03-03T06:25:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.089+0000 7fdca0ff9700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdc84068340 0x7fdc8406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:27.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.089+0000 7fdca0ff9700 1 -- 172.21.15.5:0/1132718983 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fdc9c0866a0 con 0x7fdca415b050 2023-03-03T06:25:27.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.089+0000 7fdca3fff700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdc84068340 0x7fdc8406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:27.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.090+0000 7fdca3fff700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdc84068340 0x7fdc8406a7f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400a010 tx=0x7fdc94008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:27.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.093+0000 7fdca0ff9700 1 -- 172.21.15.5:0/1132718983 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdc9c052c10 con 0x7fdca415b050 2023-03-03T06:25:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.334+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1132718983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdca406cf20 con 0x7fdca415b050 2023-03-03T06:25:27.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.934+0000 7fdca0ff9700 1 -- 172.21.15.5:0/1132718983 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdca406cf20 con 0x7fdca415b050 2023-03-03T06:25:27.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.937+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1132718983 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdc84068340 msgr2=0x7fdc8406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:27.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.937+0000 7fdcaa4da700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdc84068340 0x7fdc8406a7f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400a010 tx=0x7fdc94008030 comp rx=0 tx=0).stop 2023-03-03T06:25:27.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.937+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1132718983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca415b050 msgr2=0x7fdca40b4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:27.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.937+0000 7fdcaa4da700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca415b050 0x7fdca40b4b40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fdca40b6fc0 tx=0x7fdc9c0114b0 comp rx=0 tx=0).stop 2023-03-03T06:25:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.937+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1132718983 shutdown_connections 2023-03-03T06:25:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.937+0000 7fdcaa4da700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdca415b050 0x7fdca40b4b40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.937+0000 7fdcaa4da700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdc84068340 0x7fdc8406a7f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.937+0000 7fdcaa4da700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdc90003a00 0x7fdca40af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.937+0000 7fdcaa4da700 1 --2- 172.21.15.5:0/1132718983 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdca415abe0 0x7fdca40b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.937+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1132718983 >> 172.21.15.5:0/1132718983 conn(0x7fdca406f3c0 msgr2=0x7fdca40b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.937+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1132718983 shutdown_connections 2023-03-03T06:25:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:27.937+0000 7fdcaa4da700 1 -- 172.21.15.5:0/1132718983 wait complete. 2023-03-03T06:25:27.954 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-03T06:25:27.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:28.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.083+0000 7fb3d7e91700 1 Processor -- start 2023-03-03T06:25:28.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.084+0000 7fb3d7e91700 1 -- start start 2023-03-03T06:25:28.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d7e91700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb3d00b1fe0 0x7fb3d00cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d7e91700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d01577c0 con 0x7fb3d01573f0 2023-03-03T06:25:28.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d7e91700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d0159e60 con 0x7fb3d015d320 2023-03-03T06:25:28.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d7e91700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d00cc6e0 con 0x7fb3d00b1fe0 2023-03-03T06:25:28.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d5c2d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb3d01573f0 0x7fb3d00cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34360/0 (socket says 172.21.15.5:34360) 2023-03-03T06:25:28.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d5c2d700 1 -- 172.21.15.5:0/20211604 learned_addr learned my addr 172.21.15.5:0/20211604 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:28.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070879685 0 0) 0x7fb3d01577c0 con 0x7fb3d01573f0 2023-03-03T06:25:28.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3bc0035b0 con 0x7fb3d01573f0 2023-03-03T06:25:28.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d642e700 1 --2- 172.21.15.5:0/20211604 >> v2:172.21.15.191:3300/0 conn(0x7fb3d00b1fe0 0x7fb3d00cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3540103430 0 0) 0x7fb3bc0035b0 con 0x7fb3d01573f0 2023-03-03T06:25:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 >> v2:172.21.15.191:3300/0 conn(0x7fb3d00b1fe0 msgr2=0x7fb3d00cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 --2- 172.21.15.5:0/20211604 >> v2:172.21.15.191:3300/0 conn(0x7fb3d00b1fe0 0x7fb3d00cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 >> v1:172.21.15.191:6789/0 conn(0x7fb3d015d320 legacy=0x7fb3d00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d00ce460 con 0x7fb3d01573f0 2023-03-03T06:25:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fb3c0001670 con 0x7fb3d01573f0 2023-03-03T06:25:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 >> v1:172.21.15.5:6789/0 conn(0x7fb3d01573f0 legacy=0x7fb3d00cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 --2- 172.21.15.5:0/20211604 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3bc003a70 0x7fb3bc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 --2- 172.21.15.5:0/20211604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3bc004850 0x7fb3bc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 --2- 172.21.15.5:0/20211604 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3bc005200 0x7fb3bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.091 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc00c160 con 0x7fb3bc004850 2023-03-03T06:25:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc00c2d0 con 0x7fb3bc003a70 2023-03-03T06:25:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc00c490 con 0x7fb3bc005200 2023-03-03T06:25:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.085+0000 7fb3d542c700 1 --2- 172.21.15.5:0/20211604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3bc004850 0x7fb3bc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d5c2d700 1 --2- 172.21.15.5:0/20211604 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3bc003a70 0x7fb3bc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d642e700 1 --2- 172.21.15.5:0/20211604 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3bc005200 0x7fb3bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d542c700 1 -- 172.21.15.5:0/20211604 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3bc005200 msgr2=0x7fb3bc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d542c700 1 --2- 172.21.15.5:0/20211604 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3bc005200 0x7fb3bc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d542c700 1 -- 172.21.15.5:0/20211604 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3bc003a70 msgr2=0x7fb3bc003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d542c700 1 --2- 172.21.15.5:0/20211604 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3bc003a70 0x7fb3bc003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d542c700 1 -- 172.21.15.5:0/20211604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc0035b0 con 0x7fb3bc004850 2023-03-03T06:25:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d642e700 1 -- 172.21.15.5:0/20211604 reap_dead start 2023-03-03T06:25:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d542c700 1 --2- 172.21.15.5:0/20211604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3bc004850 0x7fb3bc004cc0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc003ee0 tx=0x7fb3bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6a47b5796cf68a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc016070 con 0x7fb3bc004850 2023-03-03T06:25:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc0068b0 con 0x7fb3bc004850 2023-03-03T06:25:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d4c2b700 1 -- 172.21.15.5:0/20211604 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc003980 con 0x7fb3bc004850 2023-03-03T06:25:28.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d7e91700 1 -- 172.21.15.5:0/20211604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3bc004850 msgr2=0x7fb3bc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.086+0000 7fb3d7e91700 1 --2- 172.21.15.5:0/20211604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3bc004850 0x7fb3bc004cc0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc003ee0 tx=0x7fb3bc005880 comp rx=0 tx=0).stop 2023-03-03T06:25:28.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.087+0000 7fb3d7e91700 1 -- 172.21.15.5:0/20211604 shutdown_connections 2023-03-03T06:25:28.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.087+0000 7fb3d7e91700 1 --2- 172.21.15.5:0/20211604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3bc004850 0x7fb3bc004cc0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.087+0000 7fb3d7e91700 1 -- 172.21.15.5:0/20211604 >> 172.21.15.5:0/20211604 conn(0x7fb3d00cc8d0 msgr2=0x7fb3d00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:28.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.087+0000 7fb3d7e91700 1 -- 172.21.15.5:0/20211604 shutdown_connections 2023-03-03T06:25:28.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.087+0000 7fb3d7e91700 1 -- 172.21.15.5:0/20211604 wait complete. 2023-03-03T06:25:28.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.088+0000 7fb3d7e91700 1 Processor -- start 2023-03-03T06:25:28.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.088+0000 7fb3d7e91700 1 -- start start 2023-03-03T06:25:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d7e91700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3bc004850 0x7fb3d00b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d7e91700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3d00c88c0 0x7fb3d00c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d7e91700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3d0150a90 0x7fb3d0150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d7e91700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d00c66c0 con 0x7fb3bc004850 2023-03-03T06:25:28.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d7e91700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0151eb0 con 0x7fb3d0150a90 2023-03-03T06:25:28.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d7e91700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0151440 con 0x7fb3d00c88c0 2023-03-03T06:25:28.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d5c2d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3bc004850 0x7fb3d00b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d5c2d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3bc004850 0x7fb3d00b4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44530/0 (socket says 172.21.15.5:44530) 2023-03-03T06:25:28.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d5c2d700 1 -- 172.21.15.5:0/40515488 learned_addr learned my addr 172.21.15.5:0/40515488 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d5c2d700 1 -- 172.21.15.5:0/40515488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3d00c88c0 msgr2=0x7fb3d00c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d5c2d700 1 --2- 172.21.15.5:0/40515488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3d00c88c0 0x7fb3d00c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d5c2d700 1 -- 172.21.15.5:0/40515488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3d0150a90 msgr2=0x7fb3d0150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d5c2d700 1 --2- 172.21.15.5:0/40515488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3d0150a90 0x7fb3d0150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d5c2d700 1 -- 172.21.15.5:0/40515488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d015dbe0 con 0x7fb3bc004850 2023-03-03T06:25:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d5c2d700 1 --2- 172.21.15.5:0/40515488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3bc004850 0x7fb3d00b4f00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0007340 tx=0x7fb3c0007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3c67fc700 1 -- 172.21.15.5:0/40515488 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000f660 con 0x7fb3bc004850 2023-03-03T06:25:28.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3c67fc700 1 -- 172.21.15.5:0/40515488 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c000f7e0 con 0x7fb3bc004850 2023-03-03T06:25:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d7e91700 1 -- 172.21.15.5:0/40515488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d015d900 con 0x7fb3bc004850 2023-03-03T06:25:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3c67fc700 1 -- 172.21.15.5:0/40515488 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000fb90 con 0x7fb3bc004850 2023-03-03T06:25:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.089+0000 7fb3d7e91700 1 -- 172.21.15.5:0/40515488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d015dec0 con 0x7fb3bc004850 2023-03-03T06:25:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.090+0000 7fb3d7e91700 1 -- 172.21.15.5:0/40515488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d004e6e0 con 0x7fb3bc004850 2023-03-03T06:25:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.091+0000 7fb3c67fc700 1 -- 172.21.15.5:0/40515488 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb3c000fcf0 con 0x7fb3bc004850 2023-03-03T06:25:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.091+0000 7fb3c67fc700 1 --2- 172.21.15.5:0/40515488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb3b40682f0 0x7fb3b406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.091+0000 7fb3c67fc700 1 -- 172.21.15.5:0/40515488 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb3c00860a0 con 0x7fb3bc004850 2023-03-03T06:25:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.091+0000 7fb3d542c700 1 --2- 172.21.15.5:0/40515488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb3b40682f0 0x7fb3b406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.092+0000 7fb3d542c700 1 --2- 172.21.15.5:0/40515488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb3b40682f0 0x7fb3b406a7a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0154460 tx=0x7fb3cc011000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:28.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.095+0000 7fb3c67fc700 1 -- 172.21.15.5:0/40515488 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb3c0052660 con 0x7fb3bc004850 2023-03-03T06:25:28.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.333+0000 7fb3d7e91700 1 -- 172.21.15.5:0/40515488 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3d00b25b0 con 0x7fb3bc004850 2023-03-03T06:25:28.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.334+0000 7fb3c67fc700 1 -- 172.21.15.5:0/40515488 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4643 (secure 0 0 0) 0x7fb3c0055c80 con 0x7fb3bc004850 2023-03-03T06:25:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:28.337 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1328243693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":1328243693},{"type":"v1","addr":"172.21.15.191:6835","nonce":1328243693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/2339980581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2339980581},{"type":"v1","addr":"172.21.15.5:6836","nonce":2339980581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/620202132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":620202132},{"type":"v1","addr":"172.21.15.5:6837","nonce":620202132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:25:24.916109+0000","modified":"2023-03-03T06:25:27.928605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5410":{"gid":5410,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6834/950486040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":950486040},{"type":"v1","addr":"172.21.15.191:6834","nonce":950486040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-03-03T06:25:28.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.336+0000 7fb3d7e91700 1 -- 172.21.15.5:0/40515488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb3b40682f0 msgr2=0x7fb3b406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.336+0000 7fb3d7e91700 1 --2- 172.21.15.5:0/40515488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb3b40682f0 0x7fb3b406a7a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0154460 tx=0x7fb3cc011000 comp rx=0 tx=0).stop 2023-03-03T06:25:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.336+0000 7fb3d7e91700 1 -- 172.21.15.5:0/40515488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3bc004850 msgr2=0x7fb3d00b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.336+0000 7fb3d7e91700 1 --2- 172.21.15.5:0/40515488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3bc004850 0x7fb3d00b4f00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0007340 tx=0x7fb3c0007650 comp rx=0 tx=0).stop 2023-03-03T06:25:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.336+0000 7fb3d7e91700 1 -- 172.21.15.5:0/40515488 shutdown_connections 2023-03-03T06:25:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.336+0000 7fb3d7e91700 1 --2- 172.21.15.5:0/40515488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3d0150a90 0x7fb3d0150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.336+0000 7fb3d7e91700 1 --2- 172.21.15.5:0/40515488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3bc004850 0x7fb3d00b4f00 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.336+0000 7fb3d7e91700 1 --2- 172.21.15.5:0/40515488 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb3b40682f0 0x7fb3b406a7a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.336+0000 7fb3d7e91700 1 --2- 172.21.15.5:0/40515488 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb3d00c88c0 0x7fb3d00c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.336+0000 7fb3d7e91700 1 -- 172.21.15.5:0/40515488 >> 172.21.15.5:0/40515488 conn(0x7fb3d00cc8d0 msgr2=0x7fb3d00cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.336+0000 7fb3d7e91700 1 -- 172.21.15.5:0/40515488 shutdown_connections 2023-03-03T06:25:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.336+0000 7fb3d7e91700 1 -- 172.21.15.5:0/40515488 wait complete. 2023-03-03T06:25:28.340 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2023-03-03T06:25:28.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:28.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.474+0000 7f365b177700 1 Processor -- start 2023-03-03T06:25:28.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.474+0000 7f365b177700 1 -- start start 2023-03-03T06:25:28.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.475+0000 7f365b177700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36540b1f80 0x7f36540cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.475+0000 7f365b177700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3654159bd0 con 0x7f36540cf7a0 2023-03-03T06:25:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.475+0000 7f365b177700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365415d650 con 0x7f36540cf3d0 2023-03-03T06:25:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.475+0000 7f365b177700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365415e1d0 con 0x7f36540b1f80 2023-03-03T06:25:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.475+0000 7f3653fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f36540cf7a0 0x7f36540b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34382/0 (socket says 172.21.15.5:34382) 2023-03-03T06:25:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.475+0000 7f3653fff700 1 -- 172.21.15.5:0/3033888094 learned_addr learned my addr 172.21.15.5:0/3033888094 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.475+0000 7f3659714700 1 --2- 172.21.15.5:0/3033888094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36540b1f80 0x7f36540cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034721209 0 0) 0x7f3640001110 con 0x7f36540cf7a0 2023-03-03T06:25:28.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36440035b0 con 0x7f36540cf7a0 2023-03-03T06:25:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633777507 0 0) 0x7f365415d650 con 0x7f36540cf3d0 2023-03-03T06:25:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3640001110 con 0x7f36540cf3d0 2023-03-03T06:25:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3295517235 0 0) 0x7f36440035b0 con 0x7f36540cf7a0 2023-03-03T06:25:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36540b1f80 msgr2=0x7f36540cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 --2- 172.21.15.5:0/3033888094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36540b1f80 0x7f36540cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 >> v1:172.21.15.191:6789/0 conn(0x7f36540cf3d0 legacy=0x7f36540cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365415d930 con 0x7f36540cf7a0 2023-03-03T06:25:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f3640001800 con 0x7f36540cf7a0 2023-03-03T06:25:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f3659714700 1 --2- 172.21.15.5:0/3033888094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36540b1f80 0x7f36540cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 >> v1:172.21.15.5:6789/0 conn(0x7f36540cf7a0 legacy=0x7f36540b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 --2- 172.21.15.5:0/3033888094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3644003c30 0x7f3644004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 --2- 172.21.15.5:0/3033888094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3644004850 0x7f3644004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 --2- 172.21.15.5:0/3033888094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36540b1f80 0x7f3644005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365415e1d0 con 0x7f3644004850 2023-03-03T06:25:28.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364400baf0 con 0x7f3644003c30 2023-03-03T06:25:28.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364400bcb0 con 0x7f36540b1f80 2023-03-03T06:25:28.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f3653fff700 1 --2- 172.21.15.5:0/3033888094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3644004850 0x7f3644004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f3658f13700 1 --2- 172.21.15.5:0/3033888094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3644003c30 0x7f3644004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f3659714700 1 --2- 172.21.15.5:0/3033888094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36540b1f80 0x7f3644005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f3653fff700 1 -- 172.21.15.5:0/3033888094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36540b1f80 msgr2=0x7f3644005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:28.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f3653fff700 1 --2- 172.21.15.5:0/3033888094 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f36540b1f80 0x7f3644005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f3653fff700 1 -- 172.21.15.5:0/3033888094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3644003c30 msgr2=0x7f3644004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f3653fff700 1 --2- 172.21.15.5:0/3033888094 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3644003c30 0x7f3644004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.476+0000 7f3653fff700 1 -- 172.21.15.5:0/3033888094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c009a70 con 0x7f3644004850 2023-03-03T06:25:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.477+0000 7f3653fff700 1 --2- 172.21.15.5:0/3033888094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3644004850 0x7f3644004cc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f364000c110 tx=0x7f3644005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a17642e23072dc5 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.477+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640007c70 con 0x7f3644004850 2023-03-03T06:25:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.477+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364000ccb0 con 0x7f3644004850 2023-03-03T06:25:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.477+0000 7f36537fe700 1 -- 172.21.15.5:0/3033888094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640005ba0 con 0x7f3644004850 2023-03-03T06:25:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.477+0000 7f365b177700 1 -- 172.21.15.5:0/3033888094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3644004850 msgr2=0x7f3644004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.477+0000 7f365b177700 1 --2- 172.21.15.5:0/3033888094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3644004850 0x7f3644004cc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f364000c110 tx=0x7f3644005880 comp rx=0 tx=0).stop 2023-03-03T06:25:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.477+0000 7f3659714700 1 -- 172.21.15.5:0/3033888094 reap_dead start 2023-03-03T06:25:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.477+0000 7f365b177700 1 -- 172.21.15.5:0/3033888094 shutdown_connections 2023-03-03T06:25:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.477+0000 7f365b177700 1 -- 172.21.15.5:0/3033888094 >> 172.21.15.5:0/3033888094 conn(0x7f365406ea70 msgr2=0x7f36540cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.477+0000 7f365b177700 1 -- 172.21.15.5:0/3033888094 shutdown_connections 2023-03-03T06:25:28.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.477+0000 7f365b177700 1 -- 172.21.15.5:0/3033888094 wait complete. 2023-03-03T06:25:28.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.479+0000 7f365b177700 1 Processor -- start 2023-03-03T06:25:28.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.479+0000 7f365b177700 1 -- start start 2023-03-03T06:25:28.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.479+0000 7f365b177700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3644004850 0x7f365414b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.479+0000 7f365b177700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3654157490 0x7f3654157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.479+0000 7f365b177700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36540c9470 0x7f36540c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.479+0000 7f365b177700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3654157e40 con 0x7f3644004850 2023-03-03T06:25:28.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.479+0000 7f365b177700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365414b650 con 0x7f36540c9470 2023-03-03T06:25:28.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.479+0000 7f365b177700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36540c9e20 con 0x7f3654157490 2023-03-03T06:25:28.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f3658f13700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3644004850 0x7f365414b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f3658f13700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3644004850 0x7f365414b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44550/0 (socket says 172.21.15.5:44550) 2023-03-03T06:25:28.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f3658f13700 1 -- 172.21.15.5:0/1606583995 learned_addr learned my addr 172.21.15.5:0/1606583995 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:28.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f3653fff700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3654157490 0x7f3654157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f3659714700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36540c9470 0x7f36540c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f3658f13700 1 -- 172.21.15.5:0/1606583995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3654157490 msgr2=0x7f3654157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f3658f13700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3654157490 0x7f3654157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f3658f13700 1 -- 172.21.15.5:0/1606583995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36540c9470 msgr2=0x7f36540c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f3658f13700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36540c9470 0x7f36540c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f3658f13700 1 -- 172.21.15.5:0/1606583995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365415def0 con 0x7f3644004850 2023-03-03T06:25:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f3659714700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36540c9470 0x7f36540c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f3658f13700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3644004850 0x7f365414b110 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f364800f7d0 tx=0x7f364800fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f36517fa700 1 -- 172.21.15.5:0/1606583995 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3648005320 con 0x7f3644004850 2023-03-03T06:25:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f36517fa700 1 -- 172.21.15.5:0/1606583995 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36480054a0 con 0x7f3644004850 2023-03-03T06:25:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f365b177700 1 -- 172.21.15.5:0/1606583995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365415dc10 con 0x7f3644004850 2023-03-03T06:25:28.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f36517fa700 1 -- 172.21.15.5:0/1606583995 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3648006aa0 con 0x7f3644004850 2023-03-03T06:25:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.480+0000 7f365b177700 1 -- 172.21.15.5:0/1606583995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365415d270 con 0x7f3644004850 2023-03-03T06:25:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.481+0000 7f365b177700 1 -- 172.21.15.5:0/1606583995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365414c780 con 0x7f3644004850 2023-03-03T06:25:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.482+0000 7f36517fa700 1 -- 172.21.15.5:0/1606583995 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f364801c030 con 0x7f3644004850 2023-03-03T06:25:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.482+0000 7f36517fa700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f36380682f0 0x7f363806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.482+0000 7f36517fa700 1 -- 172.21.15.5:0/1606583995 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f36480855f0 con 0x7f3644004850 2023-03-03T06:25:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.482+0000 7f3653fff700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f36380682f0 0x7f363806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.482+0000 7f3653fff700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f36380682f0 0x7f363806a7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f36540b1e40 tx=0x7f3640007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.486+0000 7f36517fa700 1 -- 172.21.15.5:0/1606583995 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3648051bb0 con 0x7f3644004850 2023-03-03T06:25:28.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.682+0000 7f365b177700 1 -- 172.21.15.5:0/1606583995 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f365404e6e0 con 0x7f3644004850 2023-03-03T06:25:28.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.684+0000 7f36517fa700 1 -- 172.21.15.5:0/1606583995 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+19673 (secure 0 0 0) 0x7f36480551d0 con 0x7f3644004850 2023-03-03T06:25:28.686 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:28.686 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":56,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:25.917983+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:23.205830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:23.882328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.686+0000 7f365b177700 1 -- 172.21.15.5:0/1606583995 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f36380682f0 msgr2=0x7f363806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.686+0000 7f365b177700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f36380682f0 0x7f363806a7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f36540b1e40 tx=0x7f3640007000 comp rx=0 tx=0).stop 2023-03-03T06:25:28.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.686+0000 7f365b177700 1 -- 172.21.15.5:0/1606583995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3644004850 msgr2=0x7f365414b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.686+0000 7f365b177700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3644004850 0x7f365414b110 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f364800f7d0 tx=0x7f364800fb90 comp rx=0 tx=0).stop 2023-03-03T06:25:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.686+0000 7f365b177700 1 -- 172.21.15.5:0/1606583995 shutdown_connections 2023-03-03T06:25:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.686+0000 7f365b177700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36540c9470 0x7f36540c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.686+0000 7f365b177700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3644004850 0x7f365414b110 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.686+0000 7f365b177700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f36380682f0 0x7f363806a7a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.686+0000 7f365b177700 1 --2- 172.21.15.5:0/1606583995 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3654157490 0x7f3654157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.686+0000 7f365b177700 1 -- 172.21.15.5:0/1606583995 >> 172.21.15.5:0/1606583995 conn(0x7f365406ea70 msgr2=0x7f36540b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.686+0000 7f365b177700 1 -- 172.21.15.5:0/1606583995 shutdown_connections 2023-03-03T06:25:28.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.686+0000 7f365b177700 1 -- 172.21.15.5:0/1606583995 wait complete. 2023-03-03T06:25:28.701 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-03T06:25:28.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:25:28.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.824+0000 7f64fad08700 1 Processor -- start 2023-03-03T06:25:28.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.824+0000 7f64fad08700 1 -- start start 2023-03-03T06:25:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.825+0000 7f64fad08700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64f415d320 0x7f64f40cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.825+0000 7f64fad08700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f41577c0 con 0x7f64f40b18d0 2023-03-03T06:25:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.825+0000 7f64fad08700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f4159e60 con 0x7f64f41573f0 2023-03-03T06:25:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.825+0000 7f64fad08700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f40cc6e0 con 0x7f64f415d320 2023-03-03T06:25:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.825+0000 7f64f3fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f64f415d320 0x7f64f40cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.825+0000 7f64f92a5700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f64f40b18d0 0x7f64f40b1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34404/0 (socket says 172.21.15.5:34404) 2023-03-03T06:25:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.825+0000 7f64f92a5700 1 -- 172.21.15.5:0/680118384 learned_addr learned my addr 172.21.15.5:0/680118384 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.825+0000 7f64f3fff700 1 -- 172.21.15.5:0/680118384 >> v1:172.21.15.191:6789/0 conn(0x7f64f41573f0 legacy=0x7f64f40cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.825+0000 7f64f3fff700 1 -- 172.21.15.5:0/680118384 >> v1:172.21.15.5:6789/0 conn(0x7f64f40b18d0 legacy=0x7f64f40b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.825+0000 7f64f37fe700 1 -- 172.21.15.5:0/680118384 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162106968 0 0) 0x7f64f41577c0 con 0x7f64f40b18d0 2023-03-03T06:25:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.825+0000 7f64f3fff700 1 -- 172.21.15.5:0/680118384 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f40ce460 con 0x7f64f415d320 2023-03-03T06:25:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.825+0000 7f64f3fff700 1 --2- 172.21.15.5:0/680118384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d320 0x7f64f40cc1a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009820 tx=0x7f64e0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da780b8e94a929b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.825+0000 7f64f37fe700 1 -- 172.21.15.5:0/680118384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0005e30 con 0x7f64f415d320 2023-03-03T06:25:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.826+0000 7f64f37fe700 1 -- 172.21.15.5:0/680118384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e0004030 con 0x7f64f415d320 2023-03-03T06:25:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.826+0000 7f64f37fe700 1 -- 172.21.15.5:0/680118384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e00043e0 con 0x7f64f415d320 2023-03-03T06:25:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.826+0000 7f64fad08700 1 -- 172.21.15.5:0/680118384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d320 msgr2=0x7f64f40cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.826+0000 7f64fad08700 1 --2- 172.21.15.5:0/680118384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d320 0x7f64f40cc1a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009820 tx=0x7f64e0009b30 comp rx=0 tx=0).stop 2023-03-03T06:25:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.826+0000 7f64fad08700 1 -- 172.21.15.5:0/680118384 shutdown_connections 2023-03-03T06:25:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.826+0000 7f64fad08700 1 --2- 172.21.15.5:0/680118384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d320 0x7f64f40cc1a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.826+0000 7f64fad08700 1 -- 172.21.15.5:0/680118384 >> 172.21.15.5:0/680118384 conn(0x7f64f40cc8d0 msgr2=0x7f64f40cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:28.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.826+0000 7f64fad08700 1 -- 172.21.15.5:0/680118384 shutdown_connections 2023-03-03T06:25:28.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.826+0000 7f64fad08700 1 -- 172.21.15.5:0/680118384 wait complete. 2023-03-03T06:25:28.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.828+0000 7f64fad08700 1 Processor -- start 2023-03-03T06:25:28.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.828+0000 7f64fad08700 1 -- start start 2023-03-03T06:25:28.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64fad08700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f40b18d0 0x7f64f41543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64fad08700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f41573f0 0x7f64f40c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64fad08700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d320 0x7f64f41f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64fad08700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f40c97a0 con 0x7f64f415d320 2023-03-03T06:25:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64fad08700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f40c68c0 con 0x7f64f41573f0 2023-03-03T06:25:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64fad08700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f4154900 con 0x7f64f40b18d0 2023-03-03T06:25:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64f92a5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d320 0x7f64f41f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64f92a5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d320 0x7f64f41f3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44568/0 (socket says 172.21.15.5:44568) 2023-03-03T06:25:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64f92a5700 1 -- 172.21.15.5:0/3973308926 learned_addr learned my addr 172.21.15.5:0/3973308926 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64f3fff700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f41573f0 0x7f64f40c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64f8aa4700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f40b18d0 0x7f64f41543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64f92a5700 1 -- 172.21.15.5:0/3973308926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f40b18d0 msgr2=0x7f64f41543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64f92a5700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f40b18d0 0x7f64f41543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64f92a5700 1 -- 172.21.15.5:0/3973308926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f41573f0 msgr2=0x7f64f40c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:28.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64f92a5700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f41573f0 0x7f64f40c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:28.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64f92a5700 1 -- 172.21.15.5:0/3973308926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e0009430 con 0x7f64f415d320 2023-03-03T06:25:28.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.829+0000 7f64f3fff700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f41573f0 0x7f64f40c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:28.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.830+0000 7f64f92a5700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d320 0x7f64f41f3700 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00cca0 tx=0x7f64ec00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:28.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.830+0000 7f64f17fa700 1 -- 172.21.15.5:0/3973308926 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00cea0 con 0x7f64f415d320 2023-03-03T06:25:28.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.830+0000 7f64f17fa700 1 -- 172.21.15.5:0/3973308926 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec00ade0 con 0x7f64f415d320 2023-03-03T06:25:28.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.830+0000 7f64fad08700 1 -- 172.21.15.5:0/3973308926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f415dbe0 con 0x7f64f415d320 2023-03-03T06:25:28.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.830+0000 7f64f17fa700 1 -- 172.21.15.5:0/3973308926 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec007310 con 0x7f64f415d320 2023-03-03T06:25:28.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.830+0000 7f64fad08700 1 -- 172.21.15.5:0/3973308926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f415d900 con 0x7f64f415d320 2023-03-03T06:25:28.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.831+0000 7f64fad08700 1 -- 172.21.15.5:0/3973308926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f415dec0 con 0x7f64f415d320 2023-03-03T06:25:28.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.831+0000 7f64f17fa700 1 -- 172.21.15.5:0/3973308926 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f64ec01a030 con 0x7f64f415d320 2023-03-03T06:25:28.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.831+0000 7f64f17fa700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f64d80682f0 0x7f64d806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:28.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.832+0000 7f64f17fa700 1 -- 172.21.15.5:0/3973308926 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f64ec085d10 con 0x7f64f415d320 2023-03-03T06:25:28.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.832+0000 7f64f8aa4700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f64d80682f0 0x7f64d806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:28.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.832+0000 7f64f8aa4700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f64d80682f0 0x7f64d806a7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f64e8001730 tx=0x7f64e8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:28.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:28.836+0000 7f64f17fa700 1 -- 172.21.15.5:0/3973308926 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f64ec0522d0 con 0x7f64f415d320 2023-03-03T06:25:29.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.025+0000 7f64fad08700 1 -- 172.21.15.5:0/3973308926 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64f40c9910 con 0x7f64d80682f0 2023-03-03T06:25:29.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.035+0000 7f64f17fa700 1 -- 172.21.15.5:0/3973308926 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+377472 (secure 0 0 0) 0x7f64f40c9910 con 0x7f64d80682f0 2023-03-03T06:25:29.041 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.039+0000 7f64fad08700 1 -- 172.21.15.5:0/3973308926 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f64d80682f0 msgr2=0x7f64d806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.039+0000 7f64fad08700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f64d80682f0 0x7f64d806a7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f64e8001730 tx=0x7f64e8009040 comp rx=0 tx=0).stop 2023-03-03T06:25:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.039+0000 7f64fad08700 1 -- 172.21.15.5:0/3973308926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d320 msgr2=0x7f64f41f3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.039+0000 7f64fad08700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d320 0x7f64f41f3700 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00cca0 tx=0x7f64ec00a340 comp rx=0 tx=0).stop 2023-03-03T06:25:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.039+0000 7f64fad08700 1 -- 172.21.15.5:0/3973308926 shutdown_connections 2023-03-03T06:25:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.039+0000 7f64fad08700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64f415d320 0x7f64f41f3700 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.039+0000 7f64fad08700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f64d80682f0 0x7f64d806a7a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.039+0000 7f64fad08700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f64f40b18d0 0x7f64f41543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.039+0000 7f64fad08700 1 --2- 172.21.15.5:0/3973308926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64f41573f0 0x7f64f40c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.039+0000 7f64fad08700 1 -- 172.21.15.5:0/3973308926 >> 172.21.15.5:0/3973308926 conn(0x7f64f40cc8d0 msgr2=0x7f64f40cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.039+0000 7f64fad08700 1 -- 172.21.15.5:0/3973308926 shutdown_connections 2023-03-03T06:25:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.039+0000 7f64fad08700 1 -- 172.21.15.5:0/3973308926 wait complete. 2023-03-03T06:25:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:25:29.053 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2023-03-03T06:25:27.483723+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":74400,"kb_used_data":5984,"kb_used_omap":0,"kb_used_meta":68352,"kb_avail":754900320,"statfs":{"total":773094113280,"available":773017927680,"internally_reserved":0,"allocated":6127616,"data_stored":3489798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69992448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000722"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636370+0000","last_change":"2023-03-03T06:25:05.635776+0000","last_active":"2023-03-03T06:25:19.636370+0000","last_peered":"2023-03-03T06:25:19.636370+0000","last_clean":"2023-03-03T06:25:19.636370+0000","last_became_active":"2023-03-03T06:25:04.444243+0000","last_became_peered":"2023-03-03T06:25:04.444243+0000","last_unstale":"2023-03-03T06:25:19.636370+0000","last_undegraded":"2023-03-03T06:25:19.636370+0000","last_fullsized":"2023-03-03T06:25:19.636370+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:00:41.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066956899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216133+0000","last_change":"2023-03-03T06:25:05.615550+0000","last_active":"2023-03-03T06:25:20.216133+0000","last_peered":"2023-03-03T06:25:20.216133+0000","last_clean":"2023-03-03T06:25:20.216133+0000","last_became_active":"2023-03-03T06:25:04.445574+0000","last_became_peered":"2023-03-03T06:25:04.445574+0000","last_unstale":"2023-03-03T06:25:20.216133+0000","last_undegraded":"2023-03-03T06:25:20.216133+0000","last_fullsized":"2023-03-03T06:25:20.216133+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:15:06.370284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061229600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637428+0000","last_change":"2023-03-03T06:25:05.431475+0000","last_active":"2023-03-03T06:25:19.637428+0000","last_peered":"2023-03-03T06:25:19.637428+0000","last_clean":"2023-03-03T06:25:19.637428+0000","last_became_active":"2023-03-03T06:25:04.596724+0000","last_became_peered":"2023-03-03T06:25:04.596724+0000","last_unstale":"2023-03-03T06:25:19.637428+0000","last_undegraded":"2023-03-03T06:25:19.637428+0000","last_fullsized":"2023-03-03T06:25:19.637428+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015785179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.215884+0000","last_change":"2023-03-03T06:25:05.796744+0000","last_active":"2023-03-03T06:25:20.215884+0000","last_peered":"2023-03-03T06:25:20.215884+0000","last_clean":"2023-03-03T06:25:20.215884+0000","last_became_active":"2023-03-03T06:25:04.444571+0000","last_became_peered":"2023-03-03T06:25:04.444571+0000","last_unstale":"2023-03-03T06:25:20.215884+0000","last_undegraded":"2023-03-03T06:25:20.215884+0000","last_fullsized":"2023-03-03T06:25:20.215884+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:46:48.500233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050328500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216081+0000","last_change":"2023-03-03T06:25:05.615943+0000","last_active":"2023-03-03T06:25:20.216081+0000","last_peered":"2023-03-03T06:25:20.216081+0000","last_clean":"2023-03-03T06:25:20.216081+0000","last_became_active":"2023-03-03T06:25:04.443824+0000","last_became_peered":"2023-03-03T06:25:04.443824+0000","last_unstale":"2023-03-03T06:25:20.216081+0000","last_undegraded":"2023-03-03T06:25:20.216081+0000","last_fullsized":"2023-03-03T06:25:20.216081+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:11.723607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059238800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637413+0000","last_change":"2023-03-03T06:25:05.430594+0000","last_active":"2023-03-03T06:25:19.637413+0000","last_peered":"2023-03-03T06:25:19.637413+0000","last_clean":"2023-03-03T06:25:19.637413+0000","last_became_active":"2023-03-03T06:25:04.435012+0000","last_became_peered":"2023-03-03T06:25:04.435012+0000","last_unstale":"2023-03-03T06:25:19.637413+0000","last_undegraded":"2023-03-03T06:25:19.637413+0000","last_fullsized":"2023-03-03T06:25:19.637413+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052988999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216345+0000","last_change":"2023-03-03T06:25:05.616017+0000","last_active":"2023-03-03T06:25:20.216345+0000","last_peered":"2023-03-03T06:25:20.216345+0000","last_clean":"2023-03-03T06:25:20.216345+0000","last_became_active":"2023-03-03T06:25:04.443176+0000","last_became_peered":"2023-03-03T06:25:04.443176+0000","last_unstale":"2023-03-03T06:25:20.216345+0000","last_undegraded":"2023-03-03T06:25:20.216345+0000","last_fullsized":"2023-03-03T06:25:20.216345+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:38:47.576162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034461600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637591+0000","last_change":"2023-03-03T06:25:05.431768+0000","last_active":"2023-03-03T06:25:19.637591+0000","last_peered":"2023-03-03T06:25:19.637591+0000","last_clean":"2023-03-03T06:25:19.637591+0000","last_became_active":"2023-03-03T06:25:04.596711+0000","last_became_peered":"2023-03-03T06:25:04.596711+0000","last_unstale":"2023-03-03T06:25:19.637591+0000","last_undegraded":"2023-03-03T06:25:19.637591+0000","last_fullsized":"2023-03-03T06:25:19.637591+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001569261,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636471+0000","last_change":"2023-03-03T06:25:05.635716+0000","last_active":"2023-03-03T06:25:19.636471+0000","last_peered":"2023-03-03T06:25:19.636471+0000","last_clean":"2023-03-03T06:25:19.636471+0000","last_became_active":"2023-03-03T06:25:04.433896+0000","last_became_peered":"2023-03-03T06:25:04.433896+0000","last_unstale":"2023-03-03T06:25:19.636471+0000","last_undegraded":"2023-03-03T06:25:19.636471+0000","last_fullsized":"2023-03-03T06:25:19.636471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:35.209807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060132199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637287+0000","last_change":"2023-03-03T06:25:05.429739+0000","last_active":"2023-03-03T06:25:19.637287+0000","last_peered":"2023-03-03T06:25:19.637287+0000","last_clean":"2023-03-03T06:25:19.637287+0000","last_became_active":"2023-03-03T06:25:04.438903+0000","last_became_peered":"2023-03-03T06:25:04.438903+0000","last_unstale":"2023-03-03T06:25:19.637287+0000","last_undegraded":"2023-03-03T06:25:19.637287+0000","last_fullsized":"2023-03-03T06:25:19.637287+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040434999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637369+0000","last_change":"2023-03-03T06:25:05.430443+0000","last_active":"2023-03-03T06:25:19.637369+0000","last_peered":"2023-03-03T06:25:19.637369+0000","last_clean":"2023-03-03T06:25:19.637369+0000","last_became_active":"2023-03-03T06:25:04.596481+0000","last_became_peered":"2023-03-03T06:25:04.596481+0000","last_unstale":"2023-03-03T06:25:19.637369+0000","last_undegraded":"2023-03-03T06:25:19.637369+0000","last_fullsized":"2023-03-03T06:25:19.637369+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044860800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216116+0000","last_change":"2023-03-03T06:25:05.431490+0000","last_active":"2023-03-03T06:25:20.216116+0000","last_peered":"2023-03-03T06:25:20.216116+0000","last_clean":"2023-03-03T06:25:20.216116+0000","last_became_active":"2023-03-03T06:25:04.443163+0000","last_became_peered":"2023-03-03T06:25:04.443163+0000","last_unstale":"2023-03-03T06:25:20.216116+0000","last_undegraded":"2023-03-03T06:25:20.216116+0000","last_fullsized":"2023-03-03T06:25:20.216116+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020118839999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216167+0000","last_change":"2023-03-03T06:25:05.432139+0000","last_active":"2023-03-03T06:25:20.216167+0000","last_peered":"2023-03-03T06:25:20.216167+0000","last_clean":"2023-03-03T06:25:20.216167+0000","last_became_active":"2023-03-03T06:25:04.435759+0000","last_became_peered":"2023-03-03T06:25:04.435759+0000","last_unstale":"2023-03-03T06:25:20.216167+0000","last_undegraded":"2023-03-03T06:25:20.216167+0000","last_fullsized":"2023-03-03T06:25:20.216167+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001646893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636653+0000","last_change":"2023-03-03T06:25:05.635968+0000","last_active":"2023-03-03T06:25:19.636653+0000","last_peered":"2023-03-03T06:25:19.636653+0000","last_clean":"2023-03-03T06:25:19.636653+0000","last_became_active":"2023-03-03T06:25:04.443619+0000","last_became_peered":"2023-03-03T06:25:04.443619+0000","last_unstale":"2023-03-03T06:25:19.636653+0000","last_undegraded":"2023-03-03T06:25:19.636653+0000","last_fullsized":"2023-03-03T06:25:19.636653+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:51:15.780667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077929799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216252+0000","last_change":"2023-03-03T06:25:05.432320+0000","last_active":"2023-03-03T06:25:20.216252+0000","last_peered":"2023-03-03T06:25:20.216252+0000","last_clean":"2023-03-03T06:25:20.216252+0000","last_became_active":"2023-03-03T06:25:04.436727+0000","last_became_peered":"2023-03-03T06:25:04.436727+0000","last_unstale":"2023-03-03T06:25:20.216252+0000","last_undegraded":"2023-03-03T06:25:20.216252+0000","last_fullsized":"2023-03-03T06:25:20.216252+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014361980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637553+0000","last_change":"2023-03-03T06:25:05.431681+0000","last_active":"2023-03-03T06:25:19.637553+0000","last_peered":"2023-03-03T06:25:19.637553+0000","last_clean":"2023-03-03T06:25:19.637553+0000","last_became_active":"2023-03-03T06:25:04.443599+0000","last_became_peered":"2023-03-03T06:25:04.443599+0000","last_unstale":"2023-03-03T06:25:19.637553+0000","last_undegraded":"2023-03-03T06:25:19.637553+0000","last_fullsized":"2023-03-03T06:25:19.637553+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001546473,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.214720+0000","last_change":"2023-03-03T06:25:05.796211+0000","last_active":"2023-03-03T06:25:20.214720+0000","last_peered":"2023-03-03T06:25:20.214720+0000","last_clean":"2023-03-03T06:25:20.214720+0000","last_became_active":"2023-03-03T06:25:04.436647+0000","last_became_peered":"2023-03-03T06:25:04.436647+0000","last_unstale":"2023-03-03T06:25:20.214720+0000","last_undegraded":"2023-03-03T06:25:20.214720+0000","last_fullsized":"2023-03-03T06:25:20.214720+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:07.330548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637385+0000","last_change":"2023-03-03T06:25:05.431187+0000","last_active":"2023-03-03T06:25:19.637385+0000","last_peered":"2023-03-03T06:25:19.637385+0000","last_clean":"2023-03-03T06:25:19.637385+0000","last_became_active":"2023-03-03T06:25:04.442929+0000","last_became_peered":"2023-03-03T06:25:04.442929+0000","last_unstale":"2023-03-03T06:25:19.637385+0000","last_undegraded":"2023-03-03T06:25:19.637385+0000","last_fullsized":"2023-03-03T06:25:19.637385+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001551871,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.214818+0000","last_change":"2023-03-03T06:25:05.796890+0000","last_active":"2023-03-03T06:25:20.214818+0000","last_peered":"2023-03-03T06:25:20.214818+0000","last_clean":"2023-03-03T06:25:20.214818+0000","last_became_active":"2023-03-03T06:25:04.437104+0000","last_became_peered":"2023-03-03T06:25:04.437104+0000","last_unstale":"2023-03-03T06:25:20.214818+0000","last_undegraded":"2023-03-03T06:25:20.214818+0000","last_fullsized":"2023-03-03T06:25:20.214818+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:10:21.043057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027269099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637297+0000","last_change":"2023-03-03T06:25:05.429793+0000","last_active":"2023-03-03T06:25:19.637297+0000","last_peered":"2023-03-03T06:25:19.637297+0000","last_clean":"2023-03-03T06:25:19.637297+0000","last_became_active":"2023-03-03T06:25:04.436400+0000","last_became_peered":"2023-03-03T06:25:04.436400+0000","last_unstale":"2023-03-03T06:25:19.637297+0000","last_undegraded":"2023-03-03T06:25:19.637297+0000","last_fullsized":"2023-03-03T06:25:19.637297+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038039399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216473+0000","last_change":"2023-03-03T06:25:05.797098+0000","last_active":"2023-03-03T06:25:20.216473+0000","last_peered":"2023-03-03T06:25:20.216473+0000","last_clean":"2023-03-03T06:25:20.216473+0000","last_became_active":"2023-03-03T06:25:04.446290+0000","last_became_peered":"2023-03-03T06:25:04.446290+0000","last_unstale":"2023-03-03T06:25:20.216473+0000","last_undegraded":"2023-03-03T06:25:20.216473+0000","last_fullsized":"2023-03-03T06:25:20.216473+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:23:37.795335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050239399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636704+0000","last_change":"2023-03-03T06:25:05.636038+0000","last_active":"2023-03-03T06:25:19.636704+0000","last_peered":"2023-03-03T06:25:19.636704+0000","last_clean":"2023-03-03T06:25:19.636704+0000","last_became_active":"2023-03-03T06:25:04.433771+0000","last_became_peered":"2023-03-03T06:25:04.433771+0000","last_unstale":"2023-03-03T06:25:19.636704+0000","last_undegraded":"2023-03-03T06:25:19.636704+0000","last_fullsized":"2023-03-03T06:25:19.636704+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:33:58.284544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079784699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.214822+0000","last_change":"2023-03-03T06:25:05.797366+0000","last_active":"2023-03-03T06:25:20.214822+0000","last_peered":"2023-03-03T06:25:20.214822+0000","last_clean":"2023-03-03T06:25:20.214822+0000","last_became_active":"2023-03-03T06:25:04.439424+0000","last_became_peered":"2023-03-03T06:25:04.439424+0000","last_unstale":"2023-03-03T06:25:20.214822+0000","last_undegraded":"2023-03-03T06:25:20.214822+0000","last_fullsized":"2023-03-03T06:25:20.214822+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:12.599265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020575500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216387+0000","last_change":"2023-03-03T06:25:05.431441+0000","last_active":"2023-03-03T06:25:20.216387+0000","last_peered":"2023-03-03T06:25:20.216387+0000","last_clean":"2023-03-03T06:25:20.216387+0000","last_became_active":"2023-03-03T06:25:04.443840+0000","last_became_peered":"2023-03-03T06:25:04.443840+0000","last_unstale":"2023-03-03T06:25:20.216387+0000","last_undegraded":"2023-03-03T06:25:20.216387+0000","last_fullsized":"2023-03-03T06:25:20.216387+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017814980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216281+0000","last_change":"2023-03-03T06:25:05.431854+0000","last_active":"2023-03-03T06:25:20.216281+0000","last_peered":"2023-03-03T06:25:20.216281+0000","last_clean":"2023-03-03T06:25:20.216281+0000","last_became_active":"2023-03-03T06:25:04.438570+0000","last_became_peered":"2023-03-03T06:25:04.438570+0000","last_unstale":"2023-03-03T06:25:20.216281+0000","last_undegraded":"2023-03-03T06:25:20.216281+0000","last_fullsized":"2023-03-03T06:25:20.216281+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637427+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:25:19.637427+0000","last_peered":"2023-03-03T06:25:19.637427+0000","last_clean":"2023-03-03T06:25:19.637427+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:25:19.637427+0000","last_undegraded":"2023-03-03T06:25:19.637427+0000","last_fullsized":"2023-03-03T06:25:19.637427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636485+0000","last_change":"2023-03-03T06:25:05.636335+0000","last_active":"2023-03-03T06:25:19.636485+0000","last_peered":"2023-03-03T06:25:19.636485+0000","last_clean":"2023-03-03T06:25:19.636485+0000","last_became_active":"2023-03-03T06:25:04.443299+0000","last_became_peered":"2023-03-03T06:25:04.443299+0000","last_unstale":"2023-03-03T06:25:19.636485+0000","last_undegraded":"2023-03-03T06:25:19.636485+0000","last_fullsized":"2023-03-03T06:25:19.636485+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:13:38.046974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090290399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637456+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:25:19.637456+0000","last_peered":"2023-03-03T06:25:19.637456+0000","last_clean":"2023-03-03T06:25:19.637456+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:25:19.637456+0000","last_undegraded":"2023-03-03T06:25:19.637456+0000","last_fullsized":"2023-03-03T06:25:19.637456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.214757+0000","last_change":"2023-03-03T06:25:05.796271+0000","last_active":"2023-03-03T06:25:20.214757+0000","last_peered":"2023-03-03T06:25:20.214757+0000","last_clean":"2023-03-03T06:25:20.214757+0000","last_became_active":"2023-03-03T06:25:04.595414+0000","last_became_peered":"2023-03-03T06:25:04.595414+0000","last_unstale":"2023-03-03T06:25:20.214757+0000","last_undegraded":"2023-03-03T06:25:20.214757+0000","last_fullsized":"2023-03-03T06:25:20.214757+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:07:03.140630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027036600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.214908+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:25:20.214908+0000","last_peered":"2023-03-03T06:25:20.214908+0000","last_clean":"2023-03-03T06:25:20.214908+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:25:20.214908+0000","last_undegraded":"2023-03-03T06:25:20.214908+0000","last_fullsized":"2023-03-03T06:25:20.214908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":189,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216318+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:25:20.216318+0000","last_peered":"2023-03-03T06:25:20.216318+0000","last_clean":"2023-03-03T06:25:20.216318+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:25:20.216318+0000","last_undegraded":"2023-03-03T06:25:20.216318+0000","last_fullsized":"2023-03-03T06:25:20.216318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637455+0000","last_change":"2023-03-03T06:25:05.431373+0000","last_active":"2023-03-03T06:25:19.637455+0000","last_peered":"2023-03-03T06:25:19.637455+0000","last_clean":"2023-03-03T06:25:19.637455+0000","last_became_active":"2023-03-03T06:25:04.445948+0000","last_became_peered":"2023-03-03T06:25:04.445948+0000","last_unstale":"2023-03-03T06:25:19.637455+0000","last_undegraded":"2023-03-03T06:25:19.637455+0000","last_fullsized":"2023-03-03T06:25:19.637455+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001717028,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216106+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:25:20.216106+0000","last_peered":"2023-03-03T06:25:20.216106+0000","last_clean":"2023-03-03T06:25:20.216106+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:25:20.216106+0000","last_undegraded":"2023-03-03T06:25:20.216106+0000","last_fullsized":"2023-03-03T06:25:20.216106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.215856+0000","last_change":"2023-03-03T06:25:05.796597+0000","last_active":"2023-03-03T06:25:20.215856+0000","last_peered":"2023-03-03T06:25:20.215856+0000","last_clean":"2023-03-03T06:25:20.215856+0000","last_became_active":"2023-03-03T06:25:04.442672+0000","last_became_peered":"2023-03-03T06:25:04.442672+0000","last_unstale":"2023-03-03T06:25:20.215856+0000","last_undegraded":"2023-03-03T06:25:20.215856+0000","last_fullsized":"2023-03-03T06:25:20.215856+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.033310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000479903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216286+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:25:20.216286+0000","last_peered":"2023-03-03T06:25:20.216286+0000","last_clean":"2023-03-03T06:25:20.216286+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:25:20.216286+0000","last_undegraded":"2023-03-03T06:25:20.216286+0000","last_fullsized":"2023-03-03T06:25:20.216286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636331+0000","last_change":"2023-03-03T06:25:05.636259+0000","last_active":"2023-03-03T06:25:19.636331+0000","last_peered":"2023-03-03T06:25:19.636331+0000","last_clean":"2023-03-03T06:25:19.636331+0000","last_became_active":"2023-03-03T06:25:04.438244+0000","last_became_peered":"2023-03-03T06:25:04.438244+0000","last_unstale":"2023-03-03T06:25:19.636331+0000","last_undegraded":"2023-03-03T06:25:19.636331+0000","last_fullsized":"2023-03-03T06:25:19.636331+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:36.640289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001044636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":42,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636551+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:25:19.636551+0000","last_peered":"2023-03-03T06:25:19.636551+0000","last_clean":"2023-03-03T06:25:19.636551+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:25:19.636551+0000","last_undegraded":"2023-03-03T06:25:19.636551+0000","last_fullsized":"2023-03-03T06:25:19.636551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637669+0000","last_change":"2023-03-03T06:25:05.432050+0000","last_active":"2023-03-03T06:25:19.637669+0000","last_peered":"2023-03-03T06:25:19.637669+0000","last_clean":"2023-03-03T06:25:19.637669+0000","last_became_active":"2023-03-03T06:25:04.595433+0000","last_became_peered":"2023-03-03T06:25:04.595433+0000","last_unstale":"2023-03-03T06:25:19.637669+0000","last_undegraded":"2023-03-03T06:25:19.637669+0000","last_fullsized":"2023-03-03T06:25:19.637669+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016573409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.215990+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:25:20.215990+0000","last_peered":"2023-03-03T06:25:20.215990+0000","last_clean":"2023-03-03T06:25:20.215990+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:25:20.215990+0000","last_undegraded":"2023-03-03T06:25:20.215990+0000","last_fullsized":"2023-03-03T06:25:20.215990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216499+0000","last_change":"2023-03-03T06:25:05.431790+0000","last_active":"2023-03-03T06:25:20.216499+0000","last_peered":"2023-03-03T06:25:20.216499+0000","last_clean":"2023-03-03T06:25:20.216499+0000","last_became_active":"2023-03-03T06:25:04.595837+0000","last_became_peered":"2023-03-03T06:25:04.595837+0000","last_unstale":"2023-03-03T06:25:20.216499+0000","last_undegraded":"2023-03-03T06:25:20.216499+0000","last_fullsized":"2023-03-03T06:25:20.216499+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:08:49.614056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019659870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216131+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:25:20.216131+0000","last_peered":"2023-03-03T06:25:20.216131+0000","last_clean":"2023-03-03T06:25:20.216131+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:25:20.216131+0000","last_undegraded":"2023-03-03T06:25:20.216131+0000","last_fullsized":"2023-03-03T06:25:20.216131+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10152,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94361688,"statfs":{"total":96636764160,"available":96626368512,"internally_reserved":0,"allocated":1212416,"data_stored":879241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.432},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.48999999999999999}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.624},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8932,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362908,"statfs":{"total":96636764160,"available":96627617792,"internally_reserved":0,"allocated":618496,"data_stored":288873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.318}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.372},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10088,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94361752,"statfs":{"total":96636764160,"available":96626434048,"internally_reserved":0,"allocated":1212416,"data_stored":879241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.309}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.622}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9056,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362784,"statfs":{"total":96636764160,"available":96627490816,"internally_reserved":0,"allocated":614400,"data_stored":287912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.378},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.48899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8868,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362972,"statfs":{"total":96636764160,"available":96627683328,"internally_reserved":0,"allocated":618496,"data_stored":288873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.26500000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":7.4820000000000002,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.371},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.622},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59199999999999997}]},{"osd":7,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9124,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362716,"statfs":{"total":96636764160,"available":96627421184,"internally_reserved":0,"allocated":618496,"data_stored":288873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.26700000000000002}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.371},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.504},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.63200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":618496,"data_stored":288873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.55900000000000005}]},{"osd":5,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.437}]},{"osd":6,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46200000000000002}]},{"osd":7,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.49399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8992,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362848,"statfs":{"total":96636764160,"available":96627556352,"internally_reserved":0,"allocated":614400,"data_stored":287912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.745},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.72299999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.79500000000000004}]},{"osd":3,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76000000000000001}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.52100000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.377},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.70899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:25:29.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:25:29.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.215+0000 7fd9072ef700 1 Processor -- start 2023-03-03T06:25:29.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.215+0000 7fd9072ef700 1 -- start start 2023-03-03T06:25:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.216+0000 7fd9072ef700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90015d320 0x7fd9000cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.216+0000 7fd9072ef700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9000b18d0 0x7fd9000b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.216+0000 7fd9072ef700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9001577c0 con 0x7fd9001573f0 2023-03-03T06:25:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.216+0000 7fd9072ef700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9000cc6e0 con 0x7fd9000b18d0 2023-03-03T06:25:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.216+0000 7fd9072ef700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000cd790 con 0x7fd90015d320 2023-03-03T06:25:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.216+0000 7fd90588c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9000b18d0 0x7fd9000b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.216+0000 7fd90588c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd9000b18d0 0x7fd9000b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44576/0 (socket says 172.21.15.5:44576) 2023-03-03T06:25:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.216+0000 7fd90588c700 1 -- 172.21.15.5:0/3219100062 learned_addr learned my addr 172.21.15.5:0/3219100062 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.216+0000 7fd90488a700 1 --2- 172.21.15.5:0/3219100062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90015d320 0x7fd9000cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd90588c700 1 -- 172.21.15.5:0/3219100062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90015d320 msgr2=0x7fd9000cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd90588c700 1 --2- 172.21.15.5:0/3219100062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90015d320 0x7fd9000cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd90588c700 1 -- 172.21.15.5:0/3219100062 >> v1:172.21.15.191:6789/0 conn(0x7fd9001573f0 legacy=0x7fd9000cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd90588c700 1 -- 172.21.15.5:0/3219100062 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000b2270 con 0x7fd9000b18d0 2023-03-03T06:25:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd90588c700 1 --2- 172.21.15.5:0/3219100062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b18d0 0x7fd9000b1d30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009e50 tx=0x7fd8f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71c34363ce4c7b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd8f7fff700 1 -- 172.21.15.5:0/3219100062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800e070 con 0x7fd9000b18d0 2023-03-03T06:25:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd8f7fff700 1 -- 172.21.15.5:0/3219100062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f800b9c0 con 0x7fd9000b18d0 2023-03-03T06:25:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd8f7fff700 1 -- 172.21.15.5:0/3219100062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800bd70 con 0x7fd9000b18d0 2023-03-03T06:25:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd9072ef700 1 -- 172.21.15.5:0/3219100062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b18d0 msgr2=0x7fd9000b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd9072ef700 1 --2- 172.21.15.5:0/3219100062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b18d0 0x7fd9000b1d30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009e50 tx=0x7fd8f800b330 comp rx=0 tx=0).stop 2023-03-03T06:25:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd9072ef700 1 -- 172.21.15.5:0/3219100062 shutdown_connections 2023-03-03T06:25:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd9072ef700 1 --2- 172.21.15.5:0/3219100062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b18d0 0x7fd9000b1d30 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd9072ef700 1 --2- 172.21.15.5:0/3219100062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90015d320 0x7fd9000cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.217+0000 7fd9072ef700 1 -- 172.21.15.5:0/3219100062 >> 172.21.15.5:0/3219100062 conn(0x7fd9000cc8d0 msgr2=0x7fd9000cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.218+0000 7fd9072ef700 1 -- 172.21.15.5:0/3219100062 shutdown_connections 2023-03-03T06:25:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.218+0000 7fd9072ef700 1 -- 172.21.15.5:0/3219100062 wait complete. 2023-03-03T06:25:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.219+0000 7fd9072ef700 1 Processor -- start 2023-03-03T06:25:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.219+0000 7fd9072ef700 1 -- start start 2023-03-03T06:25:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.219+0000 7fd9072ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b18d0 0x7fd90014e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.219+0000 7fd9072ef700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9001573f0 0x7fd90014d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.219+0000 7fd9072ef700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90015d320 0x7fd9000c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.219+0000 7fd9072ef700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000c8800 con 0x7fd9000b18d0 2023-03-03T06:25:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.219+0000 7fd9072ef700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd900158890 con 0x7fd9001573f0 2023-03-03T06:25:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.219+0000 7fd9072ef700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000c3bb0 con 0x7fd90015d320 2023-03-03T06:25:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd90508b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b18d0 0x7fd90014e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd90508b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b18d0 0x7fd90014e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44578/0 (socket says 172.21.15.5:44578) 2023-03-03T06:25:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd90508b700 1 -- 172.21.15.5:0/507502326 learned_addr learned my addr 172.21.15.5:0/507502326 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd90588c700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90015d320 0x7fd9000c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd90488a700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9001573f0 0x7fd90014d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd90508b700 1 -- 172.21.15.5:0/507502326 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90015d320 msgr2=0x7fd9000c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd90508b700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90015d320 0x7fd9000c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd90508b700 1 -- 172.21.15.5:0/507502326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9001573f0 msgr2=0x7fd90014d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd90508b700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9001573f0 0x7fd90014d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd90508b700 1 -- 172.21.15.5:0/507502326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f8009b30 con 0x7fd9000b18d0 2023-03-03T06:25:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd90508b700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b18d0 0x7fd90014e0e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c510 tx=0x7fd8f000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd8f5ffb700 1 -- 172.21.15.5:0/507502326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00052d0 con 0x7fd9000b18d0 2023-03-03T06:25:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd8f5ffb700 1 -- 172.21.15.5:0/507502326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f0005430 con 0x7fd9000b18d0 2023-03-03T06:25:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd8f5ffb700 1 -- 172.21.15.5:0/507502326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00038c0 con 0x7fd9000b18d0 2023-03-03T06:25:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.220+0000 7fd9072ef700 1 -- 172.21.15.5:0/507502326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9000ce460 con 0x7fd9000b18d0 2023-03-03T06:25:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.221+0000 7fd9072ef700 1 -- 172.21.15.5:0/507502326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd900159e60 con 0x7fd9000b18d0 2023-03-03T06:25:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.221+0000 7fd9072ef700 1 -- 172.21.15.5:0/507502326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90015d900 con 0x7fd9000b18d0 2023-03-03T06:25:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.222+0000 7fd8f5ffb700 1 -- 172.21.15.5:0/507502326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd8f0019030 con 0x7fd9000b18d0 2023-03-03T06:25:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.222+0000 7fd8f5ffb700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd8e40682f0 0x7fd8e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.222+0000 7fd8f5ffb700 1 -- 172.21.15.5:0/507502326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd8f00850e0 con 0x7fd9000b18d0 2023-03-03T06:25:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.222+0000 7fd90488a700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd8e40682f0 0x7fd8e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.223+0000 7fd90488a700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd8e40682f0 0x7fd8e406a7a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd9000cc630 tx=0x7fd8fc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.226+0000 7fd8f5ffb700 1 -- 172.21.15.5:0/507502326 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd8f00516a0 con 0x7fd9000b18d0 2023-03-03T06:25:29.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.416+0000 7fd9072ef700 1 -- 172.21.15.5:0/507502326 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9000c3cf0 con 0x7fd8e40682f0 2023-03-03T06:25:29.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.426+0000 7fd8f5ffb700 1 -- 172.21.15.5:0/507502326 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+377472 (secure 0 0 0) 0x7fd8fc010710 con 0x7fd8e40682f0 2023-03-03T06:25:29.432 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.430+0000 7fd9072ef700 1 -- 172.21.15.5:0/507502326 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd8e40682f0 msgr2=0x7fd8e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.430+0000 7fd9072ef700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd8e40682f0 0x7fd8e406a7a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd9000cc630 tx=0x7fd8fc008040 comp rx=0 tx=0).stop 2023-03-03T06:25:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.430+0000 7fd9072ef700 1 -- 172.21.15.5:0/507502326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b18d0 msgr2=0x7fd90014e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.430+0000 7fd9072ef700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b18d0 0x7fd90014e0e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c510 tx=0x7fd8f000c820 comp rx=0 tx=0).stop 2023-03-03T06:25:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.430+0000 7fd9072ef700 1 -- 172.21.15.5:0/507502326 shutdown_connections 2023-03-03T06:25:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.430+0000 7fd9072ef700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd8e40682f0 0x7fd8e406a7a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.430+0000 7fd9072ef700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd90015d320 0x7fd9000c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.430+0000 7fd9072ef700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9000b18d0 0x7fd90014e0e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.430+0000 7fd9072ef700 1 --2- 172.21.15.5:0/507502326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9001573f0 0x7fd90014d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.430+0000 7fd9072ef700 1 -- 172.21.15.5:0/507502326 >> 172.21.15.5:0/507502326 conn(0x7fd9000cc8d0 msgr2=0x7fd9000cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.430+0000 7fd9072ef700 1 -- 172.21.15.5:0/507502326 shutdown_connections 2023-03-03T06:25:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.430+0000 7fd9072ef700 1 -- 172.21.15.5:0/507502326 wait complete. 2023-03-03T06:25:29.436 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:25:29.444 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2023-03-03T06:25:27.483723+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":74400,"kb_used_data":5984,"kb_used_omap":0,"kb_used_meta":68352,"kb_avail":754900320,"statfs":{"total":773094113280,"available":773017927680,"internally_reserved":0,"allocated":6127616,"data_stored":3489798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69992448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000722"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636370+0000","last_change":"2023-03-03T06:25:05.635776+0000","last_active":"2023-03-03T06:25:19.636370+0000","last_peered":"2023-03-03T06:25:19.636370+0000","last_clean":"2023-03-03T06:25:19.636370+0000","last_became_active":"2023-03-03T06:25:04.444243+0000","last_became_peered":"2023-03-03T06:25:04.444243+0000","last_unstale":"2023-03-03T06:25:19.636370+0000","last_undegraded":"2023-03-03T06:25:19.636370+0000","last_fullsized":"2023-03-03T06:25:19.636370+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:00:41.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066956899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216133+0000","last_change":"2023-03-03T06:25:05.615550+0000","last_active":"2023-03-03T06:25:20.216133+0000","last_peered":"2023-03-03T06:25:20.216133+0000","last_clean":"2023-03-03T06:25:20.216133+0000","last_became_active":"2023-03-03T06:25:04.445574+0000","last_became_peered":"2023-03-03T06:25:04.445574+0000","last_unstale":"2023-03-03T06:25:20.216133+0000","last_undegraded":"2023-03-03T06:25:20.216133+0000","last_fullsized":"2023-03-03T06:25:20.216133+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:15:06.370284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061229600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637428+0000","last_change":"2023-03-03T06:25:05.431475+0000","last_active":"2023-03-03T06:25:19.637428+0000","last_peered":"2023-03-03T06:25:19.637428+0000","last_clean":"2023-03-03T06:25:19.637428+0000","last_became_active":"2023-03-03T06:25:04.596724+0000","last_became_peered":"2023-03-03T06:25:04.596724+0000","last_unstale":"2023-03-03T06:25:19.637428+0000","last_undegraded":"2023-03-03T06:25:19.637428+0000","last_fullsized":"2023-03-03T06:25:19.637428+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015785179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.215884+0000","last_change":"2023-03-03T06:25:05.796744+0000","last_active":"2023-03-03T06:25:20.215884+0000","last_peered":"2023-03-03T06:25:20.215884+0000","last_clean":"2023-03-03T06:25:20.215884+0000","last_became_active":"2023-03-03T06:25:04.444571+0000","last_became_peered":"2023-03-03T06:25:04.444571+0000","last_unstale":"2023-03-03T06:25:20.215884+0000","last_undegraded":"2023-03-03T06:25:20.215884+0000","last_fullsized":"2023-03-03T06:25:20.215884+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:46:48.500233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050328500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216081+0000","last_change":"2023-03-03T06:25:05.615943+0000","last_active":"2023-03-03T06:25:20.216081+0000","last_peered":"2023-03-03T06:25:20.216081+0000","last_clean":"2023-03-03T06:25:20.216081+0000","last_became_active":"2023-03-03T06:25:04.443824+0000","last_became_peered":"2023-03-03T06:25:04.443824+0000","last_unstale":"2023-03-03T06:25:20.216081+0000","last_undegraded":"2023-03-03T06:25:20.216081+0000","last_fullsized":"2023-03-03T06:25:20.216081+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:11.723607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059238800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637413+0000","last_change":"2023-03-03T06:25:05.430594+0000","last_active":"2023-03-03T06:25:19.637413+0000","last_peered":"2023-03-03T06:25:19.637413+0000","last_clean":"2023-03-03T06:25:19.637413+0000","last_became_active":"2023-03-03T06:25:04.435012+0000","last_became_peered":"2023-03-03T06:25:04.435012+0000","last_unstale":"2023-03-03T06:25:19.637413+0000","last_undegraded":"2023-03-03T06:25:19.637413+0000","last_fullsized":"2023-03-03T06:25:19.637413+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052988999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216345+0000","last_change":"2023-03-03T06:25:05.616017+0000","last_active":"2023-03-03T06:25:20.216345+0000","last_peered":"2023-03-03T06:25:20.216345+0000","last_clean":"2023-03-03T06:25:20.216345+0000","last_became_active":"2023-03-03T06:25:04.443176+0000","last_became_peered":"2023-03-03T06:25:04.443176+0000","last_unstale":"2023-03-03T06:25:20.216345+0000","last_undegraded":"2023-03-03T06:25:20.216345+0000","last_fullsized":"2023-03-03T06:25:20.216345+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:38:47.576162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034461600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637591+0000","last_change":"2023-03-03T06:25:05.431768+0000","last_active":"2023-03-03T06:25:19.637591+0000","last_peered":"2023-03-03T06:25:19.637591+0000","last_clean":"2023-03-03T06:25:19.637591+0000","last_became_active":"2023-03-03T06:25:04.596711+0000","last_became_peered":"2023-03-03T06:25:04.596711+0000","last_unstale":"2023-03-03T06:25:19.637591+0000","last_undegraded":"2023-03-03T06:25:19.637591+0000","last_fullsized":"2023-03-03T06:25:19.637591+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001569261,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636471+0000","last_change":"2023-03-03T06:25:05.635716+0000","last_active":"2023-03-03T06:25:19.636471+0000","last_peered":"2023-03-03T06:25:19.636471+0000","last_clean":"2023-03-03T06:25:19.636471+0000","last_became_active":"2023-03-03T06:25:04.433896+0000","last_became_peered":"2023-03-03T06:25:04.433896+0000","last_unstale":"2023-03-03T06:25:19.636471+0000","last_undegraded":"2023-03-03T06:25:19.636471+0000","last_fullsized":"2023-03-03T06:25:19.636471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:35.209807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060132199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637287+0000","last_change":"2023-03-03T06:25:05.429739+0000","last_active":"2023-03-03T06:25:19.637287+0000","last_peered":"2023-03-03T06:25:19.637287+0000","last_clean":"2023-03-03T06:25:19.637287+0000","last_became_active":"2023-03-03T06:25:04.438903+0000","last_became_peered":"2023-03-03T06:25:04.438903+0000","last_unstale":"2023-03-03T06:25:19.637287+0000","last_undegraded":"2023-03-03T06:25:19.637287+0000","last_fullsized":"2023-03-03T06:25:19.637287+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040434999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637369+0000","last_change":"2023-03-03T06:25:05.430443+0000","last_active":"2023-03-03T06:25:19.637369+0000","last_peered":"2023-03-03T06:25:19.637369+0000","last_clean":"2023-03-03T06:25:19.637369+0000","last_became_active":"2023-03-03T06:25:04.596481+0000","last_became_peered":"2023-03-03T06:25:04.596481+0000","last_unstale":"2023-03-03T06:25:19.637369+0000","last_undegraded":"2023-03-03T06:25:19.637369+0000","last_fullsized":"2023-03-03T06:25:19.637369+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044860800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216116+0000","last_change":"2023-03-03T06:25:05.431490+0000","last_active":"2023-03-03T06:25:20.216116+0000","last_peered":"2023-03-03T06:25:20.216116+0000","last_clean":"2023-03-03T06:25:20.216116+0000","last_became_active":"2023-03-03T06:25:04.443163+0000","last_became_peered":"2023-03-03T06:25:04.443163+0000","last_unstale":"2023-03-03T06:25:20.216116+0000","last_undegraded":"2023-03-03T06:25:20.216116+0000","last_fullsized":"2023-03-03T06:25:20.216116+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020118839999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216167+0000","last_change":"2023-03-03T06:25:05.432139+0000","last_active":"2023-03-03T06:25:20.216167+0000","last_peered":"2023-03-03T06:25:20.216167+0000","last_clean":"2023-03-03T06:25:20.216167+0000","last_became_active":"2023-03-03T06:25:04.435759+0000","last_became_peered":"2023-03-03T06:25:04.435759+0000","last_unstale":"2023-03-03T06:25:20.216167+0000","last_undegraded":"2023-03-03T06:25:20.216167+0000","last_fullsized":"2023-03-03T06:25:20.216167+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001646893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636653+0000","last_change":"2023-03-03T06:25:05.635968+0000","last_active":"2023-03-03T06:25:19.636653+0000","last_peered":"2023-03-03T06:25:19.636653+0000","last_clean":"2023-03-03T06:25:19.636653+0000","last_became_active":"2023-03-03T06:25:04.443619+0000","last_became_peered":"2023-03-03T06:25:04.443619+0000","last_unstale":"2023-03-03T06:25:19.636653+0000","last_undegraded":"2023-03-03T06:25:19.636653+0000","last_fullsized":"2023-03-03T06:25:19.636653+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:51:15.780667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077929799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216252+0000","last_change":"2023-03-03T06:25:05.432320+0000","last_active":"2023-03-03T06:25:20.216252+0000","last_peered":"2023-03-03T06:25:20.216252+0000","last_clean":"2023-03-03T06:25:20.216252+0000","last_became_active":"2023-03-03T06:25:04.436727+0000","last_became_peered":"2023-03-03T06:25:04.436727+0000","last_unstale":"2023-03-03T06:25:20.216252+0000","last_undegraded":"2023-03-03T06:25:20.216252+0000","last_fullsized":"2023-03-03T06:25:20.216252+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014361980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637553+0000","last_change":"2023-03-03T06:25:05.431681+0000","last_active":"2023-03-03T06:25:19.637553+0000","last_peered":"2023-03-03T06:25:19.637553+0000","last_clean":"2023-03-03T06:25:19.637553+0000","last_became_active":"2023-03-03T06:25:04.443599+0000","last_became_peered":"2023-03-03T06:25:04.443599+0000","last_unstale":"2023-03-03T06:25:19.637553+0000","last_undegraded":"2023-03-03T06:25:19.637553+0000","last_fullsized":"2023-03-03T06:25:19.637553+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001546473,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.214720+0000","last_change":"2023-03-03T06:25:05.796211+0000","last_active":"2023-03-03T06:25:20.214720+0000","last_peered":"2023-03-03T06:25:20.214720+0000","last_clean":"2023-03-03T06:25:20.214720+0000","last_became_active":"2023-03-03T06:25:04.436647+0000","last_became_peered":"2023-03-03T06:25:04.436647+0000","last_unstale":"2023-03-03T06:25:20.214720+0000","last_undegraded":"2023-03-03T06:25:20.214720+0000","last_fullsized":"2023-03-03T06:25:20.214720+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:07.330548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637385+0000","last_change":"2023-03-03T06:25:05.431187+0000","last_active":"2023-03-03T06:25:19.637385+0000","last_peered":"2023-03-03T06:25:19.637385+0000","last_clean":"2023-03-03T06:25:19.637385+0000","last_became_active":"2023-03-03T06:25:04.442929+0000","last_became_peered":"2023-03-03T06:25:04.442929+0000","last_unstale":"2023-03-03T06:25:19.637385+0000","last_undegraded":"2023-03-03T06:25:19.637385+0000","last_fullsized":"2023-03-03T06:25:19.637385+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001551871,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.214818+0000","last_change":"2023-03-03T06:25:05.796890+0000","last_active":"2023-03-03T06:25:20.214818+0000","last_peered":"2023-03-03T06:25:20.214818+0000","last_clean":"2023-03-03T06:25:20.214818+0000","last_became_active":"2023-03-03T06:25:04.437104+0000","last_became_peered":"2023-03-03T06:25:04.437104+0000","last_unstale":"2023-03-03T06:25:20.214818+0000","last_undegraded":"2023-03-03T06:25:20.214818+0000","last_fullsized":"2023-03-03T06:25:20.214818+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:10:21.043057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027269099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637297+0000","last_change":"2023-03-03T06:25:05.429793+0000","last_active":"2023-03-03T06:25:19.637297+0000","last_peered":"2023-03-03T06:25:19.637297+0000","last_clean":"2023-03-03T06:25:19.637297+0000","last_became_active":"2023-03-03T06:25:04.436400+0000","last_became_peered":"2023-03-03T06:25:04.436400+0000","last_unstale":"2023-03-03T06:25:19.637297+0000","last_undegraded":"2023-03-03T06:25:19.637297+0000","last_fullsized":"2023-03-03T06:25:19.637297+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038039399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216473+0000","last_change":"2023-03-03T06:25:05.797098+0000","last_active":"2023-03-03T06:25:20.216473+0000","last_peered":"2023-03-03T06:25:20.216473+0000","last_clean":"2023-03-03T06:25:20.216473+0000","last_became_active":"2023-03-03T06:25:04.446290+0000","last_became_peered":"2023-03-03T06:25:04.446290+0000","last_unstale":"2023-03-03T06:25:20.216473+0000","last_undegraded":"2023-03-03T06:25:20.216473+0000","last_fullsized":"2023-03-03T06:25:20.216473+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:23:37.795335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050239399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636704+0000","last_change":"2023-03-03T06:25:05.636038+0000","last_active":"2023-03-03T06:25:19.636704+0000","last_peered":"2023-03-03T06:25:19.636704+0000","last_clean":"2023-03-03T06:25:19.636704+0000","last_became_active":"2023-03-03T06:25:04.433771+0000","last_became_peered":"2023-03-03T06:25:04.433771+0000","last_unstale":"2023-03-03T06:25:19.636704+0000","last_undegraded":"2023-03-03T06:25:19.636704+0000","last_fullsized":"2023-03-03T06:25:19.636704+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:33:58.284544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079784699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.214822+0000","last_change":"2023-03-03T06:25:05.797366+0000","last_active":"2023-03-03T06:25:20.214822+0000","last_peered":"2023-03-03T06:25:20.214822+0000","last_clean":"2023-03-03T06:25:20.214822+0000","last_became_active":"2023-03-03T06:25:04.439424+0000","last_became_peered":"2023-03-03T06:25:04.439424+0000","last_unstale":"2023-03-03T06:25:20.214822+0000","last_undegraded":"2023-03-03T06:25:20.214822+0000","last_fullsized":"2023-03-03T06:25:20.214822+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:12.599265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020575500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216387+0000","last_change":"2023-03-03T06:25:05.431441+0000","last_active":"2023-03-03T06:25:20.216387+0000","last_peered":"2023-03-03T06:25:20.216387+0000","last_clean":"2023-03-03T06:25:20.216387+0000","last_became_active":"2023-03-03T06:25:04.443840+0000","last_became_peered":"2023-03-03T06:25:04.443840+0000","last_unstale":"2023-03-03T06:25:20.216387+0000","last_undegraded":"2023-03-03T06:25:20.216387+0000","last_fullsized":"2023-03-03T06:25:20.216387+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017814980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216281+0000","last_change":"2023-03-03T06:25:05.431854+0000","last_active":"2023-03-03T06:25:20.216281+0000","last_peered":"2023-03-03T06:25:20.216281+0000","last_clean":"2023-03-03T06:25:20.216281+0000","last_became_active":"2023-03-03T06:25:04.438570+0000","last_became_peered":"2023-03-03T06:25:04.438570+0000","last_unstale":"2023-03-03T06:25:20.216281+0000","last_undegraded":"2023-03-03T06:25:20.216281+0000","last_fullsized":"2023-03-03T06:25:20.216281+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637427+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:25:19.637427+0000","last_peered":"2023-03-03T06:25:19.637427+0000","last_clean":"2023-03-03T06:25:19.637427+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:25:19.637427+0000","last_undegraded":"2023-03-03T06:25:19.637427+0000","last_fullsized":"2023-03-03T06:25:19.637427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636485+0000","last_change":"2023-03-03T06:25:05.636335+0000","last_active":"2023-03-03T06:25:19.636485+0000","last_peered":"2023-03-03T06:25:19.636485+0000","last_clean":"2023-03-03T06:25:19.636485+0000","last_became_active":"2023-03-03T06:25:04.443299+0000","last_became_peered":"2023-03-03T06:25:04.443299+0000","last_unstale":"2023-03-03T06:25:19.636485+0000","last_undegraded":"2023-03-03T06:25:19.636485+0000","last_fullsized":"2023-03-03T06:25:19.636485+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:13:38.046974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090290399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":44,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637456+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:25:19.637456+0000","last_peered":"2023-03-03T06:25:19.637456+0000","last_clean":"2023-03-03T06:25:19.637456+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:25:19.637456+0000","last_undegraded":"2023-03-03T06:25:19.637456+0000","last_fullsized":"2023-03-03T06:25:19.637456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.214757+0000","last_change":"2023-03-03T06:25:05.796271+0000","last_active":"2023-03-03T06:25:20.214757+0000","last_peered":"2023-03-03T06:25:20.214757+0000","last_clean":"2023-03-03T06:25:20.214757+0000","last_became_active":"2023-03-03T06:25:04.595414+0000","last_became_peered":"2023-03-03T06:25:04.595414+0000","last_unstale":"2023-03-03T06:25:20.214757+0000","last_undegraded":"2023-03-03T06:25:20.214757+0000","last_fullsized":"2023-03-03T06:25:20.214757+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:07:03.140630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027036600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":40,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.214908+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:25:20.214908+0000","last_peered":"2023-03-03T06:25:20.214908+0000","last_clean":"2023-03-03T06:25:20.214908+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:25:20.214908+0000","last_undegraded":"2023-03-03T06:25:20.214908+0000","last_fullsized":"2023-03-03T06:25:20.214908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":189,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216318+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:25:20.216318+0000","last_peered":"2023-03-03T06:25:20.216318+0000","last_clean":"2023-03-03T06:25:20.216318+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:25:20.216318+0000","last_undegraded":"2023-03-03T06:25:20.216318+0000","last_fullsized":"2023-03-03T06:25:20.216318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637455+0000","last_change":"2023-03-03T06:25:05.431373+0000","last_active":"2023-03-03T06:25:19.637455+0000","last_peered":"2023-03-03T06:25:19.637455+0000","last_clean":"2023-03-03T06:25:19.637455+0000","last_became_active":"2023-03-03T06:25:04.445948+0000","last_became_peered":"2023-03-03T06:25:04.445948+0000","last_unstale":"2023-03-03T06:25:19.637455+0000","last_undegraded":"2023-03-03T06:25:19.637455+0000","last_fullsized":"2023-03-03T06:25:19.637455+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001717028,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216106+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:25:20.216106+0000","last_peered":"2023-03-03T06:25:20.216106+0000","last_clean":"2023-03-03T06:25:20.216106+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:25:20.216106+0000","last_undegraded":"2023-03-03T06:25:20.216106+0000","last_fullsized":"2023-03-03T06:25:20.216106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.215856+0000","last_change":"2023-03-03T06:25:05.796597+0000","last_active":"2023-03-03T06:25:20.215856+0000","last_peered":"2023-03-03T06:25:20.215856+0000","last_clean":"2023-03-03T06:25:20.215856+0000","last_became_active":"2023-03-03T06:25:04.442672+0000","last_became_peered":"2023-03-03T06:25:04.442672+0000","last_unstale":"2023-03-03T06:25:20.215856+0000","last_undegraded":"2023-03-03T06:25:20.215856+0000","last_fullsized":"2023-03-03T06:25:20.215856+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.033310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000479903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216286+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:25:20.216286+0000","last_peered":"2023-03-03T06:25:20.216286+0000","last_clean":"2023-03-03T06:25:20.216286+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:25:20.216286+0000","last_undegraded":"2023-03-03T06:25:20.216286+0000","last_fullsized":"2023-03-03T06:25:20.216286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636331+0000","last_change":"2023-03-03T06:25:05.636259+0000","last_active":"2023-03-03T06:25:19.636331+0000","last_peered":"2023-03-03T06:25:19.636331+0000","last_clean":"2023-03-03T06:25:19.636331+0000","last_became_active":"2023-03-03T06:25:04.438244+0000","last_became_peered":"2023-03-03T06:25:04.438244+0000","last_unstale":"2023-03-03T06:25:19.636331+0000","last_undegraded":"2023-03-03T06:25:19.636331+0000","last_fullsized":"2023-03-03T06:25:19.636331+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:36.640289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001044636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":42,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.636551+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:25:19.636551+0000","last_peered":"2023-03-03T06:25:19.636551+0000","last_clean":"2023-03-03T06:25:19.636551+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:25:19.636551+0000","last_undegraded":"2023-03-03T06:25:19.636551+0000","last_fullsized":"2023-03-03T06:25:19.636551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:19.637669+0000","last_change":"2023-03-03T06:25:05.432050+0000","last_active":"2023-03-03T06:25:19.637669+0000","last_peered":"2023-03-03T06:25:19.637669+0000","last_clean":"2023-03-03T06:25:19.637669+0000","last_became_active":"2023-03-03T06:25:04.595433+0000","last_became_peered":"2023-03-03T06:25:04.595433+0000","last_unstale":"2023-03-03T06:25:19.637669+0000","last_undegraded":"2023-03-03T06:25:19.637669+0000","last_fullsized":"2023-03-03T06:25:19.637669+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016573409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.215990+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:25:20.215990+0000","last_peered":"2023-03-03T06:25:20.215990+0000","last_clean":"2023-03-03T06:25:20.215990+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:25:20.215990+0000","last_undegraded":"2023-03-03T06:25:20.215990+0000","last_fullsized":"2023-03-03T06:25:20.215990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:24.490870+0000","last_change":"2023-03-03T06:25:24.490870+0000","last_active":"2023-03-03T06:25:24.490870+0000","last_peered":"2023-03-03T06:25:24.490870+0000","last_clean":"2023-03-03T06:25:24.490870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:24.490870+0000","last_undegraded":"2023-03-03T06:25:24.490870+0000","last_fullsized":"2023-03-03T06:25:24.490870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-03-03T06:25:23.486351+0000","last_change":"2023-03-03T06:25:23.486351+0000","last_active":"2023-03-03T06:25:23.486351+0000","last_peered":"2023-03-03T06:25:23.486351+0000","last_clean":"2023-03-03T06:25:23.486351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-03-03T06:25:23.486351+0000","last_undegraded":"2023-03-03T06:25:23.486351+0000","last_fullsized":"2023-03-03T06:25:23.486351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216499+0000","last_change":"2023-03-03T06:25:05.431790+0000","last_active":"2023-03-03T06:25:20.216499+0000","last_peered":"2023-03-03T06:25:20.216499+0000","last_clean":"2023-03-03T06:25:20.216499+0000","last_became_active":"2023-03-03T06:25:04.595837+0000","last_became_peered":"2023-03-03T06:25:04.595837+0000","last_unstale":"2023-03-03T06:25:20.216499+0000","last_undegraded":"2023-03-03T06:25:20.216499+0000","last_fullsized":"2023-03-03T06:25:20.216499+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:08:49.614056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019659870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-03-03T06:25:20.216131+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:25:20.216131+0000","last_peered":"2023-03-03T06:25:20.216131+0000","last_clean":"2023-03-03T06:25:20.216131+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:25:20.216131+0000","last_undegraded":"2023-03-03T06:25:20.216131+0000","last_fullsized":"2023-03-03T06:25:20.216131+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10152,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":8960,"kb_avail":94361688,"statfs":{"total":96636764160,"available":96626368512,"internally_reserved":0,"allocated":1212416,"data_stored":879241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9175040},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.432},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.48999999999999999}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.624},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8932,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362908,"statfs":{"total":96636764160,"available":96627617792,"internally_reserved":0,"allocated":618496,"data_stored":288873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.318}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.372},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10088,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94361752,"statfs":{"total":96636764160,"available":96626434048,"internally_reserved":0,"allocated":1212416,"data_stored":879241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.309}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.622}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9056,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362784,"statfs":{"total":96636764160,"available":96627490816,"internally_reserved":0,"allocated":614400,"data_stored":287912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.378},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.48899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8868,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362972,"statfs":{"total":96636764160,"available":96627683328,"internally_reserved":0,"allocated":618496,"data_stored":288873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.26500000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":7.4820000000000002,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.371},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.622},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59199999999999997}]},{"osd":7,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9124,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362716,"statfs":{"total":96636764160,"available":96627421184,"internally_reserved":0,"allocated":618496,"data_stored":288873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.26700000000000002}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.371},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.504},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.63200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":618496,"data_stored":288873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.55900000000000005}]},{"osd":5,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.437}]},{"osd":6,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46200000000000002}]},{"osd":7,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.49399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8992,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362848,"statfs":{"total":96636764160,"available":96627556352,"internally_reserved":0,"allocated":614400,"data_stored":287912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.745},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.72299999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.79500000000000004}]},{"osd":3,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76000000000000001}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.52100000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.377},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.70899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:25:29.452 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:25:29.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.607+0000 7fd9dd1f4700 1 Processor -- start 2023-03-03T06:25:29.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.607+0000 7fd9dd1f4700 1 -- start start 2023-03-03T06:25:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.608+0000 7fd9dd1f4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9d815d320 0x7fd9d80cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.608+0000 7fd9dd1f4700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd9d80b18d0 0x7fd9d80b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:29.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.608+0000 7fd9dd1f4700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d81577c0 con 0x7fd9d81573f0 2023-03-03T06:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.608+0000 7fd9dd1f4700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d80cc6e0 con 0x7fd9d80b18d0 2023-03-03T06:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.608+0000 7fd9dd1f4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80cd790 con 0x7fd9d815d320 2023-03-03T06:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.609+0000 7fd9d759e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd9d80b18d0 0x7fd9d80b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.609+0000 7fd9d659c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9d815d320 0x7fd9d80cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.609+0000 7fd9d659c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9d815d320 0x7fd9d80cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:42666/0 (socket says 172.21.15.5:42666) 2023-03-03T06:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.609+0000 7fd9d659c700 1 -- 172.21.15.5:0/129116735 learned_addr learned my addr 172.21.15.5:0/129116735 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:29.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.609+0000 7fd9d759e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd9d80b18d0 0x7fd9d80b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:44950/0 (socket says 172.21.15.5:44950) 2023-03-03T06:25:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.609+0000 7fd9d659c700 1 -- 172.21.15.5:0/129116735 >> v2:172.21.15.191:3300/0 conn(0x7fd9d80b18d0 msgr2=0x7fd9d80b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.609+0000 7fd9d659c700 1 --2- 172.21.15.5:0/129116735 >> v2:172.21.15.191:3300/0 conn(0x7fd9d80b18d0 0x7fd9d80b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.609+0000 7fd9d659c700 1 -- 172.21.15.5:0/129116735 >> v1:172.21.15.191:6789/0 conn(0x7fd9d81573f0 legacy=0x7fd9d80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.609+0000 7fd9d659c700 1 -- 172.21.15.5:0/129116735 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d80b2270 con 0x7fd9d815d320 2023-03-03T06:25:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.609+0000 7fd9d659c700 1 --2- 172.21.15.5:0/129116735 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9d815d320 0x7fd9d80cc1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0006fd0 tx=0x7fd9c000be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fce02027c942e16 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.609+0000 7fd9d5d9b700 1 -- 172.21.15.5:0/129116735 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0005e30 con 0x7fd9d815d320 2023-03-03T06:25:29.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.609+0000 7fd9d5d9b700 1 -- 172.21.15.5:0/129116735 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c0004030 con 0x7fd9d815d320 2023-03-03T06:25:29.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.609+0000 7fd9d5d9b700 1 -- 172.21.15.5:0/129116735 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c00043e0 con 0x7fd9d815d320 2023-03-03T06:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.610+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/129116735 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9d815d320 msgr2=0x7fd9d80cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.610+0000 7fd9dd1f4700 1 --2- 172.21.15.5:0/129116735 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9d815d320 0x7fd9d80cc1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0006fd0 tx=0x7fd9c000be70 comp rx=0 tx=0).stop 2023-03-03T06:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.610+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/129116735 shutdown_connections 2023-03-03T06:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.610+0000 7fd9dd1f4700 1 --2- 172.21.15.5:0/129116735 >> v2:172.21.15.191:3300/0 conn(0x7fd9d80b18d0 0x7fd9d80b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.610+0000 7fd9dd1f4700 1 --2- 172.21.15.5:0/129116735 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9d815d320 0x7fd9d80cc1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.610+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/129116735 >> 172.21.15.5:0/129116735 conn(0x7fd9d80cc8d0 msgr2=0x7fd9d80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.610+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/129116735 shutdown_connections 2023-03-03T06:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.610+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/129116735 wait complete. 2023-03-03T06:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.611+0000 7fd9dd1f4700 1 Processor -- start 2023-03-03T06:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.612+0000 7fd9dd1f4700 1 -- start start 2023-03-03T06:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.612+0000 7fd9dd1f4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9d80b18d0 0x7fd9d81ed690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.612+0000 7fd9dd1f4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9d81573f0 0x7fd9d80b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:29.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.612+0000 7fd9dd1f4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d815d320 0x7fd9d80b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.612+0000 7fd9dd1f4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d81551d0 con 0x7fd9d815d320 2023-03-03T06:25:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.612+0000 7fd9dd1f4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d81545c0 con 0x7fd9d81573f0 2023-03-03T06:25:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.612+0000 7fd9dd1f4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d81548a0 con 0x7fd9d80b18d0 2023-03-03T06:25:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.612+0000 7fd9d759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d815d320 0x7fd9d80b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.612+0000 7fd9d759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d815d320 0x7fd9d80b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44596/0 (socket says 172.21.15.5:44596) 2023-03-03T06:25:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.612+0000 7fd9d759e700 1 -- 172.21.15.5:0/1372746881 learned_addr learned my addr 172.21.15.5:0/1372746881 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.613+0000 7fd9d6d9d700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9d80b18d0 0x7fd9d81ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.613+0000 7fd9d659c700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9d81573f0 0x7fd9d80b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.613+0000 7fd9d759e700 1 -- 172.21.15.5:0/1372746881 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9d80b18d0 msgr2=0x7fd9d81ed690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.613+0000 7fd9d759e700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9d80b18d0 0x7fd9d81ed690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.613+0000 7fd9d759e700 1 -- 172.21.15.5:0/1372746881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9d81573f0 msgr2=0x7fd9d80b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.613+0000 7fd9d759e700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9d81573f0 0x7fd9d80b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.613+0000 7fd9d759e700 1 -- 172.21.15.5:0/1372746881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c000b7a0 con 0x7fd9d815d320 2023-03-03T06:25:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.613+0000 7fd9d759e700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d815d320 0x7fd9d80b3ab0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000efc0 tx=0x7fd9d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.613+0000 7fd9cf7fe700 1 -- 172.21.15.5:0/1372746881 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0009ea0 con 0x7fd9d815d320 2023-03-03T06:25:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.613+0000 7fd9cf7fe700 1 -- 172.21.15.5:0/1372746881 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d000f040 con 0x7fd9d815d320 2023-03-03T06:25:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.613+0000 7fd9cf7fe700 1 -- 172.21.15.5:0/1372746881 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000ced0 con 0x7fd9d815d320 2023-03-03T06:25:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.613+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/1372746881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d80ce460 con 0x7fd9d815d320 2023-03-03T06:25:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.613+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/1372746881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d8159e60 con 0x7fd9d815d320 2023-03-03T06:25:29.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.614+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/1372746881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d815d900 con 0x7fd9d815d320 2023-03-03T06:25:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.615+0000 7fd9cf7fe700 1 -- 172.21.15.5:0/1372746881 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd9d0014480 con 0x7fd9d815d320 2023-03-03T06:25:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.615+0000 7fd9cf7fe700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9b80682f0 0x7fd9b806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.615+0000 7fd9cf7fe700 1 -- 172.21.15.5:0/1372746881 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd9d00868b0 con 0x7fd9d815d320 2023-03-03T06:25:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.615+0000 7fd9d6d9d700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9b80682f0 0x7fd9b806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.615+0000 7fd9d6d9d700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9b80682f0 0x7fd9b806a7a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8007fd0 tx=0x7fd9c8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.619+0000 7fd9cf7fe700 1 -- 172.21.15.5:0/1372746881 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd9d0052e10 con 0x7fd9d815d320 2023-03-03T06:25:29.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.809+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/1372746881 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9d8155310 con 0x7fd9b80682f0 2023-03-03T06:25:29.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.819+0000 7fd9cf7fe700 1 -- 172.21.15.5:0/1372746881 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392265 (secure 0 0 0) 0x7fd9c8001560 con 0x7fd9b80682f0 2023-03-03T06:25:29.825 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.823+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/1372746881 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9b80682f0 msgr2=0x7fd9b806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.823+0000 7fd9dd1f4700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9b80682f0 0x7fd9b806a7a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8007fd0 tx=0x7fd9c8009040 comp rx=0 tx=0).stop 2023-03-03T06:25:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.823+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/1372746881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d815d320 msgr2=0x7fd9d80b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:29.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.823+0000 7fd9dd1f4700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d815d320 0x7fd9d80b3ab0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000efc0 tx=0x7fd9d000c3a0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.823+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/1372746881 shutdown_connections 2023-03-03T06:25:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.823+0000 7fd9dd1f4700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9d815d320 0x7fd9d80b3ab0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.823+0000 7fd9dd1f4700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9b80682f0 0x7fd9b806a7a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.823+0000 7fd9dd1f4700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9d80b18d0 0x7fd9d81ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.823+0000 7fd9dd1f4700 1 --2- 172.21.15.5:0/1372746881 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9d81573f0 0x7fd9d80b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.823+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/1372746881 >> 172.21.15.5:0/1372746881 conn(0x7fd9d80cc8d0 msgr2=0x7fd9d806b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.823+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/1372746881 shutdown_connections 2023-03-03T06:25:29.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:29.823+0000 7fd9dd1f4700 1 -- 172.21.15.5:0/1372746881 wait complete. 2023-03-03T06:25:29.829 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:25:29.837 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-03-03T06:25:29.484096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":249,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":76128,"kb_used_data":6432,"kb_used_omap":0,"kb_used_meta":69632,"kb_avail":754898592,"statfs":{"total":773094113280,"available":773016158208,"internally_reserved":0,"allocated":6586368,"data_stored":3728562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71303168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.993261"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125720+0000","last_change":"2023-03-03T06:25:24.935569+0000","last_active":"2023-03-03T06:25:26.125720+0000","last_peered":"2023-03-03T06:25:26.125720+0000","last_clean":"2023-03-03T06:25:26.125720+0000","last_became_active":"2023-03-03T06:25:24.935292+0000","last_became_peered":"2023-03-03T06:25:24.935292+0000","last_unstale":"2023-03-03T06:25:26.125720+0000","last_undegraded":"2023-03-03T06:25:26.125720+0000","last_fullsized":"2023-03-03T06:25:26.125720+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:38:56.804003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125539+0000","last_change":"2023-03-03T06:25:24.933504+0000","last_active":"2023-03-03T06:25:26.125539+0000","last_peered":"2023-03-03T06:25:26.125539+0000","last_clean":"2023-03-03T06:25:26.125539+0000","last_became_active":"2023-03-03T06:25:24.933222+0000","last_became_peered":"2023-03-03T06:25:24.933222+0000","last_unstale":"2023-03-03T06:25:26.125539+0000","last_undegraded":"2023-03-03T06:25:26.125539+0000","last_fullsized":"2023-03-03T06:25:26.125539+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:58:45.529684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126513+0000","last_change":"2023-03-03T06:25:24.941017+0000","last_active":"2023-03-03T06:25:26.126513+0000","last_peered":"2023-03-03T06:25:26.126513+0000","last_clean":"2023-03-03T06:25:26.126513+0000","last_became_active":"2023-03-03T06:25:24.939949+0000","last_became_peered":"2023-03-03T06:25:24.939949+0000","last_unstale":"2023-03-03T06:25:26.126513+0000","last_undegraded":"2023-03-03T06:25:26.126513+0000","last_fullsized":"2023-03-03T06:25:26.126513+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:00.665647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927669+0000","last_change":"2023-03-03T06:25:24.951803+0000","last_active":"2023-03-03T06:25:25.927669+0000","last_peered":"2023-03-03T06:25:25.927669+0000","last_clean":"2023-03-03T06:25:25.927669+0000","last_became_active":"2023-03-03T06:25:24.948614+0000","last_became_peered":"2023-03-03T06:25:24.948614+0000","last_unstale":"2023-03-03T06:25:25.927669+0000","last_undegraded":"2023-03-03T06:25:25.927669+0000","last_fullsized":"2023-03-03T06:25:25.927669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:16:25.029237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126611+0000","last_change":"2023-03-03T06:25:24.951103+0000","last_active":"2023-03-03T06:25:26.126611+0000","last_peered":"2023-03-03T06:25:26.126611+0000","last_clean":"2023-03-03T06:25:26.126611+0000","last_became_active":"2023-03-03T06:25:24.950824+0000","last_became_peered":"2023-03-03T06:25:24.950824+0000","last_unstale":"2023-03-03T06:25:26.126611+0000","last_undegraded":"2023-03-03T06:25:26.126611+0000","last_fullsized":"2023-03-03T06:25:26.126611+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:58:45.529684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124683+0000","last_change":"2023-03-03T06:25:24.940552+0000","last_active":"2023-03-03T06:25:26.124683+0000","last_peered":"2023-03-03T06:25:26.124683+0000","last_clean":"2023-03-03T06:25:26.124683+0000","last_became_active":"2023-03-03T06:25:24.940261+0000","last_became_peered":"2023-03-03T06:25:24.940261+0000","last_unstale":"2023-03-03T06:25:26.124683+0000","last_undegraded":"2023-03-03T06:25:26.124683+0000","last_fullsized":"2023-03-03T06:25:26.124683+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:10:56.787049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924705+0000","last_change":"2023-03-03T06:25:24.941231+0000","last_active":"2023-03-03T06:25:25.924705+0000","last_peered":"2023-03-03T06:25:25.924705+0000","last_clean":"2023-03-03T06:25:25.924705+0000","last_became_active":"2023-03-03T06:25:24.940898+0000","last_became_peered":"2023-03-03T06:25:24.940898+0000","last_unstale":"2023-03-03T06:25:25.924705+0000","last_undegraded":"2023-03-03T06:25:25.924705+0000","last_fullsized":"2023-03-03T06:25:25.924705+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:56.288223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124707+0000","last_change":"2023-03-03T06:25:24.941288+0000","last_active":"2023-03-03T06:25:26.124707+0000","last_peered":"2023-03-03T06:25:26.124707+0000","last_clean":"2023-03-03T06:25:26.124707+0000","last_became_active":"2023-03-03T06:25:24.940747+0000","last_became_peered":"2023-03-03T06:25:24.940747+0000","last_unstale":"2023-03-03T06:25:26.124707+0000","last_undegraded":"2023-03-03T06:25:26.124707+0000","last_fullsized":"2023-03-03T06:25:26.124707+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:05.741040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126840+0000","last_change":"2023-03-03T06:25:24.950479+0000","last_active":"2023-03-03T06:25:26.126840+0000","last_peered":"2023-03-03T06:25:26.126840+0000","last_clean":"2023-03-03T06:25:26.126840+0000","last_became_active":"2023-03-03T06:25:24.950185+0000","last_became_peered":"2023-03-03T06:25:24.950185+0000","last_unstale":"2023-03-03T06:25:26.126840+0000","last_undegraded":"2023-03-03T06:25:26.126840+0000","last_fullsized":"2023-03-03T06:25:26.126840+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:29:57.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126768+0000","last_change":"2023-03-03T06:25:24.942656+0000","last_active":"2023-03-03T06:25:26.126768+0000","last_peered":"2023-03-03T06:25:26.126768+0000","last_clean":"2023-03-03T06:25:26.126768+0000","last_became_active":"2023-03-03T06:25:24.942401+0000","last_became_peered":"2023-03-03T06:25:24.942401+0000","last_unstale":"2023-03-03T06:25:26.126768+0000","last_undegraded":"2023-03-03T06:25:26.126768+0000","last_fullsized":"2023-03-03T06:25:26.126768+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:50:10.945053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927752+0000","last_change":"2023-03-03T06:25:24.944377+0000","last_active":"2023-03-03T06:25:25.927752+0000","last_peered":"2023-03-03T06:25:25.927752+0000","last_clean":"2023-03-03T06:25:25.927752+0000","last_became_active":"2023-03-03T06:25:24.943646+0000","last_became_peered":"2023-03-03T06:25:24.943646+0000","last_unstale":"2023-03-03T06:25:25.927752+0000","last_undegraded":"2023-03-03T06:25:25.927752+0000","last_fullsized":"2023-03-03T06:25:25.927752+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:36:14.477572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124995+0000","last_change":"2023-03-03T06:25:24.946217+0000","last_active":"2023-03-03T06:25:26.124995+0000","last_peered":"2023-03-03T06:25:26.124995+0000","last_clean":"2023-03-03T06:25:26.124995+0000","last_became_active":"2023-03-03T06:25:24.945915+0000","last_became_peered":"2023-03-03T06:25:24.945915+0000","last_unstale":"2023-03-03T06:25:26.124995+0000","last_undegraded":"2023-03-03T06:25:26.124995+0000","last_fullsized":"2023-03-03T06:25:26.124995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:14:54.560548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124820+0000","last_change":"2023-03-03T06:25:24.941338+0000","last_active":"2023-03-03T06:25:26.124820+0000","last_peered":"2023-03-03T06:25:26.124820+0000","last_clean":"2023-03-03T06:25:26.124820+0000","last_became_active":"2023-03-03T06:25:24.940975+0000","last_became_peered":"2023-03-03T06:25:24.940975+0000","last_unstale":"2023-03-03T06:25:26.124820+0000","last_undegraded":"2023-03-03T06:25:26.124820+0000","last_fullsized":"2023-03-03T06:25:26.124820+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:05:56.931797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126380+0000","last_change":"2023-03-03T06:25:24.941629+0000","last_active":"2023-03-03T06:25:26.126380+0000","last_peered":"2023-03-03T06:25:26.126380+0000","last_clean":"2023-03-03T06:25:26.126380+0000","last_became_active":"2023-03-03T06:25:24.941356+0000","last_became_peered":"2023-03-03T06:25:24.941356+0000","last_unstale":"2023-03-03T06:25:26.126380+0000","last_undegraded":"2023-03-03T06:25:26.126380+0000","last_fullsized":"2023-03-03T06:25:26.126380+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:28:45.764299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126326+0000","last_change":"2023-03-03T06:25:24.940067+0000","last_active":"2023-03-03T06:25:26.126326+0000","last_peered":"2023-03-03T06:25:26.126326+0000","last_clean":"2023-03-03T06:25:26.126326+0000","last_became_active":"2023-03-03T06:25:24.939655+0000","last_became_peered":"2023-03-03T06:25:24.939655+0000","last_unstale":"2023-03-03T06:25:26.126326+0000","last_undegraded":"2023-03-03T06:25:26.126326+0000","last_fullsized":"2023-03-03T06:25:26.126326+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:00:12.817746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924450+0000","last_change":"2023-03-03T06:25:24.934523+0000","last_active":"2023-03-03T06:25:25.924450+0000","last_peered":"2023-03-03T06:25:25.924450+0000","last_clean":"2023-03-03T06:25:25.924450+0000","last_became_active":"2023-03-03T06:25:24.934274+0000","last_became_peered":"2023-03-03T06:25:24.934274+0000","last_unstale":"2023-03-03T06:25:25.924450+0000","last_undegraded":"2023-03-03T06:25:25.924450+0000","last_fullsized":"2023-03-03T06:25:25.924450+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:01:02.628122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125658+0000","last_change":"2023-03-03T06:25:24.949752+0000","last_active":"2023-03-03T06:25:26.125658+0000","last_peered":"2023-03-03T06:25:26.125658+0000","last_clean":"2023-03-03T06:25:26.125658+0000","last_became_active":"2023-03-03T06:25:24.949316+0000","last_became_peered":"2023-03-03T06:25:24.949316+0000","last_unstale":"2023-03-03T06:25:26.125658+0000","last_undegraded":"2023-03-03T06:25:26.125658+0000","last_fullsized":"2023-03-03T06:25:26.125658+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:19:01.571013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.928051+0000","last_change":"2023-03-03T06:25:24.951882+0000","last_active":"2023-03-03T06:25:25.928051+0000","last_peered":"2023-03-03T06:25:25.928051+0000","last_clean":"2023-03-03T06:25:25.928051+0000","last_became_active":"2023-03-03T06:25:24.948457+0000","last_became_peered":"2023-03-03T06:25:24.948457+0000","last_unstale":"2023-03-03T06:25:25.928051+0000","last_undegraded":"2023-03-03T06:25:25.928051+0000","last_fullsized":"2023-03-03T06:25:25.928051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:25:46.667651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125581+0000","last_change":"2023-03-03T06:25:24.936053+0000","last_active":"2023-03-03T06:25:26.125581+0000","last_peered":"2023-03-03T06:25:26.125581+0000","last_clean":"2023-03-03T06:25:26.125581+0000","last_became_active":"2023-03-03T06:25:24.935821+0000","last_became_peered":"2023-03-03T06:25:24.935821+0000","last_unstale":"2023-03-03T06:25:26.125581+0000","last_undegraded":"2023-03-03T06:25:26.125581+0000","last_fullsized":"2023-03-03T06:25:26.125581+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:38:56.804003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925560+0000","last_change":"2023-03-03T06:25:24.939080+0000","last_active":"2023-03-03T06:25:25.925560+0000","last_peered":"2023-03-03T06:25:25.925560+0000","last_clean":"2023-03-03T06:25:25.925560+0000","last_became_active":"2023-03-03T06:25:24.938676+0000","last_became_peered":"2023-03-03T06:25:24.938676+0000","last_unstale":"2023-03-03T06:25:25.925560+0000","last_undegraded":"2023-03-03T06:25:25.925560+0000","last_fullsized":"2023-03-03T06:25:25.925560+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:49:46.607290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124946+0000","last_change":"2023-03-03T06:25:24.928487+0000","last_active":"2023-03-03T06:25:26.124946+0000","last_peered":"2023-03-03T06:25:26.124946+0000","last_clean":"2023-03-03T06:25:26.124946+0000","last_became_active":"2023-03-03T06:25:24.928191+0000","last_became_peered":"2023-03-03T06:25:24.928191+0000","last_unstale":"2023-03-03T06:25:26.124946+0000","last_undegraded":"2023-03-03T06:25:26.124946+0000","last_fullsized":"2023-03-03T06:25:26.124946+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:47:32.677256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925618+0000","last_change":"2023-03-03T06:25:24.942231+0000","last_active":"2023-03-03T06:25:25.925618+0000","last_peered":"2023-03-03T06:25:25.925618+0000","last_clean":"2023-03-03T06:25:25.925618+0000","last_became_active":"2023-03-03T06:25:24.941956+0000","last_became_peered":"2023-03-03T06:25:24.941956+0000","last_unstale":"2023-03-03T06:25:25.925618+0000","last_undegraded":"2023-03-03T06:25:25.925618+0000","last_fullsized":"2023-03-03T06:25:25.925618+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:25:46.667651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925445+0000","last_change":"2023-03-03T06:25:24.941614+0000","last_active":"2023-03-03T06:25:25.925445+0000","last_peered":"2023-03-03T06:25:25.925445+0000","last_clean":"2023-03-03T06:25:25.925445+0000","last_became_active":"2023-03-03T06:25:24.941347+0000","last_became_peered":"2023-03-03T06:25:24.941347+0000","last_unstale":"2023-03-03T06:25:25.925445+0000","last_undegraded":"2023-03-03T06:25:25.925445+0000","last_fullsized":"2023-03-03T06:25:25.925445+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:10:56.787049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126077+0000","last_change":"2023-03-03T06:25:24.940730+0000","last_active":"2023-03-03T06:25:26.126077+0000","last_peered":"2023-03-03T06:25:26.126077+0000","last_clean":"2023-03-03T06:25:26.126077+0000","last_became_active":"2023-03-03T06:25:24.940415+0000","last_became_peered":"2023-03-03T06:25:24.940415+0000","last_unstale":"2023-03-03T06:25:26.126077+0000","last_undegraded":"2023-03-03T06:25:26.126077+0000","last_fullsized":"2023-03-03T06:25:26.126077+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:37:30.630979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125435+0000","last_change":"2023-03-03T06:25:24.934953+0000","last_active":"2023-03-03T06:25:26.125435+0000","last_peered":"2023-03-03T06:25:26.125435+0000","last_clean":"2023-03-03T06:25:26.125435+0000","last_became_active":"2023-03-03T06:25:24.934638+0000","last_became_peered":"2023-03-03T06:25:24.934638+0000","last_unstale":"2023-03-03T06:25:26.125435+0000","last_undegraded":"2023-03-03T06:25:26.125435+0000","last_fullsized":"2023-03-03T06:25:26.125435+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:47.949094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125275+0000","last_change":"2023-03-03T06:25:24.934344+0000","last_active":"2023-03-03T06:25:26.125275+0000","last_peered":"2023-03-03T06:25:26.125275+0000","last_clean":"2023-03-03T06:25:26.125275+0000","last_became_active":"2023-03-03T06:25:24.933879+0000","last_became_peered":"2023-03-03T06:25:24.933879+0000","last_unstale":"2023-03-03T06:25:26.125275+0000","last_undegraded":"2023-03-03T06:25:26.125275+0000","last_fullsized":"2023-03-03T06:25:26.125275+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:15:55.076368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927873+0000","last_change":"2023-03-03T06:25:24.950493+0000","last_active":"2023-03-03T06:25:25.927873+0000","last_peered":"2023-03-03T06:25:25.927873+0000","last_clean":"2023-03-03T06:25:25.927873+0000","last_became_active":"2023-03-03T06:25:24.948493+0000","last_became_peered":"2023-03-03T06:25:24.948493+0000","last_unstale":"2023-03-03T06:25:25.927873+0000","last_undegraded":"2023-03-03T06:25:25.927873+0000","last_fullsized":"2023-03-03T06:25:25.927873+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:10:56.787049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124425+0000","last_change":"2023-03-03T06:25:24.934079+0000","last_active":"2023-03-03T06:25:26.124425+0000","last_peered":"2023-03-03T06:25:26.124425+0000","last_clean":"2023-03-03T06:25:26.124425+0000","last_became_active":"2023-03-03T06:25:24.933811+0000","last_became_peered":"2023-03-03T06:25:24.933811+0000","last_unstale":"2023-03-03T06:25:26.124425+0000","last_undegraded":"2023-03-03T06:25:26.124425+0000","last_fullsized":"2023-03-03T06:25:26.124425+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:34:23.666936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126633+0000","last_change":"2023-03-03T06:25:24.950185+0000","last_active":"2023-03-03T06:25:26.126633+0000","last_peered":"2023-03-03T06:25:26.126633+0000","last_clean":"2023-03-03T06:25:26.126633+0000","last_became_active":"2023-03-03T06:25:24.949907+0000","last_became_peered":"2023-03-03T06:25:24.949907+0000","last_unstale":"2023-03-03T06:25:26.126633+0000","last_undegraded":"2023-03-03T06:25:26.126633+0000","last_fullsized":"2023-03-03T06:25:26.126633+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:21:16.832581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125666+0000","last_change":"2023-03-03T06:25:24.942003+0000","last_active":"2023-03-03T06:25:26.125666+0000","last_peered":"2023-03-03T06:25:26.125666+0000","last_clean":"2023-03-03T06:25:26.125666+0000","last_became_active":"2023-03-03T06:25:24.941743+0000","last_became_peered":"2023-03-03T06:25:24.941743+0000","last_unstale":"2023-03-03T06:25:26.125666+0000","last_undegraded":"2023-03-03T06:25:26.125666+0000","last_fullsized":"2023-03-03T06:25:26.125666+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:50:43.336071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927347+0000","last_change":"2023-03-03T06:25:24.953502+0000","last_active":"2023-03-03T06:25:25.927347+0000","last_peered":"2023-03-03T06:25:25.927347+0000","last_clean":"2023-03-03T06:25:25.927347+0000","last_became_active":"2023-03-03T06:25:24.953247+0000","last_became_peered":"2023-03-03T06:25:24.953247+0000","last_unstale":"2023-03-03T06:25:25.927347+0000","last_undegraded":"2023-03-03T06:25:25.927347+0000","last_fullsized":"2023-03-03T06:25:25.927347+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:19:50.229403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124277+0000","last_change":"2023-03-03T06:25:24.934820+0000","last_active":"2023-03-03T06:25:26.124277+0000","last_peered":"2023-03-03T06:25:26.124277+0000","last_clean":"2023-03-03T06:25:26.124277+0000","last_became_active":"2023-03-03T06:25:24.934333+0000","last_became_peered":"2023-03-03T06:25:24.934333+0000","last_unstale":"2023-03-03T06:25:26.124277+0000","last_undegraded":"2023-03-03T06:25:26.124277+0000","last_fullsized":"2023-03-03T06:25:26.124277+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:19:50.229403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124949+0000","last_change":"2023-03-03T06:25:24.944796+0000","last_active":"2023-03-03T06:25:26.124949+0000","last_peered":"2023-03-03T06:25:26.124949+0000","last_clean":"2023-03-03T06:25:26.124949+0000","last_became_active":"2023-03-03T06:25:24.944619+0000","last_became_peered":"2023-03-03T06:25:24.944619+0000","last_unstale":"2023-03-03T06:25:26.124949+0000","last_undegraded":"2023-03-03T06:25:26.124949+0000","last_fullsized":"2023-03-03T06:25:26.124949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:42:07.547230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"55'8","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927223+0000","last_change":"2023-03-03T06:25:24.518747+0000","last_active":"2023-03-03T06:25:25.927223+0000","last_peered":"2023-03-03T06:25:25.927223+0000","last_clean":"2023-03-03T06:25:25.927223+0000","last_became_active":"2023-03-03T06:25:24.518462+0000","last_became_peered":"2023-03-03T06:25:24.518462+0000","last_unstale":"2023-03-03T06:25:25.927223+0000","last_undegraded":"2023-03-03T06:25:25.927223+0000","last_fullsized":"2023-03-03T06:25:25.927223+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:29:56.144718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.921255+0000","last_change":"2023-03-03T06:25:05.635776+0000","last_active":"2023-03-03T06:25:24.921255+0000","last_peered":"2023-03-03T06:25:24.921255+0000","last_clean":"2023-03-03T06:25:24.921255+0000","last_became_active":"2023-03-03T06:25:04.444243+0000","last_became_peered":"2023-03-03T06:25:04.444243+0000","last_unstale":"2023-03-03T06:25:24.921255+0000","last_undegraded":"2023-03-03T06:25:24.921255+0000","last_fullsized":"2023-03-03T06:25:24.921255+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:00:41.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066956899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125958+0000","last_change":"2023-03-03T06:25:24.945196+0000","last_active":"2023-03-03T06:25:26.125958+0000","last_peered":"2023-03-03T06:25:26.125958+0000","last_clean":"2023-03-03T06:25:26.125958+0000","last_became_active":"2023-03-03T06:25:24.937674+0000","last_became_peered":"2023-03-03T06:25:24.937674+0000","last_unstale":"2023-03-03T06:25:26.125958+0000","last_undegraded":"2023-03-03T06:25:26.125958+0000","last_fullsized":"2023-03-03T06:25:26.125958+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:34:23.666936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126281+0000","last_change":"2023-03-03T06:25:24.523642+0000","last_active":"2023-03-03T06:25:26.126281+0000","last_peered":"2023-03-03T06:25:26.126281+0000","last_clean":"2023-03-03T06:25:26.126281+0000","last_became_active":"2023-03-03T06:25:24.523365+0000","last_became_peered":"2023-03-03T06:25:24.523365+0000","last_unstale":"2023-03-03T06:25:26.126281+0000","last_undegraded":"2023-03-03T06:25:26.126281+0000","last_fullsized":"2023-03-03T06:25:26.126281+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:38:55.799484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.924741+0000","last_change":"2023-03-03T06:25:05.615550+0000","last_active":"2023-03-03T06:25:24.924741+0000","last_peered":"2023-03-03T06:25:24.924741+0000","last_clean":"2023-03-03T06:25:24.924741+0000","last_became_active":"2023-03-03T06:25:04.445574+0000","last_became_peered":"2023-03-03T06:25:04.445574+0000","last_unstale":"2023-03-03T06:25:24.924741+0000","last_undegraded":"2023-03-03T06:25:24.924741+0000","last_fullsized":"2023-03-03T06:25:24.924741+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:15:06.370284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061229600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124962+0000","last_change":"2023-03-03T06:25:24.931742+0000","last_active":"2023-03-03T06:25:26.124962+0000","last_peered":"2023-03-03T06:25:26.124962+0000","last_clean":"2023-03-03T06:25:26.124962+0000","last_became_active":"2023-03-03T06:25:24.931451+0000","last_became_peered":"2023-03-03T06:25:24.931451+0000","last_unstale":"2023-03-03T06:25:26.124962+0000","last_undegraded":"2023-03-03T06:25:26.124962+0000","last_fullsized":"2023-03-03T06:25:26.124962+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:06:51.664573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125736+0000","last_change":"2023-03-03T06:25:24.510327+0000","last_active":"2023-03-03T06:25:26.125736+0000","last_peered":"2023-03-03T06:25:26.125736+0000","last_clean":"2023-03-03T06:25:26.125736+0000","last_became_active":"2023-03-03T06:25:24.509532+0000","last_became_peered":"2023-03-03T06:25:24.509532+0000","last_unstale":"2023-03-03T06:25:26.125736+0000","last_undegraded":"2023-03-03T06:25:26.125736+0000","last_fullsized":"2023-03-03T06:25:26.125736+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:42:06.542711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928065+0000","last_change":"2023-03-03T06:25:05.431475+0000","last_active":"2023-03-03T06:25:24.928065+0000","last_peered":"2023-03-03T06:25:24.928065+0000","last_clean":"2023-03-03T06:25:24.928065+0000","last_became_active":"2023-03-03T06:25:04.596724+0000","last_became_peered":"2023-03-03T06:25:04.596724+0000","last_unstale":"2023-03-03T06:25:24.928065+0000","last_undegraded":"2023-03-03T06:25:24.928065+0000","last_fullsized":"2023-03-03T06:25:24.928065+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015785179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927235+0000","last_change":"2023-03-03T06:25:24.952416+0000","last_active":"2023-03-03T06:25:25.927235+0000","last_peered":"2023-03-03T06:25:25.927235+0000","last_clean":"2023-03-03T06:25:25.927235+0000","last_became_active":"2023-03-03T06:25:24.952190+0000","last_became_peered":"2023-03-03T06:25:24.952190+0000","last_unstale":"2023-03-03T06:25:25.927235+0000","last_undegraded":"2023-03-03T06:25:25.927235+0000","last_fullsized":"2023-03-03T06:25:25.927235+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:49:46.607290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126629+0000","last_change":"2023-03-03T06:25:24.524194+0000","last_active":"2023-03-03T06:25:26.126629+0000","last_peered":"2023-03-03T06:25:26.126629+0000","last_clean":"2023-03-03T06:25:26.126629+0000","last_became_active":"2023-03-03T06:25:24.523955+0000","last_became_peered":"2023-03-03T06:25:24.523955+0000","last_unstale":"2023-03-03T06:25:26.126629+0000","last_undegraded":"2023-03-03T06:25:26.126629+0000","last_fullsized":"2023-03-03T06:25:26.126629+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:58:44.525165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.925668+0000","last_change":"2023-03-03T06:25:05.796744+0000","last_active":"2023-03-03T06:25:24.925668+0000","last_peered":"2023-03-03T06:25:24.925668+0000","last_clean":"2023-03-03T06:25:24.925668+0000","last_became_active":"2023-03-03T06:25:04.444571+0000","last_became_peered":"2023-03-03T06:25:04.444571+0000","last_unstale":"2023-03-03T06:25:24.925668+0000","last_undegraded":"2023-03-03T06:25:24.925668+0000","last_fullsized":"2023-03-03T06:25:24.925668+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:46:48.500233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050328500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927950+0000","last_change":"2023-03-03T06:25:24.939539+0000","last_active":"2023-03-03T06:25:25.927950+0000","last_peered":"2023-03-03T06:25:25.927950+0000","last_clean":"2023-03-03T06:25:25.927950+0000","last_became_active":"2023-03-03T06:25:24.939290+0000","last_became_peered":"2023-03-03T06:25:24.939290+0000","last_unstale":"2023-03-03T06:25:25.927950+0000","last_undegraded":"2023-03-03T06:25:25.927950+0000","last_fullsized":"2023-03-03T06:25:25.927950+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:15:55.076368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"55'6","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124441+0000","last_change":"2023-03-03T06:25:24.511429+0000","last_active":"2023-03-03T06:25:26.124441+0000","last_peered":"2023-03-03T06:25:26.124441+0000","last_clean":"2023-03-03T06:25:26.124441+0000","last_became_active":"2023-03-03T06:25:24.509968+0000","last_became_peered":"2023-03-03T06:25:24.509968+0000","last_unstale":"2023-03-03T06:25:26.124441+0000","last_undegraded":"2023-03-03T06:25:26.124441+0000","last_fullsized":"2023-03-03T06:25:26.124441+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:05:09.690556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927875+0000","last_change":"2023-03-03T06:25:05.615943+0000","last_active":"2023-03-03T06:25:24.927875+0000","last_peered":"2023-03-03T06:25:24.927875+0000","last_clean":"2023-03-03T06:25:24.927875+0000","last_became_active":"2023-03-03T06:25:04.443824+0000","last_became_peered":"2023-03-03T06:25:04.443824+0000","last_unstale":"2023-03-03T06:25:24.927875+0000","last_undegraded":"2023-03-03T06:25:24.927875+0000","last_fullsized":"2023-03-03T06:25:24.927875+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:11.723607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059238800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125498+0000","last_change":"2023-03-03T06:25:24.936514+0000","last_active":"2023-03-03T06:25:26.125498+0000","last_peered":"2023-03-03T06:25:26.125498+0000","last_clean":"2023-03-03T06:25:26.125498+0000","last_became_active":"2023-03-03T06:25:24.936302+0000","last_became_peered":"2023-03-03T06:25:24.936302+0000","last_unstale":"2023-03-03T06:25:26.125498+0000","last_undegraded":"2023-03-03T06:25:26.125498+0000","last_fullsized":"2023-03-03T06:25:26.125498+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:42:12.338772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"55'3","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126704+0000","last_change":"2023-03-03T06:25:24.524257+0000","last_active":"2023-03-03T06:25:26.126704+0000","last_peered":"2023-03-03T06:25:26.126704+0000","last_clean":"2023-03-03T06:25:26.126704+0000","last_became_active":"2023-03-03T06:25:24.523977+0000","last_became_peered":"2023-03-03T06:25:24.523977+0000","last_unstale":"2023-03-03T06:25:26.126704+0000","last_undegraded":"2023-03-03T06:25:26.126704+0000","last_fullsized":"2023-03-03T06:25:26.126704+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:24.002152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.938024+0000","last_change":"2023-03-03T06:25:05.430594+0000","last_active":"2023-03-03T06:25:24.938024+0000","last_peered":"2023-03-03T06:25:24.938024+0000","last_clean":"2023-03-03T06:25:24.938024+0000","last_became_active":"2023-03-03T06:25:04.435012+0000","last_became_peered":"2023-03-03T06:25:04.435012+0000","last_unstale":"2023-03-03T06:25:24.938024+0000","last_undegraded":"2023-03-03T06:25:24.938024+0000","last_fullsized":"2023-03-03T06:25:24.938024+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052988999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925746+0000","last_change":"2023-03-03T06:25:24.941624+0000","last_active":"2023-03-03T06:25:25.925746+0000","last_peered":"2023-03-03T06:25:25.925746+0000","last_clean":"2023-03-03T06:25:25.925746+0000","last_became_active":"2023-03-03T06:25:24.941371+0000","last_became_peered":"2023-03-03T06:25:24.941371+0000","last_unstale":"2023-03-03T06:25:25.925746+0000","last_undegraded":"2023-03-03T06:25:25.925746+0000","last_fullsized":"2023-03-03T06:25:25.925746+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:27:14.164819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.928147+0000","last_change":"2023-03-03T06:25:24.520152+0000","last_active":"2023-03-03T06:25:25.928147+0000","last_peered":"2023-03-03T06:25:25.928147+0000","last_clean":"2023-03-03T06:25:25.928147+0000","last_became_active":"2023-03-03T06:25:24.519863+0000","last_became_peered":"2023-03-03T06:25:24.519863+0000","last_unstale":"2023-03-03T06:25:25.928147+0000","last_undegraded":"2023-03-03T06:25:25.928147+0000","last_fullsized":"2023-03-03T06:25:25.928147+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:00:11.813227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928690+0000","last_change":"2023-03-03T06:25:05.616017+0000","last_active":"2023-03-03T06:25:24.928690+0000","last_peered":"2023-03-03T06:25:24.928690+0000","last_clean":"2023-03-03T06:25:24.928690+0000","last_became_active":"2023-03-03T06:25:04.443176+0000","last_became_peered":"2023-03-03T06:25:04.443176+0000","last_unstale":"2023-03-03T06:25:24.928690+0000","last_undegraded":"2023-03-03T06:25:24.928690+0000","last_fullsized":"2023-03-03T06:25:24.928690+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:38:47.576162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034461600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124521+0000","last_change":"2023-03-03T06:25:24.933584+0000","last_active":"2023-03-03T06:25:26.124521+0000","last_peered":"2023-03-03T06:25:26.124521+0000","last_clean":"2023-03-03T06:25:26.124521+0000","last_became_active":"2023-03-03T06:25:24.932745+0000","last_became_peered":"2023-03-03T06:25:24.932745+0000","last_unstale":"2023-03-03T06:25:26.124521+0000","last_undegraded":"2023-03-03T06:25:26.124521+0000","last_fullsized":"2023-03-03T06:25:26.124521+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:36:30.031858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126990+0000","last_change":"2023-03-03T06:25:24.524292+0000","last_active":"2023-03-03T06:25:26.126990+0000","last_peered":"2023-03-03T06:25:26.126990+0000","last_clean":"2023-03-03T06:25:26.126990+0000","last_became_active":"2023-03-03T06:25:24.523992+0000","last_became_peered":"2023-03-03T06:25:24.523992+0000","last_unstale":"2023-03-03T06:25:26.126990+0000","last_undegraded":"2023-03-03T06:25:26.126990+0000","last_fullsized":"2023-03-03T06:25:26.126990+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:10:09.890646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927153+0000","last_change":"2023-03-03T06:25:05.431768+0000","last_active":"2023-03-03T06:25:24.927153+0000","last_peered":"2023-03-03T06:25:24.927153+0000","last_clean":"2023-03-03T06:25:24.927153+0000","last_became_active":"2023-03-03T06:25:04.596711+0000","last_became_peered":"2023-03-03T06:25:04.596711+0000","last_unstale":"2023-03-03T06:25:24.927153+0000","last_undegraded":"2023-03-03T06:25:24.927153+0000","last_fullsized":"2023-03-03T06:25:24.927153+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001569261,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925513+0000","last_change":"2023-03-03T06:25:24.940880+0000","last_active":"2023-03-03T06:25:25.925513+0000","last_peered":"2023-03-03T06:25:25.925513+0000","last_clean":"2023-03-03T06:25:25.925513+0000","last_became_active":"2023-03-03T06:25:24.940629+0000","last_became_peered":"2023-03-03T06:25:24.940629+0000","last_unstale":"2023-03-03T06:25:25.925513+0000","last_undegraded":"2023-03-03T06:25:25.925513+0000","last_fullsized":"2023-03-03T06:25:25.925513+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:23:02.927157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125296+0000","last_change":"2023-03-03T06:25:24.518603+0000","last_active":"2023-03-03T06:25:26.125296+0000","last_peered":"2023-03-03T06:25:26.125296+0000","last_clean":"2023-03-03T06:25:26.125296+0000","last_became_active":"2023-03-03T06:25:24.518358+0000","last_became_peered":"2023-03-03T06:25:24.518358+0000","last_unstale":"2023-03-03T06:25:26.125296+0000","last_undegraded":"2023-03-03T06:25:26.125296+0000","last_fullsized":"2023-03-03T06:25:26.125296+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:46:07.987501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.921432+0000","last_change":"2023-03-03T06:25:05.635716+0000","last_active":"2023-03-03T06:25:24.921432+0000","last_peered":"2023-03-03T06:25:24.921432+0000","last_clean":"2023-03-03T06:25:24.921432+0000","last_became_active":"2023-03-03T06:25:04.433896+0000","last_became_peered":"2023-03-03T06:25:04.433896+0000","last_unstale":"2023-03-03T06:25:24.921432+0000","last_undegraded":"2023-03-03T06:25:24.921432+0000","last_fullsized":"2023-03-03T06:25:24.921432+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:35.209807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060132199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125405+0000","last_change":"2023-03-03T06:25:24.933888+0000","last_active":"2023-03-03T06:25:26.125405+0000","last_peered":"2023-03-03T06:25:26.125405+0000","last_clean":"2023-03-03T06:25:26.125405+0000","last_became_active":"2023-03-03T06:25:24.933615+0000","last_became_peered":"2023-03-03T06:25:24.933615+0000","last_unstale":"2023-03-03T06:25:26.125405+0000","last_undegraded":"2023-03-03T06:25:26.125405+0000","last_fullsized":"2023-03-03T06:25:26.125405+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:52:46.374182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925492+0000","last_change":"2023-03-03T06:25:24.521188+0000","last_active":"2023-03-03T06:25:25.925492+0000","last_peered":"2023-03-03T06:25:25.925492+0000","last_clean":"2023-03-03T06:25:25.925492+0000","last_became_active":"2023-03-03T06:25:24.520714+0000","last_became_peered":"2023-03-03T06:25:24.520714+0000","last_unstale":"2023-03-03T06:25:25.925492+0000","last_undegraded":"2023-03-03T06:25:25.925492+0000","last_fullsized":"2023-03-03T06:25:25.925492+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:46.944575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.938123+0000","last_change":"2023-03-03T06:25:05.429739+0000","last_active":"2023-03-03T06:25:24.938123+0000","last_peered":"2023-03-03T06:25:24.938123+0000","last_clean":"2023-03-03T06:25:24.938123+0000","last_became_active":"2023-03-03T06:25:04.438903+0000","last_became_peered":"2023-03-03T06:25:04.438903+0000","last_unstale":"2023-03-03T06:25:24.938123+0000","last_undegraded":"2023-03-03T06:25:24.938123+0000","last_fullsized":"2023-03-03T06:25:24.938123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040434999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124132+0000","last_change":"2023-03-03T06:25:24.948431+0000","last_active":"2023-03-03T06:25:26.124132+0000","last_peered":"2023-03-03T06:25:26.124132+0000","last_clean":"2023-03-03T06:25:26.124132+0000","last_became_active":"2023-03-03T06:25:24.948158+0000","last_became_peered":"2023-03-03T06:25:24.948158+0000","last_unstale":"2023-03-03T06:25:26.124132+0000","last_undegraded":"2023-03-03T06:25:26.124132+0000","last_fullsized":"2023-03-03T06:25:26.124132+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:45:13.939205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925499+0000","last_change":"2023-03-03T06:25:24.518385+0000","last_active":"2023-03-03T06:25:25.925499+0000","last_peered":"2023-03-03T06:25:25.925499+0000","last_clean":"2023-03-03T06:25:25.925499+0000","last_became_active":"2023-03-03T06:25:24.518126+0000","last_became_peered":"2023-03-03T06:25:24.518126+0000","last_unstale":"2023-03-03T06:25:25.925499+0000","last_undegraded":"2023-03-03T06:25:25.925499+0000","last_fullsized":"2023-03-03T06:25:25.925499+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:14:53.556029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.937250+0000","last_change":"2023-03-03T06:25:05.430443+0000","last_active":"2023-03-03T06:25:24.937250+0000","last_peered":"2023-03-03T06:25:24.937250+0000","last_clean":"2023-03-03T06:25:24.937250+0000","last_became_active":"2023-03-03T06:25:04.596481+0000","last_became_peered":"2023-03-03T06:25:04.596481+0000","last_unstale":"2023-03-03T06:25:24.937250+0000","last_undegraded":"2023-03-03T06:25:24.937250+0000","last_fullsized":"2023-03-03T06:25:24.937250+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044860800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924556+0000","last_change":"2023-03-03T06:25:24.929805+0000","last_active":"2023-03-03T06:25:25.924556+0000","last_peered":"2023-03-03T06:25:25.924556+0000","last_clean":"2023-03-03T06:25:25.924556+0000","last_became_active":"2023-03-03T06:25:24.929533+0000","last_became_peered":"2023-03-03T06:25:24.929533+0000","last_unstale":"2023-03-03T06:25:25.924556+0000","last_undegraded":"2023-03-03T06:25:25.924556+0000","last_fullsized":"2023-03-03T06:25:25.924556+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:13:59.125389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925540+0000","last_change":"2023-03-03T06:25:24.515807+0000","last_active":"2023-03-03T06:25:25.925540+0000","last_peered":"2023-03-03T06:25:25.925540+0000","last_clean":"2023-03-03T06:25:25.925540+0000","last_became_active":"2023-03-03T06:25:24.515261+0000","last_became_peered":"2023-03-03T06:25:24.515261+0000","last_unstale":"2023-03-03T06:25:25.925540+0000","last_undegraded":"2023-03-03T06:25:25.925540+0000","last_fullsized":"2023-03-03T06:25:25.925540+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:24:03.370366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.922995+0000","last_change":"2023-03-03T06:25:05.431490+0000","last_active":"2023-03-03T06:25:24.922995+0000","last_peered":"2023-03-03T06:25:24.922995+0000","last_clean":"2023-03-03T06:25:24.922995+0000","last_became_active":"2023-03-03T06:25:04.443163+0000","last_became_peered":"2023-03-03T06:25:04.443163+0000","last_unstale":"2023-03-03T06:25:24.922995+0000","last_undegraded":"2023-03-03T06:25:24.922995+0000","last_fullsized":"2023-03-03T06:25:24.922995+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020118839999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126936+0000","last_change":"2023-03-03T06:25:24.942160+0000","last_active":"2023-03-03T06:25:26.126936+0000","last_peered":"2023-03-03T06:25:26.126936+0000","last_clean":"2023-03-03T06:25:26.126936+0000","last_became_active":"2023-03-03T06:25:24.941839+0000","last_became_peered":"2023-03-03T06:25:24.941839+0000","last_unstale":"2023-03-03T06:25:26.126936+0000","last_undegraded":"2023-03-03T06:25:26.126936+0000","last_fullsized":"2023-03-03T06:25:26.126936+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:20:25.249056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124688+0000","last_change":"2023-03-03T06:25:24.522452+0000","last_active":"2023-03-03T06:25:26.124688+0000","last_peered":"2023-03-03T06:25:26.124688+0000","last_clean":"2023-03-03T06:25:26.124688+0000","last_became_active":"2023-03-03T06:25:24.522171+0000","last_became_peered":"2023-03-03T06:25:24.522171+0000","last_unstale":"2023-03-03T06:25:26.124688+0000","last_undegraded":"2023-03-03T06:25:26.124688+0000","last_fullsized":"2023-03-03T06:25:26.124688+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:06:50.660054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.922945+0000","last_change":"2023-03-03T06:25:05.432139+0000","last_active":"2023-03-03T06:25:24.922945+0000","last_peered":"2023-03-03T06:25:24.922945+0000","last_clean":"2023-03-03T06:25:24.922945+0000","last_became_active":"2023-03-03T06:25:04.435759+0000","last_became_peered":"2023-03-03T06:25:04.435759+0000","last_unstale":"2023-03-03T06:25:24.922945+0000","last_undegraded":"2023-03-03T06:25:24.922945+0000","last_fullsized":"2023-03-03T06:25:24.922945+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001646893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124811+0000","last_change":"2023-03-03T06:25:24.933874+0000","last_active":"2023-03-03T06:25:26.124811+0000","last_peered":"2023-03-03T06:25:26.124811+0000","last_clean":"2023-03-03T06:25:26.124811+0000","last_became_active":"2023-03-03T06:25:24.933571+0000","last_became_peered":"2023-03-03T06:25:24.933571+0000","last_unstale":"2023-03-03T06:25:26.124811+0000","last_undegraded":"2023-03-03T06:25:26.124811+0000","last_fullsized":"2023-03-03T06:25:26.124811+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:40:32.930468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124796+0000","last_change":"2023-03-03T06:25:24.514541+0000","last_active":"2023-03-03T06:25:26.124796+0000","last_peered":"2023-03-03T06:25:26.124796+0000","last_clean":"2023-03-03T06:25:26.124796+0000","last_became_active":"2023-03-03T06:25:24.514245+0000","last_became_peered":"2023-03-03T06:25:24.514245+0000","last_unstale":"2023-03-03T06:25:26.124796+0000","last_undegraded":"2023-03-03T06:25:26.124796+0000","last_fullsized":"2023-03-03T06:25:26.124796+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:05:55.927278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.920600+0000","last_change":"2023-03-03T06:25:05.635968+0000","last_active":"2023-03-03T06:25:24.920600+0000","last_peered":"2023-03-03T06:25:24.920600+0000","last_clean":"2023-03-03T06:25:24.920600+0000","last_became_active":"2023-03-03T06:25:04.443619+0000","last_became_peered":"2023-03-03T06:25:04.443619+0000","last_unstale":"2023-03-03T06:25:24.920600+0000","last_undegraded":"2023-03-03T06:25:24.920600+0000","last_fullsized":"2023-03-03T06:25:24.920600+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:51:15.780667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077929799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927785+0000","last_change":"2023-03-03T06:25:24.944547+0000","last_active":"2023-03-03T06:25:25.927785+0000","last_peered":"2023-03-03T06:25:25.927785+0000","last_clean":"2023-03-03T06:25:25.927785+0000","last_became_active":"2023-03-03T06:25:24.944037+0000","last_became_peered":"2023-03-03T06:25:24.944037+0000","last_unstale":"2023-03-03T06:25:25.927785+0000","last_undegraded":"2023-03-03T06:25:25.927785+0000","last_fullsized":"2023-03-03T06:25:25.927785+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:33:03.550930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124900+0000","last_change":"2023-03-03T06:25:24.518651+0000","last_active":"2023-03-03T06:25:26.124900+0000","last_peered":"2023-03-03T06:25:26.124900+0000","last_clean":"2023-03-03T06:25:26.124900+0000","last_became_active":"2023-03-03T06:25:24.518298+0000","last_became_peered":"2023-03-03T06:25:24.518298+0000","last_unstale":"2023-03-03T06:25:26.124900+0000","last_undegraded":"2023-03-03T06:25:26.124900+0000","last_fullsized":"2023-03-03T06:25:26.124900+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:14:53.556029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923097+0000","last_change":"2023-03-03T06:25:05.432320+0000","last_active":"2023-03-03T06:25:24.923097+0000","last_peered":"2023-03-03T06:25:24.923097+0000","last_clean":"2023-03-03T06:25:24.923097+0000","last_became_active":"2023-03-03T06:25:04.436727+0000","last_became_peered":"2023-03-03T06:25:04.436727+0000","last_unstale":"2023-03-03T06:25:24.923097+0000","last_undegraded":"2023-03-03T06:25:24.923097+0000","last_fullsized":"2023-03-03T06:25:24.923097+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014361980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125436+0000","last_change":"2023-03-03T06:25:24.937708+0000","last_active":"2023-03-03T06:25:26.125436+0000","last_peered":"2023-03-03T06:25:26.125436+0000","last_clean":"2023-03-03T06:25:26.125436+0000","last_became_active":"2023-03-03T06:25:24.937408+0000","last_became_peered":"2023-03-03T06:25:24.937408+0000","last_unstale":"2023-03-03T06:25:26.125436+0000","last_undegraded":"2023-03-03T06:25:26.125436+0000","last_fullsized":"2023-03-03T06:25:26.125436+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:19:01.571013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"55'4","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125651+0000","last_change":"2023-03-03T06:25:24.522437+0000","last_active":"2023-03-03T06:25:26.125651+0000","last_peered":"2023-03-03T06:25:26.125651+0000","last_clean":"2023-03-03T06:25:26.125651+0000","last_became_active":"2023-03-03T06:25:24.521605+0000","last_became_peered":"2023-03-03T06:25:24.521605+0000","last_unstale":"2023-03-03T06:25:26.125651+0000","last_undegraded":"2023-03-03T06:25:26.125651+0000","last_fullsized":"2023-03-03T06:25:26.125651+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:44.001614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927064+0000","last_change":"2023-03-03T06:25:05.431681+0000","last_active":"2023-03-03T06:25:24.927064+0000","last_peered":"2023-03-03T06:25:24.927064+0000","last_clean":"2023-03-03T06:25:24.927064+0000","last_became_active":"2023-03-03T06:25:04.443599+0000","last_became_peered":"2023-03-03T06:25:04.443599+0000","last_unstale":"2023-03-03T06:25:24.927064+0000","last_undegraded":"2023-03-03T06:25:24.927064+0000","last_fullsized":"2023-03-03T06:25:24.927064+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001546473,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924739+0000","last_change":"2023-03-03T06:25:24.931161+0000","last_active":"2023-03-03T06:25:25.924739+0000","last_peered":"2023-03-03T06:25:25.924739+0000","last_clean":"2023-03-03T06:25:25.924739+0000","last_became_active":"2023-03-03T06:25:24.930832+0000","last_became_peered":"2023-03-03T06:25:24.930832+0000","last_unstale":"2023-03-03T06:25:25.924739+0000","last_undegraded":"2023-03-03T06:25:25.924739+0000","last_fullsized":"2023-03-03T06:25:25.924739+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:59:03.123359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125021+0000","last_change":"2023-03-03T06:25:24.519515+0000","last_active":"2023-03-03T06:25:26.125021+0000","last_peered":"2023-03-03T06:25:26.125021+0000","last_clean":"2023-03-03T06:25:26.125021+0000","last_became_active":"2023-03-03T06:25:24.519249+0000","last_became_peered":"2023-03-03T06:25:24.519249+0000","last_unstale":"2023-03-03T06:25:26.125021+0000","last_undegraded":"2023-03-03T06:25:26.125021+0000","last_fullsized":"2023-03-03T06:25:26.125021+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:31.902827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.921714+0000","last_change":"2023-03-03T06:25:05.796211+0000","last_active":"2023-03-03T06:25:24.921714+0000","last_peered":"2023-03-03T06:25:24.921714+0000","last_clean":"2023-03-03T06:25:24.921714+0000","last_became_active":"2023-03-03T06:25:04.436647+0000","last_became_peered":"2023-03-03T06:25:04.436647+0000","last_unstale":"2023-03-03T06:25:24.921714+0000","last_undegraded":"2023-03-03T06:25:24.921714+0000","last_fullsized":"2023-03-03T06:25:24.921714+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:07.330548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124395+0000","last_change":"2023-03-03T06:25:24.949538+0000","last_active":"2023-03-03T06:25:26.124395+0000","last_peered":"2023-03-03T06:25:26.124395+0000","last_clean":"2023-03-03T06:25:26.124395+0000","last_became_active":"2023-03-03T06:25:24.949280+0000","last_became_peered":"2023-03-03T06:25:24.949280+0000","last_unstale":"2023-03-03T06:25:26.124395+0000","last_undegraded":"2023-03-03T06:25:26.124395+0000","last_fullsized":"2023-03-03T06:25:26.124395+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:25.006671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925524+0000","last_change":"2023-03-03T06:25:24.520994+0000","last_active":"2023-03-03T06:25:25.925524+0000","last_peered":"2023-03-03T06:25:25.925524+0000","last_clean":"2023-03-03T06:25:25.925524+0000","last_became_active":"2023-03-03T06:25:24.520347+0000","last_became_peered":"2023-03-03T06:25:24.520347+0000","last_unstale":"2023-03-03T06:25:25.925524+0000","last_undegraded":"2023-03-03T06:25:25.925524+0000","last_fullsized":"2023-03-03T06:25:25.925524+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:50:42.331552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927755+0000","last_change":"2023-03-03T06:25:05.431187+0000","last_active":"2023-03-03T06:25:24.927755+0000","last_peered":"2023-03-03T06:25:24.927755+0000","last_clean":"2023-03-03T06:25:24.927755+0000","last_became_active":"2023-03-03T06:25:04.442929+0000","last_became_peered":"2023-03-03T06:25:04.442929+0000","last_unstale":"2023-03-03T06:25:24.927755+0000","last_undegraded":"2023-03-03T06:25:24.927755+0000","last_fullsized":"2023-03-03T06:25:24.927755+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001551871,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927381+0000","last_change":"2023-03-03T06:25:24.942998+0000","last_active":"2023-03-03T06:25:25.927381+0000","last_peered":"2023-03-03T06:25:25.927381+0000","last_clean":"2023-03-03T06:25:25.927381+0000","last_became_active":"2023-03-03T06:25:24.942747+0000","last_became_peered":"2023-03-03T06:25:24.942747+0000","last_unstale":"2023-03-03T06:25:25.927381+0000","last_undegraded":"2023-03-03T06:25:25.927381+0000","last_fullsized":"2023-03-03T06:25:25.927381+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:40:32.930468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925709+0000","last_change":"2023-03-03T06:25:24.520259+0000","last_active":"2023-03-03T06:25:25.925709+0000","last_peered":"2023-03-03T06:25:25.925709+0000","last_clean":"2023-03-03T06:25:25.925709+0000","last_became_active":"2023-03-03T06:25:24.519667+0000","last_became_peered":"2023-03-03T06:25:24.519667+0000","last_unstale":"2023-03-03T06:25:25.925709+0000","last_undegraded":"2023-03-03T06:25:25.925709+0000","last_fullsized":"2023-03-03T06:25:25.925709+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.736521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923559+0000","last_change":"2023-03-03T06:25:05.796890+0000","last_active":"2023-03-03T06:25:24.923559+0000","last_peered":"2023-03-03T06:25:24.923559+0000","last_clean":"2023-03-03T06:25:24.923559+0000","last_became_active":"2023-03-03T06:25:04.437104+0000","last_became_peered":"2023-03-03T06:25:04.437104+0000","last_unstale":"2023-03-03T06:25:24.923559+0000","last_undegraded":"2023-03-03T06:25:24.923559+0000","last_fullsized":"2023-03-03T06:25:24.923559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:10:21.043057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027269099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125195+0000","last_change":"2023-03-03T06:25:24.933349+0000","last_active":"2023-03-03T06:25:26.125195+0000","last_peered":"2023-03-03T06:25:26.125195+0000","last_clean":"2023-03-03T06:25:26.125195+0000","last_became_active":"2023-03-03T06:25:24.933097+0000","last_became_peered":"2023-03-03T06:25:24.933097+0000","last_unstale":"2023-03-03T06:25:26.125195+0000","last_undegraded":"2023-03-03T06:25:26.125195+0000","last_fullsized":"2023-03-03T06:25:26.125195+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:25.006671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126730+0000","last_change":"2023-03-03T06:25:24.523422+0000","last_active":"2023-03-03T06:25:26.126730+0000","last_peered":"2023-03-03T06:25:26.126730+0000","last_clean":"2023-03-03T06:25:26.126730+0000","last_became_active":"2023-03-03T06:25:24.523143+0000","last_became_peered":"2023-03-03T06:25:24.523143+0000","last_unstale":"2023-03-03T06:25:26.126730+0000","last_undegraded":"2023-03-03T06:25:26.126730+0000","last_fullsized":"2023-03-03T06:25:26.126730+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:19:00.566494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.935670+0000","last_change":"2023-03-03T06:25:05.429793+0000","last_active":"2023-03-03T06:25:24.935670+0000","last_peered":"2023-03-03T06:25:24.935670+0000","last_clean":"2023-03-03T06:25:24.935670+0000","last_became_active":"2023-03-03T06:25:04.436400+0000","last_became_peered":"2023-03-03T06:25:04.436400+0000","last_unstale":"2023-03-03T06:25:24.935670+0000","last_undegraded":"2023-03-03T06:25:24.935670+0000","last_fullsized":"2023-03-03T06:25:24.935670+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038039399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125392+0000","last_change":"2023-03-03T06:25:24.938670+0000","last_active":"2023-03-03T06:25:26.125392+0000","last_peered":"2023-03-03T06:25:26.125392+0000","last_clean":"2023-03-03T06:25:26.125392+0000","last_became_active":"2023-03-03T06:25:24.938429+0000","last_became_peered":"2023-03-03T06:25:24.938429+0000","last_unstale":"2023-03-03T06:25:26.125392+0000","last_undegraded":"2023-03-03T06:25:26.125392+0000","last_fullsized":"2023-03-03T06:25:26.125392+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:56.502459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124487+0000","last_change":"2023-03-03T06:25:24.520083+0000","last_active":"2023-03-03T06:25:26.124487+0000","last_peered":"2023-03-03T06:25:26.124487+0000","last_clean":"2023-03-03T06:25:26.124487+0000","last_became_active":"2023-03-03T06:25:24.518282+0000","last_became_peered":"2023-03-03T06:25:24.518282+0000","last_unstale":"2023-03-03T06:25:26.124487+0000","last_undegraded":"2023-03-03T06:25:26.124487+0000","last_fullsized":"2023-03-03T06:25:26.124487+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:07:12.497985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.926146+0000","last_change":"2023-03-03T06:25:05.797098+0000","last_active":"2023-03-03T06:25:24.926146+0000","last_peered":"2023-03-03T06:25:24.926146+0000","last_clean":"2023-03-03T06:25:24.926146+0000","last_became_active":"2023-03-03T06:25:04.446290+0000","last_became_peered":"2023-03-03T06:25:04.446290+0000","last_unstale":"2023-03-03T06:25:24.926146+0000","last_undegraded":"2023-03-03T06:25:24.926146+0000","last_fullsized":"2023-03-03T06:25:24.926146+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:23:37.795335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050239399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125385+0000","last_change":"2023-03-03T06:25:24.934177+0000","last_active":"2023-03-03T06:25:26.125385+0000","last_peered":"2023-03-03T06:25:26.125385+0000","last_clean":"2023-03-03T06:25:26.125385+0000","last_became_active":"2023-03-03T06:25:24.933499+0000","last_became_peered":"2023-03-03T06:25:24.933499+0000","last_unstale":"2023-03-03T06:25:26.125385+0000","last_undegraded":"2023-03-03T06:25:26.125385+0000","last_fullsized":"2023-03-03T06:25:26.125385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:09.237392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124882+0000","last_change":"2023-03-03T06:25:24.509513+0000","last_active":"2023-03-03T06:25:26.124882+0000","last_peered":"2023-03-03T06:25:26.124882+0000","last_clean":"2023-03-03T06:25:26.124882+0000","last_became_active":"2023-03-03T06:25:24.509233+0000","last_became_peered":"2023-03-03T06:25:24.509233+0000","last_unstale":"2023-03-03T06:25:26.124882+0000","last_undegraded":"2023-03-03T06:25:26.124882+0000","last_fullsized":"2023-03-03T06:25:26.124882+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:47:31.672737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.920697+0000","last_change":"2023-03-03T06:25:05.636038+0000","last_active":"2023-03-03T06:25:24.920697+0000","last_peered":"2023-03-03T06:25:24.920697+0000","last_clean":"2023-03-03T06:25:24.920697+0000","last_became_active":"2023-03-03T06:25:04.433771+0000","last_became_peered":"2023-03-03T06:25:04.433771+0000","last_unstale":"2023-03-03T06:25:24.920697+0000","last_undegraded":"2023-03-03T06:25:24.920697+0000","last_fullsized":"2023-03-03T06:25:24.920697+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:33:58.284544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079784699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924611+0000","last_change":"2023-03-03T06:25:24.932033+0000","last_active":"2023-03-03T06:25:25.924611+0000","last_peered":"2023-03-03T06:25:25.924611+0000","last_clean":"2023-03-03T06:25:25.924611+0000","last_became_active":"2023-03-03T06:25:24.931758+0000","last_became_peered":"2023-03-03T06:25:24.931758+0000","last_unstale":"2023-03-03T06:25:25.924611+0000","last_undegraded":"2023-03-03T06:25:25.924611+0000","last_fullsized":"2023-03-03T06:25:25.924611+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:34:19.362959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125460+0000","last_change":"2023-03-03T06:25:24.518833+0000","last_active":"2023-03-03T06:25:26.125460+0000","last_peered":"2023-03-03T06:25:26.125460+0000","last_clean":"2023-03-03T06:25:26.125460+0000","last_became_active":"2023-03-03T06:25:24.518545+0000","last_became_peered":"2023-03-03T06:25:24.518545+0000","last_unstale":"2023-03-03T06:25:26.125460+0000","last_undegraded":"2023-03-03T06:25:26.125460+0000","last_fullsized":"2023-03-03T06:25:26.125460+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:55:47.342952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.922449+0000","last_change":"2023-03-03T06:25:05.797366+0000","last_active":"2023-03-03T06:25:24.922449+0000","last_peered":"2023-03-03T06:25:24.922449+0000","last_clean":"2023-03-03T06:25:24.922449+0000","last_became_active":"2023-03-03T06:25:04.439424+0000","last_became_peered":"2023-03-03T06:25:04.439424+0000","last_unstale":"2023-03-03T06:25:24.922449+0000","last_undegraded":"2023-03-03T06:25:24.922449+0000","last_fullsized":"2023-03-03T06:25:24.922449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:12.599265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020575500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124616+0000","last_change":"2023-03-03T06:25:24.948977+0000","last_active":"2023-03-03T06:25:26.124616+0000","last_peered":"2023-03-03T06:25:26.124616+0000","last_clean":"2023-03-03T06:25:26.124616+0000","last_became_active":"2023-03-03T06:25:24.948669+0000","last_became_peered":"2023-03-03T06:25:24.948669+0000","last_unstale":"2023-03-03T06:25:26.124616+0000","last_undegraded":"2023-03-03T06:25:26.124616+0000","last_fullsized":"2023-03-03T06:25:26.124616+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:36:14.477572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125632+0000","last_change":"2023-03-03T06:25:24.521115+0000","last_active":"2023-03-03T06:25:26.125632+0000","last_peered":"2023-03-03T06:25:26.125632+0000","last_clean":"2023-03-03T06:25:26.125632+0000","last_became_active":"2023-03-03T06:25:24.520862+0000","last_became_peered":"2023-03-03T06:25:24.520862+0000","last_unstale":"2023-03-03T06:25:26.125632+0000","last_undegraded":"2023-03-03T06:25:26.125632+0000","last_fullsized":"2023-03-03T06:25:26.125632+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:02:51.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923773+0000","last_change":"2023-03-03T06:25:05.431441+0000","last_active":"2023-03-03T06:25:24.923773+0000","last_peered":"2023-03-03T06:25:24.923773+0000","last_clean":"2023-03-03T06:25:24.923773+0000","last_became_active":"2023-03-03T06:25:04.443840+0000","last_became_peered":"2023-03-03T06:25:04.443840+0000","last_unstale":"2023-03-03T06:25:24.923773+0000","last_undegraded":"2023-03-03T06:25:24.923773+0000","last_fullsized":"2023-03-03T06:25:24.923773+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017814980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.928103+0000","last_change":"2023-03-03T06:25:24.939685+0000","last_active":"2023-03-03T06:25:25.928103+0000","last_peered":"2023-03-03T06:25:25.928103+0000","last_clean":"2023-03-03T06:25:25.928103+0000","last_became_active":"2023-03-03T06:25:24.939399+0000","last_became_peered":"2023-03-03T06:25:24.939399+0000","last_unstale":"2023-03-03T06:25:25.928103+0000","last_undegraded":"2023-03-03T06:25:25.928103+0000","last_fullsized":"2023-03-03T06:25:25.928103+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:27:14.164819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126951+0000","last_change":"2023-03-03T06:25:24.524776+0000","last_active":"2023-03-03T06:25:26.126951+0000","last_peered":"2023-03-03T06:25:26.126951+0000","last_clean":"2023-03-03T06:25:26.126951+0000","last_became_active":"2023-03-03T06:25:24.524527+0000","last_became_peered":"2023-03-03T06:25:24.524527+0000","last_unstale":"2023-03-03T06:25:26.126951+0000","last_undegraded":"2023-03-03T06:25:26.126951+0000","last_fullsized":"2023-03-03T06:25:26.126951+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:10:05.694425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923603+0000","last_change":"2023-03-03T06:25:05.431854+0000","last_active":"2023-03-03T06:25:24.923603+0000","last_peered":"2023-03-03T06:25:24.923603+0000","last_clean":"2023-03-03T06:25:24.923603+0000","last_became_active":"2023-03-03T06:25:04.438570+0000","last_became_peered":"2023-03-03T06:25:04.438570+0000","last_unstale":"2023-03-03T06:25:24.923603+0000","last_undegraded":"2023-03-03T06:25:24.923603+0000","last_fullsized":"2023-03-03T06:25:24.923603+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.942265+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:25:24.942265+0000","last_peered":"2023-03-03T06:25:24.942265+0000","last_clean":"2023-03-03T06:25:24.942265+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:25:24.942265+0000","last_undegraded":"2023-03-03T06:25:24.942265+0000","last_fullsized":"2023-03-03T06:25:24.942265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125259+0000","last_change":"2023-03-03T06:25:24.935409+0000","last_active":"2023-03-03T06:25:26.125259+0000","last_peered":"2023-03-03T06:25:26.125259+0000","last_clean":"2023-03-03T06:25:26.125259+0000","last_became_active":"2023-03-03T06:25:24.935140+0000","last_became_peered":"2023-03-03T06:25:24.935140+0000","last_unstale":"2023-03-03T06:25:26.125259+0000","last_undegraded":"2023-03-03T06:25:26.125259+0000","last_fullsized":"2023-03-03T06:25:26.125259+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:24:29.758094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925681+0000","last_change":"2023-03-03T06:25:24.516059+0000","last_active":"2023-03-03T06:25:25.925681+0000","last_peered":"2023-03-03T06:25:25.925681+0000","last_clean":"2023-03-03T06:25:25.925681+0000","last_became_active":"2023-03-03T06:25:24.515740+0000","last_became_peered":"2023-03-03T06:25:24.515740+0000","last_unstale":"2023-03-03T06:25:25.925681+0000","last_undegraded":"2023-03-03T06:25:25.925681+0000","last_fullsized":"2023-03-03T06:25:25.925681+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:05:55.927278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.922510+0000","last_change":"2023-03-03T06:25:05.636335+0000","last_active":"2023-03-03T06:25:24.922510+0000","last_peered":"2023-03-03T06:25:24.922510+0000","last_clean":"2023-03-03T06:25:24.922510+0000","last_became_active":"2023-03-03T06:25:04.443299+0000","last_became_peered":"2023-03-03T06:25:04.443299+0000","last_unstale":"2023-03-03T06:25:24.922510+0000","last_undegraded":"2023-03-03T06:25:24.922510+0000","last_fullsized":"2023-03-03T06:25:24.922510+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:13:38.046974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090290399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928347+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:25:24.928347+0000","last_peered":"2023-03-03T06:25:24.928347+0000","last_clean":"2023-03-03T06:25:24.928347+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:25:24.928347+0000","last_undegraded":"2023-03-03T06:25:24.928347+0000","last_fullsized":"2023-03-03T06:25:24.928347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124369+0000","last_change":"2023-03-03T06:25:24.934579+0000","last_active":"2023-03-03T06:25:26.124369+0000","last_peered":"2023-03-03T06:25:26.124369+0000","last_clean":"2023-03-03T06:25:26.124369+0000","last_became_active":"2023-03-03T06:25:24.933988+0000","last_became_peered":"2023-03-03T06:25:24.933988+0000","last_unstale":"2023-03-03T06:25:26.124369+0000","last_undegraded":"2023-03-03T06:25:26.124369+0000","last_fullsized":"2023-03-03T06:25:26.124369+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:49:46.607290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125278+0000","last_change":"2023-03-03T06:25:24.519139+0000","last_active":"2023-03-03T06:25:26.125278+0000","last_peered":"2023-03-03T06:25:26.125278+0000","last_clean":"2023-03-03T06:25:26.125278+0000","last_became_active":"2023-03-03T06:25:24.518849+0000","last_became_peered":"2023-03-03T06:25:24.518849+0000","last_unstale":"2023-03-03T06:25:26.125278+0000","last_undegraded":"2023-03-03T06:25:26.125278+0000","last_fullsized":"2023-03-03T06:25:26.125278+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:08.232873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.924219+0000","last_change":"2023-03-03T06:25:05.796271+0000","last_active":"2023-03-03T06:25:24.924219+0000","last_peered":"2023-03-03T06:25:24.924219+0000","last_clean":"2023-03-03T06:25:24.924219+0000","last_became_active":"2023-03-03T06:25:04.595414+0000","last_became_peered":"2023-03-03T06:25:04.595414+0000","last_unstale":"2023-03-03T06:25:24.924219+0000","last_undegraded":"2023-03-03T06:25:24.924219+0000","last_fullsized":"2023-03-03T06:25:24.924219+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:07:03.140630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027036600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":44,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923632+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:25:24.923632+0000","last_peered":"2023-03-03T06:25:24.923632+0000","last_clean":"2023-03-03T06:25:24.923632+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:25:24.923632+0000","last_undegraded":"2023-03-03T06:25:24.923632+0000","last_fullsized":"2023-03-03T06:25:24.923632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":193,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.924648+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:25:24.924648+0000","last_peered":"2023-03-03T06:25:24.924648+0000","last_clean":"2023-03-03T06:25:24.924648+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:25:24.924648+0000","last_undegraded":"2023-03-03T06:25:24.924648+0000","last_fullsized":"2023-03-03T06:25:24.924648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125189+0000","last_change":"2023-03-03T06:25:24.934898+0000","last_active":"2023-03-03T06:25:26.125189+0000","last_peered":"2023-03-03T06:25:26.125189+0000","last_clean":"2023-03-03T06:25:26.125189+0000","last_became_active":"2023-03-03T06:25:24.934581+0000","last_became_peered":"2023-03-03T06:25:24.934581+0000","last_unstale":"2023-03-03T06:25:26.125189+0000","last_undegraded":"2023-03-03T06:25:26.125189+0000","last_fullsized":"2023-03-03T06:25:26.125189+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:24:04.374885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125788+0000","last_change":"2023-03-03T06:25:24.509731+0000","last_active":"2023-03-03T06:25:26.125788+0000","last_peered":"2023-03-03T06:25:26.125788+0000","last_clean":"2023-03-03T06:25:26.125788+0000","last_became_active":"2023-03-03T06:25:24.509434+0000","last_became_peered":"2023-03-03T06:25:24.509434+0000","last_unstale":"2023-03-03T06:25:26.125788+0000","last_undegraded":"2023-03-03T06:25:26.125788+0000","last_fullsized":"2023-03-03T06:25:26.125788+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:36:29.027339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927888+0000","last_change":"2023-03-03T06:25:05.431373+0000","last_active":"2023-03-03T06:25:24.927888+0000","last_peered":"2023-03-03T06:25:24.927888+0000","last_clean":"2023-03-03T06:25:24.927888+0000","last_became_active":"2023-03-03T06:25:04.445948+0000","last_became_peered":"2023-03-03T06:25:04.445948+0000","last_unstale":"2023-03-03T06:25:24.927888+0000","last_undegraded":"2023-03-03T06:25:24.927888+0000","last_fullsized":"2023-03-03T06:25:24.927888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001717028,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928450+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:25:24.928450+0000","last_peered":"2023-03-03T06:25:24.928450+0000","last_clean":"2023-03-03T06:25:24.928450+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:25:24.928450+0000","last_undegraded":"2023-03-03T06:25:24.928450+0000","last_fullsized":"2023-03-03T06:25:24.928450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126335+0000","last_change":"2023-03-03T06:25:24.937782+0000","last_active":"2023-03-03T06:25:26.126335+0000","last_peered":"2023-03-03T06:25:26.126335+0000","last_clean":"2023-03-03T06:25:26.126335+0000","last_became_active":"2023-03-03T06:25:24.937490+0000","last_became_peered":"2023-03-03T06:25:24.937490+0000","last_unstale":"2023-03-03T06:25:26.126335+0000","last_undegraded":"2023-03-03T06:25:26.126335+0000","last_fullsized":"2023-03-03T06:25:26.126335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:10:10.895165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925276+0000","last_change":"2023-03-03T06:25:24.516424+0000","last_active":"2023-03-03T06:25:25.925276+0000","last_peered":"2023-03-03T06:25:25.925276+0000","last_clean":"2023-03-03T06:25:25.925276+0000","last_became_active":"2023-03-03T06:25:24.515550+0000","last_became_peered":"2023-03-03T06:25:24.515550+0000","last_unstale":"2023-03-03T06:25:25.925276+0000","last_undegraded":"2023-03-03T06:25:25.925276+0000","last_fullsized":"2023-03-03T06:25:25.925276+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:15:54.071849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927206+0000","last_change":"2023-03-03T06:25:05.796597+0000","last_active":"2023-03-03T06:25:24.927206+0000","last_peered":"2023-03-03T06:25:24.927206+0000","last_clean":"2023-03-03T06:25:24.927206+0000","last_became_active":"2023-03-03T06:25:04.442672+0000","last_became_peered":"2023-03-03T06:25:04.442672+0000","last_unstale":"2023-03-03T06:25:24.927206+0000","last_undegraded":"2023-03-03T06:25:24.927206+0000","last_fullsized":"2023-03-03T06:25:24.927206+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.033310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000479903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.925287+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:25:24.925287+0000","last_peered":"2023-03-03T06:25:24.925287+0000","last_clean":"2023-03-03T06:25:24.925287+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:25:24.925287+0000","last_undegraded":"2023-03-03T06:25:24.925287+0000","last_fullsized":"2023-03-03T06:25:24.925287+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126051+0000","last_change":"2023-03-03T06:25:24.932351+0000","last_active":"2023-03-03T06:25:26.126051+0000","last_peered":"2023-03-03T06:25:26.126051+0000","last_clean":"2023-03-03T06:25:26.126051+0000","last_became_active":"2023-03-03T06:25:24.931960+0000","last_became_peered":"2023-03-03T06:25:24.931960+0000","last_unstale":"2023-03-03T06:25:26.126051+0000","last_undegraded":"2023-03-03T06:25:26.126051+0000","last_fullsized":"2023-03-03T06:25:26.126051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:36:20.994518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124642+0000","last_change":"2023-03-03T06:25:24.519327+0000","last_active":"2023-03-03T06:25:26.124642+0000","last_peered":"2023-03-03T06:25:26.124642+0000","last_clean":"2023-03-03T06:25:26.124642+0000","last_became_active":"2023-03-03T06:25:24.518988+0000","last_became_peered":"2023-03-03T06:25:24.518988+0000","last_unstale":"2023-03-03T06:25:26.124642+0000","last_undegraded":"2023-03-03T06:25:26.124642+0000","last_fullsized":"2023-03-03T06:25:26.124642+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.736521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.920647+0000","last_change":"2023-03-03T06:25:05.636259+0000","last_active":"2023-03-03T06:25:24.920647+0000","last_peered":"2023-03-03T06:25:24.920647+0000","last_clean":"2023-03-03T06:25:24.920647+0000","last_became_active":"2023-03-03T06:25:04.438244+0000","last_became_peered":"2023-03-03T06:25:04.438244+0000","last_unstale":"2023-03-03T06:25:24.920647+0000","last_undegraded":"2023-03-03T06:25:24.920647+0000","last_fullsized":"2023-03-03T06:25:24.920647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:36.640289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001044636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.921515+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:25:24.921515+0000","last_peered":"2023-03-03T06:25:24.921515+0000","last_clean":"2023-03-03T06:25:24.921515+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:25:24.921515+0000","last_undegraded":"2023-03-03T06:25:24.921515+0000","last_fullsized":"2023-03-03T06:25:24.921515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125657+0000","last_change":"2023-03-03T06:25:24.948250+0000","last_active":"2023-03-03T06:25:26.125657+0000","last_peered":"2023-03-03T06:25:26.125657+0000","last_clean":"2023-03-03T06:25:26.125657+0000","last_became_active":"2023-03-03T06:25:24.947976+0000","last_became_peered":"2023-03-03T06:25:24.947976+0000","last_unstale":"2023-03-03T06:25:26.125657+0000","last_undegraded":"2023-03-03T06:25:26.125657+0000","last_fullsized":"2023-03-03T06:25:26.125657+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:10:06.698944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126879+0000","last_change":"2023-03-03T06:25:24.524124+0000","last_active":"2023-03-03T06:25:26.126879+0000","last_peered":"2023-03-03T06:25:26.126879+0000","last_clean":"2023-03-03T06:25:26.126879+0000","last_became_active":"2023-03-03T06:25:24.523594+0000","last_became_peered":"2023-03-03T06:25:24.523594+0000","last_unstale":"2023-03-03T06:25:26.126879+0000","last_undegraded":"2023-03-03T06:25:26.126879+0000","last_fullsized":"2023-03-03T06:25:26.126879+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:52:45.369663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928268+0000","last_change":"2023-03-03T06:25:05.432050+0000","last_active":"2023-03-03T06:25:24.928268+0000","last_peered":"2023-03-03T06:25:24.928268+0000","last_clean":"2023-03-03T06:25:24.928268+0000","last_became_active":"2023-03-03T06:25:04.595433+0000","last_became_peered":"2023-03-03T06:25:04.595433+0000","last_unstale":"2023-03-03T06:25:24.928268+0000","last_undegraded":"2023-03-03T06:25:24.928268+0000","last_fullsized":"2023-03-03T06:25:24.928268+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016573409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":42,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927094+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:25:24.927094+0000","last_peered":"2023-03-03T06:25:24.927094+0000","last_clean":"2023-03-03T06:25:24.927094+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:25:24.927094+0000","last_undegraded":"2023-03-03T06:25:24.927094+0000","last_fullsized":"2023-03-03T06:25:24.927094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126454+0000","last_change":"2023-03-03T06:25:24.950252+0000","last_active":"2023-03-03T06:25:26.126454+0000","last_peered":"2023-03-03T06:25:26.126454+0000","last_clean":"2023-03-03T06:25:26.126454+0000","last_became_active":"2023-03-03T06:25:24.949929+0000","last_became_peered":"2023-03-03T06:25:24.949929+0000","last_unstale":"2023-03-03T06:25:26.126454+0000","last_undegraded":"2023-03-03T06:25:26.126454+0000","last_fullsized":"2023-03-03T06:25:26.126454+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:18:23.806132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125532+0000","last_change":"2023-03-03T06:25:24.510986+0000","last_active":"2023-03-03T06:25:26.125532+0000","last_peered":"2023-03-03T06:25:26.125532+0000","last_clean":"2023-03-03T06:25:26.125532+0000","last_became_active":"2023-03-03T06:25:24.510715+0000","last_became_peered":"2023-03-03T06:25:24.510715+0000","last_unstale":"2023-03-03T06:25:26.125532+0000","last_undegraded":"2023-03-03T06:25:26.125532+0000","last_fullsized":"2023-03-03T06:25:26.125532+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:08:59.238203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923851+0000","last_change":"2023-03-03T06:25:05.431790+0000","last_active":"2023-03-03T06:25:24.923851+0000","last_peered":"2023-03-03T06:25:24.923851+0000","last_clean":"2023-03-03T06:25:24.923851+0000","last_became_active":"2023-03-03T06:25:04.595837+0000","last_became_peered":"2023-03-03T06:25:04.595837+0000","last_unstale":"2023-03-03T06:25:24.923851+0000","last_undegraded":"2023-03-03T06:25:24.923851+0000","last_fullsized":"2023-03-03T06:25:24.923851+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:08:49.614056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019659870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":42,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.926531+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:25:24.926531+0000","last_peered":"2023-03-03T06:25:24.926531+0000","last_clean":"2023-03-03T06:25:24.926531+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:25:24.926531+0000","last_undegraded":"2023-03-03T06:25:24.926531+0000","last_fullsized":"2023-03-03T06:25:24.926531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10408,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361432,"statfs":{"total":96636764160,"available":96626106368,"internally_reserved":0,"allocated":1277952,"data_stored":909264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.41199999999999998}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.52900000000000003}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.5}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9112,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362728,"statfs":{"total":96636764160,"available":96627433472,"internally_reserved":0,"allocated":671744,"data_stored":318170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.746}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.81799999999999995}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.77600000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.622},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.72699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10356,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361484,"statfs":{"total":96636764160,"available":96626159616,"internally_reserved":0,"allocated":1290240,"data_stored":910800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.38},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.34399999999999997}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.495},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.622}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9296,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362544,"statfs":{"total":96636764160,"available":96627245056,"internally_reserved":0,"allocated":663552,"data_stored":317175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.375}]},{"osd":3,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.64200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9044,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362796,"statfs":{"total":96636764160,"available":96627503104,"internally_reserved":0,"allocated":667648,"data_stored":318136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.311},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.28199999999999997}]},{"osd":1,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":7.4820000000000002,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.34300000000000003}]},{"osd":3,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.35799999999999998}]},{"osd":4,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.76700000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.748}]},{"osd":7,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.71399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362540,"statfs":{"total":96636764160,"available":96627240960,"internally_reserved":0,"allocated":667648,"data_stored":318136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.38},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.41999999999999998}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.308},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.91300000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.84899999999999998}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.97499999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.92800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9440,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362400,"statfs":{"total":96636764160,"available":96627097600,"internally_reserved":0,"allocated":679936,"data_stored":319684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.68200000000000005}]},{"osd":1,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.627},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.64500000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70999999999999996}]},{"osd":3,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.433},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47499999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.52000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9172,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362668,"statfs":{"total":96636764160,"available":96627372032,"internally_reserved":0,"allocated":667648,"data_stored":317197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.499}]},{"osd":3,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55000000000000004}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.46000000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.44900000000000001}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.43099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:25:29.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-03-03T06:25:30.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.000+0000 7f2b5278d700 1 Processor -- start 2023-03-03T06:25:30.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.000+0000 7f2b5278d700 1 -- start start 2023-03-03T06:25:30.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.001+0000 7f2b5278d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b4c0b08e0 0x7f2b4c0af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.001+0000 7f2b5278d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c0cc710 con 0x7f2b4c06d030 2023-03-03T06:25:30.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.001+0000 7f2b5278d700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c0cc9f0 con 0x7f2b4c06d400 2023-03-03T06:25:30.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.001+0000 7f2b5278d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0cd7b0 con 0x7f2b4c0b08e0 2023-03-03T06:25:30.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.001+0000 7f2b4bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2b4c06d030 0x7f2b4c0b2110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34442/0 (socket says 172.21.15.5:34442) 2023-03-03T06:25:30.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.001+0000 7f2b4bfff700 1 -- 172.21.15.5:0/3830675177 learned_addr learned my addr 172.21.15.5:0/3830675177 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:30.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.001+0000 7f2b50d2a700 1 --2- 172.21.15.5:0/3830675177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b4c0b08e0 0x7f2b4c0af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.001+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186832371 0 0) 0x7f2b4c0cc710 con 0x7f2b4c06d030 2023-03-03T06:25:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b380035b0 con 0x7f2b4c06d030 2023-03-03T06:25:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2881257647 0 0) 0x7f2b380035b0 con 0x7f2b4c06d030 2023-03-03T06:25:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b4c0b08e0 msgr2=0x7f2b4c0af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 --2- 172.21.15.5:0/3830675177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b4c0b08e0 0x7f2b4c0af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 >> v1:172.21.15.191:6789/0 conn(0x7f2b4c06d400 legacy=0x7f2b4c0b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:30.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c0cccd0 con 0x7f2b4c06d030 2023-03-03T06:25:30.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f2b34001670 con 0x7f2b4c06d030 2023-03-03T06:25:30.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 >> v1:172.21.15.5:6789/0 conn(0x7f2b4c06d030 legacy=0x7f2b4c0b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:30.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 --2- 172.21.15.5:0/3830675177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b38003aa0 0x7f2b38003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 --2- 172.21.15.5:0/3830675177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b4c0b08e0 0x7f2b38004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 --2- 172.21.15.5:0/3830675177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b38004d90 0x7f2b38005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0cd7b0 con 0x7f2b38003aa0 2023-03-03T06:25:30.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3800bb40 con 0x7f2b38004d90 2023-03-03T06:25:30.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3800bd00 con 0x7f2b4c0b08e0 2023-03-03T06:25:30.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4bfff700 1 --2- 172.21.15.5:0/3830675177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b38003aa0 0x7f2b38003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4b7fe700 1 --2- 172.21.15.5:0/3830675177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b4c0b08e0 0x7f2b38004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b50d2a700 1 --2- 172.21.15.5:0/3830675177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b38004d90 0x7f2b38005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4bfff700 1 -- 172.21.15.5:0/3830675177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b4c0b08e0 msgr2=0x7f2b38004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:30.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4bfff700 1 --2- 172.21.15.5:0/3830675177 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b4c0b08e0 0x7f2b38004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4bfff700 1 -- 172.21.15.5:0/3830675177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b38004d90 msgr2=0x7f2b38005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:30.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4bfff700 1 --2- 172.21.15.5:0/3830675177 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b38004d90 0x7f2b38005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4bfff700 1 -- 172.21.15.5:0/3830675177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b380035b0 con 0x7f2b38003aa0 2023-03-03T06:25:30.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.002+0000 7f2b4bfff700 1 --2- 172.21.15.5:0/3830675177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b38003aa0 0x7f2b38003e70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400c240 tx=0x7f2b38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501459598f9bf91c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:30.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.003+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3400cd80 con 0x7f2b38003aa0 2023-03-03T06:25:30.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.003+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34005960 con 0x7f2b38003aa0 2023-03-03T06:25:30.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.003+0000 7f2b4affd700 1 -- 172.21.15.5:0/3830675177 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34005d10 con 0x7f2b38003aa0 2023-03-03T06:25:30.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.003+0000 7f2b5278d700 1 -- 172.21.15.5:0/3830675177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b38003aa0 msgr2=0x7f2b38003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:30.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.003+0000 7f2b5278d700 1 --2- 172.21.15.5:0/3830675177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b38003aa0 0x7f2b38003e70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400c240 tx=0x7f2b38005880 comp rx=0 tx=0).stop 2023-03-03T06:25:30.010 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.003+0000 7f2b50d2a700 1 -- 172.21.15.5:0/3830675177 reap_dead start 2023-03-03T06:25:30.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.003+0000 7f2b5278d700 1 -- 172.21.15.5:0/3830675177 shutdown_connections 2023-03-03T06:25:30.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.003+0000 7f2b5278d700 1 -- 172.21.15.5:0/3830675177 >> 172.21.15.5:0/3830675177 conn(0x7f2b4c0b2cb0 msgr2=0x7f2b4c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:30.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.003+0000 7f2b5278d700 1 -- 172.21.15.5:0/3830675177 shutdown_connections 2023-03-03T06:25:30.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.003+0000 7f2b5278d700 1 -- 172.21.15.5:0/3830675177 wait complete. 2023-03-03T06:25:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.004+0000 7f2b5278d700 1 Processor -- start 2023-03-03T06:25:30.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.005+0000 7f2b5278d700 1 -- start start 2023-03-03T06:25:30.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.005+0000 7f2b5278d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b38003aa0 0x7f2b4c0c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.005+0000 7f2b5278d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b4c0c93a0 0x7f2b4c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.005+0000 7f2b5278d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b4c15aa00 0x7f2b4c1f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.005+0000 7f2b5278d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c1f6750 con 0x7f2b4c15aa00 2023-03-03T06:25:30.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.005+0000 7f2b5278d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0ca140 con 0x7f2b4c0c93a0 2023-03-03T06:25:30.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.005+0000 7f2b5278d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0c98a0 con 0x7f2b38003aa0 2023-03-03T06:25:30.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.005+0000 7f2b50d2a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b4c15aa00 0x7f2b4c1f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b4bfff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b38003aa0 0x7f2b4c0c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b50d2a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b4c15aa00 0x7f2b4c1f58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44616/0 (socket says 172.21.15.5:44616) 2023-03-03T06:25:30.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b50d2a700 1 -- 172.21.15.5:0/589134385 learned_addr learned my addr 172.21.15.5:0/589134385 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:30.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b4b7fe700 1 --2- 172.21.15.5:0/589134385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b4c0c93a0 0x7f2b4c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b50d2a700 1 -- 172.21.15.5:0/589134385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b38003aa0 msgr2=0x7f2b4c0c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:30.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b50d2a700 1 --2- 172.21.15.5:0/589134385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b38003aa0 0x7f2b4c0c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b50d2a700 1 -- 172.21.15.5:0/589134385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b4c0c93a0 msgr2=0x7f2b4c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:30.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b50d2a700 1 --2- 172.21.15.5:0/589134385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b4c0c93a0 0x7f2b4c15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b50d2a700 1 -- 172.21.15.5:0/589134385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c0cd290 con 0x7f2b4c15aa00 2023-03-03T06:25:30.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b50d2a700 1 --2- 172.21.15.5:0/589134385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b4c15aa00 0x7f2b4c1f58f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0c3860 tx=0x7f2b440111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:30.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b48ff9700 1 -- 172.21.15.5:0/589134385 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4400e070 con 0x7f2b4c15aa00 2023-03-03T06:25:30.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b48ff9700 1 -- 172.21.15.5:0/589134385 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b44003cf0 con 0x7f2b4c15aa00 2023-03-03T06:25:30.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b5278d700 1 -- 172.21.15.5:0/589134385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c0ccfb0 con 0x7f2b4c15aa00 2023-03-03T06:25:30.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b48ff9700 1 -- 172.21.15.5:0/589134385 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44003ea0 con 0x7f2b4c15aa00 2023-03-03T06:25:30.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.006+0000 7f2b5278d700 1 -- 172.21.15.5:0/589134385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c0af040 con 0x7f2b4c15aa00 2023-03-03T06:25:30.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.007+0000 7f2b5278d700 1 -- 172.21.15.5:0/589134385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4c04e6e0 con 0x7f2b4c15aa00 2023-03-03T06:25:30.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.008+0000 7f2b48ff9700 1 -- 172.21.15.5:0/589134385 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2b440116c0 con 0x7f2b4c15aa00 2023-03-03T06:25:30.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.008+0000 7f2b48ff9700 1 --2- 172.21.15.5:0/589134385 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2b2c0682f0 0x7f2b2c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.008+0000 7f2b48ff9700 1 -- 172.21.15.5:0/589134385 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2b44086350 con 0x7f2b4c15aa00 2023-03-03T06:25:30.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.008+0000 7f2b4bfff700 1 --2- 172.21.15.5:0/589134385 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2b2c0682f0 0x7f2b2c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.009+0000 7f2b4bfff700 1 --2- 172.21.15.5:0/589134385 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2b2c0682f0 0x7f2b2c06a7a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2b34015040 tx=0x7f2b3400a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:30.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.013+0000 7f2b48ff9700 1 -- 172.21.15.5:0/589134385 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2b44052910 con 0x7f2b4c15aa00 2023-03-03T06:25:30.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.287+0000 7f2b5278d700 1 -- 172.21.15.5:0/589134385 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2b4c0affb0 con 0x7f2b4c15aa00 2023-03-03T06:25:30.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.288+0000 7f2b48ff9700 1 -- 172.21.15.5:0/589134385 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1432 (secure 0 0 0) 0x7f2b44055f30 con 0x7f2b4c15aa00 2023-03-03T06:25:30.290 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:30.290 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":128,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":56,"num_osds":8,"num_up_osds":8,"osd_up_since":1677824611,"num_in_osds":8,"osd_in_since":1677824604,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":5,"num_objects":23,"data_bytes":592698,"bytes_used":77955072,"bytes_avail":773016158208,"bytes_total":773094113280,"write_bytes_sec":2392,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5410}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-03-03T06:25:13.481392+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-03-03T06:25:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.290+0000 7f2b5278d700 1 -- 172.21.15.5:0/589134385 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2b2c0682f0 msgr2=0x7f2b2c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.290+0000 7f2b5278d700 1 --2- 172.21.15.5:0/589134385 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2b2c0682f0 0x7f2b2c06a7a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2b34015040 tx=0x7f2b3400a000 comp rx=0 tx=0).stop 2023-03-03T06:25:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.290+0000 7f2b5278d700 1 -- 172.21.15.5:0/589134385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b4c15aa00 msgr2=0x7f2b4c1f58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.290+0000 7f2b5278d700 1 --2- 172.21.15.5:0/589134385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b4c15aa00 0x7f2b4c1f58f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0c3860 tx=0x7f2b440111d0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.290+0000 7f2b5278d700 1 -- 172.21.15.5:0/589134385 shutdown_connections 2023-03-03T06:25:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.290+0000 7f2b5278d700 1 --2- 172.21.15.5:0/589134385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b4c15aa00 0x7f2b4c1f58f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.290+0000 7f2b5278d700 1 --2- 172.21.15.5:0/589134385 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2b2c0682f0 0x7f2b2c06a7a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.290+0000 7f2b5278d700 1 --2- 172.21.15.5:0/589134385 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2b38003aa0 0x7f2b4c0c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.290+0000 7f2b5278d700 1 --2- 172.21.15.5:0/589134385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b4c0c93a0 0x7f2b4c15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.290+0000 7f2b5278d700 1 -- 172.21.15.5:0/589134385 >> 172.21.15.5:0/589134385 conn(0x7f2b4c0b2cb0 msgr2=0x7f2b4c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.290+0000 7f2b5278d700 1 -- 172.21.15.5:0/589134385 shutdown_connections 2023-03-03T06:25:30.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.290+0000 7f2b5278d700 1 -- 172.21.15.5:0/589134385 wait complete. 2023-03-03T06:25:30.304 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-03-03T06:25:30.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:25:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.427+0000 7fdabecdc700 1 Processor -- start 2023-03-03T06:25:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.427+0000 7fdabecdc700 1 -- start start 2023-03-03T06:25:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.428+0000 7fdabecdc700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdab815cd40 0x7fdab80b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.428+0000 7fdabecdc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab80cba50 0x7fdab80b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.428+0000 7fdabecdc700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab815d4e0 con 0x7fdab80cd3e0 2023-03-03T06:25:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.428+0000 7fdabecdc700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab815d7c0 con 0x7fdab815cd40 2023-03-03T06:25:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.428+0000 7fdabecdc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab815daa0 con 0x7fdab80cba50 2023-03-03T06:25:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.428+0000 7fdab7fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab80cba50 0x7fdab80b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.428+0000 7fdabca78700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdab815cd40 0x7fdab80b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.428+0000 7fdab7fff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab80cba50 0x7fdab80b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:42698/0 (socket says 172.21.15.5:42698) 2023-03-03T06:25:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.428+0000 7fdabca78700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdab815cd40 0x7fdab80b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:44980/0 (socket says 172.21.15.5:44980) 2023-03-03T06:25:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.428+0000 7fdabd279700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fdab80cd3e0 0x7fdab8160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:48994/0 (socket says 172.21.15.5:48994) 2023-03-03T06:25:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.428+0000 7fdab7fff700 1 -- 172.21.15.5:0/2795849786 learned_addr learned my addr 172.21.15.5:0/2795849786 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.429+0000 7fdab7fff700 1 -- 172.21.15.5:0/2795849786 >> v2:172.21.15.191:3300/0 conn(0x7fdab815cd40 msgr2=0x7fdab80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.429+0000 7fdab7fff700 1 --2- 172.21.15.5:0/2795849786 >> v2:172.21.15.191:3300/0 conn(0x7fdab815cd40 0x7fdab80b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.429+0000 7fdab7fff700 1 -- 172.21.15.5:0/2795849786 >> v1:172.21.15.191:6789/0 conn(0x7fdab80cd3e0 legacy=0x7fdab8160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.429+0000 7fdab7fff700 1 -- 172.21.15.5:0/2795849786 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab815dd80 con 0x7fdab80cba50 2023-03-03T06:25:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.429+0000 7fdab7fff700 1 --2- 172.21.15.5:0/2795849786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab80cba50 0x7fdab80b1e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4006fd0 tx=0x7fdaa4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b23558764fb2f9be server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.429+0000 7fdab77fe700 1 -- 172.21.15.5:0/2795849786 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4005e30 con 0x7fdab80cba50 2023-03-03T06:25:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.429+0000 7fdab77fe700 1 -- 172.21.15.5:0/2795849786 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa4004030 con 0x7fdab80cba50 2023-03-03T06:25:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.429+0000 7fdab77fe700 1 -- 172.21.15.5:0/2795849786 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa40043e0 con 0x7fdab80cba50 2023-03-03T06:25:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.430+0000 7fdabecdc700 1 -- 172.21.15.5:0/2795849786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab80cba50 msgr2=0x7fdab80b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.430+0000 7fdabecdc700 1 --2- 172.21.15.5:0/2795849786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab80cba50 0x7fdab80b1e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4006fd0 tx=0x7fdaa4009bd0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.430+0000 7fdabecdc700 1 -- 172.21.15.5:0/2795849786 shutdown_connections 2023-03-03T06:25:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.430+0000 7fdabecdc700 1 --2- 172.21.15.5:0/2795849786 >> v2:172.21.15.191:3300/0 conn(0x7fdab815cd40 0x7fdab80b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.430+0000 7fdabecdc700 1 --2- 172.21.15.5:0/2795849786 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab80cba50 0x7fdab80b1e10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.430+0000 7fdabecdc700 1 -- 172.21.15.5:0/2795849786 >> 172.21.15.5:0/2795849786 conn(0x7fdab80cc8d0 msgr2=0x7fdab80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.430+0000 7fdabecdc700 1 -- 172.21.15.5:0/2795849786 shutdown_connections 2023-03-03T06:25:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.430+0000 7fdabecdc700 1 -- 172.21.15.5:0/2795849786 wait complete. 2023-03-03T06:25:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.431+0000 7fdabecdc700 1 Processor -- start 2023-03-03T06:25:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.431+0000 7fdabecdc700 1 -- start start 2023-03-03T06:25:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdabecdc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdab80cba50 0x7fdab8147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdabecdc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab80cd3e0 0x7fdab80ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdabecdc700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab815cd40 0x7fdab80b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdabecdc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab81e9050 con 0x7fdab80cd3e0 2023-03-03T06:25:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdabecdc700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab8148320 con 0x7fdab80cba50 2023-03-03T06:25:30.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdabecdc700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab80ac820 con 0x7fdab815cd40 2023-03-03T06:25:30.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdab7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab80cd3e0 0x7fdab80ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdab7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab80cd3e0 0x7fdab80ac2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44628/0 (socket says 172.21.15.5:44628) 2023-03-03T06:25:30.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdab7fff700 1 -- 172.21.15.5:0/1677120721 learned_addr learned my addr 172.21.15.5:0/1677120721 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:30.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdabd279700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab815cd40 0x7fdab80b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdabca78700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdab80cba50 0x7fdab8147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdab7fff700 1 -- 172.21.15.5:0/1677120721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab815cd40 msgr2=0x7fdab80b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:30.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdab7fff700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab815cd40 0x7fdab80b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdab7fff700 1 -- 172.21.15.5:0/1677120721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdab80cba50 msgr2=0x7fdab8147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:30.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdab7fff700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdab80cba50 0x7fdab8147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.432+0000 7fdab7fff700 1 -- 172.21.15.5:0/1677120721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa4009500 con 0x7fdab80cd3e0 2023-03-03T06:25:30.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.433+0000 7fdab7fff700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab80cd3e0 0x7fdab80ac2e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009130 tx=0x7fdaa4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:30.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.433+0000 7fdab57fa700 1 -- 172.21.15.5:0/1677120721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa40045b0 con 0x7fdab80cd3e0 2023-03-03T06:25:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.433+0000 7fdab57fa700 1 -- 172.21.15.5:0/1677120721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa401d430 con 0x7fdab80cd3e0 2023-03-03T06:25:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.433+0000 7fdabecdc700 1 -- 172.21.15.5:0/1677120721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab80ca530 con 0x7fdab80cd3e0 2023-03-03T06:25:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.433+0000 7fdab57fa700 1 -- 172.21.15.5:0/1677120721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa401d7e0 con 0x7fdab80cd3e0 2023-03-03T06:25:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.433+0000 7fdabecdc700 1 -- 172.21.15.5:0/1677120721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab815e060 con 0x7fdab80cd3e0 2023-03-03T06:25:30.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.434+0000 7fdabecdc700 1 -- 172.21.15.5:0/1677120721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab815d110 con 0x7fdab80cd3e0 2023-03-03T06:25:30.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.434+0000 7fdab57fa700 1 -- 172.21.15.5:0/1677120721 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdaa402d070 con 0x7fdab80cd3e0 2023-03-03T06:25:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.435+0000 7fdab57fa700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda9c0682f0 0x7fda9c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.435+0000 7fdab57fa700 1 -- 172.21.15.5:0/1677120721 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fdaa4087120 con 0x7fdab80cd3e0 2023-03-03T06:25:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.435+0000 7fdabca78700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda9c0682f0 0x7fda9c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.435+0000 7fdabca78700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda9c0682f0 0x7fda9c06a7a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009b40 tx=0x7fdaac009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:30.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.439+0000 7fdab57fa700 1 -- 172.21.15.5:0/1677120721 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdaa40536e0 con 0x7fdab80cd3e0 2023-03-03T06:25:30.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.629+0000 7fdabecdc700 1 -- 172.21.15.5:0/1677120721 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdab804e6e0 con 0x7fda9c0682f0 2023-03-03T06:25:30.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.640+0000 7fdab57fa700 1 -- 172.21.15.5:0/1677120721 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392265 (secure 0 0 0) 0x7fdab804e6e0 con 0x7fda9c0682f0 2023-03-03T06:25:30.647 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:30.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.643+0000 7fdabecdc700 1 -- 172.21.15.5:0/1677120721 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda9c0682f0 msgr2=0x7fda9c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:30.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.643+0000 7fdabecdc700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda9c0682f0 0x7fda9c06a7a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009b40 tx=0x7fdaac009210 comp rx=0 tx=0).stop 2023-03-03T06:25:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.643+0000 7fdabecdc700 1 -- 172.21.15.5:0/1677120721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab80cd3e0 msgr2=0x7fdab80ac2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.643+0000 7fdabecdc700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab80cd3e0 0x7fdab80ac2e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009130 tx=0x7fdaa4004750 comp rx=0 tx=0).stop 2023-03-03T06:25:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.644+0000 7fdabecdc700 1 -- 172.21.15.5:0/1677120721 shutdown_connections 2023-03-03T06:25:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.644+0000 7fdabecdc700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda9c0682f0 0x7fda9c06a7a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.644+0000 7fdabecdc700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdab815cd40 0x7fdab80b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.644+0000 7fdabecdc700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdab80cba50 0x7fdab8147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.644+0000 7fdabecdc700 1 --2- 172.21.15.5:0/1677120721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdab80cd3e0 0x7fdab80ac2e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.644+0000 7fdabecdc700 1 -- 172.21.15.5:0/1677120721 >> 172.21.15.5:0/1677120721 conn(0x7fdab80cc8d0 msgr2=0x7fdab80b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.644+0000 7fdabecdc700 1 -- 172.21.15.5:0/1677120721 shutdown_connections 2023-03-03T06:25:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:30.644+0000 7fdabecdc700 1 -- 172.21.15.5:0/1677120721 wait complete. 2023-03-03T06:25:30.651 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:25:30.658 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-03-03T06:25:29.484096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":249,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":76128,"kb_used_data":6432,"kb_used_omap":0,"kb_used_meta":69632,"kb_avail":754898592,"statfs":{"total":773094113280,"available":773016158208,"internally_reserved":0,"allocated":6586368,"data_stored":3728562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71303168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.993261"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125720+0000","last_change":"2023-03-03T06:25:24.935569+0000","last_active":"2023-03-03T06:25:26.125720+0000","last_peered":"2023-03-03T06:25:26.125720+0000","last_clean":"2023-03-03T06:25:26.125720+0000","last_became_active":"2023-03-03T06:25:24.935292+0000","last_became_peered":"2023-03-03T06:25:24.935292+0000","last_unstale":"2023-03-03T06:25:26.125720+0000","last_undegraded":"2023-03-03T06:25:26.125720+0000","last_fullsized":"2023-03-03T06:25:26.125720+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:38:56.804003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125539+0000","last_change":"2023-03-03T06:25:24.933504+0000","last_active":"2023-03-03T06:25:26.125539+0000","last_peered":"2023-03-03T06:25:26.125539+0000","last_clean":"2023-03-03T06:25:26.125539+0000","last_became_active":"2023-03-03T06:25:24.933222+0000","last_became_peered":"2023-03-03T06:25:24.933222+0000","last_unstale":"2023-03-03T06:25:26.125539+0000","last_undegraded":"2023-03-03T06:25:26.125539+0000","last_fullsized":"2023-03-03T06:25:26.125539+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:58:45.529684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126513+0000","last_change":"2023-03-03T06:25:24.941017+0000","last_active":"2023-03-03T06:25:26.126513+0000","last_peered":"2023-03-03T06:25:26.126513+0000","last_clean":"2023-03-03T06:25:26.126513+0000","last_became_active":"2023-03-03T06:25:24.939949+0000","last_became_peered":"2023-03-03T06:25:24.939949+0000","last_unstale":"2023-03-03T06:25:26.126513+0000","last_undegraded":"2023-03-03T06:25:26.126513+0000","last_fullsized":"2023-03-03T06:25:26.126513+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:00.665647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927669+0000","last_change":"2023-03-03T06:25:24.951803+0000","last_active":"2023-03-03T06:25:25.927669+0000","last_peered":"2023-03-03T06:25:25.927669+0000","last_clean":"2023-03-03T06:25:25.927669+0000","last_became_active":"2023-03-03T06:25:24.948614+0000","last_became_peered":"2023-03-03T06:25:24.948614+0000","last_unstale":"2023-03-03T06:25:25.927669+0000","last_undegraded":"2023-03-03T06:25:25.927669+0000","last_fullsized":"2023-03-03T06:25:25.927669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:16:25.029237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126611+0000","last_change":"2023-03-03T06:25:24.951103+0000","last_active":"2023-03-03T06:25:26.126611+0000","last_peered":"2023-03-03T06:25:26.126611+0000","last_clean":"2023-03-03T06:25:26.126611+0000","last_became_active":"2023-03-03T06:25:24.950824+0000","last_became_peered":"2023-03-03T06:25:24.950824+0000","last_unstale":"2023-03-03T06:25:26.126611+0000","last_undegraded":"2023-03-03T06:25:26.126611+0000","last_fullsized":"2023-03-03T06:25:26.126611+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:58:45.529684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124683+0000","last_change":"2023-03-03T06:25:24.940552+0000","last_active":"2023-03-03T06:25:26.124683+0000","last_peered":"2023-03-03T06:25:26.124683+0000","last_clean":"2023-03-03T06:25:26.124683+0000","last_became_active":"2023-03-03T06:25:24.940261+0000","last_became_peered":"2023-03-03T06:25:24.940261+0000","last_unstale":"2023-03-03T06:25:26.124683+0000","last_undegraded":"2023-03-03T06:25:26.124683+0000","last_fullsized":"2023-03-03T06:25:26.124683+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:10:56.787049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924705+0000","last_change":"2023-03-03T06:25:24.941231+0000","last_active":"2023-03-03T06:25:25.924705+0000","last_peered":"2023-03-03T06:25:25.924705+0000","last_clean":"2023-03-03T06:25:25.924705+0000","last_became_active":"2023-03-03T06:25:24.940898+0000","last_became_peered":"2023-03-03T06:25:24.940898+0000","last_unstale":"2023-03-03T06:25:25.924705+0000","last_undegraded":"2023-03-03T06:25:25.924705+0000","last_fullsized":"2023-03-03T06:25:25.924705+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:56.288223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124707+0000","last_change":"2023-03-03T06:25:24.941288+0000","last_active":"2023-03-03T06:25:26.124707+0000","last_peered":"2023-03-03T06:25:26.124707+0000","last_clean":"2023-03-03T06:25:26.124707+0000","last_became_active":"2023-03-03T06:25:24.940747+0000","last_became_peered":"2023-03-03T06:25:24.940747+0000","last_unstale":"2023-03-03T06:25:26.124707+0000","last_undegraded":"2023-03-03T06:25:26.124707+0000","last_fullsized":"2023-03-03T06:25:26.124707+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:05.741040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126840+0000","last_change":"2023-03-03T06:25:24.950479+0000","last_active":"2023-03-03T06:25:26.126840+0000","last_peered":"2023-03-03T06:25:26.126840+0000","last_clean":"2023-03-03T06:25:26.126840+0000","last_became_active":"2023-03-03T06:25:24.950185+0000","last_became_peered":"2023-03-03T06:25:24.950185+0000","last_unstale":"2023-03-03T06:25:26.126840+0000","last_undegraded":"2023-03-03T06:25:26.126840+0000","last_fullsized":"2023-03-03T06:25:26.126840+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:29:57.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126768+0000","last_change":"2023-03-03T06:25:24.942656+0000","last_active":"2023-03-03T06:25:26.126768+0000","last_peered":"2023-03-03T06:25:26.126768+0000","last_clean":"2023-03-03T06:25:26.126768+0000","last_became_active":"2023-03-03T06:25:24.942401+0000","last_became_peered":"2023-03-03T06:25:24.942401+0000","last_unstale":"2023-03-03T06:25:26.126768+0000","last_undegraded":"2023-03-03T06:25:26.126768+0000","last_fullsized":"2023-03-03T06:25:26.126768+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:50:10.945053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927752+0000","last_change":"2023-03-03T06:25:24.944377+0000","last_active":"2023-03-03T06:25:25.927752+0000","last_peered":"2023-03-03T06:25:25.927752+0000","last_clean":"2023-03-03T06:25:25.927752+0000","last_became_active":"2023-03-03T06:25:24.943646+0000","last_became_peered":"2023-03-03T06:25:24.943646+0000","last_unstale":"2023-03-03T06:25:25.927752+0000","last_undegraded":"2023-03-03T06:25:25.927752+0000","last_fullsized":"2023-03-03T06:25:25.927752+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:36:14.477572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124995+0000","last_change":"2023-03-03T06:25:24.946217+0000","last_active":"2023-03-03T06:25:26.124995+0000","last_peered":"2023-03-03T06:25:26.124995+0000","last_clean":"2023-03-03T06:25:26.124995+0000","last_became_active":"2023-03-03T06:25:24.945915+0000","last_became_peered":"2023-03-03T06:25:24.945915+0000","last_unstale":"2023-03-03T06:25:26.124995+0000","last_undegraded":"2023-03-03T06:25:26.124995+0000","last_fullsized":"2023-03-03T06:25:26.124995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:14:54.560548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124820+0000","last_change":"2023-03-03T06:25:24.941338+0000","last_active":"2023-03-03T06:25:26.124820+0000","last_peered":"2023-03-03T06:25:26.124820+0000","last_clean":"2023-03-03T06:25:26.124820+0000","last_became_active":"2023-03-03T06:25:24.940975+0000","last_became_peered":"2023-03-03T06:25:24.940975+0000","last_unstale":"2023-03-03T06:25:26.124820+0000","last_undegraded":"2023-03-03T06:25:26.124820+0000","last_fullsized":"2023-03-03T06:25:26.124820+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:05:56.931797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126380+0000","last_change":"2023-03-03T06:25:24.941629+0000","last_active":"2023-03-03T06:25:26.126380+0000","last_peered":"2023-03-03T06:25:26.126380+0000","last_clean":"2023-03-03T06:25:26.126380+0000","last_became_active":"2023-03-03T06:25:24.941356+0000","last_became_peered":"2023-03-03T06:25:24.941356+0000","last_unstale":"2023-03-03T06:25:26.126380+0000","last_undegraded":"2023-03-03T06:25:26.126380+0000","last_fullsized":"2023-03-03T06:25:26.126380+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:28:45.764299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126326+0000","last_change":"2023-03-03T06:25:24.940067+0000","last_active":"2023-03-03T06:25:26.126326+0000","last_peered":"2023-03-03T06:25:26.126326+0000","last_clean":"2023-03-03T06:25:26.126326+0000","last_became_active":"2023-03-03T06:25:24.939655+0000","last_became_peered":"2023-03-03T06:25:24.939655+0000","last_unstale":"2023-03-03T06:25:26.126326+0000","last_undegraded":"2023-03-03T06:25:26.126326+0000","last_fullsized":"2023-03-03T06:25:26.126326+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:00:12.817746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924450+0000","last_change":"2023-03-03T06:25:24.934523+0000","last_active":"2023-03-03T06:25:25.924450+0000","last_peered":"2023-03-03T06:25:25.924450+0000","last_clean":"2023-03-03T06:25:25.924450+0000","last_became_active":"2023-03-03T06:25:24.934274+0000","last_became_peered":"2023-03-03T06:25:24.934274+0000","last_unstale":"2023-03-03T06:25:25.924450+0000","last_undegraded":"2023-03-03T06:25:25.924450+0000","last_fullsized":"2023-03-03T06:25:25.924450+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:01:02.628122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125658+0000","last_change":"2023-03-03T06:25:24.949752+0000","last_active":"2023-03-03T06:25:26.125658+0000","last_peered":"2023-03-03T06:25:26.125658+0000","last_clean":"2023-03-03T06:25:26.125658+0000","last_became_active":"2023-03-03T06:25:24.949316+0000","last_became_peered":"2023-03-03T06:25:24.949316+0000","last_unstale":"2023-03-03T06:25:26.125658+0000","last_undegraded":"2023-03-03T06:25:26.125658+0000","last_fullsized":"2023-03-03T06:25:26.125658+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:19:01.571013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.928051+0000","last_change":"2023-03-03T06:25:24.951882+0000","last_active":"2023-03-03T06:25:25.928051+0000","last_peered":"2023-03-03T06:25:25.928051+0000","last_clean":"2023-03-03T06:25:25.928051+0000","last_became_active":"2023-03-03T06:25:24.948457+0000","last_became_peered":"2023-03-03T06:25:24.948457+0000","last_unstale":"2023-03-03T06:25:25.928051+0000","last_undegraded":"2023-03-03T06:25:25.928051+0000","last_fullsized":"2023-03-03T06:25:25.928051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:25:46.667651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125581+0000","last_change":"2023-03-03T06:25:24.936053+0000","last_active":"2023-03-03T06:25:26.125581+0000","last_peered":"2023-03-03T06:25:26.125581+0000","last_clean":"2023-03-03T06:25:26.125581+0000","last_became_active":"2023-03-03T06:25:24.935821+0000","last_became_peered":"2023-03-03T06:25:24.935821+0000","last_unstale":"2023-03-03T06:25:26.125581+0000","last_undegraded":"2023-03-03T06:25:26.125581+0000","last_fullsized":"2023-03-03T06:25:26.125581+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:38:56.804003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925560+0000","last_change":"2023-03-03T06:25:24.939080+0000","last_active":"2023-03-03T06:25:25.925560+0000","last_peered":"2023-03-03T06:25:25.925560+0000","last_clean":"2023-03-03T06:25:25.925560+0000","last_became_active":"2023-03-03T06:25:24.938676+0000","last_became_peered":"2023-03-03T06:25:24.938676+0000","last_unstale":"2023-03-03T06:25:25.925560+0000","last_undegraded":"2023-03-03T06:25:25.925560+0000","last_fullsized":"2023-03-03T06:25:25.925560+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:49:46.607290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124946+0000","last_change":"2023-03-03T06:25:24.928487+0000","last_active":"2023-03-03T06:25:26.124946+0000","last_peered":"2023-03-03T06:25:26.124946+0000","last_clean":"2023-03-03T06:25:26.124946+0000","last_became_active":"2023-03-03T06:25:24.928191+0000","last_became_peered":"2023-03-03T06:25:24.928191+0000","last_unstale":"2023-03-03T06:25:26.124946+0000","last_undegraded":"2023-03-03T06:25:26.124946+0000","last_fullsized":"2023-03-03T06:25:26.124946+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:47:32.677256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925618+0000","last_change":"2023-03-03T06:25:24.942231+0000","last_active":"2023-03-03T06:25:25.925618+0000","last_peered":"2023-03-03T06:25:25.925618+0000","last_clean":"2023-03-03T06:25:25.925618+0000","last_became_active":"2023-03-03T06:25:24.941956+0000","last_became_peered":"2023-03-03T06:25:24.941956+0000","last_unstale":"2023-03-03T06:25:25.925618+0000","last_undegraded":"2023-03-03T06:25:25.925618+0000","last_fullsized":"2023-03-03T06:25:25.925618+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:25:46.667651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925445+0000","last_change":"2023-03-03T06:25:24.941614+0000","last_active":"2023-03-03T06:25:25.925445+0000","last_peered":"2023-03-03T06:25:25.925445+0000","last_clean":"2023-03-03T06:25:25.925445+0000","last_became_active":"2023-03-03T06:25:24.941347+0000","last_became_peered":"2023-03-03T06:25:24.941347+0000","last_unstale":"2023-03-03T06:25:25.925445+0000","last_undegraded":"2023-03-03T06:25:25.925445+0000","last_fullsized":"2023-03-03T06:25:25.925445+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:10:56.787049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126077+0000","last_change":"2023-03-03T06:25:24.940730+0000","last_active":"2023-03-03T06:25:26.126077+0000","last_peered":"2023-03-03T06:25:26.126077+0000","last_clean":"2023-03-03T06:25:26.126077+0000","last_became_active":"2023-03-03T06:25:24.940415+0000","last_became_peered":"2023-03-03T06:25:24.940415+0000","last_unstale":"2023-03-03T06:25:26.126077+0000","last_undegraded":"2023-03-03T06:25:26.126077+0000","last_fullsized":"2023-03-03T06:25:26.126077+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:37:30.630979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125435+0000","last_change":"2023-03-03T06:25:24.934953+0000","last_active":"2023-03-03T06:25:26.125435+0000","last_peered":"2023-03-03T06:25:26.125435+0000","last_clean":"2023-03-03T06:25:26.125435+0000","last_became_active":"2023-03-03T06:25:24.934638+0000","last_became_peered":"2023-03-03T06:25:24.934638+0000","last_unstale":"2023-03-03T06:25:26.125435+0000","last_undegraded":"2023-03-03T06:25:26.125435+0000","last_fullsized":"2023-03-03T06:25:26.125435+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:47.949094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125275+0000","last_change":"2023-03-03T06:25:24.934344+0000","last_active":"2023-03-03T06:25:26.125275+0000","last_peered":"2023-03-03T06:25:26.125275+0000","last_clean":"2023-03-03T06:25:26.125275+0000","last_became_active":"2023-03-03T06:25:24.933879+0000","last_became_peered":"2023-03-03T06:25:24.933879+0000","last_unstale":"2023-03-03T06:25:26.125275+0000","last_undegraded":"2023-03-03T06:25:26.125275+0000","last_fullsized":"2023-03-03T06:25:26.125275+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:15:55.076368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927873+0000","last_change":"2023-03-03T06:25:24.950493+0000","last_active":"2023-03-03T06:25:25.927873+0000","last_peered":"2023-03-03T06:25:25.927873+0000","last_clean":"2023-03-03T06:25:25.927873+0000","last_became_active":"2023-03-03T06:25:24.948493+0000","last_became_peered":"2023-03-03T06:25:24.948493+0000","last_unstale":"2023-03-03T06:25:25.927873+0000","last_undegraded":"2023-03-03T06:25:25.927873+0000","last_fullsized":"2023-03-03T06:25:25.927873+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:10:56.787049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124425+0000","last_change":"2023-03-03T06:25:24.934079+0000","last_active":"2023-03-03T06:25:26.124425+0000","last_peered":"2023-03-03T06:25:26.124425+0000","last_clean":"2023-03-03T06:25:26.124425+0000","last_became_active":"2023-03-03T06:25:24.933811+0000","last_became_peered":"2023-03-03T06:25:24.933811+0000","last_unstale":"2023-03-03T06:25:26.124425+0000","last_undegraded":"2023-03-03T06:25:26.124425+0000","last_fullsized":"2023-03-03T06:25:26.124425+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:34:23.666936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126633+0000","last_change":"2023-03-03T06:25:24.950185+0000","last_active":"2023-03-03T06:25:26.126633+0000","last_peered":"2023-03-03T06:25:26.126633+0000","last_clean":"2023-03-03T06:25:26.126633+0000","last_became_active":"2023-03-03T06:25:24.949907+0000","last_became_peered":"2023-03-03T06:25:24.949907+0000","last_unstale":"2023-03-03T06:25:26.126633+0000","last_undegraded":"2023-03-03T06:25:26.126633+0000","last_fullsized":"2023-03-03T06:25:26.126633+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:21:16.832581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125666+0000","last_change":"2023-03-03T06:25:24.942003+0000","last_active":"2023-03-03T06:25:26.125666+0000","last_peered":"2023-03-03T06:25:26.125666+0000","last_clean":"2023-03-03T06:25:26.125666+0000","last_became_active":"2023-03-03T06:25:24.941743+0000","last_became_peered":"2023-03-03T06:25:24.941743+0000","last_unstale":"2023-03-03T06:25:26.125666+0000","last_undegraded":"2023-03-03T06:25:26.125666+0000","last_fullsized":"2023-03-03T06:25:26.125666+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:50:43.336071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927347+0000","last_change":"2023-03-03T06:25:24.953502+0000","last_active":"2023-03-03T06:25:25.927347+0000","last_peered":"2023-03-03T06:25:25.927347+0000","last_clean":"2023-03-03T06:25:25.927347+0000","last_became_active":"2023-03-03T06:25:24.953247+0000","last_became_peered":"2023-03-03T06:25:24.953247+0000","last_unstale":"2023-03-03T06:25:25.927347+0000","last_undegraded":"2023-03-03T06:25:25.927347+0000","last_fullsized":"2023-03-03T06:25:25.927347+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:19:50.229403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124277+0000","last_change":"2023-03-03T06:25:24.934820+0000","last_active":"2023-03-03T06:25:26.124277+0000","last_peered":"2023-03-03T06:25:26.124277+0000","last_clean":"2023-03-03T06:25:26.124277+0000","last_became_active":"2023-03-03T06:25:24.934333+0000","last_became_peered":"2023-03-03T06:25:24.934333+0000","last_unstale":"2023-03-03T06:25:26.124277+0000","last_undegraded":"2023-03-03T06:25:26.124277+0000","last_fullsized":"2023-03-03T06:25:26.124277+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:19:50.229403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124949+0000","last_change":"2023-03-03T06:25:24.944796+0000","last_active":"2023-03-03T06:25:26.124949+0000","last_peered":"2023-03-03T06:25:26.124949+0000","last_clean":"2023-03-03T06:25:26.124949+0000","last_became_active":"2023-03-03T06:25:24.944619+0000","last_became_peered":"2023-03-03T06:25:24.944619+0000","last_unstale":"2023-03-03T06:25:26.124949+0000","last_undegraded":"2023-03-03T06:25:26.124949+0000","last_fullsized":"2023-03-03T06:25:26.124949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:42:07.547230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"55'8","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927223+0000","last_change":"2023-03-03T06:25:24.518747+0000","last_active":"2023-03-03T06:25:25.927223+0000","last_peered":"2023-03-03T06:25:25.927223+0000","last_clean":"2023-03-03T06:25:25.927223+0000","last_became_active":"2023-03-03T06:25:24.518462+0000","last_became_peered":"2023-03-03T06:25:24.518462+0000","last_unstale":"2023-03-03T06:25:25.927223+0000","last_undegraded":"2023-03-03T06:25:25.927223+0000","last_fullsized":"2023-03-03T06:25:25.927223+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:29:56.144718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.921255+0000","last_change":"2023-03-03T06:25:05.635776+0000","last_active":"2023-03-03T06:25:24.921255+0000","last_peered":"2023-03-03T06:25:24.921255+0000","last_clean":"2023-03-03T06:25:24.921255+0000","last_became_active":"2023-03-03T06:25:04.444243+0000","last_became_peered":"2023-03-03T06:25:04.444243+0000","last_unstale":"2023-03-03T06:25:24.921255+0000","last_undegraded":"2023-03-03T06:25:24.921255+0000","last_fullsized":"2023-03-03T06:25:24.921255+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:00:41.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066956899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125958+0000","last_change":"2023-03-03T06:25:24.945196+0000","last_active":"2023-03-03T06:25:26.125958+0000","last_peered":"2023-03-03T06:25:26.125958+0000","last_clean":"2023-03-03T06:25:26.125958+0000","last_became_active":"2023-03-03T06:25:24.937674+0000","last_became_peered":"2023-03-03T06:25:24.937674+0000","last_unstale":"2023-03-03T06:25:26.125958+0000","last_undegraded":"2023-03-03T06:25:26.125958+0000","last_fullsized":"2023-03-03T06:25:26.125958+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:34:23.666936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126281+0000","last_change":"2023-03-03T06:25:24.523642+0000","last_active":"2023-03-03T06:25:26.126281+0000","last_peered":"2023-03-03T06:25:26.126281+0000","last_clean":"2023-03-03T06:25:26.126281+0000","last_became_active":"2023-03-03T06:25:24.523365+0000","last_became_peered":"2023-03-03T06:25:24.523365+0000","last_unstale":"2023-03-03T06:25:26.126281+0000","last_undegraded":"2023-03-03T06:25:26.126281+0000","last_fullsized":"2023-03-03T06:25:26.126281+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:38:55.799484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.924741+0000","last_change":"2023-03-03T06:25:05.615550+0000","last_active":"2023-03-03T06:25:24.924741+0000","last_peered":"2023-03-03T06:25:24.924741+0000","last_clean":"2023-03-03T06:25:24.924741+0000","last_became_active":"2023-03-03T06:25:04.445574+0000","last_became_peered":"2023-03-03T06:25:04.445574+0000","last_unstale":"2023-03-03T06:25:24.924741+0000","last_undegraded":"2023-03-03T06:25:24.924741+0000","last_fullsized":"2023-03-03T06:25:24.924741+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:15:06.370284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061229600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124962+0000","last_change":"2023-03-03T06:25:24.931742+0000","last_active":"2023-03-03T06:25:26.124962+0000","last_peered":"2023-03-03T06:25:26.124962+0000","last_clean":"2023-03-03T06:25:26.124962+0000","last_became_active":"2023-03-03T06:25:24.931451+0000","last_became_peered":"2023-03-03T06:25:24.931451+0000","last_unstale":"2023-03-03T06:25:26.124962+0000","last_undegraded":"2023-03-03T06:25:26.124962+0000","last_fullsized":"2023-03-03T06:25:26.124962+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:06:51.664573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125736+0000","last_change":"2023-03-03T06:25:24.510327+0000","last_active":"2023-03-03T06:25:26.125736+0000","last_peered":"2023-03-03T06:25:26.125736+0000","last_clean":"2023-03-03T06:25:26.125736+0000","last_became_active":"2023-03-03T06:25:24.509532+0000","last_became_peered":"2023-03-03T06:25:24.509532+0000","last_unstale":"2023-03-03T06:25:26.125736+0000","last_undegraded":"2023-03-03T06:25:26.125736+0000","last_fullsized":"2023-03-03T06:25:26.125736+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:42:06.542711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928065+0000","last_change":"2023-03-03T06:25:05.431475+0000","last_active":"2023-03-03T06:25:24.928065+0000","last_peered":"2023-03-03T06:25:24.928065+0000","last_clean":"2023-03-03T06:25:24.928065+0000","last_became_active":"2023-03-03T06:25:04.596724+0000","last_became_peered":"2023-03-03T06:25:04.596724+0000","last_unstale":"2023-03-03T06:25:24.928065+0000","last_undegraded":"2023-03-03T06:25:24.928065+0000","last_fullsized":"2023-03-03T06:25:24.928065+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015785179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927235+0000","last_change":"2023-03-03T06:25:24.952416+0000","last_active":"2023-03-03T06:25:25.927235+0000","last_peered":"2023-03-03T06:25:25.927235+0000","last_clean":"2023-03-03T06:25:25.927235+0000","last_became_active":"2023-03-03T06:25:24.952190+0000","last_became_peered":"2023-03-03T06:25:24.952190+0000","last_unstale":"2023-03-03T06:25:25.927235+0000","last_undegraded":"2023-03-03T06:25:25.927235+0000","last_fullsized":"2023-03-03T06:25:25.927235+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:49:46.607290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126629+0000","last_change":"2023-03-03T06:25:24.524194+0000","last_active":"2023-03-03T06:25:26.126629+0000","last_peered":"2023-03-03T06:25:26.126629+0000","last_clean":"2023-03-03T06:25:26.126629+0000","last_became_active":"2023-03-03T06:25:24.523955+0000","last_became_peered":"2023-03-03T06:25:24.523955+0000","last_unstale":"2023-03-03T06:25:26.126629+0000","last_undegraded":"2023-03-03T06:25:26.126629+0000","last_fullsized":"2023-03-03T06:25:26.126629+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:58:44.525165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.925668+0000","last_change":"2023-03-03T06:25:05.796744+0000","last_active":"2023-03-03T06:25:24.925668+0000","last_peered":"2023-03-03T06:25:24.925668+0000","last_clean":"2023-03-03T06:25:24.925668+0000","last_became_active":"2023-03-03T06:25:04.444571+0000","last_became_peered":"2023-03-03T06:25:04.444571+0000","last_unstale":"2023-03-03T06:25:24.925668+0000","last_undegraded":"2023-03-03T06:25:24.925668+0000","last_fullsized":"2023-03-03T06:25:24.925668+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:46:48.500233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050328500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927950+0000","last_change":"2023-03-03T06:25:24.939539+0000","last_active":"2023-03-03T06:25:25.927950+0000","last_peered":"2023-03-03T06:25:25.927950+0000","last_clean":"2023-03-03T06:25:25.927950+0000","last_became_active":"2023-03-03T06:25:24.939290+0000","last_became_peered":"2023-03-03T06:25:24.939290+0000","last_unstale":"2023-03-03T06:25:25.927950+0000","last_undegraded":"2023-03-03T06:25:25.927950+0000","last_fullsized":"2023-03-03T06:25:25.927950+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:15:55.076368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"55'6","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124441+0000","last_change":"2023-03-03T06:25:24.511429+0000","last_active":"2023-03-03T06:25:26.124441+0000","last_peered":"2023-03-03T06:25:26.124441+0000","last_clean":"2023-03-03T06:25:26.124441+0000","last_became_active":"2023-03-03T06:25:24.509968+0000","last_became_peered":"2023-03-03T06:25:24.509968+0000","last_unstale":"2023-03-03T06:25:26.124441+0000","last_undegraded":"2023-03-03T06:25:26.124441+0000","last_fullsized":"2023-03-03T06:25:26.124441+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:05:09.690556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927875+0000","last_change":"2023-03-03T06:25:05.615943+0000","last_active":"2023-03-03T06:25:24.927875+0000","last_peered":"2023-03-03T06:25:24.927875+0000","last_clean":"2023-03-03T06:25:24.927875+0000","last_became_active":"2023-03-03T06:25:04.443824+0000","last_became_peered":"2023-03-03T06:25:04.443824+0000","last_unstale":"2023-03-03T06:25:24.927875+0000","last_undegraded":"2023-03-03T06:25:24.927875+0000","last_fullsized":"2023-03-03T06:25:24.927875+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:11.723607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059238800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125498+0000","last_change":"2023-03-03T06:25:24.936514+0000","last_active":"2023-03-03T06:25:26.125498+0000","last_peered":"2023-03-03T06:25:26.125498+0000","last_clean":"2023-03-03T06:25:26.125498+0000","last_became_active":"2023-03-03T06:25:24.936302+0000","last_became_peered":"2023-03-03T06:25:24.936302+0000","last_unstale":"2023-03-03T06:25:26.125498+0000","last_undegraded":"2023-03-03T06:25:26.125498+0000","last_fullsized":"2023-03-03T06:25:26.125498+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:42:12.338772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"55'3","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126704+0000","last_change":"2023-03-03T06:25:24.524257+0000","last_active":"2023-03-03T06:25:26.126704+0000","last_peered":"2023-03-03T06:25:26.126704+0000","last_clean":"2023-03-03T06:25:26.126704+0000","last_became_active":"2023-03-03T06:25:24.523977+0000","last_became_peered":"2023-03-03T06:25:24.523977+0000","last_unstale":"2023-03-03T06:25:26.126704+0000","last_undegraded":"2023-03-03T06:25:26.126704+0000","last_fullsized":"2023-03-03T06:25:26.126704+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:24.002152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.938024+0000","last_change":"2023-03-03T06:25:05.430594+0000","last_active":"2023-03-03T06:25:24.938024+0000","last_peered":"2023-03-03T06:25:24.938024+0000","last_clean":"2023-03-03T06:25:24.938024+0000","last_became_active":"2023-03-03T06:25:04.435012+0000","last_became_peered":"2023-03-03T06:25:04.435012+0000","last_unstale":"2023-03-03T06:25:24.938024+0000","last_undegraded":"2023-03-03T06:25:24.938024+0000","last_fullsized":"2023-03-03T06:25:24.938024+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052988999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925746+0000","last_change":"2023-03-03T06:25:24.941624+0000","last_active":"2023-03-03T06:25:25.925746+0000","last_peered":"2023-03-03T06:25:25.925746+0000","last_clean":"2023-03-03T06:25:25.925746+0000","last_became_active":"2023-03-03T06:25:24.941371+0000","last_became_peered":"2023-03-03T06:25:24.941371+0000","last_unstale":"2023-03-03T06:25:25.925746+0000","last_undegraded":"2023-03-03T06:25:25.925746+0000","last_fullsized":"2023-03-03T06:25:25.925746+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:27:14.164819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.928147+0000","last_change":"2023-03-03T06:25:24.520152+0000","last_active":"2023-03-03T06:25:25.928147+0000","last_peered":"2023-03-03T06:25:25.928147+0000","last_clean":"2023-03-03T06:25:25.928147+0000","last_became_active":"2023-03-03T06:25:24.519863+0000","last_became_peered":"2023-03-03T06:25:24.519863+0000","last_unstale":"2023-03-03T06:25:25.928147+0000","last_undegraded":"2023-03-03T06:25:25.928147+0000","last_fullsized":"2023-03-03T06:25:25.928147+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:00:11.813227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928690+0000","last_change":"2023-03-03T06:25:05.616017+0000","last_active":"2023-03-03T06:25:24.928690+0000","last_peered":"2023-03-03T06:25:24.928690+0000","last_clean":"2023-03-03T06:25:24.928690+0000","last_became_active":"2023-03-03T06:25:04.443176+0000","last_became_peered":"2023-03-03T06:25:04.443176+0000","last_unstale":"2023-03-03T06:25:24.928690+0000","last_undegraded":"2023-03-03T06:25:24.928690+0000","last_fullsized":"2023-03-03T06:25:24.928690+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:38:47.576162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034461600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124521+0000","last_change":"2023-03-03T06:25:24.933584+0000","last_active":"2023-03-03T06:25:26.124521+0000","last_peered":"2023-03-03T06:25:26.124521+0000","last_clean":"2023-03-03T06:25:26.124521+0000","last_became_active":"2023-03-03T06:25:24.932745+0000","last_became_peered":"2023-03-03T06:25:24.932745+0000","last_unstale":"2023-03-03T06:25:26.124521+0000","last_undegraded":"2023-03-03T06:25:26.124521+0000","last_fullsized":"2023-03-03T06:25:26.124521+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:36:30.031858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126990+0000","last_change":"2023-03-03T06:25:24.524292+0000","last_active":"2023-03-03T06:25:26.126990+0000","last_peered":"2023-03-03T06:25:26.126990+0000","last_clean":"2023-03-03T06:25:26.126990+0000","last_became_active":"2023-03-03T06:25:24.523992+0000","last_became_peered":"2023-03-03T06:25:24.523992+0000","last_unstale":"2023-03-03T06:25:26.126990+0000","last_undegraded":"2023-03-03T06:25:26.126990+0000","last_fullsized":"2023-03-03T06:25:26.126990+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:10:09.890646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927153+0000","last_change":"2023-03-03T06:25:05.431768+0000","last_active":"2023-03-03T06:25:24.927153+0000","last_peered":"2023-03-03T06:25:24.927153+0000","last_clean":"2023-03-03T06:25:24.927153+0000","last_became_active":"2023-03-03T06:25:04.596711+0000","last_became_peered":"2023-03-03T06:25:04.596711+0000","last_unstale":"2023-03-03T06:25:24.927153+0000","last_undegraded":"2023-03-03T06:25:24.927153+0000","last_fullsized":"2023-03-03T06:25:24.927153+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001569261,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925513+0000","last_change":"2023-03-03T06:25:24.940880+0000","last_active":"2023-03-03T06:25:25.925513+0000","last_peered":"2023-03-03T06:25:25.925513+0000","last_clean":"2023-03-03T06:25:25.925513+0000","last_became_active":"2023-03-03T06:25:24.940629+0000","last_became_peered":"2023-03-03T06:25:24.940629+0000","last_unstale":"2023-03-03T06:25:25.925513+0000","last_undegraded":"2023-03-03T06:25:25.925513+0000","last_fullsized":"2023-03-03T06:25:25.925513+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:23:02.927157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125296+0000","last_change":"2023-03-03T06:25:24.518603+0000","last_active":"2023-03-03T06:25:26.125296+0000","last_peered":"2023-03-03T06:25:26.125296+0000","last_clean":"2023-03-03T06:25:26.125296+0000","last_became_active":"2023-03-03T06:25:24.518358+0000","last_became_peered":"2023-03-03T06:25:24.518358+0000","last_unstale":"2023-03-03T06:25:26.125296+0000","last_undegraded":"2023-03-03T06:25:26.125296+0000","last_fullsized":"2023-03-03T06:25:26.125296+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:46:07.987501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.921432+0000","last_change":"2023-03-03T06:25:05.635716+0000","last_active":"2023-03-03T06:25:24.921432+0000","last_peered":"2023-03-03T06:25:24.921432+0000","last_clean":"2023-03-03T06:25:24.921432+0000","last_became_active":"2023-03-03T06:25:04.433896+0000","last_became_peered":"2023-03-03T06:25:04.433896+0000","last_unstale":"2023-03-03T06:25:24.921432+0000","last_undegraded":"2023-03-03T06:25:24.921432+0000","last_fullsized":"2023-03-03T06:25:24.921432+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:35.209807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060132199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125405+0000","last_change":"2023-03-03T06:25:24.933888+0000","last_active":"2023-03-03T06:25:26.125405+0000","last_peered":"2023-03-03T06:25:26.125405+0000","last_clean":"2023-03-03T06:25:26.125405+0000","last_became_active":"2023-03-03T06:25:24.933615+0000","last_became_peered":"2023-03-03T06:25:24.933615+0000","last_unstale":"2023-03-03T06:25:26.125405+0000","last_undegraded":"2023-03-03T06:25:26.125405+0000","last_fullsized":"2023-03-03T06:25:26.125405+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:52:46.374182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925492+0000","last_change":"2023-03-03T06:25:24.521188+0000","last_active":"2023-03-03T06:25:25.925492+0000","last_peered":"2023-03-03T06:25:25.925492+0000","last_clean":"2023-03-03T06:25:25.925492+0000","last_became_active":"2023-03-03T06:25:24.520714+0000","last_became_peered":"2023-03-03T06:25:24.520714+0000","last_unstale":"2023-03-03T06:25:25.925492+0000","last_undegraded":"2023-03-03T06:25:25.925492+0000","last_fullsized":"2023-03-03T06:25:25.925492+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:46.944575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.938123+0000","last_change":"2023-03-03T06:25:05.429739+0000","last_active":"2023-03-03T06:25:24.938123+0000","last_peered":"2023-03-03T06:25:24.938123+0000","last_clean":"2023-03-03T06:25:24.938123+0000","last_became_active":"2023-03-03T06:25:04.438903+0000","last_became_peered":"2023-03-03T06:25:04.438903+0000","last_unstale":"2023-03-03T06:25:24.938123+0000","last_undegraded":"2023-03-03T06:25:24.938123+0000","last_fullsized":"2023-03-03T06:25:24.938123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040434999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124132+0000","last_change":"2023-03-03T06:25:24.948431+0000","last_active":"2023-03-03T06:25:26.124132+0000","last_peered":"2023-03-03T06:25:26.124132+0000","last_clean":"2023-03-03T06:25:26.124132+0000","last_became_active":"2023-03-03T06:25:24.948158+0000","last_became_peered":"2023-03-03T06:25:24.948158+0000","last_unstale":"2023-03-03T06:25:26.124132+0000","last_undegraded":"2023-03-03T06:25:26.124132+0000","last_fullsized":"2023-03-03T06:25:26.124132+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:45:13.939205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925499+0000","last_change":"2023-03-03T06:25:24.518385+0000","last_active":"2023-03-03T06:25:25.925499+0000","last_peered":"2023-03-03T06:25:25.925499+0000","last_clean":"2023-03-03T06:25:25.925499+0000","last_became_active":"2023-03-03T06:25:24.518126+0000","last_became_peered":"2023-03-03T06:25:24.518126+0000","last_unstale":"2023-03-03T06:25:25.925499+0000","last_undegraded":"2023-03-03T06:25:25.925499+0000","last_fullsized":"2023-03-03T06:25:25.925499+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:14:53.556029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.937250+0000","last_change":"2023-03-03T06:25:05.430443+0000","last_active":"2023-03-03T06:25:24.937250+0000","last_peered":"2023-03-03T06:25:24.937250+0000","last_clean":"2023-03-03T06:25:24.937250+0000","last_became_active":"2023-03-03T06:25:04.596481+0000","last_became_peered":"2023-03-03T06:25:04.596481+0000","last_unstale":"2023-03-03T06:25:24.937250+0000","last_undegraded":"2023-03-03T06:25:24.937250+0000","last_fullsized":"2023-03-03T06:25:24.937250+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044860800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924556+0000","last_change":"2023-03-03T06:25:24.929805+0000","last_active":"2023-03-03T06:25:25.924556+0000","last_peered":"2023-03-03T06:25:25.924556+0000","last_clean":"2023-03-03T06:25:25.924556+0000","last_became_active":"2023-03-03T06:25:24.929533+0000","last_became_peered":"2023-03-03T06:25:24.929533+0000","last_unstale":"2023-03-03T06:25:25.924556+0000","last_undegraded":"2023-03-03T06:25:25.924556+0000","last_fullsized":"2023-03-03T06:25:25.924556+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:13:59.125389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925540+0000","last_change":"2023-03-03T06:25:24.515807+0000","last_active":"2023-03-03T06:25:25.925540+0000","last_peered":"2023-03-03T06:25:25.925540+0000","last_clean":"2023-03-03T06:25:25.925540+0000","last_became_active":"2023-03-03T06:25:24.515261+0000","last_became_peered":"2023-03-03T06:25:24.515261+0000","last_unstale":"2023-03-03T06:25:25.925540+0000","last_undegraded":"2023-03-03T06:25:25.925540+0000","last_fullsized":"2023-03-03T06:25:25.925540+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:24:03.370366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.922995+0000","last_change":"2023-03-03T06:25:05.431490+0000","last_active":"2023-03-03T06:25:24.922995+0000","last_peered":"2023-03-03T06:25:24.922995+0000","last_clean":"2023-03-03T06:25:24.922995+0000","last_became_active":"2023-03-03T06:25:04.443163+0000","last_became_peered":"2023-03-03T06:25:04.443163+0000","last_unstale":"2023-03-03T06:25:24.922995+0000","last_undegraded":"2023-03-03T06:25:24.922995+0000","last_fullsized":"2023-03-03T06:25:24.922995+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020118839999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126936+0000","last_change":"2023-03-03T06:25:24.942160+0000","last_active":"2023-03-03T06:25:26.126936+0000","last_peered":"2023-03-03T06:25:26.126936+0000","last_clean":"2023-03-03T06:25:26.126936+0000","last_became_active":"2023-03-03T06:25:24.941839+0000","last_became_peered":"2023-03-03T06:25:24.941839+0000","last_unstale":"2023-03-03T06:25:26.126936+0000","last_undegraded":"2023-03-03T06:25:26.126936+0000","last_fullsized":"2023-03-03T06:25:26.126936+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:20:25.249056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124688+0000","last_change":"2023-03-03T06:25:24.522452+0000","last_active":"2023-03-03T06:25:26.124688+0000","last_peered":"2023-03-03T06:25:26.124688+0000","last_clean":"2023-03-03T06:25:26.124688+0000","last_became_active":"2023-03-03T06:25:24.522171+0000","last_became_peered":"2023-03-03T06:25:24.522171+0000","last_unstale":"2023-03-03T06:25:26.124688+0000","last_undegraded":"2023-03-03T06:25:26.124688+0000","last_fullsized":"2023-03-03T06:25:26.124688+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:06:50.660054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.922945+0000","last_change":"2023-03-03T06:25:05.432139+0000","last_active":"2023-03-03T06:25:24.922945+0000","last_peered":"2023-03-03T06:25:24.922945+0000","last_clean":"2023-03-03T06:25:24.922945+0000","last_became_active":"2023-03-03T06:25:04.435759+0000","last_became_peered":"2023-03-03T06:25:04.435759+0000","last_unstale":"2023-03-03T06:25:24.922945+0000","last_undegraded":"2023-03-03T06:25:24.922945+0000","last_fullsized":"2023-03-03T06:25:24.922945+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001646893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124811+0000","last_change":"2023-03-03T06:25:24.933874+0000","last_active":"2023-03-03T06:25:26.124811+0000","last_peered":"2023-03-03T06:25:26.124811+0000","last_clean":"2023-03-03T06:25:26.124811+0000","last_became_active":"2023-03-03T06:25:24.933571+0000","last_became_peered":"2023-03-03T06:25:24.933571+0000","last_unstale":"2023-03-03T06:25:26.124811+0000","last_undegraded":"2023-03-03T06:25:26.124811+0000","last_fullsized":"2023-03-03T06:25:26.124811+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:40:32.930468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124796+0000","last_change":"2023-03-03T06:25:24.514541+0000","last_active":"2023-03-03T06:25:26.124796+0000","last_peered":"2023-03-03T06:25:26.124796+0000","last_clean":"2023-03-03T06:25:26.124796+0000","last_became_active":"2023-03-03T06:25:24.514245+0000","last_became_peered":"2023-03-03T06:25:24.514245+0000","last_unstale":"2023-03-03T06:25:26.124796+0000","last_undegraded":"2023-03-03T06:25:26.124796+0000","last_fullsized":"2023-03-03T06:25:26.124796+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:05:55.927278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.920600+0000","last_change":"2023-03-03T06:25:05.635968+0000","last_active":"2023-03-03T06:25:24.920600+0000","last_peered":"2023-03-03T06:25:24.920600+0000","last_clean":"2023-03-03T06:25:24.920600+0000","last_became_active":"2023-03-03T06:25:04.443619+0000","last_became_peered":"2023-03-03T06:25:04.443619+0000","last_unstale":"2023-03-03T06:25:24.920600+0000","last_undegraded":"2023-03-03T06:25:24.920600+0000","last_fullsized":"2023-03-03T06:25:24.920600+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:51:15.780667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077929799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927785+0000","last_change":"2023-03-03T06:25:24.944547+0000","last_active":"2023-03-03T06:25:25.927785+0000","last_peered":"2023-03-03T06:25:25.927785+0000","last_clean":"2023-03-03T06:25:25.927785+0000","last_became_active":"2023-03-03T06:25:24.944037+0000","last_became_peered":"2023-03-03T06:25:24.944037+0000","last_unstale":"2023-03-03T06:25:25.927785+0000","last_undegraded":"2023-03-03T06:25:25.927785+0000","last_fullsized":"2023-03-03T06:25:25.927785+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:33:03.550930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124900+0000","last_change":"2023-03-03T06:25:24.518651+0000","last_active":"2023-03-03T06:25:26.124900+0000","last_peered":"2023-03-03T06:25:26.124900+0000","last_clean":"2023-03-03T06:25:26.124900+0000","last_became_active":"2023-03-03T06:25:24.518298+0000","last_became_peered":"2023-03-03T06:25:24.518298+0000","last_unstale":"2023-03-03T06:25:26.124900+0000","last_undegraded":"2023-03-03T06:25:26.124900+0000","last_fullsized":"2023-03-03T06:25:26.124900+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:14:53.556029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923097+0000","last_change":"2023-03-03T06:25:05.432320+0000","last_active":"2023-03-03T06:25:24.923097+0000","last_peered":"2023-03-03T06:25:24.923097+0000","last_clean":"2023-03-03T06:25:24.923097+0000","last_became_active":"2023-03-03T06:25:04.436727+0000","last_became_peered":"2023-03-03T06:25:04.436727+0000","last_unstale":"2023-03-03T06:25:24.923097+0000","last_undegraded":"2023-03-03T06:25:24.923097+0000","last_fullsized":"2023-03-03T06:25:24.923097+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014361980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125436+0000","last_change":"2023-03-03T06:25:24.937708+0000","last_active":"2023-03-03T06:25:26.125436+0000","last_peered":"2023-03-03T06:25:26.125436+0000","last_clean":"2023-03-03T06:25:26.125436+0000","last_became_active":"2023-03-03T06:25:24.937408+0000","last_became_peered":"2023-03-03T06:25:24.937408+0000","last_unstale":"2023-03-03T06:25:26.125436+0000","last_undegraded":"2023-03-03T06:25:26.125436+0000","last_fullsized":"2023-03-03T06:25:26.125436+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:19:01.571013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"55'4","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125651+0000","last_change":"2023-03-03T06:25:24.522437+0000","last_active":"2023-03-03T06:25:26.125651+0000","last_peered":"2023-03-03T06:25:26.125651+0000","last_clean":"2023-03-03T06:25:26.125651+0000","last_became_active":"2023-03-03T06:25:24.521605+0000","last_became_peered":"2023-03-03T06:25:24.521605+0000","last_unstale":"2023-03-03T06:25:26.125651+0000","last_undegraded":"2023-03-03T06:25:26.125651+0000","last_fullsized":"2023-03-03T06:25:26.125651+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:44.001614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927064+0000","last_change":"2023-03-03T06:25:05.431681+0000","last_active":"2023-03-03T06:25:24.927064+0000","last_peered":"2023-03-03T06:25:24.927064+0000","last_clean":"2023-03-03T06:25:24.927064+0000","last_became_active":"2023-03-03T06:25:04.443599+0000","last_became_peered":"2023-03-03T06:25:04.443599+0000","last_unstale":"2023-03-03T06:25:24.927064+0000","last_undegraded":"2023-03-03T06:25:24.927064+0000","last_fullsized":"2023-03-03T06:25:24.927064+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001546473,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924739+0000","last_change":"2023-03-03T06:25:24.931161+0000","last_active":"2023-03-03T06:25:25.924739+0000","last_peered":"2023-03-03T06:25:25.924739+0000","last_clean":"2023-03-03T06:25:25.924739+0000","last_became_active":"2023-03-03T06:25:24.930832+0000","last_became_peered":"2023-03-03T06:25:24.930832+0000","last_unstale":"2023-03-03T06:25:25.924739+0000","last_undegraded":"2023-03-03T06:25:25.924739+0000","last_fullsized":"2023-03-03T06:25:25.924739+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:59:03.123359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125021+0000","last_change":"2023-03-03T06:25:24.519515+0000","last_active":"2023-03-03T06:25:26.125021+0000","last_peered":"2023-03-03T06:25:26.125021+0000","last_clean":"2023-03-03T06:25:26.125021+0000","last_became_active":"2023-03-03T06:25:24.519249+0000","last_became_peered":"2023-03-03T06:25:24.519249+0000","last_unstale":"2023-03-03T06:25:26.125021+0000","last_undegraded":"2023-03-03T06:25:26.125021+0000","last_fullsized":"2023-03-03T06:25:26.125021+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:31.902827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.921714+0000","last_change":"2023-03-03T06:25:05.796211+0000","last_active":"2023-03-03T06:25:24.921714+0000","last_peered":"2023-03-03T06:25:24.921714+0000","last_clean":"2023-03-03T06:25:24.921714+0000","last_became_active":"2023-03-03T06:25:04.436647+0000","last_became_peered":"2023-03-03T06:25:04.436647+0000","last_unstale":"2023-03-03T06:25:24.921714+0000","last_undegraded":"2023-03-03T06:25:24.921714+0000","last_fullsized":"2023-03-03T06:25:24.921714+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:07.330548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124395+0000","last_change":"2023-03-03T06:25:24.949538+0000","last_active":"2023-03-03T06:25:26.124395+0000","last_peered":"2023-03-03T06:25:26.124395+0000","last_clean":"2023-03-03T06:25:26.124395+0000","last_became_active":"2023-03-03T06:25:24.949280+0000","last_became_peered":"2023-03-03T06:25:24.949280+0000","last_unstale":"2023-03-03T06:25:26.124395+0000","last_undegraded":"2023-03-03T06:25:26.124395+0000","last_fullsized":"2023-03-03T06:25:26.124395+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:25.006671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925524+0000","last_change":"2023-03-03T06:25:24.520994+0000","last_active":"2023-03-03T06:25:25.925524+0000","last_peered":"2023-03-03T06:25:25.925524+0000","last_clean":"2023-03-03T06:25:25.925524+0000","last_became_active":"2023-03-03T06:25:24.520347+0000","last_became_peered":"2023-03-03T06:25:24.520347+0000","last_unstale":"2023-03-03T06:25:25.925524+0000","last_undegraded":"2023-03-03T06:25:25.925524+0000","last_fullsized":"2023-03-03T06:25:25.925524+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:50:42.331552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927755+0000","last_change":"2023-03-03T06:25:05.431187+0000","last_active":"2023-03-03T06:25:24.927755+0000","last_peered":"2023-03-03T06:25:24.927755+0000","last_clean":"2023-03-03T06:25:24.927755+0000","last_became_active":"2023-03-03T06:25:04.442929+0000","last_became_peered":"2023-03-03T06:25:04.442929+0000","last_unstale":"2023-03-03T06:25:24.927755+0000","last_undegraded":"2023-03-03T06:25:24.927755+0000","last_fullsized":"2023-03-03T06:25:24.927755+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001551871,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927381+0000","last_change":"2023-03-03T06:25:24.942998+0000","last_active":"2023-03-03T06:25:25.927381+0000","last_peered":"2023-03-03T06:25:25.927381+0000","last_clean":"2023-03-03T06:25:25.927381+0000","last_became_active":"2023-03-03T06:25:24.942747+0000","last_became_peered":"2023-03-03T06:25:24.942747+0000","last_unstale":"2023-03-03T06:25:25.927381+0000","last_undegraded":"2023-03-03T06:25:25.927381+0000","last_fullsized":"2023-03-03T06:25:25.927381+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:40:32.930468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925709+0000","last_change":"2023-03-03T06:25:24.520259+0000","last_active":"2023-03-03T06:25:25.925709+0000","last_peered":"2023-03-03T06:25:25.925709+0000","last_clean":"2023-03-03T06:25:25.925709+0000","last_became_active":"2023-03-03T06:25:24.519667+0000","last_became_peered":"2023-03-03T06:25:24.519667+0000","last_unstale":"2023-03-03T06:25:25.925709+0000","last_undegraded":"2023-03-03T06:25:25.925709+0000","last_fullsized":"2023-03-03T06:25:25.925709+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.736521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923559+0000","last_change":"2023-03-03T06:25:05.796890+0000","last_active":"2023-03-03T06:25:24.923559+0000","last_peered":"2023-03-03T06:25:24.923559+0000","last_clean":"2023-03-03T06:25:24.923559+0000","last_became_active":"2023-03-03T06:25:04.437104+0000","last_became_peered":"2023-03-03T06:25:04.437104+0000","last_unstale":"2023-03-03T06:25:24.923559+0000","last_undegraded":"2023-03-03T06:25:24.923559+0000","last_fullsized":"2023-03-03T06:25:24.923559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:10:21.043057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027269099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125195+0000","last_change":"2023-03-03T06:25:24.933349+0000","last_active":"2023-03-03T06:25:26.125195+0000","last_peered":"2023-03-03T06:25:26.125195+0000","last_clean":"2023-03-03T06:25:26.125195+0000","last_became_active":"2023-03-03T06:25:24.933097+0000","last_became_peered":"2023-03-03T06:25:24.933097+0000","last_unstale":"2023-03-03T06:25:26.125195+0000","last_undegraded":"2023-03-03T06:25:26.125195+0000","last_fullsized":"2023-03-03T06:25:26.125195+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:25.006671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126730+0000","last_change":"2023-03-03T06:25:24.523422+0000","last_active":"2023-03-03T06:25:26.126730+0000","last_peered":"2023-03-03T06:25:26.126730+0000","last_clean":"2023-03-03T06:25:26.126730+0000","last_became_active":"2023-03-03T06:25:24.523143+0000","last_became_peered":"2023-03-03T06:25:24.523143+0000","last_unstale":"2023-03-03T06:25:26.126730+0000","last_undegraded":"2023-03-03T06:25:26.126730+0000","last_fullsized":"2023-03-03T06:25:26.126730+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:19:00.566494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.935670+0000","last_change":"2023-03-03T06:25:05.429793+0000","last_active":"2023-03-03T06:25:24.935670+0000","last_peered":"2023-03-03T06:25:24.935670+0000","last_clean":"2023-03-03T06:25:24.935670+0000","last_became_active":"2023-03-03T06:25:04.436400+0000","last_became_peered":"2023-03-03T06:25:04.436400+0000","last_unstale":"2023-03-03T06:25:24.935670+0000","last_undegraded":"2023-03-03T06:25:24.935670+0000","last_fullsized":"2023-03-03T06:25:24.935670+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038039399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125392+0000","last_change":"2023-03-03T06:25:24.938670+0000","last_active":"2023-03-03T06:25:26.125392+0000","last_peered":"2023-03-03T06:25:26.125392+0000","last_clean":"2023-03-03T06:25:26.125392+0000","last_became_active":"2023-03-03T06:25:24.938429+0000","last_became_peered":"2023-03-03T06:25:24.938429+0000","last_unstale":"2023-03-03T06:25:26.125392+0000","last_undegraded":"2023-03-03T06:25:26.125392+0000","last_fullsized":"2023-03-03T06:25:26.125392+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:56.502459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124487+0000","last_change":"2023-03-03T06:25:24.520083+0000","last_active":"2023-03-03T06:25:26.124487+0000","last_peered":"2023-03-03T06:25:26.124487+0000","last_clean":"2023-03-03T06:25:26.124487+0000","last_became_active":"2023-03-03T06:25:24.518282+0000","last_became_peered":"2023-03-03T06:25:24.518282+0000","last_unstale":"2023-03-03T06:25:26.124487+0000","last_undegraded":"2023-03-03T06:25:26.124487+0000","last_fullsized":"2023-03-03T06:25:26.124487+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:07:12.497985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.926146+0000","last_change":"2023-03-03T06:25:05.797098+0000","last_active":"2023-03-03T06:25:24.926146+0000","last_peered":"2023-03-03T06:25:24.926146+0000","last_clean":"2023-03-03T06:25:24.926146+0000","last_became_active":"2023-03-03T06:25:04.446290+0000","last_became_peered":"2023-03-03T06:25:04.446290+0000","last_unstale":"2023-03-03T06:25:24.926146+0000","last_undegraded":"2023-03-03T06:25:24.926146+0000","last_fullsized":"2023-03-03T06:25:24.926146+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:23:37.795335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050239399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125385+0000","last_change":"2023-03-03T06:25:24.934177+0000","last_active":"2023-03-03T06:25:26.125385+0000","last_peered":"2023-03-03T06:25:26.125385+0000","last_clean":"2023-03-03T06:25:26.125385+0000","last_became_active":"2023-03-03T06:25:24.933499+0000","last_became_peered":"2023-03-03T06:25:24.933499+0000","last_unstale":"2023-03-03T06:25:26.125385+0000","last_undegraded":"2023-03-03T06:25:26.125385+0000","last_fullsized":"2023-03-03T06:25:26.125385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:09.237392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124882+0000","last_change":"2023-03-03T06:25:24.509513+0000","last_active":"2023-03-03T06:25:26.124882+0000","last_peered":"2023-03-03T06:25:26.124882+0000","last_clean":"2023-03-03T06:25:26.124882+0000","last_became_active":"2023-03-03T06:25:24.509233+0000","last_became_peered":"2023-03-03T06:25:24.509233+0000","last_unstale":"2023-03-03T06:25:26.124882+0000","last_undegraded":"2023-03-03T06:25:26.124882+0000","last_fullsized":"2023-03-03T06:25:26.124882+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:47:31.672737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.920697+0000","last_change":"2023-03-03T06:25:05.636038+0000","last_active":"2023-03-03T06:25:24.920697+0000","last_peered":"2023-03-03T06:25:24.920697+0000","last_clean":"2023-03-03T06:25:24.920697+0000","last_became_active":"2023-03-03T06:25:04.433771+0000","last_became_peered":"2023-03-03T06:25:04.433771+0000","last_unstale":"2023-03-03T06:25:24.920697+0000","last_undegraded":"2023-03-03T06:25:24.920697+0000","last_fullsized":"2023-03-03T06:25:24.920697+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:33:58.284544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079784699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924611+0000","last_change":"2023-03-03T06:25:24.932033+0000","last_active":"2023-03-03T06:25:25.924611+0000","last_peered":"2023-03-03T06:25:25.924611+0000","last_clean":"2023-03-03T06:25:25.924611+0000","last_became_active":"2023-03-03T06:25:24.931758+0000","last_became_peered":"2023-03-03T06:25:24.931758+0000","last_unstale":"2023-03-03T06:25:25.924611+0000","last_undegraded":"2023-03-03T06:25:25.924611+0000","last_fullsized":"2023-03-03T06:25:25.924611+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:34:19.362959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125460+0000","last_change":"2023-03-03T06:25:24.518833+0000","last_active":"2023-03-03T06:25:26.125460+0000","last_peered":"2023-03-03T06:25:26.125460+0000","last_clean":"2023-03-03T06:25:26.125460+0000","last_became_active":"2023-03-03T06:25:24.518545+0000","last_became_peered":"2023-03-03T06:25:24.518545+0000","last_unstale":"2023-03-03T06:25:26.125460+0000","last_undegraded":"2023-03-03T06:25:26.125460+0000","last_fullsized":"2023-03-03T06:25:26.125460+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:55:47.342952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.922449+0000","last_change":"2023-03-03T06:25:05.797366+0000","last_active":"2023-03-03T06:25:24.922449+0000","last_peered":"2023-03-03T06:25:24.922449+0000","last_clean":"2023-03-03T06:25:24.922449+0000","last_became_active":"2023-03-03T06:25:04.439424+0000","last_became_peered":"2023-03-03T06:25:04.439424+0000","last_unstale":"2023-03-03T06:25:24.922449+0000","last_undegraded":"2023-03-03T06:25:24.922449+0000","last_fullsized":"2023-03-03T06:25:24.922449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:12.599265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020575500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124616+0000","last_change":"2023-03-03T06:25:24.948977+0000","last_active":"2023-03-03T06:25:26.124616+0000","last_peered":"2023-03-03T06:25:26.124616+0000","last_clean":"2023-03-03T06:25:26.124616+0000","last_became_active":"2023-03-03T06:25:24.948669+0000","last_became_peered":"2023-03-03T06:25:24.948669+0000","last_unstale":"2023-03-03T06:25:26.124616+0000","last_undegraded":"2023-03-03T06:25:26.124616+0000","last_fullsized":"2023-03-03T06:25:26.124616+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:36:14.477572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125632+0000","last_change":"2023-03-03T06:25:24.521115+0000","last_active":"2023-03-03T06:25:26.125632+0000","last_peered":"2023-03-03T06:25:26.125632+0000","last_clean":"2023-03-03T06:25:26.125632+0000","last_became_active":"2023-03-03T06:25:24.520862+0000","last_became_peered":"2023-03-03T06:25:24.520862+0000","last_unstale":"2023-03-03T06:25:26.125632+0000","last_undegraded":"2023-03-03T06:25:26.125632+0000","last_fullsized":"2023-03-03T06:25:26.125632+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:02:51.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923773+0000","last_change":"2023-03-03T06:25:05.431441+0000","last_active":"2023-03-03T06:25:24.923773+0000","last_peered":"2023-03-03T06:25:24.923773+0000","last_clean":"2023-03-03T06:25:24.923773+0000","last_became_active":"2023-03-03T06:25:04.443840+0000","last_became_peered":"2023-03-03T06:25:04.443840+0000","last_unstale":"2023-03-03T06:25:24.923773+0000","last_undegraded":"2023-03-03T06:25:24.923773+0000","last_fullsized":"2023-03-03T06:25:24.923773+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017814980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.928103+0000","last_change":"2023-03-03T06:25:24.939685+0000","last_active":"2023-03-03T06:25:25.928103+0000","last_peered":"2023-03-03T06:25:25.928103+0000","last_clean":"2023-03-03T06:25:25.928103+0000","last_became_active":"2023-03-03T06:25:24.939399+0000","last_became_peered":"2023-03-03T06:25:24.939399+0000","last_unstale":"2023-03-03T06:25:25.928103+0000","last_undegraded":"2023-03-03T06:25:25.928103+0000","last_fullsized":"2023-03-03T06:25:25.928103+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:27:14.164819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126951+0000","last_change":"2023-03-03T06:25:24.524776+0000","last_active":"2023-03-03T06:25:26.126951+0000","last_peered":"2023-03-03T06:25:26.126951+0000","last_clean":"2023-03-03T06:25:26.126951+0000","last_became_active":"2023-03-03T06:25:24.524527+0000","last_became_peered":"2023-03-03T06:25:24.524527+0000","last_unstale":"2023-03-03T06:25:26.126951+0000","last_undegraded":"2023-03-03T06:25:26.126951+0000","last_fullsized":"2023-03-03T06:25:26.126951+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:10:05.694425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923603+0000","last_change":"2023-03-03T06:25:05.431854+0000","last_active":"2023-03-03T06:25:24.923603+0000","last_peered":"2023-03-03T06:25:24.923603+0000","last_clean":"2023-03-03T06:25:24.923603+0000","last_became_active":"2023-03-03T06:25:04.438570+0000","last_became_peered":"2023-03-03T06:25:04.438570+0000","last_unstale":"2023-03-03T06:25:24.923603+0000","last_undegraded":"2023-03-03T06:25:24.923603+0000","last_fullsized":"2023-03-03T06:25:24.923603+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.942265+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:25:24.942265+0000","last_peered":"2023-03-03T06:25:24.942265+0000","last_clean":"2023-03-03T06:25:24.942265+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:25:24.942265+0000","last_undegraded":"2023-03-03T06:25:24.942265+0000","last_fullsized":"2023-03-03T06:25:24.942265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125259+0000","last_change":"2023-03-03T06:25:24.935409+0000","last_active":"2023-03-03T06:25:26.125259+0000","last_peered":"2023-03-03T06:25:26.125259+0000","last_clean":"2023-03-03T06:25:26.125259+0000","last_became_active":"2023-03-03T06:25:24.935140+0000","last_became_peered":"2023-03-03T06:25:24.935140+0000","last_unstale":"2023-03-03T06:25:26.125259+0000","last_undegraded":"2023-03-03T06:25:26.125259+0000","last_fullsized":"2023-03-03T06:25:26.125259+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:24:29.758094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925681+0000","last_change":"2023-03-03T06:25:24.516059+0000","last_active":"2023-03-03T06:25:25.925681+0000","last_peered":"2023-03-03T06:25:25.925681+0000","last_clean":"2023-03-03T06:25:25.925681+0000","last_became_active":"2023-03-03T06:25:24.515740+0000","last_became_peered":"2023-03-03T06:25:24.515740+0000","last_unstale":"2023-03-03T06:25:25.925681+0000","last_undegraded":"2023-03-03T06:25:25.925681+0000","last_fullsized":"2023-03-03T06:25:25.925681+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:05:55.927278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.922510+0000","last_change":"2023-03-03T06:25:05.636335+0000","last_active":"2023-03-03T06:25:24.922510+0000","last_peered":"2023-03-03T06:25:24.922510+0000","last_clean":"2023-03-03T06:25:24.922510+0000","last_became_active":"2023-03-03T06:25:04.443299+0000","last_became_peered":"2023-03-03T06:25:04.443299+0000","last_unstale":"2023-03-03T06:25:24.922510+0000","last_undegraded":"2023-03-03T06:25:24.922510+0000","last_fullsized":"2023-03-03T06:25:24.922510+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:13:38.046974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090290399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928347+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:25:24.928347+0000","last_peered":"2023-03-03T06:25:24.928347+0000","last_clean":"2023-03-03T06:25:24.928347+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:25:24.928347+0000","last_undegraded":"2023-03-03T06:25:24.928347+0000","last_fullsized":"2023-03-03T06:25:24.928347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124369+0000","last_change":"2023-03-03T06:25:24.934579+0000","last_active":"2023-03-03T06:25:26.124369+0000","last_peered":"2023-03-03T06:25:26.124369+0000","last_clean":"2023-03-03T06:25:26.124369+0000","last_became_active":"2023-03-03T06:25:24.933988+0000","last_became_peered":"2023-03-03T06:25:24.933988+0000","last_unstale":"2023-03-03T06:25:26.124369+0000","last_undegraded":"2023-03-03T06:25:26.124369+0000","last_fullsized":"2023-03-03T06:25:26.124369+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:49:46.607290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125278+0000","last_change":"2023-03-03T06:25:24.519139+0000","last_active":"2023-03-03T06:25:26.125278+0000","last_peered":"2023-03-03T06:25:26.125278+0000","last_clean":"2023-03-03T06:25:26.125278+0000","last_became_active":"2023-03-03T06:25:24.518849+0000","last_became_peered":"2023-03-03T06:25:24.518849+0000","last_unstale":"2023-03-03T06:25:26.125278+0000","last_undegraded":"2023-03-03T06:25:26.125278+0000","last_fullsized":"2023-03-03T06:25:26.125278+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:08.232873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.924219+0000","last_change":"2023-03-03T06:25:05.796271+0000","last_active":"2023-03-03T06:25:24.924219+0000","last_peered":"2023-03-03T06:25:24.924219+0000","last_clean":"2023-03-03T06:25:24.924219+0000","last_became_active":"2023-03-03T06:25:04.595414+0000","last_became_peered":"2023-03-03T06:25:04.595414+0000","last_unstale":"2023-03-03T06:25:24.924219+0000","last_undegraded":"2023-03-03T06:25:24.924219+0000","last_fullsized":"2023-03-03T06:25:24.924219+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:07:03.140630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027036600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":44,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923632+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:25:24.923632+0000","last_peered":"2023-03-03T06:25:24.923632+0000","last_clean":"2023-03-03T06:25:24.923632+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:25:24.923632+0000","last_undegraded":"2023-03-03T06:25:24.923632+0000","last_fullsized":"2023-03-03T06:25:24.923632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":193,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.924648+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:25:24.924648+0000","last_peered":"2023-03-03T06:25:24.924648+0000","last_clean":"2023-03-03T06:25:24.924648+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:25:24.924648+0000","last_undegraded":"2023-03-03T06:25:24.924648+0000","last_fullsized":"2023-03-03T06:25:24.924648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125189+0000","last_change":"2023-03-03T06:25:24.934898+0000","last_active":"2023-03-03T06:25:26.125189+0000","last_peered":"2023-03-03T06:25:26.125189+0000","last_clean":"2023-03-03T06:25:26.125189+0000","last_became_active":"2023-03-03T06:25:24.934581+0000","last_became_peered":"2023-03-03T06:25:24.934581+0000","last_unstale":"2023-03-03T06:25:26.125189+0000","last_undegraded":"2023-03-03T06:25:26.125189+0000","last_fullsized":"2023-03-03T06:25:26.125189+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:24:04.374885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125788+0000","last_change":"2023-03-03T06:25:24.509731+0000","last_active":"2023-03-03T06:25:26.125788+0000","last_peered":"2023-03-03T06:25:26.125788+0000","last_clean":"2023-03-03T06:25:26.125788+0000","last_became_active":"2023-03-03T06:25:24.509434+0000","last_became_peered":"2023-03-03T06:25:24.509434+0000","last_unstale":"2023-03-03T06:25:26.125788+0000","last_undegraded":"2023-03-03T06:25:26.125788+0000","last_fullsized":"2023-03-03T06:25:26.125788+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:36:29.027339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927888+0000","last_change":"2023-03-03T06:25:05.431373+0000","last_active":"2023-03-03T06:25:24.927888+0000","last_peered":"2023-03-03T06:25:24.927888+0000","last_clean":"2023-03-03T06:25:24.927888+0000","last_became_active":"2023-03-03T06:25:04.445948+0000","last_became_peered":"2023-03-03T06:25:04.445948+0000","last_unstale":"2023-03-03T06:25:24.927888+0000","last_undegraded":"2023-03-03T06:25:24.927888+0000","last_fullsized":"2023-03-03T06:25:24.927888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001717028,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928450+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:25:24.928450+0000","last_peered":"2023-03-03T06:25:24.928450+0000","last_clean":"2023-03-03T06:25:24.928450+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:25:24.928450+0000","last_undegraded":"2023-03-03T06:25:24.928450+0000","last_fullsized":"2023-03-03T06:25:24.928450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126335+0000","last_change":"2023-03-03T06:25:24.937782+0000","last_active":"2023-03-03T06:25:26.126335+0000","last_peered":"2023-03-03T06:25:26.126335+0000","last_clean":"2023-03-03T06:25:26.126335+0000","last_became_active":"2023-03-03T06:25:24.937490+0000","last_became_peered":"2023-03-03T06:25:24.937490+0000","last_unstale":"2023-03-03T06:25:26.126335+0000","last_undegraded":"2023-03-03T06:25:26.126335+0000","last_fullsized":"2023-03-03T06:25:26.126335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:10:10.895165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925276+0000","last_change":"2023-03-03T06:25:24.516424+0000","last_active":"2023-03-03T06:25:25.925276+0000","last_peered":"2023-03-03T06:25:25.925276+0000","last_clean":"2023-03-03T06:25:25.925276+0000","last_became_active":"2023-03-03T06:25:24.515550+0000","last_became_peered":"2023-03-03T06:25:24.515550+0000","last_unstale":"2023-03-03T06:25:25.925276+0000","last_undegraded":"2023-03-03T06:25:25.925276+0000","last_fullsized":"2023-03-03T06:25:25.925276+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:15:54.071849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927206+0000","last_change":"2023-03-03T06:25:05.796597+0000","last_active":"2023-03-03T06:25:24.927206+0000","last_peered":"2023-03-03T06:25:24.927206+0000","last_clean":"2023-03-03T06:25:24.927206+0000","last_became_active":"2023-03-03T06:25:04.442672+0000","last_became_peered":"2023-03-03T06:25:04.442672+0000","last_unstale":"2023-03-03T06:25:24.927206+0000","last_undegraded":"2023-03-03T06:25:24.927206+0000","last_fullsized":"2023-03-03T06:25:24.927206+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.033310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000479903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.925287+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:25:24.925287+0000","last_peered":"2023-03-03T06:25:24.925287+0000","last_clean":"2023-03-03T06:25:24.925287+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:25:24.925287+0000","last_undegraded":"2023-03-03T06:25:24.925287+0000","last_fullsized":"2023-03-03T06:25:24.925287+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126051+0000","last_change":"2023-03-03T06:25:24.932351+0000","last_active":"2023-03-03T06:25:26.126051+0000","last_peered":"2023-03-03T06:25:26.126051+0000","last_clean":"2023-03-03T06:25:26.126051+0000","last_became_active":"2023-03-03T06:25:24.931960+0000","last_became_peered":"2023-03-03T06:25:24.931960+0000","last_unstale":"2023-03-03T06:25:26.126051+0000","last_undegraded":"2023-03-03T06:25:26.126051+0000","last_fullsized":"2023-03-03T06:25:26.126051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:36:20.994518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124642+0000","last_change":"2023-03-03T06:25:24.519327+0000","last_active":"2023-03-03T06:25:26.124642+0000","last_peered":"2023-03-03T06:25:26.124642+0000","last_clean":"2023-03-03T06:25:26.124642+0000","last_became_active":"2023-03-03T06:25:24.518988+0000","last_became_peered":"2023-03-03T06:25:24.518988+0000","last_unstale":"2023-03-03T06:25:26.124642+0000","last_undegraded":"2023-03-03T06:25:26.124642+0000","last_fullsized":"2023-03-03T06:25:26.124642+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.736521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.920647+0000","last_change":"2023-03-03T06:25:05.636259+0000","last_active":"2023-03-03T06:25:24.920647+0000","last_peered":"2023-03-03T06:25:24.920647+0000","last_clean":"2023-03-03T06:25:24.920647+0000","last_became_active":"2023-03-03T06:25:04.438244+0000","last_became_peered":"2023-03-03T06:25:04.438244+0000","last_unstale":"2023-03-03T06:25:24.920647+0000","last_undegraded":"2023-03-03T06:25:24.920647+0000","last_fullsized":"2023-03-03T06:25:24.920647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:36.640289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001044636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.921515+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:25:24.921515+0000","last_peered":"2023-03-03T06:25:24.921515+0000","last_clean":"2023-03-03T06:25:24.921515+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:25:24.921515+0000","last_undegraded":"2023-03-03T06:25:24.921515+0000","last_fullsized":"2023-03-03T06:25:24.921515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125657+0000","last_change":"2023-03-03T06:25:24.948250+0000","last_active":"2023-03-03T06:25:26.125657+0000","last_peered":"2023-03-03T06:25:26.125657+0000","last_clean":"2023-03-03T06:25:26.125657+0000","last_became_active":"2023-03-03T06:25:24.947976+0000","last_became_peered":"2023-03-03T06:25:24.947976+0000","last_unstale":"2023-03-03T06:25:26.125657+0000","last_undegraded":"2023-03-03T06:25:26.125657+0000","last_fullsized":"2023-03-03T06:25:26.125657+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:10:06.698944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126879+0000","last_change":"2023-03-03T06:25:24.524124+0000","last_active":"2023-03-03T06:25:26.126879+0000","last_peered":"2023-03-03T06:25:26.126879+0000","last_clean":"2023-03-03T06:25:26.126879+0000","last_became_active":"2023-03-03T06:25:24.523594+0000","last_became_peered":"2023-03-03T06:25:24.523594+0000","last_unstale":"2023-03-03T06:25:26.126879+0000","last_undegraded":"2023-03-03T06:25:26.126879+0000","last_fullsized":"2023-03-03T06:25:26.126879+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:52:45.369663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928268+0000","last_change":"2023-03-03T06:25:05.432050+0000","last_active":"2023-03-03T06:25:24.928268+0000","last_peered":"2023-03-03T06:25:24.928268+0000","last_clean":"2023-03-03T06:25:24.928268+0000","last_became_active":"2023-03-03T06:25:04.595433+0000","last_became_peered":"2023-03-03T06:25:04.595433+0000","last_unstale":"2023-03-03T06:25:24.928268+0000","last_undegraded":"2023-03-03T06:25:24.928268+0000","last_fullsized":"2023-03-03T06:25:24.928268+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016573409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":42,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927094+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:25:24.927094+0000","last_peered":"2023-03-03T06:25:24.927094+0000","last_clean":"2023-03-03T06:25:24.927094+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:25:24.927094+0000","last_undegraded":"2023-03-03T06:25:24.927094+0000","last_fullsized":"2023-03-03T06:25:24.927094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126454+0000","last_change":"2023-03-03T06:25:24.950252+0000","last_active":"2023-03-03T06:25:26.126454+0000","last_peered":"2023-03-03T06:25:26.126454+0000","last_clean":"2023-03-03T06:25:26.126454+0000","last_became_active":"2023-03-03T06:25:24.949929+0000","last_became_peered":"2023-03-03T06:25:24.949929+0000","last_unstale":"2023-03-03T06:25:26.126454+0000","last_undegraded":"2023-03-03T06:25:26.126454+0000","last_fullsized":"2023-03-03T06:25:26.126454+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:18:23.806132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125532+0000","last_change":"2023-03-03T06:25:24.510986+0000","last_active":"2023-03-03T06:25:26.125532+0000","last_peered":"2023-03-03T06:25:26.125532+0000","last_clean":"2023-03-03T06:25:26.125532+0000","last_became_active":"2023-03-03T06:25:24.510715+0000","last_became_peered":"2023-03-03T06:25:24.510715+0000","last_unstale":"2023-03-03T06:25:26.125532+0000","last_undegraded":"2023-03-03T06:25:26.125532+0000","last_fullsized":"2023-03-03T06:25:26.125532+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:08:59.238203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923851+0000","last_change":"2023-03-03T06:25:05.431790+0000","last_active":"2023-03-03T06:25:24.923851+0000","last_peered":"2023-03-03T06:25:24.923851+0000","last_clean":"2023-03-03T06:25:24.923851+0000","last_became_active":"2023-03-03T06:25:04.595837+0000","last_became_peered":"2023-03-03T06:25:04.595837+0000","last_unstale":"2023-03-03T06:25:24.923851+0000","last_undegraded":"2023-03-03T06:25:24.923851+0000","last_fullsized":"2023-03-03T06:25:24.923851+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:08:49.614056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019659870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":42,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.926531+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:25:24.926531+0000","last_peered":"2023-03-03T06:25:24.926531+0000","last_clean":"2023-03-03T06:25:24.926531+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:25:24.926531+0000","last_undegraded":"2023-03-03T06:25:24.926531+0000","last_fullsized":"2023-03-03T06:25:24.926531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10408,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361432,"statfs":{"total":96636764160,"available":96626106368,"internally_reserved":0,"allocated":1277952,"data_stored":909264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.41199999999999998}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.52900000000000003}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.5}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.60599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9112,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362728,"statfs":{"total":96636764160,"available":96627433472,"internally_reserved":0,"allocated":671744,"data_stored":318170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.746}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.81799999999999995}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.77600000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.622},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.72699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10356,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361484,"statfs":{"total":96636764160,"available":96626159616,"internally_reserved":0,"allocated":1290240,"data_stored":910800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.38},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.34399999999999997}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.495},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.622}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9296,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362544,"statfs":{"total":96636764160,"available":96627245056,"internally_reserved":0,"allocated":663552,"data_stored":317175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.375}]},{"osd":3,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.64200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9044,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362796,"statfs":{"total":96636764160,"available":96627503104,"internally_reserved":0,"allocated":667648,"data_stored":318136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.311},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.28199999999999997}]},{"osd":1,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":7.4820000000000002,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.34300000000000003}]},{"osd":3,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.35799999999999998}]},{"osd":4,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.76700000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.748}]},{"osd":7,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.71399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362540,"statfs":{"total":96636764160,"available":96627240960,"internally_reserved":0,"allocated":667648,"data_stored":318136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.38},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.41999999999999998}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.308},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.91300000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.84899999999999998}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.97499999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.92800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9440,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362400,"statfs":{"total":96636764160,"available":96627097600,"internally_reserved":0,"allocated":679936,"data_stored":319684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.68200000000000005}]},{"osd":1,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.627},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.64500000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70999999999999996}]},{"osd":3,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.433},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47499999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.52000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9172,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362668,"statfs":{"total":96636764160,"available":96627372032,"internally_reserved":0,"allocated":667648,"data_stored":317197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.499}]},{"osd":3,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55000000000000004}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.46000000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.44900000000000001}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.43099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:25:33.668 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:25:33.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.805+0000 7f38c19a5700 1 Processor -- start 2023-03-03T06:25:33.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.806+0000 7f38c19a5700 1 -- start start 2023-03-03T06:25:33.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.806+0000 7f38c19a5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38bc0b8a40 0x7f38bc160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:33.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.806+0000 7f38c19a5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38bc0cf2a0 0x7f38bc06c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:33.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.806+0000 7f38c19a5700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38bc0d2e10 con 0x7f38bc06c660 2023-03-03T06:25:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.806+0000 7f38c19a5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38bc06cae0 con 0x7f38bc0b8a40 2023-03-03T06:25:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.806+0000 7f38c19a5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc161490 con 0x7f38bc0cf2a0 2023-03-03T06:25:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.807+0000 7f38baffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38bc0b8a40 0x7f38bc160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.807+0000 7f38baffd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f38bc0b8a40 0x7f38bc160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44634/0 (socket says 172.21.15.5:44634) 2023-03-03T06:25:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.807+0000 7f38baffd700 1 -- 172.21.15.5:0/2202427165 learned_addr learned my addr 172.21.15.5:0/2202427165 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.807+0000 7f38ba7fc700 1 --2- 172.21.15.5:0/2202427165 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38bc0cf2a0 0x7f38bc06c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:33.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.807+0000 7f38baffd700 1 -- 172.21.15.5:0/2202427165 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38bc0cf2a0 msgr2=0x7f38bc06c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.807+0000 7f38baffd700 1 --2- 172.21.15.5:0/2202427165 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38bc0cf2a0 0x7f38bc06c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.807+0000 7f38baffd700 1 -- 172.21.15.5:0/2202427165 >> v1:172.21.15.191:6789/0 conn(0x7f38bc06c660 legacy=0x7f38bc06a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.807+0000 7f38baffd700 1 -- 172.21.15.5:0/2202427165 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc0cd8d0 con 0x7f38bc0b8a40 2023-03-03T06:25:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.807+0000 7f38baffd700 1 --2- 172.21.15.5:0/2202427165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0b8a40 0x7f38bc160f50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0098f0 tx=0x7f38ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6517477da25192b7 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.807+0000 7f38b9ffb700 1 -- 172.21.15.5:0/2202427165 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac011830 con 0x7f38bc0b8a40 2023-03-03T06:25:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.807+0000 7f38b9ffb700 1 -- 172.21.15.5:0/2202427165 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac011990 con 0x7f38bc0b8a40 2023-03-03T06:25:33.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.807+0000 7f38b9ffb700 1 -- 172.21.15.5:0/2202427165 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac011d20 con 0x7f38bc0b8a40 2023-03-03T06:25:33.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.808+0000 7f38c19a5700 1 -- 172.21.15.5:0/2202427165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0b8a40 msgr2=0x7f38bc160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:33.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.808+0000 7f38c19a5700 1 --2- 172.21.15.5:0/2202427165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0b8a40 0x7f38bc160f50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0098f0 tx=0x7f38ac009c00 comp rx=0 tx=0).stop 2023-03-03T06:25:33.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.808+0000 7f38c19a5700 1 -- 172.21.15.5:0/2202427165 shutdown_connections 2023-03-03T06:25:33.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.808+0000 7f38c19a5700 1 --2- 172.21.15.5:0/2202427165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0b8a40 0x7f38bc160f50 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:33.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.808+0000 7f38c19a5700 1 --2- 172.21.15.5:0/2202427165 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38bc0cf2a0 0x7f38bc06c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:33.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.808+0000 7f38c19a5700 1 -- 172.21.15.5:0/2202427165 >> 172.21.15.5:0/2202427165 conn(0x7f38bc0d05d0 msgr2=0x7f38bc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:33.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.808+0000 7f38c19a5700 1 -- 172.21.15.5:0/2202427165 shutdown_connections 2023-03-03T06:25:33.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.808+0000 7f38c19a5700 1 -- 172.21.15.5:0/2202427165 wait complete. 2023-03-03T06:25:33.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.809+0000 7f38c19a5700 1 Processor -- start 2023-03-03T06:25:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.809+0000 7f38c19a5700 1 -- start start 2023-03-03T06:25:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.810+0000 7f38c19a5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38bc06c660 0x7f38bc0b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.810+0000 7f38c19a5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38bc0b8a40 0x7f38bc159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.810+0000 7f38c19a5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0cf2a0 0x7f38bc1e8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.810+0000 7f38c19a5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc0ca120 con 0x7f38bc0cf2a0 2023-03-03T06:25:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.810+0000 7f38c19a5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc15d620 con 0x7f38bc0b8a40 2023-03-03T06:25:33.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.810+0000 7f38c19a5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc15d060 con 0x7f38bc06c660 2023-03-03T06:25:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.810+0000 7f38bb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0cf2a0 0x7f38bc1e8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.810+0000 7f38bb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0cf2a0 0x7f38bc1e8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44644/0 (socket says 172.21.15.5:44644) 2023-03-03T06:25:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.810+0000 7f38bb7fe700 1 -- 172.21.15.5:0/2647914602 learned_addr learned my addr 172.21.15.5:0/2647914602 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.810+0000 7f38ba7fc700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38bc0b8a40 0x7f38bc159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.810+0000 7f38baffd700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38bc06c660 0x7f38bc0b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.811+0000 7f38bb7fe700 1 -- 172.21.15.5:0/2647914602 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38bc06c660 msgr2=0x7f38bc0b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.811+0000 7f38bb7fe700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38bc06c660 0x7f38bc0b7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:33.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.811+0000 7f38bb7fe700 1 -- 172.21.15.5:0/2647914602 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38bc0b8a40 msgr2=0x7f38bc159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:33.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.811+0000 7f38bb7fe700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38bc0b8a40 0x7f38bc159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:33.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.811+0000 7f38bb7fe700 1 -- 172.21.15.5:0/2647914602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac009550 con 0x7f38bc0cf2a0 2023-03-03T06:25:33.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.811+0000 7f38bb7fe700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0cf2a0 0x7f38bc1e8350 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f38b400cc50 tx=0x7f38b400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:33.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.811+0000 7f38b3fff700 1 -- 172.21.15.5:0/2647914602 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4003c00 con 0x7f38bc0cf2a0 2023-03-03T06:25:33.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.811+0000 7f38b3fff700 1 -- 172.21.15.5:0/2647914602 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b4003d60 con 0x7f38bc0cf2a0 2023-03-03T06:25:33.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.811+0000 7f38c19a5700 1 -- 172.21.15.5:0/2647914602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc15ce30 con 0x7f38bc0cf2a0 2023-03-03T06:25:33.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.811+0000 7f38b3fff700 1 -- 172.21.15.5:0/2647914602 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b400aab0 con 0x7f38bc0cf2a0 2023-03-03T06:25:33.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.811+0000 7f38c19a5700 1 -- 172.21.15.5:0/2647914602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38bc0d2520 con 0x7f38bc0cf2a0 2023-03-03T06:25:33.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.812+0000 7f38c19a5700 1 -- 172.21.15.5:0/2647914602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38bc0d2850 con 0x7f38bc0cf2a0 2023-03-03T06:25:33.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.812+0000 7f38b3fff700 1 -- 172.21.15.5:0/2647914602 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f38b4010050 con 0x7f38bc0cf2a0 2023-03-03T06:25:33.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.813+0000 7f38b3fff700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f389c0682f0 0x7f389c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:33.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.813+0000 7f38b3fff700 1 -- 172.21.15.5:0/2647914602 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f38b4085c00 con 0x7f38bc0cf2a0 2023-03-03T06:25:33.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.813+0000 7f38baffd700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f389c0682f0 0x7f389c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:33.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.813+0000 7f38baffd700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f389c0682f0 0x7f389c06a7a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009c40 tx=0x7f38ac008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:33.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:33.818+0000 7f38b3fff700 1 -- 172.21.15.5:0/2647914602 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f38b408b020 con 0x7f38bc0cf2a0 2023-03-03T06:25:34.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.007+0000 7f38c19a5700 1 -- 172.21.15.5:0/2647914602 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38bc0d2e10 con 0x7f389c0682f0 2023-03-03T06:25:34.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.017+0000 7f38b3fff700 1 -- 172.21.15.5:0/2647914602 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392228 (secure 0 0 0) 0x7f38bc0d2e10 con 0x7f389c0682f0 2023-03-03T06:25:34.022 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:34.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.021+0000 7f38c19a5700 1 -- 172.21.15.5:0/2647914602 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f389c0682f0 msgr2=0x7f389c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.021+0000 7f38c19a5700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f389c0682f0 0x7f389c06a7a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009c40 tx=0x7f38ac008030 comp rx=0 tx=0).stop 2023-03-03T06:25:34.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.021+0000 7f38c19a5700 1 -- 172.21.15.5:0/2647914602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0cf2a0 msgr2=0x7f38bc1e8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.021+0000 7f38c19a5700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0cf2a0 0x7f38bc1e8350 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f38b400cc50 tx=0x7f38b400cf60 comp rx=0 tx=0).stop 2023-03-03T06:25:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.021+0000 7f38c19a5700 1 -- 172.21.15.5:0/2647914602 shutdown_connections 2023-03-03T06:25:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.021+0000 7f38c19a5700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38bc0cf2a0 0x7f38bc1e8350 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.021+0000 7f38c19a5700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f389c0682f0 0x7f389c06a7a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.021+0000 7f38c19a5700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38bc06c660 0x7f38bc0b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.021+0000 7f38c19a5700 1 --2- 172.21.15.5:0/2647914602 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38bc0b8a40 0x7f38bc159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.021+0000 7f38c19a5700 1 -- 172.21.15.5:0/2647914602 >> 172.21.15.5:0/2647914602 conn(0x7f38bc0d05d0 msgr2=0x7f38bc0b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:34.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.021+0000 7f38c19a5700 1 -- 172.21.15.5:0/2647914602 shutdown_connections 2023-03-03T06:25:34.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.021+0000 7f38c19a5700 1 -- 172.21.15.5:0/2647914602 wait complete. 2023-03-03T06:25:34.026 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:25:34.034 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-03-03T06:25:33.485143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":76192,"kb_used_data":6432,"kb_used_omap":0,"kb_used_meta":69696,"kb_avail":754898528,"statfs":{"total":773094113280,"available":773016092672,"internally_reserved":0,"allocated":6586368,"data_stored":3728562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71368704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.567202"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125720+0000","last_change":"2023-03-03T06:25:24.935569+0000","last_active":"2023-03-03T06:25:26.125720+0000","last_peered":"2023-03-03T06:25:26.125720+0000","last_clean":"2023-03-03T06:25:26.125720+0000","last_became_active":"2023-03-03T06:25:24.935292+0000","last_became_peered":"2023-03-03T06:25:24.935292+0000","last_unstale":"2023-03-03T06:25:26.125720+0000","last_undegraded":"2023-03-03T06:25:26.125720+0000","last_fullsized":"2023-03-03T06:25:26.125720+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:38:56.804003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125539+0000","last_change":"2023-03-03T06:25:24.933504+0000","last_active":"2023-03-03T06:25:26.125539+0000","last_peered":"2023-03-03T06:25:26.125539+0000","last_clean":"2023-03-03T06:25:26.125539+0000","last_became_active":"2023-03-03T06:25:24.933222+0000","last_became_peered":"2023-03-03T06:25:24.933222+0000","last_unstale":"2023-03-03T06:25:26.125539+0000","last_undegraded":"2023-03-03T06:25:26.125539+0000","last_fullsized":"2023-03-03T06:25:26.125539+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:58:45.529684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126513+0000","last_change":"2023-03-03T06:25:24.941017+0000","last_active":"2023-03-03T06:25:26.126513+0000","last_peered":"2023-03-03T06:25:26.126513+0000","last_clean":"2023-03-03T06:25:26.126513+0000","last_became_active":"2023-03-03T06:25:24.939949+0000","last_became_peered":"2023-03-03T06:25:24.939949+0000","last_unstale":"2023-03-03T06:25:26.126513+0000","last_undegraded":"2023-03-03T06:25:26.126513+0000","last_fullsized":"2023-03-03T06:25:26.126513+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:00.665647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927669+0000","last_change":"2023-03-03T06:25:24.951803+0000","last_active":"2023-03-03T06:25:25.927669+0000","last_peered":"2023-03-03T06:25:25.927669+0000","last_clean":"2023-03-03T06:25:25.927669+0000","last_became_active":"2023-03-03T06:25:24.948614+0000","last_became_peered":"2023-03-03T06:25:24.948614+0000","last_unstale":"2023-03-03T06:25:25.927669+0000","last_undegraded":"2023-03-03T06:25:25.927669+0000","last_fullsized":"2023-03-03T06:25:25.927669+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:16:25.029237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126611+0000","last_change":"2023-03-03T06:25:24.951103+0000","last_active":"2023-03-03T06:25:26.126611+0000","last_peered":"2023-03-03T06:25:26.126611+0000","last_clean":"2023-03-03T06:25:26.126611+0000","last_became_active":"2023-03-03T06:25:24.950824+0000","last_became_peered":"2023-03-03T06:25:24.950824+0000","last_unstale":"2023-03-03T06:25:26.126611+0000","last_undegraded":"2023-03-03T06:25:26.126611+0000","last_fullsized":"2023-03-03T06:25:26.126611+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:58:45.529684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124683+0000","last_change":"2023-03-03T06:25:24.940552+0000","last_active":"2023-03-03T06:25:26.124683+0000","last_peered":"2023-03-03T06:25:26.124683+0000","last_clean":"2023-03-03T06:25:26.124683+0000","last_became_active":"2023-03-03T06:25:24.940261+0000","last_became_peered":"2023-03-03T06:25:24.940261+0000","last_unstale":"2023-03-03T06:25:26.124683+0000","last_undegraded":"2023-03-03T06:25:26.124683+0000","last_fullsized":"2023-03-03T06:25:26.124683+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:10:56.787049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924705+0000","last_change":"2023-03-03T06:25:24.941231+0000","last_active":"2023-03-03T06:25:25.924705+0000","last_peered":"2023-03-03T06:25:25.924705+0000","last_clean":"2023-03-03T06:25:25.924705+0000","last_became_active":"2023-03-03T06:25:24.940898+0000","last_became_peered":"2023-03-03T06:25:24.940898+0000","last_unstale":"2023-03-03T06:25:25.924705+0000","last_undegraded":"2023-03-03T06:25:25.924705+0000","last_fullsized":"2023-03-03T06:25:25.924705+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:56.288223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124707+0000","last_change":"2023-03-03T06:25:24.941288+0000","last_active":"2023-03-03T06:25:26.124707+0000","last_peered":"2023-03-03T06:25:26.124707+0000","last_clean":"2023-03-03T06:25:26.124707+0000","last_became_active":"2023-03-03T06:25:24.940747+0000","last_became_peered":"2023-03-03T06:25:24.940747+0000","last_unstale":"2023-03-03T06:25:26.124707+0000","last_undegraded":"2023-03-03T06:25:26.124707+0000","last_fullsized":"2023-03-03T06:25:26.124707+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:05.741040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126840+0000","last_change":"2023-03-03T06:25:24.950479+0000","last_active":"2023-03-03T06:25:26.126840+0000","last_peered":"2023-03-03T06:25:26.126840+0000","last_clean":"2023-03-03T06:25:26.126840+0000","last_became_active":"2023-03-03T06:25:24.950185+0000","last_became_peered":"2023-03-03T06:25:24.950185+0000","last_unstale":"2023-03-03T06:25:26.126840+0000","last_undegraded":"2023-03-03T06:25:26.126840+0000","last_fullsized":"2023-03-03T06:25:26.126840+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:29:57.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126768+0000","last_change":"2023-03-03T06:25:24.942656+0000","last_active":"2023-03-03T06:25:26.126768+0000","last_peered":"2023-03-03T06:25:26.126768+0000","last_clean":"2023-03-03T06:25:26.126768+0000","last_became_active":"2023-03-03T06:25:24.942401+0000","last_became_peered":"2023-03-03T06:25:24.942401+0000","last_unstale":"2023-03-03T06:25:26.126768+0000","last_undegraded":"2023-03-03T06:25:26.126768+0000","last_fullsized":"2023-03-03T06:25:26.126768+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:50:10.945053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927752+0000","last_change":"2023-03-03T06:25:24.944377+0000","last_active":"2023-03-03T06:25:25.927752+0000","last_peered":"2023-03-03T06:25:25.927752+0000","last_clean":"2023-03-03T06:25:25.927752+0000","last_became_active":"2023-03-03T06:25:24.943646+0000","last_became_peered":"2023-03-03T06:25:24.943646+0000","last_unstale":"2023-03-03T06:25:25.927752+0000","last_undegraded":"2023-03-03T06:25:25.927752+0000","last_fullsized":"2023-03-03T06:25:25.927752+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:36:14.477572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124995+0000","last_change":"2023-03-03T06:25:24.946217+0000","last_active":"2023-03-03T06:25:26.124995+0000","last_peered":"2023-03-03T06:25:26.124995+0000","last_clean":"2023-03-03T06:25:26.124995+0000","last_became_active":"2023-03-03T06:25:24.945915+0000","last_became_peered":"2023-03-03T06:25:24.945915+0000","last_unstale":"2023-03-03T06:25:26.124995+0000","last_undegraded":"2023-03-03T06:25:26.124995+0000","last_fullsized":"2023-03-03T06:25:26.124995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:14:54.560548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124820+0000","last_change":"2023-03-03T06:25:24.941338+0000","last_active":"2023-03-03T06:25:26.124820+0000","last_peered":"2023-03-03T06:25:26.124820+0000","last_clean":"2023-03-03T06:25:26.124820+0000","last_became_active":"2023-03-03T06:25:24.940975+0000","last_became_peered":"2023-03-03T06:25:24.940975+0000","last_unstale":"2023-03-03T06:25:26.124820+0000","last_undegraded":"2023-03-03T06:25:26.124820+0000","last_fullsized":"2023-03-03T06:25:26.124820+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:05:56.931797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126380+0000","last_change":"2023-03-03T06:25:24.941629+0000","last_active":"2023-03-03T06:25:26.126380+0000","last_peered":"2023-03-03T06:25:26.126380+0000","last_clean":"2023-03-03T06:25:26.126380+0000","last_became_active":"2023-03-03T06:25:24.941356+0000","last_became_peered":"2023-03-03T06:25:24.941356+0000","last_unstale":"2023-03-03T06:25:26.126380+0000","last_undegraded":"2023-03-03T06:25:26.126380+0000","last_fullsized":"2023-03-03T06:25:26.126380+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:28:45.764299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126326+0000","last_change":"2023-03-03T06:25:24.940067+0000","last_active":"2023-03-03T06:25:26.126326+0000","last_peered":"2023-03-03T06:25:26.126326+0000","last_clean":"2023-03-03T06:25:26.126326+0000","last_became_active":"2023-03-03T06:25:24.939655+0000","last_became_peered":"2023-03-03T06:25:24.939655+0000","last_unstale":"2023-03-03T06:25:26.126326+0000","last_undegraded":"2023-03-03T06:25:26.126326+0000","last_fullsized":"2023-03-03T06:25:26.126326+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:00:12.817746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924450+0000","last_change":"2023-03-03T06:25:24.934523+0000","last_active":"2023-03-03T06:25:25.924450+0000","last_peered":"2023-03-03T06:25:25.924450+0000","last_clean":"2023-03-03T06:25:25.924450+0000","last_became_active":"2023-03-03T06:25:24.934274+0000","last_became_peered":"2023-03-03T06:25:24.934274+0000","last_unstale":"2023-03-03T06:25:25.924450+0000","last_undegraded":"2023-03-03T06:25:25.924450+0000","last_fullsized":"2023-03-03T06:25:25.924450+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:01:02.628122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125658+0000","last_change":"2023-03-03T06:25:24.949752+0000","last_active":"2023-03-03T06:25:26.125658+0000","last_peered":"2023-03-03T06:25:26.125658+0000","last_clean":"2023-03-03T06:25:26.125658+0000","last_became_active":"2023-03-03T06:25:24.949316+0000","last_became_peered":"2023-03-03T06:25:24.949316+0000","last_unstale":"2023-03-03T06:25:26.125658+0000","last_undegraded":"2023-03-03T06:25:26.125658+0000","last_fullsized":"2023-03-03T06:25:26.125658+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:19:01.571013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.928051+0000","last_change":"2023-03-03T06:25:24.951882+0000","last_active":"2023-03-03T06:25:25.928051+0000","last_peered":"2023-03-03T06:25:25.928051+0000","last_clean":"2023-03-03T06:25:25.928051+0000","last_became_active":"2023-03-03T06:25:24.948457+0000","last_became_peered":"2023-03-03T06:25:24.948457+0000","last_unstale":"2023-03-03T06:25:25.928051+0000","last_undegraded":"2023-03-03T06:25:25.928051+0000","last_fullsized":"2023-03-03T06:25:25.928051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:25:46.667651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125581+0000","last_change":"2023-03-03T06:25:24.936053+0000","last_active":"2023-03-03T06:25:26.125581+0000","last_peered":"2023-03-03T06:25:26.125581+0000","last_clean":"2023-03-03T06:25:26.125581+0000","last_became_active":"2023-03-03T06:25:24.935821+0000","last_became_peered":"2023-03-03T06:25:24.935821+0000","last_unstale":"2023-03-03T06:25:26.125581+0000","last_undegraded":"2023-03-03T06:25:26.125581+0000","last_fullsized":"2023-03-03T06:25:26.125581+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:38:56.804003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925560+0000","last_change":"2023-03-03T06:25:24.939080+0000","last_active":"2023-03-03T06:25:25.925560+0000","last_peered":"2023-03-03T06:25:25.925560+0000","last_clean":"2023-03-03T06:25:25.925560+0000","last_became_active":"2023-03-03T06:25:24.938676+0000","last_became_peered":"2023-03-03T06:25:24.938676+0000","last_unstale":"2023-03-03T06:25:25.925560+0000","last_undegraded":"2023-03-03T06:25:25.925560+0000","last_fullsized":"2023-03-03T06:25:25.925560+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:49:46.607290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124946+0000","last_change":"2023-03-03T06:25:24.928487+0000","last_active":"2023-03-03T06:25:26.124946+0000","last_peered":"2023-03-03T06:25:26.124946+0000","last_clean":"2023-03-03T06:25:26.124946+0000","last_became_active":"2023-03-03T06:25:24.928191+0000","last_became_peered":"2023-03-03T06:25:24.928191+0000","last_unstale":"2023-03-03T06:25:26.124946+0000","last_undegraded":"2023-03-03T06:25:26.124946+0000","last_fullsized":"2023-03-03T06:25:26.124946+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:47:32.677256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925618+0000","last_change":"2023-03-03T06:25:24.942231+0000","last_active":"2023-03-03T06:25:25.925618+0000","last_peered":"2023-03-03T06:25:25.925618+0000","last_clean":"2023-03-03T06:25:25.925618+0000","last_became_active":"2023-03-03T06:25:24.941956+0000","last_became_peered":"2023-03-03T06:25:24.941956+0000","last_unstale":"2023-03-03T06:25:25.925618+0000","last_undegraded":"2023-03-03T06:25:25.925618+0000","last_fullsized":"2023-03-03T06:25:25.925618+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:25:46.667651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925445+0000","last_change":"2023-03-03T06:25:24.941614+0000","last_active":"2023-03-03T06:25:25.925445+0000","last_peered":"2023-03-03T06:25:25.925445+0000","last_clean":"2023-03-03T06:25:25.925445+0000","last_became_active":"2023-03-03T06:25:24.941347+0000","last_became_peered":"2023-03-03T06:25:24.941347+0000","last_unstale":"2023-03-03T06:25:25.925445+0000","last_undegraded":"2023-03-03T06:25:25.925445+0000","last_fullsized":"2023-03-03T06:25:25.925445+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:10:56.787049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126077+0000","last_change":"2023-03-03T06:25:24.940730+0000","last_active":"2023-03-03T06:25:26.126077+0000","last_peered":"2023-03-03T06:25:26.126077+0000","last_clean":"2023-03-03T06:25:26.126077+0000","last_became_active":"2023-03-03T06:25:24.940415+0000","last_became_peered":"2023-03-03T06:25:24.940415+0000","last_unstale":"2023-03-03T06:25:26.126077+0000","last_undegraded":"2023-03-03T06:25:26.126077+0000","last_fullsized":"2023-03-03T06:25:26.126077+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:37:30.630979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125435+0000","last_change":"2023-03-03T06:25:24.934953+0000","last_active":"2023-03-03T06:25:26.125435+0000","last_peered":"2023-03-03T06:25:26.125435+0000","last_clean":"2023-03-03T06:25:26.125435+0000","last_became_active":"2023-03-03T06:25:24.934638+0000","last_became_peered":"2023-03-03T06:25:24.934638+0000","last_unstale":"2023-03-03T06:25:26.125435+0000","last_undegraded":"2023-03-03T06:25:26.125435+0000","last_fullsized":"2023-03-03T06:25:26.125435+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:47.949094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125275+0000","last_change":"2023-03-03T06:25:24.934344+0000","last_active":"2023-03-03T06:25:26.125275+0000","last_peered":"2023-03-03T06:25:26.125275+0000","last_clean":"2023-03-03T06:25:26.125275+0000","last_became_active":"2023-03-03T06:25:24.933879+0000","last_became_peered":"2023-03-03T06:25:24.933879+0000","last_unstale":"2023-03-03T06:25:26.125275+0000","last_undegraded":"2023-03-03T06:25:26.125275+0000","last_fullsized":"2023-03-03T06:25:26.125275+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:15:55.076368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927873+0000","last_change":"2023-03-03T06:25:24.950493+0000","last_active":"2023-03-03T06:25:25.927873+0000","last_peered":"2023-03-03T06:25:25.927873+0000","last_clean":"2023-03-03T06:25:25.927873+0000","last_became_active":"2023-03-03T06:25:24.948493+0000","last_became_peered":"2023-03-03T06:25:24.948493+0000","last_unstale":"2023-03-03T06:25:25.927873+0000","last_undegraded":"2023-03-03T06:25:25.927873+0000","last_fullsized":"2023-03-03T06:25:25.927873+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:10:56.787049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124425+0000","last_change":"2023-03-03T06:25:24.934079+0000","last_active":"2023-03-03T06:25:26.124425+0000","last_peered":"2023-03-03T06:25:26.124425+0000","last_clean":"2023-03-03T06:25:26.124425+0000","last_became_active":"2023-03-03T06:25:24.933811+0000","last_became_peered":"2023-03-03T06:25:24.933811+0000","last_unstale":"2023-03-03T06:25:26.124425+0000","last_undegraded":"2023-03-03T06:25:26.124425+0000","last_fullsized":"2023-03-03T06:25:26.124425+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:34:23.666936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126633+0000","last_change":"2023-03-03T06:25:24.950185+0000","last_active":"2023-03-03T06:25:26.126633+0000","last_peered":"2023-03-03T06:25:26.126633+0000","last_clean":"2023-03-03T06:25:26.126633+0000","last_became_active":"2023-03-03T06:25:24.949907+0000","last_became_peered":"2023-03-03T06:25:24.949907+0000","last_unstale":"2023-03-03T06:25:26.126633+0000","last_undegraded":"2023-03-03T06:25:26.126633+0000","last_fullsized":"2023-03-03T06:25:26.126633+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:21:16.832581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125666+0000","last_change":"2023-03-03T06:25:24.942003+0000","last_active":"2023-03-03T06:25:26.125666+0000","last_peered":"2023-03-03T06:25:26.125666+0000","last_clean":"2023-03-03T06:25:26.125666+0000","last_became_active":"2023-03-03T06:25:24.941743+0000","last_became_peered":"2023-03-03T06:25:24.941743+0000","last_unstale":"2023-03-03T06:25:26.125666+0000","last_undegraded":"2023-03-03T06:25:26.125666+0000","last_fullsized":"2023-03-03T06:25:26.125666+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:50:43.336071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927347+0000","last_change":"2023-03-03T06:25:24.953502+0000","last_active":"2023-03-03T06:25:25.927347+0000","last_peered":"2023-03-03T06:25:25.927347+0000","last_clean":"2023-03-03T06:25:25.927347+0000","last_became_active":"2023-03-03T06:25:24.953247+0000","last_became_peered":"2023-03-03T06:25:24.953247+0000","last_unstale":"2023-03-03T06:25:25.927347+0000","last_undegraded":"2023-03-03T06:25:25.927347+0000","last_fullsized":"2023-03-03T06:25:25.927347+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:19:50.229403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124277+0000","last_change":"2023-03-03T06:25:24.934820+0000","last_active":"2023-03-03T06:25:26.124277+0000","last_peered":"2023-03-03T06:25:26.124277+0000","last_clean":"2023-03-03T06:25:26.124277+0000","last_became_active":"2023-03-03T06:25:24.934333+0000","last_became_peered":"2023-03-03T06:25:24.934333+0000","last_unstale":"2023-03-03T06:25:26.124277+0000","last_undegraded":"2023-03-03T06:25:26.124277+0000","last_fullsized":"2023-03-03T06:25:26.124277+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:19:50.229403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124949+0000","last_change":"2023-03-03T06:25:24.944796+0000","last_active":"2023-03-03T06:25:26.124949+0000","last_peered":"2023-03-03T06:25:26.124949+0000","last_clean":"2023-03-03T06:25:26.124949+0000","last_became_active":"2023-03-03T06:25:24.944619+0000","last_became_peered":"2023-03-03T06:25:24.944619+0000","last_unstale":"2023-03-03T06:25:26.124949+0000","last_undegraded":"2023-03-03T06:25:26.124949+0000","last_fullsized":"2023-03-03T06:25:26.124949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:42:07.547230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"55'8","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927223+0000","last_change":"2023-03-03T06:25:24.518747+0000","last_active":"2023-03-03T06:25:25.927223+0000","last_peered":"2023-03-03T06:25:25.927223+0000","last_clean":"2023-03-03T06:25:25.927223+0000","last_became_active":"2023-03-03T06:25:24.518462+0000","last_became_peered":"2023-03-03T06:25:24.518462+0000","last_unstale":"2023-03-03T06:25:25.927223+0000","last_undegraded":"2023-03-03T06:25:25.927223+0000","last_fullsized":"2023-03-03T06:25:25.927223+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:29:56.144718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.921255+0000","last_change":"2023-03-03T06:25:05.635776+0000","last_active":"2023-03-03T06:25:24.921255+0000","last_peered":"2023-03-03T06:25:24.921255+0000","last_clean":"2023-03-03T06:25:24.921255+0000","last_became_active":"2023-03-03T06:25:04.444243+0000","last_became_peered":"2023-03-03T06:25:04.444243+0000","last_unstale":"2023-03-03T06:25:24.921255+0000","last_undegraded":"2023-03-03T06:25:24.921255+0000","last_fullsized":"2023-03-03T06:25:24.921255+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:00:41.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066956899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125958+0000","last_change":"2023-03-03T06:25:24.945196+0000","last_active":"2023-03-03T06:25:26.125958+0000","last_peered":"2023-03-03T06:25:26.125958+0000","last_clean":"2023-03-03T06:25:26.125958+0000","last_became_active":"2023-03-03T06:25:24.937674+0000","last_became_peered":"2023-03-03T06:25:24.937674+0000","last_unstale":"2023-03-03T06:25:26.125958+0000","last_undegraded":"2023-03-03T06:25:26.125958+0000","last_fullsized":"2023-03-03T06:25:26.125958+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:34:23.666936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126281+0000","last_change":"2023-03-03T06:25:24.523642+0000","last_active":"2023-03-03T06:25:26.126281+0000","last_peered":"2023-03-03T06:25:26.126281+0000","last_clean":"2023-03-03T06:25:26.126281+0000","last_became_active":"2023-03-03T06:25:24.523365+0000","last_became_peered":"2023-03-03T06:25:24.523365+0000","last_unstale":"2023-03-03T06:25:26.126281+0000","last_undegraded":"2023-03-03T06:25:26.126281+0000","last_fullsized":"2023-03-03T06:25:26.126281+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:38:55.799484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.924741+0000","last_change":"2023-03-03T06:25:05.615550+0000","last_active":"2023-03-03T06:25:24.924741+0000","last_peered":"2023-03-03T06:25:24.924741+0000","last_clean":"2023-03-03T06:25:24.924741+0000","last_became_active":"2023-03-03T06:25:04.445574+0000","last_became_peered":"2023-03-03T06:25:04.445574+0000","last_unstale":"2023-03-03T06:25:24.924741+0000","last_undegraded":"2023-03-03T06:25:24.924741+0000","last_fullsized":"2023-03-03T06:25:24.924741+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:15:06.370284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061229600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124962+0000","last_change":"2023-03-03T06:25:24.931742+0000","last_active":"2023-03-03T06:25:26.124962+0000","last_peered":"2023-03-03T06:25:26.124962+0000","last_clean":"2023-03-03T06:25:26.124962+0000","last_became_active":"2023-03-03T06:25:24.931451+0000","last_became_peered":"2023-03-03T06:25:24.931451+0000","last_unstale":"2023-03-03T06:25:26.124962+0000","last_undegraded":"2023-03-03T06:25:26.124962+0000","last_fullsized":"2023-03-03T06:25:26.124962+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:06:51.664573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125736+0000","last_change":"2023-03-03T06:25:24.510327+0000","last_active":"2023-03-03T06:25:26.125736+0000","last_peered":"2023-03-03T06:25:26.125736+0000","last_clean":"2023-03-03T06:25:26.125736+0000","last_became_active":"2023-03-03T06:25:24.509532+0000","last_became_peered":"2023-03-03T06:25:24.509532+0000","last_unstale":"2023-03-03T06:25:26.125736+0000","last_undegraded":"2023-03-03T06:25:26.125736+0000","last_fullsized":"2023-03-03T06:25:26.125736+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:42:06.542711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928065+0000","last_change":"2023-03-03T06:25:05.431475+0000","last_active":"2023-03-03T06:25:24.928065+0000","last_peered":"2023-03-03T06:25:24.928065+0000","last_clean":"2023-03-03T06:25:24.928065+0000","last_became_active":"2023-03-03T06:25:04.596724+0000","last_became_peered":"2023-03-03T06:25:04.596724+0000","last_unstale":"2023-03-03T06:25:24.928065+0000","last_undegraded":"2023-03-03T06:25:24.928065+0000","last_fullsized":"2023-03-03T06:25:24.928065+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015785179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927235+0000","last_change":"2023-03-03T06:25:24.952416+0000","last_active":"2023-03-03T06:25:25.927235+0000","last_peered":"2023-03-03T06:25:25.927235+0000","last_clean":"2023-03-03T06:25:25.927235+0000","last_became_active":"2023-03-03T06:25:24.952190+0000","last_became_peered":"2023-03-03T06:25:24.952190+0000","last_unstale":"2023-03-03T06:25:25.927235+0000","last_undegraded":"2023-03-03T06:25:25.927235+0000","last_fullsized":"2023-03-03T06:25:25.927235+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:49:46.607290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126629+0000","last_change":"2023-03-03T06:25:24.524194+0000","last_active":"2023-03-03T06:25:26.126629+0000","last_peered":"2023-03-03T06:25:26.126629+0000","last_clean":"2023-03-03T06:25:26.126629+0000","last_became_active":"2023-03-03T06:25:24.523955+0000","last_became_peered":"2023-03-03T06:25:24.523955+0000","last_unstale":"2023-03-03T06:25:26.126629+0000","last_undegraded":"2023-03-03T06:25:26.126629+0000","last_fullsized":"2023-03-03T06:25:26.126629+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:58:44.525165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.925668+0000","last_change":"2023-03-03T06:25:05.796744+0000","last_active":"2023-03-03T06:25:24.925668+0000","last_peered":"2023-03-03T06:25:24.925668+0000","last_clean":"2023-03-03T06:25:24.925668+0000","last_became_active":"2023-03-03T06:25:04.444571+0000","last_became_peered":"2023-03-03T06:25:04.444571+0000","last_unstale":"2023-03-03T06:25:24.925668+0000","last_undegraded":"2023-03-03T06:25:24.925668+0000","last_fullsized":"2023-03-03T06:25:24.925668+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:46:48.500233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050328500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927950+0000","last_change":"2023-03-03T06:25:24.939539+0000","last_active":"2023-03-03T06:25:25.927950+0000","last_peered":"2023-03-03T06:25:25.927950+0000","last_clean":"2023-03-03T06:25:25.927950+0000","last_became_active":"2023-03-03T06:25:24.939290+0000","last_became_peered":"2023-03-03T06:25:24.939290+0000","last_unstale":"2023-03-03T06:25:25.927950+0000","last_undegraded":"2023-03-03T06:25:25.927950+0000","last_fullsized":"2023-03-03T06:25:25.927950+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:15:55.076368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"55'6","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124441+0000","last_change":"2023-03-03T06:25:24.511429+0000","last_active":"2023-03-03T06:25:26.124441+0000","last_peered":"2023-03-03T06:25:26.124441+0000","last_clean":"2023-03-03T06:25:26.124441+0000","last_became_active":"2023-03-03T06:25:24.509968+0000","last_became_peered":"2023-03-03T06:25:24.509968+0000","last_unstale":"2023-03-03T06:25:26.124441+0000","last_undegraded":"2023-03-03T06:25:26.124441+0000","last_fullsized":"2023-03-03T06:25:26.124441+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:05:09.690556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927875+0000","last_change":"2023-03-03T06:25:05.615943+0000","last_active":"2023-03-03T06:25:24.927875+0000","last_peered":"2023-03-03T06:25:24.927875+0000","last_clean":"2023-03-03T06:25:24.927875+0000","last_became_active":"2023-03-03T06:25:04.443824+0000","last_became_peered":"2023-03-03T06:25:04.443824+0000","last_unstale":"2023-03-03T06:25:24.927875+0000","last_undegraded":"2023-03-03T06:25:24.927875+0000","last_fullsized":"2023-03-03T06:25:24.927875+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:11.723607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059238800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125498+0000","last_change":"2023-03-03T06:25:24.936514+0000","last_active":"2023-03-03T06:25:26.125498+0000","last_peered":"2023-03-03T06:25:26.125498+0000","last_clean":"2023-03-03T06:25:26.125498+0000","last_became_active":"2023-03-03T06:25:24.936302+0000","last_became_peered":"2023-03-03T06:25:24.936302+0000","last_unstale":"2023-03-03T06:25:26.125498+0000","last_undegraded":"2023-03-03T06:25:26.125498+0000","last_fullsized":"2023-03-03T06:25:26.125498+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:42:12.338772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"55'3","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126704+0000","last_change":"2023-03-03T06:25:24.524257+0000","last_active":"2023-03-03T06:25:26.126704+0000","last_peered":"2023-03-03T06:25:26.126704+0000","last_clean":"2023-03-03T06:25:26.126704+0000","last_became_active":"2023-03-03T06:25:24.523977+0000","last_became_peered":"2023-03-03T06:25:24.523977+0000","last_unstale":"2023-03-03T06:25:26.126704+0000","last_undegraded":"2023-03-03T06:25:26.126704+0000","last_fullsized":"2023-03-03T06:25:26.126704+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:24.002152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.938024+0000","last_change":"2023-03-03T06:25:05.430594+0000","last_active":"2023-03-03T06:25:24.938024+0000","last_peered":"2023-03-03T06:25:24.938024+0000","last_clean":"2023-03-03T06:25:24.938024+0000","last_became_active":"2023-03-03T06:25:04.435012+0000","last_became_peered":"2023-03-03T06:25:04.435012+0000","last_unstale":"2023-03-03T06:25:24.938024+0000","last_undegraded":"2023-03-03T06:25:24.938024+0000","last_fullsized":"2023-03-03T06:25:24.938024+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052988999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925746+0000","last_change":"2023-03-03T06:25:24.941624+0000","last_active":"2023-03-03T06:25:25.925746+0000","last_peered":"2023-03-03T06:25:25.925746+0000","last_clean":"2023-03-03T06:25:25.925746+0000","last_became_active":"2023-03-03T06:25:24.941371+0000","last_became_peered":"2023-03-03T06:25:24.941371+0000","last_unstale":"2023-03-03T06:25:25.925746+0000","last_undegraded":"2023-03-03T06:25:25.925746+0000","last_fullsized":"2023-03-03T06:25:25.925746+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:27:14.164819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.928147+0000","last_change":"2023-03-03T06:25:24.520152+0000","last_active":"2023-03-03T06:25:25.928147+0000","last_peered":"2023-03-03T06:25:25.928147+0000","last_clean":"2023-03-03T06:25:25.928147+0000","last_became_active":"2023-03-03T06:25:24.519863+0000","last_became_peered":"2023-03-03T06:25:24.519863+0000","last_unstale":"2023-03-03T06:25:25.928147+0000","last_undegraded":"2023-03-03T06:25:25.928147+0000","last_fullsized":"2023-03-03T06:25:25.928147+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:00:11.813227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928690+0000","last_change":"2023-03-03T06:25:05.616017+0000","last_active":"2023-03-03T06:25:24.928690+0000","last_peered":"2023-03-03T06:25:24.928690+0000","last_clean":"2023-03-03T06:25:24.928690+0000","last_became_active":"2023-03-03T06:25:04.443176+0000","last_became_peered":"2023-03-03T06:25:04.443176+0000","last_unstale":"2023-03-03T06:25:24.928690+0000","last_undegraded":"2023-03-03T06:25:24.928690+0000","last_fullsized":"2023-03-03T06:25:24.928690+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:38:47.576162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034461600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124521+0000","last_change":"2023-03-03T06:25:24.933584+0000","last_active":"2023-03-03T06:25:26.124521+0000","last_peered":"2023-03-03T06:25:26.124521+0000","last_clean":"2023-03-03T06:25:26.124521+0000","last_became_active":"2023-03-03T06:25:24.932745+0000","last_became_peered":"2023-03-03T06:25:24.932745+0000","last_unstale":"2023-03-03T06:25:26.124521+0000","last_undegraded":"2023-03-03T06:25:26.124521+0000","last_fullsized":"2023-03-03T06:25:26.124521+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:36:30.031858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126990+0000","last_change":"2023-03-03T06:25:24.524292+0000","last_active":"2023-03-03T06:25:26.126990+0000","last_peered":"2023-03-03T06:25:26.126990+0000","last_clean":"2023-03-03T06:25:26.126990+0000","last_became_active":"2023-03-03T06:25:24.523992+0000","last_became_peered":"2023-03-03T06:25:24.523992+0000","last_unstale":"2023-03-03T06:25:26.126990+0000","last_undegraded":"2023-03-03T06:25:26.126990+0000","last_fullsized":"2023-03-03T06:25:26.126990+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:10:09.890646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927153+0000","last_change":"2023-03-03T06:25:05.431768+0000","last_active":"2023-03-03T06:25:24.927153+0000","last_peered":"2023-03-03T06:25:24.927153+0000","last_clean":"2023-03-03T06:25:24.927153+0000","last_became_active":"2023-03-03T06:25:04.596711+0000","last_became_peered":"2023-03-03T06:25:04.596711+0000","last_unstale":"2023-03-03T06:25:24.927153+0000","last_undegraded":"2023-03-03T06:25:24.927153+0000","last_fullsized":"2023-03-03T06:25:24.927153+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001569261,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925513+0000","last_change":"2023-03-03T06:25:24.940880+0000","last_active":"2023-03-03T06:25:25.925513+0000","last_peered":"2023-03-03T06:25:25.925513+0000","last_clean":"2023-03-03T06:25:25.925513+0000","last_became_active":"2023-03-03T06:25:24.940629+0000","last_became_peered":"2023-03-03T06:25:24.940629+0000","last_unstale":"2023-03-03T06:25:25.925513+0000","last_undegraded":"2023-03-03T06:25:25.925513+0000","last_fullsized":"2023-03-03T06:25:25.925513+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:23:02.927157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125296+0000","last_change":"2023-03-03T06:25:24.518603+0000","last_active":"2023-03-03T06:25:26.125296+0000","last_peered":"2023-03-03T06:25:26.125296+0000","last_clean":"2023-03-03T06:25:26.125296+0000","last_became_active":"2023-03-03T06:25:24.518358+0000","last_became_peered":"2023-03-03T06:25:24.518358+0000","last_unstale":"2023-03-03T06:25:26.125296+0000","last_undegraded":"2023-03-03T06:25:26.125296+0000","last_fullsized":"2023-03-03T06:25:26.125296+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:46:07.987501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.921432+0000","last_change":"2023-03-03T06:25:05.635716+0000","last_active":"2023-03-03T06:25:24.921432+0000","last_peered":"2023-03-03T06:25:24.921432+0000","last_clean":"2023-03-03T06:25:24.921432+0000","last_became_active":"2023-03-03T06:25:04.433896+0000","last_became_peered":"2023-03-03T06:25:04.433896+0000","last_unstale":"2023-03-03T06:25:24.921432+0000","last_undegraded":"2023-03-03T06:25:24.921432+0000","last_fullsized":"2023-03-03T06:25:24.921432+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:35.209807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060132199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125405+0000","last_change":"2023-03-03T06:25:24.933888+0000","last_active":"2023-03-03T06:25:26.125405+0000","last_peered":"2023-03-03T06:25:26.125405+0000","last_clean":"2023-03-03T06:25:26.125405+0000","last_became_active":"2023-03-03T06:25:24.933615+0000","last_became_peered":"2023-03-03T06:25:24.933615+0000","last_unstale":"2023-03-03T06:25:26.125405+0000","last_undegraded":"2023-03-03T06:25:26.125405+0000","last_fullsized":"2023-03-03T06:25:26.125405+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:52:46.374182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925492+0000","last_change":"2023-03-03T06:25:24.521188+0000","last_active":"2023-03-03T06:25:25.925492+0000","last_peered":"2023-03-03T06:25:25.925492+0000","last_clean":"2023-03-03T06:25:25.925492+0000","last_became_active":"2023-03-03T06:25:24.520714+0000","last_became_peered":"2023-03-03T06:25:24.520714+0000","last_unstale":"2023-03-03T06:25:25.925492+0000","last_undegraded":"2023-03-03T06:25:25.925492+0000","last_fullsized":"2023-03-03T06:25:25.925492+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:46.944575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.938123+0000","last_change":"2023-03-03T06:25:05.429739+0000","last_active":"2023-03-03T06:25:24.938123+0000","last_peered":"2023-03-03T06:25:24.938123+0000","last_clean":"2023-03-03T06:25:24.938123+0000","last_became_active":"2023-03-03T06:25:04.438903+0000","last_became_peered":"2023-03-03T06:25:04.438903+0000","last_unstale":"2023-03-03T06:25:24.938123+0000","last_undegraded":"2023-03-03T06:25:24.938123+0000","last_fullsized":"2023-03-03T06:25:24.938123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040434999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124132+0000","last_change":"2023-03-03T06:25:24.948431+0000","last_active":"2023-03-03T06:25:26.124132+0000","last_peered":"2023-03-03T06:25:26.124132+0000","last_clean":"2023-03-03T06:25:26.124132+0000","last_became_active":"2023-03-03T06:25:24.948158+0000","last_became_peered":"2023-03-03T06:25:24.948158+0000","last_unstale":"2023-03-03T06:25:26.124132+0000","last_undegraded":"2023-03-03T06:25:26.124132+0000","last_fullsized":"2023-03-03T06:25:26.124132+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:45:13.939205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925499+0000","last_change":"2023-03-03T06:25:24.518385+0000","last_active":"2023-03-03T06:25:25.925499+0000","last_peered":"2023-03-03T06:25:25.925499+0000","last_clean":"2023-03-03T06:25:25.925499+0000","last_became_active":"2023-03-03T06:25:24.518126+0000","last_became_peered":"2023-03-03T06:25:24.518126+0000","last_unstale":"2023-03-03T06:25:25.925499+0000","last_undegraded":"2023-03-03T06:25:25.925499+0000","last_fullsized":"2023-03-03T06:25:25.925499+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:14:53.556029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.937250+0000","last_change":"2023-03-03T06:25:05.430443+0000","last_active":"2023-03-03T06:25:24.937250+0000","last_peered":"2023-03-03T06:25:24.937250+0000","last_clean":"2023-03-03T06:25:24.937250+0000","last_became_active":"2023-03-03T06:25:04.596481+0000","last_became_peered":"2023-03-03T06:25:04.596481+0000","last_unstale":"2023-03-03T06:25:24.937250+0000","last_undegraded":"2023-03-03T06:25:24.937250+0000","last_fullsized":"2023-03-03T06:25:24.937250+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044860800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924556+0000","last_change":"2023-03-03T06:25:24.929805+0000","last_active":"2023-03-03T06:25:25.924556+0000","last_peered":"2023-03-03T06:25:25.924556+0000","last_clean":"2023-03-03T06:25:25.924556+0000","last_became_active":"2023-03-03T06:25:24.929533+0000","last_became_peered":"2023-03-03T06:25:24.929533+0000","last_unstale":"2023-03-03T06:25:25.924556+0000","last_undegraded":"2023-03-03T06:25:25.924556+0000","last_fullsized":"2023-03-03T06:25:25.924556+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:13:59.125389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925540+0000","last_change":"2023-03-03T06:25:24.515807+0000","last_active":"2023-03-03T06:25:25.925540+0000","last_peered":"2023-03-03T06:25:25.925540+0000","last_clean":"2023-03-03T06:25:25.925540+0000","last_became_active":"2023-03-03T06:25:24.515261+0000","last_became_peered":"2023-03-03T06:25:24.515261+0000","last_unstale":"2023-03-03T06:25:25.925540+0000","last_undegraded":"2023-03-03T06:25:25.925540+0000","last_fullsized":"2023-03-03T06:25:25.925540+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:24:03.370366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.922995+0000","last_change":"2023-03-03T06:25:05.431490+0000","last_active":"2023-03-03T06:25:24.922995+0000","last_peered":"2023-03-03T06:25:24.922995+0000","last_clean":"2023-03-03T06:25:24.922995+0000","last_became_active":"2023-03-03T06:25:04.443163+0000","last_became_peered":"2023-03-03T06:25:04.443163+0000","last_unstale":"2023-03-03T06:25:24.922995+0000","last_undegraded":"2023-03-03T06:25:24.922995+0000","last_fullsized":"2023-03-03T06:25:24.922995+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020118839999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126936+0000","last_change":"2023-03-03T06:25:24.942160+0000","last_active":"2023-03-03T06:25:26.126936+0000","last_peered":"2023-03-03T06:25:26.126936+0000","last_clean":"2023-03-03T06:25:26.126936+0000","last_became_active":"2023-03-03T06:25:24.941839+0000","last_became_peered":"2023-03-03T06:25:24.941839+0000","last_unstale":"2023-03-03T06:25:26.126936+0000","last_undegraded":"2023-03-03T06:25:26.126936+0000","last_fullsized":"2023-03-03T06:25:26.126936+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:20:25.249056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124688+0000","last_change":"2023-03-03T06:25:24.522452+0000","last_active":"2023-03-03T06:25:26.124688+0000","last_peered":"2023-03-03T06:25:26.124688+0000","last_clean":"2023-03-03T06:25:26.124688+0000","last_became_active":"2023-03-03T06:25:24.522171+0000","last_became_peered":"2023-03-03T06:25:24.522171+0000","last_unstale":"2023-03-03T06:25:26.124688+0000","last_undegraded":"2023-03-03T06:25:26.124688+0000","last_fullsized":"2023-03-03T06:25:26.124688+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:06:50.660054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.922945+0000","last_change":"2023-03-03T06:25:05.432139+0000","last_active":"2023-03-03T06:25:24.922945+0000","last_peered":"2023-03-03T06:25:24.922945+0000","last_clean":"2023-03-03T06:25:24.922945+0000","last_became_active":"2023-03-03T06:25:04.435759+0000","last_became_peered":"2023-03-03T06:25:04.435759+0000","last_unstale":"2023-03-03T06:25:24.922945+0000","last_undegraded":"2023-03-03T06:25:24.922945+0000","last_fullsized":"2023-03-03T06:25:24.922945+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001646893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124811+0000","last_change":"2023-03-03T06:25:24.933874+0000","last_active":"2023-03-03T06:25:26.124811+0000","last_peered":"2023-03-03T06:25:26.124811+0000","last_clean":"2023-03-03T06:25:26.124811+0000","last_became_active":"2023-03-03T06:25:24.933571+0000","last_became_peered":"2023-03-03T06:25:24.933571+0000","last_unstale":"2023-03-03T06:25:26.124811+0000","last_undegraded":"2023-03-03T06:25:26.124811+0000","last_fullsized":"2023-03-03T06:25:26.124811+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:40:32.930468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124796+0000","last_change":"2023-03-03T06:25:24.514541+0000","last_active":"2023-03-03T06:25:26.124796+0000","last_peered":"2023-03-03T06:25:26.124796+0000","last_clean":"2023-03-03T06:25:26.124796+0000","last_became_active":"2023-03-03T06:25:24.514245+0000","last_became_peered":"2023-03-03T06:25:24.514245+0000","last_unstale":"2023-03-03T06:25:26.124796+0000","last_undegraded":"2023-03-03T06:25:26.124796+0000","last_fullsized":"2023-03-03T06:25:26.124796+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:05:55.927278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.920600+0000","last_change":"2023-03-03T06:25:05.635968+0000","last_active":"2023-03-03T06:25:24.920600+0000","last_peered":"2023-03-03T06:25:24.920600+0000","last_clean":"2023-03-03T06:25:24.920600+0000","last_became_active":"2023-03-03T06:25:04.443619+0000","last_became_peered":"2023-03-03T06:25:04.443619+0000","last_unstale":"2023-03-03T06:25:24.920600+0000","last_undegraded":"2023-03-03T06:25:24.920600+0000","last_fullsized":"2023-03-03T06:25:24.920600+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:51:15.780667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077929799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927785+0000","last_change":"2023-03-03T06:25:24.944547+0000","last_active":"2023-03-03T06:25:25.927785+0000","last_peered":"2023-03-03T06:25:25.927785+0000","last_clean":"2023-03-03T06:25:25.927785+0000","last_became_active":"2023-03-03T06:25:24.944037+0000","last_became_peered":"2023-03-03T06:25:24.944037+0000","last_unstale":"2023-03-03T06:25:25.927785+0000","last_undegraded":"2023-03-03T06:25:25.927785+0000","last_fullsized":"2023-03-03T06:25:25.927785+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:33:03.550930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124900+0000","last_change":"2023-03-03T06:25:24.518651+0000","last_active":"2023-03-03T06:25:26.124900+0000","last_peered":"2023-03-03T06:25:26.124900+0000","last_clean":"2023-03-03T06:25:26.124900+0000","last_became_active":"2023-03-03T06:25:24.518298+0000","last_became_peered":"2023-03-03T06:25:24.518298+0000","last_unstale":"2023-03-03T06:25:26.124900+0000","last_undegraded":"2023-03-03T06:25:26.124900+0000","last_fullsized":"2023-03-03T06:25:26.124900+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:14:53.556029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923097+0000","last_change":"2023-03-03T06:25:05.432320+0000","last_active":"2023-03-03T06:25:24.923097+0000","last_peered":"2023-03-03T06:25:24.923097+0000","last_clean":"2023-03-03T06:25:24.923097+0000","last_became_active":"2023-03-03T06:25:04.436727+0000","last_became_peered":"2023-03-03T06:25:04.436727+0000","last_unstale":"2023-03-03T06:25:24.923097+0000","last_undegraded":"2023-03-03T06:25:24.923097+0000","last_fullsized":"2023-03-03T06:25:24.923097+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014361980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125436+0000","last_change":"2023-03-03T06:25:24.937708+0000","last_active":"2023-03-03T06:25:26.125436+0000","last_peered":"2023-03-03T06:25:26.125436+0000","last_clean":"2023-03-03T06:25:26.125436+0000","last_became_active":"2023-03-03T06:25:24.937408+0000","last_became_peered":"2023-03-03T06:25:24.937408+0000","last_unstale":"2023-03-03T06:25:26.125436+0000","last_undegraded":"2023-03-03T06:25:26.125436+0000","last_fullsized":"2023-03-03T06:25:26.125436+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:19:01.571013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"55'4","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125651+0000","last_change":"2023-03-03T06:25:24.522437+0000","last_active":"2023-03-03T06:25:26.125651+0000","last_peered":"2023-03-03T06:25:26.125651+0000","last_clean":"2023-03-03T06:25:26.125651+0000","last_became_active":"2023-03-03T06:25:24.521605+0000","last_became_peered":"2023-03-03T06:25:24.521605+0000","last_unstale":"2023-03-03T06:25:26.125651+0000","last_undegraded":"2023-03-03T06:25:26.125651+0000","last_fullsized":"2023-03-03T06:25:26.125651+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:44.001614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927064+0000","last_change":"2023-03-03T06:25:05.431681+0000","last_active":"2023-03-03T06:25:24.927064+0000","last_peered":"2023-03-03T06:25:24.927064+0000","last_clean":"2023-03-03T06:25:24.927064+0000","last_became_active":"2023-03-03T06:25:04.443599+0000","last_became_peered":"2023-03-03T06:25:04.443599+0000","last_unstale":"2023-03-03T06:25:24.927064+0000","last_undegraded":"2023-03-03T06:25:24.927064+0000","last_fullsized":"2023-03-03T06:25:24.927064+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001546473,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924739+0000","last_change":"2023-03-03T06:25:24.931161+0000","last_active":"2023-03-03T06:25:25.924739+0000","last_peered":"2023-03-03T06:25:25.924739+0000","last_clean":"2023-03-03T06:25:25.924739+0000","last_became_active":"2023-03-03T06:25:24.930832+0000","last_became_peered":"2023-03-03T06:25:24.930832+0000","last_unstale":"2023-03-03T06:25:25.924739+0000","last_undegraded":"2023-03-03T06:25:25.924739+0000","last_fullsized":"2023-03-03T06:25:25.924739+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:59:03.123359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125021+0000","last_change":"2023-03-03T06:25:24.519515+0000","last_active":"2023-03-03T06:25:26.125021+0000","last_peered":"2023-03-03T06:25:26.125021+0000","last_clean":"2023-03-03T06:25:26.125021+0000","last_became_active":"2023-03-03T06:25:24.519249+0000","last_became_peered":"2023-03-03T06:25:24.519249+0000","last_unstale":"2023-03-03T06:25:26.125021+0000","last_undegraded":"2023-03-03T06:25:26.125021+0000","last_fullsized":"2023-03-03T06:25:26.125021+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:31.902827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.921714+0000","last_change":"2023-03-03T06:25:05.796211+0000","last_active":"2023-03-03T06:25:24.921714+0000","last_peered":"2023-03-03T06:25:24.921714+0000","last_clean":"2023-03-03T06:25:24.921714+0000","last_became_active":"2023-03-03T06:25:04.436647+0000","last_became_peered":"2023-03-03T06:25:04.436647+0000","last_unstale":"2023-03-03T06:25:24.921714+0000","last_undegraded":"2023-03-03T06:25:24.921714+0000","last_fullsized":"2023-03-03T06:25:24.921714+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:07.330548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124395+0000","last_change":"2023-03-03T06:25:24.949538+0000","last_active":"2023-03-03T06:25:26.124395+0000","last_peered":"2023-03-03T06:25:26.124395+0000","last_clean":"2023-03-03T06:25:26.124395+0000","last_became_active":"2023-03-03T06:25:24.949280+0000","last_became_peered":"2023-03-03T06:25:24.949280+0000","last_unstale":"2023-03-03T06:25:26.124395+0000","last_undegraded":"2023-03-03T06:25:26.124395+0000","last_fullsized":"2023-03-03T06:25:26.124395+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:25.006671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925524+0000","last_change":"2023-03-03T06:25:24.520994+0000","last_active":"2023-03-03T06:25:25.925524+0000","last_peered":"2023-03-03T06:25:25.925524+0000","last_clean":"2023-03-03T06:25:25.925524+0000","last_became_active":"2023-03-03T06:25:24.520347+0000","last_became_peered":"2023-03-03T06:25:24.520347+0000","last_unstale":"2023-03-03T06:25:25.925524+0000","last_undegraded":"2023-03-03T06:25:25.925524+0000","last_fullsized":"2023-03-03T06:25:25.925524+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:50:42.331552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927755+0000","last_change":"2023-03-03T06:25:05.431187+0000","last_active":"2023-03-03T06:25:24.927755+0000","last_peered":"2023-03-03T06:25:24.927755+0000","last_clean":"2023-03-03T06:25:24.927755+0000","last_became_active":"2023-03-03T06:25:04.442929+0000","last_became_peered":"2023-03-03T06:25:04.442929+0000","last_unstale":"2023-03-03T06:25:24.927755+0000","last_undegraded":"2023-03-03T06:25:24.927755+0000","last_fullsized":"2023-03-03T06:25:24.927755+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001551871,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.927381+0000","last_change":"2023-03-03T06:25:24.942998+0000","last_active":"2023-03-03T06:25:25.927381+0000","last_peered":"2023-03-03T06:25:25.927381+0000","last_clean":"2023-03-03T06:25:25.927381+0000","last_became_active":"2023-03-03T06:25:24.942747+0000","last_became_peered":"2023-03-03T06:25:24.942747+0000","last_unstale":"2023-03-03T06:25:25.927381+0000","last_undegraded":"2023-03-03T06:25:25.927381+0000","last_fullsized":"2023-03-03T06:25:25.927381+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:40:32.930468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925709+0000","last_change":"2023-03-03T06:25:24.520259+0000","last_active":"2023-03-03T06:25:25.925709+0000","last_peered":"2023-03-03T06:25:25.925709+0000","last_clean":"2023-03-03T06:25:25.925709+0000","last_became_active":"2023-03-03T06:25:24.519667+0000","last_became_peered":"2023-03-03T06:25:24.519667+0000","last_unstale":"2023-03-03T06:25:25.925709+0000","last_undegraded":"2023-03-03T06:25:25.925709+0000","last_fullsized":"2023-03-03T06:25:25.925709+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.736521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923559+0000","last_change":"2023-03-03T06:25:05.796890+0000","last_active":"2023-03-03T06:25:24.923559+0000","last_peered":"2023-03-03T06:25:24.923559+0000","last_clean":"2023-03-03T06:25:24.923559+0000","last_became_active":"2023-03-03T06:25:04.437104+0000","last_became_peered":"2023-03-03T06:25:04.437104+0000","last_unstale":"2023-03-03T06:25:24.923559+0000","last_undegraded":"2023-03-03T06:25:24.923559+0000","last_fullsized":"2023-03-03T06:25:24.923559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:10:21.043057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027269099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125195+0000","last_change":"2023-03-03T06:25:24.933349+0000","last_active":"2023-03-03T06:25:26.125195+0000","last_peered":"2023-03-03T06:25:26.125195+0000","last_clean":"2023-03-03T06:25:26.125195+0000","last_became_active":"2023-03-03T06:25:24.933097+0000","last_became_peered":"2023-03-03T06:25:24.933097+0000","last_unstale":"2023-03-03T06:25:26.125195+0000","last_undegraded":"2023-03-03T06:25:26.125195+0000","last_fullsized":"2023-03-03T06:25:26.125195+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:25.006671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126730+0000","last_change":"2023-03-03T06:25:24.523422+0000","last_active":"2023-03-03T06:25:26.126730+0000","last_peered":"2023-03-03T06:25:26.126730+0000","last_clean":"2023-03-03T06:25:26.126730+0000","last_became_active":"2023-03-03T06:25:24.523143+0000","last_became_peered":"2023-03-03T06:25:24.523143+0000","last_unstale":"2023-03-03T06:25:26.126730+0000","last_undegraded":"2023-03-03T06:25:26.126730+0000","last_fullsized":"2023-03-03T06:25:26.126730+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:19:00.566494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.935670+0000","last_change":"2023-03-03T06:25:05.429793+0000","last_active":"2023-03-03T06:25:24.935670+0000","last_peered":"2023-03-03T06:25:24.935670+0000","last_clean":"2023-03-03T06:25:24.935670+0000","last_became_active":"2023-03-03T06:25:04.436400+0000","last_became_peered":"2023-03-03T06:25:04.436400+0000","last_unstale":"2023-03-03T06:25:24.935670+0000","last_undegraded":"2023-03-03T06:25:24.935670+0000","last_fullsized":"2023-03-03T06:25:24.935670+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038039399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125392+0000","last_change":"2023-03-03T06:25:24.938670+0000","last_active":"2023-03-03T06:25:26.125392+0000","last_peered":"2023-03-03T06:25:26.125392+0000","last_clean":"2023-03-03T06:25:26.125392+0000","last_became_active":"2023-03-03T06:25:24.938429+0000","last_became_peered":"2023-03-03T06:25:24.938429+0000","last_unstale":"2023-03-03T06:25:26.125392+0000","last_undegraded":"2023-03-03T06:25:26.125392+0000","last_fullsized":"2023-03-03T06:25:26.125392+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:56.502459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124487+0000","last_change":"2023-03-03T06:25:24.520083+0000","last_active":"2023-03-03T06:25:26.124487+0000","last_peered":"2023-03-03T06:25:26.124487+0000","last_clean":"2023-03-03T06:25:26.124487+0000","last_became_active":"2023-03-03T06:25:24.518282+0000","last_became_peered":"2023-03-03T06:25:24.518282+0000","last_unstale":"2023-03-03T06:25:26.124487+0000","last_undegraded":"2023-03-03T06:25:26.124487+0000","last_fullsized":"2023-03-03T06:25:26.124487+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:07:12.497985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.926146+0000","last_change":"2023-03-03T06:25:05.797098+0000","last_active":"2023-03-03T06:25:24.926146+0000","last_peered":"2023-03-03T06:25:24.926146+0000","last_clean":"2023-03-03T06:25:24.926146+0000","last_became_active":"2023-03-03T06:25:04.446290+0000","last_became_peered":"2023-03-03T06:25:04.446290+0000","last_unstale":"2023-03-03T06:25:24.926146+0000","last_undegraded":"2023-03-03T06:25:24.926146+0000","last_fullsized":"2023-03-03T06:25:24.926146+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:23:37.795335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050239399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125385+0000","last_change":"2023-03-03T06:25:24.934177+0000","last_active":"2023-03-03T06:25:26.125385+0000","last_peered":"2023-03-03T06:25:26.125385+0000","last_clean":"2023-03-03T06:25:26.125385+0000","last_became_active":"2023-03-03T06:25:24.933499+0000","last_became_peered":"2023-03-03T06:25:24.933499+0000","last_unstale":"2023-03-03T06:25:26.125385+0000","last_undegraded":"2023-03-03T06:25:26.125385+0000","last_fullsized":"2023-03-03T06:25:26.125385+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:09.237392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124882+0000","last_change":"2023-03-03T06:25:24.509513+0000","last_active":"2023-03-03T06:25:26.124882+0000","last_peered":"2023-03-03T06:25:26.124882+0000","last_clean":"2023-03-03T06:25:26.124882+0000","last_became_active":"2023-03-03T06:25:24.509233+0000","last_became_peered":"2023-03-03T06:25:24.509233+0000","last_unstale":"2023-03-03T06:25:26.124882+0000","last_undegraded":"2023-03-03T06:25:26.124882+0000","last_fullsized":"2023-03-03T06:25:26.124882+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:47:31.672737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.920697+0000","last_change":"2023-03-03T06:25:05.636038+0000","last_active":"2023-03-03T06:25:24.920697+0000","last_peered":"2023-03-03T06:25:24.920697+0000","last_clean":"2023-03-03T06:25:24.920697+0000","last_became_active":"2023-03-03T06:25:04.433771+0000","last_became_peered":"2023-03-03T06:25:04.433771+0000","last_unstale":"2023-03-03T06:25:24.920697+0000","last_undegraded":"2023-03-03T06:25:24.920697+0000","last_fullsized":"2023-03-03T06:25:24.920697+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:33:58.284544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079784699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.924611+0000","last_change":"2023-03-03T06:25:24.932033+0000","last_active":"2023-03-03T06:25:25.924611+0000","last_peered":"2023-03-03T06:25:25.924611+0000","last_clean":"2023-03-03T06:25:25.924611+0000","last_became_active":"2023-03-03T06:25:24.931758+0000","last_became_peered":"2023-03-03T06:25:24.931758+0000","last_unstale":"2023-03-03T06:25:25.924611+0000","last_undegraded":"2023-03-03T06:25:25.924611+0000","last_fullsized":"2023-03-03T06:25:25.924611+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:34:19.362959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:27.533806+0000","last_change":"2023-03-03T06:25:24.518833+0000","last_active":"2023-03-03T06:25:27.533806+0000","last_peered":"2023-03-03T06:25:27.533806+0000","last_clean":"2023-03-03T06:25:27.533806+0000","last_became_active":"2023-03-03T06:25:24.518545+0000","last_became_peered":"2023-03-03T06:25:24.518545+0000","last_unstale":"2023-03-03T06:25:27.533806+0000","last_undegraded":"2023-03-03T06:25:27.533806+0000","last_fullsized":"2023-03-03T06:25:27.533806+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:55:47.342952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.922449+0000","last_change":"2023-03-03T06:25:05.797366+0000","last_active":"2023-03-03T06:25:24.922449+0000","last_peered":"2023-03-03T06:25:24.922449+0000","last_clean":"2023-03-03T06:25:24.922449+0000","last_became_active":"2023-03-03T06:25:04.439424+0000","last_became_peered":"2023-03-03T06:25:04.439424+0000","last_unstale":"2023-03-03T06:25:24.922449+0000","last_undegraded":"2023-03-03T06:25:24.922449+0000","last_fullsized":"2023-03-03T06:25:24.922449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:12.599265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020575500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124616+0000","last_change":"2023-03-03T06:25:24.948977+0000","last_active":"2023-03-03T06:25:26.124616+0000","last_peered":"2023-03-03T06:25:26.124616+0000","last_clean":"2023-03-03T06:25:26.124616+0000","last_became_active":"2023-03-03T06:25:24.948669+0000","last_became_peered":"2023-03-03T06:25:24.948669+0000","last_unstale":"2023-03-03T06:25:26.124616+0000","last_undegraded":"2023-03-03T06:25:26.124616+0000","last_fullsized":"2023-03-03T06:25:26.124616+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:36:14.477572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125632+0000","last_change":"2023-03-03T06:25:24.521115+0000","last_active":"2023-03-03T06:25:26.125632+0000","last_peered":"2023-03-03T06:25:26.125632+0000","last_clean":"2023-03-03T06:25:26.125632+0000","last_became_active":"2023-03-03T06:25:24.520862+0000","last_became_peered":"2023-03-03T06:25:24.520862+0000","last_unstale":"2023-03-03T06:25:26.125632+0000","last_undegraded":"2023-03-03T06:25:26.125632+0000","last_fullsized":"2023-03-03T06:25:26.125632+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:02:51.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923773+0000","last_change":"2023-03-03T06:25:05.431441+0000","last_active":"2023-03-03T06:25:24.923773+0000","last_peered":"2023-03-03T06:25:24.923773+0000","last_clean":"2023-03-03T06:25:24.923773+0000","last_became_active":"2023-03-03T06:25:04.443840+0000","last_became_peered":"2023-03-03T06:25:04.443840+0000","last_unstale":"2023-03-03T06:25:24.923773+0000","last_undegraded":"2023-03-03T06:25:24.923773+0000","last_fullsized":"2023-03-03T06:25:24.923773+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017814980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.928103+0000","last_change":"2023-03-03T06:25:24.939685+0000","last_active":"2023-03-03T06:25:25.928103+0000","last_peered":"2023-03-03T06:25:25.928103+0000","last_clean":"2023-03-03T06:25:25.928103+0000","last_became_active":"2023-03-03T06:25:24.939399+0000","last_became_peered":"2023-03-03T06:25:24.939399+0000","last_unstale":"2023-03-03T06:25:25.928103+0000","last_undegraded":"2023-03-03T06:25:25.928103+0000","last_fullsized":"2023-03-03T06:25:25.928103+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:27:14.164819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126951+0000","last_change":"2023-03-03T06:25:24.524776+0000","last_active":"2023-03-03T06:25:26.126951+0000","last_peered":"2023-03-03T06:25:26.126951+0000","last_clean":"2023-03-03T06:25:26.126951+0000","last_became_active":"2023-03-03T06:25:24.524527+0000","last_became_peered":"2023-03-03T06:25:24.524527+0000","last_unstale":"2023-03-03T06:25:26.126951+0000","last_undegraded":"2023-03-03T06:25:26.126951+0000","last_fullsized":"2023-03-03T06:25:26.126951+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:10:05.694425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923603+0000","last_change":"2023-03-03T06:25:05.431854+0000","last_active":"2023-03-03T06:25:24.923603+0000","last_peered":"2023-03-03T06:25:24.923603+0000","last_clean":"2023-03-03T06:25:24.923603+0000","last_became_active":"2023-03-03T06:25:04.438570+0000","last_became_peered":"2023-03-03T06:25:04.438570+0000","last_unstale":"2023-03-03T06:25:24.923603+0000","last_undegraded":"2023-03-03T06:25:24.923603+0000","last_fullsized":"2023-03-03T06:25:24.923603+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.942265+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:25:24.942265+0000","last_peered":"2023-03-03T06:25:24.942265+0000","last_clean":"2023-03-03T06:25:24.942265+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:25:24.942265+0000","last_undegraded":"2023-03-03T06:25:24.942265+0000","last_fullsized":"2023-03-03T06:25:24.942265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125259+0000","last_change":"2023-03-03T06:25:24.935409+0000","last_active":"2023-03-03T06:25:26.125259+0000","last_peered":"2023-03-03T06:25:26.125259+0000","last_clean":"2023-03-03T06:25:26.125259+0000","last_became_active":"2023-03-03T06:25:24.935140+0000","last_became_peered":"2023-03-03T06:25:24.935140+0000","last_unstale":"2023-03-03T06:25:26.125259+0000","last_undegraded":"2023-03-03T06:25:26.125259+0000","last_fullsized":"2023-03-03T06:25:26.125259+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:24:29.758094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925681+0000","last_change":"2023-03-03T06:25:24.516059+0000","last_active":"2023-03-03T06:25:25.925681+0000","last_peered":"2023-03-03T06:25:25.925681+0000","last_clean":"2023-03-03T06:25:25.925681+0000","last_became_active":"2023-03-03T06:25:24.515740+0000","last_became_peered":"2023-03-03T06:25:24.515740+0000","last_unstale":"2023-03-03T06:25:25.925681+0000","last_undegraded":"2023-03-03T06:25:25.925681+0000","last_fullsized":"2023-03-03T06:25:25.925681+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:05:55.927278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.922510+0000","last_change":"2023-03-03T06:25:05.636335+0000","last_active":"2023-03-03T06:25:24.922510+0000","last_peered":"2023-03-03T06:25:24.922510+0000","last_clean":"2023-03-03T06:25:24.922510+0000","last_became_active":"2023-03-03T06:25:04.443299+0000","last_became_peered":"2023-03-03T06:25:04.443299+0000","last_unstale":"2023-03-03T06:25:24.922510+0000","last_undegraded":"2023-03-03T06:25:24.922510+0000","last_fullsized":"2023-03-03T06:25:24.922510+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:13:38.046974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090290399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928347+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:25:24.928347+0000","last_peered":"2023-03-03T06:25:24.928347+0000","last_clean":"2023-03-03T06:25:24.928347+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:25:24.928347+0000","last_undegraded":"2023-03-03T06:25:24.928347+0000","last_fullsized":"2023-03-03T06:25:24.928347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124369+0000","last_change":"2023-03-03T06:25:24.934579+0000","last_active":"2023-03-03T06:25:26.124369+0000","last_peered":"2023-03-03T06:25:26.124369+0000","last_clean":"2023-03-03T06:25:26.124369+0000","last_became_active":"2023-03-03T06:25:24.933988+0000","last_became_peered":"2023-03-03T06:25:24.933988+0000","last_unstale":"2023-03-03T06:25:26.124369+0000","last_undegraded":"2023-03-03T06:25:26.124369+0000","last_fullsized":"2023-03-03T06:25:26.124369+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:49:46.607290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125278+0000","last_change":"2023-03-03T06:25:24.519139+0000","last_active":"2023-03-03T06:25:26.125278+0000","last_peered":"2023-03-03T06:25:26.125278+0000","last_clean":"2023-03-03T06:25:26.125278+0000","last_became_active":"2023-03-03T06:25:24.518849+0000","last_became_peered":"2023-03-03T06:25:24.518849+0000","last_unstale":"2023-03-03T06:25:26.125278+0000","last_undegraded":"2023-03-03T06:25:26.125278+0000","last_fullsized":"2023-03-03T06:25:26.125278+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:08.232873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":27,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.924219+0000","last_change":"2023-03-03T06:25:05.796271+0000","last_active":"2023-03-03T06:25:24.924219+0000","last_peered":"2023-03-03T06:25:24.924219+0000","last_clean":"2023-03-03T06:25:24.924219+0000","last_became_active":"2023-03-03T06:25:04.595414+0000","last_became_peered":"2023-03-03T06:25:04.595414+0000","last_unstale":"2023-03-03T06:25:24.924219+0000","last_undegraded":"2023-03-03T06:25:24.924219+0000","last_fullsized":"2023-03-03T06:25:24.924219+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:07:03.140630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027036600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":44,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923632+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:25:24.923632+0000","last_peered":"2023-03-03T06:25:24.923632+0000","last_clean":"2023-03-03T06:25:24.923632+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:25:24.923632+0000","last_undegraded":"2023-03-03T06:25:24.923632+0000","last_fullsized":"2023-03-03T06:25:24.923632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":193,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.924648+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:25:24.924648+0000","last_peered":"2023-03-03T06:25:24.924648+0000","last_clean":"2023-03-03T06:25:24.924648+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:25:24.924648+0000","last_undegraded":"2023-03-03T06:25:24.924648+0000","last_fullsized":"2023-03-03T06:25:24.924648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125189+0000","last_change":"2023-03-03T06:25:24.934898+0000","last_active":"2023-03-03T06:25:26.125189+0000","last_peered":"2023-03-03T06:25:26.125189+0000","last_clean":"2023-03-03T06:25:26.125189+0000","last_became_active":"2023-03-03T06:25:24.934581+0000","last_became_peered":"2023-03-03T06:25:24.934581+0000","last_unstale":"2023-03-03T06:25:26.125189+0000","last_undegraded":"2023-03-03T06:25:26.125189+0000","last_fullsized":"2023-03-03T06:25:26.125189+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:24:04.374885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125788+0000","last_change":"2023-03-03T06:25:24.509731+0000","last_active":"2023-03-03T06:25:26.125788+0000","last_peered":"2023-03-03T06:25:26.125788+0000","last_clean":"2023-03-03T06:25:26.125788+0000","last_became_active":"2023-03-03T06:25:24.509434+0000","last_became_peered":"2023-03-03T06:25:24.509434+0000","last_unstale":"2023-03-03T06:25:26.125788+0000","last_undegraded":"2023-03-03T06:25:26.125788+0000","last_fullsized":"2023-03-03T06:25:26.125788+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:36:29.027339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927888+0000","last_change":"2023-03-03T06:25:05.431373+0000","last_active":"2023-03-03T06:25:24.927888+0000","last_peered":"2023-03-03T06:25:24.927888+0000","last_clean":"2023-03-03T06:25:24.927888+0000","last_became_active":"2023-03-03T06:25:04.445948+0000","last_became_peered":"2023-03-03T06:25:04.445948+0000","last_unstale":"2023-03-03T06:25:24.927888+0000","last_undegraded":"2023-03-03T06:25:24.927888+0000","last_fullsized":"2023-03-03T06:25:24.927888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001717028,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928450+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:25:24.928450+0000","last_peered":"2023-03-03T06:25:24.928450+0000","last_clean":"2023-03-03T06:25:24.928450+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:25:24.928450+0000","last_undegraded":"2023-03-03T06:25:24.928450+0000","last_fullsized":"2023-03-03T06:25:24.928450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126335+0000","last_change":"2023-03-03T06:25:24.937782+0000","last_active":"2023-03-03T06:25:26.126335+0000","last_peered":"2023-03-03T06:25:26.126335+0000","last_clean":"2023-03-03T06:25:26.126335+0000","last_became_active":"2023-03-03T06:25:24.937490+0000","last_became_peered":"2023-03-03T06:25:24.937490+0000","last_unstale":"2023-03-03T06:25:26.126335+0000","last_undegraded":"2023-03-03T06:25:26.126335+0000","last_fullsized":"2023-03-03T06:25:26.126335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:10:10.895165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:25.925276+0000","last_change":"2023-03-03T06:25:24.516424+0000","last_active":"2023-03-03T06:25:25.925276+0000","last_peered":"2023-03-03T06:25:25.925276+0000","last_clean":"2023-03-03T06:25:25.925276+0000","last_became_active":"2023-03-03T06:25:24.515550+0000","last_became_peered":"2023-03-03T06:25:24.515550+0000","last_unstale":"2023-03-03T06:25:25.925276+0000","last_undegraded":"2023-03-03T06:25:25.925276+0000","last_fullsized":"2023-03-03T06:25:25.925276+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:15:54.071849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927206+0000","last_change":"2023-03-03T06:25:05.796597+0000","last_active":"2023-03-03T06:25:24.927206+0000","last_peered":"2023-03-03T06:25:24.927206+0000","last_clean":"2023-03-03T06:25:24.927206+0000","last_became_active":"2023-03-03T06:25:04.442672+0000","last_became_peered":"2023-03-03T06:25:04.442672+0000","last_unstale":"2023-03-03T06:25:24.927206+0000","last_undegraded":"2023-03-03T06:25:24.927206+0000","last_fullsized":"2023-03-03T06:25:24.927206+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.033310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000479903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.925287+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:25:24.925287+0000","last_peered":"2023-03-03T06:25:24.925287+0000","last_clean":"2023-03-03T06:25:24.925287+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:25:24.925287+0000","last_undegraded":"2023-03-03T06:25:24.925287+0000","last_fullsized":"2023-03-03T06:25:24.925287+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126051+0000","last_change":"2023-03-03T06:25:24.932351+0000","last_active":"2023-03-03T06:25:26.126051+0000","last_peered":"2023-03-03T06:25:26.126051+0000","last_clean":"2023-03-03T06:25:26.126051+0000","last_became_active":"2023-03-03T06:25:24.931960+0000","last_became_peered":"2023-03-03T06:25:24.931960+0000","last_unstale":"2023-03-03T06:25:26.126051+0000","last_undegraded":"2023-03-03T06:25:26.126051+0000","last_fullsized":"2023-03-03T06:25:26.126051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:36:20.994518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.124642+0000","last_change":"2023-03-03T06:25:24.519327+0000","last_active":"2023-03-03T06:25:26.124642+0000","last_peered":"2023-03-03T06:25:26.124642+0000","last_clean":"2023-03-03T06:25:26.124642+0000","last_became_active":"2023-03-03T06:25:24.518988+0000","last_became_peered":"2023-03-03T06:25:24.518988+0000","last_unstale":"2023-03-03T06:25:26.124642+0000","last_undegraded":"2023-03-03T06:25:26.124642+0000","last_fullsized":"2023-03-03T06:25:26.124642+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.736521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.920647+0000","last_change":"2023-03-03T06:25:05.636259+0000","last_active":"2023-03-03T06:25:24.920647+0000","last_peered":"2023-03-03T06:25:24.920647+0000","last_clean":"2023-03-03T06:25:24.920647+0000","last_became_active":"2023-03-03T06:25:04.438244+0000","last_became_peered":"2023-03-03T06:25:04.438244+0000","last_unstale":"2023-03-03T06:25:24.920647+0000","last_undegraded":"2023-03-03T06:25:24.920647+0000","last_fullsized":"2023-03-03T06:25:24.920647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:36.640289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001044636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.921515+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:25:24.921515+0000","last_peered":"2023-03-03T06:25:24.921515+0000","last_clean":"2023-03-03T06:25:24.921515+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:25:24.921515+0000","last_undegraded":"2023-03-03T06:25:24.921515+0000","last_fullsized":"2023-03-03T06:25:24.921515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125657+0000","last_change":"2023-03-03T06:25:24.948250+0000","last_active":"2023-03-03T06:25:26.125657+0000","last_peered":"2023-03-03T06:25:26.125657+0000","last_clean":"2023-03-03T06:25:26.125657+0000","last_became_active":"2023-03-03T06:25:24.947976+0000","last_became_peered":"2023-03-03T06:25:24.947976+0000","last_unstale":"2023-03-03T06:25:26.125657+0000","last_undegraded":"2023-03-03T06:25:26.125657+0000","last_fullsized":"2023-03-03T06:25:26.125657+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:10:06.698944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"55'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126879+0000","last_change":"2023-03-03T06:25:24.524124+0000","last_active":"2023-03-03T06:25:26.126879+0000","last_peered":"2023-03-03T06:25:26.126879+0000","last_clean":"2023-03-03T06:25:26.126879+0000","last_became_active":"2023-03-03T06:25:24.523594+0000","last_became_peered":"2023-03-03T06:25:24.523594+0000","last_unstale":"2023-03-03T06:25:26.126879+0000","last_undegraded":"2023-03-03T06:25:26.126879+0000","last_fullsized":"2023-03-03T06:25:26.126879+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:52:45.369663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":28,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.928268+0000","last_change":"2023-03-03T06:25:05.432050+0000","last_active":"2023-03-03T06:25:24.928268+0000","last_peered":"2023-03-03T06:25:24.928268+0000","last_clean":"2023-03-03T06:25:24.928268+0000","last_became_active":"2023-03-03T06:25:04.595433+0000","last_became_peered":"2023-03-03T06:25:04.595433+0000","last_unstale":"2023-03-03T06:25:24.928268+0000","last_undegraded":"2023-03-03T06:25:24.928268+0000","last_fullsized":"2023-03-03T06:25:24.928268+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016573409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":42,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.927094+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:25:24.927094+0000","last_peered":"2023-03-03T06:25:24.927094+0000","last_clean":"2023-03-03T06:25:24.927094+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:25:24.927094+0000","last_undegraded":"2023-03-03T06:25:24.927094+0000","last_fullsized":"2023-03-03T06:25:24.927094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.126454+0000","last_change":"2023-03-03T06:25:24.950252+0000","last_active":"2023-03-03T06:25:26.126454+0000","last_peered":"2023-03-03T06:25:26.126454+0000","last_clean":"2023-03-03T06:25:26.126454+0000","last_became_active":"2023-03-03T06:25:24.949929+0000","last_became_peered":"2023-03-03T06:25:24.949929+0000","last_unstale":"2023-03-03T06:25:26.126454+0000","last_undegraded":"2023-03-03T06:25:26.126454+0000","last_fullsized":"2023-03-03T06:25:26.126454+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:24.490870+0000","last_clean_scrub_stamp":"2023-03-03T06:25:24.490870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:18:23.806132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"55'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-03-03T06:25:26.125532+0000","last_change":"2023-03-03T06:25:24.510986+0000","last_active":"2023-03-03T06:25:26.125532+0000","last_peered":"2023-03-03T06:25:26.125532+0000","last_clean":"2023-03-03T06:25:26.125532+0000","last_became_active":"2023-03-03T06:25:24.510715+0000","last_became_peered":"2023-03-03T06:25:24.510715+0000","last_unstale":"2023-03-03T06:25:26.125532+0000","last_undegraded":"2023-03-03T06:25:26.125532+0000","last_fullsized":"2023-03-03T06:25:26.125532+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:23.486351+0000","last_clean_scrub_stamp":"2023-03-03T06:25:23.486351+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:08:59.238203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.923851+0000","last_change":"2023-03-03T06:25:05.431790+0000","last_active":"2023-03-03T06:25:24.923851+0000","last_peered":"2023-03-03T06:25:24.923851+0000","last_clean":"2023-03-03T06:25:24.923851+0000","last_became_active":"2023-03-03T06:25:04.595837+0000","last_became_peered":"2023-03-03T06:25:04.595837+0000","last_unstale":"2023-03-03T06:25:24.923851+0000","last_undegraded":"2023-03-03T06:25:24.923851+0000","last_fullsized":"2023-03-03T06:25:24.923851+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:08:49.614056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019659870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":42,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-03-03T06:25:24.926531+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:25:24.926531+0000","last_peered":"2023-03-03T06:25:24.926531+0000","last_clean":"2023-03-03T06:25:24.926531+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:25:24.926531+0000","last_undegraded":"2023-03-03T06:25:24.926531+0000","last_fullsized":"2023-03-03T06:25:24.926531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10408,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":9152,"kb_avail":94361432,"statfs":{"total":96636764160,"available":96626106368,"internally_reserved":0,"allocated":1277952,"data_stored":909264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9371648},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.443}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.57599999999999996}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.749}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9112,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362728,"statfs":{"total":96636764160,"available":96627433472,"internally_reserved":0,"allocated":671744,"data_stored":318170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.627}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.375}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46500000000000002}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.498},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10356,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":9088,"kb_avail":94361484,"statfs":{"total":96636764160,"available":96626159616,"internally_reserved":0,"allocated":1290240,"data_stored":910800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9306112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.48399999999999999}]},{"osd":3,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.498}]},{"osd":4,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.91000000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.89900000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.86899999999999999}]},{"osd":7,"last update":"Fri Mar 3 06:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.82299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9296,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362544,"statfs":{"total":96636764160,"available":96627245056,"internally_reserved":0,"allocated":663552,"data_stored":317175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Mar 3 06:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.64300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9044,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362796,"statfs":{"total":96636764160,"available":96627503104,"internally_reserved":0,"allocated":667648,"data_stored":318136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.55300000000000005}]},{"osd":1,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":7.4820000000000002,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.58899999999999997}]},{"osd":4,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.76400000000000001}]},{"osd":6,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.747}]},{"osd":7,"last update":"Fri Mar 3 06:24:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":4.1390000000000002,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362540,"statfs":{"total":96636764160,"available":96627240960,"internally_reserved":0,"allocated":667648,"data_stored":318136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.36499999999999999}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.38700000000000001}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.33200000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.495}]},{"osd":5,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42099999999999999}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.43099999999999999}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.502},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.48699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9440,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362400,"statfs":{"total":96636764160,"available":96627097600,"internally_reserved":0,"allocated":679936,"data_stored":319684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38600000000000001}]},{"osd":6,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Mar 3 06:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9236,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362604,"statfs":{"total":96636764160,"available":96627306496,"internally_reserved":0,"allocated":667648,"data_stored":317197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67800000000000005}]},{"osd":4,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.39200000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55200000000000005}]},{"osd":7,"last update":"Fri Mar 3 06:24:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:25:34.043 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-03T06:25:34.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-03-03T06:25:34.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.206+0000 7ff483e74700 1 Processor -- start 2023-03-03T06:25:34.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.206+0000 7ff483e74700 1 -- start start 2023-03-03T06:25:34.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff483e74700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff47c0af110 0x7ff47c0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:34.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff483e74700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff47c0b2250 0x7ff47c0cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:34.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff483e74700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c0cd990 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff483e74700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47c0cb830 con 0x7ff47c0af110 2023-03-03T06:25:34.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff483e74700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0cdf50 con 0x7ff47c0b2250 2023-03-03T06:25:34.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff481c10700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff47c0af110 0x7ff47c0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:34.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff482411700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff47c0cb3b0 0x7ff47c0ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34494/0 (socket says 172.21.15.5:34494) 2023-03-03T06:25:34.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff482411700 1 -- 172.21.15.5:0/3550320940 learned_addr learned my addr 172.21.15.5:0/3550320940 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:34.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff48140f700 1 --2- 172.21.15.5:0/3550320940 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff47c0b2250 0x7ff47c0cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:34.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff481c10700 1 -- 172.21.15.5:0/3550320940 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff47c0b2250 msgr2=0x7ff47c0cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:34.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff481c10700 1 --2- 172.21.15.5:0/3550320940 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff47c0b2250 0x7ff47c0cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff481c10700 1 -- 172.21.15.5:0/3550320940 >> v1:172.21.15.5:6789/0 conn(0x7ff47c0cb3b0 legacy=0x7ff47c0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff481c10700 1 -- 172.21.15.5:0/3550320940 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c0cf690 con 0x7ff47c0af110 2023-03-03T06:25:34.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff480c0e700 1 -- 172.21.15.5:0/3550320940 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073993914 0 0) 0x7ff47c0cd990 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff481c10700 1 --2- 172.21.15.5:0/3550320940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff47c0af110 0x7ff47c0cd350 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff478009840 tx=0x7ff478009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe7da1ef5a6be7d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:34.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff480c0e700 1 -- 172.21.15.5:0/3550320940 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478011830 con 0x7ff47c0af110 2023-03-03T06:25:34.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff480c0e700 1 -- 172.21.15.5:0/3550320940 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff478011990 con 0x7ff47c0af110 2023-03-03T06:25:34.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.207+0000 7ff480c0e700 1 -- 172.21.15.5:0/3550320940 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff478011d20 con 0x7ff47c0af110 2023-03-03T06:25:34.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.208+0000 7ff483e74700 1 -- 172.21.15.5:0/3550320940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff47c0af110 msgr2=0x7ff47c0cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.208+0000 7ff483e74700 1 --2- 172.21.15.5:0/3550320940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff47c0af110 0x7ff47c0cd350 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff478009840 tx=0x7ff478009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.208+0000 7ff483e74700 1 -- 172.21.15.5:0/3550320940 shutdown_connections 2023-03-03T06:25:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.208+0000 7ff483e74700 1 --2- 172.21.15.5:0/3550320940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff47c0af110 0x7ff47c0cd350 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.208+0000 7ff483e74700 1 --2- 172.21.15.5:0/3550320940 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff47c0b2250 0x7ff47c0cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.208+0000 7ff483e74700 1 -- 172.21.15.5:0/3550320940 >> 172.21.15.5:0/3550320940 conn(0x7ff47c0cc840 msgr2=0x7ff47c0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.208+0000 7ff483e74700 1 -- 172.21.15.5:0/3550320940 shutdown_connections 2023-03-03T06:25:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.208+0000 7ff483e74700 1 -- 172.21.15.5:0/3550320940 wait complete. 2023-03-03T06:25:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.209+0000 7ff483e74700 1 Processor -- start 2023-03-03T06:25:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.209+0000 7ff483e74700 1 -- start start 2023-03-03T06:25:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff483e74700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff47c0af110 0x7ff47c0c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff483e74700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff47c0b2250 0x7ff47c1f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff483e74700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff47c0cb3b0 0x7ff47c15e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff483e74700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c1f25d0 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff483e74700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c1f3060 con 0x7ff47c0af110 2023-03-03T06:25:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff483e74700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0b4260 con 0x7ff47c0b2250 2023-03-03T06:25:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff482411700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff47c0cb3b0 0x7ff47c15e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff482411700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff47c0cb3b0 0x7ff47c15e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44658/0 (socket says 172.21.15.5:44658) 2023-03-03T06:25:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff482411700 1 -- 172.21.15.5:0/861151980 learned_addr learned my addr 172.21.15.5:0/861151980 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff48140f700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff47c0b2250 0x7ff47c1f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff481c10700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff47c0af110 0x7ff47c0c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff482411700 1 -- 172.21.15.5:0/861151980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff47c0b2250 msgr2=0x7ff47c1f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff482411700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff47c0b2250 0x7ff47c1f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff482411700 1 -- 172.21.15.5:0/861151980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff47c0af110 msgr2=0x7ff47c0c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff482411700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff47c0af110 0x7ff47c0c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.210+0000 7ff482411700 1 -- 172.21.15.5:0/861151980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4780094a0 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.211+0000 7ff481c10700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff47c0af110 0x7ff47c0c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.211+0000 7ff482411700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff47c0cb3b0 0x7ff47c15e0d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff47400cc70 tx=0x7ff47400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.211+0000 7ff46e7fc700 1 -- 172.21.15.5:0/861151980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47400ab70 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.211+0000 7ff46e7fc700 1 -- 172.21.15.5:0/861151980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47400acf0 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.211+0000 7ff46e7fc700 1 -- 172.21.15.5:0/861151980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474007310 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.211+0000 7ff483e74700 1 -- 172.21.15.5:0/861151980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c0cdbe0 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.211+0000 7ff483e74700 1 -- 172.21.15.5:0/861151980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c06c850 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.212+0000 7ff483e74700 1 -- 172.21.15.5:0/861151980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c06d3d0 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.212+0000 7ff46e7fc700 1 -- 172.21.15.5:0/861151980 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff474010070 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.213+0000 7ff46e7fc700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff4600682f0 0x7ff46006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.213+0000 7ff46e7fc700 1 -- 172.21.15.5:0/861151980 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff474085970 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.213+0000 7ff481c10700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff4600682f0 0x7ff46006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.213+0000 7ff481c10700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff4600682f0 0x7ff46006a7a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff4780090b0 tx=0x7ff47801c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.217+0000 7ff46e7fc700 1 -- 172.21.15.5:0/861151980 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff474051e40 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.489+0000 7ff483e74700 1 -- 172.21.15.5:0/861151980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7ff47c0b43d0 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.493+0000 7ff46e7fc700 1 -- 172.21.15.5:0/861151980 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff47400ae60 con 0x7ff47c0cb3b0 2023-03-03T06:25:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.495+0000 7ff483e74700 1 -- 172.21.15.5:0/861151980 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff4600682f0 msgr2=0x7ff46006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.495+0000 7ff483e74700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff4600682f0 0x7ff46006a7a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff4780090b0 tx=0x7ff47801c040 comp rx=0 tx=0).stop 2023-03-03T06:25:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.495+0000 7ff483e74700 1 -- 172.21.15.5:0/861151980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff47c0cb3b0 msgr2=0x7ff47c15e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.495+0000 7ff483e74700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff47c0cb3b0 0x7ff47c15e0d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff47400cc70 tx=0x7ff47400cf80 comp rx=0 tx=0).stop 2023-03-03T06:25:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.495+0000 7ff483e74700 1 -- 172.21.15.5:0/861151980 shutdown_connections 2023-03-03T06:25:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.495+0000 7ff483e74700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff47c0cb3b0 0x7ff47c15e0d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.495+0000 7ff483e74700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff47c0af110 0x7ff47c0c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.495+0000 7ff483e74700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff4600682f0 0x7ff46006a7a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.495+0000 7ff483e74700 1 --2- 172.21.15.5:0/861151980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff47c0b2250 0x7ff47c1f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.495+0000 7ff483e74700 1 -- 172.21.15.5:0/861151980 >> 172.21.15.5:0/861151980 conn(0x7ff47c0cc840 msgr2=0x7ff47c0b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.495+0000 7ff483e74700 1 -- 172.21.15.5:0/861151980 shutdown_connections 2023-03-03T06:25:34.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.495+0000 7ff483e74700 1 -- 172.21.15.5:0/861151980 wait complete. 2023-03-03T06:25:34.498 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-03-03T06:25:34.508 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:34.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.632+0000 7ff133128700 1 Processor -- start 2023-03-03T06:25:34.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.632+0000 7ff133128700 1 -- start start 2023-03-03T06:25:34.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.632+0000 7ff133128700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff12c15dd10 0x7ff12c06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:34.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.632+0000 7ff133128700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff12c0cebc0 0x7ff12c0cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:34.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.632+0000 7ff133128700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12c06e3f0 con 0x7ff12c159550 2023-03-03T06:25:34.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.632+0000 7ff133128700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12c15e160 con 0x7ff12c0cebc0 2023-03-03T06:25:34.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.632+0000 7ff133128700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c06d6f0 con 0x7ff12c15dd10 2023-03-03T06:25:34.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.633+0000 7ff1316c5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff12c0cebc0 0x7ff12c0cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.633+0000 7ff1316c5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff12c0cebc0 0x7ff12c0cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44666/0 (socket says 172.21.15.5:44666) 2023-03-03T06:25:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.633+0000 7ff1316c5700 1 -- 172.21.15.5:0/4172459000 learned_addr learned my addr 172.21.15.5:0/4172459000 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.633+0000 7ff12bfff700 1 --2- 172.21.15.5:0/4172459000 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff12c15dd10 0x7ff12c06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.633+0000 7ff1316c5700 1 -- 172.21.15.5:0/4172459000 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff12c15dd10 msgr2=0x7ff12c06d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.633+0000 7ff1316c5700 1 --2- 172.21.15.5:0/4172459000 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff12c15dd10 0x7ff12c06d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.633+0000 7ff1316c5700 1 -- 172.21.15.5:0/4172459000 >> v1:172.21.15.191:6789/0 conn(0x7ff12c159550 legacy=0x7ff12c06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.633+0000 7ff1316c5700 1 -- 172.21.15.5:0/4172459000 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c06e6d0 con 0x7ff12c0cebc0 2023-03-03T06:25:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.633+0000 7ff1316c5700 1 --2- 172.21.15.5:0/4172459000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0cebc0 0x7ff12c0cf040 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff124009e50 tx=0x7ff12400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab56eb290178b1cb server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.633+0000 7ff12b7fe700 1 -- 172.21.15.5:0/4172459000 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400e070 con 0x7ff12c0cebc0 2023-03-03T06:25:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.633+0000 7ff12b7fe700 1 -- 172.21.15.5:0/4172459000 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12400b910 con 0x7ff12c0cebc0 2023-03-03T06:25:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.633+0000 7ff12b7fe700 1 -- 172.21.15.5:0/4172459000 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400bcc0 con 0x7ff12c0cebc0 2023-03-03T06:25:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.634+0000 7ff133128700 1 -- 172.21.15.5:0/4172459000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0cebc0 msgr2=0x7ff12c0cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.634+0000 7ff133128700 1 --2- 172.21.15.5:0/4172459000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0cebc0 0x7ff12c0cf040 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff124009e50 tx=0x7ff12400b330 comp rx=0 tx=0).stop 2023-03-03T06:25:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.634+0000 7ff133128700 1 -- 172.21.15.5:0/4172459000 shutdown_connections 2023-03-03T06:25:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.634+0000 7ff133128700 1 --2- 172.21.15.5:0/4172459000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c0cebc0 0x7ff12c0cf040 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.634+0000 7ff133128700 1 --2- 172.21.15.5:0/4172459000 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff12c15dd10 0x7ff12c06d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.634+0000 7ff133128700 1 -- 172.21.15.5:0/4172459000 >> 172.21.15.5:0/4172459000 conn(0x7ff12c0cfd00 msgr2=0x7ff12c0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.634+0000 7ff133128700 1 -- 172.21.15.5:0/4172459000 shutdown_connections 2023-03-03T06:25:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.634+0000 7ff133128700 1 -- 172.21.15.5:0/4172459000 wait complete. 2023-03-03T06:25:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.635+0000 7ff133128700 1 Processor -- start 2023-03-03T06:25:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.635+0000 7ff133128700 1 -- start start 2023-03-03T06:25:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff133128700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff12c0cebc0 0x7ff12c145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff133128700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c159550 0x7ff12c0b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff133128700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff12c15dd10 0x7ff12c0b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff133128700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0b3290 con 0x7ff12c159550 2023-03-03T06:25:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff133128700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0b59b0 con 0x7ff12c15dd10 2023-03-03T06:25:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff133128700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c153250 con 0x7ff12c0cebc0 2023-03-03T06:25:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff12bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c159550 0x7ff12c0b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff12bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c159550 0x7ff12c0b4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44668/0 (socket says 172.21.15.5:44668) 2023-03-03T06:25:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff12bfff700 1 -- 172.21.15.5:0/1565317161 learned_addr learned my addr 172.21.15.5:0/1565317161 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff130ec4700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff12c0cebc0 0x7ff12c145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff1316c5700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff12c15dd10 0x7ff12c0b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff12bfff700 1 -- 172.21.15.5:0/1565317161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff12c0cebc0 msgr2=0x7ff12c145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff12bfff700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff12c0cebc0 0x7ff12c145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff12bfff700 1 -- 172.21.15.5:0/1565317161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff12c15dd10 msgr2=0x7ff12c0b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff12bfff700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff12c15dd10 0x7ff12c0b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.636+0000 7ff12bfff700 1 -- 172.21.15.5:0/1565317161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124009b30 con 0x7ff12c159550 2023-03-03T06:25:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.637+0000 7ff12bfff700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c159550 0x7ff12c0b4b60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff118010ab0 tx=0x7ff118010e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.637+0000 7ff1297fa700 1 -- 172.21.15.5:0/1565317161 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11800ed20 con 0x7ff12c159550 2023-03-03T06:25:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.637+0000 7ff1297fa700 1 -- 172.21.15.5:0/1565317161 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11800ee80 con 0x7ff12c159550 2023-03-03T06:25:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.637+0000 7ff133128700 1 -- 172.21.15.5:0/1565317161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c06c9b0 con 0x7ff12c159550 2023-03-03T06:25:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.637+0000 7ff1297fa700 1 -- 172.21.15.5:0/1565317161 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118011650 con 0x7ff12c159550 2023-03-03T06:25:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.637+0000 7ff133128700 1 -- 172.21.15.5:0/1565317161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c06c6d0 con 0x7ff12c159550 2023-03-03T06:25:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.638+0000 7ff133128700 1 -- 172.21.15.5:0/1565317161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12c06cc90 con 0x7ff12c159550 2023-03-03T06:25:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.638+0000 7ff1297fa700 1 -- 172.21.15.5:0/1565317161 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff118020030 con 0x7ff12c159550 2023-03-03T06:25:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.638+0000 7ff1297fa700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff1100682f0 0x7ff11006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.639+0000 7ff1297fa700 1 -- 172.21.15.5:0/1565317161 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff118088000 con 0x7ff12c159550 2023-03-03T06:25:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.639+0000 7ff130ec4700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff1100682f0 0x7ff11006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.639+0000 7ff130ec4700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff1100682f0 0x7ff11006a7a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff1200016c0 tx=0x7ff120009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.643+0000 7ff1297fa700 1 -- 172.21.15.5:0/1565317161 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff1180525e0 con 0x7ff12c159550 2023-03-03T06:25:34.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.879+0000 7ff133128700 1 -- 172.21.15.5:0/1565317161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff12c06d840 con 0x7ff12c159550 2023-03-03T06:25:34.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.880+0000 7ff1297fa700 1 -- 172.21.15.5:0/1565317161 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4643 (secure 0 0 0) 0x7ff11801e070 con 0x7ff12c159550 2023-03-03T06:25:34.881 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:34.881 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1328243693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":1328243693},{"type":"v1","addr":"172.21.15.191:6835","nonce":1328243693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/2339980581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2339980581},{"type":"v1","addr":"172.21.15.5:6836","nonce":2339980581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/620202132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":620202132},{"type":"v1","addr":"172.21.15.5:6837","nonce":620202132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:25:24.916109+0000","modified":"2023-03-03T06:25:27.928605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5410":{"gid":5410,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6834/950486040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":950486040},{"type":"v1","addr":"172.21.15.191:6834","nonce":950486040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-03-03T06:25:34.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.881+0000 7ff133128700 1 -- 172.21.15.5:0/1565317161 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff1100682f0 msgr2=0x7ff11006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.881+0000 7ff133128700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff1100682f0 0x7ff11006a7a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff1200016c0 tx=0x7ff120009040 comp rx=0 tx=0).stop 2023-03-03T06:25:34.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.881+0000 7ff133128700 1 -- 172.21.15.5:0/1565317161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c159550 msgr2=0x7ff12c0b4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:34.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.882+0000 7ff133128700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c159550 0x7ff12c0b4b60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff118010ab0 tx=0x7ff118010e70 comp rx=0 tx=0).stop 2023-03-03T06:25:34.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.882+0000 7ff133128700 1 -- 172.21.15.5:0/1565317161 shutdown_connections 2023-03-03T06:25:34.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.882+0000 7ff133128700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff12c15dd10 0x7ff12c0b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.882+0000 7ff133128700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff1100682f0 0x7ff11006a7a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.882+0000 7ff133128700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff12c0cebc0 0x7ff12c145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.882+0000 7ff133128700 1 --2- 172.21.15.5:0/1565317161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff12c159550 0x7ff12c0b4b60 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.882+0000 7ff133128700 1 -- 172.21.15.5:0/1565317161 >> 172.21.15.5:0/1565317161 conn(0x7ff12c0cfd00 msgr2=0x7ff12c0cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.882+0000 7ff133128700 1 -- 172.21.15.5:0/1565317161 shutdown_connections 2023-03-03T06:25:34.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:34.882+0000 7ff133128700 1 -- 172.21.15.5:0/1565317161 wait complete. 2023-03-03T06:25:34.885 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2023-03-03T06:25:35.297 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-03T06:25:24.916109+0000', 'modified': '2023-03-03T06:25:27.928605+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5410}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5410': {'gid': 5410, 'name': 'b', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.191:6834/950486040', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 950486040}, {'type': 'v1', 'addr': '172.21.15.191:6834', 'nonce': 950486040}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-03T06:25:35.298 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-03T06:25:35.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-03-03T06:25:35.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.431+0000 7f0a4391d700 1 Processor -- start 2023-03-03T06:25:35.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.432+0000 7f0a4391d700 1 -- start start 2023-03-03T06:25:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.432+0000 7f0a4391d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a3c15a480 0x7f0a3c0d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.432+0000 7f0a4391d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a3c15a850 0x7f0a3c0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.432+0000 7f0a4391d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c0cbcd0 con 0x7f0a3c0cb4a0 2023-03-03T06:25:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.432+0000 7f0a4391d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c0cf2a0 con 0x7f0a3c15a480 2023-03-03T06:25:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.432+0000 7f0a4391d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0cb9f0 con 0x7f0a3c15a850 2023-03-03T06:25:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.432+0000 7f0a416b9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0a3c15a480 0x7f0a3c0d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.432+0000 7f0a41eba700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0a3c0cb4a0 0x7f0a3c0cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34522/0 (socket says 172.21.15.5:34522) 2023-03-03T06:25:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.432+0000 7f0a41eba700 1 -- 172.21.15.5:0/1894750012 learned_addr learned my addr 172.21.15.5:0/1894750012 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.433+0000 7f0a40eb8700 1 --2- 172.21.15.5:0/1894750012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a3c15a850 0x7f0a3c0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.433+0000 7f0a33fff700 1 -- 172.21.15.5:0/1894750012 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087312532 0 0) 0x7f0a3c0cbcd0 con 0x7f0a3c0cb4a0 2023-03-03T06:25:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.433+0000 7f0a33fff700 1 -- 172.21.15.5:0/1894750012 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a280035b0 con 0x7f0a3c0cb4a0 2023-03-03T06:25:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.433+0000 7f0a416b9700 1 -- 172.21.15.5:0/1894750012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a3c15a850 msgr2=0x7f0a3c0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.433+0000 7f0a416b9700 1 --2- 172.21.15.5:0/1894750012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a3c15a850 0x7f0a3c0b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.433+0000 7f0a416b9700 1 -- 172.21.15.5:0/1894750012 >> v1:172.21.15.5:6789/0 conn(0x7f0a3c0cb4a0 legacy=0x7f0a3c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.433+0000 7f0a416b9700 1 -- 172.21.15.5:0/1894750012 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0cebe0 con 0x7f0a3c15a480 2023-03-03T06:25:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.433+0000 7f0a40eb8700 1 --2- 172.21.15.5:0/1894750012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a3c15a850 0x7f0a3c0b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.433+0000 7f0a416b9700 1 --2- 172.21.15.5:0/1894750012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c15a480 0x7f0a3c0d1600 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009870 tx=0x7f0a38009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94adc2a064d4c7f2 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.433+0000 7f0a33fff700 1 -- 172.21.15.5:0/1894750012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38011830 con 0x7f0a3c15a480 2023-03-03T06:25:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.433+0000 7f0a33fff700 1 -- 172.21.15.5:0/1894750012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a38011990 con 0x7f0a3c15a480 2023-03-03T06:25:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.433+0000 7f0a33fff700 1 -- 172.21.15.5:0/1894750012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38011d00 con 0x7f0a3c15a480 2023-03-03T06:25:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.434+0000 7f0a4391d700 1 -- 172.21.15.5:0/1894750012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c15a480 msgr2=0x7f0a3c0d1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.434+0000 7f0a4391d700 1 --2- 172.21.15.5:0/1894750012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c15a480 0x7f0a3c0d1600 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009870 tx=0x7f0a38009b80 comp rx=0 tx=0).stop 2023-03-03T06:25:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.434+0000 7f0a4391d700 1 -- 172.21.15.5:0/1894750012 shutdown_connections 2023-03-03T06:25:35.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.434+0000 7f0a4391d700 1 --2- 172.21.15.5:0/1894750012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c15a480 0x7f0a3c0d1600 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.434+0000 7f0a4391d700 1 --2- 172.21.15.5:0/1894750012 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a3c15a850 0x7f0a3c0b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.434+0000 7f0a4391d700 1 -- 172.21.15.5:0/1894750012 >> 172.21.15.5:0/1894750012 conn(0x7f0a3c06f3c0 msgr2=0x7f0a3c06f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.434+0000 7f0a4391d700 1 -- 172.21.15.5:0/1894750012 shutdown_connections 2023-03-03T06:25:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.434+0000 7f0a4391d700 1 -- 172.21.15.5:0/1894750012 wait complete. 2023-03-03T06:25:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.435+0000 7f0a4391d700 1 Processor -- start 2023-03-03T06:25:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.435+0000 7f0a4391d700 1 -- start start 2023-03-03T06:25:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a4391d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a3c0cb4a0 0x7f0a3c1f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a4391d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a3c15a480 0x7f0a3c0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a4391d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c15a850 0x7f0a3c152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a4391d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c152630 con 0x7f0a3c15a850 2023-03-03T06:25:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a4391d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c151a20 con 0x7f0a3c15a480 2023-03-03T06:25:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a4391d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c151d00 con 0x7f0a3c0cb4a0 2023-03-03T06:25:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a41eba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c15a850 0x7f0a3c152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a41eba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c15a850 0x7f0a3c152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44684/0 (socket says 172.21.15.5:44684) 2023-03-03T06:25:35.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a41eba700 1 -- 172.21.15.5:0/1685973156 learned_addr learned my addr 172.21.15.5:0/1685973156 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a40eb8700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a3c15a480 0x7f0a3c0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a416b9700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a3c0cb4a0 0x7f0a3c1f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a41eba700 1 -- 172.21.15.5:0/1685973156 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a3c0cb4a0 msgr2=0x7f0a3c1f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a41eba700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a3c0cb4a0 0x7f0a3c1f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a41eba700 1 -- 172.21.15.5:0/1685973156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a3c15a480 msgr2=0x7f0a3c0ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a41eba700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a3c15a480 0x7f0a3c0ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.436+0000 7f0a41eba700 1 -- 172.21.15.5:0/1685973156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a380094a0 con 0x7f0a3c15a850 2023-03-03T06:25:35.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.437+0000 7f0a41eba700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c15a850 0x7f0a3c152ac0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400cbb0 tx=0x7f0a3400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.437+0000 7f0a31ffb700 1 -- 172.21.15.5:0/1685973156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3400ab50 con 0x7f0a3c15a850 2023-03-03T06:25:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.437+0000 7f0a31ffb700 1 -- 172.21.15.5:0/1685973156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3400acb0 con 0x7f0a3c15a850 2023-03-03T06:25:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.437+0000 7f0a4391d700 1 -- 172.21.15.5:0/1685973156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c0d1b40 con 0x7f0a3c15a850 2023-03-03T06:25:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.437+0000 7f0a31ffb700 1 -- 172.21.15.5:0/1685973156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a34012600 con 0x7f0a3c15a850 2023-03-03T06:25:35.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.437+0000 7f0a4391d700 1 -- 172.21.15.5:0/1685973156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c0ceec0 con 0x7f0a3c15a850 2023-03-03T06:25:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.439+0000 7f0a31ffb700 1 -- 172.21.15.5:0/1685973156 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0a34019030 con 0x7f0a3c15a850 2023-03-03T06:25:35.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.439+0000 7f0a31ffb700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0a200682f0 0x7f0a2006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.439+0000 7f0a31ffb700 1 -- 172.21.15.5:0/1685973156 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0a34085ae0 con 0x7f0a3c15a850 2023-03-03T06:25:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.439+0000 7f0a416b9700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0a200682f0 0x7f0a2006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.439+0000 7f0a416b9700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0a200682f0 0x7f0a2006a7a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0a380090b0 tx=0x7f0a38008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.441+0000 7f0a4faa6b80 1 Processor -- start 2023-03-03T06:25:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.441+0000 7f0a4faa6b80 1 -- start start 2023-03-03T06:25:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a4faa6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 0x55e07da361f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a4faa6b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da332e0 0x55e07da55140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a4faa6b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da5fc20 0x55e07da60090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a4faa6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e07d91fbc0 con 0x55e07da54d70 2023-03-03T06:25:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a4faa6b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e07d98e350 con 0x55e07da5fc20 2023-03-03T06:25:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a4faa6b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e07d987880 con 0x55e07da332e0 2023-03-03T06:25:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a416b9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 0x55e07da361f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a416b9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 0x55e07da361f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44690/0 (socket says 172.21.15.5:44690) 2023-03-03T06:25:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a416b9700 1 -- 172.21.15.5:0/3839250726 learned_addr learned my addr 172.21.15.5:0/3839250726 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:35.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a40eb8700 1 --2- 172.21.15.5:0/3839250726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da332e0 0x55e07da55140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a41eba700 1 --2- 172.21.15.5:0/3839250726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da5fc20 0x55e07da60090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a416b9700 1 -- 172.21.15.5:0/3839250726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da332e0 msgr2=0x55e07da55140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a416b9700 1 --2- 172.21.15.5:0/3839250726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da332e0 0x55e07da55140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a416b9700 1 -- 172.21.15.5:0/3839250726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da5fc20 msgr2=0x55e07da60090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a416b9700 1 --2- 172.21.15.5:0/3839250726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da5fc20 0x55e07da60090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a416b9700 1 -- 172.21.15.5:0/3839250726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e07d8095e0 con 0x55e07da54d70 2023-03-03T06:25:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a416b9700 1 --2- 172.21.15.5:0/3839250726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 0x55e07da361f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0a38011730 tx=0x7f0a38010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe5b0f581f4d48c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:35.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.442+0000 7f0a26ffd700 1 -- 172.21.15.5:0/3839250726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3802b070 con 0x55e07da54d70 2023-03-03T06:25:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.443+0000 7f0a26ffd700 1 -- 172.21.15.5:0/3839250726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a38011760 con 0x55e07da54d70 2023-03-03T06:25:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.443+0000 7f0a26ffd700 1 -- 172.21.15.5:0/3839250726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3801f070 con 0x55e07da54d70 2023-03-03T06:25:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.443+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/3839250726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 msgr2=0x55e07da361f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.443+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/3839250726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 0x55e07da361f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0a38011730 tx=0x7f0a38010000 comp rx=0 tx=0).stop 2023-03-03T06:25:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.443+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/3839250726 shutdown_connections 2023-03-03T06:25:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.443+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/3839250726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da5fc20 0x55e07da60090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.443+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/3839250726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 0x55e07da361f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.443+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/3839250726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da332e0 0x55e07da55140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.443+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/3839250726 >> 172.21.15.5:0/3839250726 conn(0x55e07da2a720 msgr2=0x55e07da2fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:35.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.443+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/3839250726 shutdown_connections 2023-03-03T06:25:35.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.443+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/3839250726 wait complete. 2023-03-03T06:25:35.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.444+0000 7f0a4faa6b80 1 -- start start 2023-03-03T06:25:35.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.444+0000 7f0a4faa6b80 1 Processor -- start 2023-03-03T06:25:35.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a4faa6b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da332e0 0x55e07da74940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a4faa6b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da54d70 0x55e07da73bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a4faa6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da5fc20 0x55e07da895c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a4faa6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e07d80b8d0 con 0x55e07da5fc20 2023-03-03T06:25:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a4faa6b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e07da76c30 con 0x55e07da332e0 2023-03-03T06:25:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a4faa6b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e07da72220 con 0x55e07da54d70 2023-03-03T06:25:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a4faa6b80 10 client.0 _ll_register_callbacks cb 0x55e07d925630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T06:25:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a41eba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da5fc20 0x55e07da895c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a41eba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da5fc20 0x55e07da895c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44700/0 (socket says 172.21.15.5:44700) 2023-03-03T06:25:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a41eba700 1 -- 172.21.15.5:0/3219956833 learned_addr learned my addr 172.21.15.5:0/3219956833 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a416b9700 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da332e0 0x55e07da74940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a40eb8700 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da54d70 0x55e07da73bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a41eba700 1 -- 172.21.15.5:0/3219956833 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da54d70 msgr2=0x55e07da73bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a41eba700 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da54d70 0x55e07da73bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a41eba700 1 -- 172.21.15.5:0/3219956833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da332e0 msgr2=0x55e07da74940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a41eba700 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da332e0 0x55e07da74940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a41eba700 1 -- 172.21.15.5:0/3219956833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c0cebe0 con 0x55e07da5fc20 2023-03-03T06:25:35.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a40eb8700 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da54d70 0x55e07da73bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:35.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a41eba700 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da5fc20 0x55e07da895c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0a3405d840 tx=0x7f0a34055560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d3e1d419d12b96 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:35.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.445+0000 7f0a1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-03-03T06:25:35.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a1bfff700 1 -- 172.21.15.5:0/3219956833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3406d030 con 0x55e07da5fc20 2023-03-03T06:25:35.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a1bfff700 1 -- 172.21.15.5:0/3219956833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0a34054ef0 con 0x55e07da5fc20 2023-03-03T06:25:35.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/3219956833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e07d955140 con 0x55e07da5fc20 2023-03-03T06:25:35.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a1bfff700 1 -- 172.21.15.5:0/3219956833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a340550b0 con 0x55e07da5fc20 2023-03-03T06:25:35.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a4faa6b80 10 client.5958 fetch_fsmap learned FSMap version 25 2023-03-03T06:25:35.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/3219956833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55e07d7b5d90 con 0x55e07da5fc20 2023-03-03T06:25:35.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a1bfff700 1 -- 172.21.15.5:0/3219956833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e07d955140 con 0x55e07da5fc20 2023-03-03T06:25:35.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a1bfff700 1 -- 172.21.15.5:0/3219956833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f0a34055d30 con 0x55e07da5fc20 2023-03-03T06:25:35.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a4faa6b80 10 client.5958 fetch_fsmap finished waiting for FSMap version 25 2023-03-03T06:25:35.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a4faa6b80 10 client.5958 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-03T06:25:35.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a4faa6b80 20 client.5958 populate_metadata read hostname 'smithi005' 2023-03-03T06:25:35.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.191:6832/950486040,v1:172.21.15.191:6834/950486040] conn(0x55e07da71cd0 0x55e07da8df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a4faa6b80 4 client.5958 mds_command: new command op to 5410 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-03T06:25:35.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/3219956833 --> [v2:172.21.15.191:6832/950486040,v1:172.21.15.191:6834/950486040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e07d80bf10 con 0x55e07da71cd0 2023-03-03T06:25:35.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.446+0000 7f0a416b9700 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.191:6832/950486040,v1:172.21.15.191:6834/950486040] conn(0x55e07da71cd0 0x55e07da8df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.447+0000 7f0a416b9700 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.191:6832/950486040,v1:172.21.15.191:6834/950486040] conn(0x55e07da71cd0 0x55e07da8df20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=993c00dc7fcb7df6 server_cookie=6c2506feb549f83d in_seq=0 out_seq=0 2023-03-03T06:25:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.447+0000 7f0a1bfff700 10 client.5958 ms_handle_connect on v2:172.21.15.191:6832/950486040 2023-03-03T06:25:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.447+0000 7f0a1bfff700 1 -- 172.21.15.5:0/3219956833 <== mds.0 v2:172.21.15.191:6832/950486040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x55e07d80bf10 con 0x55e07da71cd0 2023-03-03T06:25:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.447+0000 7f0a1bfff700 10 client.5958 handle_command_reply: tid=0 2023-03-03T06:25:35.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.448+0000 7f0a4faa6b80 1 client.5958 shutdown 2023-03-03T06:25:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.448+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/3219956833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da5fc20 msgr2=0x55e07da895c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.448+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da5fc20 0x55e07da895c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0a3405d840 tx=0x7f0a34055560 comp rx=0 tx=0).stop 2023-03-03T06:25:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.448+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/3219956833 shutdown_connections 2023-03-03T06:25:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.448+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.191:6832/950486040,v1:172.21.15.191:6834/950486040] conn(0x55e07da71cd0 0x55e07da8df20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.448+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da5fc20 0x55e07da895c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.448+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da332e0 0x55e07da74940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.448+0000 7f0a1bfff700 0 client.5958 ms_handle_reset on v2:172.21.15.191:6832/950486040 2023-03-03T06:25:35.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.448+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/3219956833 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da54d70 0x55e07da73bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.448+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/3219956833 >> 172.21.15.5:0/3219956833 conn(0x55e07da2a720 msgr2=0x55e07da2fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.448+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/3219956833 shutdown_connections 2023-03-03T06:25:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.448+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/3219956833 wait complete. 2023-03-03T06:25:35.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.448+0000 7f0a4faa6b80 20 client.5958 trim_cache size 0 max 16384 2023-03-03T06:25:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.466+0000 7f0a4faa6b80 1 Processor -- start 2023-03-03T06:25:35.467 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.466+0000 7f0a4faa6b80 1 -- start start 2023-03-03T06:25:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a4faa6b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da332e0 0x55e07da5f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a4faa6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 0x55e07da5f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a4faa6b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da5fc20 0x55e07da705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.468 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a4faa6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e07da754d0 con 0x55e07da54d70 2023-03-03T06:25:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a4faa6b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e07da7f090 con 0x55e07da5fc20 2023-03-03T06:25:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a4faa6b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e07da73610 con 0x55e07da332e0 2023-03-03T06:25:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a40eb8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 0x55e07da5f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a40eb8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 0x55e07da5f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44706/0 (socket says 172.21.15.5:44706) 2023-03-03T06:25:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a40eb8700 1 -- 172.21.15.5:0/2642784680 learned_addr learned my addr 172.21.15.5:0/2642784680 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a41eba700 1 --2- 172.21.15.5:0/2642784680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da5fc20 0x55e07da705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a416b9700 1 --2- 172.21.15.5:0/2642784680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da332e0 0x55e07da5f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a40eb8700 1 -- 172.21.15.5:0/2642784680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da332e0 msgr2=0x55e07da5f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a40eb8700 1 --2- 172.21.15.5:0/2642784680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da332e0 0x55e07da5f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a40eb8700 1 -- 172.21.15.5:0/2642784680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da5fc20 msgr2=0x55e07da705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a40eb8700 1 --2- 172.21.15.5:0/2642784680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da5fc20 0x55e07da705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a40eb8700 1 -- 172.21.15.5:0/2642784680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e07d94e140 con 0x55e07da54d70 2023-03-03T06:25:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a40eb8700 1 --2- 172.21.15.5:0/2642784680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 0x55e07da5f5e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c1efb80 tx=0x7f0a2c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25234e27cd5e4aa server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:35.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a277fe700 1 -- 172.21.15.5:0/2642784680 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c004230 con 0x55e07da54d70 2023-03-03T06:25:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a277fe700 1 -- 172.21.15.5:0/2642784680 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c00c040 con 0x55e07da54d70 2023-03-03T06:25:35.471 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.467+0000 7f0a277fe700 1 -- 172.21.15.5:0/2642784680 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0045b0 con 0x55e07da54d70 2023-03-03T06:25:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.468+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/2642784680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 msgr2=0x55e07da5f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.468+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/2642784680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 0x55e07da5f5e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c1efb80 tx=0x7f0a2c009cd0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.468+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/2642784680 shutdown_connections 2023-03-03T06:25:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.468+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/2642784680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da5fc20 0x55e07da705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.468+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/2642784680 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da332e0 0x55e07da5f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.468+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/2642784680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da54d70 0x55e07da5f5e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.468+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/2642784680 >> 172.21.15.5:0/2642784680 conn(0x55e07da2a720 msgr2=0x55e07da354f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.468+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/2642784680 shutdown_connections 2023-03-03T06:25:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.468+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/2642784680 wait complete. 2023-03-03T06:25:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.468+0000 7f0a4faa6b80 1 -- start start 2023-03-03T06:25:35.475 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.469+0000 7f0a4faa6b80 1 Processor -- start 2023-03-03T06:25:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.469+0000 7f0a4faa6b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da332e0 0x55e07da7dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.469+0000 7f0a4faa6b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da54d70 0x55e07da7e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.469+0000 7f0a4faa6b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da5fc20 0x55e07da33c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.469+0000 7f0a4faa6b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e07da70920 con 0x55e07da332e0 2023-03-03T06:25:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.469+0000 7f0a4faa6b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e07da8c180 con 0x55e07da54d70 2023-03-03T06:25:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.469+0000 7f0a4faa6b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e07da8c6b0 con 0x55e07da5fc20 2023-03-03T06:25:35.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a4faa6b80 10 client.0 _ll_register_callbacks cb 0x55e07d925630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T06:25:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a416b9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da332e0 0x55e07da7dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a416b9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da332e0 0x55e07da7dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44710/0 (socket says 172.21.15.5:44710) 2023-03-03T06:25:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a416b9700 1 -- 172.21.15.5:0/2769003977 learned_addr learned my addr 172.21.15.5:0/2769003977 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a40eb8700 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da54d70 0x55e07da7e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a41eba700 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da5fc20 0x55e07da33c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a416b9700 1 -- 172.21.15.5:0/2769003977 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da5fc20 msgr2=0x55e07da33c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a416b9700 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da5fc20 0x55e07da33c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a416b9700 1 -- 172.21.15.5:0/2769003977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da54d70 msgr2=0x55e07da7e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a416b9700 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da54d70 0x55e07da7e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a416b9700 1 -- 172.21.15.5:0/2769003977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2c0096d0 con 0x55e07da332e0 2023-03-03T06:25:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a41eba700 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da5fc20 0x55e07da33c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a416b9700 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da332e0 0x55e07da7dd60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0a38021040 tx=0x7f0a380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66cc3e363b1d92b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-03-03T06:25:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a1bfff700 1 -- 172.21.15.5:0/2769003977 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3802b040 con 0x55e07da332e0 2023-03-03T06:25:35.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a1bfff700 1 -- 172.21.15.5:0/2769003977 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0a3803baf0 con 0x55e07da332e0 2023-03-03T06:25:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/2769003977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e07da7b4f0 con 0x55e07da332e0 2023-03-03T06:25:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a1bfff700 1 -- 172.21.15.5:0/2769003977 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a3803bcd0 con 0x55e07da332e0 2023-03-03T06:25:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a4faa6b80 10 client.5964 fetch_fsmap learned FSMap version 25 2023-03-03T06:25:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/2769003977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55e07d7dc200 con 0x55e07da332e0 2023-03-03T06:25:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.470+0000 7f0a1bfff700 1 -- 172.21.15.5:0/2769003977 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e07da7b4f0 con 0x55e07da332e0 2023-03-03T06:25:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.471+0000 7f0a1bfff700 1 -- 172.21.15.5:0/2769003977 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f0a38039850 con 0x55e07da332e0 2023-03-03T06:25:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.471+0000 7f0a4faa6b80 10 client.5964 fetch_fsmap finished waiting for FSMap version 25 2023-03-03T06:25:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.471+0000 7f0a4faa6b80 10 client.5964 resolve_mds: resolved name 'b' to daemon mds.b 2023-03-03T06:25:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.471+0000 7f0a4faa6b80 20 client.5964 populate_metadata read hostname 'smithi005' 2023-03-03T06:25:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.471+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.191:6832/950486040,v1:172.21.15.191:6834/950486040] conn(0x55e07da341b0 0x55e07da34580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.471+0000 7f0a4faa6b80 4 client.5964 mds_command: new command op to 5410 tid=0[{"prefix": "status"}] 2023-03-03T06:25:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.471+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/2769003977 --> [v2:172.21.15.191:6832/950486040,v1:172.21.15.191:6834/950486040] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e07d945160 con 0x55e07da341b0 2023-03-03T06:25:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.471+0000 7f0a40eb8700 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.191:6832/950486040,v1:172.21.15.191:6834/950486040] conn(0x55e07da341b0 0x55e07da34580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.471+0000 7f0a1bfff700 10 client.5964 ms_handle_connect on v2:172.21.15.191:6832/950486040 2023-03-03T06:25:35.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.471+0000 7f0a40eb8700 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.191:6832/950486040,v1:172.21.15.191:6834/950486040] conn(0x55e07da341b0 0x55e07da34580 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a83749ed6ad2a0e4 server_cookie=ff85900bb5559fb5 in_seq=0 out_seq=0 2023-03-03T06:25:35.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.471+0000 7f0a1bfff700 1 -- 172.21.15.5:0/2769003977 <== mds.0 v2:172.21.15.191:6832/950486040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e07d945160 con 0x55e07da341b0 2023-03-03T06:25:35.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.471+0000 7f0a1bfff700 10 client.5964 handle_command_reply: tid=0 2023-03-03T06:25:35.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.471+0000 7f0a4faa6b80 1 client.5964 shutdown 2023-03-03T06:25:35.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/2769003977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da332e0 msgr2=0x55e07da7dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da332e0 0x55e07da7dd60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0a38021040 tx=0x7f0a380047c0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/2769003977 shutdown_connections 2023-03-03T06:25:35.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55e07da5fc20 0x55e07da33c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.481 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.191:6832/950486040,v1:172.21.15.191:6834/950486040] conn(0x55e07da341b0 0x55e07da34580 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e07da332e0 0x55e07da7dd60 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4faa6b80 1 --2- 172.21.15.5:0/2769003977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e07da54d70 0x55e07da7e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a1bfff700 0 client.5964 ms_handle_reset on v2:172.21.15.191:6832/950486040 2023-03-03T06:25:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/2769003977 >> 172.21.15.5:0/2769003977 conn(0x55e07da2a720 msgr2=0x55e07da746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/2769003977 shutdown_connections 2023-03-03T06:25:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4faa6b80 1 -- 172.21.15.5:0/2769003977 wait complete. 2023-03-03T06:25:35.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4faa6b80 20 client.5964 trim_cache size 0 max 16384 2023-03-03T06:25:35.483 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-03-03T06:25:35.483 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6", 2023-03-03T06:25:35.483 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-03-03T06:25:35.483 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 5410, 2023-03-03T06:25:35.483 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-03-03T06:25:35.483 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-03-03T06:25:35.484 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-03-03T06:25:35.484 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 10.553423197000001, 2023-03-03T06:25:35.484 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 25, 2023-03-03T06:25:35.484 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 56, 2023-03-03T06:25:35.484 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 56, 2023-03-03T06:25:35.484 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 15.870710538000001 2023-03-03T06:25:35.484 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-03-03T06:25:35.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4391d700 1 -- 172.21.15.5:0/1685973156 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0a200682f0 msgr2=0x7f0a2006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4391d700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0a200682f0 0x7f0a2006a7a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0a380090b0 tx=0x7f0a38008030 comp rx=0 tx=0).stop 2023-03-03T06:25:35.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4391d700 1 -- 172.21.15.5:0/1685973156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c15a850 msgr2=0x7f0a3c152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4391d700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c15a850 0x7f0a3c152ac0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400cbb0 tx=0x7f0a3400cf70 comp rx=0 tx=0).stop 2023-03-03T06:25:35.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4391d700 1 -- 172.21.15.5:0/1685973156 shutdown_connections 2023-03-03T06:25:35.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4391d700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a3c15a850 0x7f0a3c152ac0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4391d700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0a200682f0 0x7f0a2006a7a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4391d700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a3c0cb4a0 0x7f0a3c1f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4391d700 1 --2- 172.21.15.5:0/1685973156 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a3c15a480 0x7f0a3c0ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.472+0000 7f0a4391d700 1 -- 172.21.15.5:0/1685973156 >> 172.21.15.5:0/1685973156 conn(0x7f0a3c06f3c0 msgr2=0x7f0a3c0cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.473+0000 7f0a4391d700 1 -- 172.21.15.5:0/1685973156 shutdown_connections 2023-03-03T06:25:35.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.473+0000 7f0a4391d700 1 -- 172.21.15.5:0/1685973156 wait complete. 2023-03-03T06:25:35.488 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-03T06:25:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.612+0000 7fca9d20d700 1 Processor -- start 2023-03-03T06:25:35.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.612+0000 7fca9d20d700 1 -- start start 2023-03-03T06:25:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.613+0000 7fca9d20d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca98159730 0x7fca9815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.613+0000 7fca9d20d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca980cec00 0x7fca98159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.613+0000 7fca9d20d700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9815aa90 con 0x7fca9815a050 2023-03-03T06:25:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.613+0000 7fca9d20d700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9815a4d0 con 0x7fca98159730 2023-03-03T06:25:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.613+0000 7fca9d20d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9815a7b0 con 0x7fca980cec00 2023-03-03T06:25:35.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.613+0000 7fca96d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fca98159730 0x7fca9815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.613+0000 7fca9759e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fca9815a050 0x7fca980714c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34564/0 (socket says 172.21.15.5:34564) 2023-03-03T06:25:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.613+0000 7fca9759e700 1 -- 172.21.15.5:0/3029496926 learned_addr learned my addr 172.21.15.5:0/3029496926 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.613+0000 7fca9659c700 1 --2- 172.21.15.5:0/3029496926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca980cec00 0x7fca98159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.614+0000 7fca96d9d700 1 -- 172.21.15.5:0/3029496926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca980cec00 msgr2=0x7fca98159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.614+0000 7fca96d9d700 1 --2- 172.21.15.5:0/3029496926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca980cec00 0x7fca98159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.614+0000 7fca96d9d700 1 -- 172.21.15.5:0/3029496926 >> v1:172.21.15.5:6789/0 conn(0x7fca9815a050 legacy=0x7fca980714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.614+0000 7fca96d9d700 1 -- 172.21.15.5:0/3029496926 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9815d1f0 con 0x7fca98159730 2023-03-03T06:25:35.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.614+0000 7fca95d9b700 1 -- 172.21.15.5:0/3029496926 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752004042 0 0) 0x7fca9815aa90 con 0x7fca9815a050 2023-03-03T06:25:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.614+0000 7fca96d9d700 1 --2- 172.21.15.5:0/3029496926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca98159730 0x7fca9815d9f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fca88009840 tx=0x7fca88009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ebdafe2f3eebe7 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.614+0000 7fca95d9b700 1 -- 172.21.15.5:0/3029496926 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88011830 con 0x7fca98159730 2023-03-03T06:25:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.614+0000 7fca95d9b700 1 -- 172.21.15.5:0/3029496926 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca88011990 con 0x7fca98159730 2023-03-03T06:25:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.614+0000 7fca95d9b700 1 -- 172.21.15.5:0/3029496926 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88011d20 con 0x7fca98159730 2023-03-03T06:25:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.615+0000 7fca9d20d700 1 -- 172.21.15.5:0/3029496926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca98159730 msgr2=0x7fca9815d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.615+0000 7fca9d20d700 1 --2- 172.21.15.5:0/3029496926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca98159730 0x7fca9815d9f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fca88009840 tx=0x7fca88009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:35.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.615+0000 7fca9d20d700 1 -- 172.21.15.5:0/3029496926 shutdown_connections 2023-03-03T06:25:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.615+0000 7fca9d20d700 1 --2- 172.21.15.5:0/3029496926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca98159730 0x7fca9815d9f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.615+0000 7fca9d20d700 1 --2- 172.21.15.5:0/3029496926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca980cec00 0x7fca98159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.615+0000 7fca9d20d700 1 -- 172.21.15.5:0/3029496926 >> 172.21.15.5:0/3029496926 conn(0x7fca980cf4b0 msgr2=0x7fca980cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.615+0000 7fca9d20d700 1 -- 172.21.15.5:0/3029496926 shutdown_connections 2023-03-03T06:25:35.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.615+0000 7fca9d20d700 1 -- 172.21.15.5:0/3029496926 wait complete. 2023-03-03T06:25:35.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.617+0000 7fca9d20d700 1 Processor -- start 2023-03-03T06:25:35.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.617+0000 7fca9d20d700 1 -- start start 2023-03-03T06:25:35.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9d20d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca980cec00 0x7fca981ed430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9d20d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca980c3990 0x7fca980c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9d20d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca980c3e00 0x7fca980c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9d20d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca981f1020 con 0x7fca980c3e00 2023-03-03T06:25:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9d20d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca980c46f0 con 0x7fca980c3990 2023-03-03T06:25:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9d20d700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca980c49d0 con 0x7fca980cec00 2023-03-03T06:25:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca980c3e00 0x7fca980c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca980c3e00 0x7fca980c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44728/0 (socket says 172.21.15.5:44728) 2023-03-03T06:25:35.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9759e700 1 -- 172.21.15.5:0/2750106700 learned_addr learned my addr 172.21.15.5:0/2750106700 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca96d9d700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca980cec00 0x7fca981ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9659c700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca980c3990 0x7fca980c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9759e700 1 -- 172.21.15.5:0/2750106700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca980cec00 msgr2=0x7fca981ed430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9759e700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca980cec00 0x7fca981ed430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9759e700 1 -- 172.21.15.5:0/2750106700 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca980c3990 msgr2=0x7fca980c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9759e700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca980c3990 0x7fca980c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9759e700 1 -- 172.21.15.5:0/2750106700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca880094a0 con 0x7fca980c3e00 2023-03-03T06:25:35.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9759e700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca980c3e00 0x7fca980c8c90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fca9000cc10 tx=0x7fca900021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca8f7fe700 1 -- 172.21.15.5:0/2750106700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9000ab80 con 0x7fca980c3e00 2023-03-03T06:25:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca8f7fe700 1 -- 172.21.15.5:0/2750106700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9000ad00 con 0x7fca980c3e00 2023-03-03T06:25:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9d20d700 1 -- 172.21.15.5:0/2750106700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9815df30 con 0x7fca980c3e00 2023-03-03T06:25:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca8f7fe700 1 -- 172.21.15.5:0/2750106700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90007310 con 0x7fca980c3e00 2023-03-03T06:25:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.618+0000 7fca9d20d700 1 -- 172.21.15.5:0/2750106700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9815d4d0 con 0x7fca980c3e00 2023-03-03T06:25:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.619+0000 7fca9d20d700 1 -- 172.21.15.5:0/2750106700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca98071bd0 con 0x7fca980c3e00 2023-03-03T06:25:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.620+0000 7fca8f7fe700 1 -- 172.21.15.5:0/2750106700 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fca9001a030 con 0x7fca980c3e00 2023-03-03T06:25:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.620+0000 7fca8f7fe700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fca780682f0 0x7fca7806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.620+0000 7fca8f7fe700 1 -- 172.21.15.5:0/2750106700 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fca90085c80 con 0x7fca980c3e00 2023-03-03T06:25:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.620+0000 7fca96d9d700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fca780682f0 0x7fca7806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:35.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.621+0000 7fca96d9d700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fca780682f0 0x7fca7806a7a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fca88009fd0 tx=0x7fca88008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:35.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.625+0000 7fca8f7fe700 1 -- 172.21.15.5:0/2750106700 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fca900521e0 con 0x7fca980c3e00 2023-03-03T06:25:35.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.859+0000 7fca9d20d700 1 -- 172.21.15.5:0/2750106700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fca9804e6e0 con 0x7fca980c3e00 2023-03-03T06:25:35.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.859+0000 7fca8f7fe700 1 -- 172.21.15.5:0/2750106700 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7fca90018070 con 0x7fca980c3e00 2023-03-03T06:25:35.861 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-03T06:25:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.861+0000 7fca9d20d700 1 -- 172.21.15.5:0/2750106700 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fca780682f0 msgr2=0x7fca7806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.861+0000 7fca9d20d700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fca780682f0 0x7fca7806a7a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fca88009fd0 tx=0x7fca88008030 comp rx=0 tx=0).stop 2023-03-03T06:25:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.861+0000 7fca9d20d700 1 -- 172.21.15.5:0/2750106700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca980c3e00 msgr2=0x7fca980c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.861+0000 7fca9d20d700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca980c3e00 0x7fca980c8c90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fca9000cc10 tx=0x7fca900021c0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.861+0000 7fca9d20d700 1 -- 172.21.15.5:0/2750106700 shutdown_connections 2023-03-03T06:25:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.861+0000 7fca9d20d700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca980c3e00 0x7fca980c8c90 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.861+0000 7fca9d20d700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fca780682f0 0x7fca7806a7a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.861+0000 7fca9d20d700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca980cec00 0x7fca981ed430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.861+0000 7fca9d20d700 1 --2- 172.21.15.5:0/2750106700 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca980c3990 0x7fca980c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:35.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.861+0000 7fca9d20d700 1 -- 172.21.15.5:0/2750106700 >> 172.21.15.5:0/2750106700 conn(0x7fca980cf4b0 msgr2=0x7fca98158540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.861+0000 7fca9d20d700 1 -- 172.21.15.5:0/2750106700 shutdown_connections 2023-03-03T06:25:35.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:35.861+0000 7fca9d20d700 1 -- 172.21.15.5:0/2750106700 wait complete. 2023-03-03T06:25:35.874 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-03-03T06:25:35.875 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-03T06:25:35.875 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-03-03T06:25:35.875 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-03T06:25:35.876 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-03T06:25:35.876 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-03-03T06:25:35.876 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-03-03T06:25:35.876 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-03T06:25:35.877 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:25:35.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:35.877 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-03-03T06:25:35.894 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T06:25:35.895 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T06:25:35.895 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T06:25:35.895 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:35.895 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-03-03T06:25:35.895 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:35.895 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:25:35.895 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-03-03T06:25:35.896 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:25:35.896 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-03-03T06:25:35.896 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-03T06:25:35.896 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:25:35.896 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-03-03T06:25:35.896 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42407sec preferred_lft 42407sec 2023-03-03T06:25:35.896 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-03-03T06:25:35.896 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:35.897 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:25:35.897 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:25:35.897 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-03T06:25:35.897 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 6a:b3:10:0c:df:06 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:25:35.897 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-03-03T06:25:35.897 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:35.897 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::3415:96ff:fe7c:a178/64 scope link 2023-03-03T06:25:35.898 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:35.898 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-03T06:25:35.898 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 76:7c:c4:80:40:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-03T06:25:35.898 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::747c:c4ff:fe80:40be/64 scope link 2023-03-03T06:25:35.898 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:35.898 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-03T06:25:35.898 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 6a:b3:10:0c:df:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-03-03T06:25:35.898 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::68b3:10ff:fe0c:df06/64 scope link 2023-03-03T06:25:35.899 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:25:35.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:35.899 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-03T06:25:35.960 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-03-03T06:25:35.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:35.962 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-03-03T06:25:36.020 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-03-03T06:25:36.021 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-03T06:25:36.021 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-03-03T06:25:36.021 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-03-03T06:25:36.021 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-03T06:25:36.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:36.022 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:25:36.023 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:25:36.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-03-03T06:25:36.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-03-03T06:25:36.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-03-03T06:25:36.024 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:25:36.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:36.128 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-03-03T06:25:36.144 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-03-03T06:25:36.145 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-03-03T06:25:36.145 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:25:36.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:36.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-03-03T06:25:36.212 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:25:36.213 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-03T06:25:36.270 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:25:36.271 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:25:36.271 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-03T06:25:36.326 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-03-03T06:25:36.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:36.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:25:36.413 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:25:36.414 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:25:36.445 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:25:36.446 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:25:36.446 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:25:36.446 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:25:36.446 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:25:36.446 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:25:36.447 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:25:36.447 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:25:36.485 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:25:36.485 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:25:36.486 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:25:36.486 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:25:36.486 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:25:36.486 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:25:36.487 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:25:36.487 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:25:36.487 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790" 2023-03-03T06:25:36.487 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2023-03-03T06:25:36.487 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6" will pass to kernel 2023-03-03T06:25:36.495 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-03T06:25:36.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:36.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-03T06:25:36.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:36.528 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:25:36.617 INFO:teuthology.orchestra.run.smithi005.stdout:client5976 2023-03-03T06:25:36.618 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:25:36.619 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:36.636 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data mksnap snap1 2023-03-03T06:25:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.718+0000 7f2c20c6c080 1 Processor -- start 2023-03-03T06:25:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.718+0000 7f2c20c6c080 1 -- start start 2023-03-03T06:25:36.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.718+0000 7f2c20c6c080 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557acc167100 0x557acc1929a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.718+0000 7f2c20c6c080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 0x557acc162160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.718+0000 7f2c20c6c080 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x557acc1ab6b0 0x557acc1626a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.718+0000 7f2c20c6c080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557acc09efe0 con 0x557acc1aa940 2023-03-03T06:25:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.718+0000 7f2c20c6c080 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557acc1955a0 con 0x557acc167100 2023-03-03T06:25:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.718+0000 7f2c20c6c080 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x557acc17cc30 con 0x557acc1ab6b0 2023-03-03T06:25:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.718+0000 7f2c1656e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 0x557acc162160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.719+0000 7f2c1656e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 0x557acc162160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44744/0 (socket says 172.21.15.5:44744) 2023-03-03T06:25:36.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.719+0000 7f2c1656e700 1 -- 172.21.15.5:0/1887269597 learned_addr learned my addr 172.21.15.5:0/1887269597 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.719+0000 7f2c16d6f700 1 --2- 172.21.15.5:0/1887269597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557acc167100 0x557acc1929a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.719+0000 7f2c17570700 1 --2- 172.21.15.5:0/1887269597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x557acc1ab6b0 0x557acc1626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.719+0000 7f2c1656e700 1 -- 172.21.15.5:0/1887269597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x557acc1ab6b0 msgr2=0x557acc1626a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.719+0000 7f2c1656e700 1 --2- 172.21.15.5:0/1887269597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x557acc1ab6b0 0x557acc1626a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.719+0000 7f2c1656e700 1 -- 172.21.15.5:0/1887269597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557acc167100 msgr2=0x557acc1929a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.719+0000 7f2c1656e700 1 --2- 172.21.15.5:0/1887269597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557acc167100 0x557acc1929a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.719+0000 7f2c1656e700 1 -- 172.21.15.5:0/1887269597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1000a100 con 0x557acc1aa940 2023-03-03T06:25:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.719+0000 7f2c1656e700 1 --2- 172.21.15.5:0/1887269597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 0x557acc162160 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00a770 tx=0x7f2c0c00aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd739d3b0ce40749 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.719+0000 7f2c1556c700 1 -- 172.21.15.5:0/1887269597 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c00f070 con 0x557acc1aa940 2023-03-03T06:25:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.719+0000 7f2c1556c700 1 -- 172.21.15.5:0/1887269597 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c008580 con 0x557acc1aa940 2023-03-03T06:25:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.719+0000 7f2c1556c700 1 -- 172.21.15.5:0/1887269597 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0088f0 con 0x557acc1aa940 2023-03-03T06:25:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.720+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1887269597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 msgr2=0x557acc162160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.720+0000 7f2c20c6c080 1 --2- 172.21.15.5:0/1887269597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 0x557acc162160 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00a770 tx=0x7f2c0c00aa80 comp rx=0 tx=0).stop 2023-03-03T06:25:36.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.720+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1887269597 shutdown_connections 2023-03-03T06:25:36.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.720+0000 7f2c20c6c080 1 --2- 172.21.15.5:0/1887269597 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x557acc1ab6b0 0x557acc1626a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.720+0000 7f2c20c6c080 1 --2- 172.21.15.5:0/1887269597 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557acc167100 0x557acc1929a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.720+0000 7f2c20c6c080 1 --2- 172.21.15.5:0/1887269597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 0x557acc162160 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.720+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1887269597 >> 172.21.15.5:0/1887269597 conn(0x557acc1af8e0 msgr2=0x557acc164100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:36.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.720+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1887269597 shutdown_connections 2023-03-03T06:25:36.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.720+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1887269597 wait complete. 2023-03-03T06:25:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.720+0000 7f2c20c6c080 1 Processor -- start 2023-03-03T06:25:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.720+0000 7f2c20c6c080 1 -- start start 2023-03-03T06:25:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.721+0000 7f2c20c6c080 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x557acc167100 0x557acc1903a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.721+0000 7f2c20c6c080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 0x557acc1908e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.721+0000 7f2c20c6c080 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557acc1ab6b0 0x557acc2c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.721+0000 7f2c20c6c080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x557acc1af570 con 0x557acc1aa940 2023-03-03T06:25:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.721+0000 7f2c20c6c080 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557acc2c4ab0 con 0x557acc1ab6b0 2023-03-03T06:25:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.721+0000 7f2c20c6c080 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x557acc2cc9b0 con 0x557acc167100 2023-03-03T06:25:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.721+0000 7f2c1656e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 0x557acc1908e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:36.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.721+0000 7f2c1656e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 0x557acc1908e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44750/0 (socket says 172.21.15.5:44750) 2023-03-03T06:25:36.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.721+0000 7f2c1656e700 1 -- 172.21.15.5:0/1285090668 learned_addr learned my addr 172.21.15.5:0/1285090668 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:36.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.721+0000 7f2c16d6f700 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x557acc167100 0x557acc1903a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:36.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.721+0000 7f2c17570700 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557acc1ab6b0 0x557acc2c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:36.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.722+0000 7f2c1656e700 1 -- 172.21.15.5:0/1285090668 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x557acc167100 msgr2=0x557acc1903a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:36.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.722+0000 7f2c1656e700 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x557acc167100 0x557acc1903a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.722+0000 7f2c1656e700 1 -- 172.21.15.5:0/1285090668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557acc1ab6b0 msgr2=0x557acc2c1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.722+0000 7f2c1656e700 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557acc1ab6b0 0x557acc2c1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.722+0000 7f2c1656e700 1 -- 172.21.15.5:0/1285090668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c00a420 con 0x557acc1aa940 2023-03-03T06:25:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.722+0000 7f2c1656e700 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 0x557acc1908e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c018040 tx=0x7f2c0c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.722+0000 7f2bfffff700 1 -- 172.21.15.5:0/1285090668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c020650 con 0x557acc1aa940 2023-03-03T06:25:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.722+0000 7f2bfffff700 1 -- 172.21.15.5:0/1285090668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c0207d0 con 0x557acc1aa940 2023-03-03T06:25:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.722+0000 7f2bfffff700 1 -- 172.21.15.5:0/1285090668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c020b80 con 0x557acc1aa940 2023-03-03T06:25:36.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.722+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1285090668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557acc0b7120 con 0x557acc1aa940 2023-03-03T06:25:36.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.722+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1285090668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557acc0aa830 con 0x557acc1aa940 2023-03-03T06:25:36.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T06:25:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.723+0000 7f2bfffff700 1 -- 172.21.15.5:0/1285090668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2c0c026020 con 0x557acc1aa940 2023-03-03T06:25:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2bfffff700 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2c04066c10 0x7f2c040690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2bfffff700 1 -- 172.21.15.5:0/1285090668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2c0c086900 con 0x557acc1aa940 2023-03-03T06:25:36.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c16d6f700 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2c04066c10 0x7f2c040690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1285090668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- pool_op(create snap pool 10 tid 1 name snap1 v0) v4 -- 0x557acc1157c0 con 0x557acc1aa940 2023-03-03T06:25:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2bfffff700 1 -- 172.21.15.5:0/1285090668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v56) v1 ==== 43+0+0 (secure 0 0 0) 0x7f2c0c052dd0 con 0x557acc1aa940 2023-03-03T06:25:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c16d6f700 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2c04066c10 0x7f2c040690c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x557acc165760 tx=0x7f2c080017e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:error creating pool cephfs_data snapshot snap1: (95) Operation not supported 2023-03-03T06:25:36.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1285090668 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2c04066c10 msgr2=0x7f2c040690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c20c6c080 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2c04066c10 0x7f2c040690c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x557acc165760 tx=0x7f2c080017e0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1285090668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 msgr2=0x557acc1908e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c20c6c080 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 0x557acc1908e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c018040 tx=0x7f2c0c003020 comp rx=0 tx=0).stop 2023-03-03T06:25:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1285090668 shutdown_connections 2023-03-03T06:25:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c20c6c080 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557acc1ab6b0 0x557acc2c1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c20c6c080 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2c04066c10 0x7f2c040690c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c20c6c080 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x557acc167100 0x557acc1903a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c20c6c080 1 --2- 172.21.15.5:0/1285090668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557acc1aa940 0x557acc1908e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1285090668 >> 172.21.15.5:0/1285090668 conn(0x557acc1af8e0 msgr2=0x557acc1ae3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1285090668 shutdown_connections 2023-03-03T06:25:36.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.724+0000 7f2c20c6c080 1 -- 172.21.15.5:0/1285090668 wait complete. 2023-03-03T06:25:36.738 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata mksnap snap2 2023-03-03T06:25:36.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.816+0000 7f5d8e75b080 1 Processor -- start 2023-03-03T06:25:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.816+0000 7f5d8e75b080 1 -- start start 2023-03-03T06:25:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8e75b080 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561ed18bf810 0x561ed194f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8e75b080 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed18c0be0 0x561ed194ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8e75b080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed1950540 0x561ed18759f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8e75b080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ed17b1fe0 con 0x561ed1950540 2023-03-03T06:25:36.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8e75b080 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ed18bef50 con 0x561ed18c0be0 2023-03-03T06:25:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8e75b080 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ed18a1490 con 0x561ed18bf810 2023-03-03T06:25:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8505f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed1950540 0x561ed18759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8505f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed1950540 0x561ed18759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44766/0 (socket says 172.21.15.5:44766) 2023-03-03T06:25:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8505f700 1 -- 172.21.15.5:0/3039861836 learned_addr learned my addr 172.21.15.5:0/3039861836 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8505f700 1 -- 172.21.15.5:0/3039861836 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561ed18bf810 msgr2=0x561ed194f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8505f700 1 --2- 172.21.15.5:0/3039861836 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561ed18bf810 0x561ed194f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8505f700 1 -- 172.21.15.5:0/3039861836 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed18c0be0 msgr2=0x561ed194ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8405d700 1 --2- 172.21.15.5:0/3039861836 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed18c0be0 0x561ed194ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8505f700 1 --2- 172.21.15.5:0/3039861836 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed18c0be0 0x561ed194ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8505f700 1 -- 172.21.15.5:0/3039861836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d74005d80 con 0x561ed1950540 2023-03-03T06:25:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8405d700 1 --2- 172.21.15.5:0/3039861836 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed18c0be0 0x561ed194ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8505f700 1 --2- 172.21.15.5:0/3039861836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed1950540 0x561ed18759f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00b5d0 tx=0x7f5d7c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a3f1ffb23b60ce server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8305b700 1 -- 172.21.15.5:0/3039861836 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c014070 con 0x561ed1950540 2023-03-03T06:25:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8305b700 1 -- 172.21.15.5:0/3039861836 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c00b050 con 0x561ed1950540 2023-03-03T06:25:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.817+0000 7f5d8305b700 1 -- 172.21.15.5:0/3039861836 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00f7a0 con 0x561ed1950540 2023-03-03T06:25:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.818+0000 7f5d8e75b080 1 -- 172.21.15.5:0/3039861836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed1950540 msgr2=0x561ed18759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.818+0000 7f5d8e75b080 1 --2- 172.21.15.5:0/3039861836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed1950540 0x561ed18759f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00b5d0 tx=0x7f5d7c00b8e0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.818+0000 7f5d8e75b080 1 -- 172.21.15.5:0/3039861836 shutdown_connections 2023-03-03T06:25:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.818+0000 7f5d8e75b080 1 --2- 172.21.15.5:0/3039861836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed1950540 0x561ed18759f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.818+0000 7f5d8e75b080 1 --2- 172.21.15.5:0/3039861836 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561ed18bf810 0x561ed194f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.818+0000 7f5d8e75b080 1 --2- 172.21.15.5:0/3039861836 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed18c0be0 0x561ed194ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.818+0000 7f5d8e75b080 1 -- 172.21.15.5:0/3039861836 >> 172.21.15.5:0/3039861836 conn(0x561ed18791b0 msgr2=0x561ed194eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.818+0000 7f5d8e75b080 1 -- 172.21.15.5:0/3039861836 shutdown_connections 2023-03-03T06:25:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.818+0000 7f5d8e75b080 1 -- 172.21.15.5:0/3039861836 wait complete. 2023-03-03T06:25:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.819+0000 7f5d8e75b080 1 Processor -- start 2023-03-03T06:25:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.819+0000 7f5d8e75b080 1 -- start start 2023-03-03T06:25:36.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T06:25:36.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.819+0000 7f5d8e75b080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed18bf810 0x561ed18c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.819+0000 7f5d8e75b080 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561ed18c0be0 0x561ed194d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.819+0000 7f5d8e75b080 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed1950540 0x561ed194d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.819+0000 7f5d8e75b080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ed18766e0 con 0x561ed18bf810 2023-03-03T06:25:36.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.819+0000 7f5d8e75b080 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ed1942870 con 0x561ed1950540 2023-03-03T06:25:36.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.819+0000 7f5d8e75b080 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ed1942570 con 0x561ed18c0be0 2023-03-03T06:25:36.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.819+0000 7f5d8485e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed18bf810 0x561ed18c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.819+0000 7f5d8485e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed18bf810 0x561ed18c2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44768/0 (socket says 172.21.15.5:44768) 2023-03-03T06:25:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.819+0000 7f5d8485e700 1 -- 172.21.15.5:0/1615657807 learned_addr learned my addr 172.21.15.5:0/1615657807 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.820+0000 7f5d8505f700 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed1950540 0x561ed194d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.820+0000 7f5d8405d700 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561ed18c0be0 0x561ed194d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.820+0000 7f5d8485e700 1 -- 172.21.15.5:0/1615657807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561ed18c0be0 msgr2=0x561ed194d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.820+0000 7f5d8485e700 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561ed18c0be0 0x561ed194d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.820+0000 7f5d8485e700 1 -- 172.21.15.5:0/1615657807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed1950540 msgr2=0x561ed194d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:36.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.820+0000 7f5d8485e700 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed1950540 0x561ed194d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.820+0000 7f5d8485e700 1 -- 172.21.15.5:0/1615657807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c00b230 con 0x561ed18bf810 2023-03-03T06:25:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.820+0000 7f5d8485e700 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed18bf810 0x561ed18c2b10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5d74002000 tx=0x7f5d7400c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.820+0000 7f5d82059700 1 -- 172.21.15.5:0/1615657807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7400aea0 con 0x561ed18bf810 2023-03-03T06:25:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.820+0000 7f5d82059700 1 -- 172.21.15.5:0/1615657807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7400c8a0 con 0x561ed18bf810 2023-03-03T06:25:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.820+0000 7f5d8e75b080 1 -- 172.21.15.5:0/1615657807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561ed17ca120 con 0x561ed18bf810 2023-03-03T06:25:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.820+0000 7f5d82059700 1 -- 172.21.15.5:0/1615657807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7400cc50 con 0x561ed18bf810 2023-03-03T06:25:36.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.820+0000 7f5d8e75b080 1 -- 172.21.15.5:0/1615657807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ed17bd830 con 0x561ed18bf810 2023-03-03T06:25:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.822+0000 7f5d82059700 1 -- 172.21.15.5:0/1615657807 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5d74025030 con 0x561ed18bf810 2023-03-03T06:25:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.822+0000 7f5d82059700 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d70066c10 0x7f5d700690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.822+0000 7f5d82059700 1 -- 172.21.15.5:0/1615657807 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5d74085fd0 con 0x561ed18bf810 2023-03-03T06:25:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.822+0000 7f5d8405d700 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d70066c10 0x7f5d700690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.822+0000 7f5d8e75b080 1 -- 172.21.15.5:0/1615657807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- pool_op(create snap pool 9 tid 1 name snap2 v0) v4 -- 0x561ed18287c0 con 0x561ed18bf810 2023-03-03T06:25:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.822+0000 7f5d82059700 1 -- 172.21.15.5:0/1615657807 <== mon.0 v2:172.21.15.5:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v56) v1 ==== 43+0+0 (secure 0 0 0) 0x7f5d74023070 con 0x561ed18bf810 2023-03-03T06:25:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:error creating pool cephfs_metadata snapshot snap2: (95) Operation not supported 2023-03-03T06:25:36.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.822+0000 7f5d8405d700 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d70066c10 0x7f5d700690c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x561ed1943230 tx=0x7f5d78005950 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.822+0000 7f5d8e75b080 1 -- 172.21.15.5:0/1615657807 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d70066c10 msgr2=0x7f5d700690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.822+0000 7f5d8e75b080 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d70066c10 0x7f5d700690c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x561ed1943230 tx=0x7f5d78005950 comp rx=0 tx=0).stop 2023-03-03T06:25:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.822+0000 7f5d8e75b080 1 -- 172.21.15.5:0/1615657807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed18bf810 msgr2=0x561ed18c2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.822+0000 7f5d8e75b080 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed18bf810 0x561ed18c2b10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5d74002000 tx=0x7f5d7400c670 comp rx=0 tx=0).stop 2023-03-03T06:25:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.823+0000 7f5d8e75b080 1 -- 172.21.15.5:0/1615657807 shutdown_connections 2023-03-03T06:25:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.823+0000 7f5d8e75b080 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561ed1950540 0x561ed194d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.823+0000 7f5d8e75b080 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ed18bf810 0x561ed18c2b10 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.823+0000 7f5d8e75b080 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d70066c10 0x7f5d700690c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.823+0000 7f5d8e75b080 1 --2- 172.21.15.5:0/1615657807 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561ed18c0be0 0x561ed194d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:36.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.823+0000 7f5d8e75b080 1 -- 172.21.15.5:0/1615657807 >> 172.21.15.5:0/1615657807 conn(0x561ed18791b0 msgr2=0x561ed194eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:36.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.823+0000 7f5d8e75b080 1 -- 172.21.15.5:0/1615657807 shutdown_connections 2023-03-03T06:25:36.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:36.823+0000 7f5d8e75b080 1 -- 172.21.15.5:0/1615657807 wait complete. 2023-03-03T06:25:36.833 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-03-03T06:25:36.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:25:36.915 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:25:36.968 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-03-03T06:25:36.969 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:25:36.969 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:36.987 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:25:36.987 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:37.044 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:37.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.207+0000 7fc01f977700 1 Processor -- start 2023-03-03T06:25:37.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.207+0000 7fc01f977700 1 -- start start 2023-03-03T06:25:37.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.208+0000 7fc01f977700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc01815d320 0x7fc0180cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.208+0000 7fc01f977700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc0180b18d0 0x7fc0180b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.208+0000 7fc01f977700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0181577c0 con 0x7fc0181573f0 2023-03-03T06:25:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.208+0000 7fc01f977700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0180cc6e0 con 0x7fc0180b18d0 2023-03-03T06:25:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.208+0000 7fc01f977700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0180cd790 con 0x7fc01815d320 2023-03-03T06:25:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.208+0000 7fc01df14700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc0180b18d0 0x7fc0180b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.208+0000 7fc01d713700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fc0181573f0 0x7fc0180cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:49146/0 (socket says 172.21.15.5:49146) 2023-03-03T06:25:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.208+0000 7fc01d713700 1 -- 172.21.15.5:0/224530762 learned_addr learned my addr 172.21.15.5:0/224530762 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.208+0000 7fc01cf12700 1 --2- 172.21.15.5:0/224530762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc01815d320 0x7fc0180cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.208+0000 7fc01df14700 1 --2- 172.21.15.5:0/224530762 >> v2:172.21.15.191:3300/0 conn(0x7fc0180b18d0 0x7fc0180b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:45140/0 (socket says 172.21.15.5:45140) 2023-03-03T06:25:37.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.209+0000 7fc00ffff700 1 -- 172.21.15.5:0/224530762 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086406826 0 0) 0x7fc0181577c0 con 0x7fc0181573f0 2023-03-03T06:25:37.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.209+0000 7fc00ffff700 1 -- 172.21.15.5:0/224530762 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0040035b0 con 0x7fc0181573f0 2023-03-03T06:25:37.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.209+0000 7fc01df14700 1 -- 172.21.15.5:0/224530762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc01815d320 msgr2=0x7fc0180cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:37.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.209+0000 7fc01df14700 1 --2- 172.21.15.5:0/224530762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc01815d320 0x7fc0180cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.209+0000 7fc01df14700 1 -- 172.21.15.5:0/224530762 >> v1:172.21.15.191:6789/0 conn(0x7fc0181573f0 legacy=0x7fc0180cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.209+0000 7fc01df14700 1 -- 172.21.15.5:0/224530762 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0180b2270 con 0x7fc0180b18d0 2023-03-03T06:25:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.209+0000 7fc01cf12700 1 --2- 172.21.15.5:0/224530762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc01815d320 0x7fc0180cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.209+0000 7fc01df14700 1 --2- 172.21.15.5:0/224530762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0180b18d0 0x7fc0180b1d30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc010009d90 tx=0x7fc01000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f0d78a95ea60c30 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.209+0000 7fc00ffff700 1 -- 172.21.15.5:0/224530762 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01000e070 con 0x7fc0180b18d0 2023-03-03T06:25:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.209+0000 7fc00ffff700 1 -- 172.21.15.5:0/224530762 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01000bb20 con 0x7fc0180b18d0 2023-03-03T06:25:37.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.209+0000 7fc00ffff700 1 -- 172.21.15.5:0/224530762 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01000be90 con 0x7fc0180b18d0 2023-03-03T06:25:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.210+0000 7fc01f977700 1 -- 172.21.15.5:0/224530762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0180b18d0 msgr2=0x7fc0180b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.210+0000 7fc01f977700 1 --2- 172.21.15.5:0/224530762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0180b18d0 0x7fc0180b1d30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc010009d90 tx=0x7fc01000b330 comp rx=0 tx=0).stop 2023-03-03T06:25:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.210+0000 7fc01f977700 1 -- 172.21.15.5:0/224530762 shutdown_connections 2023-03-03T06:25:37.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.210+0000 7fc01f977700 1 --2- 172.21.15.5:0/224530762 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0180b18d0 0x7fc0180b1d30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.210+0000 7fc01f977700 1 --2- 172.21.15.5:0/224530762 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc01815d320 0x7fc0180cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.210+0000 7fc01f977700 1 -- 172.21.15.5:0/224530762 >> 172.21.15.5:0/224530762 conn(0x7fc0180cc8d0 msgr2=0x7fc0180cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.210+0000 7fc01f977700 1 -- 172.21.15.5:0/224530762 shutdown_connections 2023-03-03T06:25:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.210+0000 7fc01f977700 1 -- 172.21.15.5:0/224530762 wait complete. 2023-03-03T06:25:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.211+0000 7fc01f977700 1 Processor -- start 2023-03-03T06:25:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.211+0000 7fc01f977700 1 -- start start 2023-03-03T06:25:37.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01f977700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0180b18d0 0x7fc0181ec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01f977700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0181573f0 0x7fc0180b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01f977700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc01815d320 0x7fc0181f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01f977700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0180b5d10 con 0x7fc0180b18d0 2023-03-03T06:25:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01f977700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0180b5750 con 0x7fc0181573f0 2023-03-03T06:25:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01f977700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0180b5a30 con 0x7fc01815d320 2023-03-03T06:25:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01d713700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0180b18d0 0x7fc0181ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01d713700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0180b18d0 0x7fc0181ec6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44782/0 (socket says 172.21.15.5:44782) 2023-03-03T06:25:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01d713700 1 -- 172.21.15.5:0/4264214725 learned_addr learned my addr 172.21.15.5:0/4264214725 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01cf12700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0181573f0 0x7fc0180b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01df14700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc01815d320 0x7fc0181f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01d713700 1 -- 172.21.15.5:0/4264214725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc01815d320 msgr2=0x7fc0181f2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01d713700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc01815d320 0x7fc0181f2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01d713700 1 -- 172.21.15.5:0/4264214725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0181573f0 msgr2=0x7fc0180b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01d713700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0181573f0 0x7fc0180b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01d713700 1 -- 172.21.15.5:0/4264214725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc014009430 con 0x7fc0180b18d0 2023-03-03T06:25:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01df14700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc01815d320 0x7fc0181f2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.212+0000 7fc01d713700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0180b18d0 0x7fc0181ec6a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc00800e940 tx=0x7fc00800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.213+0000 7fc00dffb700 1 -- 172.21.15.5:0/4264214725 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008005b40 con 0x7fc0180b18d0 2023-03-03T06:25:37.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.213+0000 7fc00dffb700 1 -- 172.21.15.5:0/4264214725 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc008005cc0 con 0x7fc0180b18d0 2023-03-03T06:25:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.213+0000 7fc01f977700 1 -- 172.21.15.5:0/4264214725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc010009a70 con 0x7fc0180b18d0 2023-03-03T06:25:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.213+0000 7fc00dffb700 1 -- 172.21.15.5:0/4264214725 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00800ca20 con 0x7fc0180b18d0 2023-03-03T06:25:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.213+0000 7fc01f977700 1 -- 172.21.15.5:0/4264214725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0180ce460 con 0x7fc0180b18d0 2023-03-03T06:25:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.214+0000 7fc01f977700 1 -- 172.21.15.5:0/4264214725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc018159e60 con 0x7fc0180b18d0 2023-03-03T06:25:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.214+0000 7fc00dffb700 1 -- 172.21.15.5:0/4264214725 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc008021070 con 0x7fc0180b18d0 2023-03-03T06:25:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.215+0000 7fc00dffb700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbffc068320 0x7fbffc06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.215+0000 7fc00dffb700 1 -- 172.21.15.5:0/4264214725 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc008087fc0 con 0x7fc0180b18d0 2023-03-03T06:25:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.215+0000 7fc01cf12700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbffc068320 0x7fbffc06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.215+0000 7fc01cf12700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbffc068320 0x7fbffc06a7d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc014009cb0 tx=0x7fc0140091c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:37.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.219+0000 7fc00dffb700 1 -- 172.21.15.5:0/4264214725 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc008054640 con 0x7fc0180b18d0 2023-03-03T06:25:37.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.413+0000 7fc01f977700 1 -- 172.21.15.5:0/4264214725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc01815d900 con 0x7fc0180b18d0 2023-03-03T06:25:37.415 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.415+0000 7fc00dffb700 1 -- 172.21.15.5:0/4264214725 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+19673 (secure 0 0 0) 0x7fc00801f090 con 0x7fc0180b18d0 2023-03-03T06:25:37.416 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:37.416 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":56,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:25.917983+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:23.205830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:23.882328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.417+0000 7fc01f977700 1 -- 172.21.15.5:0/4264214725 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbffc068320 msgr2=0x7fbffc06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.417+0000 7fc01f977700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbffc068320 0x7fbffc06a7d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc014009cb0 tx=0x7fc0140091c0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.417+0000 7fc01f977700 1 -- 172.21.15.5:0/4264214725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0180b18d0 msgr2=0x7fc0181ec6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.417+0000 7fc01f977700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0180b18d0 0x7fc0181ec6a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc00800e940 tx=0x7fc00800ec50 comp rx=0 tx=0).stop 2023-03-03T06:25:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.417+0000 7fc01f977700 1 -- 172.21.15.5:0/4264214725 shutdown_connections 2023-03-03T06:25:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.417+0000 7fc01f977700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbffc068320 0x7fbffc06a7d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.417+0000 7fc01f977700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc01815d320 0x7fc0181f2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.417+0000 7fc01f977700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0180b18d0 0x7fc0181ec6a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.417+0000 7fc01f977700 1 --2- 172.21.15.5:0/4264214725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc0181573f0 0x7fc0180b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.417+0000 7fc01f977700 1 -- 172.21.15.5:0/4264214725 >> 172.21.15.5:0/4264214725 conn(0x7fc0180cc8d0 msgr2=0x7fc0180ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.417+0000 7fc01f977700 1 -- 172.21.15.5:0/4264214725 shutdown_connections 2023-03-03T06:25:37.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.417+0000 7fc01f977700 1 -- 172.21.15.5:0/4264214725 wait complete. 2023-03-03T06:25:37.430 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'snap-test-pool', 'create_time': '2023-03-03T06:25:02.648527+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:25:23.205830+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:25:23.882328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T06:25:37.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:25:37.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.559+0000 7f1ec6a5e700 1 Processor -- start 2023-03-03T06:25:37.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.559+0000 7f1ec6a5e700 1 -- start start 2023-03-03T06:25:37.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.560+0000 7f1ec6a5e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1ec00b8720 0x7f1ec006bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.560+0000 7f1ec6a5e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ec00cd850 0x7f1ec0160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.560+0000 7f1ec6a5e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec00d2d60 con 0x7f1ec006c120 2023-03-03T06:25:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.560+0000 7f1ec6a5e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec01612d0 con 0x7f1ec00b8720 2023-03-03T06:25:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.560+0000 7f1ec6a5e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00cf400 con 0x7f1ec00cd850 2023-03-03T06:25:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.560+0000 7f1ec4ffb700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1ec006c120 0x7f1ec00d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34636/0 (socket says 172.21.15.5:34636) 2023-03-03T06:25:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.560+0000 7f1ec4ffb700 1 -- 172.21.15.5:0/1518412574 learned_addr learned my addr 172.21.15.5:0/1518412574 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.560+0000 7f1ebffff700 1 --2- 172.21.15.5:0/1518412574 >> v2:172.21.15.191:3300/0 conn(0x7f1ec00b8720 0x7f1ec006bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.560+0000 7f1ebf7fe700 1 --2- 172.21.15.5:0/1518412574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ec00cd850 0x7f1ec0160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.561+0000 7f1ebeffd700 1 -- 172.21.15.5:0/1518412574 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568770138 0 0) 0x7f1ec00d2d60 con 0x7f1ec006c120 2023-03-03T06:25:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.561+0000 7f1ebeffd700 1 -- 172.21.15.5:0/1518412574 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea80035b0 con 0x7f1ec006c120 2023-03-03T06:25:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.561+0000 7f1ebffff700 1 -- 172.21.15.5:0/1518412574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ec00cd850 msgr2=0x7f1ec0160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.561+0000 7f1ebffff700 1 --2- 172.21.15.5:0/1518412574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ec00cd850 0x7f1ec0160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.561+0000 7f1ebffff700 1 -- 172.21.15.5:0/1518412574 >> v1:172.21.15.5:6789/0 conn(0x7f1ec006c120 legacy=0x7f1ec00d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.561+0000 7f1ebffff700 1 -- 172.21.15.5:0/1518412574 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00cf6e0 con 0x7f1ec00b8720 2023-03-03T06:25:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.561+0000 7f1ebffff700 1 --2- 172.21.15.5:0/1518412574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ec00b8720 0x7f1ec006bab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4009840 tx=0x7f1eb4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19ccabed31249745 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:37.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.561+0000 7f1ebeffd700 1 -- 172.21.15.5:0/1518412574 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4011830 con 0x7f1ec00b8720 2023-03-03T06:25:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.561+0000 7f1ebeffd700 1 -- 172.21.15.5:0/1518412574 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb4011990 con 0x7f1ec00b8720 2023-03-03T06:25:37.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.561+0000 7f1ebeffd700 1 -- 172.21.15.5:0/1518412574 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4011d00 con 0x7f1ec00b8720 2023-03-03T06:25:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.562+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/1518412574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ec00b8720 msgr2=0x7f1ec006bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.562+0000 7f1ec6a5e700 1 --2- 172.21.15.5:0/1518412574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ec00b8720 0x7f1ec006bab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4009840 tx=0x7f1eb4009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:37.567 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.562+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/1518412574 shutdown_connections 2023-03-03T06:25:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.562+0000 7f1ec6a5e700 1 --2- 172.21.15.5:0/1518412574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ec00b8720 0x7f1ec006bab0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.562+0000 7f1ec6a5e700 1 --2- 172.21.15.5:0/1518412574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ec00cd850 0x7f1ec0160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.562+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/1518412574 >> 172.21.15.5:0/1518412574 conn(0x7f1ec00d0590 msgr2=0x7f1ec00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.562+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/1518412574 shutdown_connections 2023-03-03T06:25:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.562+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/1518412574 wait complete. 2023-03-03T06:25:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.563+0000 7f1ec6a5e700 1 Processor -- start 2023-03-03T06:25:37.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.563+0000 7f1ec6a5e700 1 -- start start 2023-03-03T06:25:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ec6a5e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec006c120 0x7f1ec00ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ec6a5e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ec00b8720 0x7f1ec014d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ec6a5e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ec00cd850 0x7f1ec00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ec6a5e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00b4090 con 0x7f1ec006c120 2023-03-03T06:25:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ec6a5e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00b4370 con 0x7f1ec00cd850 2023-03-03T06:25:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ec6a5e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00b4650 con 0x7f1ec00b8720 2023-03-03T06:25:37.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ebffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec006c120 0x7f1ec00ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ebffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec006c120 0x7f1ec00ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44796/0 (socket says 172.21.15.5:44796) 2023-03-03T06:25:37.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ebffff700 1 -- 172.21.15.5:0/3631500266 learned_addr learned my addr 172.21.15.5:0/3631500266 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:37.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ec4ffb700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ec00cd850 0x7f1ec00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ebf7fe700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ec00b8720 0x7f1ec014d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ebffff700 1 -- 172.21.15.5:0/3631500266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ec00b8720 msgr2=0x7f1ec014d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ebffff700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ec00b8720 0x7f1ec014d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ebffff700 1 -- 172.21.15.5:0/3631500266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ec00cd850 msgr2=0x7f1ec00b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ebffff700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ec00cd850 0x7f1ec00b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ebffff700 1 -- 172.21.15.5:0/3631500266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb40094a0 con 0x7f1ec006c120 2023-03-03T06:25:37.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.564+0000 7f1ec4ffb700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ec00cd850 0x7f1ec00b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:37.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.565+0000 7f1ebffff700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec006c120 0x7f1ec00ccee0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40090b0 tx=0x7f1eb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:37.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.565+0000 7f1ebcff9700 1 -- 172.21.15.5:0/3631500266 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb40036a0 con 0x7f1ec006c120 2023-03-03T06:25:37.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.565+0000 7f1ebcff9700 1 -- 172.21.15.5:0/3631500266 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb401e070 con 0x7f1ec006c120 2023-03-03T06:25:37.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.565+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/3631500266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec00cdcc0 con 0x7f1ec006c120 2023-03-03T06:25:37.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.565+0000 7f1ebcff9700 1 -- 172.21.15.5:0/3631500266 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4003a60 con 0x7f1ec006c120 2023-03-03T06:25:37.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.565+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/3631500266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec00d29f0 con 0x7f1ec006c120 2023-03-03T06:25:37.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.566+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/3631500266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec00b8af0 con 0x7f1ec006c120 2023-03-03T06:25:37.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.566+0000 7f1ebcff9700 1 -- 172.21.15.5:0/3631500266 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1eb400f050 con 0x7f1ec006c120 2023-03-03T06:25:37.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.567+0000 7f1ebcff9700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1eac0682f0 0x7f1eac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.567+0000 7f1ebcff9700 1 -- 172.21.15.5:0/3631500266 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1eb4086ed0 con 0x7f1ec006c120 2023-03-03T06:25:37.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.567+0000 7f1ebf7fe700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1eac0682f0 0x7f1eac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.567+0000 7f1ebf7fe700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1eac0682f0 0x7f1eac06a7a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00d2350 tx=0x7f1eb0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:37.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.571+0000 7f1ebcff9700 1 -- 172.21.15.5:0/3631500266 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1eb4053490 con 0x7f1ec006c120 2023-03-03T06:25:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.760+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/3631500266 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1ec00b4b10 con 0x7f1ec006c120 2023-03-03T06:25:37.762 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.761+0000 7f1ebcff9700 1 -- 172.21.15.5:0/3631500266 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1eb4015020 con 0x7f1ec006c120 2023-03-03T06:25:37.762 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:25:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.763+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/3631500266 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1eac0682f0 msgr2=0x7f1eac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.763+0000 7f1ec6a5e700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1eac0682f0 0x7f1eac06a7a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00d2350 tx=0x7f1eb0008040 comp rx=0 tx=0).stop 2023-03-03T06:25:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.763+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/3631500266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec006c120 msgr2=0x7f1ec00ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.764 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.763+0000 7f1ec6a5e700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec006c120 0x7f1ec00ccee0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40090b0 tx=0x7f1eb4004750 comp rx=0 tx=0).stop 2023-03-03T06:25:37.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.763+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/3631500266 shutdown_connections 2023-03-03T06:25:37.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.763+0000 7f1ec6a5e700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ec00cd850 0x7f1ec00b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.763+0000 7f1ec6a5e700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ec006c120 0x7f1ec00ccee0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.763+0000 7f1ec6a5e700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1eac0682f0 0x7f1eac06a7a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.765 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.763+0000 7f1ec6a5e700 1 --2- 172.21.15.5:0/3631500266 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ec00b8720 0x7f1ec014d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.763+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/3631500266 >> 172.21.15.5:0/3631500266 conn(0x7f1ec00d0590 msgr2=0x7f1ec00b66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:37.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.763+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/3631500266 shutdown_connections 2023-03-03T06:25:37.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.763+0000 7f1ec6a5e700 1 -- 172.21.15.5:0/3631500266 wait complete. 2023-03-03T06:25:37.776 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:25:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.903+0000 7fb2f0ff7700 1 Processor -- start 2023-03-03T06:25:37.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.903+0000 7fb2f0ff7700 1 -- start start 2023-03-03T06:25:37.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.904+0000 7fb2f0ff7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2ec15c980 0x7fb2ec160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.904+0000 7fb2f0ff7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2ec06d1f0 0x7fb2ec06b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.904+0000 7fb2f0ff7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec160ea0 con 0x7fb2ec06b860 2023-03-03T06:25:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.904+0000 7fb2f0ff7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec161460 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.904+0000 7fb2f0ff7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec161180 con 0x7fb2ec15c980 2023-03-03T06:25:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.904+0000 7fb2e9d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb2ec06d1f0 0x7fb2ec06b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.904+0000 7fb2ead9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb2ec06b860 0x7fb2ec06dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34650/0 (socket says 172.21.15.5:34650) 2023-03-03T06:25:37.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.904+0000 7fb2ead9d700 1 -- 172.21.15.5:0/1687495889 learned_addr learned my addr 172.21.15.5:0/1687495889 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.904+0000 7fb2ea59c700 1 --2- 172.21.15.5:0/1687495889 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2ec15c980 0x7fb2ec160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.904+0000 7fb2e9d9b700 1 -- 172.21.15.5:0/1687495889 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2ec15c980 msgr2=0x7fb2ec160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.904+0000 7fb2e9d9b700 1 --2- 172.21.15.5:0/1687495889 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2ec15c980 0x7fb2ec160530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.904+0000 7fb2e9d9b700 1 -- 172.21.15.5:0/1687495889 >> v1:172.21.15.5:6789/0 conn(0x7fb2ec06b860 legacy=0x7fb2ec06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.904+0000 7fb2e959a700 1 -- 172.21.15.5:0/1687495889 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321309962 0 0) 0x7fb2ec160ea0 con 0x7fb2ec06b860 2023-03-03T06:25:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.905+0000 7fb2e9d9b700 1 -- 172.21.15.5:0/1687495889 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0ce890 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.905+0000 7fb2e9d9b700 1 --2- 172.21.15.5:0/1687495889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec06d1f0 0x7fb2ec06b320 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009840 tx=0x7fb2dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6768bbde7ccbcc server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:37.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.905+0000 7fb2e959a700 1 -- 172.21.15.5:0/1687495889 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc011830 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.905+0000 7fb2e959a700 1 -- 172.21.15.5:0/1687495889 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc011990 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.905+0000 7fb2e959a700 1 -- 172.21.15.5:0/1687495889 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc011d20 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.905+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1687495889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec06d1f0 msgr2=0x7fb2ec06b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.905+0000 7fb2f0ff7700 1 --2- 172.21.15.5:0/1687495889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec06d1f0 0x7fb2ec06b320 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009840 tx=0x7fb2dc009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:37.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.905+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1687495889 shutdown_connections 2023-03-03T06:25:37.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.905+0000 7fb2f0ff7700 1 --2- 172.21.15.5:0/1687495889 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2ec15c980 0x7fb2ec160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.905+0000 7fb2f0ff7700 1 --2- 172.21.15.5:0/1687495889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec06d1f0 0x7fb2ec06b320 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.905+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1687495889 >> 172.21.15.5:0/1687495889 conn(0x7fb2ec0cfd00 msgr2=0x7fb2ec0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.905+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1687495889 shutdown_connections 2023-03-03T06:25:37.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.906+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1687495889 wait complete. 2023-03-03T06:25:37.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.907+0000 7fb2f0ff7700 1 Processor -- start 2023-03-03T06:25:37.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.907+0000 7fb2f0ff7700 1 -- start start 2023-03-03T06:25:37.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2f0ff7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2ec06b860 0x7fb2ec159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2f0ff7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec06d1f0 0x7fb2ec1f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2f0ff7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2ec15c980 0x7fb2ec0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2f0ff7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec1f6cc0 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2f0ff7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0c79f0 con 0x7fb2ec15c980 2023-03-03T06:25:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2f0ff7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0c7cd0 con 0x7fb2ec06b860 2023-03-03T06:25:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2e9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec06d1f0 0x7fb2ec1f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2e9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec06d1f0 0x7fb2ec1f6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44812/0 (socket says 172.21.15.5:44812) 2023-03-03T06:25:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2e9d9b700 1 -- 172.21.15.5:0/1334450149 learned_addr learned my addr 172.21.15.5:0/1334450149 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2ea59c700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2ec06b860 0x7fb2ec159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2ead9d700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2ec15c980 0x7fb2ec0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2e9d9b700 1 -- 172.21.15.5:0/1334450149 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2ec06b860 msgr2=0x7fb2ec159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2e9d9b700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2ec06b860 0x7fb2ec159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2e9d9b700 1 -- 172.21.15.5:0/1334450149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2ec15c980 msgr2=0x7fb2ec0cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2e9d9b700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2ec15c980 0x7fb2ec0cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2e9d9b700 1 -- 172.21.15.5:0/1334450149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc0094a0 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2ea59c700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2ec06b860 0x7fb2ec159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2e9d9b700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec06d1f0 0x7fb2ec1f6780 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0090b0 tx=0x7fb2dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.908+0000 7fb2daffd700 1 -- 172.21.15.5:0/1334450149 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0045f0 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.909+0000 7fb2daffd700 1 -- 172.21.15.5:0/1334450149 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc01f070 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.909+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1334450149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec15cd50 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.909+0000 7fb2daffd700 1 -- 172.21.15.5:0/1334450149 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc003aa0 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.909+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1334450149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec0ceb70 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.909+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1334450149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec160a70 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.910+0000 7fb2daffd700 1 -- 172.21.15.5:0/1334450149 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb2dc00f050 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.910+0000 7fb2daffd700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb2cc0682f0 0x7fb2cc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:37.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.910+0000 7fb2daffd700 1 -- 172.21.15.5:0/1334450149 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb2dc021070 con 0x7fb2ec06d1f0 2023-03-03T06:25:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.910+0000 7fb2ea59c700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb2cc0682f0 0x7fb2cc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.911+0000 7fb2ea59c700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb2cc0682f0 0x7fb2cc06a7a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0006fd0 tx=0x7fb2e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:37.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:37.915+0000 7fb2daffd700 1 -- 172.21.15.5:0/1334450149 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb2dc054030 con 0x7fb2ec06d1f0 2023-03-03T06:25:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.108+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1334450149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2ec04e6e0 con 0x7fb2ec06d1f0 2023-03-03T06:25:38.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.108+0000 7fb2daffd700 1 -- 172.21.15.5:0/1334450149 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2dc0150a0 con 0x7fb2ec06d1f0 2023-03-03T06:25:38.110 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:25:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.110+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1334450149 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb2cc0682f0 msgr2=0x7fb2cc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.110+0000 7fb2f0ff7700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb2cc0682f0 0x7fb2cc06a7a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0006fd0 tx=0x7fb2e0008040 comp rx=0 tx=0).stop 2023-03-03T06:25:38.111 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.110+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1334450149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec06d1f0 msgr2=0x7fb2ec1f6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.110+0000 7fb2f0ff7700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec06d1f0 0x7fb2ec1f6780 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0090b0 tx=0x7fb2dc004750 comp rx=0 tx=0).stop 2023-03-03T06:25:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.110+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1334450149 shutdown_connections 2023-03-03T06:25:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.110+0000 7fb2f0ff7700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb2ec15c980 0x7fb2ec0cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.110+0000 7fb2f0ff7700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb2cc0682f0 0x7fb2cc06a7a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.110+0000 7fb2f0ff7700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb2ec06b860 0x7fb2ec159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.112 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.110+0000 7fb2f0ff7700 1 --2- 172.21.15.5:0/1334450149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2ec06d1f0 0x7fb2ec1f6780 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.110+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1334450149 >> 172.21.15.5:0/1334450149 conn(0x7fb2ec0cfd00 msgr2=0x7fb2ec0d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.110+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1334450149 shutdown_connections 2023-03-03T06:25:38.113 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.110+0000 7fb2f0ff7700 1 -- 172.21.15.5:0/1334450149 wait complete. 2023-03-03T06:25:38.123 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-03-03T06:25:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.250+0000 7f798dca3700 1 Processor -- start 2023-03-03T06:25:38.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.250+0000 7f798dca3700 1 -- start start 2023-03-03T06:25:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.251+0000 7f798dca3700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f79880cd3e0 0x7f79880cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.251+0000 7f798dca3700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798815e160 con 0x7f79880b1fe0 2023-03-03T06:25:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.251+0000 7f798dca3700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798815d110 con 0x7f798815cd40 2023-03-03T06:25:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.251+0000 7f798dca3700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79880cd870 con 0x7f79880cd3e0 2023-03-03T06:25:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.251+0000 7f7987fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f79880b1fe0 0x7f79880ce290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34664/0 (socket says 172.21.15.5:34664) 2023-03-03T06:25:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.251+0000 7f7987fff700 1 -- 172.21.15.5:0/1915450674 learned_addr learned my addr 172.21.15.5:0/1915450674 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f7986ffd700 1 --2- 172.21.15.5:0/1915450674 >> v2:172.21.15.191:3300/0 conn(0x7f79880cd3e0 0x7f79880cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539652860 0 0) 0x7f798815e160 con 0x7f79880b1fe0 2023-03-03T06:25:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79700035b0 con 0x7f79880b1fe0 2023-03-03T06:25:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 719326110 0 0) 0x7f79700035b0 con 0x7f79880b1fe0 2023-03-03T06:25:38.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 >> v2:172.21.15.191:3300/0 conn(0x7f79880cd3e0 msgr2=0x7f79880cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 --2- 172.21.15.5:0/1915450674 >> v2:172.21.15.191:3300/0 conn(0x7f79880cd3e0 0x7f79880cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 >> v1:172.21.15.191:6789/0 conn(0x7f798815cd40 legacy=0x7f79880b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798815d3c0 con 0x7f79880b1fe0 2023-03-03T06:25:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f79800019f0 con 0x7f79880b1fe0 2023-03-03T06:25:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 >> v1:172.21.15.5:6789/0 conn(0x7f79880b1fe0 legacy=0x7f79880ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 --2- 172.21.15.5:0/1915450674 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7970003a00 0x7f7970003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 --2- 172.21.15.5:0/1915450674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7970004850 0x7f7970004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 --2- 172.21.15.5:0/1915450674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7970005200 0x7f797000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79880cd870 con 0x7f7970005200 2023-03-03T06:25:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797000c110 con 0x7f7970004850 2023-03-03T06:25:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797000c2d0 con 0x7f7970003a00 2023-03-03T06:25:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f7987fff700 1 --2- 172.21.15.5:0/1915450674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7970005200 0x7f797000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f7986ffd700 1 --2- 172.21.15.5:0/1915450674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7970004850 0x7f7970004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f79877fe700 1 --2- 172.21.15.5:0/1915450674 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7970003a00 0x7f7970003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f7987fff700 1 -- 172.21.15.5:0/1915450674 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7970003a00 msgr2=0x7f7970003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f7987fff700 1 --2- 172.21.15.5:0/1915450674 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7970003a00 0x7f7970003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f7987fff700 1 -- 172.21.15.5:0/1915450674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7970004850 msgr2=0x7f7970004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f7987fff700 1 --2- 172.21.15.5:0/1915450674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7970004850 0x7f7970004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.252+0000 7f7987fff700 1 -- 172.21.15.5:0/1915450674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79700035b0 con 0x7f7970005200 2023-03-03T06:25:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.253+0000 7f7987fff700 1 -- 172.21.15.5:0/1915450674 reap_dead start 2023-03-03T06:25:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.253+0000 7f7987fff700 1 --2- 172.21.15.5:0/1915450674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7970005200 0x7f797000ba10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f798000a830 tx=0x7f7970005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccb64bce75a4202 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.253+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798000a2f0 con 0x7f7970005200 2023-03-03T06:25:38.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.253+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7980012620 con 0x7f7970005200 2023-03-03T06:25:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.253+0000 7f79867fc700 1 -- 172.21.15.5:0/1915450674 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79800129d0 con 0x7f7970005200 2023-03-03T06:25:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.253+0000 7f798dca3700 1 -- 172.21.15.5:0/1915450674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7970005200 msgr2=0x7f797000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.253+0000 7f798dca3700 1 --2- 172.21.15.5:0/1915450674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7970005200 0x7f797000ba10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f798000a830 tx=0x7f7970005880 comp rx=0 tx=0).stop 2023-03-03T06:25:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.253+0000 7f798dca3700 1 -- 172.21.15.5:0/1915450674 shutdown_connections 2023-03-03T06:25:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.253+0000 7f798dca3700 1 --2- 172.21.15.5:0/1915450674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7970005200 0x7f797000ba10 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.253+0000 7f798dca3700 1 -- 172.21.15.5:0/1915450674 >> 172.21.15.5:0/1915450674 conn(0x7f79880cc8d0 msgr2=0x7f79880cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:38.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.253+0000 7f798dca3700 1 -- 172.21.15.5:0/1915450674 shutdown_connections 2023-03-03T06:25:38.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.253+0000 7f798dca3700 1 -- 172.21.15.5:0/1915450674 wait complete. 2023-03-03T06:25:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.255+0000 7f798dca3700 1 Processor -- start 2023-03-03T06:25:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.255+0000 7f798dca3700 1 -- start start 2023-03-03T06:25:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f798dca3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7970005200 0x7f79880c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f798dca3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79880b0180 0x7f798815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f798dca3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79880ae770 0x7f79880aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f798dca3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79880c85c0 con 0x7f7970005200 2023-03-03T06:25:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f798dca3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79880c7500 con 0x7f79880b0180 2023-03-03T06:25:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f798dca3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79880c77e0 con 0x7f79880ae770 2023-03-03T06:25:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f79877fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7970005200 0x7f79880c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f79877fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7970005200 0x7f79880c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44830/0 (socket says 172.21.15.5:44830) 2023-03-03T06:25:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f79877fe700 1 -- 172.21.15.5:0/2502361583 learned_addr learned my addr 172.21.15.5:0/2502361583 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f7986ffd700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79880b0180 0x7f798815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f7987fff700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79880ae770 0x7f79880aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f79877fe700 1 -- 172.21.15.5:0/2502361583 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79880ae770 msgr2=0x7f79880aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f79877fe700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79880ae770 0x7f79880aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f79877fe700 1 -- 172.21.15.5:0/2502361583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79880b0180 msgr2=0x7f798815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f79877fe700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79880b0180 0x7f798815b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f79877fe700 1 -- 172.21.15.5:0/2502361583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798815d980 con 0x7f7970005200 2023-03-03T06:25:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f7986ffd700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79880b0180 0x7f798815b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:38.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f79877fe700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7970005200 0x7f79880c6f20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f797800f7f0 tx=0x7f797800fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f796ffff700 1 -- 172.21.15.5:0/2502361583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79780052e0 con 0x7f7970005200 2023-03-03T06:25:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f796ffff700 1 -- 172.21.15.5:0/2502361583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7978005440 con 0x7f7970005200 2023-03-03T06:25:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f798dca3700 1 -- 172.21.15.5:0/2502361583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798815d6a0 con 0x7f7970005200 2023-03-03T06:25:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f796ffff700 1 -- 172.21.15.5:0/2502361583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79780038a0 con 0x7f7970005200 2023-03-03T06:25:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.256+0000 7f798dca3700 1 -- 172.21.15.5:0/2502361583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798815dc60 con 0x7f7970005200 2023-03-03T06:25:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.257+0000 7f798dca3700 1 -- 172.21.15.5:0/2502361583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79880c88a0 con 0x7f7970005200 2023-03-03T06:25:38.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.258+0000 7f796ffff700 1 -- 172.21.15.5:0/2502361583 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7978003a00 con 0x7f7970005200 2023-03-03T06:25:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.258+0000 7f796ffff700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f79740682f0 0x7f797406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.258+0000 7f796ffff700 1 -- 172.21.15.5:0/2502361583 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7978085e80 con 0x7f7970005200 2023-03-03T06:25:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.258+0000 7f7986ffd700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f79740682f0 0x7f797406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.259+0000 7f7986ffd700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f79740682f0 0x7f797406a7a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f797c006ba0 tx=0x7f797c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:38.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.262+0000 7f796ffff700 1 -- 172.21.15.5:0/2502361583 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7978052440 con 0x7f7970005200 2023-03-03T06:25:38.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.453+0000 7f798dca3700 1 -- 172.21.15.5:0/2502361583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f798804e6e0 con 0x7f7970005200 2023-03-03T06:25:38.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.454+0000 7f796ffff700 1 -- 172.21.15.5:0/2502361583 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v56) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7978055a60 con 0x7f7970005200 2023-03-03T06:25:38.456 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:25:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.455+0000 7f798dca3700 1 -- 172.21.15.5:0/2502361583 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f79740682f0 msgr2=0x7f797406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.455+0000 7f798dca3700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f79740682f0 0x7f797406a7a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f797c006ba0 tx=0x7f797c008040 comp rx=0 tx=0).stop 2023-03-03T06:25:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.455+0000 7f798dca3700 1 -- 172.21.15.5:0/2502361583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7970005200 msgr2=0x7f79880c6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.455+0000 7f798dca3700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7970005200 0x7f79880c6f20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f797800f7f0 tx=0x7f797800fbb0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.456+0000 7f798dca3700 1 -- 172.21.15.5:0/2502361583 shutdown_connections 2023-03-03T06:25:38.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.456+0000 7f798dca3700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f79740682f0 0x7f797406a7a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.456+0000 7f798dca3700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79880ae770 0x7f79880aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.456+0000 7f798dca3700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7970005200 0x7f79880c6f20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.456+0000 7f798dca3700 1 --2- 172.21.15.5:0/2502361583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79880b0180 0x7f798815b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.456+0000 7f798dca3700 1 -- 172.21.15.5:0/2502361583 >> 172.21.15.5:0/2502361583 conn(0x7f79880cc8d0 msgr2=0x7f798806c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:38.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.456+0000 7f798dca3700 1 -- 172.21.15.5:0/2502361583 shutdown_connections 2023-03-03T06:25:38.460 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.456+0000 7f798dca3700 1 -- 172.21.15.5:0/2502361583 wait complete. 2023-03-03T06:25:38.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:25:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.596+0000 7fc2aa260700 1 Processor -- start 2023-03-03T06:25:38.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.596+0000 7fc2aa260700 1 -- start start 2023-03-03T06:25:38.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.597+0000 7fc2aa260700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc2a415cc70 0x7fc2a40cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.597+0000 7fc2aa260700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a40cdd80 con 0x7fc2a415dbf0 2023-03-03T06:25:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.597+0000 7fc2aa260700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a415d110 con 0x7fc2a415c8a0 2023-03-03T06:25:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.597+0000 7fc2aa260700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a415d3f0 con 0x7fc2a415cc70 2023-03-03T06:25:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.597+0000 7fc2a3fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc2a415dbf0 0x7fc2a406c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34684/0 (socket says 172.21.15.5:34684) 2023-03-03T06:25:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.597+0000 7fc2a3fff700 1 -- 172.21.15.5:0/149660545 learned_addr learned my addr 172.21.15.5:0/149660545 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a2ffd700 1 --2- 172.21.15.5:0/149660545 >> v2:172.21.15.191:3300/0 conn(0x7fc2a415cc70 0x7fc2a40cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866337387 0 0) 0x7fc2a40cdd80 con 0x7fc2a415dbf0 2023-03-03T06:25:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2900035b0 con 0x7fc2a415dbf0 2023-03-03T06:25:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 126357027 0 0) 0x7fc2900035b0 con 0x7fc2a415dbf0 2023-03-03T06:25:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 >> v2:172.21.15.191:3300/0 conn(0x7fc2a415cc70 msgr2=0x7fc2a40cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 --2- 172.21.15.5:0/149660545 >> v2:172.21.15.191:3300/0 conn(0x7fc2a415cc70 0x7fc2a40cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 >> v1:172.21.15.191:6789/0 conn(0x7fc2a415c8a0 legacy=0x7fc2a4160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a415d6d0 con 0x7fc2a415dbf0 2023-03-03T06:25:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fc29c0019f0 con 0x7fc2a415dbf0 2023-03-03T06:25:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a2ffd700 1 --2- 172.21.15.5:0/149660545 >> v2:172.21.15.191:3300/0 conn(0x7fc2a415cc70 0x7fc2a40cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 >> v1:172.21.15.5:6789/0 conn(0x7fc2a415dbf0 legacy=0x7fc2a406c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 --2- 172.21.15.5:0/149660545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc290003a00 0x7fc290003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 --2- 172.21.15.5:0/149660545 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc290004850 0x7fc290004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 --2- 172.21.15.5:0/149660545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc290005200 0x7fc29000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a415d3f0 con 0x7fc290005200 2023-03-03T06:25:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29000c110 con 0x7fc290003a00 2023-03-03T06:25:38.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29000c2d0 con 0x7fc290004850 2023-03-03T06:25:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a3fff700 1 --2- 172.21.15.5:0/149660545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc290005200 0x7fc29000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a37fe700 1 --2- 172.21.15.5:0/149660545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc290003a00 0x7fc290003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a2ffd700 1 --2- 172.21.15.5:0/149660545 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc290004850 0x7fc290004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a3fff700 1 -- 172.21.15.5:0/149660545 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc290004850 msgr2=0x7fc290004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.598+0000 7fc2a3fff700 1 --2- 172.21.15.5:0/149660545 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc290004850 0x7fc290004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2a3fff700 1 -- 172.21.15.5:0/149660545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc290003a00 msgr2=0x7fc290003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2a3fff700 1 --2- 172.21.15.5:0/149660545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc290003a00 0x7fc290003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2a3fff700 1 -- 172.21.15.5:0/149660545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2900035b0 con 0x7fc290005200 2023-03-03T06:25:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2a3fff700 1 -- 172.21.15.5:0/149660545 reap_dead start 2023-03-03T06:25:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2a3fff700 1 --2- 172.21.15.5:0/149660545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc290005200 0x7fc29000ba10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00a830 tx=0x7fc290005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b66db44edf104e3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:38.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c00a2f0 con 0x7fc290005200 2023-03-03T06:25:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c012620 con 0x7fc290005200 2023-03-03T06:25:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2a27fc700 1 -- 172.21.15.5:0/149660545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c0129d0 con 0x7fc290005200 2023-03-03T06:25:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2aa260700 1 -- 172.21.15.5:0/149660545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc290005200 msgr2=0x7fc29000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2aa260700 1 --2- 172.21.15.5:0/149660545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc290005200 0x7fc29000ba10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00a830 tx=0x7fc290005880 comp rx=0 tx=0).stop 2023-03-03T06:25:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2aa260700 1 -- 172.21.15.5:0/149660545 shutdown_connections 2023-03-03T06:25:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2aa260700 1 --2- 172.21.15.5:0/149660545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc290005200 0x7fc29000ba10 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2aa260700 1 -- 172.21.15.5:0/149660545 >> 172.21.15.5:0/149660545 conn(0x7fc2a40d0820 msgr2=0x7fc2a40d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2aa260700 1 -- 172.21.15.5:0/149660545 shutdown_connections 2023-03-03T06:25:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.599+0000 7fc2aa260700 1 -- 172.21.15.5:0/149660545 wait complete. 2023-03-03T06:25:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.601+0000 7fc2aa260700 1 Processor -- start 2023-03-03T06:25:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.601+0000 7fc2aa260700 1 -- start start 2023-03-03T06:25:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2aa260700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc290005200 0x7fc2a41ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2aa260700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a40b5f80 0x7fc2a40b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2aa260700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2a40b70b0 0x7fc2a40b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2aa260700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a41f31e0 con 0x7fc2a40b5f80 2023-03-03T06:25:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2aa260700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a41f3760 con 0x7fc290005200 2023-03-03T06:25:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2aa260700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a40b7a90 con 0x7fc2a40b70b0 2023-03-03T06:25:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2a2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a40b5f80 0x7fc2a40b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2a2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a40b5f80 0x7fc2a40b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44852/0 (socket says 172.21.15.5:44852) 2023-03-03T06:25:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2a2ffd700 1 -- 172.21.15.5:0/3369410325 learned_addr learned my addr 172.21.15.5:0/3369410325 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2a3fff700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2a40b70b0 0x7fc2a40b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2a37fe700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc290005200 0x7fc2a41ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2a2ffd700 1 -- 172.21.15.5:0/3369410325 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2a40b70b0 msgr2=0x7fc2a40b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2a2ffd700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2a40b70b0 0x7fc2a40b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2a2ffd700 1 -- 172.21.15.5:0/3369410325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc290005200 msgr2=0x7fc2a41ef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2a2ffd700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc290005200 0x7fc2a41ef380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2a2ffd700 1 -- 172.21.15.5:0/3369410325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40cd7a0 con 0x7fc2a40b5f80 2023-03-03T06:25:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2a2ffd700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a40b5f80 0x7fc2a40b63f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc28c011d00 tx=0x7fc28c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:38.618 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc29bfff700 1 -- 172.21.15.5:0/3369410325 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c00fb30 con 0x7fc2a40b5f80 2023-03-03T06:25:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc29bfff700 1 -- 172.21.15.5:0/3369410325 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c00fc90 con 0x7fc2a40b5f80 2023-03-03T06:25:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2aa260700 1 -- 172.21.15.5:0/3369410325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a40ce060 con 0x7fc2a40b5f80 2023-03-03T06:25:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc29bfff700 1 -- 172.21.15.5:0/3369410325 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c004030 con 0x7fc2a40b5f80 2023-03-03T06:25:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.602+0000 7fc2aa260700 1 -- 172.21.15.5:0/3369410325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a40cd930 con 0x7fc2a40b5f80 2023-03-03T06:25:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.603+0000 7fc2aa260700 1 -- 172.21.15.5:0/3369410325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a404e6e0 con 0x7fc2a40b5f80 2023-03-03T06:25:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.604+0000 7fc29bfff700 1 -- 172.21.15.5:0/3369410325 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc28c024070 con 0x7fc2a40b5f80 2023-03-03T06:25:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.604+0000 7fc29bfff700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc2840682f0 0x7fc28406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.621 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.604+0000 7fc29bfff700 1 -- 172.21.15.5:0/3369410325 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc28c086370 con 0x7fc2a40b5f80 2023-03-03T06:25:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.604+0000 7fc2a37fe700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc2840682f0 0x7fc28406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.605+0000 7fc2a37fe700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc2840682f0 0x7fc28406a7a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc294007fd0 tx=0x7fc294009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:38.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.608+0000 7fc29bfff700 1 -- 172.21.15.5:0/3369410325 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc28c052930 con 0x7fc2a40b5f80 2023-03-03T06:25:38.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.803+0000 7fc2aa260700 1 -- 172.21.15.5:0/3369410325 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2a40d0d20 con 0x7fc2a40b5f80 2023-03-03T06:25:38.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.803+0000 7fc29bfff700 1 -- 172.21.15.5:0/3369410325 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc28c055f50 con 0x7fc2a40b5f80 2023-03-03T06:25:38.806 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:25:38.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.805+0000 7fc2aa260700 1 -- 172.21.15.5:0/3369410325 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc2840682f0 msgr2=0x7fc28406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.805+0000 7fc2aa260700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc2840682f0 0x7fc28406a7a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc294007fd0 tx=0x7fc294009040 comp rx=0 tx=0).stop 2023-03-03T06:25:38.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.806+0000 7fc2aa260700 1 -- 172.21.15.5:0/3369410325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a40b5f80 msgr2=0x7fc2a40b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.806+0000 7fc2aa260700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a40b5f80 0x7fc2a40b63f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc28c011d00 tx=0x7fc28c00f520 comp rx=0 tx=0).stop 2023-03-03T06:25:38.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.806+0000 7fc2aa260700 1 -- 172.21.15.5:0/3369410325 shutdown_connections 2023-03-03T06:25:38.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.806+0000 7fc2aa260700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc2840682f0 0x7fc28406a7a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.806+0000 7fc2aa260700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2a40b70b0 0x7fc2a40b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.806+0000 7fc2aa260700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc290005200 0x7fc2a41ef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.806+0000 7fc2aa260700 1 --2- 172.21.15.5:0/3369410325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2a40b5f80 0x7fc2a40b63f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.806+0000 7fc2aa260700 1 -- 172.21.15.5:0/3369410325 >> 172.21.15.5:0/3369410325 conn(0x7fc2a40d0820 msgr2=0x7fc2a415faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:38.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.806+0000 7fc2aa260700 1 -- 172.21.15.5:0/3369410325 shutdown_connections 2023-03-03T06:25:38.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.806+0000 7fc2aa260700 1 -- 172.21.15.5:0/3369410325 wait complete. 2023-03-03T06:25:38.820 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:25:38.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.946+0000 7fad8cf7b700 1 Processor -- start 2023-03-03T06:25:38.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.946+0000 7fad8cf7b700 1 -- start start 2023-03-03T06:25:38.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.947+0000 7fad8cf7b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fad8815a7b0 0x7fad8815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.947+0000 7fad8cf7b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad880cf380 con 0x7fad8806b700 2023-03-03T06:25:38.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.947+0000 7fad8cf7b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad880cf5c0 con 0x7fad880cde30 2023-03-03T06:25:38.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.947+0000 7fad8cf7b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad880cf8a0 con 0x7fad8815a7b0 2023-03-03T06:25:38.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.947+0000 7fad86d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fad8806b700 0x7fad8806bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34700/0 (socket says 172.21.15.5:34700) 2023-03-03T06:25:38.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.947+0000 7fad86d9d700 1 -- 172.21.15.5:0/419003288 learned_addr learned my addr 172.21.15.5:0/419003288 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:38.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.947+0000 7fad8659c700 1 --2- 172.21.15.5:0/419003288 >> v2:172.21.15.191:3300/0 conn(0x7fad8815a7b0 0x7fad8815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.947+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474060998 0 0) 0x7fad80001490 con 0x7fad8806b700 2023-03-03T06:25:38.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.947+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad700035b0 con 0x7fad8806b700 2023-03-03T06:25:38.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3019496790 0 0) 0x7fad700035b0 con 0x7fad8806b700 2023-03-03T06:25:38.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 >> v2:172.21.15.191:3300/0 conn(0x7fad8815a7b0 msgr2=0x7fad8815ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:38.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8559a700 1 --2- 172.21.15.5:0/419003288 >> v2:172.21.15.191:3300/0 conn(0x7fad8815a7b0 0x7fad8815ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 >> v1:172.21.15.191:6789/0 conn(0x7fad880cde30 legacy=0x7fad880cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad880cfb80 con 0x7fad8806b700 2023-03-03T06:25:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fad80001b80 con 0x7fad8806b700 2023-03-03T06:25:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 >> v1:172.21.15.5:6789/0 conn(0x7fad8806b700 legacy=0x7fad8806bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8559a700 1 --2- 172.21.15.5:0/419003288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad70003a00 0x7fad70003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8559a700 1 --2- 172.21.15.5:0/419003288 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad70004850 0x7fad70004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8559a700 1 --2- 172.21.15.5:0/419003288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70005200 0x7fad7000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad880cf8a0 con 0x7fad70005200 2023-03-03T06:25:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7000c080 con 0x7fad70004850 2023-03-03T06:25:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7000c240 con 0x7fad70003a00 2023-03-03T06:25:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad86d9d700 1 --2- 172.21.15.5:0/419003288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70005200 0x7fad7000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad8659c700 1 --2- 172.21.15.5:0/419003288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad70003a00 0x7fad70003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad85d9b700 1 --2- 172.21.15.5:0/419003288 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad70004850 0x7fad70004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad86d9d700 1 -- 172.21.15.5:0/419003288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad70003a00 msgr2=0x7fad70003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad86d9d700 1 --2- 172.21.15.5:0/419003288 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad70003a00 0x7fad70003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad86d9d700 1 -- 172.21.15.5:0/419003288 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad70004850 msgr2=0x7fad70004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:38.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad86d9d700 1 --2- 172.21.15.5:0/419003288 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad70004850 0x7fad70004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad86d9d700 1 -- 172.21.15.5:0/419003288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad700035b0 con 0x7fad70005200 2023-03-03T06:25:38.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad86d9d700 1 -- 172.21.15.5:0/419003288 reap_dead start 2023-03-03T06:25:38.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.948+0000 7fad86d9d700 1 --2- 172.21.15.5:0/419003288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70005200 0x7fad7000ba10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fad8000a830 tx=0x7fad70005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7538bd62eb52281a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:38.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.949+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8000a490 con 0x7fad70005200 2023-03-03T06:25:38.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.949+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad80012620 con 0x7fad70005200 2023-03-03T06:25:38.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.949+0000 7fad8559a700 1 -- 172.21.15.5:0/419003288 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad800129d0 con 0x7fad70005200 2023-03-03T06:25:38.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.949+0000 7fad8cf7b700 1 -- 172.21.15.5:0/419003288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70005200 msgr2=0x7fad7000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.949+0000 7fad8cf7b700 1 --2- 172.21.15.5:0/419003288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70005200 0x7fad7000ba10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fad8000a830 tx=0x7fad70005880 comp rx=0 tx=0).stop 2023-03-03T06:25:38.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.949+0000 7fad8cf7b700 1 -- 172.21.15.5:0/419003288 shutdown_connections 2023-03-03T06:25:38.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.949+0000 7fad8cf7b700 1 --2- 172.21.15.5:0/419003288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70005200 0x7fad7000ba10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.949+0000 7fad8cf7b700 1 -- 172.21.15.5:0/419003288 >> 172.21.15.5:0/419003288 conn(0x7fad880cc8d0 msgr2=0x7fad880cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.949+0000 7fad8cf7b700 1 -- 172.21.15.5:0/419003288 shutdown_connections 2023-03-03T06:25:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.949+0000 7fad8cf7b700 1 -- 172.21.15.5:0/419003288 wait complete. 2023-03-03T06:25:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.951+0000 7fad8cf7b700 1 Processor -- start 2023-03-03T06:25:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.951+0000 7fad8cf7b700 1 -- start start 2023-03-03T06:25:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8cf7b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70005200 0x7fad880c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8cf7b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad88148e50 0x7fad881492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8cf7b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad881e2b80 0x7fad881e3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8cf7b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad88149800 con 0x7fad70005200 2023-03-03T06:25:38.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8cf7b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad881e38b0 con 0x7fad881e2b80 2023-03-03T06:25:38.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8cf7b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad881e3b90 con 0x7fad88148e50 2023-03-03T06:25:38.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70005200 0x7fad880c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70005200 0x7fad880c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44870/0 (socket says 172.21.15.5:44870) 2023-03-03T06:25:38.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8659c700 1 -- 172.21.15.5:0/319633714 learned_addr learned my addr 172.21.15.5:0/319633714 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:38.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad85d9b700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad88148e50 0x7fad881492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad86d9d700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad881e2b80 0x7fad881e3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8659c700 1 -- 172.21.15.5:0/319633714 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad88148e50 msgr2=0x7fad881492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8659c700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad88148e50 0x7fad881492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8659c700 1 -- 172.21.15.5:0/319633714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad881e2b80 msgr2=0x7fad881e3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8659c700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad881e2b80 0x7fad881e3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.952+0000 7fad8659c700 1 -- 172.21.15.5:0/319633714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad880b3020 con 0x7fad70005200 2023-03-03T06:25:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.953+0000 7fad8659c700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70005200 0x7fad880c91a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fad780119a0 tx=0x7fad78011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.953+0000 7fad76ffd700 1 -- 172.21.15.5:0/319633714 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7800f940 con 0x7fad70005200 2023-03-03T06:25:38.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.953+0000 7fad76ffd700 1 -- 172.21.15.5:0/319633714 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7800faa0 con 0x7fad70005200 2023-03-03T06:25:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.953+0000 7fad8cf7b700 1 -- 172.21.15.5:0/319633714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad880b2d40 con 0x7fad70005200 2023-03-03T06:25:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.953+0000 7fad76ffd700 1 -- 172.21.15.5:0/319633714 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7800fe30 con 0x7fad70005200 2023-03-03T06:25:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.953+0000 7fad8cf7b700 1 -- 172.21.15.5:0/319633714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8815ab80 con 0x7fad70005200 2023-03-03T06:25:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.954+0000 7fad8cf7b700 1 -- 172.21.15.5:0/319633714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8804e6e0 con 0x7fad70005200 2023-03-03T06:25:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.954+0000 7fad76ffd700 1 -- 172.21.15.5:0/319633714 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fad78014440 con 0x7fad70005200 2023-03-03T06:25:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.954+0000 7fad76ffd700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fad680682f0 0x7fad6806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.955+0000 7fad76ffd700 1 -- 172.21.15.5:0/319633714 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fad780867a0 con 0x7fad70005200 2023-03-03T06:25:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.955+0000 7fad85d9b700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fad680682f0 0x7fad6806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.955+0000 7fad85d9b700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fad680682f0 0x7fad6806a7a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fad880b1ba0 tx=0x7fad7c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:38.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:38.959+0000 7fad76ffd700 1 -- 172.21.15.5:0/319633714 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fad78052d00 con 0x7fad70005200 2023-03-03T06:25:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.155+0000 7fad8cf7b700 1 -- 172.21.15.5:0/319633714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad880cf160 con 0x7fad70005200 2023-03-03T06:25:39.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.155+0000 7fad76ffd700 1 -- 172.21.15.5:0/319633714 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad78022020 con 0x7fad70005200 2023-03-03T06:25:39.158 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:25:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.158+0000 7fad8cf7b700 1 -- 172.21.15.5:0/319633714 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fad680682f0 msgr2=0x7fad6806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.158+0000 7fad8cf7b700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fad680682f0 0x7fad6806a7a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fad880b1ba0 tx=0x7fad7c009040 comp rx=0 tx=0).stop 2023-03-03T06:25:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.158+0000 7fad8cf7b700 1 -- 172.21.15.5:0/319633714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70005200 msgr2=0x7fad880c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.158+0000 7fad8cf7b700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70005200 0x7fad880c91a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fad780119a0 tx=0x7fad78011d60 comp rx=0 tx=0).stop 2023-03-03T06:25:39.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.158+0000 7fad8cf7b700 1 -- 172.21.15.5:0/319633714 shutdown_connections 2023-03-03T06:25:39.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.158+0000 7fad8cf7b700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad881e2b80 0x7fad881e3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.158+0000 7fad8cf7b700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad70005200 0x7fad880c91a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.158+0000 7fad8cf7b700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fad680682f0 0x7fad6806a7a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.158+0000 7fad8cf7b700 1 --2- 172.21.15.5:0/319633714 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fad88148e50 0x7fad881492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.158+0000 7fad8cf7b700 1 -- 172.21.15.5:0/319633714 >> 172.21.15.5:0/319633714 conn(0x7fad880cc8d0 msgr2=0x7fad88159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:39.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.158+0000 7fad8cf7b700 1 -- 172.21.15.5:0/319633714 shutdown_connections 2023-03-03T06:25:39.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.158+0000 7fad8cf7b700 1 -- 172.21.15.5:0/319633714 wait complete. 2023-03-03T06:25:39.172 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-03T06:25:39.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.296+0000 7f4d19714700 1 Processor -- start 2023-03-03T06:25:39.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.297+0000 7f4d19714700 1 -- start start 2023-03-03T06:25:39.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.297+0000 7f4d19714700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d140b8a40 0x7f4d14160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:39.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.297+0000 7f4d19714700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d1406c830 0x7f4d140d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:39.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.297+0000 7f4d19714700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d140d2e10 con 0x7f4d140cf2a0 2023-03-03T06:25:39.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.297+0000 7f4d19714700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d14161490 con 0x7f4d1406c830 2023-03-03T06:25:39.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.297+0000 7f4d19714700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140cd8d0 con 0x7f4d140b8a40 2023-03-03T06:25:39.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d137fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d1406c830 0x7f4d140d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:39.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d127fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4d140cf2a0 0x7f4d1406c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34720/0 (socket says 172.21.15.5:34720) 2023-03-03T06:25:39.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d137fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4d1406c830 0x7f4d140d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44880/0 (socket says 172.21.15.5:44880) 2023-03-03T06:25:39.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d127fc700 1 -- 172.21.15.5:0/2500787824 learned_addr learned my addr 172.21.15.5:0/2500787824 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:39.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d12ffd700 1 --2- 172.21.15.5:0/2500787824 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d140b8a40 0x7f4d14160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:39.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d137fe700 1 -- 172.21.15.5:0/2500787824 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d140b8a40 msgr2=0x7f4d14160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:39.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d137fe700 1 --2- 172.21.15.5:0/2500787824 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d140b8a40 0x7f4d14160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d137fe700 1 -- 172.21.15.5:0/2500787824 >> v1:172.21.15.5:6789/0 conn(0x7f4d140cf2a0 legacy=0x7f4d1406c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:39.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d11ffb700 1 -- 172.21.15.5:0/2500787824 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604364434 0 0) 0x7f4d04001110 con 0x7f4d140cf2a0 2023-03-03T06:25:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d137fe700 1 -- 172.21.15.5:0/2500787824 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d140d2520 con 0x7f4d1406c830 2023-03-03T06:25:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d137fe700 1 --2- 172.21.15.5:0/2500787824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d1406c830 0x7f4d140d0c20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009d90 tx=0x7f4d0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f5e7b14ea74396 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d11ffb700 1 -- 172.21.15.5:0/2500787824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00e070 con 0x7f4d1406c830 2023-03-03T06:25:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d11ffb700 1 -- 172.21.15.5:0/2500787824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c00bbd0 con 0x7f4d1406c830 2023-03-03T06:25:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.298+0000 7f4d11ffb700 1 -- 172.21.15.5:0/2500787824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c012430 con 0x7f4d1406c830 2023-03-03T06:25:39.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.299+0000 7f4d19714700 1 -- 172.21.15.5:0/2500787824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d1406c830 msgr2=0x7f4d140d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:39.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.299+0000 7f4d19714700 1 --2- 172.21.15.5:0/2500787824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d1406c830 0x7f4d140d0c20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009d90 tx=0x7f4d0c00b330 comp rx=0 tx=0).stop 2023-03-03T06:25:39.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.299+0000 7f4d19714700 1 -- 172.21.15.5:0/2500787824 shutdown_connections 2023-03-03T06:25:39.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.299+0000 7f4d19714700 1 --2- 172.21.15.5:0/2500787824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d1406c830 0x7f4d140d0c20 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.299+0000 7f4d19714700 1 --2- 172.21.15.5:0/2500787824 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d140b8a40 0x7f4d14160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.299+0000 7f4d19714700 1 -- 172.21.15.5:0/2500787824 >> 172.21.15.5:0/2500787824 conn(0x7f4d140d05d0 msgr2=0x7f4d140d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.299+0000 7f4d19714700 1 -- 172.21.15.5:0/2500787824 shutdown_connections 2023-03-03T06:25:39.307 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.299+0000 7f4d19714700 1 -- 172.21.15.5:0/2500787824 wait complete. 2023-03-03T06:25:39.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.300+0000 7f4d19714700 1 Processor -- start 2023-03-03T06:25:39.309 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.300+0000 7f4d19714700 1 -- start start 2023-03-03T06:25:39.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d19714700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d1406c830 0x7f4d140c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:39.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d19714700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d140b8a40 0x7f4d1414f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:39.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d19714700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d140cf2a0 0x7f4d141f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:39.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d19714700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140cc250 con 0x7f4d140cf2a0 2023-03-03T06:25:39.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d19714700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d141f6a70 con 0x7f4d1406c830 2023-03-03T06:25:39.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d19714700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140cbbd0 con 0x7f4d140b8a40 2023-03-03T06:25:39.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d140cf2a0 0x7f4d141f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:39.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d137fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d140cf2a0 0x7f4d141f6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44886/0 (socket says 172.21.15.5:44886) 2023-03-03T06:25:39.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d137fe700 1 -- 172.21.15.5:0/2541069100 learned_addr learned my addr 172.21.15.5:0/2541069100 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d12ffd700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d1406c830 0x7f4d140c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d127fc700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d140b8a40 0x7f4d1414f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d137fe700 1 -- 172.21.15.5:0/2541069100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d140b8a40 msgr2=0x7f4d1414f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d137fe700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d140b8a40 0x7f4d1414f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d137fe700 1 -- 172.21.15.5:0/2541069100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d1406c830 msgr2=0x7f4d140c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:39.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d137fe700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d1406c830 0x7f4d140c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d137fe700 1 -- 172.21.15.5:0/2541069100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c009a70 con 0x7f4d140cf2a0 2023-03-03T06:25:39.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.301+0000 7f4d137fe700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d140cf2a0 0x7f4d141f6530 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4d1408b940 tx=0x7f4d0c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:39.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.302+0000 7f4cfb7fe700 1 -- 172.21.15.5:0/2541069100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c012430 con 0x7f4d140cf2a0 2023-03-03T06:25:39.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.302+0000 7f4cfb7fe700 1 -- 172.21.15.5:0/2541069100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c020070 con 0x7f4d140cf2a0 2023-03-03T06:25:39.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.302+0000 7f4d19714700 1 -- 172.21.15.5:0/2541069100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d140d2850 con 0x7f4d140cf2a0 2023-03-03T06:25:39.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.302+0000 7f4cfb7fe700 1 -- 172.21.15.5:0/2541069100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c004280 con 0x7f4d140cf2a0 2023-03-03T06:25:39.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.302+0000 7f4d19714700 1 -- 172.21.15.5:0/2541069100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1415ce30 con 0x7f4d140cf2a0 2023-03-03T06:25:39.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.303+0000 7f4d19714700 1 -- 172.21.15.5:0/2541069100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d140d2b30 con 0x7f4d140cf2a0 2023-03-03T06:25:39.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.303+0000 7f4cfb7fe700 1 -- 172.21.15.5:0/2541069100 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4d0c0043e0 con 0x7f4d140cf2a0 2023-03-03T06:25:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.304+0000 7f4cfb7fe700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4d000682f0 0x7f4d0006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.304+0000 7f4cfb7fe700 1 -- 172.21.15.5:0/2541069100 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4d0c022070 con 0x7f4d140cf2a0 2023-03-03T06:25:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.304+0000 7f4d12ffd700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4d000682f0 0x7f4d0006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:39.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.304+0000 7f4d12ffd700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4d000682f0 0x7f4d0006a7a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009930 tx=0x7f4d08008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:39.316 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.308+0000 7f4cfb7fe700 1 -- 172.21.15.5:0/2541069100 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4d0c054a10 con 0x7f4d140cf2a0 2023-03-03T06:25:39.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.518+0000 7f4d19714700 1 -- 172.21.15.5:0/2541069100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4d1404e6e0 con 0x7f4d140cf2a0 2023-03-03T06:25:39.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.518+0000 7f4cfb7fe700 1 -- 172.21.15.5:0/2541069100 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4d0c058030 con 0x7f4d140cf2a0 2023-03-03T06:25:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.521+0000 7f4d19714700 1 -- 172.21.15.5:0/2541069100 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4d000682f0 msgr2=0x7f4d0006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.521+0000 7f4d19714700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4d000682f0 0x7f4d0006a7a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009930 tx=0x7f4d08008040 comp rx=0 tx=0).stop 2023-03-03T06:25:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.521+0000 7f4d19714700 1 -- 172.21.15.5:0/2541069100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d140cf2a0 msgr2=0x7f4d141f6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:39.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.521+0000 7f4d19714700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d140cf2a0 0x7f4d141f6530 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4d1408b940 tx=0x7f4d0c004ad0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.521+0000 7f4d19714700 1 -- 172.21.15.5:0/2541069100 shutdown_connections 2023-03-03T06:25:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.521+0000 7f4d19714700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d140cf2a0 0x7f4d141f6530 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.521+0000 7f4d19714700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d1406c830 0x7f4d140c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.521+0000 7f4d19714700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4d000682f0 0x7f4d0006a7a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.521+0000 7f4d19714700 1 --2- 172.21.15.5:0/2541069100 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4d140b8a40 0x7f4d1414f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.521+0000 7f4d19714700 1 -- 172.21.15.5:0/2541069100 >> 172.21.15.5:0/2541069100 conn(0x7f4d140d05d0 msgr2=0x7f4d1406c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.521+0000 7f4d19714700 1 -- 172.21.15.5:0/2541069100 shutdown_connections 2023-03-03T06:25:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.521+0000 7f4d19714700 1 -- 172.21.15.5:0/2541069100 wait complete. 2023-03-03T06:25:39.525 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-03-03T06:25:39.535 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-03-03T06:25:39.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:39.536 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-03-03T06:25:39.583 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-03-03T06:25:39.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:25:39.584 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-03-03T06:25:39.602 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:25:39.602 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:39.623 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-03-03T06:25:39.623 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:25:39.623 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:39.660 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287360k,nr_inodes=4071840,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19712 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-03-03T06:25:39.661 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:25:39.662 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:39.682 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-03-03T06:25:39.683 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.823+0000 7fa0a43bf700 1 Processor -- start 2023-03-03T06:25:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.823+0000 7fa0a43bf700 1 -- start start 2023-03-03T06:25:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.824+0000 7fa0a43bf700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa09c0b1fe0 0x7fa09c0cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:39.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.824+0000 7fa0a43bf700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa09c0cba50 0x7fa09c0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.824+0000 7fa0a43bf700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09c15d4e0 con 0x7fa09c15cd40 2023-03-03T06:25:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.824+0000 7fa0a43bf700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09c15d7c0 con 0x7fa09c0cba50 2023-03-03T06:25:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.824+0000 7fa0a43bf700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09c15daa0 con 0x7fa09c0b1fe0 2023-03-03T06:25:39.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.824+0000 7fa0a295c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa09c0cba50 0x7fa09c0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.824+0000 7fa0a295c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa09c0cba50 0x7fa09c0ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44894/0 (socket says 172.21.15.5:44894) 2023-03-03T06:25:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.824+0000 7fa0a295c700 1 -- 172.21.15.5:0/2883058790 learned_addr learned my addr 172.21.15.5:0/2883058790 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.824+0000 7fa0a195a700 1 --2- 172.21.15.5:0/2883058790 >> v2:172.21.15.191:3300/0 conn(0x7fa09c0b1fe0 0x7fa09c0cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.825+0000 7fa0a295c700 1 -- 172.21.15.5:0/2883058790 >> v2:172.21.15.191:3300/0 conn(0x7fa09c0b1fe0 msgr2=0x7fa09c0cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:39.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.825+0000 7fa0a295c700 1 --2- 172.21.15.5:0/2883058790 >> v2:172.21.15.191:3300/0 conn(0x7fa09c0b1fe0 0x7fa09c0cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.825+0000 7fa0a295c700 1 -- 172.21.15.5:0/2883058790 >> v1:172.21.15.191:6789/0 conn(0x7fa09c15cd40 legacy=0x7fa09c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:39.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.825+0000 7fa0a295c700 1 -- 172.21.15.5:0/2883058790 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c15dd80 con 0x7fa09c0cba50 2023-03-03T06:25:39.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.825+0000 7fa0a295c700 1 --2- 172.21.15.5:0/2883058790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c0cba50 0x7fa09c0ce490 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0c6ed0 tx=0x7fa09400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db351deb0bad5845 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:39.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.825+0000 7fa0a1159700 1 -- 172.21.15.5:0/2883058790 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09400e070 con 0x7fa09c0cba50 2023-03-03T06:25:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.825+0000 7fa0a1159700 1 -- 172.21.15.5:0/2883058790 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09400b910 con 0x7fa09c0cba50 2023-03-03T06:25:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.825+0000 7fa0a1159700 1 -- 172.21.15.5:0/2883058790 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09400bcc0 con 0x7fa09c0cba50 2023-03-03T06:25:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.825+0000 7fa0a43bf700 1 -- 172.21.15.5:0/2883058790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c0cba50 msgr2=0x7fa09c0ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.825+0000 7fa0a43bf700 1 --2- 172.21.15.5:0/2883058790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c0cba50 0x7fa09c0ce490 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0c6ed0 tx=0x7fa09400b330 comp rx=0 tx=0).stop 2023-03-03T06:25:39.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.826+0000 7fa0a43bf700 1 -- 172.21.15.5:0/2883058790 shutdown_connections 2023-03-03T06:25:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.826+0000 7fa0a43bf700 1 --2- 172.21.15.5:0/2883058790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c0cba50 0x7fa09c0ce490 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.826+0000 7fa0a43bf700 1 --2- 172.21.15.5:0/2883058790 >> v2:172.21.15.191:3300/0 conn(0x7fa09c0b1fe0 0x7fa09c0cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.826+0000 7fa0a43bf700 1 -- 172.21.15.5:0/2883058790 >> 172.21.15.5:0/2883058790 conn(0x7fa09c0cc8d0 msgr2=0x7fa09c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:39.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.826+0000 7fa0a43bf700 1 -- 172.21.15.5:0/2883058790 shutdown_connections 2023-03-03T06:25:39.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.826+0000 7fa0a43bf700 1 -- 172.21.15.5:0/2883058790 wait complete. 2023-03-03T06:25:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.827+0000 7fa0a43bf700 1 Processor -- start 2023-03-03T06:25:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.827+0000 7fa0a43bf700 1 -- start start 2023-03-03T06:25:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.827+0000 7fa0a43bf700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa09c0b1fe0 0x7fa09c153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:39.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.827+0000 7fa0a43bf700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa09c0cba50 0x7fa09c0c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.827+0000 7fa0a43bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15cd40 0x7fa09c0c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.827+0000 7fa0a43bf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0c9c60 con 0x7fa09c15cd40 2023-03-03T06:25:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.827+0000 7fa0a43bf700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0c7ad0 con 0x7fa09c0cba50 2023-03-03T06:25:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a43bf700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0c7db0 con 0x7fa09c0b1fe0 2023-03-03T06:25:39.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a295c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15cd40 0x7fa09c0c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:39.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a295c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15cd40 0x7fa09c0c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44900/0 (socket says 172.21.15.5:44900) 2023-03-03T06:25:39.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a295c700 1 -- 172.21.15.5:0/3464995147 learned_addr learned my addr 172.21.15.5:0/3464995147 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:39.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a195a700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa09c0cba50 0x7fa09c0c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:39.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a215b700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa09c0b1fe0 0x7fa09c153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:39.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a295c700 1 -- 172.21.15.5:0/3464995147 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa09c0b1fe0 msgr2=0x7fa09c153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:39.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a295c700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa09c0b1fe0 0x7fa09c153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a295c700 1 -- 172.21.15.5:0/3464995147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa09c0cba50 msgr2=0x7fa09c0c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:39.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a295c700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa09c0cba50 0x7fa09c0c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:39.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a295c700 1 -- 172.21.15.5:0/3464995147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa094009b30 con 0x7fa09c15cd40 2023-03-03T06:25:39.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a195a700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa09c0cba50 0x7fa09c0c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:39.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a295c700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15cd40 0x7fa09c0c57e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa09c071050 tx=0x7fa094004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:39.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa08effd700 1 -- 172.21.15.5:0/3464995147 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0940099b0 con 0x7fa09c15cd40 2023-03-03T06:25:39.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa08effd700 1 -- 172.21.15.5:0/3464995147 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0940092e0 con 0x7fa09c15cd40 2023-03-03T06:25:39.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa08effd700 1 -- 172.21.15.5:0/3464995147 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09401c640 con 0x7fa09c15cd40 2023-03-03T06:25:39.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a43bf700 1 -- 172.21.15.5:0/3464995147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09c0ca530 con 0x7fa09c15cd40 2023-03-03T06:25:39.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.828+0000 7fa0a43bf700 1 -- 172.21.15.5:0/3464995147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09c15e060 con 0x7fa09c15cd40 2023-03-03T06:25:39.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.829+0000 7fa0a43bf700 1 -- 172.21.15.5:0/3464995147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09c15d110 con 0x7fa09c15cd40 2023-03-03T06:25:39.842 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.830+0000 7fa08effd700 1 -- 172.21.15.5:0/3464995147 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa09402c070 con 0x7fa09c15cd40 2023-03-03T06:25:39.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.830+0000 7fa08effd700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0800682f0 0x7fa08006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:39.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.830+0000 7fa08effd700 1 -- 172.21.15.5:0/3464995147 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa094087b30 con 0x7fa09c15cd40 2023-03-03T06:25:39.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.830+0000 7fa0a215b700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0800682f0 0x7fa08006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:39.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.831+0000 7fa0a215b700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0800682f0 0x7fa08006a7a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa090000f60 tx=0x7fa090009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:39.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:39.835+0000 7fa08effd700 1 -- 172.21.15.5:0/3464995147 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa0940540f0 con 0x7fa09c15cd40 2023-03-03T06:25:40.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.074+0000 7fa0a43bf700 1 -- 172.21.15.5:0/3464995147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa09c0c8270 con 0x7fa09c15cd40 2023-03-03T06:25:40.076 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.074+0000 7fa08effd700 1 -- 172.21.15.5:0/3464995147 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4643 (secure 0 0 0) 0x7fa094057710 con 0x7fa09c15cd40 2023-03-03T06:25:40.077 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:40.077 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1328243693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":1328243693},{"type":"v1","addr":"172.21.15.191:6835","nonce":1328243693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/2339980581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2339980581},{"type":"v1","addr":"172.21.15.5:6836","nonce":2339980581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/620202132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":620202132},{"type":"v1","addr":"172.21.15.5:6837","nonce":620202132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:25:24.916109+0000","modified":"2023-03-03T06:25:27.928605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5410":{"gid":5410,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6834/950486040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":950486040},{"type":"v1","addr":"172.21.15.191:6834","nonce":950486040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-03-03T06:25:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.076+0000 7fa0a43bf700 1 -- 172.21.15.5:0/3464995147 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0800682f0 msgr2=0x7fa08006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.076+0000 7fa0a43bf700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0800682f0 0x7fa08006a7a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa090000f60 tx=0x7fa090009040 comp rx=0 tx=0).stop 2023-03-03T06:25:40.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.076+0000 7fa0a43bf700 1 -- 172.21.15.5:0/3464995147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15cd40 msgr2=0x7fa09c0c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.076+0000 7fa0a43bf700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15cd40 0x7fa09c0c57e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa09c071050 tx=0x7fa094004ad0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.076+0000 7fa0a43bf700 1 -- 172.21.15.5:0/3464995147 shutdown_connections 2023-03-03T06:25:40.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.076+0000 7fa0a43bf700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa09c15cd40 0x7fa09c0c57e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.076+0000 7fa0a43bf700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0800682f0 0x7fa08006a7a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.076+0000 7fa0a43bf700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa09c0b1fe0 0x7fa09c153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.076+0000 7fa0a43bf700 1 --2- 172.21.15.5:0/3464995147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa09c0cba50 0x7fa09c0c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.076+0000 7fa0a43bf700 1 -- 172.21.15.5:0/3464995147 >> 172.21.15.5:0/3464995147 conn(0x7fa09c0cc8d0 msgr2=0x7fa09c0af340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:40.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.076+0000 7fa0a43bf700 1 -- 172.21.15.5:0/3464995147 shutdown_connections 2023-03-03T06:25:40.080 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.076+0000 7fa0a43bf700 1 -- 172.21.15.5:0/3464995147 wait complete. 2023-03-03T06:25:40.080 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2023-03-03T06:25:40.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:40.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.212+0000 7f2e4f288700 1 Processor -- start 2023-03-03T06:25:40.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.213+0000 7f2e4f288700 1 -- start start 2023-03-03T06:25:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4f288700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e4815d320 0x7f2e480cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4f288700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2e480b18d0 0x7f2e480b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4f288700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e481577c0 con 0x7f2e481573f0 2023-03-03T06:25:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4f288700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e480cc6e0 con 0x7f2e480b18d0 2023-03-03T06:25:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4f288700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480cd790 con 0x7f2e4815d320 2023-03-03T06:25:40.218 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4d024700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2e481573f0 0x7f2e480cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34746/0 (socket says 172.21.15.5:34746) 2023-03-03T06:25:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4d024700 1 -- 172.21.15.5:0/383812082 learned_addr learned my addr 172.21.15.5:0/383812082 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4d825700 1 --2- 172.21.15.5:0/383812082 >> v2:172.21.15.5:3300/0 conn(0x7f2e480b18d0 0x7f2e480b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e3bfff700 1 -- 172.21.15.5:0/383812082 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531349186 0 0) 0x7f2e481577c0 con 0x7f2e481573f0 2023-03-03T06:25:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e3bfff700 1 -- 172.21.15.5:0/383812082 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e340057c0 con 0x7f2e481573f0 2023-03-03T06:25:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4c823700 1 --2- 172.21.15.5:0/383812082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e4815d320 0x7f2e480cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4d825700 1 -- 172.21.15.5:0/383812082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e4815d320 msgr2=0x7f2e480cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:40.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4d825700 1 --2- 172.21.15.5:0/383812082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e4815d320 0x7f2e480cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4d825700 1 -- 172.21.15.5:0/383812082 >> v1:172.21.15.5:6789/0 conn(0x7f2e481573f0 legacy=0x7f2e480cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4d825700 1 -- 172.21.15.5:0/383812082 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e480b2270 con 0x7f2e480b18d0 2023-03-03T06:25:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.214+0000 7f2e4d825700 1 --2- 172.21.15.5:0/383812082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e480b18d0 0x7f2e480b1d30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009d90 tx=0x7f2e4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94c466398140e85 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.215+0000 7f2e3bfff700 1 -- 172.21.15.5:0/383812082 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4000e070 con 0x7f2e480b18d0 2023-03-03T06:25:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.215+0000 7f2e3bfff700 1 -- 172.21.15.5:0/383812082 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4000bb20 con 0x7f2e480b18d0 2023-03-03T06:25:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.215+0000 7f2e3bfff700 1 -- 172.21.15.5:0/383812082 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40012430 con 0x7f2e480b18d0 2023-03-03T06:25:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.215+0000 7f2e4f288700 1 -- 172.21.15.5:0/383812082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e480b18d0 msgr2=0x7f2e480b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.215+0000 7f2e4f288700 1 --2- 172.21.15.5:0/383812082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e480b18d0 0x7f2e480b1d30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009d90 tx=0x7f2e4000b330 comp rx=0 tx=0).stop 2023-03-03T06:25:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.215+0000 7f2e4f288700 1 -- 172.21.15.5:0/383812082 shutdown_connections 2023-03-03T06:25:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.215+0000 7f2e4f288700 1 --2- 172.21.15.5:0/383812082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e480b18d0 0x7f2e480b1d30 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.215+0000 7f2e4f288700 1 --2- 172.21.15.5:0/383812082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e4815d320 0x7f2e480cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.215+0000 7f2e4f288700 1 -- 172.21.15.5:0/383812082 >> 172.21.15.5:0/383812082 conn(0x7f2e480cc8d0 msgr2=0x7f2e480cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.215+0000 7f2e4f288700 1 -- 172.21.15.5:0/383812082 shutdown_connections 2023-03-03T06:25:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.215+0000 7f2e4f288700 1 -- 172.21.15.5:0/383812082 wait complete. 2023-03-03T06:25:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.216+0000 7f2e4f288700 1 Processor -- start 2023-03-03T06:25:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.217+0000 7f2e4f288700 1 -- start start 2023-03-03T06:25:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.217+0000 7f2e4f288700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e480b18d0 0x7f2e48144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.217+0000 7f2e4f288700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e481573f0 0x7f2e4815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.217+0000 7f2e4f288700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e4815d320 0x7f2e4815a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.217+0000 7f2e4f288700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48144650 con 0x7f2e481573f0 2023-03-03T06:25:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.217+0000 7f2e4f288700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480b3020 con 0x7f2e480b18d0 2023-03-03T06:25:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.217+0000 7f2e4f288700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480b3300 con 0x7f2e4815d320 2023-03-03T06:25:40.226 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.217+0000 7f2e4c823700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e481573f0 0x7f2e4815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.217+0000 7f2e4c823700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e481573f0 0x7f2e4815a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44912/0 (socket says 172.21.15.5:44912) 2023-03-03T06:25:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.217+0000 7f2e4c823700 1 -- 172.21.15.5:0/699871989 learned_addr learned my addr 172.21.15.5:0/699871989 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.218+0000 7f2e4d825700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e4815d320 0x7f2e4815a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.218+0000 7f2e4d024700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e480b18d0 0x7f2e48144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.218+0000 7f2e4c823700 1 -- 172.21.15.5:0/699871989 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e4815d320 msgr2=0x7f2e4815a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.218+0000 7f2e4c823700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e4815d320 0x7f2e4815a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.218+0000 7f2e4c823700 1 -- 172.21.15.5:0/699871989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e480b18d0 msgr2=0x7f2e48144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.227 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.218+0000 7f2e4c823700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e480b18d0 0x7f2e48144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.218+0000 7f2e4c823700 1 -- 172.21.15.5:0/699871989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e40009a70 con 0x7f2e481573f0 2023-03-03T06:25:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.218+0000 7f2e4c823700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e481573f0 0x7f2e4815a2f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00c7f0 tx=0x7f2e3c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.218+0000 7f2e39ffb700 1 -- 172.21.15.5:0/699871989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c011800 con 0x7f2e481573f0 2023-03-03T06:25:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.218+0000 7f2e39ffb700 1 -- 172.21.15.5:0/699871989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c011960 con 0x7f2e481573f0 2023-03-03T06:25:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.218+0000 7f2e4f288700 1 -- 172.21.15.5:0/699871989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e480ce460 con 0x7f2e481573f0 2023-03-03T06:25:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.218+0000 7f2e39ffb700 1 -- 172.21.15.5:0/699871989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c011cf0 con 0x7f2e481573f0 2023-03-03T06:25:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.218+0000 7f2e4f288700 1 -- 172.21.15.5:0/699871989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e48159e60 con 0x7f2e481573f0 2023-03-03T06:25:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.219+0000 7f2e4f288700 1 -- 172.21.15.5:0/699871989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4815d900 con 0x7f2e481573f0 2023-03-03T06:25:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.219+0000 7f2e39ffb700 1 -- 172.21.15.5:0/699871989 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2e3c021070 con 0x7f2e481573f0 2023-03-03T06:25:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.220+0000 7f2e39ffb700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2e2c0682f0 0x7f2e2c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.220+0000 7f2e39ffb700 1 -- 172.21.15.5:0/699871989 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2e3c085ce0 con 0x7f2e481573f0 2023-03-03T06:25:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.220+0000 7f2e4d024700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2e2c0682f0 0x7f2e2c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.229 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.220+0000 7f2e4d024700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2e2c0682f0 0x7f2e2c06a7a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2e440011e0 tx=0x7f2e44009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:40.230 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.224+0000 7f2e39ffb700 1 -- 172.21.15.5:0/699871989 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2e3c0522a0 con 0x7f2e481573f0 2023-03-03T06:25:40.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.421+0000 7f2e4f288700 1 -- 172.21.15.5:0/699871989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e48159770 con 0x7f2e481573f0 2023-03-03T06:25:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.423+0000 7f2e39ffb700 1 -- 172.21.15.5:0/699871989 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+19673 (secure 0 0 0) 0x7f2e3c01f020 con 0x7f2e481573f0 2023-03-03T06:25:40.425 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:40.425 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":56,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:25.917983+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:23.205830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:23.882328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.425+0000 7f2e4f288700 1 -- 172.21.15.5:0/699871989 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2e2c0682f0 msgr2=0x7f2e2c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.425+0000 7f2e4f288700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2e2c0682f0 0x7f2e2c06a7a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2e440011e0 tx=0x7f2e44009040 comp rx=0 tx=0).stop 2023-03-03T06:25:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.425+0000 7f2e4f288700 1 -- 172.21.15.5:0/699871989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e481573f0 msgr2=0x7f2e4815a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.425+0000 7f2e4f288700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e481573f0 0x7f2e4815a2f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00c7f0 tx=0x7f2e3c00cbb0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.425+0000 7f2e4f288700 1 -- 172.21.15.5:0/699871989 shutdown_connections 2023-03-03T06:25:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.425+0000 7f2e4f288700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2e2c0682f0 0x7f2e2c06a7a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.425+0000 7f2e4f288700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e4815d320 0x7f2e4815a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.425+0000 7f2e4f288700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e480b18d0 0x7f2e48144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.425+0000 7f2e4f288700 1 --2- 172.21.15.5:0/699871989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e481573f0 0x7f2e4815a2f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.425+0000 7f2e4f288700 1 -- 172.21.15.5:0/699871989 >> 172.21.15.5:0/699871989 conn(0x7f2e480cc8d0 msgr2=0x7f2e48155460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.425+0000 7f2e4f288700 1 -- 172.21.15.5:0/699871989 shutdown_connections 2023-03-03T06:25:40.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.425+0000 7f2e4f288700 1 -- 172.21.15.5:0/699871989 wait complete. 2023-03-03T06:25:40.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'snap-test-pool', 'create_time': '2023-03-03T06:25:02.648527+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:25:23.205830+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:25:23.882328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T06:25:40.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:25:40.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.568+0000 7fb5b892c700 1 Processor -- start 2023-03-03T06:25:40.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.568+0000 7fb5b892c700 1 -- start start 2023-03-03T06:25:40.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b892c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb5b415cbf0 0x7fb5b4160560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b892c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb5b4160aa0 0x7fb5b406b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b892c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5b406b860 0x7fb5b406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b892c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b40af5d0 con 0x7fb5b415cbf0 2023-03-03T06:25:40.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b892c700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b40ce760 con 0x7fb5b4160aa0 2023-03-03T06:25:40.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b892c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b40ced20 con 0x7fb5b406b860 2023-03-03T06:25:40.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb5b415cbf0 0x7fb5b4160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b259c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb5b415cbf0 0x7fb5b4160560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44918/0 (socket says 172.21.15.5:44918) 2023-03-03T06:25:40.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b259c700 1 -- 172.21.15.5:0/1790486280 learned_addr learned my addr 172.21.15.5:0/1790486280 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:40.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b2d9d700 1 --2- 172.21.15.5:0/1790486280 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5b406b860 0x7fb5b406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b1d9b700 1 --2- 172.21.15.5:0/1790486280 >> v2:172.21.15.191:3300/0 conn(0x7fb5b4160aa0 0x7fb5b406b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b259c700 1 -- 172.21.15.5:0/1790486280 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5b406b860 msgr2=0x7fb5b406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b259c700 1 --2- 172.21.15.5:0/1790486280 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5b406b860 0x7fb5b406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b259c700 1 -- 172.21.15.5:0/1790486280 >> v2:172.21.15.191:3300/0 conn(0x7fb5b4160aa0 msgr2=0x7fb5b406b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b259c700 1 --2- 172.21.15.5:0/1790486280 >> v2:172.21.15.191:3300/0 conn(0x7fb5b4160aa0 0x7fb5b406b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b259c700 1 -- 172.21.15.5:0/1790486280 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4160fb0 con 0x7fb5b415cbf0 2023-03-03T06:25:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.569+0000 7fb5b259c700 1 --2- 172.21.15.5:0/1790486280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b415cbf0 0x7fb5b4160560 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40718c0 tx=0x7fb5a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb04f0fa16fe309 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.570+0000 7fb5b159a700 1 -- 172.21.15.5:0/1790486280 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a400b870 con 0x7fb5b415cbf0 2023-03-03T06:25:40.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.570+0000 7fb5b159a700 1 -- 172.21.15.5:0/1790486280 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a400b9d0 con 0x7fb5b415cbf0 2023-03-03T06:25:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.570+0000 7fb5b159a700 1 -- 172.21.15.5:0/1790486280 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a400bd60 con 0x7fb5b415cbf0 2023-03-03T06:25:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.570+0000 7fb5b892c700 1 -- 172.21.15.5:0/1790486280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b415cbf0 msgr2=0x7fb5b4160560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.570+0000 7fb5b892c700 1 --2- 172.21.15.5:0/1790486280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b415cbf0 0x7fb5b4160560 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40718c0 tx=0x7fb5a4009bd0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.570+0000 7fb5b892c700 1 -- 172.21.15.5:0/1790486280 shutdown_connections 2023-03-03T06:25:40.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.570+0000 7fb5b892c700 1 --2- 172.21.15.5:0/1790486280 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5b406b860 0x7fb5b406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.570+0000 7fb5b892c700 1 --2- 172.21.15.5:0/1790486280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b415cbf0 0x7fb5b4160560 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.570+0000 7fb5b892c700 1 --2- 172.21.15.5:0/1790486280 >> v2:172.21.15.191:3300/0 conn(0x7fb5b4160aa0 0x7fb5b406b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.570+0000 7fb5b892c700 1 -- 172.21.15.5:0/1790486280 >> 172.21.15.5:0/1790486280 conn(0x7fb5b40cfd00 msgr2=0x7fb5b40d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:40.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.570+0000 7fb5b892c700 1 -- 172.21.15.5:0/1790486280 shutdown_connections 2023-03-03T06:25:40.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.570+0000 7fb5b892c700 1 -- 172.21.15.5:0/1790486280 wait complete. 2023-03-03T06:25:40.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.572+0000 7fb5b892c700 1 Processor -- start 2023-03-03T06:25:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.572+0000 7fb5b892c700 1 -- start start 2023-03-03T06:25:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.572+0000 7fb5b892c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5b406b860 0x7fb5b41f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.572+0000 7fb5b892c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b415cbf0 0x7fb5b415d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.572+0000 7fb5b892c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5b4160aa0 0x7fb5b415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.572+0000 7fb5b892c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b415f140 con 0x7fb5b415cbf0 2023-03-03T06:25:40.580 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.572+0000 7fb5b892c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b41f3170 con 0x7fb5b406b860 2023-03-03T06:25:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.572+0000 7fb5b892c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b415e8a0 con 0x7fb5b4160aa0 2023-03-03T06:25:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.572+0000 7fb5b1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b415cbf0 0x7fb5b415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5b1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b415cbf0 0x7fb5b415d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44926/0 (socket says 172.21.15.5:44926) 2023-03-03T06:25:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5b1d9b700 1 -- 172.21.15.5:0/468947114 learned_addr learned my addr 172.21.15.5:0/468947114 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5b259c700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5b406b860 0x7fb5b41f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5b2d9d700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5b4160aa0 0x7fb5b415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.581 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5b1d9b700 1 -- 172.21.15.5:0/468947114 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5b4160aa0 msgr2=0x7fb5b415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5b1d9b700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5b4160aa0 0x7fb5b415aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5b1d9b700 1 -- 172.21.15.5:0/468947114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5b406b860 msgr2=0x7fb5b41f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5b1d9b700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5b406b860 0x7fb5b41f2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5b1d9b700 1 -- 172.21.15.5:0/468947114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a4009550 con 0x7fb5b415cbf0 2023-03-03T06:25:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5b1d9b700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b415cbf0 0x7fb5b415d020 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800d800 tx=0x7fb5a800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5a2ffd700 1 -- 172.21.15.5:0/468947114 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80126b0 con 0x7fb5b415cbf0 2023-03-03T06:25:40.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5a2ffd700 1 -- 172.21.15.5:0/468947114 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a8012810 con 0x7fb5b415cbf0 2023-03-03T06:25:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5b892c700 1 -- 172.21.15.5:0/468947114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b40ce9b0 con 0x7fb5b415cbf0 2023-03-03T06:25:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5a2ffd700 1 -- 172.21.15.5:0/468947114 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8012ba0 con 0x7fb5b415cbf0 2023-03-03T06:25:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.573+0000 7fb5b892c700 1 -- 172.21.15.5:0/468947114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b4161290 con 0x7fb5b415cbf0 2023-03-03T06:25:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.574+0000 7fb5b892c700 1 -- 172.21.15.5:0/468947114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b406d350 con 0x7fb5b415cbf0 2023-03-03T06:25:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.575+0000 7fb5a2ffd700 1 -- 172.21.15.5:0/468947114 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb5a8012d00 con 0x7fb5b415cbf0 2023-03-03T06:25:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.575+0000 7fb5a2ffd700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5940682f0 0x7fb59406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.575+0000 7fb5a2ffd700 1 -- 172.21.15.5:0/468947114 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb5a8086140 con 0x7fb5b415cbf0 2023-03-03T06:25:40.583 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.575+0000 7fb5b259c700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5940682f0 0x7fb59406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.575+0000 7fb5b259c700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5940682f0 0x7fb59406a7a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4000c00 tx=0x7fb5a4008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:40.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.579+0000 7fb5a2ffd700 1 -- 172.21.15.5:0/468947114 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb5a8052700 con 0x7fb5b415cbf0 2023-03-03T06:25:40.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.771+0000 7fb5b892c700 1 -- 172.21.15.5:0/468947114 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb5b404e6e0 con 0x7fb5b415cbf0 2023-03-03T06:25:40.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.771+0000 7fb5a2ffd700 1 -- 172.21.15.5:0/468947114 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb5a8055d20 con 0x7fb5b415cbf0 2023-03-03T06:25:40.774 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:25:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.773+0000 7fb5b892c700 1 -- 172.21.15.5:0/468947114 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5940682f0 msgr2=0x7fb59406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.773+0000 7fb5b892c700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5940682f0 0x7fb59406a7a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4000c00 tx=0x7fb5a4008030 comp rx=0 tx=0).stop 2023-03-03T06:25:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.773+0000 7fb5b892c700 1 -- 172.21.15.5:0/468947114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b415cbf0 msgr2=0x7fb5b415d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.773+0000 7fb5b892c700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b415cbf0 0x7fb5b415d020 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800d800 tx=0x7fb5a800db10 comp rx=0 tx=0).stop 2023-03-03T06:25:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.773+0000 7fb5b892c700 1 -- 172.21.15.5:0/468947114 shutdown_connections 2023-03-03T06:25:40.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.773+0000 7fb5b892c700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5940682f0 0x7fb59406a7a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.773+0000 7fb5b892c700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5b4160aa0 0x7fb5b415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.773+0000 7fb5b892c700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb5b406b860 0x7fb5b41f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.773+0000 7fb5b892c700 1 --2- 172.21.15.5:0/468947114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b415cbf0 0x7fb5b415d020 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.773+0000 7fb5b892c700 1 -- 172.21.15.5:0/468947114 >> 172.21.15.5:0/468947114 conn(0x7fb5b40cfd00 msgr2=0x7fb5b40d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.774+0000 7fb5b892c700 1 -- 172.21.15.5:0/468947114 shutdown_connections 2023-03-03T06:25:40.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.774+0000 7fb5b892c700 1 -- 172.21.15.5:0/468947114 wait complete. 2023-03-03T06:25:40.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:25:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.913+0000 7fdd4907b700 1 Processor -- start 2023-03-03T06:25:40.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.913+0000 7fdd4907b700 1 -- start start 2023-03-03T06:25:40.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.913+0000 7fdd4907b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdd440af450 0x7fdd4406c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.913+0000 7fdd4907b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd440cd990 con 0x7fdd440af080 2023-03-03T06:25:40.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.913+0000 7fdd4907b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4406d540 con 0x7fdd440cb6d0 2023-03-03T06:25:40.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.913+0000 7fdd4907b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd440cdbe0 con 0x7fdd440af450 2023-03-03T06:25:40.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd42d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdd440af080 0x7fdd440cafc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34774/0 (socket says 172.21.15.5:34774) 2023-03-03T06:25:40.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd42d9d700 1 -- 172.21.15.5:0/3337286014 learned_addr learned my addr 172.21.15.5:0/3337286014 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:40.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd4259c700 1 --2- 172.21.15.5:0/3337286014 >> v2:172.21.15.191:3300/0 conn(0x7fdd440af450 0x7fdd4406c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695477759 0 0) 0x7fdd440cd990 con 0x7fdd440af080 2023-03-03T06:25:40.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd2c0035b0 con 0x7fdd440af080 2023-03-03T06:25:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3696531624 0 0) 0x7fdd2c0035b0 con 0x7fdd440af080 2023-03-03T06:25:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 >> v2:172.21.15.191:3300/0 conn(0x7fdd440af450 msgr2=0x7fdd4406c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 --2- 172.21.15.5:0/3337286014 >> v2:172.21.15.191:3300/0 conn(0x7fdd440af450 0x7fdd4406c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 >> v1:172.21.15.191:6789/0 conn(0x7fdd440cb6d0 legacy=0x7fdd4406cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd440cdec0 con 0x7fdd440af080 2023-03-03T06:25:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fdd34001670 con 0x7fdd440af080 2023-03-03T06:25:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 >> v1:172.21.15.5:6789/0 conn(0x7fdd440af080 legacy=0x7fdd440cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 --2- 172.21.15.5:0/3337286014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd2c003a00 0x7fdd2c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 --2- 172.21.15.5:0/3337286014 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd2c004850 0x7fdd2c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 --2- 172.21.15.5:0/3337286014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd2c005200 0x7fdd2c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd440cdbe0 con 0x7fdd2c005200 2023-03-03T06:25:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c00c110 con 0x7fdd2c003a00 2023-03-03T06:25:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c00c2d0 con 0x7fdd2c004850 2023-03-03T06:25:40.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd4359e700 1 --2- 172.21.15.5:0/3337286014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd2c005200 0x7fdd2c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd4259c700 1 --2- 172.21.15.5:0/3337286014 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd2c004850 0x7fdd2c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.914+0000 7fdd42d9d700 1 --2- 172.21.15.5:0/3337286014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd2c003a00 0x7fdd2c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.915+0000 7fdd4359e700 1 -- 172.21.15.5:0/3337286014 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd2c004850 msgr2=0x7fdd2c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.915+0000 7fdd4359e700 1 --2- 172.21.15.5:0/3337286014 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd2c004850 0x7fdd2c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.915+0000 7fdd4359e700 1 -- 172.21.15.5:0/3337286014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd2c003a00 msgr2=0x7fdd2c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:40.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.915+0000 7fdd4359e700 1 --2- 172.21.15.5:0/3337286014 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd2c003a00 0x7fdd2c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.915+0000 7fdd4359e700 1 -- 172.21.15.5:0/3337286014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c0035b0 con 0x7fdd2c005200 2023-03-03T06:25:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.915+0000 7fdd4359e700 1 -- 172.21.15.5:0/3337286014 reap_dead start 2023-03-03T06:25:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.915+0000 7fdd4359e700 1 --2- 172.21.15.5:0/3337286014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd2c005200 0x7fdd2c00ba10 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00c160 tx=0x7fdd2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d21c647f466831 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.915+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c001db0 con 0x7fdd2c005200 2023-03-03T06:25:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.915+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c00cca0 con 0x7fdd2c005200 2023-03-03T06:25:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.915+0000 7fdd41d9b700 1 -- 172.21.15.5:0/3337286014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c003c40 con 0x7fdd2c005200 2023-03-03T06:25:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.915+0000 7fdd4907b700 1 -- 172.21.15.5:0/3337286014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd2c005200 msgr2=0x7fdd2c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.915+0000 7fdd4907b700 1 --2- 172.21.15.5:0/3337286014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd2c005200 0x7fdd2c00ba10 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c00c160 tx=0x7fdd2c005880 comp rx=0 tx=0).stop 2023-03-03T06:25:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.916+0000 7fdd4907b700 1 -- 172.21.15.5:0/3337286014 shutdown_connections 2023-03-03T06:25:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.916+0000 7fdd4907b700 1 --2- 172.21.15.5:0/3337286014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd2c005200 0x7fdd2c00ba10 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.916+0000 7fdd4907b700 1 -- 172.21.15.5:0/3337286014 >> 172.21.15.5:0/3337286014 conn(0x7fdd440cc840 msgr2=0x7fdd440ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.916+0000 7fdd4907b700 1 -- 172.21.15.5:0/3337286014 shutdown_connections 2023-03-03T06:25:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.916+0000 7fdd4907b700 1 -- 172.21.15.5:0/3337286014 wait complete. 2023-03-03T06:25:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.917+0000 7fdd4907b700 1 Processor -- start 2023-03-03T06:25:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.917+0000 7fdd4907b700 1 -- start start 2023-03-03T06:25:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4907b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd2c005200 0x7fdd4415fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4907b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd44156e70 0x7fdd44156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.927 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4907b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd4415be80 0x7fdd4415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4907b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4415c830 con 0x7fdd4415be80 2023-03-03T06:25:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4907b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd440b2bf0 con 0x7fdd44156e70 2023-03-03T06:25:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4907b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd440b2e40 con 0x7fdd2c005200 2023-03-03T06:25:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4359e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd4415be80 0x7fdd4415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4359e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd4415be80 0x7fdd4415c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44948/0 (socket says 172.21.15.5:44948) 2023-03-03T06:25:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4359e700 1 -- 172.21.15.5:0/1714087745 learned_addr learned my addr 172.21.15.5:0/1714087745 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4359e700 1 -- 172.21.15.5:0/1714087745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd2c005200 msgr2=0x7fdd4415fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd42d9d700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd2c005200 0x7fdd4415fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4259c700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd44156e70 0x7fdd44156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4359e700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd2c005200 0x7fdd4415fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4359e700 1 -- 172.21.15.5:0/1714087745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd44156e70 msgr2=0x7fdd44156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4359e700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd44156e70 0x7fdd44156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4359e700 1 -- 172.21.15.5:0/1714087745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd440cafc0 con 0x7fdd4415be80 2023-03-03T06:25:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.918+0000 7fdd4359e700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd4415be80 0x7fdd4415c2f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fdd44068550 tx=0x7fdd3c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.919+0000 7fdd2b7fe700 1 -- 172.21.15.5:0/1714087745 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c020070 con 0x7fdd4415be80 2023-03-03T06:25:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.919+0000 7fdd2b7fe700 1 -- 172.21.15.5:0/1714087745 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c003c40 con 0x7fdd4415be80 2023-03-03T06:25:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.919+0000 7fdd4907b700 1 -- 172.21.15.5:0/1714087745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd440ce1a0 con 0x7fdd4415be80 2023-03-03T06:25:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.919+0000 7fdd2b7fe700 1 -- 172.21.15.5:0/1714087745 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c005020 con 0x7fdd4415be80 2023-03-03T06:25:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.919+0000 7fdd4907b700 1 -- 172.21.15.5:0/1714087745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd440cb150 con 0x7fdd4415be80 2023-03-03T06:25:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.920+0000 7fdd4907b700 1 -- 172.21.15.5:0/1714087745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd440b5b50 con 0x7fdd4415be80 2023-03-03T06:25:40.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.920+0000 7fdd2b7fe700 1 -- 172.21.15.5:0/1714087745 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdd3c019040 con 0x7fdd4415be80 2023-03-03T06:25:40.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.921+0000 7fdd2b7fe700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdd300682f0 0x7fdd3006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:40.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.921+0000 7fdd42d9d700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdd300682f0 0x7fdd3006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:40.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.921+0000 7fdd2b7fe700 1 -- 172.21.15.5:0/1714087745 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fdd3c0862d0 con 0x7fdd4415be80 2023-03-03T06:25:40.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.921+0000 7fdd42d9d700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdd300682f0 0x7fdd3006a7a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdd34000c00 tx=0x7fdd34009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:40.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:40.925+0000 7fdd2b7fe700 1 -- 172.21.15.5:0/1714087745 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdd3c052830 con 0x7fdd4415be80 2023-03-03T06:25:41.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.119+0000 7fdd4907b700 1 -- 172.21.15.5:0/1714087745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd4406daf0 con 0x7fdd4415be80 2023-03-03T06:25:41.122 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.120+0000 7fdd2b7fe700 1 -- 172.21.15.5:0/1714087745 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd3c055e50 con 0x7fdd4415be80 2023-03-03T06:25:41.123 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:25:41.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.122+0000 7fdd4907b700 1 -- 172.21.15.5:0/1714087745 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdd300682f0 msgr2=0x7fdd3006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.122+0000 7fdd4907b700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdd300682f0 0x7fdd3006a7a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdd34000c00 tx=0x7fdd34009040 comp rx=0 tx=0).stop 2023-03-03T06:25:41.125 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.122+0000 7fdd4907b700 1 -- 172.21.15.5:0/1714087745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd4415be80 msgr2=0x7fdd4415c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.122+0000 7fdd4907b700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd4415be80 0x7fdd4415c2f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fdd44068550 tx=0x7fdd3c0014a0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.122+0000 7fdd4907b700 1 -- 172.21.15.5:0/1714087745 shutdown_connections 2023-03-03T06:25:41.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.122+0000 7fdd4907b700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd4415be80 0x7fdd4415c2f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.122+0000 7fdd4907b700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdd300682f0 0x7fdd3006a7a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.122+0000 7fdd4907b700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd2c005200 0x7fdd4415fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.122+0000 7fdd4907b700 1 --2- 172.21.15.5:0/1714087745 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd44156e70 0x7fdd44156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.122+0000 7fdd4907b700 1 -- 172.21.15.5:0/1714087745 >> 172.21.15.5:0/1714087745 conn(0x7fdd440cc840 msgr2=0x7fdd4415a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:41.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.122+0000 7fdd4907b700 1 -- 172.21.15.5:0/1714087745 shutdown_connections 2023-03-03T06:25:41.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.122+0000 7fdd4907b700 1 -- 172.21.15.5:0/1714087745 wait complete. 2023-03-03T06:25:41.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-03-03T06:25:41.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.262+0000 7f724d224700 1 Processor -- start 2023-03-03T06:25:41.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.262+0000 7f724d224700 1 -- start start 2023-03-03T06:25:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.263+0000 7f724d224700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7248158d90 0x7f72480ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.263+0000 7f724d224700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f724815d1f0 0x7f724806d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.263+0000 7f724d224700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724806e040 con 0x7f724806dbe0 2023-03-03T06:25:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.263+0000 7f724d224700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7248159160 con 0x7f724815d1f0 2023-03-03T06:25:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.263+0000 7f724d224700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72480ca680 con 0x7f7248158d90 2023-03-03T06:25:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.263+0000 7f724659c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f724815d1f0 0x7f724806d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.263+0000 7f724759e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f724806dbe0 0x7f7248071590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34798/0 (socket says 172.21.15.5:34798) 2023-03-03T06:25:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.263+0000 7f724759e700 1 -- 172.21.15.5:0/3378118862 learned_addr learned my addr 172.21.15.5:0/3378118862 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.264+0000 7f724659c700 1 -- 172.21.15.5:0/3378118862 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7248158d90 msgr2=0x7f72480ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.264+0000 7f7246d9d700 1 --2- 172.21.15.5:0/3378118862 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7248158d90 0x7f72480ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.264+0000 7f7245d9b700 1 -- 172.21.15.5:0/3378118862 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960643739 0 0) 0x7f724806e040 con 0x7f724806dbe0 2023-03-03T06:25:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.264+0000 7f724659c700 1 --2- 172.21.15.5:0/3378118862 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7248158d90 0x7f72480ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.264+0000 7f724659c700 1 -- 172.21.15.5:0/3378118862 >> v1:172.21.15.5:6789/0 conn(0x7f724806dbe0 legacy=0x7f7248071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.264+0000 7f724659c700 1 -- 172.21.15.5:0/3378118862 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72480ca960 con 0x7f724815d1f0 2023-03-03T06:25:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.264+0000 7f7246d9d700 1 --2- 172.21.15.5:0/3378118862 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7248158d90 0x7f72480ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.264+0000 7f724659c700 1 --2- 172.21.15.5:0/3378118862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724815d1f0 0x7f724806d6a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7238009840 tx=0x7f7238009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354f87551b3e578d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.264+0000 7f7245d9b700 1 -- 172.21.15.5:0/3378118862 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723800c900 con 0x7f724815d1f0 2023-03-03T06:25:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.264+0000 7f7245d9b700 1 -- 172.21.15.5:0/3378118862 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723800ca60 con 0x7f724815d1f0 2023-03-03T06:25:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.264+0000 7f7245d9b700 1 -- 172.21.15.5:0/3378118862 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723800cdf0 con 0x7f724815d1f0 2023-03-03T06:25:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.264+0000 7f724d224700 1 -- 172.21.15.5:0/3378118862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724815d1f0 msgr2=0x7f724806d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.264+0000 7f724d224700 1 --2- 172.21.15.5:0/3378118862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724815d1f0 0x7f724806d6a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7238009840 tx=0x7f7238009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.265+0000 7f724d224700 1 -- 172.21.15.5:0/3378118862 shutdown_connections 2023-03-03T06:25:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.265+0000 7f724d224700 1 --2- 172.21.15.5:0/3378118862 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7248158d90 0x7f72480ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.265+0000 7f724d224700 1 --2- 172.21.15.5:0/3378118862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724815d1f0 0x7f724806d6a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.265+0000 7f724d224700 1 -- 172.21.15.5:0/3378118862 >> 172.21.15.5:0/3378118862 conn(0x7f72480b1c60 msgr2=0x7f72480cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.265+0000 7f724d224700 1 -- 172.21.15.5:0/3378118862 shutdown_connections 2023-03-03T06:25:41.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.265+0000 7f724d224700 1 -- 172.21.15.5:0/3378118862 wait complete. 2023-03-03T06:25:41.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.266+0000 7f724d224700 1 Processor -- start 2023-03-03T06:25:41.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.266+0000 7f724d224700 1 -- start start 2023-03-03T06:25:41.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724d224700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f724806dbe0 0x7f724814a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724d224700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248158d90 0x7f7248071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724d224700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724815d1f0 0x7f72480719d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724d224700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72480c66b0 con 0x7f724815d1f0 2023-03-03T06:25:41.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724d224700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72480c6990 con 0x7f7248158d90 2023-03-03T06:25:41.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724d224700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72480c6c70 con 0x7f724806dbe0 2023-03-03T06:25:41.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724815d1f0 0x7f72480719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.274 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724759e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724815d1f0 0x7f72480719d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44962/0 (socket says 172.21.15.5:44962) 2023-03-03T06:25:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724759e700 1 -- 172.21.15.5:0/2340298509 learned_addr learned my addr 172.21.15.5:0/2340298509 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724659c700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248158d90 0x7f7248071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f7246d9d700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f724806dbe0 0x7f724814a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724759e700 1 -- 172.21.15.5:0/2340298509 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f724806dbe0 msgr2=0x7f724814a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724759e700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f724806dbe0 0x7f724814a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724759e700 1 -- 172.21.15.5:0/2340298509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248158d90 msgr2=0x7f7248071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724759e700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248158d90 0x7f7248071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724759e700 1 -- 172.21.15.5:0/2340298509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72380094a0 con 0x7f724815d1f0 2023-03-03T06:25:41.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.267+0000 7f724659c700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248158d90 0x7f7248071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:41.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.268+0000 7f724759e700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724815d1f0 0x7f72480719d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7240002230 tx=0x7f724000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:41.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.268+0000 7f723f7fe700 1 -- 172.21.15.5:0/2340298509 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724000ac20 con 0x7f724815d1f0 2023-03-03T06:25:41.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.268+0000 7f723f7fe700 1 -- 172.21.15.5:0/2340298509 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724000ada0 con 0x7f724815d1f0 2023-03-03T06:25:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.268+0000 7f724d224700 1 -- 172.21.15.5:0/2340298509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72480caf20 con 0x7f724815d1f0 2023-03-03T06:25:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.268+0000 7f723f7fe700 1 -- 172.21.15.5:0/2340298509 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240007310 con 0x7f724815d1f0 2023-03-03T06:25:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.268+0000 7f724d224700 1 -- 172.21.15.5:0/2340298509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72480cac40 con 0x7f724815d1f0 2023-03-03T06:25:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.269+0000 7f724d224700 1 -- 172.21.15.5:0/2340298509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72480cb200 con 0x7f724815d1f0 2023-03-03T06:25:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.269+0000 7f723f7fe700 1 -- 172.21.15.5:0/2340298509 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f724001a030 con 0x7f724815d1f0 2023-03-03T06:25:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.270+0000 7f723f7fe700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f72280682f0 0x7f722806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.270+0000 7f7246d9d700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f72280682f0 0x7f722806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.270+0000 7f723f7fe700 1 -- 172.21.15.5:0/2340298509 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7240085cf0 con 0x7f724815d1f0 2023-03-03T06:25:41.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.270+0000 7f7246d9d700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f72280682f0 0x7f722806a7a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7230006fd0 tx=0x7f7230008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:41.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.274+0000 7f723f7fe700 1 -- 172.21.15.5:0/2340298509 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f72400522b0 con 0x7f724815d1f0 2023-03-03T06:25:41.469 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.467+0000 7f724d224700 1 -- 172.21.15.5:0/2340298509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f724804e6e0 con 0x7f724815d1f0 2023-03-03T06:25:41.470 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.467+0000 7f723f7fe700 1 -- 172.21.15.5:0/2340298509 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v56) v1 ==== 103+0+11 (secure 0 0 0) 0x7f72400180a0 con 0x7f724815d1f0 2023-03-03T06:25:41.470 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:25:41.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.469+0000 7f724d224700 1 -- 172.21.15.5:0/2340298509 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f72280682f0 msgr2=0x7f722806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.469+0000 7f724d224700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f72280682f0 0x7f722806a7a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7230006fd0 tx=0x7f7230008040 comp rx=0 tx=0).stop 2023-03-03T06:25:41.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.469+0000 7f724d224700 1 -- 172.21.15.5:0/2340298509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724815d1f0 msgr2=0x7f72480719d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.469+0000 7f724d224700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724815d1f0 0x7f72480719d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7240002230 tx=0x7f724000a060 comp rx=0 tx=0).stop 2023-03-03T06:25:41.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.469+0000 7f724d224700 1 -- 172.21.15.5:0/2340298509 shutdown_connections 2023-03-03T06:25:41.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.469+0000 7f724d224700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f724815d1f0 0x7f72480719d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.469+0000 7f724d224700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f72280682f0 0x7f722806a7a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.469+0000 7f724d224700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f724806dbe0 0x7f724814a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.469+0000 7f724d224700 1 --2- 172.21.15.5:0/2340298509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7248158d90 0x7f7248071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.469+0000 7f724d224700 1 -- 172.21.15.5:0/2340298509 >> 172.21.15.5:0/2340298509 conn(0x7f72480b1c60 msgr2=0x7f724806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:41.473 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.470+0000 7f724d224700 1 -- 172.21.15.5:0/2340298509 shutdown_connections 2023-03-03T06:25:41.474 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.470+0000 7f724d224700 1 -- 172.21.15.5:0/2340298509 wait complete. 2023-03-03T06:25:41.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:25:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.611+0000 7fb49f4a2700 1 Processor -- start 2023-03-03T06:25:41.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.611+0000 7fb49f4a2700 1 -- start start 2023-03-03T06:25:41.622 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb49f4a2700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb4980cf7c0 0x7fb4980cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb49f4a2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4980cc370 con 0x7fb4980b18d0 2023-03-03T06:25:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb49f4a2700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4980cb760 con 0x7fb4980cf3f0 2023-03-03T06:25:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb49f4a2700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4980cba40 con 0x7fb4980cf7c0 2023-03-03T06:25:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb49da3f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb4980b18d0 0x7fb4980cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34812/0 (socket says 172.21.15.5:34812) 2023-03-03T06:25:41.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb49da3f700 1 -- 172.21.15.5:0/910971541 learned_addr learned my addr 172.21.15.5:0/910971541 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb49ca3d700 1 --2- 172.21.15.5:0/910971541 >> v2:172.21.15.191:3300/0 conn(0x7fb4980cf7c0 0x7fb4980cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863878091 0 0) 0x7fb4980cc370 con 0x7fb4980b18d0 2023-03-03T06:25:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4840035b0 con 0x7fb4980b18d0 2023-03-03T06:25:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3632715986 0 0) 0x7fb4840035b0 con 0x7fb4980b18d0 2023-03-03T06:25:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 >> v2:172.21.15.191:3300/0 conn(0x7fb4980cf7c0 msgr2=0x7fb4980cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:41.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb48ffff700 1 --2- 172.21.15.5:0/910971541 >> v2:172.21.15.191:3300/0 conn(0x7fb4980cf7c0 0x7fb4980cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 >> v1:172.21.15.191:6789/0 conn(0x7fb4980cf3f0 legacy=0x7fb49815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980cbd20 con 0x7fb4980b18d0 2023-03-03T06:25:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.612+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fb4900019f0 con 0x7fb4980b18d0 2023-03-03T06:25:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 >> v1:172.21.15.5:6789/0 conn(0x7fb4980b18d0 legacy=0x7fb4980cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb48ffff700 1 --2- 172.21.15.5:0/910971541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb484003a00 0x7fb484003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb48ffff700 1 --2- 172.21.15.5:0/910971541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb484004850 0x7fb484004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb48ffff700 1 --2- 172.21.15.5:0/910971541 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb484005200 0x7fb48400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980cba40 con 0x7fb484004850 2023-03-03T06:25:41.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48400e290 con 0x7fb484003a00 2023-03-03T06:25:41.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48400e450 con 0x7fb484005200 2023-03-03T06:25:41.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb49ca3d700 1 --2- 172.21.15.5:0/910971541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb484004850 0x7fb484004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb49d23e700 1 --2- 172.21.15.5:0/910971541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb484003a00 0x7fb484003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb49da3f700 1 --2- 172.21.15.5:0/910971541 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb484005200 0x7fb48400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb49ca3d700 1 -- 172.21.15.5:0/910971541 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb484005200 msgr2=0x7fb48400dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb49ca3d700 1 --2- 172.21.15.5:0/910971541 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb484005200 0x7fb48400dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb49ca3d700 1 -- 172.21.15.5:0/910971541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb484003a00 msgr2=0x7fb484003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb49ca3d700 1 --2- 172.21.15.5:0/910971541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb484003a00 0x7fb484003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb49ca3d700 1 -- 172.21.15.5:0/910971541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4840035b0 con 0x7fb484004850 2023-03-03T06:25:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb49da3f700 1 -- 172.21.15.5:0/910971541 reap_dead start 2023-03-03T06:25:41.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb49ca3d700 1 --2- 172.21.15.5:0/910971541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb484004850 0x7fb484004cc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb494009b60 tx=0x7fb484005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f73498a15f68a0b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:41.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49400e6c0 con 0x7fb484004850 2023-03-03T06:25:41.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49400e820 con 0x7fb484004850 2023-03-03T06:25:41.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.613+0000 7fb48ffff700 1 -- 172.21.15.5:0/910971541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49400ebb0 con 0x7fb484004850 2023-03-03T06:25:41.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.614+0000 7fb49f4a2700 1 -- 172.21.15.5:0/910971541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb484004850 msgr2=0x7fb484004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.614+0000 7fb49f4a2700 1 --2- 172.21.15.5:0/910971541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb484004850 0x7fb484004cc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb494009b60 tx=0x7fb484005880 comp rx=0 tx=0).stop 2023-03-03T06:25:41.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.614+0000 7fb49f4a2700 1 -- 172.21.15.5:0/910971541 shutdown_connections 2023-03-03T06:25:41.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.614+0000 7fb49f4a2700 1 --2- 172.21.15.5:0/910971541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb484004850 0x7fb484004cc0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.614+0000 7fb49f4a2700 1 -- 172.21.15.5:0/910971541 >> 172.21.15.5:0/910971541 conn(0x7fb4980cc8d0 msgr2=0x7fb4980cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.614+0000 7fb49f4a2700 1 -- 172.21.15.5:0/910971541 shutdown_connections 2023-03-03T06:25:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.614+0000 7fb49f4a2700 1 -- 172.21.15.5:0/910971541 wait complete. 2023-03-03T06:25:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.615+0000 7fb49f4a2700 1 Processor -- start 2023-03-03T06:25:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.615+0000 7fb49f4a2700 1 -- start start 2023-03-03T06:25:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49f4a2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb484004850 0x7fb4981f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49f4a2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4980b0ee0 0x7fb4980c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49f4a2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4981f63f0 0x7fb498155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49f4a2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4981f5f60 con 0x7fb4981f63f0 2023-03-03T06:25:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49f4a2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980c8da0 con 0x7fb484004850 2023-03-03T06:25:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49f4a2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980c9ec0 con 0x7fb4980b0ee0 2023-03-03T06:25:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49da3f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4981f63f0 0x7fb498155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49da3f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4981f63f0 0x7fb498155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44982/0 (socket says 172.21.15.5:44982) 2023-03-03T06:25:41.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49da3f700 1 -- 172.21.15.5:0/1986297249 learned_addr learned my addr 172.21.15.5:0/1986297249 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49da3f700 1 -- 172.21.15.5:0/1986297249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4980b0ee0 msgr2=0x7fb4980c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49da3f700 1 --2- 172.21.15.5:0/1986297249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4980b0ee0 0x7fb4980c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49da3f700 1 -- 172.21.15.5:0/1986297249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb484004850 msgr2=0x7fb4981f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49d23e700 1 --2- 172.21.15.5:0/1986297249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb484004850 0x7fb4981f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49da3f700 1 --2- 172.21.15.5:0/1986297249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb484004850 0x7fb4981f5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49da3f700 1 -- 172.21.15.5:0/1986297249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980cd450 con 0x7fb4981f63f0 2023-03-03T06:25:41.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.616+0000 7fb49da3f700 1 --2- 172.21.15.5:0/1986297249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4981f63f0 0x7fb498155d20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb498070920 tx=0x7fb490007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.617+0000 7fb48dffb700 1 -- 172.21.15.5:0/1986297249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000ec60 con 0x7fb4981f63f0 2023-03-03T06:25:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.617+0000 7fb48dffb700 1 -- 172.21.15.5:0/1986297249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49000edc0 con 0x7fb4981f63f0 2023-03-03T06:25:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.617+0000 7fb49f4a2700 1 -- 172.21.15.5:0/1986297249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4980cc000 con 0x7fb4981f63f0 2023-03-03T06:25:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.617+0000 7fb48dffb700 1 -- 172.21.15.5:0/1986297249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490013660 con 0x7fb4981f63f0 2023-03-03T06:25:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.617+0000 7fb49f4a2700 1 -- 172.21.15.5:0/1986297249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4980cd5e0 con 0x7fb4981f63f0 2023-03-03T06:25:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.618+0000 7fb49f4a2700 1 -- 172.21.15.5:0/1986297249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49804e6e0 con 0x7fb4981f63f0 2023-03-03T06:25:41.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.618+0000 7fb48dffb700 1 -- 172.21.15.5:0/1986297249 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb4900137c0 con 0x7fb4981f63f0 2023-03-03T06:25:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.619+0000 7fb48dffb700 1 --2- 172.21.15.5:0/1986297249 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb47c068320 0x7fb47c06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.619+0000 7fb49d23e700 1 --2- 172.21.15.5:0/1986297249 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb47c068320 0x7fb47c06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.619+0000 7fb48dffb700 1 -- 172.21.15.5:0/1986297249 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb490086730 con 0x7fb4981f63f0 2023-03-03T06:25:41.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.619+0000 7fb49d23e700 1 --2- 172.21.15.5:0/1986297249 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb47c068320 0x7fb47c06a7d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb488007fd0 tx=0x7fb488009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:41.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.623+0000 7fb48dffb700 1 -- 172.21.15.5:0/1986297249 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb490052c00 con 0x7fb4981f63f0 2023-03-03T06:25:41.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.816+0000 7fb49f4a2700 1 -- 172.21.15.5:0/1986297249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4980b59c0 con 0x7fb4981f63f0 2023-03-03T06:25:41.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.817+0000 7fb48dffb700 1 -- 172.21.15.5:0/1986297249 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb490056220 con 0x7fb4981f63f0 2023-03-03T06:25:41.820 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:25:41.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.819+0000 7fb49f4a2700 1 -- 172.21.15.5:0/1986297249 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb47c068320 msgr2=0x7fb47c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.819+0000 7fb49f4a2700 1 --2- 172.21.15.5:0/1986297249 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb47c068320 0x7fb47c06a7d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb488007fd0 tx=0x7fb488009040 comp rx=0 tx=0).stop 2023-03-03T06:25:41.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.819+0000 7fb49f4a2700 1 -- 172.21.15.5:0/1986297249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4981f63f0 msgr2=0x7fb498155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.822 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.819+0000 7fb49f4a2700 1 --2- 172.21.15.5:0/1986297249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4981f63f0 0x7fb498155d20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb498070920 tx=0x7fb490007c90 comp rx=0 tx=0).stop 2023-03-03T06:25:41.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.819+0000 7fb49f4a2700 1 -- 172.21.15.5:0/1986297249 shutdown_connections 2023-03-03T06:25:41.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.819+0000 7fb49f4a2700 1 --2- 172.21.15.5:0/1986297249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4981f63f0 0x7fb498155d20 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.819+0000 7fb49f4a2700 1 --2- 172.21.15.5:0/1986297249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb484004850 0x7fb4981f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.819+0000 7fb49f4a2700 1 --2- 172.21.15.5:0/1986297249 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb47c068320 0x7fb47c06a7d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.819+0000 7fb49f4a2700 1 --2- 172.21.15.5:0/1986297249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4980b0ee0 0x7fb4980c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.819+0000 7fb49f4a2700 1 -- 172.21.15.5:0/1986297249 >> 172.21.15.5:0/1986297249 conn(0x7fb4980cc8d0 msgr2=0x7fb4980b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:41.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.819+0000 7fb49f4a2700 1 -- 172.21.15.5:0/1986297249 shutdown_connections 2023-03-03T06:25:41.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.819+0000 7fb49f4a2700 1 -- 172.21.15.5:0/1986297249 wait complete. 2023-03-03T06:25:41.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:25:41.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.958+0000 7ffafc8fe700 1 Processor -- start 2023-03-03T06:25:41.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.958+0000 7ffafc8fe700 1 -- start start 2023-03-03T06:25:41.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.959+0000 7ffafc8fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ffaf815a7b0 0x7ffaf815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.959+0000 7ffafc8fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffaf806b700 0x7ffaf806bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.959+0000 7ffafc8fe700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf80cf380 con 0x7ffaf80cde30 2023-03-03T06:25:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.959+0000 7ffafc8fe700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf806c080 con 0x7ffaf815a7b0 2023-03-03T06:25:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.959+0000 7ffafc8fe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80cf5c0 con 0x7ffaf806b700 2023-03-03T06:25:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf6d9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffaf806b700 0x7ffaf806bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf659c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ffaf815a7b0 0x7ffaf815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf6d9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffaf806b700 0x7ffaf806bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:43068/0 (socket says 172.21.15.5:43068) 2023-03-03T06:25:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf6d9d700 1 -- 172.21.15.5:0/3811846910 learned_addr learned my addr 172.21.15.5:0/3811846910 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:41.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf5d9b700 1 --1- 172.21.15.5:0/3811846910 >> v1:172.21.15.191:6789/0 conn(0x7ffaf80cde30 0x7ffaf80cec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:49356/0 (socket says 172.21.15.5:49356) 2023-03-03T06:25:41.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf659c700 1 -- 172.21.15.5:0/3811846910 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffaf806b700 msgr2=0x7ffaf806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:41.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf659c700 1 --2- 172.21.15.5:0/3811846910 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffaf806b700 0x7ffaf806bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf659c700 1 -- 172.21.15.5:0/3811846910 >> v1:172.21.15.191:6789/0 conn(0x7ffaf80cde30 legacy=0x7ffaf80cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf559a700 1 -- 172.21.15.5:0/3811846910 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023399823 0 0) 0x7ffae8001110 con 0x7ffaf80cde30 2023-03-03T06:25:41.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf659c700 1 -- 172.21.15.5:0/3811846910 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf80cf8a0 con 0x7ffaf815a7b0 2023-03-03T06:25:41.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf6d9d700 1 --2- 172.21.15.5:0/3811846910 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffaf806b700 0x7ffaf806bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:41.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf659c700 1 --2- 172.21.15.5:0/3811846910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffaf815a7b0 0x7ffaf815ab80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009840 tx=0x7ffaec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0a42ada1164b365 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:41.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf559a700 1 -- 172.21.15.5:0/3811846910 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec011830 con 0x7ffaf815a7b0 2023-03-03T06:25:41.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf559a700 1 -- 172.21.15.5:0/3811846910 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec011990 con 0x7ffaf815a7b0 2023-03-03T06:25:41.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.960+0000 7ffaf559a700 1 -- 172.21.15.5:0/3811846910 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec011d20 con 0x7ffaf815a7b0 2023-03-03T06:25:41.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.961+0000 7ffafc8fe700 1 -- 172.21.15.5:0/3811846910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffaf815a7b0 msgr2=0x7ffaf815ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.961+0000 7ffafc8fe700 1 --2- 172.21.15.5:0/3811846910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffaf815a7b0 0x7ffaf815ab80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009840 tx=0x7ffaec009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.961+0000 7ffafc8fe700 1 -- 172.21.15.5:0/3811846910 shutdown_connections 2023-03-03T06:25:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.961+0000 7ffafc8fe700 1 --2- 172.21.15.5:0/3811846910 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffaf806b700 0x7ffaf806bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.961+0000 7ffafc8fe700 1 --2- 172.21.15.5:0/3811846910 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffaf815a7b0 0x7ffaf815ab80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.961+0000 7ffafc8fe700 1 -- 172.21.15.5:0/3811846910 >> 172.21.15.5:0/3811846910 conn(0x7ffaf80cc8d0 msgr2=0x7ffaf80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.961+0000 7ffafc8fe700 1 -- 172.21.15.5:0/3811846910 shutdown_connections 2023-03-03T06:25:41.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.961+0000 7ffafc8fe700 1 -- 172.21.15.5:0/3811846910 wait complete. 2023-03-03T06:25:41.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.962+0000 7ffafc8fe700 1 Processor -- start 2023-03-03T06:25:41.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.962+0000 7ffafc8fe700 1 -- start start 2023-03-03T06:25:41.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.963+0000 7ffafc8fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf806b700 0x7ffaf80c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.963+0000 7ffafc8fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffaf80cde30 0x7ffaf81527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.963+0000 7ffafc8fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffaf815a7b0 0x7ffaf80c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.963+0000 7ffafc8fe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80c7460 con 0x7ffaf806b700 2023-03-03T06:25:41.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.963+0000 7ffafc8fe700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80c7700 con 0x7ffaf815a7b0 2023-03-03T06:25:41.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.963+0000 7ffafc8fe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80c79e0 con 0x7ffaf80cde30 2023-03-03T06:25:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.963+0000 7ffaf659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf806b700 0x7ffaf80c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.963+0000 7ffaf659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf806b700 0x7ffaf80c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44992/0 (socket says 172.21.15.5:44992) 2023-03-03T06:25:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.963+0000 7ffaf659c700 1 -- 172.21.15.5:0/1119758023 learned_addr learned my addr 172.21.15.5:0/1119758023 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.963+0000 7ffaf5d9b700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffaf80cde30 0x7ffaf81527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.963+0000 7ffaf6d9d700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffaf815a7b0 0x7ffaf80c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.964+0000 7ffaf659c700 1 -- 172.21.15.5:0/1119758023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffaf80cde30 msgr2=0x7ffaf81527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.964+0000 7ffaf659c700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffaf80cde30 0x7ffaf81527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.964+0000 7ffaf659c700 1 -- 172.21.15.5:0/1119758023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffaf815a7b0 msgr2=0x7ffaf80c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.964+0000 7ffaf659c700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffaf815a7b0 0x7ffaf80c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.964+0000 7ffaf659c700 1 -- 172.21.15.5:0/1119758023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf0009b30 con 0x7ffaf806b700 2023-03-03T06:25:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.964+0000 7ffaf6d9d700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffaf815a7b0 0x7ffaf80c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:41.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.964+0000 7ffaf659c700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf806b700 0x7ffaf80c6f20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009fd0 tx=0x7ffaec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.964+0000 7ffae6ffd700 1 -- 172.21.15.5:0/1119758023 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec0045d0 con 0x7ffaf806b700 2023-03-03T06:25:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.964+0000 7ffae6ffd700 1 -- 172.21.15.5:0/1119758023 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec01e070 con 0x7ffaf806b700 2023-03-03T06:25:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.964+0000 7ffafc8fe700 1 -- 172.21.15.5:0/1119758023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec0094a0 con 0x7ffaf806b700 2023-03-03T06:25:41.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.964+0000 7ffae6ffd700 1 -- 172.21.15.5:0/1119758023 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec0038e0 con 0x7ffaf806b700 2023-03-03T06:25:41.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.964+0000 7ffafc8fe700 1 -- 172.21.15.5:0/1119758023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf80b2d40 con 0x7ffaf806b700 2023-03-03T06:25:41.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.965+0000 7ffafc8fe700 1 -- 172.21.15.5:0/1119758023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf80cfb80 con 0x7ffaf806b700 2023-03-03T06:25:41.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.965+0000 7ffae6ffd700 1 -- 172.21.15.5:0/1119758023 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ffaec00f050 con 0x7ffaf806b700 2023-03-03T06:25:41.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.966+0000 7ffae6ffd700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffad80682f0 0x7ffad806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:41.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.966+0000 7ffae6ffd700 1 -- 172.21.15.5:0/1119758023 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ffaec086fa0 con 0x7ffaf806b700 2023-03-03T06:25:41.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.966+0000 7ffaf5d9b700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffad80682f0 0x7ffad806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:41.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.966+0000 7ffaf5d9b700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffad80682f0 0x7ffad806a7a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80c6700 tx=0x7ffae8007c20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:41.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:41.970+0000 7ffae6ffd700 1 -- 172.21.15.5:0/1119758023 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ffaec0534e0 con 0x7ffaf806b700 2023-03-03T06:25:42.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.163+0000 7ffafc8fe700 1 -- 172.21.15.5:0/1119758023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffaf80b3020 con 0x7ffaf806b700 2023-03-03T06:25:42.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.164+0000 7ffae6ffd700 1 -- 172.21.15.5:0/1119758023 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffaec0150a0 con 0x7ffaf806b700 2023-03-03T06:25:42.166 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:25:42.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.166+0000 7ffafc8fe700 1 -- 172.21.15.5:0/1119758023 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffad80682f0 msgr2=0x7ffad806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.166+0000 7ffafc8fe700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffad80682f0 0x7ffad806a7a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80c6700 tx=0x7ffae8007c20 comp rx=0 tx=0).stop 2023-03-03T06:25:42.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.166+0000 7ffafc8fe700 1 -- 172.21.15.5:0/1119758023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf806b700 msgr2=0x7ffaf80c6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.166+0000 7ffafc8fe700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf806b700 0x7ffaf80c6f20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009fd0 tx=0x7ffaec004750 comp rx=0 tx=0).stop 2023-03-03T06:25:42.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.166+0000 7ffafc8fe700 1 -- 172.21.15.5:0/1119758023 shutdown_connections 2023-03-03T06:25:42.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.166+0000 7ffafc8fe700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffaf815a7b0 0x7ffaf80c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.166+0000 7ffafc8fe700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaf806b700 0x7ffaf80c6f20 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.166+0000 7ffafc8fe700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ffad80682f0 0x7ffad806a7a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.166+0000 7ffafc8fe700 1 --2- 172.21.15.5:0/1119758023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ffaf80cde30 0x7ffaf81527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.166+0000 7ffafc8fe700 1 -- 172.21.15.5:0/1119758023 >> 172.21.15.5:0/1119758023 conn(0x7ffaf80cc8d0 msgr2=0x7ffaf80b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.166+0000 7ffafc8fe700 1 -- 172.21.15.5:0/1119758023 shutdown_connections 2023-03-03T06:25:42.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.166+0000 7ffafc8fe700 1 -- 172.21.15.5:0/1119758023 wait complete. 2023-03-03T06:25:42.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.303+0000 7f4671e06700 1 Processor -- start 2023-03-03T06:25:42.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.304+0000 7f4671e06700 1 -- start start 2023-03-03T06:25:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.304+0000 7f4671e06700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c0af080 0x7f466c0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.304+0000 7f4671e06700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c06b590 con 0x7f466c0b1f80 2023-03-03T06:25:42.310 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.304+0000 7f4671e06700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c06b870 con 0x7f466c0af450 2023-03-03T06:25:42.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.304+0000 7f4671e06700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c06bb50 con 0x7f466c0af080 2023-03-03T06:25:42.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.304+0000 7f466bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f466c0b1f80 0x7f466c0cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34846/0 (socket says 172.21.15.5:34846) 2023-03-03T06:25:42.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.305+0000 7f466bfff700 1 -- 172.21.15.5:0/1930159719 learned_addr learned my addr 172.21.15.5:0/1930159719 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:42.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.305+0000 7f466b7fe700 1 --2- 172.21.15.5:0/1930159719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c0af080 0x7f466c0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:42.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.305+0000 7f466a7fc700 1 -- 172.21.15.5:0/1930159719 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039336331 0 0) 0x7f466c06b590 con 0x7f466c0b1f80 2023-03-03T06:25:42.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.305+0000 7f466a7fc700 1 -- 172.21.15.5:0/1930159719 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46540035b0 con 0x7f466c0b1f80 2023-03-03T06:25:42.311 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.305+0000 7f466a7fc700 1 -- 172.21.15.5:0/1930159719 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451332278 0 0) 0x7f466c06b870 con 0x7f466c0af450 2023-03-03T06:25:42.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.305+0000 7f466a7fc700 1 -- 172.21.15.5:0/1930159719 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f466c06b590 con 0x7f466c0af450 2023-03-03T06:25:42.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.305+0000 7f466a7fc700 1 -- 172.21.15.5:0/1930159719 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2139625322 0 0) 0x7f46540035b0 con 0x7f466c0b1f80 2023-03-03T06:25:42.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.305+0000 7f466b7fe700 1 -- 172.21.15.5:0/1930159719 >> v1:172.21.15.191:6789/0 conn(0x7f466c0af450 legacy=0x7f466c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.305+0000 7f466b7fe700 1 -- 172.21.15.5:0/1930159719 >> v1:172.21.15.5:6789/0 conn(0x7f466c0b1f80 legacy=0x7f466c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.312 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.305+0000 7f466b7fe700 1 -- 172.21.15.5:0/1930159719 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c06be30 con 0x7f466c0af080 2023-03-03T06:25:42.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.305+0000 7f466b7fe700 1 --2- 172.21.15.5:0/1930159719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c0af080 0x7f466c0cd350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f465c009870 tx=0x7f465c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f47ad94308b3e347 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:42.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.305+0000 7f466a7fc700 1 -- 172.21.15.5:0/1930159719 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640019f0 con 0x7f466c0af080 2023-03-03T06:25:42.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.306+0000 7f466a7fc700 1 -- 172.21.15.5:0/1930159719 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c004030 con 0x7f466c0af080 2023-03-03T06:25:42.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.306+0000 7f466a7fc700 1 -- 172.21.15.5:0/1930159719 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c0043c0 con 0x7f466c0af080 2023-03-03T06:25:42.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.306+0000 7f4671e06700 1 -- 172.21.15.5:0/1930159719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c0af080 msgr2=0x7f466c0cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.306+0000 7f4671e06700 1 --2- 172.21.15.5:0/1930159719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c0af080 0x7f466c0cd350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f465c009870 tx=0x7f465c009b80 comp rx=0 tx=0).stop 2023-03-03T06:25:42.313 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.306+0000 7f4671e06700 1 -- 172.21.15.5:0/1930159719 shutdown_connections 2023-03-03T06:25:42.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.306+0000 7f4671e06700 1 --2- 172.21.15.5:0/1930159719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c0af080 0x7f466c0cd350 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.306+0000 7f4671e06700 1 -- 172.21.15.5:0/1930159719 >> 172.21.15.5:0/1930159719 conn(0x7f466c06ea70 msgr2=0x7f466c0cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:42.314 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.306+0000 7f4671e06700 1 -- 172.21.15.5:0/1930159719 shutdown_connections 2023-03-03T06:25:42.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.306+0000 7f4671e06700 1 -- 172.21.15.5:0/1930159719 wait complete. 2023-03-03T06:25:42.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.307+0000 7f4671e06700 1 Processor -- start 2023-03-03T06:25:42.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.307+0000 7f4671e06700 1 -- start start 2023-03-03T06:25:42.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.308+0000 7f4671e06700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0af080 0x7f466c155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:42.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.308+0000 7f4671e06700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f466c0af450 0x7f466c1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:42.319 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.308+0000 7f4671e06700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c0b1f80 0x7f466c15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:42.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.308+0000 7f4671e06700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c15e180 con 0x7f466c0af080 2023-03-03T06:25:42.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.308+0000 7f4671e06700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c15e740 con 0x7f466c0af450 2023-03-03T06:25:42.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.308+0000 7f4671e06700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c15fb20 con 0x7f466c0b1f80 2023-03-03T06:25:42.320 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.308+0000 7f466b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0af080 0x7f466c155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:42.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.308+0000 7f466b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0af080 0x7f466c155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45006/0 (socket says 172.21.15.5:45006) 2023-03-03T06:25:42.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.308+0000 7f466b7fe700 1 -- 172.21.15.5:0/61825986 learned_addr learned my addr 172.21.15.5:0/61825986 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:42.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.308+0000 7f466bfff700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c0b1f80 0x7f466c15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:42.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.308+0000 7f466affd700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f466c0af450 0x7f466c1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:42.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.309+0000 7f466b7fe700 1 -- 172.21.15.5:0/61825986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c0b1f80 msgr2=0x7f466c15ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.309+0000 7f466b7fe700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c0b1f80 0x7f466c15ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.321 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.309+0000 7f466b7fe700 1 -- 172.21.15.5:0/61825986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f466c0af450 msgr2=0x7f466c1559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.309+0000 7f466b7fe700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f466c0af450 0x7f466c1559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.309+0000 7f466b7fe700 1 -- 172.21.15.5:0/61825986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c0094a0 con 0x7f466c0af080 2023-03-03T06:25:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.309+0000 7f466affd700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f466c0af450 0x7f466c1559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.309+0000 7f466bfff700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c0b1f80 0x7f466c15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.309+0000 7f466b7fe700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0af080 0x7f466c155f50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f465c0090b0 tx=0x7f465c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:42.322 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.309+0000 7f4653fff700 1 -- 172.21.15.5:0/61825986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c011630 con 0x7f466c0af080 2023-03-03T06:25:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.309+0000 7f4671e06700 1 -- 172.21.15.5:0/61825986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466c06d370 con 0x7f466c0af080 2023-03-03T06:25:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.309+0000 7f4653fff700 1 -- 172.21.15.5:0/61825986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c01f070 con 0x7f466c0af080 2023-03-03T06:25:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.309+0000 7f4653fff700 1 -- 172.21.15.5:0/61825986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c0119f0 con 0x7f466c0af080 2023-03-03T06:25:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.309+0000 7f4671e06700 1 -- 172.21.15.5:0/61825986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466c06c110 con 0x7f466c0af080 2023-03-03T06:25:42.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.310+0000 7f4671e06700 1 -- 172.21.15.5:0/61825986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466c06cb70 con 0x7f466c0af080 2023-03-03T06:25:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.310+0000 7f4653fff700 1 -- 172.21.15.5:0/61825986 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f465c017020 con 0x7f466c0af080 2023-03-03T06:25:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.311+0000 7f4653fff700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f46580682f0 0x7f465806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.311+0000 7f4653fff700 1 -- 172.21.15.5:0/61825986 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f465c021070 con 0x7f466c0af080 2023-03-03T06:25:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.311+0000 7f466affd700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f46580682f0 0x7f465806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.311+0000 7f466affd700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f46580682f0 0x7f465806a7a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f466c0ca5f0 tx=0x7f4660009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:42.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.315+0000 7f4653fff700 1 -- 172.21.15.5:0/61825986 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f465c053bf0 con 0x7f466c0af080 2023-03-03T06:25:42.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.553+0000 7f4671e06700 1 -- 172.21.15.5:0/61825986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f466c15ea20 con 0x7f466c0af080 2023-03-03T06:25:42.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.554+0000 7f4653fff700 1 -- 172.21.15.5:0/61825986 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4643 (secure 0 0 0) 0x7f465c057210 con 0x7f466c0af080 2023-03-03T06:25:42.556 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:42.557 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1328243693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":1328243693},{"type":"v1","addr":"172.21.15.191:6835","nonce":1328243693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/2339980581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2339980581},{"type":"v1","addr":"172.21.15.5:6836","nonce":2339980581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/620202132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":620202132},{"type":"v1","addr":"172.21.15.5:6837","nonce":620202132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:25:24.916109+0000","modified":"2023-03-03T06:25:27.928605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5410":{"gid":5410,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6834/950486040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":950486040},{"type":"v1","addr":"172.21.15.191:6834","nonce":950486040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-03-03T06:25:42.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.556+0000 7f4671e06700 1 -- 172.21.15.5:0/61825986 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f46580682f0 msgr2=0x7f465806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.556+0000 7f4671e06700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f46580682f0 0x7f465806a7a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f466c0ca5f0 tx=0x7f4660009040 comp rx=0 tx=0).stop 2023-03-03T06:25:42.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.556+0000 7f4671e06700 1 -- 172.21.15.5:0/61825986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0af080 msgr2=0x7f466c155f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.556+0000 7f4671e06700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0af080 0x7f466c155f50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f465c0090b0 tx=0x7f465c004750 comp rx=0 tx=0).stop 2023-03-03T06:25:42.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.556+0000 7f4671e06700 1 -- 172.21.15.5:0/61825986 shutdown_connections 2023-03-03T06:25:42.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.556+0000 7f4671e06700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f46580682f0 0x7f465806a7a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.556+0000 7f4671e06700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c0b1f80 0x7f466c15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.556+0000 7f4671e06700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f466c0af080 0x7f466c155f50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.556+0000 7f4671e06700 1 --2- 172.21.15.5:0/61825986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f466c0af450 0x7f466c1559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.556+0000 7f4671e06700 1 -- 172.21.15.5:0/61825986 >> 172.21.15.5:0/61825986 conn(0x7f466c06ea70 msgr2=0x7f466c0b4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:42.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.556+0000 7f4671e06700 1 -- 172.21.15.5:0/61825986 shutdown_connections 2023-03-03T06:25:42.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.556+0000 7f4671e06700 1 -- 172.21.15.5:0/61825986 wait complete. 2023-03-03T06:25:42.560 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2023-03-03T06:25:42.571 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.694+0000 7f1acfd63700 1 Processor -- start 2023-03-03T06:25:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.694+0000 7f1acfd63700 1 -- start start 2023-03-03T06:25:42.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1acfd63700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f1ac815a750 0x7f1ac80cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:42.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1acfd63700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ac806b540 0x7f1ac806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1acfd63700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac806bee0 con 0x7f1ac80ca440 2023-03-03T06:25:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1acfd63700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac80cc320 con 0x7f1ac806b540 2023-03-03T06:25:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1acfd63700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac80ca8b0 con 0x7f1ac815a750 2023-03-03T06:25:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1ace300700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ac806b540 0x7f1ac806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1ace300700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1ac806b540 0x7f1ac806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45018/0 (socket says 172.21.15.5:45018) 2023-03-03T06:25:42.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1ace300700 1 -- 172.21.15.5:0/1253022015 learned_addr learned my addr 172.21.15.5:0/1253022015 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1acdaff700 1 --2- 172.21.15.5:0/1253022015 >> v2:172.21.15.191:3300/0 conn(0x7f1ac815a750 0x7f1ac80cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1ace300700 1 -- 172.21.15.5:0/1253022015 >> v2:172.21.15.191:3300/0 conn(0x7f1ac815a750 msgr2=0x7f1ac80cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1ace300700 1 --2- 172.21.15.5:0/1253022015 >> v2:172.21.15.191:3300/0 conn(0x7f1ac815a750 0x7f1ac80cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1ace300700 1 -- 172.21.15.5:0/1253022015 >> v1:172.21.15.191:6789/0 conn(0x7f1ac80ca440 legacy=0x7f1ac80cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1ace300700 1 -- 172.21.15.5:0/1253022015 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac80cab70 con 0x7f1ac806b540 2023-03-03T06:25:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.695+0000 7f1acdaff700 1 --2- 172.21.15.5:0/1253022015 >> v2:172.21.15.191:3300/0 conn(0x7f1ac815a750 0x7f1ac80cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.696+0000 7f1ace300700 1 --2- 172.21.15.5:0/1253022015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ac806b540 0x7f1ac806b9a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8071a60 tx=0x7f1ac000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e65f3a8d52a4776 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:42.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.696+0000 7f1accafd700 1 -- 172.21.15.5:0/1253022015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac000e070 con 0x7f1ac806b540 2023-03-03T06:25:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.696+0000 7f1accafd700 1 -- 172.21.15.5:0/1253022015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac0003a20 con 0x7f1ac806b540 2023-03-03T06:25:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.696+0000 7f1accafd700 1 -- 172.21.15.5:0/1253022015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0003dd0 con 0x7f1ac806b540 2023-03-03T06:25:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.696+0000 7f1acfd63700 1 -- 172.21.15.5:0/1253022015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ac806b540 msgr2=0x7f1ac806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.696+0000 7f1acfd63700 1 --2- 172.21.15.5:0/1253022015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ac806b540 0x7f1ac806b9a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8071a60 tx=0x7f1ac000b330 comp rx=0 tx=0).stop 2023-03-03T06:25:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.696+0000 7f1acfd63700 1 -- 172.21.15.5:0/1253022015 shutdown_connections 2023-03-03T06:25:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.696+0000 7f1acfd63700 1 --2- 172.21.15.5:0/1253022015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ac806b540 0x7f1ac806b9a0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.696+0000 7f1acfd63700 1 --2- 172.21.15.5:0/1253022015 >> v2:172.21.15.191:3300/0 conn(0x7f1ac815a750 0x7f1ac80cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.696+0000 7f1acfd63700 1 -- 172.21.15.5:0/1253022015 >> 172.21.15.5:0/1253022015 conn(0x7f1ac806ea70 msgr2=0x7f1ac80cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:42.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.696+0000 7f1acfd63700 1 -- 172.21.15.5:0/1253022015 shutdown_connections 2023-03-03T06:25:42.702 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.696+0000 7f1acfd63700 1 -- 172.21.15.5:0/1253022015 wait complete. 2023-03-03T06:25:42.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.698+0000 7f1acfd63700 1 Processor -- start 2023-03-03T06:25:42.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.698+0000 7f1acfd63700 1 -- start start 2023-03-03T06:25:42.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.698+0000 7f1acfd63700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ac806b540 0x7f1ac815d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:42.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.698+0000 7f1acfd63700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ac80ca440 0x7f1ac81f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:42.704 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.698+0000 7f1acfd63700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ac815a750 0x7f1ac80b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:42.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.698+0000 7f1acfd63700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac815bef0 con 0x7f1ac815a750 2023-03-03T06:25:42.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.698+0000 7f1acfd63700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac81f5d90 con 0x7f1ac80ca440 2023-03-03T06:25:42.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.698+0000 7f1acfd63700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac81f6070 con 0x7f1ac806b540 2023-03-03T06:25:42.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1ace300700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ac815a750 0x7f1ac80b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:42.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1ace300700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ac815a750 0x7f1ac80b5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45024/0 (socket says 172.21.15.5:45024) 2023-03-03T06:25:42.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1ace300700 1 -- 172.21.15.5:0/2206464138 learned_addr learned my addr 172.21.15.5:0/2206464138 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:42.705 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1acdaff700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ac806b540 0x7f1ac815d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:42.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1acd2fe700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ac80ca440 0x7f1ac81f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:42.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1ace300700 1 -- 172.21.15.5:0/2206464138 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ac806b540 msgr2=0x7f1ac815d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1ace300700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ac806b540 0x7f1ac815d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1ace300700 1 -- 172.21.15.5:0/2206464138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ac80ca440 msgr2=0x7f1ac81f53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1ace300700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ac80ca440 0x7f1ac81f53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1ace300700 1 -- 172.21.15.5:0/2206464138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac0009b30 con 0x7f1ac815a750 2023-03-03T06:25:42.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1acd2fe700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ac80ca440 0x7f1ac81f53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:42.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1ace300700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ac815a750 0x7f1ac80b5120 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0015040 tx=0x7f1ac0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:42.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1abe7fc700 1 -- 172.21.15.5:0/2206464138 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0004440 con 0x7f1ac815a750 2023-03-03T06:25:42.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1abe7fc700 1 -- 172.21.15.5:0/2206464138 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac00045a0 con 0x7f1ac815a750 2023-03-03T06:25:42.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1acfd63700 1 -- 172.21.15.5:0/2206464138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac80cb130 con 0x7f1ac815a750 2023-03-03T06:25:42.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1abe7fc700 1 -- 172.21.15.5:0/2206464138 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0004950 con 0x7f1ac815a750 2023-03-03T06:25:42.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.699+0000 7f1acfd63700 1 -- 172.21.15.5:0/2206464138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac80cae50 con 0x7f1ac815a750 2023-03-03T06:25:42.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.700+0000 7f1acfd63700 1 -- 172.21.15.5:0/2206464138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac80cb410 con 0x7f1ac815a750 2023-03-03T06:25:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.701+0000 7f1abe7fc700 1 -- 172.21.15.5:0/2206464138 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1ac0022030 con 0x7f1ac815a750 2023-03-03T06:25:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.701+0000 7f1abe7fc700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1aac0682f0 0x7f1aac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.701+0000 7f1abe7fc700 1 -- 172.21.15.5:0/2206464138 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1ac00873f0 con 0x7f1ac815a750 2023-03-03T06:25:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.701+0000 7f1acdaff700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1aac0682f0 0x7f1aac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.701+0000 7f1acdaff700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1aac0682f0 0x7f1aac06a7a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8006fd0 tx=0x7f1ab8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:42.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.705+0000 7f1abe7fc700 1 -- 172.21.15.5:0/2206464138 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1ac0053930 con 0x7f1ac815a750 2023-03-03T06:25:42.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.900+0000 7f1acfd63700 1 -- 172.21.15.5:0/2206464138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ac804e6e0 con 0x7f1ac815a750 2023-03-03T06:25:42.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.902+0000 7f1abe7fc700 1 -- 172.21.15.5:0/2206464138 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+19673 (secure 0 0 0) 0x7f1ac0007310 con 0x7f1ac815a750 2023-03-03T06:25:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:42.904 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":56,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:25.917983+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:23.205830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:23.882328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:42.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.904+0000 7f1acfd63700 1 -- 172.21.15.5:0/2206464138 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1aac0682f0 msgr2=0x7f1aac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.904+0000 7f1acfd63700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1aac0682f0 0x7f1aac06a7a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8006fd0 tx=0x7f1ab8008040 comp rx=0 tx=0).stop 2023-03-03T06:25:42.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.904+0000 7f1acfd63700 1 -- 172.21.15.5:0/2206464138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ac815a750 msgr2=0x7f1ac80b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:42.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.904+0000 7f1acfd63700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ac815a750 0x7f1ac80b5120 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0015040 tx=0x7f1ac0004ad0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.904+0000 7f1acfd63700 1 -- 172.21.15.5:0/2206464138 shutdown_connections 2023-03-03T06:25:42.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.904+0000 7f1acfd63700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ac815a750 0x7f1ac80b5120 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.904+0000 7f1acfd63700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1aac0682f0 0x7f1aac06a7a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.904+0000 7f1acfd63700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1ac806b540 0x7f1ac815d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.904+0000 7f1acfd63700 1 --2- 172.21.15.5:0/2206464138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1ac80ca440 0x7f1ac81f53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:42.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.904+0000 7f1acfd63700 1 -- 172.21.15.5:0/2206464138 >> 172.21.15.5:0/2206464138 conn(0x7f1ac806ea70 msgr2=0x7f1ac8159330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:42.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.904+0000 7f1acfd63700 1 -- 172.21.15.5:0/2206464138 shutdown_connections 2023-03-03T06:25:42.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:42.904+0000 7f1acfd63700 1 -- 172.21.15.5:0/2206464138 wait complete. 2023-03-03T06:25:42.918 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-03-03T06:25:42.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.041+0000 7f226dc14700 1 Processor -- start 2023-03-03T06:25:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.041+0000 7f226dc14700 1 -- start start 2023-03-03T06:25:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.042+0000 7f226dc14700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f226815cd40 0x7f22680b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.042+0000 7f226dc14700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f22680cef60 0x7f22680b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.042+0000 7f226dc14700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226815d4e0 con 0x7f22680cba50 2023-03-03T06:25:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.042+0000 7f226dc14700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226815d7c0 con 0x7f22680cef60 2023-03-03T06:25:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.042+0000 7f226dc14700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226815daa0 con 0x7f226815cd40 2023-03-03T06:25:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.042+0000 7f2266ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f22680cba50 0x7f2268160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34872/0 (socket says 172.21.15.5:34872) 2023-03-03T06:25:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.042+0000 7f2266ffd700 1 -- 172.21.15.5:0/2666238498 learned_addr learned my addr 172.21.15.5:0/2666238498 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.042+0000 7f2267fff700 1 --2- 172.21.15.5:0/2666238498 >> v2:172.21.15.191:3300/0 conn(0x7f22680cef60 0x7f22680b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.042+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282961097 0 0) 0x7f226815d4e0 con 0x7f22680cba50 2023-03-03T06:25:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.042+0000 7f22677fe700 1 --2- 172.21.15.5:0/2666238498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f226815cd40 0x7f22680b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.042+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22540035b0 con 0x7f22680cba50 2023-03-03T06:25:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3311080211 0 0) 0x7f22540035b0 con 0x7f22680cba50 2023-03-03T06:25:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f226815cd40 msgr2=0x7f22680b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 --2- 172.21.15.5:0/2666238498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f226815cd40 0x7f22680b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 >> v2:172.21.15.191:3300/0 conn(0x7f22680cef60 msgr2=0x7f22680b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 --2- 172.21.15.5:0/2666238498 >> v2:172.21.15.191:3300/0 conn(0x7f22680cef60 0x7f22680b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226815dd80 con 0x7f22680cba50 2023-03-03T06:25:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f22500017f0 con 0x7f22680cba50 2023-03-03T06:25:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 >> v1:172.21.15.5:6789/0 conn(0x7f22680cba50 legacy=0x7f2268160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 --2- 172.21.15.5:0/2666238498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f226815cd40 0x7f2254003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 --2- 172.21.15.5:0/2666238498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2254003ff0 0x7f2254004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 --2- 172.21.15.5:0/2666238498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2254004d90 0x7f2254005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226815d7c0 con 0x7f2254003ff0 2023-03-03T06:25:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226815daa0 con 0x7f2254004d90 2023-03-03T06:25:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225400ba10 con 0x7f226815cd40 2023-03-03T06:25:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f2266ffd700 1 --2- 172.21.15.5:0/2666238498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2254003ff0 0x7f2254004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f2267fff700 1 --2- 172.21.15.5:0/2666238498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2254004d90 0x7f2254005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22677fe700 1 --2- 172.21.15.5:0/2666238498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f226815cd40 0x7f2254003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f2266ffd700 1 -- 172.21.15.5:0/2666238498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f226815cd40 msgr2=0x7f2254003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f2266ffd700 1 --2- 172.21.15.5:0/2666238498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f226815cd40 0x7f2254003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f2266ffd700 1 -- 172.21.15.5:0/2666238498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2254004d90 msgr2=0x7f2254005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f2266ffd700 1 --2- 172.21.15.5:0/2666238498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2254004d90 0x7f2254005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f2266ffd700 1 -- 172.21.15.5:0/2666238498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22540035b0 con 0x7f2254003ff0 2023-03-03T06:25:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22677fe700 1 --2- 172.21.15.5:0/2666238498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f226815cd40 0x7f2254003a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f2266ffd700 1 --2- 172.21.15.5:0/2666238498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2254003ff0 0x7f2254004850 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f225000c270 tx=0x7f2254005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e36196daaf8f4 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225000cdd0 con 0x7f2254003ff0 2023-03-03T06:25:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2250007bd0 con 0x7f2254003ff0 2023-03-03T06:25:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.043+0000 7f22667fc700 1 -- 172.21.15.5:0/2666238498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250007310 con 0x7f2254003ff0 2023-03-03T06:25:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.044+0000 7f226dc14700 1 -- 172.21.15.5:0/2666238498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2254003ff0 msgr2=0x7f2254004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.044+0000 7f226dc14700 1 --2- 172.21.15.5:0/2666238498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2254003ff0 0x7f2254004850 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f225000c270 tx=0x7f2254005880 comp rx=0 tx=0).stop 2023-03-03T06:25:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.044+0000 7f2267fff700 1 -- 172.21.15.5:0/2666238498 reap_dead start 2023-03-03T06:25:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.044+0000 7f226dc14700 1 -- 172.21.15.5:0/2666238498 shutdown_connections 2023-03-03T06:25:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.044+0000 7f226dc14700 1 -- 172.21.15.5:0/2666238498 >> 172.21.15.5:0/2666238498 conn(0x7f22680cc8d0 msgr2=0x7f22680cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.044+0000 7f226dc14700 1 -- 172.21.15.5:0/2666238498 shutdown_connections 2023-03-03T06:25:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.044+0000 7f226dc14700 1 -- 172.21.15.5:0/2666238498 wait complete. 2023-03-03T06:25:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.045+0000 7f226dc14700 1 Processor -- start 2023-03-03T06:25:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.045+0000 7f226dc14700 1 -- start start 2023-03-03T06:25:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.046+0000 7f226dc14700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2254003ff0 0x7f226814dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.046+0000 7f226dc14700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22680c6f20 0x7f22680c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.046+0000 7f226dc14700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22680b5220 0x7f22680b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.046+0000 7f226dc14700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22680c77a0 con 0x7f22680c6f20 2023-03-03T06:25:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.046+0000 7f226dc14700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226814e530 con 0x7f22680b5220 2023-03-03T06:25:43.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.046+0000 7f226dc14700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22680b5bd0 con 0x7f2254003ff0 2023-03-03T06:25:43.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.046+0000 7f2266ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22680c6f20 0x7f22680c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.046+0000 7f2266ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22680c6f20 0x7f22680c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45042/0 (socket says 172.21.15.5:45042) 2023-03-03T06:25:43.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.046+0000 7f2266ffd700 1 -- 172.21.15.5:0/1005504726 learned_addr learned my addr 172.21.15.5:0/1005504726 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:43.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.046+0000 7f22677fe700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2254003ff0 0x7f226814dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.046+0000 7f2267fff700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22680b5220 0x7f22680b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.047+0000 7f2266ffd700 1 -- 172.21.15.5:0/1005504726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2254003ff0 msgr2=0x7f226814dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.047+0000 7f2266ffd700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2254003ff0 0x7f226814dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.047+0000 7f2266ffd700 1 -- 172.21.15.5:0/1005504726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22680b5220 msgr2=0x7f22680b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.047+0000 7f2266ffd700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22680b5220 0x7f22680b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.047+0000 7f2266ffd700 1 -- 172.21.15.5:0/1005504726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22680ca530 con 0x7f22680c6f20 2023-03-03T06:25:43.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.047+0000 7f2266ffd700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22680c6f20 0x7f22680c9980 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2254004740 tx=0x7f2250001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:43.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.047+0000 7f225ffff700 1 -- 172.21.15.5:0/1005504726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250005d40 con 0x7f22680c6f20 2023-03-03T06:25:43.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.047+0000 7f225ffff700 1 -- 172.21.15.5:0/1005504726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22500070d0 con 0x7f22680c6f20 2023-03-03T06:25:43.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.047+0000 7f225ffff700 1 -- 172.21.15.5:0/1005504726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250007480 con 0x7f22680c6f20 2023-03-03T06:25:43.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.047+0000 7f226dc14700 1 -- 172.21.15.5:0/1005504726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226815e060 con 0x7f22680c6f20 2023-03-03T06:25:43.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.047+0000 7f226dc14700 1 -- 172.21.15.5:0/1005504726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226815d110 con 0x7f22680c6f20 2023-03-03T06:25:43.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.048+0000 7f226dc14700 1 -- 172.21.15.5:0/1005504726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226804e6e0 con 0x7f22680c6f20 2023-03-03T06:25:43.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.048+0000 7f225ffff700 1 -- 172.21.15.5:0/1005504726 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f225002d070 con 0x7f22680c6f20 2023-03-03T06:25:43.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.049+0000 7f225ffff700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f22480682f0 0x7f224806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.049+0000 7f22677fe700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f22480682f0 0x7f224806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.049+0000 7f225ffff700 1 -- 172.21.15.5:0/1005504726 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2250087160 con 0x7f22680c6f20 2023-03-03T06:25:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.049+0000 7f22677fe700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f22480682f0 0x7f224806a7a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2258009ae0 tx=0x7f2258008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.053+0000 7f225ffff700 1 -- 172.21.15.5:0/1005504726 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f22500537d0 con 0x7f22680c6f20 2023-03-03T06:25:43.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.289+0000 7f226dc14700 1 -- 172.21.15.5:0/1005504726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22680b25b0 con 0x7f22680c6f20 2023-03-03T06:25:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.289+0000 7f225ffff700 1 -- 172.21.15.5:0/1005504726 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4643 (secure 0 0 0) 0x7f2250056df0 con 0x7f22680c6f20 2023-03-03T06:25:43.292 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:43.292 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1328243693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":1328243693},{"type":"v1","addr":"172.21.15.191:6835","nonce":1328243693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/2339980581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2339980581},{"type":"v1","addr":"172.21.15.5:6836","nonce":2339980581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/620202132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":620202132},{"type":"v1","addr":"172.21.15.5:6837","nonce":620202132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:25:24.916109+0000","modified":"2023-03-03T06:25:27.928605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5410":{"gid":5410,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6834/950486040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":950486040},{"type":"v1","addr":"172.21.15.191:6834","nonce":950486040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-03-03T06:25:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.292+0000 7f226dc14700 1 -- 172.21.15.5:0/1005504726 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f22480682f0 msgr2=0x7f224806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.292+0000 7f226dc14700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f22480682f0 0x7f224806a7a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2258009ae0 tx=0x7f2258008040 comp rx=0 tx=0).stop 2023-03-03T06:25:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.292+0000 7f226dc14700 1 -- 172.21.15.5:0/1005504726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22680c6f20 msgr2=0x7f22680c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.292+0000 7f226dc14700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22680c6f20 0x7f22680c9980 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2254004740 tx=0x7f2250001160 comp rx=0 tx=0).stop 2023-03-03T06:25:43.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.292+0000 7f226dc14700 1 -- 172.21.15.5:0/1005504726 shutdown_connections 2023-03-03T06:25:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.292+0000 7f226dc14700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f22680b5220 0x7f22680b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.292+0000 7f226dc14700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f22480682f0 0x7f224806a7a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.292+0000 7f226dc14700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2254003ff0 0x7f226814dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.292+0000 7f226dc14700 1 --2- 172.21.15.5:0/1005504726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22680c6f20 0x7f22680c9980 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.292+0000 7f226dc14700 1 -- 172.21.15.5:0/1005504726 >> 172.21.15.5:0/1005504726 conn(0x7f22680cc8d0 msgr2=0x7f226806cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.292+0000 7f226dc14700 1 -- 172.21.15.5:0/1005504726 shutdown_connections 2023-03-03T06:25:43.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.292+0000 7f226dc14700 1 -- 172.21.15.5:0/1005504726 wait complete. 2023-03-03T06:25:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2023-03-03T06:25:43.306 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:43.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.428+0000 7f8715439700 1 Processor -- start 2023-03-03T06:25:43.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.429+0000 7f8715439700 1 -- start start 2023-03-03T06:25:43.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.429+0000 7f8715439700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f871015cda0 0x7f87100d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.429+0000 7f8715439700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87100cf9e0 0x7f87100cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.429+0000 7f8715439700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87100d10b0 con 0x7f87100cd960 2023-03-03T06:25:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.429+0000 7f8715439700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87100d1c30 con 0x7f871015cda0 2023-03-03T06:25:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.429+0000 7f8715439700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87100d1300 con 0x7f87100cf9e0 2023-03-03T06:25:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.430+0000 7f870effd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f871015cda0 0x7f87100d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.430+0000 7f870f7fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87100cf9e0 0x7f87100cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.430+0000 7f870effd700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f871015cda0 0x7f87100d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:45408/0 (socket says 172.21.15.5:45408) 2023-03-03T06:25:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.430+0000 7f870effd700 1 -- 172.21.15.5:0/3302374658 learned_addr learned my addr 172.21.15.5:0/3302374658 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:43.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.430+0000 7f870effd700 1 -- 172.21.15.5:0/3302374658 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87100cf9e0 msgr2=0x7f87100cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:43.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.430+0000 7f870effd700 1 --2- 172.21.15.5:0/3302374658 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87100cf9e0 0x7f87100cfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.430+0000 7f870effd700 1 -- 172.21.15.5:0/3302374658 >> v1:172.21.15.191:6789/0 conn(0x7f87100cd960 legacy=0x7f87100cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.430+0000 7f870dffb700 1 -- 172.21.15.5:0/3302374658 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291202864 0 0) 0x7f87100d10b0 con 0x7f87100cd960 2023-03-03T06:25:43.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.430+0000 7f870effd700 1 -- 172.21.15.5:0/3302374658 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87100d15e0 con 0x7f871015cda0 2023-03-03T06:25:43.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.430+0000 7f870effd700 1 --2- 172.21.15.5:0/3302374658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f871015cda0 0x7f87100d20c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f87000098f0 tx=0x7f8700009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c74071cf92f3a67 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.430+0000 7f870dffb700 1 -- 172.21.15.5:0/3302374658 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700011830 con 0x7f871015cda0 2023-03-03T06:25:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.431+0000 7f870dffb700 1 -- 172.21.15.5:0/3302374658 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8700011990 con 0x7f871015cda0 2023-03-03T06:25:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.431+0000 7f870dffb700 1 -- 172.21.15.5:0/3302374658 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700011d20 con 0x7f871015cda0 2023-03-03T06:25:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.431+0000 7f8715439700 1 -- 172.21.15.5:0/3302374658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f871015cda0 msgr2=0x7f87100d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.431+0000 7f8715439700 1 --2- 172.21.15.5:0/3302374658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f871015cda0 0x7f87100d20c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f87000098f0 tx=0x7f8700009c00 comp rx=0 tx=0).stop 2023-03-03T06:25:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.431+0000 7f8715439700 1 -- 172.21.15.5:0/3302374658 shutdown_connections 2023-03-03T06:25:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.431+0000 7f8715439700 1 --2- 172.21.15.5:0/3302374658 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f87100cf9e0 0x7f87100cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.431+0000 7f8715439700 1 --2- 172.21.15.5:0/3302374658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f871015cda0 0x7f87100d20c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.431+0000 7f8715439700 1 -- 172.21.15.5:0/3302374658 >> 172.21.15.5:0/3302374658 conn(0x7f87100b4c10 msgr2=0x7f87100b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.431+0000 7f8715439700 1 -- 172.21.15.5:0/3302374658 shutdown_connections 2023-03-03T06:25:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.431+0000 7f8715439700 1 -- 172.21.15.5:0/3302374658 wait complete. 2023-03-03T06:25:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.432+0000 7f8715439700 1 Processor -- start 2023-03-03T06:25:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.432+0000 7f8715439700 1 -- start start 2023-03-03T06:25:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.433+0000 7f8715439700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87100cd960 0x7f871015e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.433+0000 7f8715439700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87100cf9e0 0x7f8710160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.433+0000 7f8715439700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f871015cda0 0x7f871015b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.433+0000 7f8715439700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871015f4c0 con 0x7f87100cf9e0 2023-03-03T06:25:43.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.433+0000 7f8715439700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871015ec20 con 0x7f87100cd960 2023-03-03T06:25:43.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.433+0000 7f8715439700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871015ef00 con 0x7f871015cda0 2023-03-03T06:25:43.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.433+0000 7f870e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87100cf9e0 0x7f8710160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.433+0000 7f870e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87100cf9e0 0x7f8710160060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45056/0 (socket says 172.21.15.5:45056) 2023-03-03T06:25:43.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.433+0000 7f870e7fc700 1 -- 172.21.15.5:0/2957337343 learned_addr learned my addr 172.21.15.5:0/2957337343 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:43.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.433+0000 7f870effd700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87100cd960 0x7f871015e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.433+0000 7f870f7fe700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f871015cda0 0x7f871015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.434+0000 7f870e7fc700 1 -- 172.21.15.5:0/2957337343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f871015cda0 msgr2=0x7f871015b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.434+0000 7f870e7fc700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f871015cda0 0x7f871015b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.434+0000 7f870e7fc700 1 -- 172.21.15.5:0/2957337343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87100cd960 msgr2=0x7f871015e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.434+0000 7f870e7fc700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87100cd960 0x7f871015e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.434+0000 7f870e7fc700 1 -- 172.21.15.5:0/2957337343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8700009550 con 0x7f87100cf9e0 2023-03-03T06:25:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.434+0000 7f870effd700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87100cd960 0x7f871015e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:43.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.434+0000 7f870e7fc700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87100cf9e0 0x7f8710160060 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f86f80011e0 tx=0x7f86f800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:43.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.434+0000 7f87077fe700 1 -- 172.21.15.5:0/2957337343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80054e0 con 0x7f87100cf9e0 2023-03-03T06:25:43.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.434+0000 7f87077fe700 1 -- 172.21.15.5:0/2957337343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f8003680 con 0x7f87100cf9e0 2023-03-03T06:25:43.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.434+0000 7f8715439700 1 -- 172.21.15.5:0/2957337343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87100d03a0 con 0x7f87100cf9e0 2023-03-03T06:25:43.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.434+0000 7f87077fe700 1 -- 172.21.15.5:0/2957337343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8003a30 con 0x7f87100cf9e0 2023-03-03T06:25:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.434+0000 7f8715439700 1 -- 172.21.15.5:0/2957337343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87100d18c0 con 0x7f87100cf9e0 2023-03-03T06:25:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.435+0000 7f8715439700 1 -- 172.21.15.5:0/2957337343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871015d170 con 0x7f87100cf9e0 2023-03-03T06:25:43.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.435+0000 7f87077fe700 1 -- 172.21.15.5:0/2957337343 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f86f8019030 con 0x7f87100cf9e0 2023-03-03T06:25:43.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.436+0000 7f87077fe700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86f00682f0 0x7f86f006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.436+0000 7f87077fe700 1 -- 172.21.15.5:0/2957337343 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f86f80852b0 con 0x7f87100cf9e0 2023-03-03T06:25:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.436+0000 7f870effd700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86f00682f0 0x7f86f006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.447 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.436+0000 7f870effd700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86f00682f0 0x7f86f006a7a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8700014040 tx=0x7f8700008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:43.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.440+0000 7f87077fe700 1 -- 172.21.15.5:0/2957337343 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f86f80517e0 con 0x7f87100cf9e0 2023-03-03T06:25:43.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.677+0000 7f8715439700 1 -- 172.21.15.5:0/2957337343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f871004e6e0 con 0x7f87100cf9e0 2023-03-03T06:25:43.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.678+0000 7f87077fe700 1 -- 172.21.15.5:0/2957337343 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4643 (secure 0 0 0) 0x7f86f8017020 con 0x7f87100cf9e0 2023-03-03T06:25:43.680 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:43.680 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1328243693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":1328243693},{"type":"v1","addr":"172.21.15.191:6835","nonce":1328243693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/2339980581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2339980581},{"type":"v1","addr":"172.21.15.5:6836","nonce":2339980581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/620202132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":620202132},{"type":"v1","addr":"172.21.15.5:6837","nonce":620202132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:25:24.916109+0000","modified":"2023-03-03T06:25:27.928605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5410":{"gid":5410,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6834/950486040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":950486040},{"type":"v1","addr":"172.21.15.191:6834","nonce":950486040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-03-03T06:25:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.680+0000 7f8715439700 1 -- 172.21.15.5:0/2957337343 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86f00682f0 msgr2=0x7f86f006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.680+0000 7f8715439700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86f00682f0 0x7f86f006a7a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8700014040 tx=0x7f8700008030 comp rx=0 tx=0).stop 2023-03-03T06:25:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.680+0000 7f8715439700 1 -- 172.21.15.5:0/2957337343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87100cf9e0 msgr2=0x7f8710160060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.680+0000 7f8715439700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87100cf9e0 0x7f8710160060 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f86f80011e0 tx=0x7f86f800ca30 comp rx=0 tx=0).stop 2023-03-03T06:25:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.680+0000 7f8715439700 1 -- 172.21.15.5:0/2957337343 shutdown_connections 2023-03-03T06:25:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.680+0000 7f8715439700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86f00682f0 0x7f86f006a7a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.680+0000 7f8715439700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f871015cda0 0x7f871015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.680+0000 7f8715439700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87100cd960 0x7f871015e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.680+0000 7f8715439700 1 --2- 172.21.15.5:0/2957337343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87100cf9e0 0x7f8710160060 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.680+0000 7f8715439700 1 -- 172.21.15.5:0/2957337343 >> 172.21.15.5:0/2957337343 conn(0x7f87100b4c10 msgr2=0x7f871006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:43.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.680+0000 7f8715439700 1 -- 172.21.15.5:0/2957337343 shutdown_connections 2023-03-03T06:25:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.680+0000 7f8715439700 1 -- 172.21.15.5:0/2957337343 wait complete. 2023-03-03T06:25:43.684 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2023-03-03T06:25:43.695 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.819+0000 7f7f8f1ad700 1 Processor -- start 2023-03-03T06:25:43.821 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.819+0000 7f7f8f1ad700 1 -- start start 2023-03-03T06:25:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f8f1ad700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8815dd10 0x7f7f8806d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f8f1ad700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8806e3f0 con 0x7f7f88159550 2023-03-03T06:25:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f8f1ad700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8806e6d0 con 0x7f7f880cebc0 2023-03-03T06:25:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f8f1ad700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8815e160 con 0x7f7f8815dd10 2023-03-03T06:25:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f8cf49700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7f88159550 0x7f7f8806dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34904/0 (socket says 172.21.15.5:34904) 2023-03-03T06:25:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f8cf49700 1 -- 172.21.15.5:0/1639427838 learned_addr learned my addr 172.21.15.5:0/1639427838 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121469479 0 0) 0x7f7f8806e3f0 con 0x7f7f88159550 2023-03-03T06:25:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f87fff700 1 --2- 172.21.15.5:0/1639427838 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8815dd10 0x7f7f8806d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f780035b0 con 0x7f7f88159550 2023-03-03T06:25:43.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1337176441 0 0) 0x7f7f780035b0 con 0x7f7f88159550 2023-03-03T06:25:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8815dd10 msgr2=0x7f7f8806d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 --2- 172.21.15.5:0/1639427838 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8815dd10 0x7f7f8806d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 >> v1:172.21.15.191:6789/0 conn(0x7f7f880cebc0 legacy=0x7f7f880cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8806c6d0 con 0x7f7f88159550 2023-03-03T06:25:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f7f7c001670 con 0x7f7f88159550 2023-03-03T06:25:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 >> v1:172.21.15.5:6789/0 conn(0x7f7f88159550 legacy=0x7f7f8806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 --2- 172.21.15.5:0/1639427838 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8815dd10 0x7f7f78003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 --2- 172.21.15.5:0/1639427838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f78004020 0x7f7f78004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 --2- 172.21.15.5:0/1639427838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f78004d90 0x7f7f78005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8815e160 con 0x7f7f78004d90 2023-03-03T06:25:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7800bb50 con 0x7f7f78004020 2023-03-03T06:25:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.820+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7800bd10 con 0x7f7f8815dd10 2023-03-03T06:25:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.821+0000 7f7f8cf49700 1 --2- 172.21.15.5:0/1639427838 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8815dd10 0x7f7f78003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.821+0000 7f7f8d74a700 1 --2- 172.21.15.5:0/1639427838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f78004d90 0x7f7f78005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.821+0000 7f7f87fff700 1 --2- 172.21.15.5:0/1639427838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f78004020 0x7f7f78004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.821+0000 7f7f8cf49700 1 -- 172.21.15.5:0/1639427838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f78004020 msgr2=0x7f7f78004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.821+0000 7f7f8cf49700 1 --2- 172.21.15.5:0/1639427838 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f78004020 0x7f7f78004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.821+0000 7f7f8cf49700 1 -- 172.21.15.5:0/1639427838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f78004d90 msgr2=0x7f7f78005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.821+0000 7f7f8cf49700 1 --2- 172.21.15.5:0/1639427838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f78004d90 0x7f7f78005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.821+0000 7f7f8cf49700 1 -- 172.21.15.5:0/1639427838 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780035b0 con 0x7f7f8815dd10 2023-03-03T06:25:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.821+0000 7f7f8d74a700 1 --2- 172.21.15.5:0/1639427838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f78004d90 0x7f7f78005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:43.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.821+0000 7f7f8cf49700 1 --2- 172.21.15.5:0/1639427838 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8815dd10 0x7f7f78003aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c240 tx=0x7f7f78005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd77f8c4a8fd877c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.821+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c007c10 con 0x7f7f8815dd10 2023-03-03T06:25:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.821+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c00cde0 con 0x7f7f8815dd10 2023-03-03T06:25:43.828 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.821+0000 7f7f877fe700 1 -- 172.21.15.5:0/1639427838 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c005ba0 con 0x7f7f8815dd10 2023-03-03T06:25:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.822+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/1639427838 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8815dd10 msgr2=0x7f7f78003aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.822+0000 7f7f8f1ad700 1 --2- 172.21.15.5:0/1639427838 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8815dd10 0x7f7f78003aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c240 tx=0x7f7f78005880 comp rx=0 tx=0).stop 2023-03-03T06:25:43.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.822+0000 7f7f8d74a700 1 -- 172.21.15.5:0/1639427838 reap_dead start 2023-03-03T06:25:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.822+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/1639427838 shutdown_connections 2023-03-03T06:25:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.822+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/1639427838 >> 172.21.15.5:0/1639427838 conn(0x7f7f880cfd00 msgr2=0x7f7f880d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.822+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/1639427838 shutdown_connections 2023-03-03T06:25:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.822+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/1639427838 wait complete. 2023-03-03T06:25:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.823+0000 7f7f8f1ad700 1 Processor -- start 2023-03-03T06:25:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.824+0000 7f7f8f1ad700 1 -- start start 2023-03-03T06:25:43.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f8f1ad700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8806ae30 0x7f7f880b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f8f1ad700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f880b0c40 0x7f7f880c3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f8f1ad700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f8806b200 0x7f7f880c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f8f1ad700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880cc9c0 con 0x7f7f880b0c40 2023-03-03T06:25:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f8f1ad700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880b3a60 con 0x7f7f8806b200 2023-03-03T06:25:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f8f1ad700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880b1500 con 0x7f7f8806ae30 2023-03-03T06:25:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f87fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f880b0c40 0x7f7f880c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f87fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f880b0c40 0x7f7f880c3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45076/0 (socket says 172.21.15.5:45076) 2023-03-03T06:25:43.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f87fff700 1 -- 172.21.15.5:0/2128718678 learned_addr learned my addr 172.21.15.5:0/2128718678 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f8cf49700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8806ae30 0x7f7f880b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f8d74a700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f8806b200 0x7f7f880c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f87fff700 1 -- 172.21.15.5:0/2128718678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8806ae30 msgr2=0x7f7f880b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f87fff700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8806ae30 0x7f7f880b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f87fff700 1 -- 172.21.15.5:0/2128718678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f8806b200 msgr2=0x7f7f880c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f87fff700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f8806b200 0x7f7f880c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:43.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f87fff700 1 -- 172.21.15.5:0/2128718678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8806cc90 con 0x7f7f880b0c40 2023-03-03T06:25:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f87fff700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f880b0c40 0x7f7f880c3830 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7f74011aa0 tx=0x7f7f74011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f857fa700 1 -- 172.21.15.5:0/2128718678 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400f980 con 0x7f7f880b0c40 2023-03-03T06:25:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f857fa700 1 -- 172.21.15.5:0/2128718678 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7400fae0 con 0x7f7f880b0c40 2023-03-03T06:25:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/2128718678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8806c9b0 con 0x7f7f880b0c40 2023-03-03T06:25:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f857fa700 1 -- 172.21.15.5:0/2128718678 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400fe90 con 0x7f7f880b0c40 2023-03-03T06:25:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.825+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/2128718678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f88159920 con 0x7f7f880b0c40 2023-03-03T06:25:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.826+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/2128718678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8806d840 con 0x7f7f880b0c40 2023-03-03T06:25:43.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.827+0000 7f7f857fa700 1 -- 172.21.15.5:0/2128718678 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7f7401d400 con 0x7f7f880b0c40 2023-03-03T06:25:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.827+0000 7f7f857fa700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7f6c0682f0 0x7f7f6c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.827+0000 7f7f857fa700 1 -- 172.21.15.5:0/2128718678 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7f740867e0 con 0x7f7f880b0c40 2023-03-03T06:25:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.827+0000 7f7f8cf49700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7f6c0682f0 0x7f7f6c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.828+0000 7f7f8cf49700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7f6c0682f0 0x7f7f6c06a7a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7f880708d0 tx=0x7f7f7c007000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:43.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:43.832+0000 7f7f857fa700 1 -- 172.21.15.5:0/2128718678 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7f74052d40 con 0x7f7f880b0c40 2023-03-03T06:25:44.026 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.024+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/2128718678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f880b3bd0 con 0x7f7f880b0c40 2023-03-03T06:25:44.027 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.026+0000 7f7f857fa700 1 -- 172.21.15.5:0/2128718678 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+19673 (secure 0 0 0) 0x7f7f74056360 con 0x7f7f880b0c40 2023-03-03T06:25:44.028 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:44.028 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":56,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:25.917983+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:23.205830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:23.882328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.028+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/2128718678 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7f6c0682f0 msgr2=0x7f7f6c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.028+0000 7f7f8f1ad700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7f6c0682f0 0x7f7f6c06a7a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7f880708d0 tx=0x7f7f7c007000 comp rx=0 tx=0).stop 2023-03-03T06:25:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.028+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/2128718678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f880b0c40 msgr2=0x7f7f880c3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.028+0000 7f7f8f1ad700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f880b0c40 0x7f7f880c3830 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7f74011aa0 tx=0x7f7f74011e60 comp rx=0 tx=0).stop 2023-03-03T06:25:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.028+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/2128718678 shutdown_connections 2023-03-03T06:25:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.028+0000 7f7f8f1ad700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f8806b200 0x7f7f880c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.028+0000 7f7f8f1ad700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7f6c0682f0 0x7f7f6c06a7a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.028+0000 7f7f8f1ad700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f8806ae30 0x7f7f880b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.028+0000 7f7f8f1ad700 1 --2- 172.21.15.5:0/2128718678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f880b0c40 0x7f7f880c3830 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.028+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/2128718678 >> 172.21.15.5:0/2128718678 conn(0x7f7f880cfd00 msgr2=0x7f7f880cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.028+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/2128718678 shutdown_connections 2023-03-03T06:25:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.028+0000 7f7f8f1ad700 1 -- 172.21.15.5:0/2128718678 wait complete. 2023-03-03T06:25:44.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-03-03T06:25:44.168 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.166+0000 7f4547fe7700 1 Processor -- start 2023-03-03T06:25:44.169 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.166+0000 7f4547fe7700 1 -- start start 2023-03-03T06:25:44.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.167+0000 7f4547fe7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45400cbae0 0x7f45400b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:44.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.167+0000 7f4547fe7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454015f2a0 con 0x7f45400b41e0 2023-03-03T06:25:44.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.167+0000 7f4547fe7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45400cf550 con 0x7f45400cb710 2023-03-03T06:25:44.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.167+0000 7f4547fe7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45400cd820 con 0x7f45400cbae0 2023-03-03T06:25:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.167+0000 7f4545582700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f45400cbae0 0x7f45400b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.167+0000 7f4546584700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f45400b41e0 0x7f454015e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34928/0 (socket says 172.21.15.5:34928) 2023-03-03T06:25:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.167+0000 7f4546584700 1 -- 172.21.15.5:0/3664600049 learned_addr learned my addr 172.21.15.5:0/3664600049 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.168+0000 7f4545582700 1 -- 172.21.15.5:0/3664600049 >> v1:172.21.15.191:6789/0 conn(0x7f45400cb710 legacy=0x7f45400cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.168+0000 7f4545582700 1 -- 172.21.15.5:0/3664600049 >> v1:172.21.15.5:6789/0 conn(0x7f45400b41e0 legacy=0x7f454015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.168+0000 7f4545582700 1 -- 172.21.15.5:0/3664600049 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45400b45f0 con 0x7f45400cbae0 2023-03-03T06:25:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.168+0000 7f4544d81700 1 -- 172.21.15.5:0/3664600049 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873420293 0 0) 0x7f454015f2a0 con 0x7f45400b41e0 2023-03-03T06:25:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.168+0000 7f4545582700 1 --2- 172.21.15.5:0/3664600049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45400cbae0 0x7f45400b3ca0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4530009840 tx=0x7f4530009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70be0a7dd68660c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.168+0000 7f4544d81700 1 -- 172.21.15.5:0/3664600049 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530011830 con 0x7f45400cbae0 2023-03-03T06:25:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.168+0000 7f4544d81700 1 -- 172.21.15.5:0/3664600049 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4530011990 con 0x7f45400cbae0 2023-03-03T06:25:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.168+0000 7f4544d81700 1 -- 172.21.15.5:0/3664600049 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530011d20 con 0x7f45400cbae0 2023-03-03T06:25:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.168+0000 7f4547fe7700 1 -- 172.21.15.5:0/3664600049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45400cbae0 msgr2=0x7f45400b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.168+0000 7f4547fe7700 1 --2- 172.21.15.5:0/3664600049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45400cbae0 0x7f45400b3ca0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4530009840 tx=0x7f4530009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.169+0000 7f4547fe7700 1 -- 172.21.15.5:0/3664600049 shutdown_connections 2023-03-03T06:25:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.169+0000 7f4547fe7700 1 --2- 172.21.15.5:0/3664600049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45400cbae0 0x7f45400b3ca0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.169+0000 7f4547fe7700 1 -- 172.21.15.5:0/3664600049 >> 172.21.15.5:0/3664600049 conn(0x7f4540070050 msgr2=0x7f4540070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.169+0000 7f4547fe7700 1 -- 172.21.15.5:0/3664600049 shutdown_connections 2023-03-03T06:25:44.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.169+0000 7f4547fe7700 1 -- 172.21.15.5:0/3664600049 wait complete. 2023-03-03T06:25:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.170+0000 7f4547fe7700 1 Processor -- start 2023-03-03T06:25:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.170+0000 7f4547fe7700 1 -- start start 2023-03-03T06:25:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4547fe7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f45400b41e0 0x7f45401f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:44.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4547fe7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45400cb710 0x7f45401f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4547fe7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45400cbae0 0x7f45400c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4547fe7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4540159e50 con 0x7f45400cbae0 2023-03-03T06:25:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4547fe7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400b30f0 con 0x7f45400cb710 2023-03-03T06:25:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4547fe7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45401f6530 con 0x7f45400b41e0 2023-03-03T06:25:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4546584700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45400cbae0 0x7f45400c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:44.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4546584700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45400cbae0 0x7f45400c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45092/0 (socket says 172.21.15.5:45092) 2023-03-03T06:25:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4546584700 1 -- 172.21.15.5:0/969250207 learned_addr learned my addr 172.21.15.5:0/969250207 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4545582700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45400cb710 0x7f45401f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4545d83700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f45400b41e0 0x7f45401f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4546584700 1 -- 172.21.15.5:0/969250207 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f45400b41e0 msgr2=0x7f45401f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4546584700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f45400b41e0 0x7f45401f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4546584700 1 -- 172.21.15.5:0/969250207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45400cb710 msgr2=0x7f45401f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4546584700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45400cb710 0x7f45401f1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4546584700 1 -- 172.21.15.5:0/969250207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45300094a0 con 0x7f45400cbae0 2023-03-03T06:25:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4545582700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45400cb710 0x7f45401f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4546584700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45400cbae0 0x7f45400c9700 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4538002230 tx=0x7f453800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f45367fc700 1 -- 172.21.15.5:0/969250207 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453800ac20 con 0x7f45400cbae0 2023-03-03T06:25:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f45367fc700 1 -- 172.21.15.5:0/969250207 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453800ada0 con 0x7f45400cbae0 2023-03-03T06:25:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4547fe7700 1 -- 172.21.15.5:0/969250207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45400cef00 con 0x7f45400cbae0 2023-03-03T06:25:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f45367fc700 1 -- 172.21.15.5:0/969250207 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538007310 con 0x7f45400cbae0 2023-03-03T06:25:44.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.171+0000 7f4547fe7700 1 -- 172.21.15.5:0/969250207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454015efc0 con 0x7f45400cbae0 2023-03-03T06:25:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.172+0000 7f4547fe7700 1 -- 172.21.15.5:0/969250207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45400cf1e0 con 0x7f45400cbae0 2023-03-03T06:25:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.173+0000 7f45367fc700 1 -- 172.21.15.5:0/969250207 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f453801a030 con 0x7f45400cbae0 2023-03-03T06:25:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.173+0000 7f45367fc700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f45240682f0 0x7f452406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.173+0000 7f45367fc700 1 -- 172.21.15.5:0/969250207 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4538085cf0 con 0x7f45400cbae0 2023-03-03T06:25:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.173+0000 7f4545d83700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f45240682f0 0x7f452406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.174+0000 7f4545d83700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f45240682f0 0x7f452406a7a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f453c000f60 tx=0x7f453c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.177+0000 7f45367fc700 1 -- 172.21.15.5:0/969250207 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f45380522b0 con 0x7f45400cbae0 2023-03-03T06:25:44.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.420+0000 7f4547fe7700 1 -- 172.21.15.5:0/969250207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f454004e6e0 con 0x7f45400cbae0 2023-03-03T06:25:44.565 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T06:25:44.563+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-03-03T06:25:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.570+0000 7f45367fc700 1 -- 172.21.15.5:0/969250207 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4538018090 con 0x7f45400cbae0 2023-03-03T06:25:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.572+0000 7f4547fe7700 1 -- 172.21.15.5:0/969250207 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f45240682f0 msgr2=0x7f452406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.572+0000 7f4547fe7700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f45240682f0 0x7f452406a7a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f453c000f60 tx=0x7f453c009040 comp rx=0 tx=0).stop 2023-03-03T06:25:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.572+0000 7f4547fe7700 1 -- 172.21.15.5:0/969250207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45400cbae0 msgr2=0x7f45400c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.572+0000 7f4547fe7700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45400cbae0 0x7f45400c9700 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4538002230 tx=0x7f453800a060 comp rx=0 tx=0).stop 2023-03-03T06:25:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.572+0000 7f4547fe7700 1 -- 172.21.15.5:0/969250207 shutdown_connections 2023-03-03T06:25:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.572+0000 7f4547fe7700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45400cbae0 0x7f45400c9700 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.572+0000 7f4547fe7700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f45240682f0 0x7f452406a7a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.575 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.572+0000 7f4547fe7700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f45400b41e0 0x7f45401f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.572+0000 7f4547fe7700 1 --2- 172.21.15.5:0/969250207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45400cb710 0x7f45401f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.572+0000 7f4547fe7700 1 -- 172.21.15.5:0/969250207 >> 172.21.15.5:0/969250207 conn(0x7f4540070050 msgr2=0x7f45400afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:44.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.572+0000 7f4547fe7700 1 -- 172.21.15.5:0/969250207 shutdown_connections 2023-03-03T06:25:44.576 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.572+0000 7f4547fe7700 1 -- 172.21.15.5:0/969250207 wait complete. 2023-03-03T06:25:44.576 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-03-03T06:25:44.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-03-03T06:25:44.604 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-03-03T06:25:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.713+0000 7f62ec887700 1 Processor -- start 2023-03-03T06:25:44.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.713+0000 7f62ec887700 1 -- start start 2023-03-03T06:25:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62ec887700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62e815a7b0 0x7f62e815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62ec887700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62e806b700 0x7f62e806bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62ec887700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e80cf380 con 0x7f62e80cde30 2023-03-03T06:25:44.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62ec887700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e806c080 con 0x7f62e815a7b0 2023-03-03T06:25:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62ec887700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80cf5c0 con 0x7f62e806b700 2023-03-03T06:25:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62e659c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62e815a7b0 0x7f62e815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62e5d9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f62e80cde30 0x7f62e80cec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34938/0 (socket says 172.21.15.5:34938) 2023-03-03T06:25:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62e5d9b700 1 -- 172.21.15.5:0/2158974595 learned_addr learned my addr 172.21.15.5:0/2158974595 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62e6d9d700 1 --2- 172.21.15.5:0/2158974595 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62e806b700 0x7f62e806bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62e659c700 1 -- 172.21.15.5:0/2158974595 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62e806b700 msgr2=0x7f62e806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:44.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62e659c700 1 --2- 172.21.15.5:0/2158974595 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62e806b700 0x7f62e806bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62e659c700 1 -- 172.21.15.5:0/2158974595 >> v1:172.21.15.5:6789/0 conn(0x7f62e80cde30 legacy=0x7f62e80cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62e659c700 1 -- 172.21.15.5:0/2158974595 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e80cf8a0 con 0x7f62e815a7b0 2023-03-03T06:25:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62e559a700 1 -- 172.21.15.5:0/2158974595 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148304559 0 0) 0x7f62dc001110 con 0x7f62e80cde30 2023-03-03T06:25:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.714+0000 7f62e659c700 1 --2- 172.21.15.5:0/2158974595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e815a7b0 0x7f62e815ab80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009840 tx=0x7f62d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1c514a9dca45c3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.715+0000 7f62e559a700 1 -- 172.21.15.5:0/2158974595 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8011830 con 0x7f62e815a7b0 2023-03-03T06:25:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.715+0000 7f62e559a700 1 -- 172.21.15.5:0/2158974595 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d8011990 con 0x7f62e815a7b0 2023-03-03T06:25:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.715+0000 7f62e559a700 1 -- 172.21.15.5:0/2158974595 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8011d20 con 0x7f62e815a7b0 2023-03-03T06:25:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.715+0000 7f62ec887700 1 -- 172.21.15.5:0/2158974595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e815a7b0 msgr2=0x7f62e815ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.715+0000 7f62ec887700 1 --2- 172.21.15.5:0/2158974595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e815a7b0 0x7f62e815ab80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009840 tx=0x7f62d8009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.715+0000 7f62ec887700 1 -- 172.21.15.5:0/2158974595 shutdown_connections 2023-03-03T06:25:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.715+0000 7f62ec887700 1 --2- 172.21.15.5:0/2158974595 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62e806b700 0x7f62e806bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.715+0000 7f62ec887700 1 --2- 172.21.15.5:0/2158974595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e815a7b0 0x7f62e815ab80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.715+0000 7f62ec887700 1 -- 172.21.15.5:0/2158974595 >> 172.21.15.5:0/2158974595 conn(0x7f62e80cc8d0 msgr2=0x7f62e80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.715+0000 7f62ec887700 1 -- 172.21.15.5:0/2158974595 shutdown_connections 2023-03-03T06:25:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.715+0000 7f62ec887700 1 -- 172.21.15.5:0/2158974595 wait complete. 2023-03-03T06:25:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.717+0000 7f62ec887700 1 Processor -- start 2023-03-03T06:25:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.717+0000 7f62ec887700 1 -- start start 2023-03-03T06:25:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.717+0000 7f62ec887700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e806b700 0x7f62e815d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.717+0000 7f62ec887700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62e80cde30 0x7f62e81f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.717+0000 7f62ec887700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e815a7b0 0x7f62e8158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.717+0000 7f62ec887700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80cc500 con 0x7f62e815a7b0 2023-03-03T06:25:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.717+0000 7f62ec887700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80ca5b0 con 0x7f62e806b700 2023-03-03T06:25:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.717+0000 7f62ec887700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80ca890 con 0x7f62e80cde30 2023-03-03T06:25:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62e6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e815a7b0 0x7f62e8158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62e6d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e815a7b0 0x7f62e8158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45106/0 (socket says 172.21.15.5:45106) 2023-03-03T06:25:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62e6d9d700 1 -- 172.21.15.5:0/1352266872 learned_addr learned my addr 172.21.15.5:0/1352266872 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62e5d9b700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62e80cde30 0x7f62e81f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:44.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62e659c700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e806b700 0x7f62e815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62e6d9d700 1 -- 172.21.15.5:0/1352266872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62e80cde30 msgr2=0x7f62e81f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62e6d9d700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62e80cde30 0x7f62e81f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62e6d9d700 1 -- 172.21.15.5:0/1352266872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e806b700 msgr2=0x7f62e815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62e6d9d700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e806b700 0x7f62e815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62e6d9d700 1 -- 172.21.15.5:0/1352266872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d80094a0 con 0x7f62e815a7b0 2023-03-03T06:25:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62e659c700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e806b700 0x7f62e815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62e6d9d700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e815a7b0 0x7f62e8158f50 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f62e0007e40 tx=0x7f62e000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62d6ffd700 1 -- 172.21.15.5:0/1352266872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e000eea0 con 0x7f62e815a7b0 2023-03-03T06:25:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62d6ffd700 1 -- 172.21.15.5:0/1352266872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e0014420 con 0x7f62e815a7b0 2023-03-03T06:25:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62ec887700 1 -- 172.21.15.5:0/1352266872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e80b2d40 con 0x7f62e815a7b0 2023-03-03T06:25:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62d6ffd700 1 -- 172.21.15.5:0/1352266872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e00147b0 con 0x7f62e815a7b0 2023-03-03T06:25:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.718+0000 7f62ec887700 1 -- 172.21.15.5:0/1352266872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e80cfb80 con 0x7f62e815a7b0 2023-03-03T06:25:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.719+0000 7f62ec887700 1 -- 172.21.15.5:0/1352266872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e80b3020 con 0x7f62e815a7b0 2023-03-03T06:25:44.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.720+0000 7f62d6ffd700 1 -- 172.21.15.5:0/1352266872 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f62e0012050 con 0x7f62e815a7b0 2023-03-03T06:25:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.720+0000 7f62d6ffd700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f62c80682f0 0x7f62c806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.720+0000 7f62d6ffd700 1 -- 172.21.15.5:0/1352266872 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f62e0086730 con 0x7f62e815a7b0 2023-03-03T06:25:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.720+0000 7f62e659c700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f62c80682f0 0x7f62c806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.721+0000 7f62e659c700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f62c80682f0 0x7f62c806a7a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f62d80090b0 tx=0x7f62d8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:44.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.724+0000 7f62d6ffd700 1 -- 172.21.15.5:0/1352266872 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f62e0052c10 con 0x7f62e815a7b0 2023-03-03T06:25:44.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:44.960+0000 7f62ec887700 1 -- 172.21.15.5:0/1352266872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f62e804e6e0 con 0x7f62e815a7b0 2023-03-03T06:25:45.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.571+0000 7f62d6ffd700 1 -- 172.21.15.5:0/1352266872 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f62e0056230 con 0x7f62e815a7b0 2023-03-03T06:25:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.574+0000 7f62ec887700 1 -- 172.21.15.5:0/1352266872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f62c80682f0 msgr2=0x7f62c806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.574+0000 7f62ec887700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f62c80682f0 0x7f62c806a7a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f62d80090b0 tx=0x7f62d8008030 comp rx=0 tx=0).stop 2023-03-03T06:25:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.574+0000 7f62ec887700 1 -- 172.21.15.5:0/1352266872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e815a7b0 msgr2=0x7f62e8158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.574+0000 7f62ec887700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e815a7b0 0x7f62e8158f50 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f62e0007e40 tx=0x7f62e000e3c0 comp rx=0 tx=0).stop 2023-03-03T06:25:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.575+0000 7f62ec887700 1 -- 172.21.15.5:0/1352266872 shutdown_connections 2023-03-03T06:25:45.577 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.575+0000 7f62ec887700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e815a7b0 0x7f62e8158f50 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.575+0000 7f62ec887700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62e806b700 0x7f62e815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.575+0000 7f62ec887700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f62c80682f0 0x7f62c806a7a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.575+0000 7f62ec887700 1 --2- 172.21.15.5:0/1352266872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62e80cde30 0x7f62e81f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.575+0000 7f62ec887700 1 -- 172.21.15.5:0/1352266872 >> 172.21.15.5:0/1352266872 conn(0x7f62e80cc8d0 msgr2=0x7f62e80ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.575+0000 7f62ec887700 1 -- 172.21.15.5:0/1352266872 shutdown_connections 2023-03-03T06:25:45.578 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.575+0000 7f62ec887700 1 -- 172.21.15.5:0/1352266872 wait complete. 2023-03-03T06:25:45.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-03-03T06:25:45.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.726+0000 7fa809d9a700 1 Processor -- start 2023-03-03T06:25:45.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.726+0000 7fa809d9a700 1 -- start start 2023-03-03T06:25:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.727+0000 7fa809d9a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040cfcd0 0x7fa8040ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:45.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.727+0000 7fa809d9a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8040b3bb0 con 0x7fa80406cb40 2023-03-03T06:25:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.727+0000 7fa809d9a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8040cd960 con 0x7fa8040cebd0 2023-03-03T06:25:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.727+0000 7fa809d9a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80406d080 con 0x7fa8040cfcd0 2023-03-03T06:25:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.727+0000 7fa803fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa80406cb40 0x7fa804159450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34956/0 (socket says 172.21.15.5:34956) 2023-03-03T06:25:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.727+0000 7fa803fff700 1 -- 172.21.15.5:0/3027616812 learned_addr learned my addr 172.21.15.5:0/3027616812 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.727+0000 7fa8037fe700 1 --2- 172.21.15.5:0/3027616812 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040cfcd0 0x7fa8040ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.727+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541113397 0 0) 0x7fa8040b3bb0 con 0x7fa80406cb40 2023-03-03T06:25:45.732 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.727+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f00035b0 con 0x7fa80406cb40 2023-03-03T06:25:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3685117327 0 0) 0x7fa7f00035b0 con 0x7fa80406cb40 2023-03-03T06:25:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040cfcd0 msgr2=0x7fa8040ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8027fc700 1 --2- 172.21.15.5:0/3027616812 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040cfcd0 0x7fa8040ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 >> v1:172.21.15.191:6789/0 conn(0x7fa8040cebd0 legacy=0x7fa80406c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8040cdbb0 con 0x7fa80406cb40 2023-03-03T06:25:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fa7fc0019f0 con 0x7fa80406cb40 2023-03-03T06:25:45.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 >> v1:172.21.15.5:6789/0 conn(0x7fa80406cb40 legacy=0x7fa804159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8027fc700 1 --2- 172.21.15.5:0/3027616812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7f0003a30 0x7fa7f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8027fc700 1 --2- 172.21.15.5:0/3027616812 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040cfcd0 0x7fa7f0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8027fc700 1 --2- 172.21.15.5:0/3027616812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f0004d90 0x7fa7f0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80406d080 con 0x7fa7f0004d90 2023-03-03T06:25:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f000bb20 con 0x7fa7f0003a30 2023-03-03T06:25:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f000def0 con 0x7fa8040cfcd0 2023-03-03T06:25:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa803fff700 1 --2- 172.21.15.5:0/3027616812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f0004d90 0x7fa7f0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:45.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa8037fe700 1 --2- 172.21.15.5:0/3027616812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7f0003a30 0x7fa7f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa802ffd700 1 --2- 172.21.15.5:0/3027616812 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040cfcd0 0x7fa7f0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa803fff700 1 -- 172.21.15.5:0/3027616812 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040cfcd0 msgr2=0x7fa7f0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa803fff700 1 --2- 172.21.15.5:0/3027616812 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040cfcd0 0x7fa7f0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa803fff700 1 -- 172.21.15.5:0/3027616812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7f0003a30 msgr2=0x7fa7f0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa803fff700 1 --2- 172.21.15.5:0/3027616812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7f0003a30 0x7fa7f0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa803fff700 1 -- 172.21.15.5:0/3027616812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f00035b0 con 0x7fa7f0004d90 2023-03-03T06:25:45.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa802ffd700 1 --2- 172.21.15.5:0/3027616812 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040cfcd0 0x7fa7f0004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.728+0000 7fa803fff700 1 --2- 172.21.15.5:0/3027616812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f0004d90 0x7fa7f0005200 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00a830 tx=0x7fa7f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c3adc962811f5b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.729+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc012600 con 0x7fa7f0004d90 2023-03-03T06:25:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.729+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc012780 con 0x7fa7f0004d90 2023-03-03T06:25:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.729+0000 7fa8027fc700 1 -- 172.21.15.5:0/3027616812 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc012b30 con 0x7fa7f0004d90 2023-03-03T06:25:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.729+0000 7fa809d9a700 1 -- 172.21.15.5:0/3027616812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f0004d90 msgr2=0x7fa7f0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.729+0000 7fa809d9a700 1 --2- 172.21.15.5:0/3027616812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7f0004d90 0x7fa7f0005200 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00a830 tx=0x7fa7f0005880 comp rx=0 tx=0).stop 2023-03-03T06:25:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.729+0000 7fa803fff700 1 -- 172.21.15.5:0/3027616812 reap_dead start 2023-03-03T06:25:45.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.729+0000 7fa809d9a700 1 -- 172.21.15.5:0/3027616812 shutdown_connections 2023-03-03T06:25:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.729+0000 7fa809d9a700 1 -- 172.21.15.5:0/3027616812 >> 172.21.15.5:0/3027616812 conn(0x7fa8040b2ce0 msgr2=0x7fa8040b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.729+0000 7fa809d9a700 1 -- 172.21.15.5:0/3027616812 shutdown_connections 2023-03-03T06:25:45.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.729+0000 7fa809d9a700 1 -- 172.21.15.5:0/3027616812 wait complete. 2023-03-03T06:25:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.731+0000 7fa809d9a700 1 Processor -- start 2023-03-03T06:25:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.731+0000 7fa809d9a700 1 -- start start 2023-03-03T06:25:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa809d9a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8041543e0 0x7fa8040c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:45.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa809d9a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8040c4000 0x7fa8040adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa809d9a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040ae1b0 0x7fa8040aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa809d9a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c50a0 con 0x7fa8041543e0 2023-03-03T06:25:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa809d9a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c4490 con 0x7fa8040c4000 2023-03-03T06:25:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa809d9a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c4770 con 0x7fa8040ae1b0 2023-03-03T06:25:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa8037fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8041543e0 0x7fa8040c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa8037fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8041543e0 0x7fa8040c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45122/0 (socket says 172.21.15.5:45122) 2023-03-03T06:25:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa8037fe700 1 -- 172.21.15.5:0/816644032 learned_addr learned my addr 172.21.15.5:0/816644032 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:45.740 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa802ffd700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8040c4000 0x7fa8040adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa8037fe700 1 -- 172.21.15.5:0/816644032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040ae1b0 msgr2=0x7fa8040aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa803fff700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040ae1b0 0x7fa8040aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa8037fe700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040ae1b0 0x7fa8040aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa8037fe700 1 -- 172.21.15.5:0/816644032 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8040c4000 msgr2=0x7fa8040adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa8037fe700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8040c4000 0x7fa8040adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa8037fe700 1 -- 172.21.15.5:0/816644032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8040ce170 con 0x7fa8041543e0 2023-03-03T06:25:45.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.732+0000 7fa802ffd700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8040c4000 0x7fa8040adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.733+0000 7fa8037fe700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8041543e0 0x7fa8040c5530 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40119a0 tx=0x7fa7f4011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.733+0000 7fa7fbfff700 1 -- 172.21.15.5:0/816644032 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400f940 con 0x7fa8041543e0 2023-03-03T06:25:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.733+0000 7fa7fbfff700 1 -- 172.21.15.5:0/816644032 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f400faa0 con 0x7fa8041543e0 2023-03-03T06:25:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.733+0000 7fa809d9a700 1 -- 172.21.15.5:0/816644032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8040cde90 con 0x7fa8041543e0 2023-03-03T06:25:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.733+0000 7fa7fbfff700 1 -- 172.21.15.5:0/816644032 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400fe30 con 0x7fa8041543e0 2023-03-03T06:25:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.733+0000 7fa809d9a700 1 -- 172.21.15.5:0/816644032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa804159b60 con 0x7fa8041543e0 2023-03-03T06:25:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.734+0000 7fa809d9a700 1 -- 172.21.15.5:0/816644032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80404e6e0 con 0x7fa8041543e0 2023-03-03T06:25:45.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.734+0000 7fa7fbfff700 1 -- 172.21.15.5:0/816644032 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa7f4014440 con 0x7fa8041543e0 2023-03-03T06:25:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.735+0000 7fa7fbfff700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa7e40682f0 0x7fa7e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.735+0000 7fa7fbfff700 1 -- 172.21.15.5:0/816644032 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6821+0+0 (secure 0 0 0) 0x7fa7f4086810 con 0x7fa8041543e0 2023-03-03T06:25:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.735+0000 7fa802ffd700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa7e40682f0 0x7fa7e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.735+0000 7fa802ffd700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa7e40682f0 0x7fa7e406a7a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa8040ae9b0 tx=0x7fa7ec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:45.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.739+0000 7fa7fbfff700 1 -- 172.21.15.5:0/816644032 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa7f4052d10 con 0x7fa8041543e0 2023-03-03T06:25:45.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:45.930+0000 7fa809d9a700 1 -- 172.21.15.5:0/816644032 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa8040b4130 con 0x7fa8041543e0 2023-03-03T06:25:46.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.624+0000 7fa7fbfff700 1 -- 172.21.15.5:0/816644032 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa7f4056330 con 0x7fa8041543e0 2023-03-03T06:25:46.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.627+0000 7fa809d9a700 1 -- 172.21.15.5:0/816644032 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa7e40682f0 msgr2=0x7fa7e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:46.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.627+0000 7fa809d9a700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa7e40682f0 0x7fa7e406a7a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa8040ae9b0 tx=0x7fa7ec009040 comp rx=0 tx=0).stop 2023-03-03T06:25:46.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.627+0000 7fa809d9a700 1 -- 172.21.15.5:0/816644032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8041543e0 msgr2=0x7fa8040c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:46.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.627+0000 7fa809d9a700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8041543e0 0x7fa8040c5530 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40119a0 tx=0x7fa7f4011d60 comp rx=0 tx=0).stop 2023-03-03T06:25:46.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.627+0000 7fa809d9a700 1 -- 172.21.15.5:0/816644032 shutdown_connections 2023-03-03T06:25:46.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.627+0000 7fa809d9a700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa7e40682f0 0x7fa7e406a7a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:46.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.627+0000 7fa809d9a700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa8040ae1b0 0x7fa8040aed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:46.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.627+0000 7fa809d9a700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8041543e0 0x7fa8040c5530 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:46.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.627+0000 7fa809d9a700 1 --2- 172.21.15.5:0/816644032 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa8040c4000 0x7fa8040adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:46.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.627+0000 7fa809d9a700 1 -- 172.21.15.5:0/816644032 >> 172.21.15.5:0/816644032 conn(0x7fa8040b2ce0 msgr2=0x7fa80406e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:46.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.627+0000 7fa809d9a700 1 -- 172.21.15.5:0/816644032 shutdown_connections 2023-03-03T06:25:46.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.627+0000 7fa809d9a700 1 -- 172.21.15.5:0/816644032 wait complete. 2023-03-03T06:25:46.631 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-03-03T06:25:46.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-03-03T06:25:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.782+0000 7fa97473e700 1 Processor -- start 2023-03-03T06:25:46.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.782+0000 7fa97473e700 1 -- start start 2023-03-03T06:25:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa97473e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa96c15a530 0x7fa96c15a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa97473e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa96c0cb690 0x7fa96c15e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa97473e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96c06e1b0 con 0x7fa96c15ae40 2023-03-03T06:25:46.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa97473e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96c15e410 con 0x7fa96c0cb690 2023-03-03T06:25:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa97473e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c15b3a0 con 0x7fa96c15a530 2023-03-03T06:25:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa971cd9700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa96c15ae40 0x7fa96c0c9db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34972/0 (socket says 172.21.15.5:34972) 2023-03-03T06:25:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa971cd9700 1 -- 172.21.15.5:0/3321290235 learned_addr learned my addr 172.21.15.5:0/3321290235 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107837729 0 0) 0x7fa96c06e1b0 con 0x7fa96c15ae40 2023-03-03T06:25:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa972cdb700 1 --2- 172.21.15.5:0/3321290235 >> v2:172.21.15.191:3300/0 conn(0x7fa96c0cb690 0x7fa96c15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9580035b0 con 0x7fa96c15ae40 2023-03-03T06:25:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9724da700 1 --2- 172.21.15.5:0/3321290235 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa96c15a530 0x7fa96c15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:46.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4043064522 0 0) 0x7fa9580035b0 con 0x7fa96c15ae40 2023-03-03T06:25:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa96c15a530 msgr2=0x7fa96c15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 --2- 172.21.15.5:0/3321290235 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa96c15a530 0x7fa96c15a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 >> v2:172.21.15.191:3300/0 conn(0x7fa96c0cb690 msgr2=0x7fa96c15e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 --2- 172.21.15.5:0/3321290235 >> v2:172.21.15.191:3300/0 conn(0x7fa96c0cb690 0x7fa96c15e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c15b680 con 0x7fa96c15ae40 2023-03-03T06:25:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fa95c001670 con 0x7fa96c15ae40 2023-03-03T06:25:46.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 >> v1:172.21.15.5:6789/0 conn(0x7fa96c15ae40 legacy=0x7fa96c0c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 --2- 172.21.15.5:0/3321290235 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa96c15a530 0x7fa958003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 --2- 172.21.15.5:0/3321290235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa958003f80 0x7fa958004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 --2- 172.21.15.5:0/3321290235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa958004d90 0x7fa958005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c15e410 con 0x7fa958004d90 2023-03-03T06:25:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c15b3a0 con 0x7fa958003f80 2023-03-03T06:25:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.783+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95800ba10 con 0x7fa96c15a530 2023-03-03T06:25:46.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.784+0000 7fa972cdb700 1 --2- 172.21.15.5:0/3321290235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa958004d90 0x7fa958005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:46.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.784+0000 7fa9724da700 1 --2- 172.21.15.5:0/3321290235 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa96c15a530 0x7fa958003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:46.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.784+0000 7fa971cd9700 1 --2- 172.21.15.5:0/3321290235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa958003f80 0x7fa958004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:46.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.784+0000 7fa972cdb700 1 -- 172.21.15.5:0/3321290235 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa96c15a530 msgr2=0x7fa958003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:46.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.784+0000 7fa972cdb700 1 --2- 172.21.15.5:0/3321290235 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa96c15a530 0x7fa958003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:46.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.784+0000 7fa972cdb700 1 -- 172.21.15.5:0/3321290235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa958003f80 msgr2=0x7fa958004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:46.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.784+0000 7fa972cdb700 1 --2- 172.21.15.5:0/3321290235 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa958003f80 0x7fa958004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:46.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.784+0000 7fa972cdb700 1 -- 172.21.15.5:0/3321290235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9580035b0 con 0x7fa958004d90 2023-03-03T06:25:46.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.784+0000 7fa972cdb700 1 --2- 172.21.15.5:0/3321290235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa958004d90 0x7fa958005200 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa964009fc0 tx=0x7fa958005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b13c314908a90e9 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:46.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.784+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96400ec30 con 0x7fa958004d90 2023-03-03T06:25:46.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.784+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96400f040 con 0x7fa958004d90 2023-03-03T06:25:46.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.784+0000 7fa9714d8700 1 -- 172.21.15.5:0/3321290235 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964014480 con 0x7fa958004d90 2023-03-03T06:25:46.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.785+0000 7fa97473e700 1 -- 172.21.15.5:0/3321290235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa958004d90 msgr2=0x7fa958005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:46.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.785+0000 7fa97473e700 1 --2- 172.21.15.5:0/3321290235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa958004d90 0x7fa958005200 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa964009fc0 tx=0x7fa958005880 comp rx=0 tx=0).stop 2023-03-03T06:25:46.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.785+0000 7fa972cdb700 1 -- 172.21.15.5:0/3321290235 reap_dead start 2023-03-03T06:25:46.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.785+0000 7fa97473e700 1 -- 172.21.15.5:0/3321290235 shutdown_connections 2023-03-03T06:25:46.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.785+0000 7fa97473e700 1 -- 172.21.15.5:0/3321290235 >> 172.21.15.5:0/3321290235 conn(0x7fa96c0b1bd0 msgr2=0x7fa96c0cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:46.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.785+0000 7fa97473e700 1 -- 172.21.15.5:0/3321290235 shutdown_connections 2023-03-03T06:25:46.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.785+0000 7fa97473e700 1 -- 172.21.15.5:0/3321290235 wait complete. 2023-03-03T06:25:46.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.786+0000 7fa97473e700 1 Processor -- start 2023-03-03T06:25:46.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.787+0000 7fa97473e700 1 -- start start 2023-03-03T06:25:46.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.787+0000 7fa97473e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa958004d90 0x7fa96c1f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:46.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.787+0000 7fa97473e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa96c0c6500 0x7fa96c1efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa97473e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa96c1eff50 0x7fa96c0b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa97473e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c1f12c0 con 0x7fa96c0c6500 2023-03-03T06:25:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa97473e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c0c6aa0 con 0x7fa96c1eff50 2023-03-03T06:25:46.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa97473e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c0c6d80 con 0x7fa958004d90 2023-03-03T06:25:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa971cd9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa96c0c6500 0x7fa96c1efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa971cd9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa96c0c6500 0x7fa96c1efa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45144/0 (socket says 172.21.15.5:45144) 2023-03-03T06:25:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa971cd9700 1 -- 172.21.15.5:0/2309726144 learned_addr learned my addr 172.21.15.5:0/2309726144 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:46.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa9724da700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa958004d90 0x7fa96c1f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa971cd9700 1 -- 172.21.15.5:0/2309726144 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa958004d90 msgr2=0x7fa96c1f0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa971cd9700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa958004d90 0x7fa96c1f0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa972cdb700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa96c1eff50 0x7fa96c0b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:46.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa971cd9700 1 -- 172.21.15.5:0/2309726144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa96c1eff50 msgr2=0x7fa96c0b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa971cd9700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa96c1eff50 0x7fa96c0b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa971cd9700 1 -- 172.21.15.5:0/2309726144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c0ca4c0 con 0x7fa96c0c6500 2023-03-03T06:25:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa972cdb700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa96c1eff50 0x7fa96c0b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa971cd9700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa96c0c6500 0x7fa96c1efa10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0017a0 tx=0x7fa95c0076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa962ffd700 1 -- 172.21.15.5:0/2309726144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c007ca0 con 0x7fa96c0c6500 2023-03-03T06:25:46.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa962ffd700 1 -- 172.21.15.5:0/2309726144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c00f8d0 con 0x7fa96c0c6500 2023-03-03T06:25:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa97473e700 1 -- 172.21.15.5:0/2309726144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96c15b960 con 0x7fa96c0c6500 2023-03-03T06:25:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa962ffd700 1 -- 172.21.15.5:0/2309726144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c00fc80 con 0x7fa96c0c6500 2023-03-03T06:25:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.788+0000 7fa97473e700 1 -- 172.21.15.5:0/2309726144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96c15a900 con 0x7fa96c0c6500 2023-03-03T06:25:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.789+0000 7fa97473e700 1 -- 172.21.15.5:0/2309726144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96c04e6e0 con 0x7fa96c0c6500 2023-03-03T06:25:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.790+0000 7fa962ffd700 1 -- 172.21.15.5:0/2309726144 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa95c01d460 con 0x7fa96c0c6500 2023-03-03T06:25:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.790+0000 7fa962ffd700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9500682f0 0x7fa95006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:46.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.790+0000 7fa962ffd700 1 -- 172.21.15.5:0/2309726144 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6383+0+0 (secure 0 0 0) 0x7fa95c086060 con 0x7fa96c0c6500 2023-03-03T06:25:46.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.790+0000 7fa9724da700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9500682f0 0x7fa95006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:46.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.790+0000 7fa9724da700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9500682f0 0x7fa95006a7a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0714d0 tx=0x7fa968008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:46.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.794+0000 7fa962ffd700 1 -- 172.21.15.5:0/2309726144 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa95c0527d0 con 0x7fa96c0c6500 2023-03-03T06:25:46.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:46.990+0000 7fa97473e700 1 -- 172.21.15.5:0/2309726144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa96c0b2260 con 0x7fa96c0c6500 2023-03-03T06:25:47.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:25:47.434 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:25:47.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.630+0000 7fa962ffd700 1 -- 172.21.15.5:0/2309726144 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa96c0b2260 con 0x7fa96c0c6500 2023-03-03T06:25:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.634+0000 7fa97473e700 1 -- 172.21.15.5:0/2309726144 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9500682f0 msgr2=0x7fa95006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:47.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.634+0000 7fa97473e700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9500682f0 0x7fa95006a7a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0714d0 tx=0x7fa968008040 comp rx=0 tx=0).stop 2023-03-03T06:25:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.634+0000 7fa97473e700 1 -- 172.21.15.5:0/2309726144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa96c0c6500 msgr2=0x7fa96c1efa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.634+0000 7fa97473e700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa96c0c6500 0x7fa96c1efa10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0017a0 tx=0x7fa95c0076a0 comp rx=0 tx=0).stop 2023-03-03T06:25:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.634+0000 7fa97473e700 1 -- 172.21.15.5:0/2309726144 shutdown_connections 2023-03-03T06:25:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.634+0000 7fa97473e700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa96c1eff50 0x7fa96c0b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.634+0000 7fa97473e700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa9500682f0 0x7fa95006a7a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:47.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.634+0000 7fa97473e700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa958004d90 0x7fa96c1f0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:47.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.634+0000 7fa97473e700 1 --2- 172.21.15.5:0/2309726144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa96c0c6500 0x7fa96c1efa10 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:47.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.634+0000 7fa97473e700 1 -- 172.21.15.5:0/2309726144 >> 172.21.15.5:0/2309726144 conn(0x7fa96c0b1bd0 msgr2=0x7fa96c15bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:47.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.634+0000 7fa97473e700 1 -- 172.21.15.5:0/2309726144 shutdown_connections 2023-03-03T06:25:47.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.635+0000 7fa97473e700 1 -- 172.21.15.5:0/2309726144 wait complete. 2023-03-03T06:25:47.639 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-03-03T06:25:47.652 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-03-03T06:25:47.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.793+0000 7f0c19b10700 1 Processor -- start 2023-03-03T06:25:47.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.793+0000 7f0c19b10700 1 -- start start 2023-03-03T06:25:47.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.793+0000 7f0c19b10700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c1415a460 0x7f0c140cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:47.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.793+0000 7f0c19b10700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0c140cdf70 0x7f0c140cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.793+0000 7f0c19b10700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c140cd650 con 0x7f0c1415a830 2023-03-03T06:25:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.793+0000 7f0c19b10700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c140cb4a0 con 0x7f0c140cdf70 2023-03-03T06:25:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.793+0000 7f0c19b10700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140d16a0 con 0x7f0c1415a460 2023-03-03T06:25:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.794+0000 7f0c137fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c1415a460 0x7f0c140cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.794+0000 7f0c13fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0c140cdf70 0x7f0c140cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.794+0000 7f0c13fff700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0c140cdf70 0x7f0c140cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:45514/0 (socket says 172.21.15.5:45514) 2023-03-03T06:25:47.798 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.794+0000 7f0c137fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c1415a460 0x7f0c140cd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:43228/0 (socket says 172.21.15.5:43228) 2023-03-03T06:25:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.794+0000 7f0c13fff700 1 -- 172.21.15.5:0/949646941 learned_addr learned my addr 172.21.15.5:0/949646941 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.794+0000 7f0c137fe700 1 -- 172.21.15.5:0/949646941 >> v2:172.21.15.191:3300/0 conn(0x7f0c140cdf70 msgr2=0x7f0c140cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.794+0000 7f0c137fe700 1 --2- 172.21.15.5:0/949646941 >> v2:172.21.15.191:3300/0 conn(0x7f0c140cdf70 0x7f0c140cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.794+0000 7f0c137fe700 1 -- 172.21.15.5:0/949646941 >> v1:172.21.15.191:6789/0 conn(0x7f0c1415a830 legacy=0x7f0c140cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.794+0000 7f0c127fc700 1 -- 172.21.15.5:0/949646941 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916749628 0 0) 0x7f0c140cd650 con 0x7f0c1415a830 2023-03-03T06:25:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.794+0000 7f0c137fe700 1 -- 172.21.15.5:0/949646941 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c140cbc70 con 0x7f0c1415a460 2023-03-03T06:25:47.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.794+0000 7f0c13fff700 1 --2- 172.21.15.5:0/949646941 >> v2:172.21.15.191:3300/0 conn(0x7f0c140cdf70 0x7f0c140cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.795+0000 7f0c137fe700 1 --2- 172.21.15.5:0/949646941 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c1415a460 0x7f0c140cd110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009840 tx=0x7f0c04009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e687a5848cec6467 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.795+0000 7f0c127fc700 1 -- 172.21.15.5:0/949646941 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04011830 con 0x7f0c1415a460 2023-03-03T06:25:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.795+0000 7f0c127fc700 1 -- 172.21.15.5:0/949646941 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c04011990 con 0x7f0c1415a460 2023-03-03T06:25:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.795+0000 7f0c127fc700 1 -- 172.21.15.5:0/949646941 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04011d20 con 0x7f0c1415a460 2023-03-03T06:25:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.795+0000 7f0c19b10700 1 -- 172.21.15.5:0/949646941 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c1415a460 msgr2=0x7f0c140cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.795+0000 7f0c19b10700 1 --2- 172.21.15.5:0/949646941 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c1415a460 0x7f0c140cd110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009840 tx=0x7f0c04009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.795+0000 7f0c19b10700 1 -- 172.21.15.5:0/949646941 shutdown_connections 2023-03-03T06:25:47.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.795+0000 7f0c19b10700 1 --2- 172.21.15.5:0/949646941 >> v2:172.21.15.191:3300/0 conn(0x7f0c140cdf70 0x7f0c140cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.795+0000 7f0c19b10700 1 --2- 172.21.15.5:0/949646941 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c1415a460 0x7f0c140cd110 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.795+0000 7f0c19b10700 1 -- 172.21.15.5:0/949646941 >> 172.21.15.5:0/949646941 conn(0x7f0c1406f3c0 msgr2=0x7f0c1406f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.795+0000 7f0c19b10700 1 -- 172.21.15.5:0/949646941 shutdown_connections 2023-03-03T06:25:47.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.795+0000 7f0c19b10700 1 -- 172.21.15.5:0/949646941 wait complete. 2023-03-03T06:25:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.797+0000 7f0c19b10700 1 Processor -- start 2023-03-03T06:25:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.797+0000 7f0c19b10700 1 -- start start 2023-03-03T06:25:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.797+0000 7f0c19b10700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c140cdf70 0x7f0c141f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:47.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c19b10700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c1415a460 0x7f0c141ed760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c19b10700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c1415a830 0x7f0c140ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c19b10700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140c8b10 con 0x7f0c1415a830 2023-03-03T06:25:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c19b10700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140c7f20 con 0x7f0c1415a460 2023-03-03T06:25:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c19b10700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c140c8170 con 0x7f0c140cdf70 2023-03-03T06:25:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c13fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c1415a830 0x7f0c140ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c13fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c1415a830 0x7f0c140ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45160/0 (socket says 172.21.15.5:45160) 2023-03-03T06:25:47.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c13fff700 1 -- 172.21.15.5:0/2823129401 learned_addr learned my addr 172.21.15.5:0/2823129401 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c137fe700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c140cdf70 0x7f0c141f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c12ffd700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c1415a460 0x7f0c141ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c13fff700 1 -- 172.21.15.5:0/2823129401 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c140cdf70 msgr2=0x7f0c141f0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c13fff700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c140cdf70 0x7f0c141f0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c13fff700 1 -- 172.21.15.5:0/2823129401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c1415a460 msgr2=0x7f0c141ed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c13fff700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c1415a460 0x7f0c141ed760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:47.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c13fff700 1 -- 172.21.15.5:0/2823129401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c009b30 con 0x7f0c1415a830 2023-03-03T06:25:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c13fff700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c1415a830 0x7f0c140ca6c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00ef90 tx=0x7f0c0c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0bfbfff700 1 -- 172.21.15.5:0/2823129401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c003c20 con 0x7f0c1415a830 2023-03-03T06:25:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0bfbfff700 1 -- 172.21.15.5:0/2823129401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c00f040 con 0x7f0c1415a830 2023-03-03T06:25:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0bfbfff700 1 -- 172.21.15.5:0/2823129401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c00c9a0 con 0x7f0c1415a830 2023-03-03T06:25:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c19b10700 1 -- 172.21.15.5:0/2823129401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c040094a0 con 0x7f0c1415a830 2023-03-03T06:25:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.798+0000 7f0c19b10700 1 -- 172.21.15.5:0/2823129401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c140cb990 con 0x7f0c1415a830 2023-03-03T06:25:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.799+0000 7f0c19b10700 1 -- 172.21.15.5:0/2823129401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c140cb6b0 con 0x7f0c1415a830 2023-03-03T06:25:47.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.800+0000 7f0bfbfff700 1 -- 172.21.15.5:0/2823129401 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0c0c00cb00 con 0x7f0c1415a830 2023-03-03T06:25:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.800+0000 7f0bfbfff700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0c000682f0 0x7f0c0006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.800+0000 7f0bfbfff700 1 -- 172.21.15.5:0/2823129401 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f0c0c086240 con 0x7f0c1415a830 2023-03-03T06:25:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.800+0000 7f0c137fe700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0c000682f0 0x7f0c0006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.801+0000 7f0c137fe700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0c000682f0 0x7f0c0006a7a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c040090b0 tx=0x7f0c04008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:47.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:47.804+0000 7f0bfbfff700 1 -- 172.21.15.5:0/2823129401 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0c0c052af0 con 0x7f0c1415a830 2023-03-03T06:25:48.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.003+0000 7f0c19b10700 1 -- 172.21.15.5:0/2823129401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0c140d1940 con 0x7f0c1415a830 2023-03-03T06:25:48.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.006+0000 7f0bfbfff700 1 -- 172.21.15.5:0/2823129401 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0c0c056110 con 0x7f0c1415a830 2023-03-03T06:25:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.008+0000 7f0c19b10700 1 -- 172.21.15.5:0/2823129401 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0c000682f0 msgr2=0x7f0c0006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.008+0000 7f0c19b10700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0c000682f0 0x7f0c0006a7a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c040090b0 tx=0x7f0c04008030 comp rx=0 tx=0).stop 2023-03-03T06:25:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.008+0000 7f0c19b10700 1 -- 172.21.15.5:0/2823129401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c1415a830 msgr2=0x7f0c140ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.008+0000 7f0c19b10700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c1415a830 0x7f0c140ca6c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00ef90 tx=0x7f0c0c00c3a0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.009+0000 7f0c19b10700 1 -- 172.21.15.5:0/2823129401 shutdown_connections 2023-03-03T06:25:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.009+0000 7f0c19b10700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c1415a830 0x7f0c140ca6c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.009+0000 7f0c19b10700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0c000682f0 0x7f0c0006a7a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.009+0000 7f0c19b10700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0c140cdf70 0x7f0c141f0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.009+0000 7f0c19b10700 1 --2- 172.21.15.5:0/2823129401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c1415a460 0x7f0c141ed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.009+0000 7f0c19b10700 1 -- 172.21.15.5:0/2823129401 >> 172.21.15.5:0/2823129401 conn(0x7f0c1406f3c0 msgr2=0x7f0c140b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:48.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.009+0000 7f0c19b10700 1 -- 172.21.15.5:0/2823129401 shutdown_connections 2023-03-03T06:25:48.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.009+0000 7f0c19b10700 1 -- 172.21.15.5:0/2823129401 wait complete. 2023-03-03T06:25:48.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-03-03T06:25:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.145+0000 7f822d23a700 1 Processor -- start 2023-03-03T06:25:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.145+0000 7f822d23a700 1 -- start start 2023-03-03T06:25:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.146+0000 7f822d23a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f822806bc50 0x7f82280ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.146+0000 7f822d23a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82280cd7d0 con 0x7f822815a750 2023-03-03T06:25:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.146+0000 7f822d23a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82280cab70 con 0x7f82280cd360 2023-03-03T06:25:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.146+0000 7f822d23a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82280cc320 con 0x7f822806bc50 2023-03-03T06:25:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.146+0000 7f8226d9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f822815a750 0x7f82280cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35006/0 (socket says 172.21.15.5:35006) 2023-03-03T06:25:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.146+0000 7f8226d9d700 1 -- 172.21.15.5:0/4000985822 learned_addr learned my addr 172.21.15.5:0/4000985822 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.146+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709510403 0 0) 0x7f82280cd7d0 con 0x7f822815a750 2023-03-03T06:25:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.146+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82100035b0 con 0x7f822815a750 2023-03-03T06:25:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.146+0000 7f822759e700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f822806bc50 0x7f82280ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548097722 0 0) 0x7f82100035b0 con 0x7f822815a750 2023-03-03T06:25:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f822806bc50 msgr2=0x7f82280ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f822806bc50 0x7f82280ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 >> v1:172.21.15.191:6789/0 conn(0x7f82280cd360 legacy=0x7f822806b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82280cae50 con 0x7f822815a750 2023-03-03T06:25:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f821c001670 con 0x7f822815a750 2023-03-03T06:25:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 >> v1:172.21.15.5:6789/0 conn(0x7f822815a750 legacy=0x7f82280cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8210003aa0 0x7f8210003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f822806bc50 0x7f8210004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8210004d90 0x7f8210005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280cc320 con 0x7f8210004d90 2023-03-03T06:25:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821000bba0 con 0x7f8210003aa0 2023-03-03T06:25:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821000bd60 con 0x7f822806bc50 2023-03-03T06:25:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f822759e700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8210004d90 0x7f8210005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f822659c700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f822806bc50 0x7f8210004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8226d9d700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8210003aa0 0x7f8210003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f822759e700 1 -- 172.21.15.5:0/4000985822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f822806bc50 msgr2=0x7f8210004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f822759e700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f822806bc50 0x7f8210004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f822759e700 1 -- 172.21.15.5:0/4000985822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8210003aa0 msgr2=0x7f8210003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f822759e700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8210003aa0 0x7f8210003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f822759e700 1 -- 172.21.15.5:0/4000985822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82100035b0 con 0x7f8210004d90 2023-03-03T06:25:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f822659c700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f822806bc50 0x7f8210004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8226d9d700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8210003aa0 0x7f8210003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f822759e700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8210004d90 0x7f8210005200 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f822815f420 tx=0x7f8210005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0f2a9be931ed9e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822000ebd0 con 0x7f8210004d90 2023-03-03T06:25:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822000f040 con 0x7f8210004d90 2023-03-03T06:25:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.147+0000 7f8225d9b700 1 -- 172.21.15.5:0/4000985822 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220014480 con 0x7f8210004d90 2023-03-03T06:25:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.148+0000 7f822d23a700 1 -- 172.21.15.5:0/4000985822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8210004d90 msgr2=0x7f8210005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.148+0000 7f822d23a700 1 --2- 172.21.15.5:0/4000985822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8210004d90 0x7f8210005200 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f822815f420 tx=0x7f8210005880 comp rx=0 tx=0).stop 2023-03-03T06:25:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.148+0000 7f822759e700 1 -- 172.21.15.5:0/4000985822 reap_dead start 2023-03-03T06:25:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.148+0000 7f822d23a700 1 -- 172.21.15.5:0/4000985822 shutdown_connections 2023-03-03T06:25:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.148+0000 7f822d23a700 1 -- 172.21.15.5:0/4000985822 >> 172.21.15.5:0/4000985822 conn(0x7f822806ea70 msgr2=0x7f82280cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.148+0000 7f822d23a700 1 -- 172.21.15.5:0/4000985822 shutdown_connections 2023-03-03T06:25:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.148+0000 7f822d23a700 1 -- 172.21.15.5:0/4000985822 wait complete. 2023-03-03T06:25:48.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.150+0000 7f822d23a700 1 Processor -- start 2023-03-03T06:25:48.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.150+0000 7f822d23a700 1 -- start start 2023-03-03T06:25:48.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822d23a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8228153090 0x7f82280b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822d23a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8228153720 0x7f82280b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822d23a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82280b5370 0x7f82281f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822d23a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280b46d0 con 0x7f8228153720 2023-03-03T06:25:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822d23a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280b3630 con 0x7f82280b5370 2023-03-03T06:25:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822d23a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82280b3910 con 0x7f8228153090 2023-03-03T06:25:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8228153720 0x7f82280b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8228153720 0x7f82280b4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45178/0 (socket says 172.21.15.5:45178) 2023-03-03T06:25:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822659c700 1 -- 172.21.15.5:0/2234209152 learned_addr learned my addr 172.21.15.5:0/2234209152 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:48.160 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f8226d9d700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8228153090 0x7f82280b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:48.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822759e700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82280b5370 0x7f82281f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:48.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822659c700 1 -- 172.21.15.5:0/2234209152 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8228153090 msgr2=0x7f82280b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:48.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822659c700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8228153090 0x7f82280b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822659c700 1 -- 172.21.15.5:0/2234209152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82280b5370 msgr2=0x7f82281f32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:48.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822659c700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82280b5370 0x7f82281f32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.151+0000 7f822659c700 1 -- 172.21.15.5:0/2234209152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82280cb410 con 0x7f8228153720 2023-03-03T06:25:48.161 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.152+0000 7f822659c700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8228153720 0x7f82280b4e30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f821800e780 tx=0x7f821800eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.152+0000 7f820f7fe700 1 -- 172.21.15.5:0/2234209152 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82180052e0 con 0x7f8228153720 2023-03-03T06:25:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.152+0000 7f820f7fe700 1 -- 172.21.15.5:0/2234209152 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8218005440 con 0x7f8228153720 2023-03-03T06:25:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.152+0000 7f822d23a700 1 -- 172.21.15.5:0/2234209152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82280cb130 con 0x7f8228153720 2023-03-03T06:25:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.152+0000 7f820f7fe700 1 -- 172.21.15.5:0/2234209152 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218003880 con 0x7f8228153720 2023-03-03T06:25:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.152+0000 7f822d23a700 1 -- 172.21.15.5:0/2234209152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82280cb6f0 con 0x7f8228153720 2023-03-03T06:25:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.153+0000 7f822d23a700 1 -- 172.21.15.5:0/2234209152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82280b4520 con 0x7f8228153720 2023-03-03T06:25:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.153+0000 7f820f7fe700 1 -- 172.21.15.5:0/2234209152 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f821801b030 con 0x7f8228153720 2023-03-03T06:25:48.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.154+0000 7f820f7fe700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f82140682f0 0x7f821406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.154+0000 7f820f7fe700 1 -- 172.21.15.5:0/2234209152 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f8218085380 con 0x7f8228153720 2023-03-03T06:25:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.154+0000 7f8226d9d700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f82140682f0 0x7f821406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.154+0000 7f8226d9d700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f82140682f0 0x7f821406a7a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f821c0048d0 tx=0x7f821c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:48.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.158+0000 7f820f7fe700 1 -- 172.21.15.5:0/2234209152 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f821804d5e0 con 0x7f8228153720 2023-03-03T06:25:48.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.434+0000 7f822d23a700 1 -- 172.21.15.5:0/2234209152 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7f822804e6e0 con 0x7f8228153720 2023-03-03T06:25:48.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.631+0000 7f820f7fe700 1 -- 172.21.15.5:0/2234209152 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v141) v1 ==== 178+0+0 (secure 0 0 0) 0x7f8218051c60 con 0x7f8228153720 2023-03-03T06:25:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.634+0000 7f822d23a700 1 -- 172.21.15.5:0/2234209152 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f82140682f0 msgr2=0x7f821406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.634+0000 7f822d23a700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f82140682f0 0x7f821406a7a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f821c0048d0 tx=0x7f821c009040 comp rx=0 tx=0).stop 2023-03-03T06:25:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.634+0000 7f822d23a700 1 -- 172.21.15.5:0/2234209152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8228153720 msgr2=0x7f82280b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.634+0000 7f822d23a700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8228153720 0x7f82280b4e30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f821800e780 tx=0x7f821800eb40 comp rx=0 tx=0).stop 2023-03-03T06:25:48.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.634+0000 7f822d23a700 1 -- 172.21.15.5:0/2234209152 shutdown_connections 2023-03-03T06:25:48.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.634+0000 7f822d23a700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82280b5370 0x7f82281f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.634+0000 7f822d23a700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f82140682f0 0x7f821406a7a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.634+0000 7f822d23a700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8228153090 0x7f82280b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.634+0000 7f822d23a700 1 --2- 172.21.15.5:0/2234209152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8228153720 0x7f82280b4e30 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.634+0000 7f822d23a700 1 -- 172.21.15.5:0/2234209152 >> 172.21.15.5:0/2234209152 conn(0x7f822806ea70 msgr2=0x7f82280c7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:48.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.634+0000 7f822d23a700 1 -- 172.21.15.5:0/2234209152 shutdown_connections 2023-03-03T06:25:48.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.634+0000 7f822d23a700 1 -- 172.21.15.5:0/2234209152 wait complete. 2023-03-03T06:25:48.649 INFO:tasks.cephfs_test_runner:test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) ... ok 2023-03-03T06:25:48.649 INFO:tasks.cephfs_test_runner:Starting test: test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-03-03T06:25:48.650 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-03-03T06:25:48.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.774+0000 7f6292716700 1 Processor -- start 2023-03-03T06:25:48.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.774+0000 7f6292716700 1 -- start start 2023-03-03T06:25:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f6292716700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f628c15cd40 0x7f628c0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f6292716700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f628c0cba50 0x7f628c0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f6292716700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f628c0cd3e0 0x7f628c160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f6292716700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c15d4e0 con 0x7f628c0cba50 2023-03-03T06:25:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f6292716700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c15d7c0 con 0x7f628c0cd3e0 2023-03-03T06:25:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f6292716700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c15daa0 con 0x7f628c15cd40 2023-03-03T06:25:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f628b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f628c0cba50 0x7f628c0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f628b7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f628c0cba50 0x7f628c0b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45184/0 (socket says 172.21.15.5:45184) 2023-03-03T06:25:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f628b7fe700 1 -- 172.21.15.5:0/2416255351 learned_addr learned my addr 172.21.15.5:0/2416255351 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f628b7fe700 1 -- 172.21.15.5:0/2416255351 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f628c15cd40 msgr2=0x7f628c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:48.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f628b7fe700 1 --2- 172.21.15.5:0/2416255351 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f628c15cd40 0x7f628c0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f628b7fe700 1 -- 172.21.15.5:0/2416255351 >> v2:172.21.15.191:3300/0 conn(0x7f628c0cd3e0 msgr2=0x7f628c160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f628b7fe700 1 --2- 172.21.15.5:0/2416255351 >> v2:172.21.15.191:3300/0 conn(0x7f628c0cd3e0 0x7f628c160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f628b7fe700 1 -- 172.21.15.5:0/2416255351 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c15dd80 con 0x7f628c0cba50 2023-03-03T06:25:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.775+0000 7f628b7fe700 1 --2- 172.21.15.5:0/2416255351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628c0cba50 0x7f628c0b1e10 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f628c066b70 tx=0x7f627c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9403e5feca93c6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.776+0000 7f628affd700 1 -- 172.21.15.5:0/2416255351 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c005e30 con 0x7f628c0cba50 2023-03-03T06:25:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.776+0000 7f628affd700 1 -- 172.21.15.5:0/2416255351 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c004030 con 0x7f628c0cba50 2023-03-03T06:25:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.776+0000 7f628affd700 1 -- 172.21.15.5:0/2416255351 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c0043e0 con 0x7f628c0cba50 2023-03-03T06:25:48.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.776+0000 7f6292716700 1 -- 172.21.15.5:0/2416255351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628c0cba50 msgr2=0x7f628c0b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.776+0000 7f6292716700 1 --2- 172.21.15.5:0/2416255351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628c0cba50 0x7f628c0b1e10 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f628c066b70 tx=0x7f627c009bd0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.776+0000 7f6292716700 1 -- 172.21.15.5:0/2416255351 shutdown_connections 2023-03-03T06:25:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.776+0000 7f6292716700 1 --2- 172.21.15.5:0/2416255351 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f628c15cd40 0x7f628c0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.776+0000 7f6292716700 1 --2- 172.21.15.5:0/2416255351 >> v2:172.21.15.191:3300/0 conn(0x7f628c0cd3e0 0x7f628c160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.776+0000 7f6292716700 1 --2- 172.21.15.5:0/2416255351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628c0cba50 0x7f628c0b1e10 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.776+0000 7f6292716700 1 -- 172.21.15.5:0/2416255351 >> 172.21.15.5:0/2416255351 conn(0x7f628c0cc8d0 msgr2=0x7f628c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:48.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.776+0000 7f6292716700 1 -- 172.21.15.5:0/2416255351 shutdown_connections 2023-03-03T06:25:48.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.776+0000 7f6292716700 1 -- 172.21.15.5:0/2416255351 wait complete. 2023-03-03T06:25:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.777+0000 7f6292716700 1 Processor -- start 2023-03-03T06:25:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.778+0000 7f6292716700 1 -- start start 2023-03-03T06:25:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.778+0000 7f6292716700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628c0cba50 0x7f628c0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.778+0000 7f6292716700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f628c0cd3e0 0x7f628c14b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.778+0000 7f6292716700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f628c15cd40 0x7f628c06bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.778+0000 7f6292716700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0c6670 con 0x7f628c0cba50 2023-03-03T06:25:48.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.778+0000 7f6292716700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0c7bd0 con 0x7f628c0cd3e0 2023-03-03T06:25:48.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.778+0000 7f6292716700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0c7050 con 0x7f628c15cd40 2023-03-03T06:25:48.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.778+0000 7f628bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628c0cba50 0x7f628c0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:48.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f628bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628c0cba50 0x7f628c0c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45190/0 (socket says 172.21.15.5:45190) 2023-03-03T06:25:48.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f628bfff700 1 -- 172.21.15.5:0/1521687263 learned_addr learned my addr 172.21.15.5:0/1521687263 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:48.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f628b7fe700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f628c0cd3e0 0x7f628c14b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:48.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f6290cb3700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f628c15cd40 0x7f628c06bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:48.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f628bfff700 1 -- 172.21.15.5:0/1521687263 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f628c15cd40 msgr2=0x7f628c06bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f628bfff700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f628c15cd40 0x7f628c06bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f628bfff700 1 -- 172.21.15.5:0/1521687263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f628c0cd3e0 msgr2=0x7f628c14b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f628bfff700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f628c0cd3e0 0x7f628c14b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f628bfff700 1 -- 172.21.15.5:0/1521687263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c009500 con 0x7f628c0cba50 2023-03-03T06:25:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f628bfff700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628c0cba50 0x7f628c0c6130 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f628000b4a0 tx=0x7f628000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f6288ff9700 1 -- 172.21.15.5:0/1521687263 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6280011830 con 0x7f628c0cba50 2023-03-03T06:25:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f6288ff9700 1 -- 172.21.15.5:0/1521687263 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6280011990 con 0x7f628c0cba50 2023-03-03T06:25:48.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f6292716700 1 -- 172.21.15.5:0/1521687263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628c0ca530 con 0x7f628c0cba50 2023-03-03T06:25:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f6288ff9700 1 -- 172.21.15.5:0/1521687263 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6280011d40 con 0x7f628c0cba50 2023-03-03T06:25:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.779+0000 7f6292716700 1 -- 172.21.15.5:0/1521687263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628c15e060 con 0x7f628c0cba50 2023-03-03T06:25:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.780+0000 7f6292716700 1 -- 172.21.15.5:0/1521687263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628c15d110 con 0x7f628c0cba50 2023-03-03T06:25:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.781+0000 7f6288ff9700 1 -- 172.21.15.5:0/1521687263 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6280021070 con 0x7f628c0cba50 2023-03-03T06:25:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.781+0000 7f6288ff9700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f62780682f0 0x7f627806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.781+0000 7f6288ff9700 1 -- 172.21.15.5:0/1521687263 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f6280085ba0 con 0x7f628c0cba50 2023-03-03T06:25:48.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.781+0000 7f628b7fe700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f62780682f0 0x7f627806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:48.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.781+0000 7f628b7fe700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f62780682f0 0x7f627806a7a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f628c066b70 tx=0x7f627c008070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:48.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:48.785+0000 7f6288ff9700 1 -- 172.21.15.5:0/1521687263 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f62800523d0 con 0x7f628c0cba50 2023-03-03T06:25:49.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.057+0000 7f6292716700 1 -- 172.21.15.5:0/1521687263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7f628c04e6e0 con 0x7f628c0cba50 2023-03-03T06:25:49.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.637+0000 7f6288ff9700 1 -- 172.21.15.5:0/1521687263 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v142) v1 ==== 176+0+0 (secure 0 0 0) 0x7f6280015020 con 0x7f628c0cba50 2023-03-03T06:25:49.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.639+0000 7f6292716700 1 -- 172.21.15.5:0/1521687263 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f62780682f0 msgr2=0x7f627806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.639+0000 7f6292716700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f62780682f0 0x7f627806a7a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f628c066b70 tx=0x7f627c008070 comp rx=0 tx=0).stop 2023-03-03T06:25:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.639+0000 7f6292716700 1 -- 172.21.15.5:0/1521687263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628c0cba50 msgr2=0x7f628c0c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.639+0000 7f6292716700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628c0cba50 0x7f628c0c6130 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f628000b4a0 tx=0x7f628000b860 comp rx=0 tx=0).stop 2023-03-03T06:25:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.639+0000 7f6292716700 1 -- 172.21.15.5:0/1521687263 shutdown_connections 2023-03-03T06:25:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.639+0000 7f6292716700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f62780682f0 0x7f627806a7a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:49.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.639+0000 7f6292716700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f628c15cd40 0x7f628c06bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.639+0000 7f6292716700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f628c0cba50 0x7f628c0c6130 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.639+0000 7f6292716700 1 --2- 172.21.15.5:0/1521687263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f628c0cd3e0 0x7f628c14b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.639+0000 7f6292716700 1 -- 172.21.15.5:0/1521687263 >> 172.21.15.5:0/1521687263 conn(0x7f628c0cc8d0 msgr2=0x7f628c06b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.640+0000 7f6292716700 1 -- 172.21.15.5:0/1521687263 shutdown_connections 2023-03-03T06:25:49.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.640+0000 7f6292716700 1 -- 172.21.15.5:0/1521687263 wait complete. 2023-03-03T06:25:49.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-03-03T06:25:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.789+0000 7f5d40fed700 1 Processor -- start 2023-03-03T06:25:49.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.789+0000 7f5d40fed700 1 -- start start 2023-03-03T06:25:49.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.790+0000 7f5d40fed700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c15cd40 0x7f5d3c0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:49.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.790+0000 7f5d40fed700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5d3c0cd3e0 0x7f5d3c0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:49.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.790+0000 7f5d40fed700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3c15e160 con 0x7f5d3c0cb9d0 2023-03-03T06:25:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.790+0000 7f5d40fed700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3c0cd870 con 0x7f5d3c0cd3e0 2023-03-03T06:25:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.790+0000 7f5d40fed700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c15d110 con 0x7f5d3c15cd40 2023-03-03T06:25:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.790+0000 7f5d3a59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c15cd40 0x7f5d3c0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.790+0000 7f5d39d9b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5d3c0cd3e0 0x7f5d3c0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.790+0000 7f5d3a59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c15cd40 0x7f5d3c0b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:43276/0 (socket says 172.21.15.5:43276) 2023-03-03T06:25:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.790+0000 7f5d3a59c700 1 -- 172.21.15.5:0/3696603415 learned_addr learned my addr 172.21.15.5:0/3696603415 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:49.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.790+0000 7f5d3ad9d700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f5d3c0cb9d0 0x7f5d3c160720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:49572/0 (socket says 172.21.15.5:49572) 2023-03-03T06:25:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.791+0000 7f5d3a59c700 1 -- 172.21.15.5:0/3696603415 >> v2:172.21.15.191:3300/0 conn(0x7f5d3c0cd3e0 msgr2=0x7f5d3c0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.791+0000 7f5d3a59c700 1 --2- 172.21.15.5:0/3696603415 >> v2:172.21.15.191:3300/0 conn(0x7f5d3c0cd3e0 0x7f5d3c0b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.791+0000 7f5d3a59c700 1 -- 172.21.15.5:0/3696603415 >> v1:172.21.15.191:6789/0 conn(0x7f5d3c0cb9d0 legacy=0x7f5d3c160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.791+0000 7f5d3a59c700 1 -- 172.21.15.5:0/3696603415 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c15d3c0 con 0x7f5d3c15cd40 2023-03-03T06:25:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.791+0000 7f5d3a59c700 1 --2- 172.21.15.5:0/3696603415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c15cd40 0x7f5d3c0b18d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d300098f0 tx=0x7f5d30009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf95cf9daa8f0172 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.791+0000 7f5d3959a700 1 -- 172.21.15.5:0/3696603415 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30011830 con 0x7f5d3c15cd40 2023-03-03T06:25:49.795 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.791+0000 7f5d3959a700 1 -- 172.21.15.5:0/3696603415 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d30011990 con 0x7f5d3c15cd40 2023-03-03T06:25:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.791+0000 7f5d3959a700 1 -- 172.21.15.5:0/3696603415 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30011d20 con 0x7f5d3c15cd40 2023-03-03T06:25:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.792+0000 7f5d40fed700 1 -- 172.21.15.5:0/3696603415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c15cd40 msgr2=0x7f5d3c0b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.792+0000 7f5d40fed700 1 --2- 172.21.15.5:0/3696603415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c15cd40 0x7f5d3c0b18d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d300098f0 tx=0x7f5d30009c00 comp rx=0 tx=0).stop 2023-03-03T06:25:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.792+0000 7f5d40fed700 1 -- 172.21.15.5:0/3696603415 shutdown_connections 2023-03-03T06:25:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.792+0000 7f5d40fed700 1 --2- 172.21.15.5:0/3696603415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c15cd40 0x7f5d3c0b18d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.792+0000 7f5d40fed700 1 --2- 172.21.15.5:0/3696603415 >> v2:172.21.15.191:3300/0 conn(0x7f5d3c0cd3e0 0x7f5d3c0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:49.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.792+0000 7f5d40fed700 1 -- 172.21.15.5:0/3696603415 >> 172.21.15.5:0/3696603415 conn(0x7f5d3c0cc8d0 msgr2=0x7f5d3c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:49.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.792+0000 7f5d40fed700 1 -- 172.21.15.5:0/3696603415 shutdown_connections 2023-03-03T06:25:49.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.792+0000 7f5d40fed700 1 -- 172.21.15.5:0/3696603415 wait complete. 2023-03-03T06:25:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.793+0000 7f5d40fed700 1 Processor -- start 2023-03-03T06:25:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.793+0000 7f5d40fed700 1 -- start start 2023-03-03T06:25:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d40fed700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d3c0cb9d0 0x7f5d3c148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d40fed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c0cd3e0 0x7f5d3c147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:49.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d40fed700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c15cd40 0x7f5d3c0ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d40fed700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0af010 con 0x7f5d3c0cd3e0 2023-03-03T06:25:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d40fed700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0b4730 con 0x7f5d3c0cb9d0 2023-03-03T06:25:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d40fed700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0b3e00 con 0x7f5d3c15cd40 2023-03-03T06:25:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d39d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c0cd3e0 0x7f5d3c147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d39d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c0cd3e0 0x7f5d3c147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45206/0 (socket says 172.21.15.5:45206) 2023-03-03T06:25:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d39d9b700 1 -- 172.21.15.5:0/753919790 learned_addr learned my addr 172.21.15.5:0/753919790 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d3ad9d700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c15cd40 0x7f5d3c0ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:49.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d3a59c700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d3c0cb9d0 0x7f5d3c148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d39d9b700 1 -- 172.21.15.5:0/753919790 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c15cd40 msgr2=0x7f5d3c0ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d39d9b700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c15cd40 0x7f5d3c0ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d39d9b700 1 -- 172.21.15.5:0/753919790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d3c0cb9d0 msgr2=0x7f5d3c148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d39d9b700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d3c0cb9d0 0x7f5d3c148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d39d9b700 1 -- 172.21.15.5:0/753919790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d30009550 con 0x7f5d3c0cd3e0 2023-03-03T06:25:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.794+0000 7f5d3ad9d700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c15cd40 0x7f5d3c0ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:49.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.795+0000 7f5d39d9b700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c0cd3e0 0x7f5d3c147980 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00e870 tx=0x7f5d2c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:49.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.795+0000 7f5d2affd700 1 -- 172.21.15.5:0/753919790 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c009590 con 0x7f5d3c0cd3e0 2023-03-03T06:25:49.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.795+0000 7f5d2affd700 1 -- 172.21.15.5:0/753919790 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2c013680 con 0x7f5d3c0cd3e0 2023-03-03T06:25:49.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.795+0000 7f5d40fed700 1 -- 172.21.15.5:0/753919790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3c15d980 con 0x7f5d3c0cd3e0 2023-03-03T06:25:49.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.795+0000 7f5d2affd700 1 -- 172.21.15.5:0/753919790 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0139f0 con 0x7f5d3c0cd3e0 2023-03-03T06:25:49.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.795+0000 7f5d40fed700 1 -- 172.21.15.5:0/753919790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3c15d6a0 con 0x7f5d3c0cd3e0 2023-03-03T06:25:49.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.796+0000 7f5d40fed700 1 -- 172.21.15.5:0/753919790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3c15dc60 con 0x7f5d3c0cd3e0 2023-03-03T06:25:49.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.796+0000 7f5d2affd700 1 -- 172.21.15.5:0/753919790 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5d2c019030 con 0x7f5d3c0cd3e0 2023-03-03T06:25:49.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.797+0000 7f5d2affd700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d1c0682f0 0x7f5d1c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.797+0000 7f5d2affd700 1 -- 172.21.15.5:0/753919790 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f5d2c085ab0 con 0x7f5d3c0cd3e0 2023-03-03T06:25:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.797+0000 7f5d3a59c700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d1c0682f0 0x7f5d1c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.797+0000 7f5d3a59c700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d1c0682f0 0x7f5d1c06a7a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009c40 tx=0x7f5d30008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:49.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.801+0000 7f5d2affd700 1 -- 172.21.15.5:0/753919790 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5d2c052270 con 0x7f5d3c0cd3e0 2023-03-03T06:25:49.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.993+0000 7f5d40fed700 1 -- 172.21.15.5:0/753919790 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5d3c0b48a0 con 0x7f5d3c0cd3e0 2023-03-03T06:25:49.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.997+0000 7f5d2affd700 1 -- 172.21.15.5:0/753919790 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v15)=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5d2c055890 con 0x7f5d3c0cd3e0 2023-03-03T06:25:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.999+0000 7f5d40fed700 1 -- 172.21.15.5:0/753919790 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d1c0682f0 msgr2=0x7f5d1c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:50.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.999+0000 7f5d40fed700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d1c0682f0 0x7f5d1c06a7a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009c40 tx=0x7f5d30008030 comp rx=0 tx=0).stop 2023-03-03T06:25:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.999+0000 7f5d40fed700 1 -- 172.21.15.5:0/753919790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c0cd3e0 msgr2=0x7f5d3c147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.999+0000 7f5d40fed700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c0cd3e0 0x7f5d3c147980 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00e870 tx=0x7f5d2c00eb80 comp rx=0 tx=0).stop 2023-03-03T06:25:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.999+0000 7f5d40fed700 1 -- 172.21.15.5:0/753919790 shutdown_connections 2023-03-03T06:25:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.999+0000 7f5d40fed700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5d1c0682f0 0x7f5d1c06a7a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.999+0000 7f5d40fed700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d3c15cd40 0x7f5d3c0ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.999+0000 7f5d40fed700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d3c0cb9d0 0x7f5d3c148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.999+0000 7f5d40fed700 1 --2- 172.21.15.5:0/753919790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d3c0cd3e0 0x7f5d3c147980 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.999+0000 7f5d40fed700 1 -- 172.21.15.5:0/753919790 >> 172.21.15.5:0/753919790 conn(0x7f5d3c0cc8d0 msgr2=0x7f5d3c06b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.999+0000 7f5d40fed700 1 -- 172.21.15.5:0/753919790 shutdown_connections 2023-03-03T06:25:50.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:49.999+0000 7f5d40fed700 1 -- 172.21.15.5:0/753919790 wait complete. 2023-03-03T06:25:50.013 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-03-03T06:25:50.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:25:50.054 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:25:50.101 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-03-03T06:25:50.101 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:25:50.102 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:50.119 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287360k,nr_inodes=4071840,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19712 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-03-03T06:25:50.120 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:25:50.120 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:50.141 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-03-03T06:25:50.142 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:25:50.142 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:50.177 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287360k,nr_inodes=4071840,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19712 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-03-03T06:25:50.177 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:25:50.178 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:25:50.200 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-03-03T06:25:50.200 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-03-03T06:25:50.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.340+0000 7f5cab929700 1 Processor -- start 2023-03-03T06:25:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.340+0000 7f5cab929700 1 -- start start 2023-03-03T06:25:50.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5cab929700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ca415c980 0x7f5ca4160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5cab929700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ca406d1f0 0x7f5ca406b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5cab929700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca4160ea0 con 0x7f5ca406b860 2023-03-03T06:25:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5cab929700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca4161460 con 0x7f5ca406d1f0 2023-03-03T06:25:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5cab929700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4161180 con 0x7f5ca415c980 2023-03-03T06:25:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5ca8ec4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ca406d1f0 0x7f5ca406b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5ca8ec4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5ca406d1f0 0x7f5ca406b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45212/0 (socket says 172.21.15.5:45212) 2023-03-03T06:25:50.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5ca8ec4700 1 -- 172.21.15.5:0/1825724303 learned_addr learned my addr 172.21.15.5:0/1825724303 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5ca96c5700 1 --2- 172.21.15.5:0/1825724303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ca415c980 0x7f5ca4160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5ca8ec4700 1 -- 172.21.15.5:0/1825724303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ca415c980 msgr2=0x7f5ca4160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5ca8ec4700 1 --2- 172.21.15.5:0/1825724303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ca415c980 0x7f5ca4160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5ca8ec4700 1 -- 172.21.15.5:0/1825724303 >> v1:172.21.15.191:6789/0 conn(0x7f5ca406b860 legacy=0x7f5ca406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5ca8ec4700 1 -- 172.21.15.5:0/1825724303 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca40ce890 con 0x7f5ca406d1f0 2023-03-03T06:25:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5ca8ec4700 1 --2- 172.21.15.5:0/1825724303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca406d1f0 0x7f5ca406b320 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5c980098f0 tx=0x7f5c98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad97234884f51a6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:50.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5c97fff700 1 -- 172.21.15.5:0/1825724303 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800b8a0 con 0x7f5ca406d1f0 2023-03-03T06:25:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5c97fff700 1 -- 172.21.15.5:0/1825724303 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9800ba00 con 0x7f5ca406d1f0 2023-03-03T06:25:50.346 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.341+0000 7f5c97fff700 1 -- 172.21.15.5:0/1825724303 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800bd90 con 0x7f5ca406d1f0 2023-03-03T06:25:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.342+0000 7f5cab929700 1 -- 172.21.15.5:0/1825724303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca406d1f0 msgr2=0x7f5ca406b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.342+0000 7f5cab929700 1 --2- 172.21.15.5:0/1825724303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca406d1f0 0x7f5ca406b320 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5c980098f0 tx=0x7f5c98009c00 comp rx=0 tx=0).stop 2023-03-03T06:25:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.342+0000 7f5cab929700 1 -- 172.21.15.5:0/1825724303 shutdown_connections 2023-03-03T06:25:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.342+0000 7f5cab929700 1 --2- 172.21.15.5:0/1825724303 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ca415c980 0x7f5ca4160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.342+0000 7f5cab929700 1 --2- 172.21.15.5:0/1825724303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca406d1f0 0x7f5ca406b320 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.342+0000 7f5cab929700 1 -- 172.21.15.5:0/1825724303 >> 172.21.15.5:0/1825724303 conn(0x7f5ca40cfd00 msgr2=0x7f5ca40d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.342+0000 7f5cab929700 1 -- 172.21.15.5:0/1825724303 shutdown_connections 2023-03-03T06:25:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.342+0000 7f5cab929700 1 -- 172.21.15.5:0/1825724303 wait complete. 2023-03-03T06:25:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.343+0000 7f5cab929700 1 Processor -- start 2023-03-03T06:25:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.343+0000 7f5cab929700 1 -- start start 2023-03-03T06:25:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5cab929700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ca406b860 0x7f5ca4154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:50.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5cab929700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ca406d1f0 0x7f5ca40c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5cab929700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415c980 0x7f5ca41e7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5cab929700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40c8970 con 0x7f5ca415c980 2023-03-03T06:25:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5cab929700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca41547b0 con 0x7f5ca406b860 2023-03-03T06:25:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5cab929700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40c91a0 con 0x7f5ca406d1f0 2023-03-03T06:25:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5ca9ec6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415c980 0x7f5ca41e7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5ca9ec6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415c980 0x7f5ca41e7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45222/0 (socket says 172.21.15.5:45222) 2023-03-03T06:25:50.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5ca9ec6700 1 -- 172.21.15.5:0/2123785630 learned_addr learned my addr 172.21.15.5:0/2123785630 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5ca96c5700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ca406b860 0x7f5ca4154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5ca8ec4700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ca406d1f0 0x7f5ca40c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5ca9ec6700 1 -- 172.21.15.5:0/2123785630 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ca406d1f0 msgr2=0x7f5ca40c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5ca9ec6700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ca406d1f0 0x7f5ca40c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5ca9ec6700 1 -- 172.21.15.5:0/2123785630 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ca406b860 msgr2=0x7f5ca4154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5ca9ec6700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ca406b860 0x7f5ca4154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.344+0000 7f5ca9ec6700 1 -- 172.21.15.5:0/2123785630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c98009550 con 0x7f5ca415c980 2023-03-03T06:25:50.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.345+0000 7f5ca9ec6700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415c980 0x7f5ca41e7a60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00cb10 tx=0x7f5c9c00ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:50.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.345+0000 7f5c95ffb700 1 -- 172.21.15.5:0/2123785630 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c003c00 con 0x7f5ca415c980 2023-03-03T06:25:50.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.345+0000 7f5c95ffb700 1 -- 172.21.15.5:0/2123785630 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c003d60 con 0x7f5ca415c980 2023-03-03T06:25:50.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.345+0000 7f5c95ffb700 1 -- 172.21.15.5:0/2123785630 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00aa20 con 0x7f5ca415c980 2023-03-03T06:25:50.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.345+0000 7f5cab929700 1 -- 172.21.15.5:0/2123785630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca415cd50 con 0x7f5ca415c980 2023-03-03T06:25:50.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.345+0000 7f5cab929700 1 -- 172.21.15.5:0/2123785630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca40ceb70 con 0x7f5ca415c980 2023-03-03T06:25:50.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.346+0000 7f5cab929700 1 -- 172.21.15.5:0/2123785630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca4160a70 con 0x7f5ca415c980 2023-03-03T06:25:50.352 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.346+0000 7f5c95ffb700 1 -- 172.21.15.5:0/2123785630 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5c9c010050 con 0x7f5ca415c980 2023-03-03T06:25:50.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.346+0000 7f5c95ffb700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5c880682f0 0x7f5c8806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:50.353 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.347+0000 7f5c95ffb700 1 -- 172.21.15.5:0/2123785630 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f5c9c0859a0 con 0x7f5ca415c980 2023-03-03T06:25:50.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.347+0000 7f5ca96c5700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5c880682f0 0x7f5c8806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:50.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.347+0000 7f5ca96c5700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5c880682f0 0x7f5c8806a7a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40c9630 tx=0x7f5ca0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:50.354 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.351+0000 7f5c95ffb700 1 -- 172.21.15.5:0/2123785630 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5c9c052250 con 0x7f5ca415c980 2023-03-03T06:25:50.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.588+0000 7f5cab929700 1 -- 172.21.15.5:0/2123785630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ca404e6e0 con 0x7f5ca415c980 2023-03-03T06:25:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.589+0000 7f5c95ffb700 1 -- 172.21.15.5:0/2123785630 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f5c9c055870 con 0x7f5ca415c980 2023-03-03T06:25:50.591 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:50.591 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5138,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1328243693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":1328243693},{"type":"v1","addr":"172.21.15.191:6835","nonce":1328243693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5395,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/2339980581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2339980581},{"type":"v1","addr":"172.21.15.5:6836","nonce":2339980581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/620202132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":620202132},{"type":"v1","addr":"172.21.15.5:6837","nonce":620202132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/664219121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":664219121},{"type":"v1","addr":"172.21.15.191:6834","nonce":664219121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-03-03T06:25:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.591+0000 7f5cab929700 1 -- 172.21.15.5:0/2123785630 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5c880682f0 msgr2=0x7f5c8806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.591+0000 7f5cab929700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5c880682f0 0x7f5c8806a7a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40c9630 tx=0x7f5ca0008040 comp rx=0 tx=0).stop 2023-03-03T06:25:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.591+0000 7f5cab929700 1 -- 172.21.15.5:0/2123785630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415c980 msgr2=0x7f5ca41e7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.591+0000 7f5cab929700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415c980 0x7f5ca41e7a60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00cb10 tx=0x7f5c9c00ce20 comp rx=0 tx=0).stop 2023-03-03T06:25:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.591+0000 7f5cab929700 1 -- 172.21.15.5:0/2123785630 shutdown_connections 2023-03-03T06:25:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.591+0000 7f5cab929700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ca415c980 0x7f5ca41e7a60 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.591+0000 7f5cab929700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ca406b860 0x7f5ca4154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.591+0000 7f5cab929700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5c880682f0 0x7f5c8806a7a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.591+0000 7f5cab929700 1 --2- 172.21.15.5:0/2123785630 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ca406d1f0 0x7f5ca40c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.591+0000 7f5cab929700 1 -- 172.21.15.5:0/2123785630 >> 172.21.15.5:0/2123785630 conn(0x7f5ca40cfd00 msgr2=0x7f5ca406ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:50.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.591+0000 7f5cab929700 1 -- 172.21.15.5:0/2123785630 shutdown_connections 2023-03-03T06:25:50.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.591+0000 7f5cab929700 1 -- 172.21.15.5:0/2123785630 wait complete. 2023-03-03T06:25:50.595 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2023-03-03T06:25:50.605 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-03T06:25:50.606 INFO:tasks.ceph.mds.a:Stopping old one... 2023-03-03T06:25:50.606 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-03-03T06:25:50.606 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:25:50.606 INFO:tasks.ceph.mds.c:Restarting daemon 2023-03-03T06:25:50.607 INFO:tasks.ceph.mds.c:Stopping old one... 2023-03-03T06:25:50.607 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-03-03T06:25:50.607 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:25:50.607 INFO:tasks.ceph.mds.b:Restarting daemon 2023-03-03T06:25:50.607 INFO:tasks.ceph.mds.b:Stopping old one... 2023-03-03T06:25:50.608 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-03-03T06:25:50.608 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:25:50.608 INFO:tasks.ceph.mds.d:Restarting daemon 2023-03-03T06:25:50.608 INFO:tasks.ceph.mds.d:Stopping old one... 2023-03-03T06:25:50.609 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-03-03T06:25:50.609 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:25:50.615 INFO:tasks.ceph.mds.a:Stopped 2023-03-03T06:25:50.615 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-03T06:25:50.616 INFO:tasks.ceph.mds.c:Stopped 2023-03-03T06:25:50.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-03-03T06:25:50.619 INFO:tasks.ceph.mds.b:Stopped 2023-03-03T06:25:50.619 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-03-03T06:25:50.620 INFO:tasks.ceph.mds.d:Stopped 2023-03-03T06:25:50.621 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-03-03T06:25:50.658 INFO:tasks.ceph.mds.a:Started 2023-03-03T06:25:50.658 DEBUG:teuthology.parallel:result is None 2023-03-03T06:25:50.659 INFO:tasks.ceph.mds.c:Started 2023-03-03T06:25:50.659 DEBUG:teuthology.parallel:result is None 2023-03-03T06:25:50.662 INFO:tasks.ceph.mds.b:Started 2023-03-03T06:25:50.662 DEBUG:teuthology.parallel:result is None 2023-03-03T06:25:50.663 INFO:tasks.ceph.mds.d:Started 2023-03-03T06:25:50.664 DEBUG:teuthology.parallel:result is None 2023-03-03T06:25:50.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-03-03T06:25:50.740 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-03-03T06:25:50.740 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-03-03T06:25:50.746 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-03-03T06:25:50.746 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-03-03T06:25:50.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.799+0000 7f0679f19700 1 Processor -- start 2023-03-03T06:25:50.802 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.799+0000 7f0679f19700 1 -- start start 2023-03-03T06:25:50.803 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.800+0000 7f0679f19700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06740cb710 0x7f06740cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:50.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.800+0000 7f0679f19700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06740cff20 0x7f06740b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:50.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.800+0000 7f0679f19700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067415f2a0 con 0x7f06740cbae0 2023-03-03T06:25:50.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.800+0000 7f0679f19700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06740cd820 con 0x7f06740cb710 2023-03-03T06:25:50.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.800+0000 7f0679f19700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06740cf550 con 0x7f06740cff20 2023-03-03T06:25:50.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.800+0000 7f06737fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f06740cb710 0x7f06740cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:50.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.800+0000 7f0673fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f06740cbae0 0x7f067415e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35096/0 (socket says 172.21.15.5:35096) 2023-03-03T06:25:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.800+0000 7f0673fff700 1 -- 172.21.15.5:0/146348180 learned_addr learned my addr 172.21.15.5:0/146348180 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.801+0000 7f0672ffd700 1 --2- 172.21.15.5:0/146348180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06740cff20 0x7f06740b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.801+0000 7f06737fe700 1 -- 172.21.15.5:0/146348180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06740cff20 msgr2=0x7f06740b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.801+0000 7f06737fe700 1 --2- 172.21.15.5:0/146348180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06740cff20 0x7f06740b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.801+0000 7f06737fe700 1 -- 172.21.15.5:0/146348180 >> v1:172.21.15.5:6789/0 conn(0x7f06740cbae0 legacy=0x7f067415e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:50.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.801+0000 7f06737fe700 1 -- 172.21.15.5:0/146348180 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067415efc0 con 0x7f06740cb710 2023-03-03T06:25:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.801+0000 7f06727fc700 1 -- 172.21.15.5:0/146348180 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858939391 0 0) 0x7f067415f2a0 con 0x7f06740cbae0 2023-03-03T06:25:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.801+0000 7f0672ffd700 1 --2- 172.21.15.5:0/146348180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06740cff20 0x7f06740b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.801+0000 7f06737fe700 1 --2- 172.21.15.5:0/146348180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06740cb710 0x7f06740cf9e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0664009840 tx=0x7f0664009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81e36e62ed7a2c6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.801+0000 7f06727fc700 1 -- 172.21.15.5:0/146348180 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0664011830 con 0x7f06740cb710 2023-03-03T06:25:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.801+0000 7f06727fc700 1 -- 172.21.15.5:0/146348180 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0664011990 con 0x7f06740cb710 2023-03-03T06:25:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.801+0000 7f06727fc700 1 -- 172.21.15.5:0/146348180 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0664011d20 con 0x7f06740cb710 2023-03-03T06:25:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.802+0000 7f0679f19700 1 -- 172.21.15.5:0/146348180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06740cb710 msgr2=0x7f06740cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.802+0000 7f0679f19700 1 --2- 172.21.15.5:0/146348180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06740cb710 0x7f06740cf9e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0664009840 tx=0x7f0664009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.802+0000 7f0679f19700 1 -- 172.21.15.5:0/146348180 shutdown_connections 2023-03-03T06:25:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.802+0000 7f0679f19700 1 --2- 172.21.15.5:0/146348180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06740cb710 0x7f06740cf9e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.802+0000 7f0679f19700 1 --2- 172.21.15.5:0/146348180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06740cff20 0x7f06740b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.802+0000 7f0679f19700 1 -- 172.21.15.5:0/146348180 >> 172.21.15.5:0/146348180 conn(0x7f0674070050 msgr2=0x7f0674070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.802+0000 7f0679f19700 1 -- 172.21.15.5:0/146348180 shutdown_connections 2023-03-03T06:25:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.802+0000 7f0679f19700 1 -- 172.21.15.5:0/146348180 wait complete. 2023-03-03T06:25:50.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.803+0000 7f0679f19700 1 Processor -- start 2023-03-03T06:25:50.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.803+0000 7f0679f19700 1 -- start start 2023-03-03T06:25:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f0679f19700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06740cb710 0x7f0674146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f0679f19700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06740cbae0 0x7f067415ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f0679f19700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06740cff20 0x7f067415b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f0679f19700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0674148800 con 0x7f06740cb710 2023-03-03T06:25:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f0679f19700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06741466d0 con 0x7f06740cbae0 2023-03-03T06:25:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f0679f19700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0674147760 con 0x7f06740cff20 2023-03-03T06:25:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f06737fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06740cb710 0x7f0674146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f06737fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06740cb710 0x7f0674146190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45256/0 (socket says 172.21.15.5:45256) 2023-03-03T06:25:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f06737fe700 1 -- 172.21.15.5:0/360615730 learned_addr learned my addr 172.21.15.5:0/360615730 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f06737fe700 1 -- 172.21.15.5:0/360615730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06740cff20 msgr2=0x7f067415b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f06737fe700 1 --2- 172.21.15.5:0/360615730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06740cff20 0x7f067415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f06737fe700 1 -- 172.21.15.5:0/360615730 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06740cbae0 msgr2=0x7f067415ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:50.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f06737fe700 1 --2- 172.21.15.5:0/360615730 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06740cbae0 0x7f067415ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f06737fe700 1 -- 172.21.15.5:0/360615730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06640094a0 con 0x7f06740cb710 2023-03-03T06:25:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f06737fe700 1 --2- 172.21.15.5:0/360615730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06740cb710 0x7f0674146190 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0664014040 tx=0x7f0664004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.804+0000 7f065bfff700 1 -- 172.21.15.5:0/360615730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06640038a0 con 0x7f06740cb710 2023-03-03T06:25:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.805+0000 7f065bfff700 1 -- 172.21.15.5:0/360615730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066401e070 con 0x7f06740cb710 2023-03-03T06:25:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.805+0000 7f0679f19700 1 -- 172.21.15.5:0/360615730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06740cf1e0 con 0x7f06740cb710 2023-03-03T06:25:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.805+0000 7f065bfff700 1 -- 172.21.15.5:0/360615730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0664003c40 con 0x7f06740cb710 2023-03-03T06:25:50.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.805+0000 7f0679f19700 1 -- 172.21.15.5:0/360615730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06740cef00 con 0x7f06740cb710 2023-03-03T06:25:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.806+0000 7f0679f19700 1 -- 172.21.15.5:0/360615730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f067415eac0 con 0x7f06740cb710 2023-03-03T06:25:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.806+0000 7f065bfff700 1 -- 172.21.15.5:0/360615730 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f066400f050 con 0x7f06740cb710 2023-03-03T06:25:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.806+0000 7f065bfff700 1 --2- 172.21.15.5:0/360615730 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f06600682f0 0x7f066006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.806+0000 7f065bfff700 1 -- 172.21.15.5:0/360615730 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5969+0+0 (secure 0 0 0) 0x7f0664086e10 con 0x7f06740cb710 2023-03-03T06:25:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.806+0000 7f0672ffd700 1 --2- 172.21.15.5:0/360615730 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f06600682f0 0x7f066006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.807+0000 7f0672ffd700 1 --2- 172.21.15.5:0/360615730 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f06600682f0 0x7f066006a7a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f06740cfc20 tx=0x7f06680083d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:50.811+0000 7f065bfff700 1 -- 172.21.15.5:0/360615730 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f06640536c0 con 0x7f06740cb710 2023-03-03T06:25:51.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.022+0000 7f0679f19700 1 -- 172.21.15.5:0/360615730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f067404e6e0 con 0x7f06740cb710 2023-03-03T06:25:51.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.787+0000 7f065bfff700 1 -- 172.21.15.5:0/360615730 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v64) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0664020020 con 0x7f06740cb710 2023-03-03T06:25:51.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.790+0000 7f0679f19700 1 -- 172.21.15.5:0/360615730 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f06600682f0 msgr2=0x7f066006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:51.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.790+0000 7f0679f19700 1 --2- 172.21.15.5:0/360615730 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f06600682f0 0x7f066006a7a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f06740cfc20 tx=0x7f06680083d0 comp rx=0 tx=0).stop 2023-03-03T06:25:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.790+0000 7f0679f19700 1 -- 172.21.15.5:0/360615730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06740cb710 msgr2=0x7f0674146190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.790+0000 7f0679f19700 1 --2- 172.21.15.5:0/360615730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06740cb710 0x7f0674146190 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0664014040 tx=0x7f0664004750 comp rx=0 tx=0).stop 2023-03-03T06:25:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.790+0000 7f0679f19700 1 -- 172.21.15.5:0/360615730 shutdown_connections 2023-03-03T06:25:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.790+0000 7f0679f19700 1 --2- 172.21.15.5:0/360615730 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f06600682f0 0x7f066006a7a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.790+0000 7f0679f19700 1 --2- 172.21.15.5:0/360615730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f06740cff20 0x7f067415b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:51.793 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.790+0000 7f0679f19700 1 --2- 172.21.15.5:0/360615730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06740cb710 0x7f0674146190 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:51.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.790+0000 7f0679f19700 1 --2- 172.21.15.5:0/360615730 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06740cbae0 0x7f067415ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:51.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.790+0000 7f0679f19700 1 -- 172.21.15.5:0/360615730 >> 172.21.15.5:0/360615730 conn(0x7f0674070050 msgr2=0x7f067415a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:51.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.790+0000 7f0679f19700 1 -- 172.21.15.5:0/360615730 shutdown_connections 2023-03-03T06:25:51.794 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.790+0000 7f0679f19700 1 -- 172.21.15.5:0/360615730 wait complete. 2023-03-03T06:25:51.794 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-03-03T06:25:51.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-03-03T06:25:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.937+0000 7f60d78ef700 1 Processor -- start 2023-03-03T06:25:51.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.937+0000 7f60d78ef700 1 -- start start 2023-03-03T06:25:51.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d78ef700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f60d015cd40 0x7f60d00b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:51.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d78ef700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60d00cba50 0x7f60d00b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d78ef700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d00cd3e0 0x7f60d0160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d78ef700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d015d4e0 con 0x7f60d00cba50 2023-03-03T06:25:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d78ef700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d015d7c0 con 0x7f60d015cd40 2023-03-03T06:25:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d78ef700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d015daa0 con 0x7f60d00cd3e0 2023-03-03T06:25:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d4e8a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60d00cba50 0x7f60d00b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d4e8a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f60d00cba50 0x7f60d00b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45270/0 (socket says 172.21.15.5:45270) 2023-03-03T06:25:51.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d4e8a700 1 -- 172.21.15.5:0/914328819 learned_addr learned my addr 172.21.15.5:0/914328819 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:51.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d5e8c700 1 --2- 172.21.15.5:0/914328819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d00cd3e0 0x7f60d0160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:51.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d4e8a700 1 -- 172.21.15.5:0/914328819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d00cd3e0 msgr2=0x7f60d0160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:51.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d568b700 1 --2- 172.21.15.5:0/914328819 >> v2:172.21.15.191:3300/0 conn(0x7f60d015cd40 0x7f60d00b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:51.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d4e8a700 1 --2- 172.21.15.5:0/914328819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d00cd3e0 0x7f60d0160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:51.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d4e8a700 1 -- 172.21.15.5:0/914328819 >> v2:172.21.15.191:3300/0 conn(0x7f60d015cd40 msgr2=0x7f60d00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:51.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d4e8a700 1 --2- 172.21.15.5:0/914328819 >> v2:172.21.15.191:3300/0 conn(0x7f60d015cd40 0x7f60d00b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:51.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d4e8a700 1 -- 172.21.15.5:0/914328819 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d015dd80 con 0x7f60d00cba50 2023-03-03T06:25:51.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d5e8c700 1 --2- 172.21.15.5:0/914328819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d00cd3e0 0x7f60d0160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.938+0000 7f60d568b700 1 --2- 172.21.15.5:0/914328819 >> v2:172.21.15.191:3300/0 conn(0x7f60d015cd40 0x7f60d00b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.939+0000 7f60d4e8a700 1 --2- 172.21.15.5:0/914328819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d00cba50 0x7f60d00b1e10 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f60d0071020 tx=0x7f60cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67414d62437b367c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.939+0000 7f60c7fff700 1 -- 172.21.15.5:0/914328819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc005e30 con 0x7f60d00cba50 2023-03-03T06:25:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.939+0000 7f60c7fff700 1 -- 172.21.15.5:0/914328819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc004030 con 0x7f60d00cba50 2023-03-03T06:25:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.939+0000 7f60c7fff700 1 -- 172.21.15.5:0/914328819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc0043e0 con 0x7f60d00cba50 2023-03-03T06:25:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.939+0000 7f60d78ef700 1 -- 172.21.15.5:0/914328819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d00cba50 msgr2=0x7f60d00b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:51.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.939+0000 7f60d78ef700 1 --2- 172.21.15.5:0/914328819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d00cba50 0x7f60d00b1e10 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f60d0071020 tx=0x7f60cc009bd0 comp rx=0 tx=0).stop 2023-03-03T06:25:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.939+0000 7f60d78ef700 1 -- 172.21.15.5:0/914328819 shutdown_connections 2023-03-03T06:25:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.939+0000 7f60d78ef700 1 --2- 172.21.15.5:0/914328819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d00cd3e0 0x7f60d0160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.939+0000 7f60d78ef700 1 --2- 172.21.15.5:0/914328819 >> v2:172.21.15.191:3300/0 conn(0x7f60d015cd40 0x7f60d00b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.939+0000 7f60d78ef700 1 --2- 172.21.15.5:0/914328819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d00cba50 0x7f60d00b1e10 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.939+0000 7f60d78ef700 1 -- 172.21.15.5:0/914328819 >> 172.21.15.5:0/914328819 conn(0x7f60d00cc8d0 msgr2=0x7f60d00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.939+0000 7f60d78ef700 1 -- 172.21.15.5:0/914328819 shutdown_connections 2023-03-03T06:25:51.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.940+0000 7f60d78ef700 1 -- 172.21.15.5:0/914328819 wait complete. 2023-03-03T06:25:51.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.941+0000 7f60d78ef700 1 Processor -- start 2023-03-03T06:25:51.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.941+0000 7f60d78ef700 1 -- start start 2023-03-03T06:25:51.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.941+0000 7f60d78ef700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60d00cba50 0x7f60d01471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:51.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.941+0000 7f60d78ef700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d00cd3e0 0x7f60d00ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:51.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.941+0000 7f60d78ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d015cd40 0x7f60d00c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:51.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.941+0000 7f60d78ef700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d00ac2e0 con 0x7f60d015cd40 2023-03-03T06:25:51.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.941+0000 7f60d78ef700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d0154910 con 0x7f60d00cba50 2023-03-03T06:25:51.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.941+0000 7f60d78ef700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d00ac530 con 0x7f60d00cd3e0 2023-03-03T06:25:51.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60d5e8c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d015cd40 0x7f60d00c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60d5e8c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d015cd40 0x7f60d00c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45278/0 (socket says 172.21.15.5:45278) 2023-03-03T06:25:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60d5e8c700 1 -- 172.21.15.5:0/2254492835 learned_addr learned my addr 172.21.15.5:0/2254492835 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60d4e8a700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d00cd3e0 0x7f60d00ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60d568b700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60d00cba50 0x7f60d01471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60d5e8c700 1 -- 172.21.15.5:0/2254492835 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d00cd3e0 msgr2=0x7f60d00ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60d5e8c700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d00cd3e0 0x7f60d00ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:51.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60d5e8c700 1 -- 172.21.15.5:0/2254492835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60d00cba50 msgr2=0x7f60d01471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60d5e8c700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60d00cba50 0x7f60d01471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60d5e8c700 1 -- 172.21.15.5:0/2254492835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc009500 con 0x7f60d015cd40 2023-03-03T06:25:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60d5e8c700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d015cd40 0x7f60d00c8e00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f60c800cef0 tx=0x7f60c800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60c5ffb700 1 -- 172.21.15.5:0/2254492835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c800ac80 con 0x7f60d015cd40 2023-03-03T06:25:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60c5ffb700 1 -- 172.21.15.5:0/2254492835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c800ade0 con 0x7f60d015cd40 2023-03-03T06:25:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60c5ffb700 1 -- 172.21.15.5:0/2254492835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8015680 con 0x7f60d015cd40 2023-03-03T06:25:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.942+0000 7f60d78ef700 1 -- 172.21.15.5:0/2254492835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60d00ca530 con 0x7f60d015cd40 2023-03-03T06:25:51.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.943+0000 7f60d78ef700 1 -- 172.21.15.5:0/2254492835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d015e060 con 0x7f60d015cd40 2023-03-03T06:25:51.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.943+0000 7f60d78ef700 1 -- 172.21.15.5:0/2254492835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60d015d110 con 0x7f60d015cd40 2023-03-03T06:25:51.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.944+0000 7f60c5ffb700 1 -- 172.21.15.5:0/2254492835 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f60c801c030 con 0x7f60d015cd40 2023-03-03T06:25:51.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.944+0000 7f60c5ffb700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f60b4068320 0x7f60b406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:51.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.944+0000 7f60c5ffb700 1 -- 172.21.15.5:0/2254492835 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5883+0+0 (secure 0 0 0) 0x7f60c8085e90 con 0x7f60d015cd40 2023-03-03T06:25:51.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.944+0000 7f60d568b700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f60b4068320 0x7f60b406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:51.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.945+0000 7f60d568b700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f60b4068320 0x7f60b406a7d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f60c0006fd0 tx=0x7f60c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:51.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:51.948+0000 7f60c5ffb700 1 -- 172.21.15.5:0/2254492835 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f60c80527a0 con 0x7f60d015cd40 2023-03-03T06:25:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.220+0000 7f60d78ef700 1 -- 172.21.15.5:0/2254492835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f60d004e6e0 con 0x7f60d015cd40 2023-03-03T06:25:52.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.220+0000 7f60c5ffb700 1 -- 172.21.15.5:0/2254492835 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f60c801a020 con 0x7f60d015cd40 2023-03-03T06:25:52.223 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:52.223 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-03-03T06:25:52.223 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-03-03T06:25:52.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.223 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-03-03T06:25:52.223 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkziqmKRAARZXnnbV545/aKwJvt9QAgw==", 2023-03-03T06:25:52.224 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:52.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:25:52.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:25:52.224 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.224 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.225 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.225 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-03-03T06:25:52.225 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkYP9KNhAA/yyEBoBn/eJ8/6mufuiznQ==", 2023-03-03T06:25:52.225 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:52.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:25:52.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:25:52.226 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.226 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.226 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.226 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-03-03T06:25:52.226 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFk23MbMRAA1E6lR036GpHdLG9WAVzE2A==", 2023-03-03T06:25:52.226 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:52.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:25:52.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:25:52.227 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.227 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.227 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.227 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-03-03T06:25:52.228 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFkQYUSAhAAt9Hj4Yq5VW5NJENi11Gsag==", 2023-03-03T06:25:52.228 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:52.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:25:52.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:25:52.228 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.228 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.229 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-03-03T06:25:52.229 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7kgFkiS2tKRAAuYbICLnn3CQtdepNk9uG7Q==", 2023-03-03T06:25:52.229 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.229 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:52.229 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:52.230 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.230 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.230 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.230 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-03-03T06:25:52.230 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA+kgFkpDf4KBAA77yBycaKiSFdrCP9F0C5IA==", 2023-03-03T06:25:52.230 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.230 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:52.231 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:52.231 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.231 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.231 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.231 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-03-03T06:25:52.231 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBkgFk/OK7JxAAQFCaUo0b/+8gDkgP1Ifqwg==", 2023-03-03T06:25:52.232 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.232 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:52.232 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:52.232 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.232 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.232 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-03-03T06:25:52.233 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEkgFkhcBFJxAA3Q62rulwQRz9/VZeV938sg==", 2023-03-03T06:25:52.233 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.233 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:52.233 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:52.233 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.233 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.234 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-03-03T06:25:52.234 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKkgFkHSO9KBAATkFiqiMet/gmDP9rNTozLA==", 2023-03-03T06:25:52.234 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.234 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:52.234 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:52.234 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.235 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.235 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-03-03T06:25:52.235 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBNkgFkOUmVJxAA4gVwSp2IhnyXKPt+72wXOw==", 2023-03-03T06:25:52.235 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.235 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:52.236 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:52.236 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.236 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.236 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-03-03T06:25:52.236 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBQkgFkBHsSJxAA0kN0Sob1BvksDKPj4e/yTA==", 2023-03-03T06:25:52.237 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.237 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:52.237 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:52.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.237 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.238 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-03-03T06:25:52.238 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBTkgFkusR5JhAAsvEY2m5hImRjdFSqtEFVBw==", 2023-03-03T06:25:52.238 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.238 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:25:52.239 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:25:52.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.239 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.239 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-03-03T06:25:52.239 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFkkZyRBhAA/Q44zwMnP6p4QwYJUCk0Ow==", 2023-03-03T06:25:52.240 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.240 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:52.240 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-03-03T06:25:52.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw pool=cephfs_data" 2023-03-03T06:25:52.240 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.241 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-03-03T06:25:52.241 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFke8dHDRAA5tXiSg31lHzCfcffU+ycDw==", 2023-03-03T06:25:52.241 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.241 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:52.242 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-03-03T06:25:52.242 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-03-03T06:25:52.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-03-03T06:25:52.242 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.243 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-03-03T06:25:52.243 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFk6W3zCRAAMk0SzOs1po/kkiSR41EAbA==", 2023-03-03T06:25:52.243 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.244 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:52.244 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-03-03T06:25:52.244 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-03-03T06:25:52.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-03-03T06:25:52.244 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.245 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-03-03T06:25:52.245 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFk4NGTEBAAQne/fOUfeZe1sWAZXnJ5Cw==", 2023-03-03T06:25:52.245 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.245 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:25:52.245 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-03-03T06:25:52.245 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-03-03T06:25:52.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-03-03T06:25:52.245 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.246 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-03-03T06:25:52.246 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkrhMlDBAAIRxVSXIMLiI0L4p+Odt4AA==", 2023-03-03T06:25:52.246 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.246 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-03-03T06:25:52.246 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:25:52.247 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:25:52.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.247 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-03-03T06:25:52.247 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkRHQbJhAAq2ZAqxUiXeNQLLcfaVvj7g==", 2023-03-03T06:25:52.248 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.248 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-03-03T06:25:52.248 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-03-03T06:25:52.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.248 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:52.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:52.248 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-03-03T06:25:52.249 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFktxgZIhAAsvbF/OzJf4OZ7a85LkWKtw==", 2023-03-03T06:25:52.249 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:25:52.249 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-03-03T06:25:52.249 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-03-03T06:25:52.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:25:52.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:52.250 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-03-03T06:25:52.250 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-03-03T06:25:52.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.222+0000 7f60d78ef700 1 -- 172.21.15.5:0/2254492835 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f60b4068320 msgr2=0x7f60b406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:52.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.222+0000 7f60d78ef700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f60b4068320 0x7f60b406a7d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f60c0006fd0 tx=0x7f60c0008040 comp rx=0 tx=0).stop 2023-03-03T06:25:52.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.222+0000 7f60d78ef700 1 -- 172.21.15.5:0/2254492835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d015cd40 msgr2=0x7f60d00c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:52.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.222+0000 7f60d78ef700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d015cd40 0x7f60d00c8e00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f60c800cef0 tx=0x7f60c800cf20 comp rx=0 tx=0).stop 2023-03-03T06:25:52.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.222+0000 7f60d78ef700 1 -- 172.21.15.5:0/2254492835 shutdown_connections 2023-03-03T06:25:52.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.222+0000 7f60d78ef700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60d015cd40 0x7f60d00c8e00 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.222+0000 7f60d78ef700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60d00cba50 0x7f60d01471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.222+0000 7f60d78ef700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f60b4068320 0x7f60b406a7d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.222+0000 7f60d78ef700 1 --2- 172.21.15.5:0/2254492835 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60d00cd3e0 0x7f60d00ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.222+0000 7f60d78ef700 1 -- 172.21.15.5:0/2254492835 >> 172.21.15.5:0/2254492835 conn(0x7f60d00cc8d0 msgr2=0x7f60d00cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:52.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.222+0000 7f60d78ef700 1 -- 172.21.15.5:0/2254492835 shutdown_connections 2023-03-03T06:25:52.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.222+0000 7f60d78ef700 1 -- 172.21.15.5:0/2254492835 wait complete. 2023-03-03T06:25:52.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.376+0000 7f7ddac69700 1 Processor -- start 2023-03-03T06:25:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.376+0000 7f7ddac69700 1 -- start start 2023-03-03T06:25:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.377+0000 7f7ddac69700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7dd41573f0 0x7f7dd415d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.377+0000 7f7ddac69700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7dd40b18d0 0x7f7dd40b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.377+0000 7f7ddac69700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd41577c0 con 0x7f7dd40cc1a0 2023-03-03T06:25:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.377+0000 7f7ddac69700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd40cd790 con 0x7f7dd40b18d0 2023-03-03T06:25:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.377+0000 7f7ddac69700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd4159e60 con 0x7f7dd41573f0 2023-03-03T06:25:52.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.377+0000 7f7dd9206700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7dd40b18d0 0x7f7dd40b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.377+0000 7f7dd9206700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7dd40b18d0 0x7f7dd40b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45286/0 (socket says 172.21.15.5:45286) 2023-03-03T06:25:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.377+0000 7f7dd9206700 1 -- 172.21.15.5:0/1453897897 learned_addr learned my addr 172.21.15.5:0/1453897897 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.377+0000 7f7dd8a05700 1 --2- 172.21.15.5:0/1453897897 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7dd41573f0 0x7f7dd415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.377+0000 7f7dd9206700 1 -- 172.21.15.5:0/1453897897 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7dd41573f0 msgr2=0x7f7dd415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.377+0000 7f7dd9206700 1 --2- 172.21.15.5:0/1453897897 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7dd41573f0 0x7f7dd415d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.377+0000 7f7dd9206700 1 -- 172.21.15.5:0/1453897897 >> v1:172.21.15.191:6789/0 conn(0x7f7dd40cc1a0 legacy=0x7f7dd40cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.377+0000 7f7dd9206700 1 -- 172.21.15.5:0/1453897897 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd40b2270 con 0x7f7dd40b18d0 2023-03-03T06:25:52.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.378+0000 7f7dd9206700 1 --2- 172.21.15.5:0/1453897897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd40b18d0 0x7f7dd40b1d30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00d150 tx=0x7f7dcc00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c87bab5b3c8801f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:52.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.378+0000 7f7dd37fe700 1 -- 172.21.15.5:0/1453897897 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc010070 con 0x7f7dd40b18d0 2023-03-03T06:25:52.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.378+0000 7f7dd37fe700 1 -- 172.21.15.5:0/1453897897 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc00ddc0 con 0x7f7dd40b18d0 2023-03-03T06:25:52.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.378+0000 7f7dd37fe700 1 -- 172.21.15.5:0/1453897897 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc00b310 con 0x7f7dd40b18d0 2023-03-03T06:25:52.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.378+0000 7f7ddac69700 1 -- 172.21.15.5:0/1453897897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd40b18d0 msgr2=0x7f7dd40b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:52.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.378+0000 7f7ddac69700 1 --2- 172.21.15.5:0/1453897897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd40b18d0 0x7f7dd40b1d30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00d150 tx=0x7f7dcc00d460 comp rx=0 tx=0).stop 2023-03-03T06:25:52.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.378+0000 7f7ddac69700 1 -- 172.21.15.5:0/1453897897 shutdown_connections 2023-03-03T06:25:52.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.378+0000 7f7ddac69700 1 --2- 172.21.15.5:0/1453897897 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd40b18d0 0x7f7dd40b1d30 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.378+0000 7f7ddac69700 1 --2- 172.21.15.5:0/1453897897 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7dd41573f0 0x7f7dd415d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.378+0000 7f7ddac69700 1 -- 172.21.15.5:0/1453897897 >> 172.21.15.5:0/1453897897 conn(0x7f7dd40cc8d0 msgr2=0x7f7dd40cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:52.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.378+0000 7f7ddac69700 1 -- 172.21.15.5:0/1453897897 shutdown_connections 2023-03-03T06:25:52.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.378+0000 7f7ddac69700 1 -- 172.21.15.5:0/1453897897 wait complete. 2023-03-03T06:25:52.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.380+0000 7f7ddac69700 1 Processor -- start 2023-03-03T06:25:52.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.380+0000 7f7ddac69700 1 -- start start 2023-03-03T06:25:52.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.380+0000 7f7ddac69700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd40b18d0 0x7f7dd40b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:52.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.380+0000 7f7ddac69700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7dd40cc1a0 0x7f7dd40c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:52.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.380+0000 7f7ddac69700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dd41573f0 0x7f7dd40c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:52.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7ddac69700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40c6700 con 0x7f7dd40b18d0 2023-03-03T06:25:52.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7ddac69700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40b5b10 con 0x7f7dd41573f0 2023-03-03T06:25:52.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7ddac69700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40b48f0 con 0x7f7dd40cc1a0 2023-03-03T06:25:52.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7dd8a05700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd40b18d0 0x7f7dd40b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:52.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7dd8a05700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd40b18d0 0x7f7dd40b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45288/0 (socket says 172.21.15.5:45288) 2023-03-03T06:25:52.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7dd8a05700 1 -- 172.21.15.5:0/1218238270 learned_addr learned my addr 172.21.15.5:0/1218238270 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:52.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7dd8a05700 1 -- 172.21.15.5:0/1218238270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7dd40cc1a0 msgr2=0x7f7dd40c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:52.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7dd8a05700 1 --2- 172.21.15.5:0/1218238270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7dd40cc1a0 0x7f7dd40c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7dd8a05700 1 -- 172.21.15.5:0/1218238270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dd41573f0 msgr2=0x7f7dd40c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7dd8a05700 1 --2- 172.21.15.5:0/1218238270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dd41573f0 0x7f7dd40c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7dd8a05700 1 -- 172.21.15.5:0/1218238270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc00bd40 con 0x7f7dd40b18d0 2023-03-03T06:25:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7dd8a05700 1 --2- 172.21.15.5:0/1218238270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd40b18d0 0x7f7dd40b55d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800e810 tx=0x7f7dc800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7dd17fa700 1 -- 172.21.15.5:0/1218238270 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8013610 con 0x7f7dd40b18d0 2023-03-03T06:25:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7dd17fa700 1 -- 172.21.15.5:0/1218238270 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8013770 con 0x7f7dd40b18d0 2023-03-03T06:25:52.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7ddac69700 1 -- 172.21.15.5:0/1218238270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd40cc610 con 0x7f7dd40b18d0 2023-03-03T06:25:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7dd17fa700 1 -- 172.21.15.5:0/1218238270 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8013b20 con 0x7f7dd40b18d0 2023-03-03T06:25:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.381+0000 7f7ddac69700 1 -- 172.21.15.5:0/1218238270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd40ce460 con 0x7f7dd40b18d0 2023-03-03T06:25:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.382+0000 7f7ddac69700 1 -- 172.21.15.5:0/1218238270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd415d900 con 0x7f7dd40b18d0 2023-03-03T06:25:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.383+0000 7f7dd17fa700 1 -- 172.21.15.5:0/1218238270 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7dc8023070 con 0x7f7dd40b18d0 2023-03-03T06:25:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.383+0000 7f7dd17fa700 1 --2- 172.21.15.5:0/1218238270 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7db80682f0 0x7f7db806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.383+0000 7f7dd17fa700 1 -- 172.21.15.5:0/1218238270 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5883+0+0 (secure 0 0 0) 0x7f7dc80858c0 con 0x7f7dd40b18d0 2023-03-03T06:25:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.383+0000 7f7dd3fff700 1 --2- 172.21.15.5:0/1218238270 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7db80682f0 0x7f7db806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:52.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.384+0000 7f7dd3fff700 1 --2- 172.21.15.5:0/1218238270 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7db80682f0 0x7f7db806a7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0000fb0 tx=0x7f7dc0007a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:52.390 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.388+0000 7f7dd17fa700 1 -- 172.21.15.5:0/1218238270 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7dc8052150 con 0x7f7dd40b18d0 2023-03-03T06:25:52.584 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.582+0000 7f7ddac69700 1 -- 172.21.15.5:0/1218238270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7dd404e6e0 con 0x7f7dd40b18d0 2023-03-03T06:25:52.585 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.583+0000 7f7dd17fa700 1 -- 172.21.15.5:0/1218238270 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16020 (secure 0 0 0) 0x7f7dc8055770 con 0x7f7dd40b18d0 2023-03-03T06:25:52.585 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:52.586 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":64,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:51.784046+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.585+0000 7f7ddac69700 1 -- 172.21.15.5:0/1218238270 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7db80682f0 msgr2=0x7f7db806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.585+0000 7f7ddac69700 1 --2- 172.21.15.5:0/1218238270 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7db80682f0 0x7f7db806a7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0000fb0 tx=0x7f7dc0007a30 comp rx=0 tx=0).stop 2023-03-03T06:25:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.585+0000 7f7ddac69700 1 -- 172.21.15.5:0/1218238270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd40b18d0 msgr2=0x7f7dd40b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.585+0000 7f7ddac69700 1 --2- 172.21.15.5:0/1218238270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd40b18d0 0x7f7dd40b55d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800e810 tx=0x7f7dc800ebd0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.586+0000 7f7ddac69700 1 -- 172.21.15.5:0/1218238270 shutdown_connections 2023-03-03T06:25:52.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.586+0000 7f7ddac69700 1 --2- 172.21.15.5:0/1218238270 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7dd41573f0 0x7f7dd40c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.586+0000 7f7ddac69700 1 --2- 172.21.15.5:0/1218238270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7dd40b18d0 0x7f7dd40b55d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.586+0000 7f7ddac69700 1 --2- 172.21.15.5:0/1218238270 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7db80682f0 0x7f7db806a7a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.586+0000 7f7ddac69700 1 --2- 172.21.15.5:0/1218238270 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7dd40cc1a0 0x7f7dd40c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.586+0000 7f7ddac69700 1 -- 172.21.15.5:0/1218238270 >> 172.21.15.5:0/1218238270 conn(0x7f7dd40cc8d0 msgr2=0x7f7dd406abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.586+0000 7f7ddac69700 1 -- 172.21.15.5:0/1218238270 shutdown_connections 2023-03-03T06:25:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.586+0000 7f7ddac69700 1 -- 172.21.15.5:0/1218238270 wait complete. 2023-03-03T06:25:52.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'snap-test-pool', 'create_time': '2023-03-03T06:25:02.648527+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T06:25:52.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:25:52.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.728+0000 7f201d958700 1 Processor -- start 2023-03-03T06:25:52.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.728+0000 7f201d958700 1 -- start start 2023-03-03T06:25:52.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f201d958700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f201806bab0 0x7f20180cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:52.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f201d958700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f201806c120 0x7f201806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:52.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f201d958700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20180d2d60 con 0x7f20180b8720 2023-03-03T06:25:52.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f201d958700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201806cae0 con 0x7f201806c120 2023-03-03T06:25:52.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f201d958700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20180cdd90 con 0x7f201806bab0 2023-03-03T06:25:52.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f20177fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f201806c120 0x7f201806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:52.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f20177fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f201806c120 0x7f201806c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45300/0 (socket says 172.21.15.5:45300) 2023-03-03T06:25:52.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f2016ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f20180b8720 0x7f2018160d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35138/0 (socket says 172.21.15.5:35138) 2023-03-03T06:25:52.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f20177fe700 1 -- 172.21.15.5:0/2057462276 learned_addr learned my addr 172.21.15.5:0/2057462276 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:52.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f20167fc700 1 --2- 172.21.15.5:0/2057462276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f201806bab0 0x7f20180cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:52.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f20177fe700 1 -- 172.21.15.5:0/2057462276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f201806bab0 msgr2=0x7f20180cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:52.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f20177fe700 1 --2- 172.21.15.5:0/2057462276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f201806bab0 0x7f20180cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f20177fe700 1 -- 172.21.15.5:0/2057462276 >> v1:172.21.15.5:6789/0 conn(0x7f20180b8720 legacy=0x7f2018160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:52.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f20177fe700 1 -- 172.21.15.5:0/2057462276 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20180cf400 con 0x7f201806c120 2023-03-03T06:25:52.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.729+0000 7f2015ffb700 1 -- 172.21.15.5:0/2057462276 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796122949 0 0) 0x7f20180d2d60 con 0x7f20180b8720 2023-03-03T06:25:52.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.730+0000 7f20177fe700 1 --2- 172.21.15.5:0/2057462276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f201806c120 0x7f201806c5a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2010009e50 tx=0x7f201000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d524e3217e93ba server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:52.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.730+0000 7f2015ffb700 1 -- 172.21.15.5:0/2057462276 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201000e070 con 0x7f201806c120 2023-03-03T06:25:52.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.730+0000 7f2015ffb700 1 -- 172.21.15.5:0/2057462276 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201000b9c0 con 0x7f201806c120 2023-03-03T06:25:52.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.730+0000 7f2015ffb700 1 -- 172.21.15.5:0/2057462276 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201000bd70 con 0x7f201806c120 2023-03-03T06:25:52.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.730+0000 7f201d958700 1 -- 172.21.15.5:0/2057462276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f201806c120 msgr2=0x7f201806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:52.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.730+0000 7f201d958700 1 --2- 172.21.15.5:0/2057462276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f201806c120 0x7f201806c5a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2010009e50 tx=0x7f201000b330 comp rx=0 tx=0).stop 2023-03-03T06:25:52.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.730+0000 7f201d958700 1 -- 172.21.15.5:0/2057462276 shutdown_connections 2023-03-03T06:25:52.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.730+0000 7f201d958700 1 --2- 172.21.15.5:0/2057462276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f201806c120 0x7f201806c5a0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.730+0000 7f201d958700 1 --2- 172.21.15.5:0/2057462276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f201806bab0 0x7f20180cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.730+0000 7f201d958700 1 -- 172.21.15.5:0/2057462276 >> 172.21.15.5:0/2057462276 conn(0x7f20180d0590 msgr2=0x7f20180d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:52.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.730+0000 7f201d958700 1 -- 172.21.15.5:0/2057462276 shutdown_connections 2023-03-03T06:25:52.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.730+0000 7f201d958700 1 -- 172.21.15.5:0/2057462276 wait complete. 2023-03-03T06:25:52.739 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.731+0000 7f201d958700 1 Processor -- start 2023-03-03T06:25:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.732+0000 7f201d958700 1 -- start start 2023-03-03T06:25:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.732+0000 7f201d958700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f201806bab0 0x7f20180cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:52.741 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.732+0000 7f201d958700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f201806c120 0x7f2018152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:52.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.732+0000 7f201d958700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20180b8720 0x7f2018152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:52.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.732+0000 7f201d958700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20180b3670 con 0x7f201806bab0 2023-03-03T06:25:52.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.732+0000 7f201d958700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20180b3950 con 0x7f20180b8720 2023-03-03T06:25:52.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.732+0000 7f201d958700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20180b3c30 con 0x7f201806c120 2023-03-03T06:25:52.742 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f2016ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f201806bab0 0x7f20180cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:52.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f2016ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f201806bab0 0x7f20180cc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45302/0 (socket says 172.21.15.5:45302) 2023-03-03T06:25:52.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f2016ffd700 1 -- 172.21.15.5:0/1394678621 learned_addr learned my addr 172.21.15.5:0/1394678621 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:52.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f20167fc700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f201806c120 0x7f2018152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:52.743 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f2016ffd700 1 -- 172.21.15.5:0/1394678621 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f201806c120 msgr2=0x7f2018152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:52.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f2016ffd700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f201806c120 0x7f2018152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f20177fe700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20180b8720 0x7f2018152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:52.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f2016ffd700 1 -- 172.21.15.5:0/1394678621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20180b8720 msgr2=0x7f2018152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:52.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f2016ffd700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20180b8720 0x7f2018152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.744 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f2016ffd700 1 -- 172.21.15.5:0/1394678621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2010009b30 con 0x7f201806bab0 2023-03-03T06:25:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f2016ffd700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f201806bab0 0x7f20180cc7b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f200c0011e0 tx=0x7f200c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f1ffffff700 1 -- 172.21.15.5:0/1394678621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c004c80 con 0x7f201806bab0 2023-03-03T06:25:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f1ffffff700 1 -- 172.21.15.5:0/1394678621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c004e00 con 0x7f201806bab0 2023-03-03T06:25:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f1ffffff700 1 -- 172.21.15.5:0/1394678621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c007310 con 0x7f201806bab0 2023-03-03T06:25:52.745 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f201d958700 1 -- 172.21.15.5:0/1394678621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20180d29f0 con 0x7f201806bab0 2023-03-03T06:25:52.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.733+0000 7f201d958700 1 -- 172.21.15.5:0/1394678621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20180cf6e0 con 0x7f201806bab0 2023-03-03T06:25:52.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.734+0000 7f201d958700 1 -- 172.21.15.5:0/1394678621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20180b8af0 con 0x7f201806bab0 2023-03-03T06:25:52.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.735+0000 7f1ffffff700 1 -- 172.21.15.5:0/1394678621 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f200c01a020 con 0x7f201806bab0 2023-03-03T06:25:52.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.735+0000 7f1ffffff700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f20040682f0 0x7f200406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:52.746 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.735+0000 7f1ffffff700 1 -- 172.21.15.5:0/1394678621 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5883+0+0 (secure 0 0 0) 0x7f200c085820 con 0x7f201806bab0 2023-03-03T06:25:52.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.735+0000 7f20167fc700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f20040682f0 0x7f200406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:52.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.735+0000 7f20167fc700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f20040682f0 0x7f200406a7a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f20180b79e0 tx=0x7f2008008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:52.747 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.739+0000 7f1ffffff700 1 -- 172.21.15.5:0/1394678621 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f200c0521e0 con 0x7f201806bab0 2023-03-03T06:25:52.936 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.934+0000 7f201d958700 1 -- 172.21.15.5:0/1394678621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f201804e6e0 con 0x7f201806bab0 2023-03-03T06:25:52.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.934+0000 7f1ffffff700 1 -- 172.21.15.5:0/1394678621 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7f200c055800 con 0x7f201806bab0 2023-03-03T06:25:52.937 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:25:52.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.936+0000 7f201d958700 1 -- 172.21.15.5:0/1394678621 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f20040682f0 msgr2=0x7f200406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.936+0000 7f201d958700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f20040682f0 0x7f200406a7a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f20180b79e0 tx=0x7f2008008040 comp rx=0 tx=0).stop 2023-03-03T06:25:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.936+0000 7f201d958700 1 -- 172.21.15.5:0/1394678621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f201806bab0 msgr2=0x7f20180cc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.936+0000 7f201d958700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f201806bab0 0x7f20180cc7b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f200c0011e0 tx=0x7f200c00cae0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.936+0000 7f201d958700 1 -- 172.21.15.5:0/1394678621 shutdown_connections 2023-03-03T06:25:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.936+0000 7f201d958700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20180b8720 0x7f2018152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.936+0000 7f201d958700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f201806bab0 0x7f20180cc7b0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.936+0000 7f201d958700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f20040682f0 0x7f200406a7a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.936+0000 7f201d958700 1 --2- 172.21.15.5:0/1394678621 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f201806c120 0x7f2018152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.936+0000 7f201d958700 1 -- 172.21.15.5:0/1394678621 >> 172.21.15.5:0/1394678621 conn(0x7f20180d0590 msgr2=0x7f201815cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.936+0000 7f201d958700 1 -- 172.21.15.5:0/1394678621 shutdown_connections 2023-03-03T06:25:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:52.936+0000 7f201d958700 1 -- 172.21.15.5:0/1394678621 wait complete. 2023-03-03T06:25:52.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:25:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.077+0000 7fbd7a97c700 1 Processor -- start 2023-03-03T06:25:53.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.077+0000 7fbd7a97c700 1 -- start start 2023-03-03T06:25:53.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd7a97c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbd74159550 0x7fbd7415dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd7a97c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd7406d1b0 0x7fbd7406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd7a97c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd740cebc0 0x7fbd740cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd7a97c700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd740cf580 con 0x7fbd740cebc0 2023-03-03T06:25:53.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd7a97c700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7406e140 con 0x7fbd74159550 2023-03-03T06:25:53.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd7a97c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7406e3f0 con 0x7fbd7406d1b0 2023-03-03T06:25:53.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd78f19700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd740cebc0 0x7fbd740cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd78f19700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbd740cebc0 0x7fbd740cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45314/0 (socket says 172.21.15.5:45314) 2023-03-03T06:25:53.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd78f19700 1 -- 172.21.15.5:0/990766383 learned_addr learned my addr 172.21.15.5:0/990766383 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:53.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd73fff700 1 --2- 172.21.15.5:0/990766383 >> v2:172.21.15.191:3300/0 conn(0x7fbd74159550 0x7fbd7415dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd737fe700 1 --2- 172.21.15.5:0/990766383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd7406d1b0 0x7fbd7406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd78f19700 1 -- 172.21.15.5:0/990766383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd7406d1b0 msgr2=0x7fbd7406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:53.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd78f19700 1 --2- 172.21.15.5:0/990766383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd7406d1b0 0x7fbd7406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd78f19700 1 -- 172.21.15.5:0/990766383 >> v2:172.21.15.191:3300/0 conn(0x7fbd74159550 msgr2=0x7fbd7415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:53.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd78f19700 1 --2- 172.21.15.5:0/990766383 >> v2:172.21.15.191:3300/0 conn(0x7fbd74159550 0x7fbd7415dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd78f19700 1 -- 172.21.15.5:0/990766383 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7406e6d0 con 0x7fbd740cebc0 2023-03-03T06:25:53.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.078+0000 7fbd78f19700 1 --2- 172.21.15.5:0/990766383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740cebc0 0x7fbd740cf040 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fbd7406ef00 tx=0x7fbd6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc8e3047c4062d6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:53.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.079+0000 7fbd72ffd700 1 -- 172.21.15.5:0/990766383 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00e070 con 0x7fbd740cebc0 2023-03-03T06:25:53.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.079+0000 7fbd72ffd700 1 -- 172.21.15.5:0/990766383 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c00b9c0 con 0x7fbd740cebc0 2023-03-03T06:25:53.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.079+0000 7fbd72ffd700 1 -- 172.21.15.5:0/990766383 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00bd70 con 0x7fbd740cebc0 2023-03-03T06:25:53.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.079+0000 7fbd7a97c700 1 -- 172.21.15.5:0/990766383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740cebc0 msgr2=0x7fbd740cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.079+0000 7fbd7a97c700 1 --2- 172.21.15.5:0/990766383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740cebc0 0x7fbd740cf040 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fbd7406ef00 tx=0x7fbd6c00b330 comp rx=0 tx=0).stop 2023-03-03T06:25:53.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.079+0000 7fbd7a97c700 1 -- 172.21.15.5:0/990766383 shutdown_connections 2023-03-03T06:25:53.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.079+0000 7fbd7a97c700 1 --2- 172.21.15.5:0/990766383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd740cebc0 0x7fbd740cf040 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.079+0000 7fbd7a97c700 1 --2- 172.21.15.5:0/990766383 >> v2:172.21.15.191:3300/0 conn(0x7fbd74159550 0x7fbd7415dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.079+0000 7fbd7a97c700 1 --2- 172.21.15.5:0/990766383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd7406d1b0 0x7fbd7406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.079+0000 7fbd7a97c700 1 -- 172.21.15.5:0/990766383 >> 172.21.15.5:0/990766383 conn(0x7fbd740cfd00 msgr2=0x7fbd740d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:53.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.079+0000 7fbd7a97c700 1 -- 172.21.15.5:0/990766383 shutdown_connections 2023-03-03T06:25:53.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.079+0000 7fbd7a97c700 1 -- 172.21.15.5:0/990766383 wait complete. 2023-03-03T06:25:53.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.080+0000 7fbd7a97c700 1 Processor -- start 2023-03-03T06:25:53.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.081+0000 7fbd7a97c700 1 -- start start 2023-03-03T06:25:53.092 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.081+0000 7fbd7a97c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd7406d1b0 0x7fbd740c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.081+0000 7fbd7a97c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd740cebc0 0x7fbd740c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.081+0000 7fbd7a97c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd74159550 0x7fbd740b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.081+0000 7fbd7a97c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74149090 con 0x7fbd7406d1b0 2023-03-03T06:25:53.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.081+0000 7fbd7a97c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd741481a0 con 0x7fbd74159550 2023-03-03T06:25:53.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.081+0000 7fbd7a97c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74148480 con 0x7fbd740cebc0 2023-03-03T06:25:53.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.081+0000 7fbd73fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd7406d1b0 0x7fbd740c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.093 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.081+0000 7fbd73fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd7406d1b0 0x7fbd740c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45316/0 (socket says 172.21.15.5:45316) 2023-03-03T06:25:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.081+0000 7fbd73fff700 1 -- 172.21.15.5:0/1666454638 learned_addr learned my addr 172.21.15.5:0/1666454638 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd737fe700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd740cebc0 0x7fbd740c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd78f19700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd74159550 0x7fbd740b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd73fff700 1 -- 172.21.15.5:0/1666454638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd740cebc0 msgr2=0x7fbd740c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd73fff700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd740cebc0 0x7fbd740c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd73fff700 1 -- 172.21.15.5:0/1666454638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd74159550 msgr2=0x7fbd740b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd73fff700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd74159550 0x7fbd740b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.094 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd73fff700 1 -- 172.21.15.5:0/1666454638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c009b30 con 0x7fbd7406d1b0 2023-03-03T06:25:53.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd737fe700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd740cebc0 0x7fbd740c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:53.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd78f19700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd74159550 0x7fbd740b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:53.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd73fff700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd7406d1b0 0x7fbd740c5a20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00d800 tx=0x7fbd5c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:53.095 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd70ff9700 1 -- 172.21.15.5:0/1666454638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0125f0 con 0x7fbd7406d1b0 2023-03-03T06:25:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd70ff9700 1 -- 172.21.15.5:0/1666454638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c012750 con 0x7fbd7406d1b0 2023-03-03T06:25:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd7a97c700 1 -- 172.21.15.5:0/1666454638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7406c9b0 con 0x7fbd7406d1b0 2023-03-03T06:25:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd70ff9700 1 -- 172.21.15.5:0/1666454638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c012b00 con 0x7fbd7406d1b0 2023-03-03T06:25:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.082+0000 7fbd7a97c700 1 -- 172.21.15.5:0/1666454638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7406c6d0 con 0x7fbd7406d1b0 2023-03-03T06:25:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.083+0000 7fbd7a97c700 1 -- 172.21.15.5:0/1666454638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7406cc90 con 0x7fbd7406d1b0 2023-03-03T06:25:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.084+0000 7fbd70ff9700 1 -- 172.21.15.5:0/1666454638 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbd5c012c60 con 0x7fbd7406d1b0 2023-03-03T06:25:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.084+0000 7fbd70ff9700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbd540682f0 0x7fbd5406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.084+0000 7fbd70ff9700 1 -- 172.21.15.5:0/1666454638 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5883+0+0 (secure 0 0 0) 0x7fbd5c086170 con 0x7fbd7406d1b0 2023-03-03T06:25:53.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.084+0000 7fbd737fe700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbd540682f0 0x7fbd5406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.084+0000 7fbd737fe700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbd540682f0 0x7fbd5406a7a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbd7406bc60 tx=0x7fbd64008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:53.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.088+0000 7fbd70ff9700 1 -- 172.21.15.5:0/1666454638 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbd5c052a00 con 0x7fbd7406d1b0 2023-03-03T06:25:53.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.282+0000 7fbd7a97c700 1 -- 172.21.15.5:0/1666454638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd7406d840 con 0x7fbd7406d1b0 2023-03-03T06:25:53.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.282+0000 7fbd70ff9700 1 -- 172.21.15.5:0/1666454638 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd5c056020 con 0x7fbd7406d1b0 2023-03-03T06:25:53.285 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:25:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.284+0000 7fbd7a97c700 1 -- 172.21.15.5:0/1666454638 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbd540682f0 msgr2=0x7fbd5406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.284+0000 7fbd7a97c700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbd540682f0 0x7fbd5406a7a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbd7406bc60 tx=0x7fbd64008040 comp rx=0 tx=0).stop 2023-03-03T06:25:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.284+0000 7fbd7a97c700 1 -- 172.21.15.5:0/1666454638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd7406d1b0 msgr2=0x7fbd740c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.284+0000 7fbd7a97c700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd7406d1b0 0x7fbd740c5a20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00d800 tx=0x7fbd5c00dbc0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.284+0000 7fbd7a97c700 1 -- 172.21.15.5:0/1666454638 shutdown_connections 2023-03-03T06:25:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.284+0000 7fbd7a97c700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd74159550 0x7fbd740b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.287 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.285+0000 7fbd7a97c700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbd7406d1b0 0x7fbd740c5a20 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.285+0000 7fbd7a97c700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbd540682f0 0x7fbd5406a7a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.285+0000 7fbd7a97c700 1 --2- 172.21.15.5:0/1666454638 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbd740cebc0 0x7fbd740c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.285+0000 7fbd7a97c700 1 -- 172.21.15.5:0/1666454638 >> 172.21.15.5:0/1666454638 conn(0x7fbd740cfd00 msgr2=0x7fbd74157050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:53.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.285+0000 7fbd7a97c700 1 -- 172.21.15.5:0/1666454638 shutdown_connections 2023-03-03T06:25:53.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.285+0000 7fbd7a97c700 1 -- 172.21.15.5:0/1666454638 wait complete. 2023-03-03T06:25:53.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-03-03T06:25:53.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.426+0000 7fbc1559b700 1 Processor -- start 2023-03-03T06:25:53.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.426+0000 7fbc1559b700 1 -- start start 2023-03-03T06:25:53.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.426+0000 7fbc1559b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc1015c650 0x7fbc10161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.426+0000 7fbc1559b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc100ce210 con 0x7fbc100cf130 2023-03-03T06:25:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.426+0000 7fbc1559b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc10160560 con 0x7fbc1015ca20 2023-03-03T06:25:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.426+0000 7fbc1559b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100cdf30 con 0x7fbc1015c650 2023-03-03T06:25:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0f7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbc100cf130 0x7fbc100cb4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35170/0 (socket says 172.21.15.5:35170) 2023-03-03T06:25:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0f7fe700 1 -- 172.21.15.5:0/1908564186 learned_addr learned my addr 172.21.15.5:0/1908564186 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:53.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383712927 0 0) 0x7fbc100ce210 con 0x7fbc100cf130 2023-03-03T06:25:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbf80035b0 con 0x7fbc100cf130 2023-03-03T06:25:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0effd700 1 --2- 172.21.15.5:0/1908564186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc1015c650 0x7fbc10161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2714046868 0 0) 0x7fbbf80035b0 con 0x7fbc100cf130 2023-03-03T06:25:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc1015c650 msgr2=0x7fbc10161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 --2- 172.21.15.5:0/1908564186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc1015c650 0x7fbc10161000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 >> v1:172.21.15.191:6789/0 conn(0x7fbc1015ca20 legacy=0x7fbc100cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc10160800 con 0x7fbc100cf130 2023-03-03T06:25:53.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fbc080019f0 con 0x7fbc100cf130 2023-03-03T06:25:53.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 >> v1:172.21.15.5:6789/0 conn(0x7fbc100cf130 legacy=0x7fbc100cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 --2- 172.21.15.5:0/1908564186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc1015c650 0x7fbbf8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 --2- 172.21.15.5:0/1908564186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbf8003fb0 0x7fbbf8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 --2- 172.21.15.5:0/1908564186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbf8004d90 0x7fbbf8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100cdf30 con 0x7fbbf8004d90 2023-03-03T06:25:53.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf800bba0 con 0x7fbbf8003fb0 2023-03-03T06:25:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf800bd60 con 0x7fbc1015c650 2023-03-03T06:25:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0f7fe700 1 --2- 172.21.15.5:0/1908564186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbf8004d90 0x7fbbf8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0e7fc700 1 --2- 172.21.15.5:0/1908564186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbf8003fb0 0x7fbbf8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.427+0000 7fbc0effd700 1 --2- 172.21.15.5:0/1908564186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc1015c650 0x7fbbf8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.428+0000 7fbc0f7fe700 1 -- 172.21.15.5:0/1908564186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc1015c650 msgr2=0x7fbbf8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:53.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.428+0000 7fbc0f7fe700 1 --2- 172.21.15.5:0/1908564186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc1015c650 0x7fbbf8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.428+0000 7fbc0f7fe700 1 -- 172.21.15.5:0/1908564186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbf8003fb0 msgr2=0x7fbbf8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.428+0000 7fbc0f7fe700 1 --2- 172.21.15.5:0/1908564186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbbf8003fb0 0x7fbbf8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.428+0000 7fbc0f7fe700 1 -- 172.21.15.5:0/1908564186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf80035b0 con 0x7fbbf8004d90 2023-03-03T06:25:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.428+0000 7fbc0f7fe700 1 --2- 172.21.15.5:0/1908564186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbf8004d90 0x7fbbf8005200 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fbc1006de30 tx=0x7fbbf8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a84035a77f3bf6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.428+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800a2f0 con 0x7fbbf8004d90 2023-03-03T06:25:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.428+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc08012600 con 0x7fbbf8004d90 2023-03-03T06:25:53.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.428+0000 7fbc0dffb700 1 -- 172.21.15.5:0/1908564186 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc080129b0 con 0x7fbbf8004d90 2023-03-03T06:25:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.429+0000 7fbc1559b700 1 -- 172.21.15.5:0/1908564186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbf8004d90 msgr2=0x7fbbf8005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.429+0000 7fbc1559b700 1 --2- 172.21.15.5:0/1908564186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbbf8004d90 0x7fbbf8005200 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fbc1006de30 tx=0x7fbbf8005880 comp rx=0 tx=0).stop 2023-03-03T06:25:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.429+0000 7fbc0f7fe700 1 -- 172.21.15.5:0/1908564186 reap_dead start 2023-03-03T06:25:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.429+0000 7fbc1559b700 1 -- 172.21.15.5:0/1908564186 shutdown_connections 2023-03-03T06:25:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.429+0000 7fbc1559b700 1 -- 172.21.15.5:0/1908564186 >> 172.21.15.5:0/1908564186 conn(0x7fbc1006f3c0 msgr2=0x7fbc1006f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.429+0000 7fbc1559b700 1 -- 172.21.15.5:0/1908564186 shutdown_connections 2023-03-03T06:25:53.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.429+0000 7fbc1559b700 1 -- 172.21.15.5:0/1908564186 wait complete. 2023-03-03T06:25:53.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.430+0000 7fbc1559b700 1 Processor -- start 2023-03-03T06:25:53.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.430+0000 7fbc1559b700 1 -- start start 2023-03-03T06:25:53.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc1559b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc100ca810 0x7fbc100b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc1559b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc100cabe0 0x7fbc100b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc1559b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc100b0a60 0x7fbc100b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc1559b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100b1a70 con 0x7fbc100cabe0 2023-03-03T06:25:53.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc1559b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc101e69b0 con 0x7fbc100b0a60 2023-03-03T06:25:53.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc1559b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100b1790 con 0x7fbc100ca810 2023-03-03T06:25:53.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc0e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc100cabe0 0x7fbc100b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc0e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc100cabe0 0x7fbc100b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45338/0 (socket says 172.21.15.5:45338) 2023-03-03T06:25:53.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc0e7fc700 1 -- 172.21.15.5:0/292869754 learned_addr learned my addr 172.21.15.5:0/292869754 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:53.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc0effd700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc100ca810 0x7fbc100b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.442 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc0f7fe700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc100b0a60 0x7fbc100b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc0e7fc700 1 -- 172.21.15.5:0/292869754 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc100ca810 msgr2=0x7fbc100b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc0e7fc700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc100ca810 0x7fbc100b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc0e7fc700 1 -- 172.21.15.5:0/292869754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc100b0a60 msgr2=0x7fbc100b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc0e7fc700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc100b0a60 0x7fbc100b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc0e7fc700 1 -- 172.21.15.5:0/292869754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc10161000 con 0x7fbc100cabe0 2023-03-03T06:25:53.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.431+0000 7fbc0e7fc700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc100cabe0 0x7fbc100b41c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400f7f0 tx=0x7fbc0400fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:53.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.432+0000 7fbbf77fe700 1 -- 172.21.15.5:0/292869754 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc040052e0 con 0x7fbc100cabe0 2023-03-03T06:25:53.443 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.432+0000 7fbbf77fe700 1 -- 172.21.15.5:0/292869754 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc04005440 con 0x7fbc100cabe0 2023-03-03T06:25:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.432+0000 7fbc1559b700 1 -- 172.21.15.5:0/292869754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc10160ae0 con 0x7fbc100cabe0 2023-03-03T06:25:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.432+0000 7fbbf77fe700 1 -- 172.21.15.5:0/292869754 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc040038c0 con 0x7fbc100cabe0 2023-03-03T06:25:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.432+0000 7fbc1559b700 1 -- 172.21.15.5:0/292869754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc10161190 con 0x7fbc100cabe0 2023-03-03T06:25:53.444 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.433+0000 7fbc1559b700 1 -- 172.21.15.5:0/292869754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc101e6b20 con 0x7fbc100cabe0 2023-03-03T06:25:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.433+0000 7fbbf77fe700 1 -- 172.21.15.5:0/292869754 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbc04003a20 con 0x7fbc100cabe0 2023-03-03T06:25:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.433+0000 7fbbf77fe700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbbfc068320 0x7fbbfc06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.434+0000 7fbbf77fe700 1 -- 172.21.15.5:0/292869754 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5883+0+0 (secure 0 0 0) 0x7fbc04085b00 con 0x7fbc100cabe0 2023-03-03T06:25:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.434+0000 7fbc0effd700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbbfc068320 0x7fbbfc06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.434+0000 7fbc0effd700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbbfc068320 0x7fbbfc06a7d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009c60 tx=0x7fbc00009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:53.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.438+0000 7fbbf77fe700 1 -- 172.21.15.5:0/292869754 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbc04087e60 con 0x7fbc100cabe0 2023-03-03T06:25:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.630+0000 7fbc1559b700 1 -- 172.21.15.5:0/292869754 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fbc1004e6e0 con 0x7fbc100cabe0 2023-03-03T06:25:53.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.630+0000 7fbbf77fe700 1 -- 172.21.15.5:0/292869754 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v64) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbc04052320 con 0x7fbc100cabe0 2023-03-03T06:25:53.633 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:25:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.632+0000 7fbc1559b700 1 -- 172.21.15.5:0/292869754 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbbfc068320 msgr2=0x7fbbfc06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.632+0000 7fbc1559b700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbbfc068320 0x7fbbfc06a7d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009c60 tx=0x7fbc00009210 comp rx=0 tx=0).stop 2023-03-03T06:25:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.632+0000 7fbc1559b700 1 -- 172.21.15.5:0/292869754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc100cabe0 msgr2=0x7fbc100b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.632+0000 7fbc1559b700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc100cabe0 0x7fbc100b41c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbc0400f7f0 tx=0x7fbc0400fb00 comp rx=0 tx=0).stop 2023-03-03T06:25:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.632+0000 7fbc1559b700 1 -- 172.21.15.5:0/292869754 shutdown_connections 2023-03-03T06:25:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.632+0000 7fbc1559b700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc100b0a60 0x7fbc100b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.632+0000 7fbc1559b700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbbfc068320 0x7fbbfc06a7d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.632+0000 7fbc1559b700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc100ca810 0x7fbc100b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.632+0000 7fbc1559b700 1 --2- 172.21.15.5:0/292869754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc100cabe0 0x7fbc100b41c0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.632+0000 7fbc1559b700 1 -- 172.21.15.5:0/292869754 >> 172.21.15.5:0/292869754 conn(0x7fbc1006f3c0 msgr2=0x7fbc100cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.632+0000 7fbc1559b700 1 -- 172.21.15.5:0/292869754 shutdown_connections 2023-03-03T06:25:53.637 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.632+0000 7fbc1559b700 1 -- 172.21.15.5:0/292869754 wait complete. 2023-03-03T06:25:53.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-03T06:25:53.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.769+0000 7f705519e700 1 Processor -- start 2023-03-03T06:25:53.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.770+0000 7f705519e700 1 -- start start 2023-03-03T06:25:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.770+0000 7f705519e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7050159310 0x7f70500cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.770+0000 7f705519e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70500ce0e0 0x7f70500cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.770+0000 7f705519e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70500cfdc0 0x7f705015ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.770+0000 7f705519e700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705006d120 con 0x7f70500cfdc0 2023-03-03T06:25:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.770+0000 7f705519e700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70501596e0 con 0x7f7050159310 2023-03-03T06:25:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.770+0000 7f705519e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70500d0260 con 0x7f70500ce0e0 2023-03-03T06:25:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.770+0000 7f705499d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70500cfdc0 0x7f705015ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.770+0000 7f705499d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f70500cfdc0 0x7f705015ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45348/0 (socket says 172.21.15.5:45348) 2023-03-03T06:25:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.770+0000 7f705499d700 1 -- 172.21.15.5:0/2076244782 learned_addr learned my addr 172.21.15.5:0/2076244782 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.771+0000 7f704f7fe700 1 --2- 172.21.15.5:0/2076244782 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70500ce0e0 0x7f70500cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.771+0000 7f704ffff700 1 --2- 172.21.15.5:0/2076244782 >> v2:172.21.15.191:3300/0 conn(0x7f7050159310 0x7f70500cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.771+0000 7f705499d700 1 -- 172.21.15.5:0/2076244782 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70500ce0e0 msgr2=0x7f70500cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.771+0000 7f705499d700 1 --2- 172.21.15.5:0/2076244782 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70500ce0e0 0x7f70500cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.771+0000 7f705499d700 1 -- 172.21.15.5:0/2076244782 >> v2:172.21.15.191:3300/0 conn(0x7f7050159310 msgr2=0x7f70500cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.771+0000 7f705499d700 1 --2- 172.21.15.5:0/2076244782 >> v2:172.21.15.191:3300/0 conn(0x7f7050159310 0x7f70500cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.771+0000 7f705499d700 1 -- 172.21.15.5:0/2076244782 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705006c4a0 con 0x7f70500cfdc0 2023-03-03T06:25:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.771+0000 7f704f7fe700 1 --2- 172.21.15.5:0/2076244782 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70500ce0e0 0x7f70500cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.771+0000 7f704ffff700 1 --2- 172.21.15.5:0/2076244782 >> v2:172.21.15.191:3300/0 conn(0x7f7050159310 0x7f70500cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.771+0000 7f705499d700 1 --2- 172.21.15.5:0/2076244782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70500cfdc0 0x7f705015ce30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f70500d0bc0 tx=0x7f704800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10da6401204dbe3a server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.771+0000 7f704effd700 1 -- 172.21.15.5:0/2076244782 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704800e070 con 0x7f70500cfdc0 2023-03-03T06:25:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.771+0000 7f704effd700 1 -- 172.21.15.5:0/2076244782 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704800b9c0 con 0x7f70500cfdc0 2023-03-03T06:25:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.771+0000 7f704effd700 1 -- 172.21.15.5:0/2076244782 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704800bd70 con 0x7f70500cfdc0 2023-03-03T06:25:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.772+0000 7f705519e700 1 -- 172.21.15.5:0/2076244782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70500cfdc0 msgr2=0x7f705015ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.772+0000 7f705519e700 1 --2- 172.21.15.5:0/2076244782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70500cfdc0 0x7f705015ce30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f70500d0bc0 tx=0x7f704800b330 comp rx=0 tx=0).stop 2023-03-03T06:25:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.772+0000 7f705519e700 1 -- 172.21.15.5:0/2076244782 shutdown_connections 2023-03-03T06:25:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.772+0000 7f705519e700 1 --2- 172.21.15.5:0/2076244782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70500cfdc0 0x7f705015ce30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.772+0000 7f705519e700 1 --2- 172.21.15.5:0/2076244782 >> v2:172.21.15.191:3300/0 conn(0x7f7050159310 0x7f70500cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.772+0000 7f705519e700 1 --2- 172.21.15.5:0/2076244782 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f70500ce0e0 0x7f70500cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.772+0000 7f705519e700 1 -- 172.21.15.5:0/2076244782 >> 172.21.15.5:0/2076244782 conn(0x7f705006dc50 msgr2=0x7f705006e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.772+0000 7f705519e700 1 -- 172.21.15.5:0/2076244782 shutdown_connections 2023-03-03T06:25:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.772+0000 7f705519e700 1 -- 172.21.15.5:0/2076244782 wait complete. 2023-03-03T06:25:53.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.773+0000 7f705519e700 1 Processor -- start 2023-03-03T06:25:53.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.773+0000 7f705519e700 1 -- start start 2023-03-03T06:25:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f705519e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70500ce0e0 0x7f7050155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f705519e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70500cfdc0 0x7f70500aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f705519e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7050159310 0x7f70500b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f705519e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7050155040 con 0x7f70500ce0e0 2023-03-03T06:25:53.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f705519e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70500af560 con 0x7f70500cfdc0 2023-03-03T06:25:53.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f705519e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70500af840 con 0x7f7050159310 2023-03-03T06:25:53.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f704ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70500ce0e0 0x7f7050155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f704ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70500ce0e0 0x7f7050155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45350/0 (socket says 172.21.15.5:45350) 2023-03-03T06:25:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f704ffff700 1 -- 172.21.15.5:0/4134409817 learned_addr learned my addr 172.21.15.5:0/4134409817 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f705499d700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7050159310 0x7f70500b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f704f7fe700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70500cfdc0 0x7f70500aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f704ffff700 1 -- 172.21.15.5:0/4134409817 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7050159310 msgr2=0x7f70500b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f704ffff700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7050159310 0x7f70500b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f704ffff700 1 -- 172.21.15.5:0/4134409817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70500cfdc0 msgr2=0x7f70500aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f704ffff700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70500cfdc0 0x7f70500aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f704ffff700 1 -- 172.21.15.5:0/4134409817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7048009b30 con 0x7f70500ce0e0 2023-03-03T06:25:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f705499d700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7050159310 0x7f70500b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.774+0000 7f704f7fe700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70500cfdc0 0x7f70500aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:53.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.775+0000 7f704ffff700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70500ce0e0 0x7f7050155270 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f704000c7f0 tx=0x7f704000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.775+0000 7f704cff9700 1 -- 172.21.15.5:0/4134409817 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040011800 con 0x7f70500ce0e0 2023-03-03T06:25:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.775+0000 7f704cff9700 1 -- 172.21.15.5:0/4134409817 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7040011960 con 0x7f70500ce0e0 2023-03-03T06:25:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.775+0000 7f705519e700 1 -- 172.21.15.5:0/4134409817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705006ca60 con 0x7f70500ce0e0 2023-03-03T06:25:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.775+0000 7f704cff9700 1 -- 172.21.15.5:0/4134409817 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040011d10 con 0x7f70500ce0e0 2023-03-03T06:25:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.775+0000 7f705519e700 1 -- 172.21.15.5:0/4134409817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705006c780 con 0x7f70500ce0e0 2023-03-03T06:25:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.776+0000 7f705519e700 1 -- 172.21.15.5:0/4134409817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705006cd40 con 0x7f70500ce0e0 2023-03-03T06:25:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.776+0000 7f704cff9700 1 -- 172.21.15.5:0/4134409817 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7040021070 con 0x7f70500ce0e0 2023-03-03T06:25:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.777+0000 7f704cff9700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70300682f0 0x7f703006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.777+0000 7f704cff9700 1 -- 172.21.15.5:0/4134409817 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5883+0+0 (secure 0 0 0) 0x7f7040085ab0 con 0x7f70500ce0e0 2023-03-03T06:25:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.777+0000 7f704f7fe700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70300682f0 0x7f703006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.777+0000 7f704f7fe700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70300682f0 0x7f703006a7a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7050154cd0 tx=0x7f7038008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.781+0000 7f704cff9700 1 -- 172.21.15.5:0/4134409817 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f70400523c0 con 0x7f70500ce0e0 2023-03-03T06:25:53.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.978+0000 7f705519e700 1 -- 172.21.15.5:0/4134409817 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f705004e6e0 con 0x7f70500ce0e0 2023-03-03T06:25:53.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.979+0000 7f704cff9700 1 -- 172.21.15.5:0/4134409817 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+198 (secure 0 0 0) 0x7f704001f020 con 0x7f70500ce0e0 2023-03-03T06:25:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:53.981 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-03-03T06:25:53.981 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-03-03T06:25:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-03-03T06:25:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-03-03T06:25:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-03-03T06:25:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:25:53.982 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:25:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 8, 2023-03-03T06:25:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "snap-test-pool" 2023-03-03T06:25:53.983 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:25:53.983 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-03-03T06:25:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.981+0000 7f705519e700 1 -- 172.21.15.5:0/4134409817 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70300682f0 msgr2=0x7f703006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.981+0000 7f705519e700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70300682f0 0x7f703006a7a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7050154cd0 tx=0x7f7038008040 comp rx=0 tx=0).stop 2023-03-03T06:25:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.981+0000 7f705519e700 1 -- 172.21.15.5:0/4134409817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70500ce0e0 msgr2=0x7f7050155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.981+0000 7f705519e700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70500ce0e0 0x7f7050155270 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f704000c7f0 tx=0x7f704000cbb0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.981+0000 7f705519e700 1 -- 172.21.15.5:0/4134409817 shutdown_connections 2023-03-03T06:25:53.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.981+0000 7f705519e700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f70300682f0 0x7f703006a7a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.981+0000 7f705519e700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7050159310 0x7f70500b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.981+0000 7f705519e700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70500ce0e0 0x7f7050155270 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.981+0000 7f705519e700 1 --2- 172.21.15.5:0/4134409817 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f70500cfdc0 0x7f70500aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:53.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.981+0000 7f705519e700 1 -- 172.21.15.5:0/4134409817 >> 172.21.15.5:0/4134409817 conn(0x7f705006dc50 msgr2=0x7f70500b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:53.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.981+0000 7f705519e700 1 -- 172.21.15.5:0/4134409817 shutdown_connections 2023-03-03T06:25:53.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:53.981+0000 7f705519e700 1 -- 172.21.15.5:0/4134409817 wait complete. 2023-03-03T06:25:53.995 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-03T06:25:53.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-03T06:25:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.121+0000 7f44bcb40700 1 Processor -- start 2023-03-03T06:25:54.124 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.122+0000 7f44bcb40700 1 -- start start 2023-03-03T06:25:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.122+0000 7f44bcb40700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f44b806d560 0x7f44b815d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44bcb40700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44b80ca420 0x7f44b80ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44bcb40700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b80c9f40 con 0x7f44b806d930 2023-03-03T06:25:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44bcb40700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b815a200 con 0x7f44b80ca420 2023-03-03T06:25:54.126 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44bcb40700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b815d6c0 con 0x7f44b806d560 2023-03-03T06:25:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44b6d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44b80ca420 0x7f44b80ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44b6d9d700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f44b80ca420 0x7f44b80ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45362/0 (socket says 172.21.15.5:45362) 2023-03-03T06:25:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44b6d9d700 1 -- 172.21.15.5:0/2989093270 learned_addr learned my addr 172.21.15.5:0/2989093270 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44b659c700 1 --2- 172.21.15.5:0/2989093270 >> v2:172.21.15.191:3300/0 conn(0x7f44b806d560 0x7f44b815d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44b6d9d700 1 -- 172.21.15.5:0/2989093270 >> v2:172.21.15.191:3300/0 conn(0x7f44b806d560 msgr2=0x7f44b815d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44b6d9d700 1 --2- 172.21.15.5:0/2989093270 >> v2:172.21.15.191:3300/0 conn(0x7f44b806d560 0x7f44b815d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.127 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44b6d9d700 1 -- 172.21.15.5:0/2989093270 >> v1:172.21.15.191:6789/0 conn(0x7f44b806d930 legacy=0x7f44b8158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44b6d9d700 1 -- 172.21.15.5:0/2989093270 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b80cb9c0 con 0x7f44b80ca420 2023-03-03T06:25:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44b659c700 1 --2- 172.21.15.5:0/2989093270 >> v2:172.21.15.191:3300/0 conn(0x7f44b806d560 0x7f44b815d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44b6d9d700 1 --2- 172.21.15.5:0/2989093270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44b80ca420 0x7f44b80ca840 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f44b80cfd40 tx=0x7f44b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e214f42c132a01d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44b559a700 1 -- 172.21.15.5:0/2989093270 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000e070 con 0x7f44b80ca420 2023-03-03T06:25:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44b559a700 1 -- 172.21.15.5:0/2989093270 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b0003a20 con 0x7f44b80ca420 2023-03-03T06:25:54.128 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.123+0000 7f44b559a700 1 -- 172.21.15.5:0/2989093270 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0003dd0 con 0x7f44b80ca420 2023-03-03T06:25:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.124+0000 7f44bcb40700 1 -- 172.21.15.5:0/2989093270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44b80ca420 msgr2=0x7f44b80ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.124+0000 7f44bcb40700 1 --2- 172.21.15.5:0/2989093270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44b80ca420 0x7f44b80ca840 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f44b80cfd40 tx=0x7f44b000b330 comp rx=0 tx=0).stop 2023-03-03T06:25:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.124+0000 7f44bcb40700 1 -- 172.21.15.5:0/2989093270 shutdown_connections 2023-03-03T06:25:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.124+0000 7f44bcb40700 1 --2- 172.21.15.5:0/2989093270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44b80ca420 0x7f44b80ca840 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.124+0000 7f44bcb40700 1 --2- 172.21.15.5:0/2989093270 >> v2:172.21.15.191:3300/0 conn(0x7f44b806d560 0x7f44b815d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.124+0000 7f44bcb40700 1 -- 172.21.15.5:0/2989093270 >> 172.21.15.5:0/2989093270 conn(0x7f44b80b1bd0 msgr2=0x7f44b80cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:54.129 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.124+0000 7f44bcb40700 1 -- 172.21.15.5:0/2989093270 shutdown_connections 2023-03-03T06:25:54.130 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.124+0000 7f44bcb40700 1 -- 172.21.15.5:0/2989093270 wait complete. 2023-03-03T06:25:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.125+0000 7f44bcb40700 1 Processor -- start 2023-03-03T06:25:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.125+0000 7f44bcb40700 1 -- start start 2023-03-03T06:25:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44bcb40700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44b806d560 0x7f44b80c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:54.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44bcb40700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44b806d930 0x7f44b814a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44bcb40700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44b80ca420 0x7f44b815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44bcb40700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80b2ca0 con 0x7f44b806d930 2023-03-03T06:25:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44bcb40700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b814a970 con 0x7f44b806d560 2023-03-03T06:25:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44bcb40700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b815c720 con 0x7f44b80ca420 2023-03-03T06:25:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44b5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44b806d930 0x7f44b814a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44b5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44b806d930 0x7f44b814a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45366/0 (socket says 172.21.15.5:45366) 2023-03-03T06:25:54.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44b5d9b700 1 -- 172.21.15.5:0/129102834 learned_addr learned my addr 172.21.15.5:0/129102834 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44b659c700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44b806d560 0x7f44b80c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44b6d9d700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44b80ca420 0x7f44b815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44b5d9b700 1 -- 172.21.15.5:0/129102834 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44b80ca420 msgr2=0x7f44b815bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44b5d9b700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44b80ca420 0x7f44b815bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44b5d9b700 1 -- 172.21.15.5:0/129102834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44b806d560 msgr2=0x7f44b80c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.126+0000 7f44b5d9b700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44b806d560 0x7f44b80c5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.127+0000 7f44b5d9b700 1 -- 172.21.15.5:0/129102834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0009b30 con 0x7f44b806d930 2023-03-03T06:25:54.134 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.127+0000 7f44b6d9d700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44b80ca420 0x7f44b815bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.127+0000 7f44b5d9b700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44b806d930 0x7f44b814a430 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f44a000c4d0 tx=0x7f44a000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.127+0000 7f44aeffd700 1 -- 172.21.15.5:0/129102834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0011790 con 0x7f44b806d930 2023-03-03T06:25:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.127+0000 7f44aeffd700 1 -- 172.21.15.5:0/129102834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a00118f0 con 0x7f44b806d930 2023-03-03T06:25:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.127+0000 7f44bcb40700 1 -- 172.21.15.5:0/129102834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b8159960 con 0x7f44b806d930 2023-03-03T06:25:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.127+0000 7f44aeffd700 1 -- 172.21.15.5:0/129102834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0011ca0 con 0x7f44b806d930 2023-03-03T06:25:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.127+0000 7f44bcb40700 1 -- 172.21.15.5:0/129102834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b8159680 con 0x7f44b806d930 2023-03-03T06:25:54.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.128+0000 7f44bcb40700 1 -- 172.21.15.5:0/129102834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b8159c40 con 0x7f44b806d930 2023-03-03T06:25:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.128+0000 7f44aeffd700 1 -- 172.21.15.5:0/129102834 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f44a0010050 con 0x7f44b806d930 2023-03-03T06:25:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.129+0000 7f44aeffd700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4498068320 0x7f449806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.129+0000 7f44aeffd700 1 -- 172.21.15.5:0/129102834 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5883+0+0 (secure 0 0 0) 0x7f44a0085800 con 0x7f44b806d930 2023-03-03T06:25:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.129+0000 7f44b659c700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4498068320 0x7f449806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:54.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.129+0000 7f44b659c700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4498068320 0x7f449806a7d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f44a8006fd0 tx=0x7f44a8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:54.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.133+0000 7f44aeffd700 1 -- 172.21.15.5:0/129102834 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f44a0052090 con 0x7f44b806d930 2023-03-03T06:25:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.325+0000 7f44bcb40700 1 -- 172.21.15.5:0/129102834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f44b80cbd20 con 0x7f44b806d930 2023-03-03T06:25:54.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.650+0000 7f44aeffd700 1 -- 172.21.15.5:0/129102834 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7f44a00556b0 con 0x7f44b806d930 2023-03-03T06:25:54.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.654+0000 7f44bcb40700 1 -- 172.21.15.5:0/129102834 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4498068320 msgr2=0x7f449806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.654+0000 7f44bcb40700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4498068320 0x7f449806a7d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f44a8006fd0 tx=0x7f44a8008040 comp rx=0 tx=0).stop 2023-03-03T06:25:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.654+0000 7f44bcb40700 1 -- 172.21.15.5:0/129102834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44b806d930 msgr2=0x7f44b814a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.654+0000 7f44bcb40700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44b806d930 0x7f44b814a430 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f44a000c4d0 tx=0x7f44a000c7e0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.655+0000 7f44bcb40700 1 -- 172.21.15.5:0/129102834 shutdown_connections 2023-03-03T06:25:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.655+0000 7f44bcb40700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4498068320 0x7f449806a7d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.655+0000 7f44bcb40700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f44b80ca420 0x7f44b815bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.659 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.655+0000 7f44bcb40700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f44b806d560 0x7f44b80c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.655+0000 7f44bcb40700 1 --2- 172.21.15.5:0/129102834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44b806d930 0x7f44b814a430 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.655+0000 7f44bcb40700 1 -- 172.21.15.5:0/129102834 >> 172.21.15.5:0/129102834 conn(0x7f44b80b1bd0 msgr2=0x7f44b8158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:54.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.656+0000 7f44bcb40700 1 -- 172.21.15.5:0/129102834 shutdown_connections 2023-03-03T06:25:54.660 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.656+0000 7f44bcb40700 1 -- 172.21.15.5:0/129102834 wait complete. 2023-03-03T06:25:54.661 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-03-03T06:25:54.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-03-03T06:25:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.806+0000 7f55b3be0700 1 Processor -- start 2023-03-03T06:25:54.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.806+0000 7f55b3be0700 1 -- start start 2023-03-03T06:25:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b3be0700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f55ac0cbf00 0x7f55ac0b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b3be0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55ac0b1d80 0x7f55ac0b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b3be0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac15ac90 con 0x7f55ac15a8c0 2023-03-03T06:25:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b3be0700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ac0b2200 con 0x7f55ac0cbf00 2023-03-03T06:25:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b3be0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0cae60 con 0x7f55ac0b1d80 2023-03-03T06:25:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b197c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f55ac15a8c0 0x7f55ac0ca410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35214/0 (socket says 172.21.15.5:35214) 2023-03-03T06:25:54.810 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b197c700 1 -- 172.21.15.5:0/3817325076 learned_addr learned my addr 172.21.15.5:0/3817325076 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b117b700 1 --2- 172.21.15.5:0/3817325076 >> v2:172.21.15.191:3300/0 conn(0x7f55ac0cbf00 0x7f55ac0b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b217d700 1 --2- 172.21.15.5:0/3817325076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55ac0b1d80 0x7f55ac0b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b097a700 1 -- 172.21.15.5:0/3817325076 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604644979 0 0) 0x7f55ac15ac90 con 0x7f55ac15a8c0 2023-03-03T06:25:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b097a700 1 -- 172.21.15.5:0/3817325076 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55980035b0 con 0x7f55ac15a8c0 2023-03-03T06:25:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b097a700 1 -- 172.21.15.5:0/3817325076 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1346806860 0 0) 0x7f55980035b0 con 0x7f55ac15a8c0 2023-03-03T06:25:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b117b700 1 -- 172.21.15.5:0/3817325076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55ac0b1d80 msgr2=0x7f55ac0b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:54.811 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b117b700 1 --2- 172.21.15.5:0/3817325076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55ac0b1d80 0x7f55ac0b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b117b700 1 -- 172.21.15.5:0/3817325076 >> v1:172.21.15.5:6789/0 conn(0x7f55ac15a8c0 legacy=0x7f55ac0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b117b700 1 -- 172.21.15.5:0/3817325076 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac0cb140 con 0x7f55ac0cbf00 2023-03-03T06:25:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.807+0000 7f55b217d700 1 --2- 172.21.15.5:0/3817325076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55ac0b1d80 0x7f55ac0b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.808+0000 7f55b117b700 1 --2- 172.21.15.5:0/3817325076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac0cbf00 0x7f55ac0b1840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f559c009840 tx=0x7f559c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8383fe6a8f8c9fe server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.808+0000 7f55b097a700 1 -- 172.21.15.5:0/3817325076 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8001670 con 0x7f55ac0cbf00 2023-03-03T06:25:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.808+0000 7f55b097a700 1 -- 172.21.15.5:0/3817325076 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c004030 con 0x7f55ac0cbf00 2023-03-03T06:25:54.812 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.808+0000 7f55b097a700 1 -- 172.21.15.5:0/3817325076 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c0043c0 con 0x7f55ac0cbf00 2023-03-03T06:25:54.814 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.808+0000 7f55b3be0700 1 -- 172.21.15.5:0/3817325076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac0cbf00 msgr2=0x7f55ac0b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:54.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.808+0000 7f55b3be0700 1 --2- 172.21.15.5:0/3817325076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac0cbf00 0x7f55ac0b1840 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f559c009840 tx=0x7f559c009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:54.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.808+0000 7f55b3be0700 1 -- 172.21.15.5:0/3817325076 shutdown_connections 2023-03-03T06:25:54.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.808+0000 7f55b3be0700 1 --2- 172.21.15.5:0/3817325076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55ac0b1d80 0x7f55ac0b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.808+0000 7f55b3be0700 1 --2- 172.21.15.5:0/3817325076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac0cbf00 0x7f55ac0b1840 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.808+0000 7f55b3be0700 1 -- 172.21.15.5:0/3817325076 >> 172.21.15.5:0/3817325076 conn(0x7f55ac0cc840 msgr2=0x7f55ac0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:54.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.809+0000 7f55b3be0700 1 -- 172.21.15.5:0/3817325076 shutdown_connections 2023-03-03T06:25:54.815 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.809+0000 7f55b3be0700 1 -- 172.21.15.5:0/3817325076 wait complete. 2023-03-03T06:25:54.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.810+0000 7f55b3be0700 1 Processor -- start 2023-03-03T06:25:54.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.810+0000 7f55b3be0700 1 -- start start 2023-03-03T06:25:54.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b3be0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55ac0b1d80 0x7f55ac0c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:54.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b3be0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac0cbf00 0x7f55ac149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:54.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b3be0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55ac15a8c0 0x7f55ac14a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:54.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b3be0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0c5310 con 0x7f55ac15a8c0 2023-03-03T06:25:54.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b3be0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0cf910 con 0x7f55ac0cbf00 2023-03-03T06:25:54.816 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b3be0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0c49e0 con 0x7f55ac0b1d80 2023-03-03T06:25:54.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b217d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55ac15a8c0 0x7f55ac14a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:54.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b217d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55ac15a8c0 0x7f55ac14a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45382/0 (socket says 172.21.15.5:45382) 2023-03-03T06:25:54.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b217d700 1 -- 172.21.15.5:0/946026186 learned_addr learned my addr 172.21.15.5:0/946026186 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:54.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b197c700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55ac0b1d80 0x7f55ac0c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:54.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b117b700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac0cbf00 0x7f55ac149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:54.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b217d700 1 -- 172.21.15.5:0/946026186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55ac0b1d80 msgr2=0x7f55ac0c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:54.817 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b217d700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55ac0b1d80 0x7f55ac0c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b217d700 1 -- 172.21.15.5:0/946026186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac0cbf00 msgr2=0x7f55ac149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:54.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b217d700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac0cbf00 0x7f55ac149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:54.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b217d700 1 -- 172.21.15.5:0/946026186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a4009a70 con 0x7f55ac15a8c0 2023-03-03T06:25:54.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b217d700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55ac15a8c0 0x7f55ac14a070 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f55a400efc0 tx=0x7f55a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:54.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55a27fc700 1 -- 172.21.15.5:0/946026186 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4009cd0 con 0x7f55ac15a8c0 2023-03-03T06:25:54.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55a27fc700 1 -- 172.21.15.5:0/946026186 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a400f040 con 0x7f55ac15a8c0 2023-03-03T06:25:54.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b3be0700 1 -- 172.21.15.5:0/946026186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c0094a0 con 0x7f55ac15a8c0 2023-03-03T06:25:54.818 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55a27fc700 1 -- 172.21.15.5:0/946026186 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a400cd60 con 0x7f55ac15a8c0 2023-03-03T06:25:54.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.811+0000 7f55b3be0700 1 -- 172.21.15.5:0/946026186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ac0cb700 con 0x7f55ac15a8c0 2023-03-03T06:25:54.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.812+0000 7f55b3be0700 1 -- 172.21.15.5:0/946026186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ac0cb420 con 0x7f55ac15a8c0 2023-03-03T06:25:54.819 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.813+0000 7f55a27fc700 1 -- 172.21.15.5:0/946026186 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f55a4014480 con 0x7f55ac15a8c0 2023-03-03T06:25:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.813+0000 7f55a27fc700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f55900682f0 0x7f559006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.813+0000 7f55a27fc700 1 -- 172.21.15.5:0/946026186 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6253+0+0 (secure 0 0 0) 0x7f55a4086610 con 0x7f55ac15a8c0 2023-03-03T06:25:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.813+0000 7f55b197c700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f55900682f0 0x7f559006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.814+0000 7f55b197c700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f55900682f0 0x7f559006a7a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f55a8001eb0 tx=0x7f55a8001ce0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:54.820 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:54.818+0000 7f55a27fc700 1 -- 172.21.15.5:0/946026186 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f55a4052d30 con 0x7f55ac15a8c0 2023-03-03T06:25:55.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.013+0000 7f55b3be0700 1 -- 172.21.15.5:0/946026186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f55ac0cb9e0 con 0x7f55ac15a8c0 2023-03-03T06:25:55.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.654+0000 7f55a27fc700 1 -- 172.21.15.5:0/946026186 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) v1 ==== 170+0+0 (secure 0 0 0) 0x7f55a4056350 con 0x7f55ac15a8c0 2023-03-03T06:25:55.661 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.659+0000 7f55b3be0700 1 -- 172.21.15.5:0/946026186 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f55900682f0 msgr2=0x7f559006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.659+0000 7f55b3be0700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f55900682f0 0x7f559006a7a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f55a8001eb0 tx=0x7f55a8001ce0 comp rx=0 tx=0).stop 2023-03-03T06:25:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.659+0000 7f55b3be0700 1 -- 172.21.15.5:0/946026186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55ac15a8c0 msgr2=0x7f55ac14a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.659+0000 7f55b3be0700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55ac15a8c0 0x7f55ac14a070 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f55a400efc0 tx=0x7f55a400c3a0 comp rx=0 tx=0).stop 2023-03-03T06:25:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.660+0000 7f55b3be0700 1 -- 172.21.15.5:0/946026186 shutdown_connections 2023-03-03T06:25:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.660+0000 7f55b3be0700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55ac15a8c0 0x7f55ac14a070 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.660+0000 7f55b3be0700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f55900682f0 0x7f559006a7a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:55.662 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.660+0000 7f55b3be0700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55ac0b1d80 0x7f55ac0c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:55.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.660+0000 7f55b3be0700 1 --2- 172.21.15.5:0/946026186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55ac0cbf00 0x7f55ac149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:55.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.660+0000 7f55b3be0700 1 -- 172.21.15.5:0/946026186 >> 172.21.15.5:0/946026186 conn(0x7f55ac0cc840 msgr2=0x7f55ac0cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:55.663 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.662+0000 7f55b3be0700 1 -- 172.21.15.5:0/946026186 shutdown_connections 2023-03-03T06:25:55.664 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.662+0000 7f55b3be0700 1 -- 172.21.15.5:0/946026186 wait complete. 2023-03-03T06:25:55.667 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-03-03T06:25:55.690 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-03T06:25:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.821+0000 7f4b740e0700 1 Processor -- start 2023-03-03T06:25:55.824 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.822+0000 7f4b740e0700 1 -- start start 2023-03-03T06:25:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.822+0000 7f4b740e0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b6c15d210 0x7f4b6c06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.822+0000 7f4b740e0700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4b6c06dbe0 0x7f4b6c0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:55.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.822+0000 7f4b740e0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6c06afa0 con 0x7f4b6c158c00 2023-03-03T06:25:55.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.822+0000 7f4b740e0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c06e060 con 0x7f4b6c15d210 2023-03-03T06:25:55.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.822+0000 7f4b740e0700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c0cb400 con 0x7f4b6c06dbe0 2023-03-03T06:25:55.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.822+0000 7f4b7167b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b6c15d210 0x7f4b6c06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:55.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.823+0000 7f4b7167b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4b6c15d210 0x7f4b6c06d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45386/0 (socket says 172.21.15.5:45386) 2023-03-03T06:25:55.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.823+0000 7f4b7167b700 1 -- 172.21.15.5:0/1746473627 learned_addr learned my addr 172.21.15.5:0/1746473627 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:55.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.823+0000 7f4b7267d700 1 --2- 172.21.15.5:0/1746473627 >> v2:172.21.15.191:3300/0 conn(0x7f4b6c06dbe0 0x7f4b6c0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:55.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.823+0000 7f4b7167b700 1 -- 172.21.15.5:0/1746473627 >> v2:172.21.15.191:3300/0 conn(0x7f4b6c06dbe0 msgr2=0x7f4b6c0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:55.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.823+0000 7f4b7167b700 1 --2- 172.21.15.5:0/1746473627 >> v2:172.21.15.191:3300/0 conn(0x7f4b6c06dbe0 0x7f4b6c0cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:55.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.823+0000 7f4b7167b700 1 -- 172.21.15.5:0/1746473627 >> v1:172.21.15.5:6789/0 conn(0x7f4b6c158c00 legacy=0x7f4b6c0ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:55.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.823+0000 7f4b70e7a700 1 -- 172.21.15.5:0/1746473627 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182968776 0 0) 0x7f4b6c06afa0 con 0x7f4b6c158c00 2023-03-03T06:25:55.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.823+0000 7f4b7167b700 1 -- 172.21.15.5:0/1746473627 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0ca7f0 con 0x7f4b6c15d210 2023-03-03T06:25:55.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.823+0000 7f4b7167b700 1 --2- 172.21.15.5:0/1746473627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15d210 0x7f4b6c06d6a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0725a0 tx=0x7f4b6800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad528bbb576015ad server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:55.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.823+0000 7f4b70e7a700 1 -- 172.21.15.5:0/1746473627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6800dc20 con 0x7f4b6c15d210 2023-03-03T06:25:55.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.823+0000 7f4b70e7a700 1 -- 172.21.15.5:0/1746473627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6800dd80 con 0x7f4b6c15d210 2023-03-03T06:25:55.827 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.823+0000 7f4b70e7a700 1 -- 172.21.15.5:0/1746473627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68017630 con 0x7f4b6c15d210 2023-03-03T06:25:55.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.824+0000 7f4b740e0700 1 -- 172.21.15.5:0/1746473627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15d210 msgr2=0x7f4b6c06d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:55.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.824+0000 7f4b740e0700 1 --2- 172.21.15.5:0/1746473627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15d210 0x7f4b6c06d6a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0725a0 tx=0x7f4b6800be70 comp rx=0 tx=0).stop 2023-03-03T06:25:55.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.824+0000 7f4b740e0700 1 -- 172.21.15.5:0/1746473627 shutdown_connections 2023-03-03T06:25:55.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.824+0000 7f4b740e0700 1 --2- 172.21.15.5:0/1746473627 >> v2:172.21.15.191:3300/0 conn(0x7f4b6c06dbe0 0x7f4b6c0cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:55.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.824+0000 7f4b740e0700 1 --2- 172.21.15.5:0/1746473627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15d210 0x7f4b6c06d6a0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:55.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.824+0000 7f4b740e0700 1 -- 172.21.15.5:0/1746473627 >> 172.21.15.5:0/1746473627 conn(0x7f4b6c0b1c50 msgr2=0x7f4b6c0cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:55.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.824+0000 7f4b740e0700 1 -- 172.21.15.5:0/1746473627 shutdown_connections 2023-03-03T06:25:55.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.824+0000 7f4b740e0700 1 -- 172.21.15.5:0/1746473627 wait complete. 2023-03-03T06:25:55.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.825+0000 7f4b740e0700 1 Processor -- start 2023-03-03T06:25:55.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.825+0000 7f4b740e0700 1 -- start start 2023-03-03T06:25:55.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b740e0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b6c06dbe0 0x7f4b6c14b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:55.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b740e0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b6c158c00 0x7f4b6c15afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:55.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b740e0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15d210 0x7f4b6c15b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:55.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b740e0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c14c3b0 con 0x7f4b6c15d210 2023-03-03T06:25:55.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b740e0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c14be50 con 0x7f4b6c158c00 2023-03-03T06:25:55.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b740e0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0c7120 con 0x7f4b6c06dbe0 2023-03-03T06:25:55.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b7267d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15d210 0x7f4b6c15b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:55.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b7267d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15d210 0x7f4b6c15b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45394/0 (socket says 172.21.15.5:45394) 2023-03-03T06:25:55.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b7267d700 1 -- 172.21.15.5:0/1871960553 learned_addr learned my addr 172.21.15.5:0/1871960553 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:55.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b71e7c700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b6c06dbe0 0x7f4b6c14b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:55.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b7167b700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b6c158c00 0x7f4b6c15afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:55.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b7267d700 1 -- 172.21.15.5:0/1871960553 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b6c06dbe0 msgr2=0x7f4b6c14b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:55.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b7267d700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b6c06dbe0 0x7f4b6c14b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:55.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b7267d700 1 -- 172.21.15.5:0/1871960553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b6c158c00 msgr2=0x7f4b6c15afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:55.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b7267d700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b6c158c00 0x7f4b6c15afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:55.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.826+0000 7f4b7267d700 1 -- 172.21.15.5:0/1871960553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6800b7f0 con 0x7f4b6c15d210 2023-03-03T06:25:55.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.827+0000 7f4b7267d700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15d210 0x7f4b6c15b520 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4b64007e90 tx=0x7f4b6400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:55.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.827+0000 7f4b627fc700 1 -- 172.21.15.5:0/1871960553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6400ede0 con 0x7f4b6c15d210 2023-03-03T06:25:55.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.827+0000 7f4b627fc700 1 -- 172.21.15.5:0/1871960553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b64014420 con 0x7f4b6c15d210 2023-03-03T06:25:55.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.827+0000 7f4b740e0700 1 -- 172.21.15.5:0/1871960553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c0cadb0 con 0x7f4b6c15d210 2023-03-03T06:25:55.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.827+0000 7f4b627fc700 1 -- 172.21.15.5:0/1871960553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640147d0 con 0x7f4b6c15d210 2023-03-03T06:25:55.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.827+0000 7f4b740e0700 1 -- 172.21.15.5:0/1871960553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c0caad0 con 0x7f4b6c15d210 2023-03-03T06:25:55.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.828+0000 7f4b740e0700 1 -- 172.21.15.5:0/1871960553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6c0cb090 con 0x7f4b6c15d210 2023-03-03T06:25:55.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.828+0000 7f4b627fc700 1 -- 172.21.15.5:0/1871960553 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4b64012050 con 0x7f4b6c15d210 2023-03-03T06:25:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.829+0000 7f4b627fc700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4b500682f0 0x7f4b5006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.829+0000 7f4b627fc700 1 -- 172.21.15.5:0/1871960553 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6635+0+0 (secure 0 0 0) 0x7f4b64086500 con 0x7f4b6c15d210 2023-03-03T06:25:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.829+0000 7f4b71e7c700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4b500682f0 0x7f4b5006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.829+0000 7f4b71e7c700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4b500682f0 0x7f4b5006a7a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c000f60 tx=0x7f4b5c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:55.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:55.833+0000 7f4b627fc700 1 -- 172.21.15.5:0/1871960553 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4b64052b20 con 0x7f4b6c15d210 2023-03-03T06:25:56.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.072+0000 7f4b740e0700 1 -- 172.21.15.5:0/1871960553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4b6c04e6e0 con 0x7f4b6c15d210 2023-03-03T06:25:56.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.077+0000 7f4b627fc700 1 -- 172.21.15.5:0/1871960553 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v29) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4b64056140 con 0x7f4b6c15d210 2023-03-03T06:25:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.082+0000 7f4b740e0700 1 -- 172.21.15.5:0/1871960553 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4b500682f0 msgr2=0x7f4b5006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.082+0000 7f4b740e0700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4b500682f0 0x7f4b5006a7a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c000f60 tx=0x7f4b5c009040 comp rx=0 tx=0).stop 2023-03-03T06:25:56.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.082+0000 7f4b740e0700 1 -- 172.21.15.5:0/1871960553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15d210 msgr2=0x7f4b6c15b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.082+0000 7f4b740e0700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15d210 0x7f4b6c15b520 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4b64007e90 tx=0x7f4b6400e3c0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.084+0000 7f4b740e0700 1 -- 172.21.15.5:0/1871960553 shutdown_connections 2023-03-03T06:25:56.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.084+0000 7f4b740e0700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b6c15d210 0x7f4b6c15b520 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.084+0000 7f4b740e0700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4b500682f0 0x7f4b5006a7a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.084+0000 7f4b740e0700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4b6c06dbe0 0x7f4b6c14b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.084+0000 7f4b740e0700 1 --2- 172.21.15.5:0/1871960553 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4b6c158c00 0x7f4b6c15afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.084+0000 7f4b740e0700 1 -- 172.21.15.5:0/1871960553 >> 172.21.15.5:0/1871960553 conn(0x7f4b6c0b1c50 msgr2=0x7f4b6c06b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:56.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.085+0000 7f4b740e0700 1 -- 172.21.15.5:0/1871960553 shutdown_connections 2023-03-03T06:25:56.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.088+0000 7f4b740e0700 1 -- 172.21.15.5:0/1871960553 wait complete. 2023-03-03T06:25:56.096 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 11 and data pool 12 2023-03-03T06:25:56.112 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:56.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.234+0000 7f5e3b394700 1 Processor -- start 2023-03-03T06:25:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.235+0000 7f5e3b394700 1 -- start start 2023-03-03T06:25:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.235+0000 7f5e3b394700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e340cb0e0 0x7f5e340cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e3b394700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3406e630 con 0x7f5e340cac40 2023-03-03T06:25:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e3b394700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e34157320 con 0x7f5e34156f50 2023-03-03T06:25:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e3b394700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3415d1c0 con 0x7f5e340cb0e0 2023-03-03T06:25:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e3892f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5e340cac40 0x7f5e340ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35244/0 (socket says 172.21.15.5:35244) 2023-03-03T06:25:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e3892f700 1 -- 172.21.15.5:0/3512322338 learned_addr learned my addr 172.21.15.5:0/3512322338 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e39931700 1 --2- 172.21.15.5:0/3512322338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e340cb0e0 0x7f5e340cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22906223 0 0) 0x7f5e3406e630 con 0x7f5e340cac40 2023-03-03T06:25:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e200035b0 con 0x7f5e340cac40 2023-03-03T06:25:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4248758869 0 0) 0x7f5e200035b0 con 0x7f5e340cac40 2023-03-03T06:25:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e340cb0e0 msgr2=0x7f5e340cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 --2- 172.21.15.5:0/3512322338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e340cb0e0 0x7f5e340cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 >> v1:172.21.15.191:6789/0 conn(0x7f5e34156f50 legacy=0x7f5e3406df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3415d4a0 con 0x7f5e340cac40 2023-03-03T06:25:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f5e28001670 con 0x7f5e340cac40 2023-03-03T06:25:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 >> v1:172.21.15.5:6789/0 conn(0x7f5e340cac40 legacy=0x7f5e340ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 --2- 172.21.15.5:0/3512322338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e20003aa0 0x7f5e20003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 --2- 172.21.15.5:0/3512322338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e20004850 0x7f5e20004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 --2- 172.21.15.5:0/3512322338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e340cb0e0 0x7f5e20005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3415d1c0 con 0x7f5e20003aa0 2023-03-03T06:25:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2000baf0 con 0x7f5e20004850 2023-03-03T06:25:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2000bcb0 con 0x7f5e340cb0e0 2023-03-03T06:25:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e39130700 1 --2- 172.21.15.5:0/3512322338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e20003aa0 0x7f5e20003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.236+0000 7f5e3892f700 1 --2- 172.21.15.5:0/3512322338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e20004850 0x7f5e20004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.237+0000 7f5e39931700 1 --2- 172.21.15.5:0/3512322338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e340cb0e0 0x7f5e20005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.237+0000 7f5e39130700 1 -- 172.21.15.5:0/3512322338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e340cb0e0 msgr2=0x7f5e20005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.237+0000 7f5e39130700 1 --2- 172.21.15.5:0/3512322338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e340cb0e0 0x7f5e20005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.237+0000 7f5e39130700 1 -- 172.21.15.5:0/3512322338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e20004850 msgr2=0x7f5e20004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.237+0000 7f5e39130700 1 --2- 172.21.15.5:0/3512322338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e20004850 0x7f5e20004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.237+0000 7f5e39130700 1 -- 172.21.15.5:0/3512322338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e200035b0 con 0x7f5e20003aa0 2023-03-03T06:25:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.237+0000 7f5e39130700 1 --2- 172.21.15.5:0/3512322338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e20003aa0 0x7f5e20003eb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5e300017c0 tx=0x7f5e20005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2797ee99b10430c8 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.237+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e300052d0 con 0x7f5e20003aa0 2023-03-03T06:25:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.237+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e30005430 con 0x7f5e20003aa0 2023-03-03T06:25:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.237+0000 7f5e27fff700 1 -- 172.21.15.5:0/3512322338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e300038c0 con 0x7f5e20003aa0 2023-03-03T06:25:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.237+0000 7f5e3b394700 1 -- 172.21.15.5:0/3512322338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e20003aa0 msgr2=0x7f5e20003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.237+0000 7f5e3b394700 1 --2- 172.21.15.5:0/3512322338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e20003aa0 0x7f5e20003eb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5e300017c0 tx=0x7f5e20005880 comp rx=0 tx=0).stop 2023-03-03T06:25:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.237+0000 7f5e39931700 1 -- 172.21.15.5:0/3512322338 reap_dead start 2023-03-03T06:25:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.238+0000 7f5e3b394700 1 -- 172.21.15.5:0/3512322338 shutdown_connections 2023-03-03T06:25:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.238+0000 7f5e3b394700 1 -- 172.21.15.5:0/3512322338 >> 172.21.15.5:0/3512322338 conn(0x7f5e340cfd00 msgr2=0x7f5e340d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.238+0000 7f5e3b394700 1 -- 172.21.15.5:0/3512322338 shutdown_connections 2023-03-03T06:25:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.238+0000 7f5e3b394700 1 -- 172.21.15.5:0/3512322338 wait complete. 2023-03-03T06:25:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.239+0000 7f5e3b394700 1 Processor -- start 2023-03-03T06:25:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.239+0000 7f5e3b394700 1 -- start start 2023-03-03T06:25:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3b394700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e20003aa0 0x7f5e340c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3b394700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340b0820 0x7f5e340b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3b394700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e341f59e0 0x7f5e341f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3b394700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e340b11d0 con 0x7f5e340b0820 2023-03-03T06:25:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3b394700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e341f6710 con 0x7f5e341f59e0 2023-03-03T06:25:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3b394700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34148e50 con 0x7f5e20003aa0 2023-03-03T06:25:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3892f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340b0820 0x7f5e340b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3892f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340b0820 0x7f5e340b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45414/0 (socket says 172.21.15.5:45414) 2023-03-03T06:25:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3892f700 1 -- 172.21.15.5:0/1648445483 learned_addr learned my addr 172.21.15.5:0/1648445483 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e39130700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e20003aa0 0x7f5e340c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e39931700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e341f59e0 0x7f5e341f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3892f700 1 -- 172.21.15.5:0/1648445483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e20003aa0 msgr2=0x7f5e340c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3892f700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e20003aa0 0x7f5e340c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3892f700 1 -- 172.21.15.5:0/1648445483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e341f59e0 msgr2=0x7f5e341f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3892f700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e341f59e0 0x7f5e341f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3892f700 1 -- 172.21.15.5:0/1648445483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3415da60 con 0x7f5e340b0820 2023-03-03T06:25:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3892f700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340b0820 0x7f5e340b0c90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5e280072c0 tx=0x7f5e28007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e25ffb700 1 -- 172.21.15.5:0/1648445483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2800f850 con 0x7f5e340b0820 2023-03-03T06:25:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e25ffb700 1 -- 172.21.15.5:0/1648445483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2800f9d0 con 0x7f5e340b0820 2023-03-03T06:25:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e3b394700 1 -- 172.21.15.5:0/1648445483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3415d780 con 0x7f5e340b0820 2023-03-03T06:25:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.240+0000 7f5e25ffb700 1 -- 172.21.15.5:0/1648445483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2800fd80 con 0x7f5e340b0820 2023-03-03T06:25:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.241+0000 7f5e3b394700 1 -- 172.21.15.5:0/1648445483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e340cb500 con 0x7f5e340b0820 2023-03-03T06:25:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.241+0000 7f5e3b394700 1 -- 172.21.15.5:0/1648445483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e34148ca0 con 0x7f5e340b0820 2023-03-03T06:25:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.242+0000 7f5e25ffb700 1 -- 172.21.15.5:0/1648445483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5e2801d460 con 0x7f5e340b0820 2023-03-03T06:25:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.242+0000 7f5e25ffb700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5e180682f0 0x7f5e1806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.242+0000 7f5e25ffb700 1 -- 172.21.15.5:0/1648445483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5e28086000 con 0x7f5e340b0820 2023-03-03T06:25:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.242+0000 7f5e39130700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5e180682f0 0x7f5e1806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.243+0000 7f5e39130700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5e180682f0 0x7f5e1806a7a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5e30000c00 tx=0x7f5e30009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.247+0000 7f5e25ffb700 1 -- 172.21.15.5:0/1648445483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5e28052560 con 0x7f5e340b0820 2023-03-03T06:25:56.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.443+0000 7f5e3b394700 1 -- 172.21.15.5:0/1648445483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e340cc560 con 0x7f5e340b0820 2023-03-03T06:25:56.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.444+0000 7f5e25ffb700 1 -- 172.21.15.5:0/1648445483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+19747 (secure 0 0 0) 0x7f5e28055b80 con 0x7f5e340b0820 2023-03-03T06:25:56.447 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:56.447 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":67,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:56.073654+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:54.356683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:55.044358+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:56.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.446+0000 7f5e3b394700 1 -- 172.21.15.5:0/1648445483 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5e180682f0 msgr2=0x7f5e1806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.446+0000 7f5e3b394700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5e180682f0 0x7f5e1806a7a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5e30000c00 tx=0x7f5e30009030 comp rx=0 tx=0).stop 2023-03-03T06:25:56.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.446+0000 7f5e3b394700 1 -- 172.21.15.5:0/1648445483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340b0820 msgr2=0x7f5e340b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.446+0000 7f5e3b394700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340b0820 0x7f5e340b0c90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5e280072c0 tx=0x7f5e28007680 comp rx=0 tx=0).stop 2023-03-03T06:25:56.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.446+0000 7f5e3b394700 1 -- 172.21.15.5:0/1648445483 shutdown_connections 2023-03-03T06:25:56.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.446+0000 7f5e3b394700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e341f59e0 0x7f5e341f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.446+0000 7f5e3b394700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5e180682f0 0x7f5e1806a7a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.446+0000 7f5e3b394700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e20003aa0 0x7f5e340c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.446+0000 7f5e3b394700 1 --2- 172.21.15.5:0/1648445483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340b0820 0x7f5e340b0c90 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.446+0000 7f5e3b394700 1 -- 172.21.15.5:0/1648445483 >> 172.21.15.5:0/1648445483 conn(0x7f5e340cfd00 msgr2=0x7f5e340ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:56.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.446+0000 7f5e3b394700 1 -- 172.21.15.5:0/1648445483 shutdown_connections 2023-03-03T06:25:56.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.446+0000 7f5e3b394700 1 -- 172.21.15.5:0/1648445483 wait complete. 2023-03-03T06:25:56.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:56.586 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.584+0000 7f5e8a095700 1 Processor -- start 2023-03-03T06:25:56.587 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.585+0000 7f5e8a095700 1 -- start start 2023-03-03T06:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.585+0000 7f5e8a095700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e8415a7b0 0x7f5e8406b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.585+0000 7f5e8a095700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5e8406ba80 0x7f5e840ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.585+0000 7f5e8a095700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8406bed0 con 0x7f5e8415ab80 2023-03-03T06:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.585+0000 7f5e8a095700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e840b3290 con 0x7f5e8406ba80 2023-03-03T06:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.585+0000 7f5e8a095700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840b2ca0 con 0x7f5e8415a7b0 2023-03-03T06:25:56.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e82ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5e8415ab80 0x7f5e840b36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35264/0 (socket says 172.21.15.5:35264) 2023-03-03T06:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e82ffd700 1 -- 172.21.15.5:0/2930483366 learned_addr learned my addr 172.21.15.5:0/2930483366 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e837fe700 1 --2- 172.21.15.5:0/2930483366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e8415a7b0 0x7f5e8406b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e83fff700 1 --2- 172.21.15.5:0/2930483366 >> v2:172.21.15.191:3300/0 conn(0x7f5e8406ba80 0x7f5e840ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140821286 0 0) 0x7f5e78001290 con 0x7f5e8415ab80 2023-03-03T06:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e6c0035b0 con 0x7f5e8415ab80 2023-03-03T06:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4148149366 0 0) 0x7f5e6c0035b0 con 0x7f5e8415ab80 2023-03-03T06:25:56.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e8415a7b0 msgr2=0x7f5e8406b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 --2- 172.21.15.5:0/2930483366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e8415a7b0 0x7f5e8406b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 >> v2:172.21.15.191:3300/0 conn(0x7f5e8406ba80 msgr2=0x7f5e840ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 --2- 172.21.15.5:0/2930483366 >> v2:172.21.15.191:3300/0 conn(0x7f5e8406ba80 0x7f5e840ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840cf7e0 con 0x7f5e8415ab80 2023-03-03T06:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f5e78001980 con 0x7f5e8415ab80 2023-03-03T06:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 >> v1:172.21.15.5:6789/0 conn(0x7f5e8415ab80 legacy=0x7f5e840b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 --2- 172.21.15.5:0/2930483366 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e6c003a70 0x7f5e6c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 --2- 172.21.15.5:0/2930483366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e8415a7b0 0x7f5e6c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 --2- 172.21.15.5:0/2930483366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c004d90 0x7f5e6c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840b3290 con 0x7f5e6c004d90 2023-03-03T06:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840b2ca0 con 0x7f5e6c003a70 2023-03-03T06:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c00ba60 con 0x7f5e8415a7b0 2023-03-03T06:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e83fff700 1 --2- 172.21.15.5:0/2930483366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c004d90 0x7f5e6c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e837fe700 1 --2- 172.21.15.5:0/2930483366 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e6c003a70 0x7f5e6c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.586+0000 7f5e82ffd700 1 --2- 172.21.15.5:0/2930483366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e8415a7b0 0x7f5e6c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.587+0000 7f5e83fff700 1 -- 172.21.15.5:0/2930483366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e8415a7b0 msgr2=0x7f5e6c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.587+0000 7f5e83fff700 1 --2- 172.21.15.5:0/2930483366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e8415a7b0 0x7f5e6c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.587+0000 7f5e83fff700 1 -- 172.21.15.5:0/2930483366 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e6c003a70 msgr2=0x7f5e6c003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.587+0000 7f5e83fff700 1 --2- 172.21.15.5:0/2930483366 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e6c003a70 0x7f5e6c003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.587+0000 7f5e83fff700 1 -- 172.21.15.5:0/2930483366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c0035b0 con 0x7f5e6c004d90 2023-03-03T06:25:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.587+0000 7f5e83fff700 1 --2- 172.21.15.5:0/2930483366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c004d90 0x7f5e6c005200 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00e170 tx=0x7f5e6c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306700b533238844 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.587+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00ec90 con 0x7f5e6c004d90 2023-03-03T06:25:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.587+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c00f040 con 0x7f5e6c004d90 2023-03-03T06:25:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.587+0000 7f5e827fc700 1 -- 172.21.15.5:0/2930483366 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c014480 con 0x7f5e6c004d90 2023-03-03T06:25:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.588+0000 7f5e8a095700 1 -- 172.21.15.5:0/2930483366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c004d90 msgr2=0x7f5e6c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.588+0000 7f5e8a095700 1 --2- 172.21.15.5:0/2930483366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e6c004d90 0x7f5e6c005200 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c00e170 tx=0x7f5e6c005880 comp rx=0 tx=0).stop 2023-03-03T06:25:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.588+0000 7f5e83fff700 1 -- 172.21.15.5:0/2930483366 reap_dead start 2023-03-03T06:25:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.588+0000 7f5e8a095700 1 -- 172.21.15.5:0/2930483366 shutdown_connections 2023-03-03T06:25:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.588+0000 7f5e8a095700 1 -- 172.21.15.5:0/2930483366 >> 172.21.15.5:0/2930483366 conn(0x7f5e840cc8d0 msgr2=0x7f5e840cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:56.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.588+0000 7f5e8a095700 1 -- 172.21.15.5:0/2930483366 shutdown_connections 2023-03-03T06:25:56.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.588+0000 7f5e8a095700 1 -- 172.21.15.5:0/2930483366 wait complete. 2023-03-03T06:25:56.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.589+0000 7f5e8a095700 1 Processor -- start 2023-03-03T06:25:56.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.589+0000 7f5e8a095700 1 -- start start 2023-03-03T06:25:56.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e8a095700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e841560b0 0x7f5e840ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e8a095700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e840ac3a0 0x7f5e840b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e8a095700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e840b1e60 0x7f5e841f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e8a095700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840b1490 con 0x7f5e841560b0 2023-03-03T06:25:56.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e8a095700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840b0880 con 0x7f5e840ac3a0 2023-03-03T06:25:56.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e8a095700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840b0b60 con 0x7f5e840b1e60 2023-03-03T06:25:56.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e837fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e841560b0 0x7f5e840ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e837fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e841560b0 0x7f5e840ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45432/0 (socket says 172.21.15.5:45432) 2023-03-03T06:25:56.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e837fe700 1 -- 172.21.15.5:0/1951574957 learned_addr learned my addr 172.21.15.5:0/1951574957 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:56.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e837fe700 1 -- 172.21.15.5:0/1951574957 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e840b1e60 msgr2=0x7f5e841f36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e837fe700 1 --2- 172.21.15.5:0/1951574957 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e840b1e60 0x7f5e841f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e837fe700 1 -- 172.21.15.5:0/1951574957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e840ac3a0 msgr2=0x7f5e840b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e837fe700 1 --2- 172.21.15.5:0/1951574957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e840ac3a0 0x7f5e840b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e837fe700 1 -- 172.21.15.5:0/1951574957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840b2eb0 con 0x7f5e841560b0 2023-03-03T06:25:56.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e837fe700 1 --2- 172.21.15.5:0/1951574957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e841560b0 0x7f5e840ad6d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5e740119a0 tx=0x7f5e74011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:56.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.590+0000 7f5e6bfff700 1 -- 172.21.15.5:0/1951574957 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7400f8c0 con 0x7f5e841560b0 2023-03-03T06:25:56.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.591+0000 7f5e6bfff700 1 -- 172.21.15.5:0/1951574957 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7400fa20 con 0x7f5e841560b0 2023-03-03T06:25:56.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.591+0000 7f5e8a095700 1 -- 172.21.15.5:0/1951574957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e840cfac0 con 0x7f5e841560b0 2023-03-03T06:25:56.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.591+0000 7f5e6bfff700 1 -- 172.21.15.5:0/1951574957 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7400fdb0 con 0x7f5e841560b0 2023-03-03T06:25:56.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.591+0000 7f5e8a095700 1 -- 172.21.15.5:0/1951574957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e840cd5b0 con 0x7f5e841560b0 2023-03-03T06:25:56.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.592+0000 7f5e8a095700 1 -- 172.21.15.5:0/1951574957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e840b1770 con 0x7f5e841560b0 2023-03-03T06:25:56.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.592+0000 7f5e6bfff700 1 -- 172.21.15.5:0/1951574957 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5e74014440 con 0x7f5e841560b0 2023-03-03T06:25:56.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.592+0000 7f5e6bfff700 1 --2- 172.21.15.5:0/1951574957 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5e70068320 0x7f5e7006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.593+0000 7f5e82ffd700 1 --2- 172.21.15.5:0/1951574957 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5e70068320 0x7f5e7006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.593+0000 7f5e6bfff700 1 -- 172.21.15.5:0/1951574957 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5e740866e0 con 0x7f5e841560b0 2023-03-03T06:25:56.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.593+0000 7f5e82ffd700 1 --2- 172.21.15.5:0/1951574957 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5e70068320 0x7f5e7006a7d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5e78001430 tx=0x7f5e78000bc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:56.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.597+0000 7f5e6bfff700 1 -- 172.21.15.5:0/1951574957 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5e74052c40 con 0x7f5e841560b0 2023-03-03T06:25:56.651 INFO:tasks.ceph.mds.d.smithi191.stderr:2023-03-03T06:25:56.648+0000 7f3e9dfed700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-03T06:25:56.796 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.794+0000 7f5e8a095700 1 -- 172.21.15.5:0/1951574957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e8404e6e0 con 0x7f5e841560b0 2023-03-03T06:25:56.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.795+0000 7f5e6bfff700 1 -- 172.21.15.5:0/1951574957 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+19747 (secure 0 0 0) 0x7f5e74056260 con 0x7f5e841560b0 2023-03-03T06:25:56.798 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:56.798 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":67,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:56.073654+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:54.356683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:55.044358+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:56.799 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.797+0000 7f5e8a095700 1 -- 172.21.15.5:0/1951574957 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5e70068320 msgr2=0x7f5e7006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.797+0000 7f5e8a095700 1 --2- 172.21.15.5:0/1951574957 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5e70068320 0x7f5e7006a7d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5e78001430 tx=0x7f5e78000bc0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.797+0000 7f5e8a095700 1 -- 172.21.15.5:0/1951574957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e841560b0 msgr2=0x7f5e840ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.797+0000 7f5e8a095700 1 --2- 172.21.15.5:0/1951574957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e841560b0 0x7f5e840ad6d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5e740119a0 tx=0x7f5e74011d60 comp rx=0 tx=0).stop 2023-03-03T06:25:56.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.797+0000 7f5e8a095700 1 -- 172.21.15.5:0/1951574957 shutdown_connections 2023-03-03T06:25:56.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.797+0000 7f5e8a095700 1 --2- 172.21.15.5:0/1951574957 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5e70068320 0x7f5e7006a7d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.797+0000 7f5e8a095700 1 --2- 172.21.15.5:0/1951574957 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5e840b1e60 0x7f5e841f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.800 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.797+0000 7f5e8a095700 1 --2- 172.21.15.5:0/1951574957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e841560b0 0x7f5e840ad6d0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.797+0000 7f5e8a095700 1 --2- 172.21.15.5:0/1951574957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5e840ac3a0 0x7f5e840b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.797+0000 7f5e8a095700 1 -- 172.21.15.5:0/1951574957 >> 172.21.15.5:0/1951574957 conn(0x7f5e840cc8d0 msgr2=0x7f5e8415bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:56.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.797+0000 7f5e8a095700 1 -- 172.21.15.5:0/1951574957 shutdown_connections 2023-03-03T06:25:56.801 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.798+0000 7f5e8a095700 1 -- 172.21.15.5:0/1951574957 wait complete. 2023-03-03T06:25:56.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-03T06:25:56.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.937+0000 7f9db2465700 1 Processor -- start 2023-03-03T06:25:56.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.937+0000 7f9db2465700 1 -- start start 2023-03-03T06:25:56.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.938+0000 7f9db2465700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f9dac06e310 0x7f9dac0cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.938+0000 7f9db2465700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f9dac0cf010 0x7f9dac0cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.938+0000 7f9db2465700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dac15e110 con 0x7f9dac06d130 2023-03-03T06:25:56.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.938+0000 7f9db2465700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac0cf720 con 0x7f9dac0cf010 2023-03-03T06:25:56.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.938+0000 7f9db2465700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac15d350 con 0x7f9dac06e310 2023-03-03T06:25:56.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.938+0000 7f9dabfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f9dac06d130 0x7f9dac06dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35282/0 (socket says 172.21.15.5:35282) 2023-03-03T06:25:56.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.938+0000 7f9dabfff700 1 -- 172.21.15.5:0/3489489593 learned_addr learned my addr 172.21.15.5:0/3489489593 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:56.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.938+0000 7f9db0a02700 1 --2- 172.21.15.5:0/3489489593 >> v2:172.21.15.5:3300/0 conn(0x7f9dac0cf010 0x7f9dac0cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.939+0000 7f9dab7fe700 1 --2- 172.21.15.5:0/3489489593 >> v2:172.21.15.191:3300/0 conn(0x7f9dac06e310 0x7f9dac0cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.939+0000 7f9daaffd700 1 -- 172.21.15.5:0/3489489593 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195150552 0 0) 0x7f9dac15e110 con 0x7f9dac06d130 2023-03-03T06:25:56.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.939+0000 7f9daaffd700 1 -- 172.21.15.5:0/3489489593 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d940035b0 con 0x7f9dac06d130 2023-03-03T06:25:56.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.939+0000 7f9db0a02700 1 -- 172.21.15.5:0/3489489593 >> v2:172.21.15.191:3300/0 conn(0x7f9dac06e310 msgr2=0x7f9dac0cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:56.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.939+0000 7f9db0a02700 1 --2- 172.21.15.5:0/3489489593 >> v2:172.21.15.191:3300/0 conn(0x7f9dac06e310 0x7f9dac0cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.939+0000 7f9db0a02700 1 -- 172.21.15.5:0/3489489593 >> v1:172.21.15.5:6789/0 conn(0x7f9dac06d130 legacy=0x7f9dac06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.939+0000 7f9db0a02700 1 -- 172.21.15.5:0/3489489593 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac15d630 con 0x7f9dac0cf010 2023-03-03T06:25:56.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.939+0000 7f9dab7fe700 1 --2- 172.21.15.5:0/3489489593 >> v2:172.21.15.191:3300/0 conn(0x7f9dac06e310 0x7f9dac0cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:56.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.939+0000 7f9db0a02700 1 --2- 172.21.15.5:0/3489489593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dac0cf010 0x7f9dac0cb260 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9dac06ef00 tx=0x7f9da400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb95ddbf49ce99ff server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:56.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.939+0000 7f9daaffd700 1 -- 172.21.15.5:0/3489489593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400e070 con 0x7f9dac0cf010 2023-03-03T06:25:56.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.939+0000 7f9daaffd700 1 -- 172.21.15.5:0/3489489593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da400bb20 con 0x7f9dac0cf010 2023-03-03T06:25:56.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.939+0000 7f9daaffd700 1 -- 172.21.15.5:0/3489489593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4012430 con 0x7f9dac0cf010 2023-03-03T06:25:56.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.940+0000 7f9db2465700 1 -- 172.21.15.5:0/3489489593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dac0cf010 msgr2=0x7f9dac0cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.940+0000 7f9db2465700 1 --2- 172.21.15.5:0/3489489593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dac0cf010 0x7f9dac0cb260 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9dac06ef00 tx=0x7f9da400b330 comp rx=0 tx=0).stop 2023-03-03T06:25:56.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.940+0000 7f9db2465700 1 -- 172.21.15.5:0/3489489593 shutdown_connections 2023-03-03T06:25:56.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.940+0000 7f9db2465700 1 --2- 172.21.15.5:0/3489489593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dac0cf010 0x7f9dac0cb260 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.940+0000 7f9db2465700 1 --2- 172.21.15.5:0/3489489593 >> v2:172.21.15.191:3300/0 conn(0x7f9dac06e310 0x7f9dac0cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.940+0000 7f9db2465700 1 -- 172.21.15.5:0/3489489593 >> 172.21.15.5:0/3489489593 conn(0x7f9dac0cfd00 msgr2=0x7f9dac0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:56.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.940+0000 7f9db2465700 1 -- 172.21.15.5:0/3489489593 shutdown_connections 2023-03-03T06:25:56.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.940+0000 7f9db2465700 1 -- 172.21.15.5:0/3489489593 wait complete. 2023-03-03T06:25:56.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.941+0000 7f9db2465700 1 Processor -- start 2023-03-03T06:25:56.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.941+0000 7f9db2465700 1 -- start start 2023-03-03T06:25:56.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db2465700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dac06d130 0x7f9dac0c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db2465700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dac06e310 0x7f9dac0c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db2465700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dac0cf010 0x7f9dac15af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db2465700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0c2bf0 con 0x7f9dac0cf010 2023-03-03T06:25:56.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db2465700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0c74c0 con 0x7f9dac06e310 2023-03-03T06:25:56.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db2465700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0c5c10 con 0x7f9dac06d130 2023-03-03T06:25:56.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db0a02700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dac0cf010 0x7f9dac15af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db0a02700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dac0cf010 0x7f9dac15af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45450/0 (socket says 172.21.15.5:45450) 2023-03-03T06:25:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db0a02700 1 -- 172.21.15.5:0/4039203136 learned_addr learned my addr 172.21.15.5:0/4039203136 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9dabfff700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dac06d130 0x7f9dac0c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db0a02700 1 -- 172.21.15.5:0/4039203136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dac06d130 msgr2=0x7f9dac0c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db0a02700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dac06d130 0x7f9dac0c2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db0a02700 1 -- 172.21.15.5:0/4039203136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dac06e310 msgr2=0x7f9dac0c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9dab7fe700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dac06e310 0x7f9dac0c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db0a02700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dac06e310 0x7f9dac0c26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:56.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db0a02700 1 -- 172.21.15.5:0/4039203136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da4009a70 con 0x7f9dac0cf010 2023-03-03T06:25:56.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.942+0000 7f9db0a02700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dac0cf010 0x7f9dac15af80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9da4014040 tx=0x7f9da4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:56.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.943+0000 7f9da8ff9700 1 -- 172.21.15.5:0/4039203136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4012430 con 0x7f9dac0cf010 2023-03-03T06:25:56.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.943+0000 7f9da8ff9700 1 -- 172.21.15.5:0/4039203136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da4020070 con 0x7f9dac0cf010 2023-03-03T06:25:56.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.943+0000 7f9da8ff9700 1 -- 172.21.15.5:0/4039203136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4004280 con 0x7f9dac0cf010 2023-03-03T06:25:56.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.943+0000 7f9db2465700 1 -- 172.21.15.5:0/4039203136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac15dbf0 con 0x7f9dac0cf010 2023-03-03T06:25:56.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.943+0000 7f9db2465700 1 -- 172.21.15.5:0/4039203136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac15d910 con 0x7f9dac0cf010 2023-03-03T06:25:56.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.944+0000 7f9db2465700 1 -- 172.21.15.5:0/4039203136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac0cf420 con 0x7f9dac0cf010 2023-03-03T06:25:56.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.944+0000 7f9da8ff9700 1 -- 172.21.15.5:0/4039203136 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9da402e070 con 0x7f9dac0cf010 2023-03-03T06:25:56.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.945+0000 7f9da8ff9700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9d980682f0 0x7f9d9806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:56.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.945+0000 7f9dabfff700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9d980682f0 0x7f9d9806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:56.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.945+0000 7f9da8ff9700 1 -- 172.21.15.5:0/4039203136 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9da4022070 con 0x7f9dac0cf010 2023-03-03T06:25:56.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.945+0000 7f9dabfff700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9d980682f0 0x7f9d9806a7a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0011e0 tx=0x7f9d9c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:56.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:56.949+0000 7f9da8ff9700 1 -- 172.21.15.5:0/4039203136 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9da4054240 con 0x7f9dac0cf010 2023-03-03T06:25:57.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:57.191+0000 7f9db2465700 1 -- 172.21.15.5:0/4039203136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9dac06d840 con 0x7f9dac0cf010 2023-03-03T06:25:58.081 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.079+0000 7f9da8ff9700 1 -- 172.21.15.5:0/4039203136 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9da402c0b0 con 0x7f9dac0cf010 2023-03-03T06:25:58.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.082+0000 7f9db2465700 1 -- 172.21.15.5:0/4039203136 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9d980682f0 msgr2=0x7f9d9806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:58.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.082+0000 7f9db2465700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9d980682f0 0x7f9d9806a7a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0011e0 tx=0x7f9d9c009040 comp rx=0 tx=0).stop 2023-03-03T06:25:58.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.082+0000 7f9db2465700 1 -- 172.21.15.5:0/4039203136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dac0cf010 msgr2=0x7f9dac15af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:58.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.082+0000 7f9db2465700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dac0cf010 0x7f9dac15af80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9da4014040 tx=0x7f9da4004ad0 comp rx=0 tx=0).stop 2023-03-03T06:25:58.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.082+0000 7f9db2465700 1 -- 172.21.15.5:0/4039203136 shutdown_connections 2023-03-03T06:25:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.082+0000 7f9db2465700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9dac0cf010 0x7f9dac15af80 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.082+0000 7f9db2465700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9d980682f0 0x7f9d9806a7a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.082+0000 7f9db2465700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9dac06d130 0x7f9dac0c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.082+0000 7f9db2465700 1 --2- 172.21.15.5:0/4039203136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9dac06e310 0x7f9dac0c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.082+0000 7f9db2465700 1 -- 172.21.15.5:0/4039203136 >> 172.21.15.5:0/4039203136 conn(0x7f9dac0cfd00 msgr2=0x7f9dac0d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:58.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.082+0000 7f9db2465700 1 -- 172.21.15.5:0/4039203136 shutdown_connections 2023-03-03T06:25:58.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.082+0000 7f9db2465700 1 -- 172.21.15.5:0/4039203136 wait complete. 2023-03-03T06:25:58.099 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-03-03T06:25:58.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-03T06:25:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.232+0000 7f0725a58700 1 Processor -- start 2023-03-03T06:25:58.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.232+0000 7f0725a58700 1 -- start start 2023-03-03T06:25:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f0725a58700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07200cdbe0 0x7f072006ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f0725a58700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07200b51f0 0x7f072015d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f0725a58700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072006a8b0 con 0x7f072015cec0 2023-03-03T06:25:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f0725a58700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072006a330 con 0x7f07200cdbe0 2023-03-03T06:25:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f0725a58700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07200cdfb0 con 0x7f07200b51f0 2023-03-03T06:25:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f071effd700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f07200cdbe0 0x7f072006ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f071e7fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f072015cec0 0x7f07200b4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35298/0 (socket says 172.21.15.5:35298) 2023-03-03T06:25:58.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f071e7fc700 1 -- 172.21.15.5:0/982293440 learned_addr learned my addr 172.21.15.5:0/982293440 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f071f7fe700 1 --2- 172.21.15.5:0/982293440 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07200b51f0 0x7f072015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f071effd700 1 -- 172.21.15.5:0/982293440 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07200b51f0 msgr2=0x7f072015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f071effd700 1 --2- 172.21.15.5:0/982293440 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07200b51f0 0x7f072015d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f071effd700 1 -- 172.21.15.5:0/982293440 >> v1:172.21.15.5:6789/0 conn(0x7f072015cec0 legacy=0x7f07200b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f071effd700 1 -- 172.21.15.5:0/982293440 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072006b280 con 0x7f07200cdbe0 2023-03-03T06:25:58.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.233+0000 7f071dffb700 1 -- 172.21.15.5:0/982293440 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915634343 0 0) 0x7f072006a8b0 con 0x7f072015cec0 2023-03-03T06:25:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.234+0000 7f071effd700 1 --2- 172.21.15.5:0/982293440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07200cdbe0 0x7f072006ad40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0714009840 tx=0x7f0714009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5f8206bd263f57 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.234+0000 7f071dffb700 1 -- 172.21.15.5:0/982293440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714011830 con 0x7f07200cdbe0 2023-03-03T06:25:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.234+0000 7f071dffb700 1 -- 172.21.15.5:0/982293440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0714011990 con 0x7f07200cdbe0 2023-03-03T06:25:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.234+0000 7f071dffb700 1 -- 172.21.15.5:0/982293440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714011d20 con 0x7f07200cdbe0 2023-03-03T06:25:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.234+0000 7f0725a58700 1 -- 172.21.15.5:0/982293440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07200cdbe0 msgr2=0x7f072006ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.234+0000 7f0725a58700 1 --2- 172.21.15.5:0/982293440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07200cdbe0 0x7f072006ad40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0714009840 tx=0x7f0714009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.234+0000 7f0725a58700 1 -- 172.21.15.5:0/982293440 shutdown_connections 2023-03-03T06:25:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.234+0000 7f0725a58700 1 --2- 172.21.15.5:0/982293440 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07200b51f0 0x7f072015d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.234+0000 7f0725a58700 1 --2- 172.21.15.5:0/982293440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07200cdbe0 0x7f072006ad40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.234+0000 7f0725a58700 1 -- 172.21.15.5:0/982293440 >> 172.21.15.5:0/982293440 conn(0x7f07200cfae0 msgr2=0x7f07200cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.234+0000 7f0725a58700 1 -- 172.21.15.5:0/982293440 shutdown_connections 2023-03-03T06:25:58.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.234+0000 7f0725a58700 1 -- 172.21.15.5:0/982293440 wait complete. 2023-03-03T06:25:58.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.236+0000 7f0725a58700 1 Processor -- start 2023-03-03T06:25:58.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.236+0000 7f0725a58700 1 -- start start 2023-03-03T06:25:58.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.236+0000 7f0725a58700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07200b51f0 0x7f07200c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:58.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.236+0000 7f0725a58700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07200cdbe0 0x7f07201f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:58.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.236+0000 7f0725a58700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f072015cec0 0x7f07201f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:58.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.236+0000 7f0725a58700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07200cd830 con 0x7f072015cec0 2023-03-03T06:25:58.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.236+0000 7f0725a58700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07200ca130 con 0x7f07200b51f0 2023-03-03T06:25:58.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.236+0000 7f0725a58700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07200ca6f0 con 0x7f07200cdbe0 2023-03-03T06:25:58.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f071f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f072015cec0 0x7f07201f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:58.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f071f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f072015cec0 0x7f07201f2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45464/0 (socket says 172.21.15.5:45464) 2023-03-03T06:25:58.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f071f7fe700 1 -- 172.21.15.5:0/4100854102 learned_addr learned my addr 172.21.15.5:0/4100854102 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:58.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f071e7fc700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07200cdbe0 0x7f07201f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:58.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f071f7fe700 1 -- 172.21.15.5:0/4100854102 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07200cdbe0 msgr2=0x7f07201f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f071f7fe700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07200cdbe0 0x7f07201f2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f071f7fe700 1 -- 172.21.15.5:0/4100854102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07200b51f0 msgr2=0x7f07200c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f071effd700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07200b51f0 0x7f07200c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f071f7fe700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07200b51f0 0x7f07200c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f071f7fe700 1 -- 172.21.15.5:0/4100854102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07140094a0 con 0x7f072015cec0 2023-03-03T06:25:58.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f071f7fe700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f072015cec0 0x7f07201f2740 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0718007e10 tx=0x7f071800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f0707fff700 1 -- 172.21.15.5:0/4100854102 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071800eea0 con 0x7f072015cec0 2023-03-03T06:25:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f0707fff700 1 -- 172.21.15.5:0/4100854102 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0718014420 con 0x7f072015cec0 2023-03-03T06:25:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f0707fff700 1 -- 172.21.15.5:0/4100854102 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07180147b0 con 0x7f072015cec0 2023-03-03T06:25:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f0725a58700 1 -- 172.21.15.5:0/4100854102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072015dcd0 con 0x7f072015cec0 2023-03-03T06:25:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.237+0000 7f0725a58700 1 -- 172.21.15.5:0/4100854102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072015d9f0 con 0x7f072015cec0 2023-03-03T06:25:58.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.238+0000 7f0725a58700 1 -- 172.21.15.5:0/4100854102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072006a540 con 0x7f072015cec0 2023-03-03T06:25:58.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.239+0000 7f0707fff700 1 -- 172.21.15.5:0/4100854102 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0718012050 con 0x7f072015cec0 2023-03-03T06:25:58.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.239+0000 7f0707fff700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f070c0682f0 0x7f070c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:58.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.239+0000 7f0707fff700 1 -- 172.21.15.5:0/4100854102 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0718086540 con 0x7f072015cec0 2023-03-03T06:25:58.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.239+0000 7f071effd700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f070c0682f0 0x7f070c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:58.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.240+0000 7f071effd700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f070c0682f0 0x7f070c06a7a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f07200b1b10 tx=0x7f0714008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:58.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.243+0000 7f0707fff700 1 -- 172.21.15.5:0/4100854102 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0718052b00 con 0x7f072015cec0 2023-03-03T06:25:58.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:58.484+0000 7f0725a58700 1 -- 172.21.15.5:0/4100854102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f072004e6e0 con 0x7f072015cec0 2023-03-03T06:25:59.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.083+0000 7f0707fff700 1 -- 172.21.15.5:0/4100854102 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0718056120 con 0x7f072015cec0 2023-03-03T06:25:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.086+0000 7f0725a58700 1 -- 172.21.15.5:0/4100854102 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f070c0682f0 msgr2=0x7f070c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.086+0000 7f0725a58700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f070c0682f0 0x7f070c06a7a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f07200b1b10 tx=0x7f0714008030 comp rx=0 tx=0).stop 2023-03-03T06:25:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.086+0000 7f0725a58700 1 -- 172.21.15.5:0/4100854102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f072015cec0 msgr2=0x7f07201f2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.086+0000 7f0725a58700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f072015cec0 0x7f07201f2740 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0718007e10 tx=0x7f071800e3c0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.086+0000 7f0725a58700 1 -- 172.21.15.5:0/4100854102 shutdown_connections 2023-03-03T06:25:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.086+0000 7f0725a58700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f072015cec0 0x7f07201f2740 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.086+0000 7f0725a58700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f07200b51f0 0x7f07200c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.089 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.086+0000 7f0725a58700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f070c0682f0 0x7f070c06a7a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.086+0000 7f0725a58700 1 --2- 172.21.15.5:0/4100854102 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f07200cdbe0 0x7f07201f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.086+0000 7f0725a58700 1 -- 172.21.15.5:0/4100854102 >> 172.21.15.5:0/4100854102 conn(0x7f07200cfae0 msgr2=0x7f07200b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.086+0000 7f0725a58700 1 -- 172.21.15.5:0/4100854102 shutdown_connections 2023-03-03T06:25:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.086+0000 7f0725a58700 1 -- 172.21.15.5:0/4100854102 wait complete. 2023-03-03T06:25:59.103 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-03T06:25:59.104 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:25:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.233+0000 7fe1349eb700 1 Processor -- start 2023-03-03T06:25:59.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.233+0000 7fe1349eb700 1 -- start start 2023-03-03T06:25:59.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe1349eb700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe13015a480 0x7fe1300d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe1349eb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1300cb4a0 0x7fe1300cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe1349eb700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1300cbcd0 con 0x7fe13015a850 2023-03-03T06:25:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe1349eb700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1300cf2a0 con 0x7fe13015a480 2023-03-03T06:25:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe1349eb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300cb9f0 con 0x7fe1300cb4a0 2023-03-03T06:25:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe12e59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe13015a480 0x7fe1300d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe12dd9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe13015a850 0x7fe1300b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35312/0 (socket says 172.21.15.5:35312) 2023-03-03T06:25:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe12e59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe13015a480 0x7fe1300d1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45468/0 (socket says 172.21.15.5:45468) 2023-03-03T06:25:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe12dd9b700 1 -- 172.21.15.5:0/831462851 learned_addr learned my addr 172.21.15.5:0/831462851 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe12ed9d700 1 --2- 172.21.15.5:0/831462851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1300cb4a0 0x7fe1300cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe12e59c700 1 -- 172.21.15.5:0/831462851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1300cb4a0 msgr2=0x7fe1300cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe12e59c700 1 --2- 172.21.15.5:0/831462851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1300cb4a0 0x7fe1300cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe12e59c700 1 -- 172.21.15.5:0/831462851 >> v1:172.21.15.5:6789/0 conn(0x7fe13015a850 legacy=0x7fe1300b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe12e59c700 1 -- 172.21.15.5:0/831462851 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1300cebe0 con 0x7fe13015a480 2023-03-03T06:25:59.238 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe12d59a700 1 -- 172.21.15.5:0/831462851 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545208063 0 0) 0x7fe1300cbcd0 con 0x7fe13015a850 2023-03-03T06:25:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe12ed9d700 1 --2- 172.21.15.5:0/831462851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1300cb4a0 0x7fe1300cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.234+0000 7fe12e59c700 1 --2- 172.21.15.5:0/831462851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe13015a480 0x7fe1300d1600 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe120009870 tx=0x7fe120009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adb8419d80f43c8 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.235+0000 7fe12d59a700 1 -- 172.21.15.5:0/831462851 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe120011830 con 0x7fe13015a480 2023-03-03T06:25:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.235+0000 7fe12d59a700 1 -- 172.21.15.5:0/831462851 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe120011990 con 0x7fe13015a480 2023-03-03T06:25:59.239 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.235+0000 7fe12d59a700 1 -- 172.21.15.5:0/831462851 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe120011d20 con 0x7fe13015a480 2023-03-03T06:25:59.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.235+0000 7fe1349eb700 1 -- 172.21.15.5:0/831462851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe13015a480 msgr2=0x7fe1300d1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.241 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.235+0000 7fe1349eb700 1 --2- 172.21.15.5:0/831462851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe13015a480 0x7fe1300d1600 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe120009870 tx=0x7fe120009b80 comp rx=0 tx=0).stop 2023-03-03T06:25:59.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.235+0000 7fe1349eb700 1 -- 172.21.15.5:0/831462851 shutdown_connections 2023-03-03T06:25:59.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.235+0000 7fe1349eb700 1 --2- 172.21.15.5:0/831462851 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1300cb4a0 0x7fe1300cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.235+0000 7fe1349eb700 1 --2- 172.21.15.5:0/831462851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe13015a480 0x7fe1300d1600 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.235+0000 7fe1349eb700 1 -- 172.21.15.5:0/831462851 >> 172.21.15.5:0/831462851 conn(0x7fe13006f3c0 msgr2=0x7fe13006f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:59.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.235+0000 7fe1349eb700 1 -- 172.21.15.5:0/831462851 shutdown_connections 2023-03-03T06:25:59.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.235+0000 7fe1349eb700 1 -- 172.21.15.5:0/831462851 wait complete. 2023-03-03T06:25:59.242 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.237+0000 7fe1349eb700 1 Processor -- start 2023-03-03T06:25:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.237+0000 7fe1349eb700 1 -- start start 2023-03-03T06:25:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.237+0000 7fe1349eb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1300cb4a0 0x7fe1300c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.237+0000 7fe1349eb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe13015a480 0x7fe130146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.237+0000 7fe1349eb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe13015a850 0x7fe130142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.237+0000 7fe1349eb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1301474c0 con 0x7fe13015a480 2023-03-03T06:25:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.237+0000 7fe1349eb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1301f0a30 con 0x7fe1300cb4a0 2023-03-03T06:25:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.237+0000 7fe1349eb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1301f0cd0 con 0x7fe13015a850 2023-03-03T06:25:59.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.237+0000 7fe12dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe13015a480 0x7fe130146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.237+0000 7fe12dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe13015a480 0x7fe130146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45476/0 (socket says 172.21.15.5:45476) 2023-03-03T06:25:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.237+0000 7fe12dd9b700 1 -- 172.21.15.5:0/2434857019 learned_addr learned my addr 172.21.15.5:0/2434857019 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.238+0000 7fe12ed9d700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe13015a850 0x7fe130142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.238+0000 7fe12e59c700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1300cb4a0 0x7fe1300c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.238+0000 7fe12dd9b700 1 -- 172.21.15.5:0/2434857019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe13015a850 msgr2=0x7fe130142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.238+0000 7fe12dd9b700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe13015a850 0x7fe130142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.238+0000 7fe12dd9b700 1 -- 172.21.15.5:0/2434857019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1300cb4a0 msgr2=0x7fe1300c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.238+0000 7fe12dd9b700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1300cb4a0 0x7fe1300c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.238+0000 7fe12dd9b700 1 -- 172.21.15.5:0/2434857019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1200094a0 con 0x7fe13015a480 2023-03-03T06:25:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.238+0000 7fe12dd9b700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe13015a480 0x7fe130146f80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe1240011e0 tx=0x7fe12400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.238+0000 7fe11effd700 1 -- 172.21.15.5:0/2434857019 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124004c80 con 0x7fe13015a480 2023-03-03T06:25:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.238+0000 7fe11effd700 1 -- 172.21.15.5:0/2434857019 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe124004e00 con 0x7fe13015a480 2023-03-03T06:25:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.238+0000 7fe1349eb700 1 -- 172.21.15.5:0/2434857019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1300b43b0 con 0x7fe13015a480 2023-03-03T06:25:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.238+0000 7fe11effd700 1 -- 172.21.15.5:0/2434857019 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124007310 con 0x7fe13015a480 2023-03-03T06:25:59.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.238+0000 7fe1349eb700 1 -- 172.21.15.5:0/2434857019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1300ceec0 con 0x7fe13015a480 2023-03-03T06:25:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.239+0000 7fe1349eb700 1 -- 172.21.15.5:0/2434857019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1301f0ef0 con 0x7fe13015a480 2023-03-03T06:25:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.240+0000 7fe11effd700 1 -- 172.21.15.5:0/2434857019 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe12401a020 con 0x7fe13015a480 2023-03-03T06:25:59.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.240+0000 7fe11effd700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe1100682f0 0x7fe11006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.240+0000 7fe11effd700 1 -- 172.21.15.5:0/2434857019 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe124085bd0 con 0x7fe13015a480 2023-03-03T06:25:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.240+0000 7fe12e59c700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe1100682f0 0x7fe11006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.240+0000 7fe12e59c700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe1100682f0 0x7fe11006a7a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe1200090b0 tx=0x7fe120008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:59.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.244+0000 7fe11effd700 1 -- 172.21.15.5:0/2434857019 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe1240521c0 con 0x7fe13015a480 2023-03-03T06:25:59.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.485+0000 7fe1349eb700 1 -- 172.21.15.5:0/2434857019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1300d1b00 con 0x7fe13015a480 2023-03-03T06:25:59.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.486+0000 7fe11effd700 1 -- 172.21.15.5:0/2434857019 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4647 (secure 0 0 0) 0x7fe1240557e0 con 0x7fe13015a480 2023-03-03T06:25:59.488 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:59.488 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3446616567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3446616567},{"type":"v1","addr":"172.21.15.5:6836","nonce":3446616567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/430214005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":430214005},{"type":"v1","addr":"172.21.15.5:6837","nonce":430214005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6198,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/3308805305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":3308805305},{"type":"v1","addr":"172.21.15.191:6834","nonce":3308805305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:25:56.073978+0000","modified":"2023-03-03T06:25:59.082181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6201":{"gid":6201,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1046120178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":1046120178},{"type":"v1","addr":"172.21.15.191:6835","nonce":1046120178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-03-03T06:25:59.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.488+0000 7fe1349eb700 1 -- 172.21.15.5:0/2434857019 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe1100682f0 msgr2=0x7fe11006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.488+0000 7fe1349eb700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe1100682f0 0x7fe11006a7a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe1200090b0 tx=0x7fe120008030 comp rx=0 tx=0).stop 2023-03-03T06:25:59.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.488+0000 7fe1349eb700 1 -- 172.21.15.5:0/2434857019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe13015a480 msgr2=0x7fe130146f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.488+0000 7fe1349eb700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe13015a480 0x7fe130146f80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe1240011e0 tx=0x7fe12400cae0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.488+0000 7fe1349eb700 1 -- 172.21.15.5:0/2434857019 shutdown_connections 2023-03-03T06:25:59.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.488+0000 7fe1349eb700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe1100682f0 0x7fe11006a7a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.488+0000 7fe1349eb700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe13015a850 0x7fe130142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.488+0000 7fe1349eb700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1300cb4a0 0x7fe1300c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.488+0000 7fe1349eb700 1 --2- 172.21.15.5:0/2434857019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe13015a480 0x7fe130146f80 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.488+0000 7fe1349eb700 1 -- 172.21.15.5:0/2434857019 >> 172.21.15.5:0/2434857019 conn(0x7fe13006f3c0 msgr2=0x7fe13006f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:59.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.488+0000 7fe1349eb700 1 -- 172.21.15.5:0/2434857019 shutdown_connections 2023-03-03T06:25:59.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.488+0000 7fe1349eb700 1 -- 172.21.15.5:0/2434857019 wait complete. 2023-03-03T06:25:59.494 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-03-03T06:25:59.503 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:25:59.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.626+0000 7f838c951700 1 Processor -- start 2023-03-03T06:25:59.629 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.626+0000 7f838c951700 1 -- start start 2023-03-03T06:25:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.627+0000 7f838c951700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f838815a850 0x7f83880b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.627+0000 7f838c951700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83880cb4a0 0x7f83880cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.627+0000 7f838c951700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83880cbcd0 con 0x7f838815a480 2023-03-03T06:25:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.627+0000 7f838c951700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83880cf2a0 con 0x7f838815a850 2023-03-03T06:25:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.627+0000 7f838c951700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83880d1d10 con 0x7f83880cb4a0 2023-03-03T06:25:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.627+0000 7f838659c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f838815a480 0x7f83880d1600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35324/0 (socket says 172.21.15.5:35324) 2023-03-03T06:25:59.639 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.627+0000 7f838659c700 1 -- 172.21.15.5:0/2268264335 learned_addr learned my addr 172.21.15.5:0/2268264335 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.627+0000 7f8385d9b700 1 --2- 172.21.15.5:0/2268264335 >> v2:172.21.15.191:3300/0 conn(0x7f838815a850 0x7f83880b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.627+0000 7f8386d9d700 1 --2- 172.21.15.5:0/2268264335 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83880cb4a0 0x7f83880cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118581536 0 0) 0x7f83880cbcd0 con 0x7f838815a480 2023-03-03T06:25:59.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83700035b0 con 0x7f838815a480 2023-03-03T06:25:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 181419178 0 0) 0x7f83700035b0 con 0x7f838815a480 2023-03-03T06:25:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83880cb4a0 msgr2=0x7f83880cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 --2- 172.21.15.5:0/2268264335 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83880cb4a0 0x7f83880cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.641 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 >> v2:172.21.15.191:3300/0 conn(0x7f838815a850 msgr2=0x7f83880b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 --2- 172.21.15.5:0/2268264335 >> v2:172.21.15.191:3300/0 conn(0x7f838815a850 0x7f83880b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880cb9f0 con 0x7f838815a480 2023-03-03T06:25:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f837c001670 con 0x7f838815a480 2023-03-03T06:25:59.642 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 >> v1:172.21.15.5:6789/0 conn(0x7f838815a480 legacy=0x7f83880d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 --2- 172.21.15.5:0/2268264335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8370003a70 0x7f8370003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 --2- 172.21.15.5:0/2268264335 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83880cb4a0 0x7f8370004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 --2- 172.21.15.5:0/2268264335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8370004d90 0x7f8370005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83880cf2a0 con 0x7f8370004d90 2023-03-03T06:25:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837000ba10 con 0x7f8370003a70 2023-03-03T06:25:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837000bbd0 con 0x7f83880cb4a0 2023-03-03T06:25:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f8385d9b700 1 --2- 172.21.15.5:0/2268264335 >> v2:172.21.15.191:3300/0 conn(0x7f838815a850 0x7f83880b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:25:59.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f8386d9d700 1 --2- 172.21.15.5:0/2268264335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8370004d90 0x7f8370005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f838659c700 1 --2- 172.21.15.5:0/2268264335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8370003a70 0x7f8370003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f8385d9b700 1 --2- 172.21.15.5:0/2268264335 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83880cb4a0 0x7f8370004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f8386d9d700 1 -- 172.21.15.5:0/2268264335 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83880cb4a0 msgr2=0x7f8370004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:59.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f8386d9d700 1 --2- 172.21.15.5:0/2268264335 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83880cb4a0 0x7f8370004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f8386d9d700 1 -- 172.21.15.5:0/2268264335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8370003a70 msgr2=0x7f8370003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:25:59.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f8386d9d700 1 --2- 172.21.15.5:0/2268264335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8370003a70 0x7f8370003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f8386d9d700 1 -- 172.21.15.5:0/2268264335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700035b0 con 0x7f8370004d90 2023-03-03T06:25:59.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.628+0000 7f8385d9b700 1 --2- 172.21.15.5:0/2268264335 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83880cb4a0 0x7f8370004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:25:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.629+0000 7f8386d9d700 1 --2- 172.21.15.5:0/2268264335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8370004d90 0x7f8370005200 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8380009f90 tx=0x7f8370005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d4ca3fc7029731 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.629+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838000ec30 con 0x7f8370004d90 2023-03-03T06:25:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.629+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838000f040 con 0x7f8370004d90 2023-03-03T06:25:59.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.629+0000 7f838559a700 1 -- 172.21.15.5:0/2268264335 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380014480 con 0x7f8370004d90 2023-03-03T06:25:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.629+0000 7f838c951700 1 -- 172.21.15.5:0/2268264335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8370004d90 msgr2=0x7f8370005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.629+0000 7f838c951700 1 --2- 172.21.15.5:0/2268264335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8370004d90 0x7f8370005200 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8380009f90 tx=0x7f8370005880 comp rx=0 tx=0).stop 2023-03-03T06:25:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.629+0000 7f8386d9d700 1 -- 172.21.15.5:0/2268264335 reap_dead start 2023-03-03T06:25:59.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.629+0000 7f838c951700 1 -- 172.21.15.5:0/2268264335 shutdown_connections 2023-03-03T06:25:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.629+0000 7f838c951700 1 -- 172.21.15.5:0/2268264335 >> 172.21.15.5:0/2268264335 conn(0x7f838806f3c0 msgr2=0x7f838806f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.629+0000 7f838c951700 1 -- 172.21.15.5:0/2268264335 shutdown_connections 2023-03-03T06:25:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.629+0000 7f838c951700 1 -- 172.21.15.5:0/2268264335 wait complete. 2023-03-03T06:25:59.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.631+0000 7f838c951700 1 Processor -- start 2023-03-03T06:25:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.631+0000 7f838c951700 1 -- start start 2023-03-03T06:25:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f838c951700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8370004d90 0x7f838806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f838c951700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838806bcd0 0x7f838814ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f838c951700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8388150510 0x7f8388152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f838c951700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8388150980 con 0x7f8388150510 2023-03-03T06:25:59.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f838c951700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838806cde0 con 0x7f838806bcd0 2023-03-03T06:25:59.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f838c951700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838806c1d0 con 0x7f8370004d90 2023-03-03T06:25:59.651 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f8386d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8388150510 0x7f8388152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f8386d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8388150510 0x7f8388152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45498/0 (socket says 172.21.15.5:45498) 2023-03-03T06:25:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f8386d9d700 1 -- 172.21.15.5:0/1784159254 learned_addr learned my addr 172.21.15.5:0/1784159254 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f838659c700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8370004d90 0x7f838806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f8385d9b700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838806bcd0 0x7f838814ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f8386d9d700 1 -- 172.21.15.5:0/1784159254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8370004d90 msgr2=0x7f838806d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f8386d9d700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8370004d90 0x7f838806d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f8386d9d700 1 -- 172.21.15.5:0/1784159254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838806bcd0 msgr2=0x7f838814ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f8386d9d700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838806bcd0 0x7f838814ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f8386d9d700 1 -- 172.21.15.5:0/1784159254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880ceec0 con 0x7f8388150510 2023-03-03T06:25:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f838659c700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8370004d90 0x7f838806d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:59.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f8386d9d700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8388150510 0x7f8388152710 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f838000e700 tx=0x7f8380009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f8376ffd700 1 -- 172.21.15.5:0/1784159254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380007000 con 0x7f8388150510 2023-03-03T06:25:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f8376ffd700 1 -- 172.21.15.5:0/1784159254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8380003c30 con 0x7f8388150510 2023-03-03T06:25:59.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f838c951700 1 -- 172.21.15.5:0/1784159254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83880cebe0 con 0x7f8388150510 2023-03-03T06:25:59.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f8376ffd700 1 -- 172.21.15.5:0/1784159254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380003de0 con 0x7f8388150510 2023-03-03T06:25:59.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.632+0000 7f838c951700 1 -- 172.21.15.5:0/1784159254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83880b41e0 con 0x7f8388150510 2023-03-03T06:25:59.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.633+0000 7f838c951700 1 -- 172.21.15.5:0/1784159254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838804e6e0 con 0x7f8388150510 2023-03-03T06:25:59.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.634+0000 7f8376ffd700 1 -- 172.21.15.5:0/1784159254 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f838002d070 con 0x7f8388150510 2023-03-03T06:25:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.635+0000 7f8376ffd700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83680682f0 0x7f836806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.635+0000 7f838659c700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83680682f0 0x7f836806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.635+0000 7f8376ffd700 1 -- 172.21.15.5:0/1784159254 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f83800878a0 con 0x7f8388150510 2023-03-03T06:25:59.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.635+0000 7f838659c700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83680682f0 0x7f836806a7a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f837c000c00 tx=0x7f837c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:59.658 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.639+0000 7f8376ffd700 1 -- 172.21.15.5:0/1784159254 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8380057930 con 0x7f8388150510 2023-03-03T06:25:59.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.831+0000 7f838c951700 1 -- 172.21.15.5:0/1784159254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83880b3370 con 0x7f8388150510 2023-03-03T06:25:59.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.833+0000 7f8376ffd700 1 -- 172.21.15.5:0/1784159254 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+19734 (secure 0 0 0) 0x7f8380057520 con 0x7f8388150510 2023-03-03T06:25:59.835 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:25:59.835 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":68,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:25:57.075317+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:54.356683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:55.044358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:25:59.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.835+0000 7f838c951700 1 -- 172.21.15.5:0/1784159254 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83680682f0 msgr2=0x7f836806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.835+0000 7f838c951700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83680682f0 0x7f836806a7a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f837c000c00 tx=0x7f837c009040 comp rx=0 tx=0).stop 2023-03-03T06:25:59.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.835+0000 7f838c951700 1 -- 172.21.15.5:0/1784159254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8388150510 msgr2=0x7f8388152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.835+0000 7f838c951700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8388150510 0x7f8388152710 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f838000e700 tx=0x7f8380009750 comp rx=0 tx=0).stop 2023-03-03T06:25:59.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.835+0000 7f838c951700 1 -- 172.21.15.5:0/1784159254 shutdown_connections 2023-03-03T06:25:59.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.835+0000 7f838c951700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8388150510 0x7f8388152710 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.835+0000 7f838c951700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83680682f0 0x7f836806a7a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.835+0000 7f838c951700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8370004d90 0x7f838806d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.835+0000 7f838c951700 1 --2- 172.21.15.5:0/1784159254 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838806bcd0 0x7f838814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.835+0000 7f838c951700 1 -- 172.21.15.5:0/1784159254 >> 172.21.15.5:0/1784159254 conn(0x7f838806f3c0 msgr2=0x7f8388156ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:59.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.835+0000 7f838c951700 1 -- 172.21.15.5:0/1784159254 shutdown_connections 2023-03-03T06:25:59.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.835+0000 7f838c951700 1 -- 172.21.15.5:0/1784159254 wait complete. 2023-03-03T06:25:59.850 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-03T06:25:59.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:25:59.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.973+0000 7f3ed1b19700 1 Processor -- start 2023-03-03T06:25:59.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.973+0000 7f3ed1b19700 1 -- start start 2023-03-03T06:25:59.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.974+0000 7f3ed1b19700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f3ecc0af080 0x7f3ecc0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.974+0000 7f3ed1b19700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc06b590 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.974+0000 7f3ed1b19700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc06b870 con 0x7f3ecc0af450 2023-03-03T06:25:59.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.974+0000 7f3ed1b19700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ecc06bb50 con 0x7f3ecc0af080 2023-03-03T06:25:59.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.974+0000 7f3ecbfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3ecc0b1f80 0x7f3ecc0cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35348/0 (socket says 172.21.15.5:35348) 2023-03-03T06:25:59.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.974+0000 7f3ecbfff700 1 -- 172.21.15.5:0/1294109385 learned_addr learned my addr 172.21.15.5:0/1294109385 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:25:59.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.975+0000 7f3ecb7fe700 1 --2- 172.21.15.5:0/1294109385 >> v2:172.21.15.191:3300/0 conn(0x7f3ecc0af080 0x7f3ecc0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.975+0000 7f3ecaffd700 1 -- 172.21.15.5:0/1294109385 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742844130 0 0) 0x7f3ecc06b590 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.975+0000 7f3ecaffd700 1 -- 172.21.15.5:0/1294109385 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb80035b0 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.975+0000 7f3ecaffd700 1 -- 172.21.15.5:0/1294109385 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1951228080 0 0) 0x7f3eb80035b0 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.975+0000 7f3ecb7fe700 1 -- 172.21.15.5:0/1294109385 >> v1:172.21.15.191:6789/0 conn(0x7f3ecc0af450 legacy=0x7f3ecc0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.975+0000 7f3ecb7fe700 1 -- 172.21.15.5:0/1294109385 >> v1:172.21.15.5:6789/0 conn(0x7f3ecc0b1f80 legacy=0x7f3ecc0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.975+0000 7f3ecb7fe700 1 -- 172.21.15.5:0/1294109385 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc06be30 con 0x7f3ecc0af080 2023-03-03T06:25:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.975+0000 7f3ecb7fe700 1 --2- 172.21.15.5:0/1294109385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ecc0af080 0x7f3ecc0cd350 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009840 tx=0x7f3ebc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16e7594f0193d8b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.975+0000 7f3ecaffd700 1 -- 172.21.15.5:0/1294109385 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40019f0 con 0x7f3ecc0af080 2023-03-03T06:25:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.975+0000 7f3ecaffd700 1 -- 172.21.15.5:0/1294109385 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc004030 con 0x7f3ecc0af080 2023-03-03T06:25:59.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.975+0000 7f3ecaffd700 1 -- 172.21.15.5:0/1294109385 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0043c0 con 0x7f3ecc0af080 2023-03-03T06:25:59.981 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.976+0000 7f3ed1b19700 1 -- 172.21.15.5:0/1294109385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ecc0af080 msgr2=0x7f3ecc0cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.976+0000 7f3ed1b19700 1 --2- 172.21.15.5:0/1294109385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ecc0af080 0x7f3ecc0cd350 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009840 tx=0x7f3ebc009b50 comp rx=0 tx=0).stop 2023-03-03T06:25:59.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.976+0000 7f3ed1b19700 1 -- 172.21.15.5:0/1294109385 shutdown_connections 2023-03-03T06:25:59.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.976+0000 7f3ed1b19700 1 --2- 172.21.15.5:0/1294109385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ecc0af080 0x7f3ecc0cd350 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.976+0000 7f3ed1b19700 1 -- 172.21.15.5:0/1294109385 >> 172.21.15.5:0/1294109385 conn(0x7f3ecc06ea70 msgr2=0x7f3ecc0cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:25:59.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.976+0000 7f3ed1b19700 1 -- 172.21.15.5:0/1294109385 shutdown_connections 2023-03-03T06:25:59.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.976+0000 7f3ed1b19700 1 -- 172.21.15.5:0/1294109385 wait complete. 2023-03-03T06:25:59.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.977+0000 7f3ed1b19700 1 Processor -- start 2023-03-03T06:25:59.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.977+0000 7f3ed1b19700 1 -- start start 2023-03-03T06:25:59.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ed1b19700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ecc0af080 0x7f3ecc155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ed1b19700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ecc0af450 0x7f3ecc15e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ed1b19700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ecc0b1f80 0x7f3ecc15af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ed1b19700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc153cb0 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ed1b19700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc1f3f10 con 0x7f3ecc0af080 2023-03-03T06:25:59.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ed1b19700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc15f060 con 0x7f3ecc0af450 2023-03-03T06:25:59.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ecbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ecc0b1f80 0x7f3ecc15af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ecbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ecc0b1f80 0x7f3ecc15af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45512/0 (socket says 172.21.15.5:45512) 2023-03-03T06:25:59.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ecbfff700 1 -- 172.21.15.5:0/4058909093 learned_addr learned my addr 172.21.15.5:0/4058909093 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:25:59.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ecb7fe700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ecc0af080 0x7f3ecc155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ec3fff700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ecc0af450 0x7f3ecc15e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ecbfff700 1 -- 172.21.15.5:0/4058909093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ecc0af450 msgr2=0x7f3ecc15e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ecbfff700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ecc0af450 0x7f3ecc15e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ecbfff700 1 -- 172.21.15.5:0/4058909093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ecc0af080 msgr2=0x7f3ecc155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:25:59.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ecbfff700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ecc0af080 0x7f3ecc155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:25:59.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ecbfff700 1 -- 172.21.15.5:0/4058909093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc0094a0 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ecb7fe700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ecc0af080 0x7f3ecc155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:59.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.978+0000 7f3ec3fff700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ecc0af450 0x7f3ecc15e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:25:59.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.979+0000 7f3ecbfff700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ecc0b1f80 0x7f3ecc15af30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400cbe0 tx=0x7f3ec400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:59.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.979+0000 7f3ec8ff9700 1 -- 172.21.15.5:0/4058909093 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400ab80 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.979+0000 7f3ec8ff9700 1 -- 172.21.15.5:0/4058909093 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec400ad00 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.979+0000 7f3ed1b19700 1 -- 172.21.15.5:0/4058909093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ecc06d370 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.979+0000 7f3ec8ff9700 1 -- 172.21.15.5:0/4058909093 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4007310 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.979+0000 7f3ed1b19700 1 -- 172.21.15.5:0/4058909093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc06c110 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.980+0000 7f3ed1b19700 1 -- 172.21.15.5:0/4058909093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ecc071690 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.980+0000 7f3ec8ff9700 1 -- 172.21.15.5:0/4058909093 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3ec401a030 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.981+0000 7f3ec8ff9700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3eac0682f0 0x7f3eac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:25:59.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.981+0000 7f3ec8ff9700 1 -- 172.21.15.5:0/4058909093 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3ec4085cb0 con 0x7f3ecc0b1f80 2023-03-03T06:25:59.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.981+0000 7f3ecb7fe700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3eac0682f0 0x7f3eac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:25:59.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.981+0000 7f3ecb7fe700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3eac0682f0 0x7f3eac06a7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0090b0 tx=0x7f3ebc008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:25:59.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:25:59.985+0000 7f3ec8ff9700 1 -- 172.21.15.5:0/4058909093 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3ec4052210 con 0x7f3ecc0b1f80 2023-03-03T06:26:00.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.176+0000 7f3ed1b19700 1 -- 172.21.15.5:0/4058909093 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ecc04e6e0 con 0x7f3eac0682f0 2023-03-03T06:26:00.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.187+0000 7f3ec8ff9700 1 -- 172.21.15.5:0/4058909093 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392678 (secure 0 0 0) 0x7f3ecc04e6e0 con 0x7f3eac0682f0 2023-03-03T06:26:00.193 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.191+0000 7f3ed1b19700 1 -- 172.21.15.5:0/4058909093 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3eac0682f0 msgr2=0x7f3eac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.191+0000 7f3ed1b19700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3eac0682f0 0x7f3eac06a7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0090b0 tx=0x7f3ebc008030 comp rx=0 tx=0).stop 2023-03-03T06:26:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.191+0000 7f3ed1b19700 1 -- 172.21.15.5:0/4058909093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ecc0b1f80 msgr2=0x7f3ecc15af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.191+0000 7f3ed1b19700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ecc0b1f80 0x7f3ecc15af30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400cbe0 tx=0x7f3ec400a060 comp rx=0 tx=0).stop 2023-03-03T06:26:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.191+0000 7f3ed1b19700 1 -- 172.21.15.5:0/4058909093 shutdown_connections 2023-03-03T06:26:00.196 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.191+0000 7f3ed1b19700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3ecc0b1f80 0x7f3ecc15af30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.191+0000 7f3ed1b19700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ecc0af080 0x7f3ecc155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.191+0000 7f3ed1b19700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f3eac0682f0 0x7f3eac06a7a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.191+0000 7f3ed1b19700 1 --2- 172.21.15.5:0/4058909093 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3ecc0af450 0x7f3ecc15e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.191+0000 7f3ed1b19700 1 -- 172.21.15.5:0/4058909093 >> 172.21.15.5:0/4058909093 conn(0x7f3ecc06ea70 msgr2=0x7f3ecc0cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.191+0000 7f3ed1b19700 1 -- 172.21.15.5:0/4058909093 shutdown_connections 2023-03-03T06:26:00.197 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.191+0000 7f3ed1b19700 1 -- 172.21.15.5:0/4058909093 wait complete. 2023-03-03T06:26:00.198 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:26:00.205 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2023-03-03T06:25:59.490877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":79372,"kb_used_data":7564,"kb_used_omap":0,"kb_used_meta":71744,"kb_avail":754895348,"statfs":{"total":773094113280,"available":773012836352,"internally_reserved":0,"allocated":7745536,"data_stored":4323896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73465856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.841178"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203460+0000","last_change":"2023-03-03T06:25:56.106643+0000","last_active":"2023-03-03T06:25:57.203460+0000","last_peered":"2023-03-03T06:25:57.203460+0000","last_clean":"2023-03-03T06:25:57.203460+0000","last_became_active":"2023-03-03T06:25:56.106358+0000","last_became_peered":"2023-03-03T06:25:56.106358+0000","last_unstale":"2023-03-03T06:25:57.203460+0000","last_undegraded":"2023-03-03T06:25:57.203460+0000","last_fullsized":"2023-03-03T06:25:57.203460+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:52:19.009495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496839+0000","last_change":"2023-03-03T06:25:56.099884+0000","last_active":"2023-03-03T06:25:57.496839+0000","last_peered":"2023-03-03T06:25:57.496839+0000","last_clean":"2023-03-03T06:25:57.496839+0000","last_became_active":"2023-03-03T06:25:56.097121+0000","last_became_peered":"2023-03-03T06:25:56.097121+0000","last_unstale":"2023-03-03T06:25:57.496839+0000","last_undegraded":"2023-03-03T06:25:57.496839+0000","last_fullsized":"2023-03-03T06:25:57.496839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:46:02.587487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495596+0000","last_change":"2023-03-03T06:25:56.085066+0000","last_active":"2023-03-03T06:25:57.495596+0000","last_peered":"2023-03-03T06:25:57.495596+0000","last_clean":"2023-03-03T06:25:57.495596+0000","last_became_active":"2023-03-03T06:25:56.084827+0000","last_became_peered":"2023-03-03T06:25:56.084827+0000","last_unstale":"2023-03-03T06:25:57.495596+0000","last_undegraded":"2023-03-03T06:25:57.495596+0000","last_fullsized":"2023-03-03T06:25:57.495596+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:29:37.913800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494605+0000","last_change":"2023-03-03T06:25:56.092061+0000","last_active":"2023-03-03T06:25:57.494605+0000","last_peered":"2023-03-03T06:25:57.494605+0000","last_clean":"2023-03-03T06:25:57.494605+0000","last_became_active":"2023-03-03T06:25:56.091797+0000","last_became_peered":"2023-03-03T06:25:56.091797+0000","last_unstale":"2023-03-03T06:25:57.494605+0000","last_undegraded":"2023-03-03T06:25:57.494605+0000","last_fullsized":"2023-03-03T06:25:57.494605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:46:31.226919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079353+0000","last_change":"2023-03-03T06:25:56.104486+0000","last_active":"2023-03-03T06:25:57.079353+0000","last_peered":"2023-03-03T06:25:57.079353+0000","last_clean":"2023-03-03T06:25:57.079353+0000","last_became_active":"2023-03-03T06:25:56.104227+0000","last_became_peered":"2023-03-03T06:25:56.104227+0000","last_unstale":"2023-03-03T06:25:57.079353+0000","last_undegraded":"2023-03-03T06:25:57.079353+0000","last_fullsized":"2023-03-03T06:25:57.079353+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:50:19.944317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496611+0000","last_change":"2023-03-03T06:25:56.104229+0000","last_active":"2023-03-03T06:25:57.496611+0000","last_peered":"2023-03-03T06:25:57.496611+0000","last_clean":"2023-03-03T06:25:57.496611+0000","last_became_active":"2023-03-03T06:25:56.103532+0000","last_became_peered":"2023-03-03T06:25:56.103532+0000","last_unstale":"2023-03-03T06:25:57.496611+0000","last_undegraded":"2023-03-03T06:25:57.496611+0000","last_fullsized":"2023-03-03T06:25:57.496611+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:04:58.315586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082735+0000","last_change":"2023-03-03T06:25:56.109358+0000","last_active":"2023-03-03T06:25:57.082735+0000","last_peered":"2023-03-03T06:25:57.082735+0000","last_clean":"2023-03-03T06:25:57.082735+0000","last_became_active":"2023-03-03T06:25:56.109051+0000","last_became_peered":"2023-03-03T06:25:56.109051+0000","last_unstale":"2023-03-03T06:25:57.082735+0000","last_undegraded":"2023-03-03T06:25:57.082735+0000","last_fullsized":"2023-03-03T06:25:57.082735+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:16:36.237179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.078750+0000","last_change":"2023-03-03T06:25:56.099455+0000","last_active":"2023-03-03T06:25:57.078750+0000","last_peered":"2023-03-03T06:25:57.078750+0000","last_clean":"2023-03-03T06:25:57.078750+0000","last_became_active":"2023-03-03T06:25:56.099215+0000","last_became_peered":"2023-03-03T06:25:56.099215+0000","last_unstale":"2023-03-03T06:25:57.078750+0000","last_undegraded":"2023-03-03T06:25:57.078750+0000","last_fullsized":"2023-03-03T06:25:57.078750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:20:21.387826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080676+0000","last_change":"2023-03-03T06:25:56.097222+0000","last_active":"2023-03-03T06:25:57.080676+0000","last_peered":"2023-03-03T06:25:57.080676+0000","last_clean":"2023-03-03T06:25:57.080676+0000","last_became_active":"2023-03-03T06:25:56.096904+0000","last_became_peered":"2023-03-03T06:25:56.096904+0000","last_unstale":"2023-03-03T06:25:57.080676+0000","last_undegraded":"2023-03-03T06:25:57.080676+0000","last_fullsized":"2023-03-03T06:25:57.080676+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:28.378207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494685+0000","last_change":"2023-03-03T06:25:56.095548+0000","last_active":"2023-03-03T06:25:57.494685+0000","last_peered":"2023-03-03T06:25:57.494685+0000","last_clean":"2023-03-03T06:25:57.494685+0000","last_became_active":"2023-03-03T06:25:56.095279+0000","last_became_peered":"2023-03-03T06:25:56.095279+0000","last_unstale":"2023-03-03T06:25:57.494685+0000","last_undegraded":"2023-03-03T06:25:57.494685+0000","last_fullsized":"2023-03-03T06:25:57.494685+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:08:55.169820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495664+0000","last_change":"2023-03-03T06:25:56.100217+0000","last_active":"2023-03-03T06:25:57.495664+0000","last_peered":"2023-03-03T06:25:57.495664+0000","last_clean":"2023-03-03T06:25:57.495664+0000","last_became_active":"2023-03-03T06:25:56.099807+0000","last_became_peered":"2023-03-03T06:25:56.099807+0000","last_unstale":"2023-03-03T06:25:57.495664+0000","last_undegraded":"2023-03-03T06:25:57.495664+0000","last_fullsized":"2023-03-03T06:25:57.495664+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:46:48.117716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494899+0000","last_change":"2023-03-03T06:25:56.103210+0000","last_active":"2023-03-03T06:25:57.494899+0000","last_peered":"2023-03-03T06:25:57.494899+0000","last_clean":"2023-03-03T06:25:57.494899+0000","last_became_active":"2023-03-03T06:25:56.102700+0000","last_became_peered":"2023-03-03T06:25:56.102700+0000","last_unstale":"2023-03-03T06:25:57.494899+0000","last_undegraded":"2023-03-03T06:25:57.494899+0000","last_fullsized":"2023-03-03T06:25:57.494899+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:42:30.715793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079255+0000","last_change":"2023-03-03T06:25:56.093713+0000","last_active":"2023-03-03T06:25:57.079255+0000","last_peered":"2023-03-03T06:25:57.079255+0000","last_clean":"2023-03-03T06:25:57.079255+0000","last_became_active":"2023-03-03T06:25:56.093383+0000","last_became_peered":"2023-03-03T06:25:56.093383+0000","last_unstale":"2023-03-03T06:25:57.079255+0000","last_undegraded":"2023-03-03T06:25:57.079255+0000","last_fullsized":"2023-03-03T06:25:57.079255+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:27:45.323242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496535+0000","last_change":"2023-03-03T06:25:56.104385+0000","last_active":"2023-03-03T06:25:57.496535+0000","last_peered":"2023-03-03T06:25:57.496535+0000","last_clean":"2023-03-03T06:25:57.496535+0000","last_became_active":"2023-03-03T06:25:56.103881+0000","last_became_peered":"2023-03-03T06:25:56.103881+0000","last_unstale":"2023-03-03T06:25:57.496535+0000","last_undegraded":"2023-03-03T06:25:57.496535+0000","last_fullsized":"2023-03-03T06:25:57.496535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:52:23.249309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495264+0000","last_change":"2023-03-03T06:25:56.097832+0000","last_active":"2023-03-03T06:25:57.495264+0000","last_peered":"2023-03-03T06:25:57.495264+0000","last_clean":"2023-03-03T06:25:57.495264+0000","last_became_active":"2023-03-03T06:25:56.097237+0000","last_became_peered":"2023-03-03T06:25:56.097237+0000","last_unstale":"2023-03-03T06:25:57.495264+0000","last_undegraded":"2023-03-03T06:25:57.495264+0000","last_fullsized":"2023-03-03T06:25:57.495264+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:03:22.983718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.202826+0000","last_change":"2023-03-03T06:25:56.104268+0000","last_active":"2023-03-03T06:25:57.202826+0000","last_peered":"2023-03-03T06:25:57.202826+0000","last_clean":"2023-03-03T06:25:57.202826+0000","last_became_active":"2023-03-03T06:25:56.103986+0000","last_became_peered":"2023-03-03T06:25:56.103986+0000","last_unstale":"2023-03-03T06:25:57.202826+0000","last_undegraded":"2023-03-03T06:25:57.202826+0000","last_fullsized":"2023-03-03T06:25:57.202826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:47.353315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079501+0000","last_change":"2023-03-03T06:25:56.106890+0000","last_active":"2023-03-03T06:25:57.079501+0000","last_peered":"2023-03-03T06:25:57.079501+0000","last_clean":"2023-03-03T06:25:57.079501+0000","last_became_active":"2023-03-03T06:25:56.106625+0000","last_became_peered":"2023-03-03T06:25:56.106625+0000","last_unstale":"2023-03-03T06:25:57.079501+0000","last_undegraded":"2023-03-03T06:25:57.079501+0000","last_fullsized":"2023-03-03T06:25:57.079501+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:50:17.765713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495573+0000","last_change":"2023-03-03T06:25:56.096272+0000","last_active":"2023-03-03T06:25:57.495573+0000","last_peered":"2023-03-03T06:25:57.495573+0000","last_clean":"2023-03-03T06:25:57.495573+0000","last_became_active":"2023-03-03T06:25:56.092063+0000","last_became_peered":"2023-03-03T06:25:56.092063+0000","last_unstale":"2023-03-03T06:25:57.495573+0000","last_undegraded":"2023-03-03T06:25:57.495573+0000","last_fullsized":"2023-03-03T06:25:57.495573+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:53:12.251213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496509+0000","last_change":"2023-03-03T06:25:56.093667+0000","last_active":"2023-03-03T06:25:57.496509+0000","last_peered":"2023-03-03T06:25:57.496509+0000","last_clean":"2023-03-03T06:25:57.496509+0000","last_became_active":"2023-03-03T06:25:56.093420+0000","last_became_peered":"2023-03-03T06:25:56.093420+0000","last_unstale":"2023-03-03T06:25:57.496509+0000","last_undegraded":"2023-03-03T06:25:57.496509+0000","last_fullsized":"2023-03-03T06:25:57.496509+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:16:39.291453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079116+0000","last_change":"2023-03-03T06:25:56.091330+0000","last_active":"2023-03-03T06:25:57.079116+0000","last_peered":"2023-03-03T06:25:57.079116+0000","last_clean":"2023-03-03T06:25:57.079116+0000","last_became_active":"2023-03-03T06:25:56.091044+0000","last_became_peered":"2023-03-03T06:25:56.091044+0000","last_unstale":"2023-03-03T06:25:57.079116+0000","last_undegraded":"2023-03-03T06:25:57.079116+0000","last_fullsized":"2023-03-03T06:25:57.079116+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:23:34.085580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080217+0000","last_change":"2023-03-03T06:25:56.098685+0000","last_active":"2023-03-03T06:25:57.080217+0000","last_peered":"2023-03-03T06:25:57.080217+0000","last_clean":"2023-03-03T06:25:57.080217+0000","last_became_active":"2023-03-03T06:25:56.098411+0000","last_became_peered":"2023-03-03T06:25:56.098411+0000","last_unstale":"2023-03-03T06:25:57.080217+0000","last_undegraded":"2023-03-03T06:25:57.080217+0000","last_fullsized":"2023-03-03T06:25:57.080217+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:42:30.715793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.078960+0000","last_change":"2023-03-03T06:25:56.093796+0000","last_active":"2023-03-03T06:25:57.078960+0000","last_peered":"2023-03-03T06:25:57.078960+0000","last_clean":"2023-03-03T06:25:57.078960+0000","last_became_active":"2023-03-03T06:25:56.093529+0000","last_became_peered":"2023-03-03T06:25:56.093529+0000","last_unstale":"2023-03-03T06:25:57.078960+0000","last_undegraded":"2023-03-03T06:25:57.078960+0000","last_fullsized":"2023-03-03T06:25:57.078960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:17.826074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080136+0000","last_change":"2023-03-03T06:25:56.095604+0000","last_active":"2023-03-03T06:25:57.080136+0000","last_peered":"2023-03-03T06:25:57.080136+0000","last_clean":"2023-03-03T06:25:57.080136+0000","last_became_active":"2023-03-03T06:25:56.095321+0000","last_became_peered":"2023-03-03T06:25:56.095321+0000","last_unstale":"2023-03-03T06:25:57.080136+0000","last_undegraded":"2023-03-03T06:25:57.080136+0000","last_fullsized":"2023-03-03T06:25:57.080136+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:46:31.226919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495141+0000","last_change":"2023-03-03T06:25:56.097846+0000","last_active":"2023-03-03T06:25:57.495141+0000","last_peered":"2023-03-03T06:25:57.495141+0000","last_clean":"2023-03-03T06:25:57.495141+0000","last_became_active":"2023-03-03T06:25:56.097566+0000","last_became_peered":"2023-03-03T06:25:56.097566+0000","last_unstale":"2023-03-03T06:25:57.495141+0000","last_undegraded":"2023-03-03T06:25:57.495141+0000","last_fullsized":"2023-03-03T06:25:57.495141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:42:58.683886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496948+0000","last_change":"2023-03-03T06:25:56.103079+0000","last_active":"2023-03-03T06:25:57.496948+0000","last_peered":"2023-03-03T06:25:57.496948+0000","last_clean":"2023-03-03T06:25:57.496948+0000","last_became_active":"2023-03-03T06:25:56.102814+0000","last_became_peered":"2023-03-03T06:25:56.102814+0000","last_unstale":"2023-03-03T06:25:57.496948+0000","last_undegraded":"2023-03-03T06:25:57.496948+0000","last_fullsized":"2023-03-03T06:25:57.496948+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:28.378207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494720+0000","last_change":"2023-03-03T06:25:56.103181+0000","last_active":"2023-03-03T06:25:57.494720+0000","last_peered":"2023-03-03T06:25:57.494720+0000","last_clean":"2023-03-03T06:25:57.494720+0000","last_became_active":"2023-03-03T06:25:56.102890+0000","last_became_peered":"2023-03-03T06:25:56.102890+0000","last_unstale":"2023-03-03T06:25:57.494720+0000","last_undegraded":"2023-03-03T06:25:57.494720+0000","last_fullsized":"2023-03-03T06:25:57.494720+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:20:50.411879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203193+0000","last_change":"2023-03-03T06:25:56.097911+0000","last_active":"2023-03-03T06:25:57.203193+0000","last_peered":"2023-03-03T06:25:57.203193+0000","last_clean":"2023-03-03T06:25:57.203193+0000","last_became_active":"2023-03-03T06:25:56.097360+0000","last_became_peered":"2023-03-03T06:25:56.097360+0000","last_unstale":"2023-03-03T06:25:57.203193+0000","last_undegraded":"2023-03-03T06:25:57.203193+0000","last_fullsized":"2023-03-03T06:25:57.203193+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:09.797200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.078972+0000","last_change":"2023-03-03T06:25:56.091302+0000","last_active":"2023-03-03T06:25:57.078972+0000","last_peered":"2023-03-03T06:25:57.078972+0000","last_clean":"2023-03-03T06:25:57.078972+0000","last_became_active":"2023-03-03T06:25:56.090753+0000","last_became_peered":"2023-03-03T06:25:56.090753+0000","last_unstale":"2023-03-03T06:25:57.078972+0000","last_undegraded":"2023-03-03T06:25:57.078972+0000","last_fullsized":"2023-03-03T06:25:57.078972+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:33:34.709353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495813+0000","last_change":"2023-03-03T06:25:56.100190+0000","last_active":"2023-03-03T06:25:57.495813+0000","last_peered":"2023-03-03T06:25:57.495813+0000","last_clean":"2023-03-03T06:25:57.495813+0000","last_became_active":"2023-03-03T06:25:56.099924+0000","last_became_peered":"2023-03-03T06:25:56.099924+0000","last_unstale":"2023-03-03T06:25:57.495813+0000","last_undegraded":"2023-03-03T06:25:57.495813+0000","last_fullsized":"2023-03-03T06:25:57.495813+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:40:15.714529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.202977+0000","last_change":"2023-03-03T06:25:56.101020+0000","last_active":"2023-03-03T06:25:57.202977+0000","last_peered":"2023-03-03T06:25:57.202977+0000","last_clean":"2023-03-03T06:25:57.202977+0000","last_became_active":"2023-03-03T06:25:56.100807+0000","last_became_peered":"2023-03-03T06:25:56.100807+0000","last_unstale":"2023-03-03T06:25:57.202977+0000","last_undegraded":"2023-03-03T06:25:57.202977+0000","last_fullsized":"2023-03-03T06:25:57.202977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:49:27.238328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494832+0000","last_change":"2023-03-03T06:25:56.101134+0000","last_active":"2023-03-03T06:25:57.494832+0000","last_peered":"2023-03-03T06:25:57.494832+0000","last_clean":"2023-03-03T06:25:57.494832+0000","last_became_active":"2023-03-03T06:25:56.100876+0000","last_became_peered":"2023-03-03T06:25:56.100876+0000","last_unstale":"2023-03-03T06:25:57.494832+0000","last_undegraded":"2023-03-03T06:25:57.494832+0000","last_fullsized":"2023-03-03T06:25:57.494832+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:21:22.017295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.202921+0000","last_change":"2023-03-03T06:25:56.105988+0000","last_active":"2023-03-03T06:25:57.202921+0000","last_peered":"2023-03-03T06:25:57.202921+0000","last_clean":"2023-03-03T06:25:57.202921+0000","last_became_active":"2023-03-03T06:25:56.105719+0000","last_became_peered":"2023-03-03T06:25:56.105719+0000","last_unstale":"2023-03-03T06:25:57.202921+0000","last_undegraded":"2023-03-03T06:25:57.202921+0000","last_fullsized":"2023-03-03T06:25:57.202921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:13:44.325287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082808+0000","last_change":"2023-03-03T06:25:56.101182+0000","last_active":"2023-03-03T06:25:57.082808+0000","last_peered":"2023-03-03T06:25:57.082808+0000","last_clean":"2023-03-03T06:25:57.082808+0000","last_became_active":"2023-03-03T06:25:56.100912+0000","last_became_peered":"2023-03-03T06:25:56.100912+0000","last_unstale":"2023-03-03T06:25:57.082808+0000","last_undegraded":"2023-03-03T06:25:57.082808+0000","last_fullsized":"2023-03-03T06:25:57.082808+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:25:54.177340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203104+0000","last_change":"2023-03-03T06:25:55.679799+0000","last_active":"2023-03-03T06:25:57.203104+0000","last_peered":"2023-03-03T06:25:57.203104+0000","last_clean":"2023-03-03T06:25:57.203104+0000","last_became_active":"2023-03-03T06:25:55.679576+0000","last_became_peered":"2023-03-03T06:25:55.679576+0000","last_unstale":"2023-03-03T06:25:57.203104+0000","last_undegraded":"2023-03-03T06:25:57.203104+0000","last_fullsized":"2023-03-03T06:25:57.203104+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:25:41.983780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.078519+0000","last_change":"2023-03-03T06:25:05.635776+0000","last_active":"2023-03-03T06:25:56.078519+0000","last_peered":"2023-03-03T06:25:56.078519+0000","last_clean":"2023-03-03T06:25:56.078519+0000","last_became_active":"2023-03-03T06:25:04.444243+0000","last_became_peered":"2023-03-03T06:25:04.444243+0000","last_unstale":"2023-03-03T06:25:56.078519+0000","last_undegraded":"2023-03-03T06:25:56.078519+0000","last_fullsized":"2023-03-03T06:25:56.078519+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:00:41.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066956899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494621+0000","last_change":"2023-03-03T06:25:56.094983+0000","last_active":"2023-03-03T06:25:57.494621+0000","last_peered":"2023-03-03T06:25:57.494621+0000","last_clean":"2023-03-03T06:25:57.494621+0000","last_became_active":"2023-03-03T06:25:56.094511+0000","last_became_peered":"2023-03-03T06:25:56.094511+0000","last_unstale":"2023-03-03T06:25:57.494621+0000","last_undegraded":"2023-03-03T06:25:57.494621+0000","last_fullsized":"2023-03-03T06:25:57.494621+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:52:04.016434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"67'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494436+0000","last_change":"2023-03-03T06:25:55.667137+0000","last_active":"2023-03-03T06:25:57.494436+0000","last_peered":"2023-03-03T06:25:57.494436+0000","last_clean":"2023-03-03T06:25:57.494436+0000","last_became_active":"2023-03-03T06:25:55.666830+0000","last_became_peered":"2023-03-03T06:25:55.666830+0000","last_unstale":"2023-03-03T06:25:57.494436+0000","last_undegraded":"2023-03-03T06:25:57.494436+0000","last_fullsized":"2023-03-03T06:25:57.494436+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:52:18.007639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.093511+0000","last_change":"2023-03-03T06:25:05.615550+0000","last_active":"2023-03-03T06:25:56.093511+0000","last_peered":"2023-03-03T06:25:56.093511+0000","last_clean":"2023-03-03T06:25:56.093511+0000","last_became_active":"2023-03-03T06:25:04.445574+0000","last_became_peered":"2023-03-03T06:25:04.445574+0000","last_unstale":"2023-03-03T06:25:56.093511+0000","last_undegraded":"2023-03-03T06:25:56.093511+0000","last_fullsized":"2023-03-03T06:25:56.093511+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:15:06.370284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061229600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.083064+0000","last_change":"2023-03-03T06:25:56.095900+0000","last_active":"2023-03-03T06:25:57.083064+0000","last_peered":"2023-03-03T06:25:57.083064+0000","last_clean":"2023-03-03T06:25:57.083064+0000","last_became_active":"2023-03-03T06:25:56.095612+0000","last_became_peered":"2023-03-03T06:25:56.095612+0000","last_unstale":"2023-03-03T06:25:57.083064+0000","last_undegraded":"2023-03-03T06:25:57.083064+0000","last_fullsized":"2023-03-03T06:25:57.083064+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:31:28.438828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"67'8","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495927+0000","last_change":"2023-03-03T06:25:55.667014+0000","last_active":"2023-03-03T06:25:57.495927+0000","last_peered":"2023-03-03T06:25:57.495927+0000","last_clean":"2023-03-03T06:25:57.495927+0000","last_became_active":"2023-03-03T06:25:55.666717+0000","last_became_peered":"2023-03-03T06:25:55.666717+0000","last_unstale":"2023-03-03T06:25:57.495927+0000","last_undegraded":"2023-03-03T06:25:57.495927+0000","last_fullsized":"2023-03-03T06:25:57.495927+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:29.938169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":38,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.089324+0000","last_change":"2023-03-03T06:25:05.431475+0000","last_active":"2023-03-03T06:25:56.089324+0000","last_peered":"2023-03-03T06:25:56.089324+0000","last_clean":"2023-03-03T06:25:56.089324+0000","last_became_active":"2023-03-03T06:25:04.596724+0000","last_became_peered":"2023-03-03T06:25:04.596724+0000","last_unstale":"2023-03-03T06:25:56.089324+0000","last_undegraded":"2023-03-03T06:25:56.089324+0000","last_fullsized":"2023-03-03T06:25:56.089324+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015785179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082871+0000","last_change":"2023-03-03T06:25:56.102616+0000","last_active":"2023-03-03T06:25:57.082871+0000","last_peered":"2023-03-03T06:25:57.082871+0000","last_clean":"2023-03-03T06:25:57.082871+0000","last_became_active":"2023-03-03T06:25:56.102361+0000","last_became_peered":"2023-03-03T06:25:56.102361+0000","last_unstale":"2023-03-03T06:25:57.082871+0000","last_undegraded":"2023-03-03T06:25:57.082871+0000","last_fullsized":"2023-03-03T06:25:57.082871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:15:55.501403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.078821+0000","last_change":"2023-03-03T06:25:55.672747+0000","last_active":"2023-03-03T06:25:57.078821+0000","last_peered":"2023-03-03T06:25:57.078821+0000","last_clean":"2023-03-03T06:25:57.078821+0000","last_became_active":"2023-03-03T06:25:55.672334+0000","last_became_peered":"2023-03-03T06:25:55.672334+0000","last_unstale":"2023-03-03T06:25:57.078821+0000","last_undegraded":"2023-03-03T06:25:57.078821+0000","last_fullsized":"2023-03-03T06:25:57.078821+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:30.822215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":35,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.088896+0000","last_change":"2023-03-03T06:25:05.796744+0000","last_active":"2023-03-03T06:25:56.088896+0000","last_peered":"2023-03-03T06:25:56.088896+0000","last_clean":"2023-03-03T06:25:56.088896+0000","last_became_active":"2023-03-03T06:25:04.444571+0000","last_became_peered":"2023-03-03T06:25:04.444571+0000","last_unstale":"2023-03-03T06:25:56.088896+0000","last_undegraded":"2023-03-03T06:25:56.088896+0000","last_fullsized":"2023-03-03T06:25:56.088896+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:46:48.500233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050328500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494911+0000","last_change":"2023-03-03T06:25:56.093921+0000","last_active":"2023-03-03T06:25:57.494911+0000","last_peered":"2023-03-03T06:25:57.494911+0000","last_clean":"2023-03-03T06:25:57.494911+0000","last_became_active":"2023-03-03T06:25:56.093622+0000","last_became_peered":"2023-03-03T06:25:56.093622+0000","last_unstale":"2023-03-03T06:25:57.494911+0000","last_undegraded":"2023-03-03T06:25:57.494911+0000","last_fullsized":"2023-03-03T06:25:57.494911+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:44:53.606330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494779+0000","last_change":"2023-03-03T06:25:55.672493+0000","last_active":"2023-03-03T06:25:57.494779+0000","last_peered":"2023-03-03T06:25:57.494779+0000","last_clean":"2023-03-03T06:25:57.494779+0000","last_became_active":"2023-03-03T06:25:55.672194+0000","last_became_peered":"2023-03-03T06:25:55.672194+0000","last_unstale":"2023-03-03T06:25:57.494779+0000","last_undegraded":"2023-03-03T06:25:57.494779+0000","last_fullsized":"2023-03-03T06:25:57.494779+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:08.795345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.088445+0000","last_change":"2023-03-03T06:25:05.615943+0000","last_active":"2023-03-03T06:25:56.088445+0000","last_peered":"2023-03-03T06:25:56.088445+0000","last_clean":"2023-03-03T06:25:56.088445+0000","last_became_active":"2023-03-03T06:25:04.443824+0000","last_became_peered":"2023-03-03T06:25:04.443824+0000","last_unstale":"2023-03-03T06:25:56.088445+0000","last_undegraded":"2023-03-03T06:25:56.088445+0000","last_fullsized":"2023-03-03T06:25:56.088445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:11.723607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059238800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495147+0000","last_change":"2023-03-03T06:25:56.107463+0000","last_active":"2023-03-03T06:25:57.495147+0000","last_peered":"2023-03-03T06:25:57.495147+0000","last_clean":"2023-03-03T06:25:57.495147+0000","last_became_active":"2023-03-03T06:25:56.107214+0000","last_became_peered":"2023-03-03T06:25:56.107214+0000","last_unstale":"2023-03-03T06:25:57.495147+0000","last_undegraded":"2023-03-03T06:25:57.495147+0000","last_fullsized":"2023-03-03T06:25:57.495147+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:19:49.766279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203439+0000","last_change":"2023-03-03T06:25:55.678109+0000","last_active":"2023-03-03T06:25:57.203439+0000","last_peered":"2023-03-03T06:25:57.203439+0000","last_clean":"2023-03-03T06:25:57.203439+0000","last_became_active":"2023-03-03T06:25:55.677807+0000","last_became_peered":"2023-03-03T06:25:55.677807+0000","last_unstale":"2023-03-03T06:25:57.203439+0000","last_undegraded":"2023-03-03T06:25:57.203439+0000","last_fullsized":"2023-03-03T06:25:57.203439+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:16:35.235324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.085430+0000","last_change":"2023-03-03T06:25:05.430594+0000","last_active":"2023-03-03T06:25:56.085430+0000","last_peered":"2023-03-03T06:25:56.085430+0000","last_clean":"2023-03-03T06:25:56.085430+0000","last_became_active":"2023-03-03T06:25:04.435012+0000","last_became_peered":"2023-03-03T06:25:04.435012+0000","last_unstale":"2023-03-03T06:25:56.085430+0000","last_undegraded":"2023-03-03T06:25:56.085430+0000","last_fullsized":"2023-03-03T06:25:56.085430+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052988999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494885+0000","last_change":"2023-03-03T06:25:56.107656+0000","last_active":"2023-03-03T06:25:57.494885+0000","last_peered":"2023-03-03T06:25:57.494885+0000","last_clean":"2023-03-03T06:25:57.494885+0000","last_became_active":"2023-03-03T06:25:56.107398+0000","last_became_peered":"2023-03-03T06:25:56.107398+0000","last_unstale":"2023-03-03T06:25:57.494885+0000","last_undegraded":"2023-03-03T06:25:57.494885+0000","last_fullsized":"2023-03-03T06:25:57.494885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:11:52.602772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"67'6","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082913+0000","last_change":"2023-03-03T06:25:55.667072+0000","last_active":"2023-03-03T06:25:57.082913+0000","last_peered":"2023-03-03T06:25:57.082913+0000","last_clean":"2023-03-03T06:25:57.082913+0000","last_became_active":"2023-03-03T06:25:55.666796+0000","last_became_peered":"2023-03-03T06:25:55.666796+0000","last_unstale":"2023-03-03T06:25:57.082913+0000","last_undegraded":"2023-03-03T06:25:57.082913+0000","last_fullsized":"2023-03-03T06:25:57.082913+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:01:20.131181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.099011+0000","last_change":"2023-03-03T06:25:05.616017+0000","last_active":"2023-03-03T06:25:56.099011+0000","last_peered":"2023-03-03T06:25:56.099011+0000","last_clean":"2023-03-03T06:25:56.099011+0000","last_became_active":"2023-03-03T06:25:04.443176+0000","last_became_peered":"2023-03-03T06:25:04.443176+0000","last_unstale":"2023-03-03T06:25:56.099011+0000","last_undegraded":"2023-03-03T06:25:56.099011+0000","last_fullsized":"2023-03-03T06:25:56.099011+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:38:47.576162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034461600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496495+0000","last_change":"2023-03-03T06:25:56.100653+0000","last_active":"2023-03-03T06:25:57.496495+0000","last_peered":"2023-03-03T06:25:57.496495+0000","last_clean":"2023-03-03T06:25:57.496495+0000","last_became_active":"2023-03-03T06:25:56.100383+0000","last_became_peered":"2023-03-03T06:25:56.100383+0000","last_unstale":"2023-03-03T06:25:57.496495+0000","last_undegraded":"2023-03-03T06:25:57.496495+0000","last_fullsized":"2023-03-03T06:25:57.496495+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:52:02.544501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"67'3","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079191+0000","last_change":"2023-03-03T06:25:55.669256+0000","last_active":"2023-03-03T06:25:57.079191+0000","last_peered":"2023-03-03T06:25:57.079191+0000","last_clean":"2023-03-03T06:25:57.079191+0000","last_became_active":"2023-03-03T06:25:55.668948+0000","last_became_peered":"2023-03-03T06:25:55.668948+0000","last_unstale":"2023-03-03T06:25:57.079191+0000","last_undegraded":"2023-03-03T06:25:57.079191+0000","last_fullsized":"2023-03-03T06:25:57.079191+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:39.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":38,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.089677+0000","last_change":"2023-03-03T06:25:05.431768+0000","last_active":"2023-03-03T06:25:56.089677+0000","last_peered":"2023-03-03T06:25:56.089677+0000","last_clean":"2023-03-03T06:25:56.089677+0000","last_became_active":"2023-03-03T06:25:04.596711+0000","last_became_peered":"2023-03-03T06:25:04.596711+0000","last_unstale":"2023-03-03T06:25:56.089677+0000","last_undegraded":"2023-03-03T06:25:56.089677+0000","last_fullsized":"2023-03-03T06:25:56.089677+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001569261,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495493+0000","last_change":"2023-03-03T06:25:56.100049+0000","last_active":"2023-03-03T06:25:57.495493+0000","last_peered":"2023-03-03T06:25:57.495493+0000","last_clean":"2023-03-03T06:25:57.495493+0000","last_became_active":"2023-03-03T06:25:56.099480+0000","last_became_peered":"2023-03-03T06:25:56.099480+0000","last_unstale":"2023-03-03T06:25:57.495493+0000","last_undegraded":"2023-03-03T06:25:57.495493+0000","last_fullsized":"2023-03-03T06:25:57.495493+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:49:48.201810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"67'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494438+0000","last_change":"2023-03-03T06:25:55.675963+0000","last_active":"2023-03-03T06:25:57.494438+0000","last_peered":"2023-03-03T06:25:57.494438+0000","last_clean":"2023-03-03T06:25:57.494438+0000","last_became_active":"2023-03-03T06:25:55.675408+0000","last_became_peered":"2023-03-03T06:25:55.675408+0000","last_unstale":"2023-03-03T06:25:57.494438+0000","last_undegraded":"2023-03-03T06:25:57.494438+0000","last_fullsized":"2023-03-03T06:25:57.494438+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:56:15.985732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.078421+0000","last_change":"2023-03-03T06:25:05.635716+0000","last_active":"2023-03-03T06:25:56.078421+0000","last_peered":"2023-03-03T06:25:56.078421+0000","last_clean":"2023-03-03T06:25:56.078421+0000","last_became_active":"2023-03-03T06:25:04.433896+0000","last_became_peered":"2023-03-03T06:25:04.433896+0000","last_unstale":"2023-03-03T06:25:56.078421+0000","last_undegraded":"2023-03-03T06:25:56.078421+0000","last_fullsized":"2023-03-03T06:25:56.078421+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:35.209807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060132199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495318+0000","last_change":"2023-03-03T06:25:56.100653+0000","last_active":"2023-03-03T06:25:57.495318+0000","last_peered":"2023-03-03T06:25:57.495318+0000","last_clean":"2023-03-03T06:25:57.495318+0000","last_became_active":"2023-03-03T06:25:56.098319+0000","last_became_peered":"2023-03-03T06:25:56.098319+0000","last_unstale":"2023-03-03T06:25:57.495318+0000","last_undegraded":"2023-03-03T06:25:57.495318+0000","last_fullsized":"2023-03-03T06:25:57.495318+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:17:09.456011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"67'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080769+0000","last_change":"2023-03-03T06:25:55.673555+0000","last_active":"2023-03-03T06:25:57.080769+0000","last_peered":"2023-03-03T06:25:57.080769+0000","last_clean":"2023-03-03T06:25:57.080769+0000","last_became_active":"2023-03-03T06:25:55.672936+0000","last_became_peered":"2023-03-03T06:25:55.672936+0000","last_unstale":"2023-03-03T06:25:57.080769+0000","last_undegraded":"2023-03-03T06:25:57.080769+0000","last_fullsized":"2023-03-03T06:25:57.080769+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:59:41.826231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.086306+0000","last_change":"2023-03-03T06:25:05.429739+0000","last_active":"2023-03-03T06:25:56.086306+0000","last_peered":"2023-03-03T06:25:56.086306+0000","last_clean":"2023-03-03T06:25:56.086306+0000","last_became_active":"2023-03-03T06:25:04.438903+0000","last_became_peered":"2023-03-03T06:25:04.438903+0000","last_unstale":"2023-03-03T06:25:56.086306+0000","last_undegraded":"2023-03-03T06:25:56.086306+0000","last_fullsized":"2023-03-03T06:25:56.086306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040434999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082998+0000","last_change":"2023-03-03T06:25:56.109030+0000","last_active":"2023-03-03T06:25:57.082998+0000","last_peered":"2023-03-03T06:25:57.082998+0000","last_clean":"2023-03-03T06:25:57.082998+0000","last_became_active":"2023-03-03T06:25:56.108725+0000","last_became_peered":"2023-03-03T06:25:56.108725+0000","last_unstale":"2023-03-03T06:25:57.082998+0000","last_undegraded":"2023-03-03T06:25:57.082998+0000","last_fullsized":"2023-03-03T06:25:57.082998+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:20:38.452147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.078833+0000","last_change":"2023-03-03T06:25:55.668379+0000","last_active":"2023-03-03T06:25:57.078833+0000","last_peered":"2023-03-03T06:25:57.078833+0000","last_clean":"2023-03-03T06:25:57.078833+0000","last_became_active":"2023-03-03T06:25:55.667272+0000","last_became_peered":"2023-03-03T06:25:55.667272+0000","last_unstale":"2023-03-03T06:25:57.078833+0000","last_undegraded":"2023-03-03T06:25:57.078833+0000","last_fullsized":"2023-03-03T06:25:57.078833+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:30:27.305804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.087199+0000","last_change":"2023-03-03T06:25:05.430443+0000","last_active":"2023-03-03T06:25:56.087199+0000","last_peered":"2023-03-03T06:25:56.087199+0000","last_clean":"2023-03-03T06:25:56.087199+0000","last_became_active":"2023-03-03T06:25:04.596481+0000","last_became_peered":"2023-03-03T06:25:04.596481+0000","last_unstale":"2023-03-03T06:25:56.087199+0000","last_undegraded":"2023-03-03T06:25:56.087199+0000","last_fullsized":"2023-03-03T06:25:56.087199+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044860800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080439+0000","last_change":"2023-03-03T06:25:56.096695+0000","last_active":"2023-03-03T06:25:57.080439+0000","last_peered":"2023-03-03T06:25:57.080439+0000","last_clean":"2023-03-03T06:25:57.080439+0000","last_became_active":"2023-03-03T06:25:56.096174+0000","last_became_peered":"2023-03-03T06:25:56.096174+0000","last_unstale":"2023-03-03T06:25:57.080439+0000","last_undegraded":"2023-03-03T06:25:57.080439+0000","last_fullsized":"2023-03-03T06:25:57.080439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:52:04.016434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495311+0000","last_change":"2023-03-03T06:25:55.674908+0000","last_active":"2023-03-03T06:25:57.495311+0000","last_peered":"2023-03-03T06:25:57.495311+0000","last_clean":"2023-03-03T06:25:57.495311+0000","last_became_active":"2023-03-03T06:25:55.674628+0000","last_became_peered":"2023-03-03T06:25:55.674628+0000","last_unstale":"2023-03-03T06:25:57.495311+0000","last_undegraded":"2023-03-03T06:25:57.495311+0000","last_fullsized":"2023-03-03T06:25:57.495311+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:46.351459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.093284+0000","last_change":"2023-03-03T06:25:05.431490+0000","last_active":"2023-03-03T06:25:56.093284+0000","last_peered":"2023-03-03T06:25:56.093284+0000","last_clean":"2023-03-03T06:25:56.093284+0000","last_became_active":"2023-03-03T06:25:04.443163+0000","last_became_peered":"2023-03-03T06:25:04.443163+0000","last_unstale":"2023-03-03T06:25:56.093284+0000","last_undegraded":"2023-03-03T06:25:56.093284+0000","last_fullsized":"2023-03-03T06:25:56.093284+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020118839999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495412+0000","last_change":"2023-03-03T06:25:56.098001+0000","last_active":"2023-03-03T06:25:57.495412+0000","last_peered":"2023-03-03T06:25:57.495412+0000","last_clean":"2023-03-03T06:25:57.495412+0000","last_became_active":"2023-03-03T06:25:56.097577+0000","last_became_peered":"2023-03-03T06:25:56.097577+0000","last_unstale":"2023-03-03T06:25:57.495412+0000","last_undegraded":"2023-03-03T06:25:57.495412+0000","last_fullsized":"2023-03-03T06:25:57.495412+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:04:58.315586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"67'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203358+0000","last_change":"2023-03-03T06:25:55.674231+0000","last_active":"2023-03-03T06:25:57.203358+0000","last_peered":"2023-03-03T06:25:57.203358+0000","last_clean":"2023-03-03T06:25:57.203358+0000","last_became_active":"2023-03-03T06:25:55.673938+0000","last_became_peered":"2023-03-03T06:25:55.673938+0000","last_unstale":"2023-03-03T06:25:57.203358+0000","last_undegraded":"2023-03-03T06:25:57.203358+0000","last_fullsized":"2023-03-03T06:25:57.203358+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:23:52.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.086458+0000","last_change":"2023-03-03T06:25:05.432139+0000","last_active":"2023-03-03T06:25:56.086458+0000","last_peered":"2023-03-03T06:25:56.086458+0000","last_clean":"2023-03-03T06:25:56.086458+0000","last_became_active":"2023-03-03T06:25:04.435759+0000","last_became_peered":"2023-03-03T06:25:04.435759+0000","last_unstale":"2023-03-03T06:25:56.086458+0000","last_undegraded":"2023-03-03T06:25:56.086458+0000","last_fullsized":"2023-03-03T06:25:56.086458+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001646893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494676+0000","last_change":"2023-03-03T06:25:56.092274+0000","last_active":"2023-03-03T06:25:57.494676+0000","last_peered":"2023-03-03T06:25:57.494676+0000","last_clean":"2023-03-03T06:25:57.494676+0000","last_became_active":"2023-03-03T06:25:56.091998+0000","last_became_peered":"2023-03-03T06:25:56.091998+0000","last_unstale":"2023-03-03T06:25:57.494676+0000","last_undegraded":"2023-03-03T06:25:57.494676+0000","last_fullsized":"2023-03-03T06:25:57.494676+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:27:53.405992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"67'4","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079401+0000","last_change":"2023-03-03T06:25:55.672634+0000","last_active":"2023-03-03T06:25:57.079401+0000","last_peered":"2023-03-03T06:25:57.079401+0000","last_clean":"2023-03-03T06:25:57.079401+0000","last_became_active":"2023-03-03T06:25:55.672083+0000","last_became_peered":"2023-03-03T06:25:55.672083+0000","last_unstale":"2023-03-03T06:25:57.079401+0000","last_undegraded":"2023-03-03T06:25:57.079401+0000","last_fullsized":"2023-03-03T06:25:57.079401+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:29:15.920867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.079202+0000","last_change":"2023-03-03T06:25:05.635968+0000","last_active":"2023-03-03T06:25:56.079202+0000","last_peered":"2023-03-03T06:25:56.079202+0000","last_clean":"2023-03-03T06:25:56.079202+0000","last_became_active":"2023-03-03T06:25:04.443619+0000","last_became_peered":"2023-03-03T06:25:04.443619+0000","last_unstale":"2023-03-03T06:25:56.079202+0000","last_undegraded":"2023-03-03T06:25:56.079202+0000","last_fullsized":"2023-03-03T06:25:56.079202+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:51:15.780667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077929799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080470+0000","last_change":"2023-03-03T06:25:56.098564+0000","last_active":"2023-03-03T06:25:57.080470+0000","last_peered":"2023-03-03T06:25:57.080470+0000","last_clean":"2023-03-03T06:25:57.080470+0000","last_became_active":"2023-03-03T06:25:56.098089+0000","last_became_peered":"2023-03-03T06:25:56.098089+0000","last_unstale":"2023-03-03T06:25:57.080470+0000","last_undegraded":"2023-03-03T06:25:57.080470+0000","last_fullsized":"2023-03-03T06:25:57.080470+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:20:50.411879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"67'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082810+0000","last_change":"2023-03-03T06:25:55.671232+0000","last_active":"2023-03-03T06:25:57.082810+0000","last_peered":"2023-03-03T06:25:57.082810+0000","last_clean":"2023-03-03T06:25:57.082810+0000","last_became_active":"2023-03-03T06:25:55.670879+0000","last_became_peered":"2023-03-03T06:25:55.670879+0000","last_unstale":"2023-03-03T06:25:57.082810+0000","last_undegraded":"2023-03-03T06:25:57.082810+0000","last_fullsized":"2023-03-03T06:25:57.082810+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:05:52.789527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.092396+0000","last_change":"2023-03-03T06:25:05.432320+0000","last_active":"2023-03-03T06:25:56.092396+0000","last_peered":"2023-03-03T06:25:56.092396+0000","last_clean":"2023-03-03T06:25:56.092396+0000","last_became_active":"2023-03-03T06:25:04.436727+0000","last_became_peered":"2023-03-03T06:25:04.436727+0000","last_unstale":"2023-03-03T06:25:56.092396+0000","last_undegraded":"2023-03-03T06:25:56.092396+0000","last_fullsized":"2023-03-03T06:25:56.092396+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014361980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080332+0000","last_change":"2023-03-03T06:25:56.101790+0000","last_active":"2023-03-03T06:25:57.080332+0000","last_peered":"2023-03-03T06:25:57.080332+0000","last_clean":"2023-03-03T06:25:57.080332+0000","last_became_active":"2023-03-03T06:25:56.101402+0000","last_became_peered":"2023-03-03T06:25:56.101402+0000","last_unstale":"2023-03-03T06:25:57.080332+0000","last_undegraded":"2023-03-03T06:25:57.080332+0000","last_fullsized":"2023-03-03T06:25:57.080332+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:52:02.544501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"67'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203346+0000","last_change":"2023-03-03T06:25:55.678435+0000","last_active":"2023-03-03T06:25:57.203346+0000","last_peered":"2023-03-03T06:25:57.203346+0000","last_clean":"2023-03-03T06:25:57.203346+0000","last_became_active":"2023-03-03T06:25:55.678211+0000","last_became_peered":"2023-03-03T06:25:55.678211+0000","last_unstale":"2023-03-03T06:25:57.203346+0000","last_undegraded":"2023-03-03T06:25:57.203346+0000","last_fullsized":"2023-03-03T06:25:57.203346+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:26:15.352266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":38,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.089752+0000","last_change":"2023-03-03T06:25:05.431681+0000","last_active":"2023-03-03T06:25:56.089752+0000","last_peered":"2023-03-03T06:25:56.089752+0000","last_clean":"2023-03-03T06:25:56.089752+0000","last_became_active":"2023-03-03T06:25:04.443599+0000","last_became_peered":"2023-03-03T06:25:04.443599+0000","last_unstale":"2023-03-03T06:25:56.089752+0000","last_undegraded":"2023-03-03T06:25:56.089752+0000","last_fullsized":"2023-03-03T06:25:56.089752+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001546473,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082941+0000","last_change":"2023-03-03T06:25:56.109044+0000","last_active":"2023-03-03T06:25:57.082941+0000","last_peered":"2023-03-03T06:25:57.082941+0000","last_clean":"2023-03-03T06:25:57.082941+0000","last_became_active":"2023-03-03T06:25:56.108798+0000","last_became_peered":"2023-03-03T06:25:56.108798+0000","last_unstale":"2023-03-03T06:25:57.082941+0000","last_undegraded":"2023-03-03T06:25:57.082941+0000","last_fullsized":"2023-03-03T06:25:57.082941+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:32:14.455577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079055+0000","last_change":"2023-03-03T06:25:55.675443+0000","last_active":"2023-03-03T06:25:57.079055+0000","last_peered":"2023-03-03T06:25:57.079055+0000","last_clean":"2023-03-03T06:25:57.079055+0000","last_became_active":"2023-03-03T06:25:55.675149+0000","last_became_peered":"2023-03-03T06:25:55.675149+0000","last_unstale":"2023-03-03T06:25:57.079055+0000","last_undegraded":"2023-03-03T06:25:57.079055+0000","last_fullsized":"2023-03-03T06:25:57.079055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:07:21.821141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.079797+0000","last_change":"2023-03-03T06:25:05.796211+0000","last_active":"2023-03-03T06:25:56.079797+0000","last_peered":"2023-03-03T06:25:56.079797+0000","last_clean":"2023-03-03T06:25:56.079797+0000","last_became_active":"2023-03-03T06:25:04.436647+0000","last_became_peered":"2023-03-03T06:25:04.436647+0000","last_unstale":"2023-03-03T06:25:56.079797+0000","last_undegraded":"2023-03-03T06:25:56.079797+0000","last_fullsized":"2023-03-03T06:25:56.079797+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:07.330548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082835+0000","last_change":"2023-03-03T06:25:56.097677+0000","last_active":"2023-03-03T06:25:57.082835+0000","last_peered":"2023-03-03T06:25:57.082835+0000","last_clean":"2023-03-03T06:25:57.082835+0000","last_became_active":"2023-03-03T06:25:56.097328+0000","last_became_peered":"2023-03-03T06:25:56.097328+0000","last_unstale":"2023-03-03T06:25:57.082835+0000","last_undegraded":"2023-03-03T06:25:57.082835+0000","last_fullsized":"2023-03-03T06:25:57.082835+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:23:53.311706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082679+0000","last_change":"2023-03-03T06:25:55.670533+0000","last_active":"2023-03-03T06:25:57.082679+0000","last_peered":"2023-03-03T06:25:57.082679+0000","last_clean":"2023-03-03T06:25:57.082679+0000","last_became_active":"2023-03-03T06:25:55.670202+0000","last_became_peered":"2023-03-03T06:25:55.670202+0000","last_unstale":"2023-03-03T06:25:57.082679+0000","last_undegraded":"2023-03-03T06:25:57.082679+0000","last_fullsized":"2023-03-03T06:25:57.082679+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:14:26.183601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":38,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.087221+0000","last_change":"2023-03-03T06:25:05.431187+0000","last_active":"2023-03-03T06:25:56.087221+0000","last_peered":"2023-03-03T06:25:56.087221+0000","last_clean":"2023-03-03T06:25:56.087221+0000","last_became_active":"2023-03-03T06:25:04.442929+0000","last_became_peered":"2023-03-03T06:25:04.442929+0000","last_unstale":"2023-03-03T06:25:56.087221+0000","last_undegraded":"2023-03-03T06:25:56.087221+0000","last_fullsized":"2023-03-03T06:25:56.087221+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001551871,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495751+0000","last_change":"2023-03-03T06:25:56.107191+0000","last_active":"2023-03-03T06:25:57.495751+0000","last_peered":"2023-03-03T06:25:57.495751+0000","last_clean":"2023-03-03T06:25:57.495751+0000","last_became_active":"2023-03-03T06:25:56.106888+0000","last_became_peered":"2023-03-03T06:25:56.106888+0000","last_unstale":"2023-03-03T06:25:57.495751+0000","last_undegraded":"2023-03-03T06:25:57.495751+0000","last_fullsized":"2023-03-03T06:25:57.495751+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:20:38.452147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494685+0000","last_change":"2023-03-03T06:25:55.674595+0000","last_active":"2023-03-03T06:25:57.494685+0000","last_peered":"2023-03-03T06:25:57.494685+0000","last_clean":"2023-03-03T06:25:57.494685+0000","last_became_active":"2023-03-03T06:25:55.674276+0000","last_became_peered":"2023-03-03T06:25:55.674276+0000","last_unstale":"2023-03-03T06:25:57.494685+0000","last_undegraded":"2023-03-03T06:25:57.494685+0000","last_fullsized":"2023-03-03T06:25:57.494685+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:14:26.183601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.080590+0000","last_change":"2023-03-03T06:25:05.796890+0000","last_active":"2023-03-03T06:25:56.080590+0000","last_peered":"2023-03-03T06:25:56.080590+0000","last_clean":"2023-03-03T06:25:56.080590+0000","last_became_active":"2023-03-03T06:25:04.437104+0000","last_became_peered":"2023-03-03T06:25:04.437104+0000","last_unstale":"2023-03-03T06:25:56.080590+0000","last_undegraded":"2023-03-03T06:25:56.080590+0000","last_fullsized":"2023-03-03T06:25:56.080590+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:10:21.043057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027269099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495625+0000","last_change":"2023-03-03T06:25:56.106615+0000","last_active":"2023-03-03T06:25:57.495625+0000","last_peered":"2023-03-03T06:25:57.495625+0000","last_clean":"2023-03-03T06:25:57.495625+0000","last_became_active":"2023-03-03T06:25:56.106329+0000","last_became_peered":"2023-03-03T06:25:56.106329+0000","last_unstale":"2023-03-03T06:25:57.495625+0000","last_undegraded":"2023-03-03T06:25:57.495625+0000","last_fullsized":"2023-03-03T06:25:57.495625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:51:52.135207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082549+0000","last_change":"2023-03-03T06:25:55.664299+0000","last_active":"2023-03-03T06:25:57.082549+0000","last_peered":"2023-03-03T06:25:57.082549+0000","last_clean":"2023-03-03T06:25:57.082549+0000","last_became_active":"2023-03-03T06:25:55.663980+0000","last_became_peered":"2023-03-03T06:25:55.663980+0000","last_unstale":"2023-03-03T06:25:57.082549+0000","last_undegraded":"2023-03-03T06:25:57.082549+0000","last_fullsized":"2023-03-03T06:25:57.082549+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:18:06.584599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.090614+0000","last_change":"2023-03-03T06:25:05.429793+0000","last_active":"2023-03-03T06:25:56.090614+0000","last_peered":"2023-03-03T06:25:56.090614+0000","last_clean":"2023-03-03T06:25:56.090614+0000","last_became_active":"2023-03-03T06:25:04.436400+0000","last_became_peered":"2023-03-03T06:25:04.436400+0000","last_unstale":"2023-03-03T06:25:56.090614+0000","last_undegraded":"2023-03-03T06:25:56.090614+0000","last_fullsized":"2023-03-03T06:25:56.090614+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038039399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082651+0000","last_change":"2023-03-03T06:25:56.100449+0000","last_active":"2023-03-03T06:25:57.082651+0000","last_peered":"2023-03-03T06:25:57.082651+0000","last_clean":"2023-03-03T06:25:57.082651+0000","last_became_active":"2023-03-03T06:25:56.100084+0000","last_became_peered":"2023-03-03T06:25:56.100084+0000","last_unstale":"2023-03-03T06:25:57.082651+0000","last_undegraded":"2023-03-03T06:25:57.082651+0000","last_fullsized":"2023-03-03T06:25:57.082651+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:59:31.195287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496927+0000","last_change":"2023-03-03T06:25:55.679196+0000","last_active":"2023-03-03T06:25:57.496927+0000","last_peered":"2023-03-03T06:25:57.496927+0000","last_clean":"2023-03-03T06:25:57.496927+0000","last_became_active":"2023-03-03T06:25:55.678807+0000","last_became_peered":"2023-03-03T06:25:55.678807+0000","last_unstale":"2023-03-03T06:25:57.496927+0000","last_undegraded":"2023-03-03T06:25:57.496927+0000","last_fullsized":"2023-03-03T06:25:57.496927+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:13:43.323432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":35,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.094821+0000","last_change":"2023-03-03T06:25:05.797098+0000","last_active":"2023-03-03T06:25:56.094821+0000","last_peered":"2023-03-03T06:25:56.094821+0000","last_clean":"2023-03-03T06:25:56.094821+0000","last_became_active":"2023-03-03T06:25:04.446290+0000","last_became_peered":"2023-03-03T06:25:04.446290+0000","last_unstale":"2023-03-03T06:25:56.094821+0000","last_undegraded":"2023-03-03T06:25:56.094821+0000","last_fullsized":"2023-03-03T06:25:56.094821+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:23:37.795335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050239399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080023+0000","last_change":"2023-03-03T06:25:56.097458+0000","last_active":"2023-03-03T06:25:57.080023+0000","last_peered":"2023-03-03T06:25:57.080023+0000","last_clean":"2023-03-03T06:25:57.080023+0000","last_became_active":"2023-03-03T06:25:56.097168+0000","last_became_peered":"2023-03-03T06:25:56.097168+0000","last_unstale":"2023-03-03T06:25:57.080023+0000","last_undegraded":"2023-03-03T06:25:57.080023+0000","last_fullsized":"2023-03-03T06:25:57.080023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:42:58.683886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"67'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494884+0000","last_change":"2023-03-03T06:25:55.677103+0000","last_active":"2023-03-03T06:25:57.494884+0000","last_peered":"2023-03-03T06:25:57.494884+0000","last_clean":"2023-03-03T06:25:57.494884+0000","last_became_active":"2023-03-03T06:25:55.676800+0000","last_became_peered":"2023-03-03T06:25:55.676800+0000","last_unstale":"2023-03-03T06:25:57.494884+0000","last_undegraded":"2023-03-03T06:25:57.494884+0000","last_fullsized":"2023-03-03T06:25:57.494884+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:29.938169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.079271+0000","last_change":"2023-03-03T06:25:05.636038+0000","last_active":"2023-03-03T06:25:56.079271+0000","last_peered":"2023-03-03T06:25:56.079271+0000","last_clean":"2023-03-03T06:25:56.079271+0000","last_became_active":"2023-03-03T06:25:04.433771+0000","last_became_peered":"2023-03-03T06:25:04.433771+0000","last_unstale":"2023-03-03T06:25:56.079271+0000","last_undegraded":"2023-03-03T06:25:56.079271+0000","last_fullsized":"2023-03-03T06:25:56.079271+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:33:58.284544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079784699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495860+0000","last_change":"2023-03-03T06:25:56.104660+0000","last_active":"2023-03-03T06:25:57.495860+0000","last_peered":"2023-03-03T06:25:57.495860+0000","last_clean":"2023-03-03T06:25:57.495860+0000","last_became_active":"2023-03-03T06:25:56.104377+0000","last_became_peered":"2023-03-03T06:25:56.104377+0000","last_unstale":"2023-03-03T06:25:57.495860+0000","last_undegraded":"2023-03-03T06:25:57.495860+0000","last_fullsized":"2023-03-03T06:25:57.495860+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:16:11.562031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203118+0000","last_change":"2023-03-03T06:25:55.678062+0000","last_active":"2023-03-03T06:25:57.203118+0000","last_peered":"2023-03-03T06:25:57.203118+0000","last_clean":"2023-03-03T06:25:57.203118+0000","last_became_active":"2023-03-03T06:25:55.677794+0000","last_became_peered":"2023-03-03T06:25:55.677794+0000","last_unstale":"2023-03-03T06:25:57.203118+0000","last_undegraded":"2023-03-03T06:25:57.203118+0000","last_fullsized":"2023-03-03T06:25:57.203118+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:31:27.436973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.081352+0000","last_change":"2023-03-03T06:25:05.797366+0000","last_active":"2023-03-03T06:25:56.081352+0000","last_peered":"2023-03-03T06:25:56.081352+0000","last_clean":"2023-03-03T06:25:56.081352+0000","last_became_active":"2023-03-03T06:25:04.439424+0000","last_became_peered":"2023-03-03T06:25:04.439424+0000","last_unstale":"2023-03-03T06:25:56.081352+0000","last_undegraded":"2023-03-03T06:25:56.081352+0000","last_fullsized":"2023-03-03T06:25:56.081352+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:12.599265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020575500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080449+0000","last_change":"2023-03-03T06:25:56.097268+0000","last_active":"2023-03-03T06:25:57.080449+0000","last_peered":"2023-03-03T06:25:57.080449+0000","last_clean":"2023-03-03T06:25:57.080449+0000","last_became_active":"2023-03-03T06:25:56.096845+0000","last_became_peered":"2023-03-03T06:25:56.096845+0000","last_unstale":"2023-03-03T06:25:57.080449+0000","last_undegraded":"2023-03-03T06:25:57.080449+0000","last_fullsized":"2023-03-03T06:25:57.080449+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:25:58.703587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203254+0000","last_change":"2023-03-03T06:25:55.672756+0000","last_active":"2023-03-03T06:25:57.203254+0000","last_peered":"2023-03-03T06:25:57.203254+0000","last_clean":"2023-03-03T06:25:57.203254+0000","last_became_active":"2023-03-03T06:25:55.672422+0000","last_became_peered":"2023-03-03T06:25:55.672422+0000","last_unstale":"2023-03-03T06:25:57.203254+0000","last_undegraded":"2023-03-03T06:25:57.203254+0000","last_fullsized":"2023-03-03T06:25:57.203254+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:14:13.671591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.094042+0000","last_change":"2023-03-03T06:25:05.431441+0000","last_active":"2023-03-03T06:25:56.094042+0000","last_peered":"2023-03-03T06:25:56.094042+0000","last_clean":"2023-03-03T06:25:56.094042+0000","last_became_active":"2023-03-03T06:25:04.443840+0000","last_became_peered":"2023-03-03T06:25:04.443840+0000","last_unstale":"2023-03-03T06:25:56.094042+0000","last_undegraded":"2023-03-03T06:25:56.094042+0000","last_fullsized":"2023-03-03T06:25:56.094042+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017814980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495247+0000","last_change":"2023-03-03T06:25:56.093414+0000","last_active":"2023-03-03T06:25:57.495247+0000","last_peered":"2023-03-03T06:25:57.495247+0000","last_clean":"2023-03-03T06:25:57.495247+0000","last_became_active":"2023-03-03T06:25:56.093165+0000","last_became_peered":"2023-03-03T06:25:56.093165+0000","last_unstale":"2023-03-03T06:25:57.495247+0000","last_undegraded":"2023-03-03T06:25:57.495247+0000","last_fullsized":"2023-03-03T06:25:57.495247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:27.345875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"67'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203527+0000","last_change":"2023-03-03T06:25:55.676939+0000","last_active":"2023-03-03T06:25:57.203527+0000","last_peered":"2023-03-03T06:25:57.203527+0000","last_clean":"2023-03-03T06:25:57.203527+0000","last_became_active":"2023-03-03T06:25:55.676631+0000","last_became_peered":"2023-03-03T06:25:55.676631+0000","last_unstale":"2023-03-03T06:25:57.203527+0000","last_undegraded":"2023-03-03T06:25:57.203527+0000","last_fullsized":"2023-03-03T06:25:57.203527+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:25:53.175485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.092236+0000","last_change":"2023-03-03T06:25:05.431854+0000","last_active":"2023-03-03T06:25:56.092236+0000","last_peered":"2023-03-03T06:25:56.092236+0000","last_clean":"2023-03-03T06:25:56.092236+0000","last_became_active":"2023-03-03T06:25:04.438570+0000","last_became_peered":"2023-03-03T06:25:04.438570+0000","last_unstale":"2023-03-03T06:25:56.092236+0000","last_undegraded":"2023-03-03T06:25:56.092236+0000","last_fullsized":"2023-03-03T06:25:56.092236+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.084716+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:25:56.084716+0000","last_peered":"2023-03-03T06:25:56.084716+0000","last_clean":"2023-03-03T06:25:56.084716+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:25:56.084716+0000","last_undegraded":"2023-03-03T06:25:56.084716+0000","last_fullsized":"2023-03-03T06:25:56.084716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.078818+0000","last_change":"2023-03-03T06:25:56.106706+0000","last_active":"2023-03-03T06:25:57.078818+0000","last_peered":"2023-03-03T06:25:57.078818+0000","last_clean":"2023-03-03T06:25:57.078818+0000","last_became_active":"2023-03-03T06:25:56.106438+0000","last_became_peered":"2023-03-03T06:25:56.106438+0000","last_unstale":"2023-03-03T06:25:57.078818+0000","last_undegraded":"2023-03-03T06:25:57.078818+0000","last_fullsized":"2023-03-03T06:25:57.078818+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:41:04.088891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"67'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080628+0000","last_change":"2023-03-03T06:25:55.676180+0000","last_active":"2023-03-03T06:25:57.080628+0000","last_peered":"2023-03-03T06:25:57.080628+0000","last_clean":"2023-03-03T06:25:57.080628+0000","last_became_active":"2023-03-03T06:25:55.675982+0000","last_became_peered":"2023-03-03T06:25:55.675982+0000","last_unstale":"2023-03-03T06:25:57.080628+0000","last_undegraded":"2023-03-03T06:25:57.080628+0000","last_fullsized":"2023-03-03T06:25:57.080628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:52:18.007639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.078802+0000","last_change":"2023-03-03T06:25:05.636335+0000","last_active":"2023-03-03T06:25:56.078802+0000","last_peered":"2023-03-03T06:25:56.078802+0000","last_clean":"2023-03-03T06:25:56.078802+0000","last_became_active":"2023-03-03T06:25:04.443299+0000","last_became_peered":"2023-03-03T06:25:04.443299+0000","last_unstale":"2023-03-03T06:25:56.078802+0000","last_undegraded":"2023-03-03T06:25:56.078802+0000","last_fullsized":"2023-03-03T06:25:56.078802+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:13:38.046974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090290399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":59,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.089058+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:25:56.089058+0000","last_peered":"2023-03-03T06:25:56.089058+0000","last_clean":"2023-03-03T06:25:56.089058+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:25:56.089058+0000","last_undegraded":"2023-03-03T06:25:56.089058+0000","last_fullsized":"2023-03-03T06:25:56.089058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496878+0000","last_change":"2023-03-03T06:25:56.099670+0000","last_active":"2023-03-03T06:25:57.496878+0000","last_peered":"2023-03-03T06:25:57.496878+0000","last_clean":"2023-03-03T06:25:57.496878+0000","last_became_active":"2023-03-03T06:25:56.097776+0000","last_became_peered":"2023-03-03T06:25:56.097776+0000","last_unstale":"2023-03-03T06:25:57.496878+0000","last_undegraded":"2023-03-03T06:25:57.496878+0000","last_fullsized":"2023-03-03T06:25:57.496878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:16:39.291453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496289+0000","last_change":"2023-03-03T06:25:55.670679+0000","last_active":"2023-03-03T06:25:57.496289+0000","last_peered":"2023-03-03T06:25:57.496289+0000","last_clean":"2023-03-03T06:25:57.496289+0000","last_became_active":"2023-03-03T06:25:55.670397+0000","last_became_peered":"2023-03-03T06:25:55.670397+0000","last_unstale":"2023-03-03T06:25:57.496289+0000","last_undegraded":"2023-03-03T06:25:57.496289+0000","last_fullsized":"2023-03-03T06:25:57.496289+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:47.422230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.079654+0000","last_change":"2023-03-03T06:25:05.796271+0000","last_active":"2023-03-03T06:25:56.079654+0000","last_peered":"2023-03-03T06:25:56.079654+0000","last_clean":"2023-03-03T06:25:56.079654+0000","last_became_active":"2023-03-03T06:25:04.595414+0000","last_became_peered":"2023-03-03T06:25:04.595414+0000","last_unstale":"2023-03-03T06:25:56.079654+0000","last_undegraded":"2023-03-03T06:25:56.079654+0000","last_fullsized":"2023-03-03T06:25:56.079654+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:07:03.140630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027036600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":54,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.080662+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:25:56.080662+0000","last_peered":"2023-03-03T06:25:56.080662+0000","last_clean":"2023-03-03T06:25:56.080662+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:25:56.080662+0000","last_undegraded":"2023-03-03T06:25:56.080662+0000","last_fullsized":"2023-03-03T06:25:56.080662+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":202,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.093350+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:25:56.093350+0000","last_peered":"2023-03-03T06:25:56.093350+0000","last_clean":"2023-03-03T06:25:56.093350+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:25:56.093350+0000","last_undegraded":"2023-03-03T06:25:56.093350+0000","last_fullsized":"2023-03-03T06:25:56.093350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.083035+0000","last_change":"2023-03-03T06:25:56.101341+0000","last_active":"2023-03-03T06:25:57.083035+0000","last_peered":"2023-03-03T06:25:57.083035+0000","last_clean":"2023-03-03T06:25:57.083035+0000","last_became_active":"2023-03-03T06:25:56.101052+0000","last_became_peered":"2023-03-03T06:25:56.101052+0000","last_unstale":"2023-03-03T06:25:57.083035+0000","last_undegraded":"2023-03-03T06:25:57.083035+0000","last_fullsized":"2023-03-03T06:25:57.083035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:31:03.940981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495186+0000","last_change":"2023-03-03T06:25:55.670469+0000","last_active":"2023-03-03T06:25:57.495186+0000","last_peered":"2023-03-03T06:25:57.495186+0000","last_clean":"2023-03-03T06:25:57.495186+0000","last_became_active":"2023-03-03T06:25:55.670156+0000","last_became_peered":"2023-03-03T06:25:55.670156+0000","last_unstale":"2023-03-03T06:25:57.495186+0000","last_undegraded":"2023-03-03T06:25:57.495186+0000","last_fullsized":"2023-03-03T06:25:57.495186+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:44:52.604474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":38,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.089256+0000","last_change":"2023-03-03T06:25:05.431373+0000","last_active":"2023-03-03T06:25:56.089256+0000","last_peered":"2023-03-03T06:25:56.089256+0000","last_clean":"2023-03-03T06:25:56.089256+0000","last_became_active":"2023-03-03T06:25:04.445948+0000","last_became_peered":"2023-03-03T06:25:04.445948+0000","last_unstale":"2023-03-03T06:25:56.089256+0000","last_undegraded":"2023-03-03T06:25:56.089256+0000","last_fullsized":"2023-03-03T06:25:56.089256+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001717028,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.088125+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:25:56.088125+0000","last_peered":"2023-03-03T06:25:56.088125+0000","last_clean":"2023-03-03T06:25:56.088125+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:25:56.088125+0000","last_undegraded":"2023-03-03T06:25:56.088125+0000","last_fullsized":"2023-03-03T06:25:56.088125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203293+0000","last_change":"2023-03-03T06:25:56.098087+0000","last_active":"2023-03-03T06:25:57.203293+0000","last_peered":"2023-03-03T06:25:57.203293+0000","last_clean":"2023-03-03T06:25:57.203293+0000","last_became_active":"2023-03-03T06:25:56.097655+0000","last_became_peered":"2023-03-03T06:25:56.097655+0000","last_unstale":"2023-03-03T06:25:57.203293+0000","last_undegraded":"2023-03-03T06:25:57.203293+0000","last_fullsized":"2023-03-03T06:25:57.203293+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:30.940024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496379+0000","last_change":"2023-03-03T06:25:55.675032+0000","last_active":"2023-03-03T06:25:57.496379+0000","last_peered":"2023-03-03T06:25:57.496379+0000","last_clean":"2023-03-03T06:25:57.496379+0000","last_became_active":"2023-03-03T06:25:55.673914+0000","last_became_peered":"2023-03-03T06:25:55.673914+0000","last_unstale":"2023-03-03T06:25:57.496379+0000","last_undegraded":"2023-03-03T06:25:57.496379+0000","last_fullsized":"2023-03-03T06:25:57.496379+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:30:49.557933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":35,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.092715+0000","last_change":"2023-03-03T06:25:05.796597+0000","last_active":"2023-03-03T06:25:56.092715+0000","last_peered":"2023-03-03T06:25:56.092715+0000","last_clean":"2023-03-03T06:25:56.092715+0000","last_became_active":"2023-03-03T06:25:04.442672+0000","last_became_peered":"2023-03-03T06:25:04.442672+0000","last_unstale":"2023-03-03T06:25:56.092715+0000","last_undegraded":"2023-03-03T06:25:56.092715+0000","last_fullsized":"2023-03-03T06:25:56.092715+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.033310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000479903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.093435+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:25:56.093435+0000","last_peered":"2023-03-03T06:25:56.093435+0000","last_clean":"2023-03-03T06:25:56.093435+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:25:56.093435+0000","last_undegraded":"2023-03-03T06:25:56.093435+0000","last_fullsized":"2023-03-03T06:25:56.093435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495485+0000","last_change":"2023-03-03T06:25:56.100030+0000","last_active":"2023-03-03T06:25:57.495485+0000","last_peered":"2023-03-03T06:25:57.495485+0000","last_clean":"2023-03-03T06:25:57.495485+0000","last_became_active":"2023-03-03T06:25:56.098649+0000","last_became_peered":"2023-03-03T06:25:56.098649+0000","last_unstale":"2023-03-03T06:25:57.495485+0000","last_undegraded":"2023-03-03T06:25:57.495485+0000","last_fullsized":"2023-03-03T06:25:57.495485+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:27.345875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"67'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496487+0000","last_change":"2023-03-03T06:25:55.676505+0000","last_active":"2023-03-03T06:25:57.496487+0000","last_peered":"2023-03-03T06:25:57.496487+0000","last_clean":"2023-03-03T06:25:57.496487+0000","last_became_active":"2023-03-03T06:25:55.676135+0000","last_became_peered":"2023-03-03T06:25:55.676135+0000","last_unstale":"2023-03-03T06:25:57.496487+0000","last_undegraded":"2023-03-03T06:25:57.496487+0000","last_fullsized":"2023-03-03T06:25:57.496487+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:42:57.682030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.078421+0000","last_change":"2023-03-03T06:25:05.636259+0000","last_active":"2023-03-03T06:25:56.078421+0000","last_peered":"2023-03-03T06:25:56.078421+0000","last_clean":"2023-03-03T06:25:56.078421+0000","last_became_active":"2023-03-03T06:25:04.438244+0000","last_became_peered":"2023-03-03T06:25:04.438244+0000","last_unstale":"2023-03-03T06:25:56.078421+0000","last_undegraded":"2023-03-03T06:25:56.078421+0000","last_fullsized":"2023-03-03T06:25:56.078421+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:36.640289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001044636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":57,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.078423+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:25:56.078423+0000","last_peered":"2023-03-03T06:25:56.078423+0000","last_clean":"2023-03-03T06:25:56.078423+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:25:56.078423+0000","last_undegraded":"2023-03-03T06:25:56.078423+0000","last_fullsized":"2023-03-03T06:25:56.078423+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496407+0000","last_change":"2023-03-03T06:25:56.093749+0000","last_active":"2023-03-03T06:25:57.496407+0000","last_peered":"2023-03-03T06:25:57.496407+0000","last_clean":"2023-03-03T06:25:57.496407+0000","last_became_active":"2023-03-03T06:25:56.093067+0000","last_became_peered":"2023-03-03T06:25:56.093067+0000","last_unstale":"2023-03-03T06:25:57.496407+0000","last_undegraded":"2023-03-03T06:25:57.496407+0000","last_fullsized":"2023-03-03T06:25:57.496407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:40:15.714529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495472+0000","last_change":"2023-03-03T06:25:55.666614+0000","last_active":"2023-03-03T06:25:57.495472+0000","last_peered":"2023-03-03T06:25:57.495472+0000","last_clean":"2023-03-03T06:25:57.495472+0000","last_became_active":"2023-03-03T06:25:55.666305+0000","last_became_peered":"2023-03-03T06:25:55.666305+0000","last_unstale":"2023-03-03T06:25:57.495472+0000","last_undegraded":"2023-03-03T06:25:57.495472+0000","last_fullsized":"2023-03-03T06:25:57.495472+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:01:20.131181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":38,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.092375+0000","last_change":"2023-03-03T06:25:05.432050+0000","last_active":"2023-03-03T06:25:56.092375+0000","last_peered":"2023-03-03T06:25:56.092375+0000","last_clean":"2023-03-03T06:25:56.092375+0000","last_became_active":"2023-03-03T06:25:04.595433+0000","last_became_peered":"2023-03-03T06:25:04.595433+0000","last_unstale":"2023-03-03T06:25:56.092375+0000","last_undegraded":"2023-03-03T06:25:56.092375+0000","last_fullsized":"2023-03-03T06:25:56.092375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016573409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.089725+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:25:56.089725+0000","last_peered":"2023-03-03T06:25:56.089725+0000","last_clean":"2023-03-03T06:25:56.089725+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:25:56.089725+0000","last_undegraded":"2023-03-03T06:25:56.089725+0000","last_fullsized":"2023-03-03T06:25:56.089725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079010+0000","last_change":"2023-03-03T06:25:56.098552+0000","last_active":"2023-03-03T06:25:57.079010+0000","last_peered":"2023-03-03T06:25:57.079010+0000","last_clean":"2023-03-03T06:25:57.079010+0000","last_became_active":"2023-03-03T06:25:56.098294+0000","last_became_peered":"2023-03-03T06:25:56.098294+0000","last_unstale":"2023-03-03T06:25:57.079010+0000","last_undegraded":"2023-03-03T06:25:57.079010+0000","last_fullsized":"2023-03-03T06:25:57.079010+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:11:27.945471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"67'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079289+0000","last_change":"2023-03-03T06:25:55.666353+0000","last_active":"2023-03-03T06:25:57.079289+0000","last_peered":"2023-03-03T06:25:57.079289+0000","last_clean":"2023-03-03T06:25:57.079289+0000","last_became_active":"2023-03-03T06:25:55.666024+0000","last_became_peered":"2023-03-03T06:25:55.666024+0000","last_unstale":"2023-03-03T06:25:57.079289+0000","last_undegraded":"2023-03-03T06:25:57.079289+0000","last_fullsized":"2023-03-03T06:25:57.079289+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:00:42.974313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.094123+0000","last_change":"2023-03-03T06:25:05.431790+0000","last_active":"2023-03-03T06:25:56.094123+0000","last_peered":"2023-03-03T06:25:56.094123+0000","last_clean":"2023-03-03T06:25:56.094123+0000","last_became_active":"2023-03-03T06:25:04.595837+0000","last_became_peered":"2023-03-03T06:25:04.595837+0000","last_unstale":"2023-03-03T06:25:56.094123+0000","last_undegraded":"2023-03-03T06:25:56.094123+0000","last_fullsized":"2023-03-03T06:25:56.094123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:08:49.614056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019659870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.090031+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:25:56.090031+0000","last_peered":"2023-03-03T06:25:56.090031+0000","last_clean":"2023-03-03T06:25:56.090031+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:25:56.090031+0000","last_undegraded":"2023-03-03T06:25:56.090031+0000","last_fullsized":"2023-03-03T06:25:56.090031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10792,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":9408,"kb_avail":94361048,"statfs":{"total":96636764160,"available":96625713152,"internally_reserved":0,"allocated":1409024,"data_stored":982027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9633792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71099999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.64900000000000002,"5min":0.745,"15min":0.745},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70399999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68200000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72799999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.63800000000000001}]},{"osd":4,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63400000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70699999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70899999999999996,"5min":0.746,"15min":0.746},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.38500000000000001}]},{"osd":6,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71299999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85399999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.46899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9580,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362260,"statfs":{"total":96636764160,"available":96626954240,"internally_reserved":0,"allocated":823296,"data_stored":393185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76700000000000002,"5min":2.278,"15min":2.278},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":3.109,"5min":3.109,"15min":3.109},"last":0.57999999999999996}]},{"osd":1,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.70999999999999996,"5min":0.751,"15min":0.751},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.622}]},{"osd":3,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.74399999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.47299999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.623,"15min":0.625},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83299999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.59199999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10732,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361108,"statfs":{"total":96636764160,"available":96625774592,"internally_reserved":0,"allocated":1413120,"data_stored":982117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35199999999999998,"15min":0.35299999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52000000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.193},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.34799999999999998,"15min":0.34499999999999997},"min":{"1min":0.28199999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.47299999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.314,"15min":0.312},"min":{"1min":0.25600000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.372,"15min":0.37},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.253}]},{"osd":3,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.27100000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48799999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.372,"15min":0.375},"min":{"1min":0.23999999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.502,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.28399999999999997}]},{"osd":4,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.41999999999999998}]},{"osd":5,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80800000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.31}]},{"osd":6,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.443,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.49099999999999999}]},{"osd":7,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.503,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82299999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9692,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362148,"statfs":{"total":96636764160,"available":96626839552,"internally_reserved":0,"allocated":806912,"data_stored":390676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.41199999999999998,"15min":0.42799999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.50700000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.252},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52000000000000002,"5min":1.827,"15min":1.827},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.41999999999999998,"15min":0.432},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65600000000000003,"5min":1.722,"15min":1.722},"last":0.308},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.44700000000000001,"15min":0.46100000000000002},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61799999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.38400000000000001}]},{"osd":3,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.47499999999999998,"15min":0.49199999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.58799999999999997,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.1870000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.434,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84699999999999998,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.53400000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.45700000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92000000000000004,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.502},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86799999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82199999999999995,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.67600000000000005,"15min":0.68999999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81100000000000005,"5min":1.835,"15min":1.835},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.66400000000000003,"15min":0.67600000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88400000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.746,"5min":1.732,"15min":1.732},"last":0.45900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9464,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362376,"statfs":{"total":96636764160,"available":96627073024,"internally_reserved":0,"allocated":835584,"data_stored":399689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33100000000000002},"min":{"1min":0.23899999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.28299999999999997}]},{"osd":1,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.70599999999999996,"15min":0.75},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.238,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.313}]},{"osd":3,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.52100000000000002,"15min":0.46400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":8.6039999999999992,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.76300000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1240000000000001,"5min":1.224,"15min":1.224},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.69699999999999995},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4359999999999999,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1479999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73399999999999999,"15min":0.72999999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.597,"5min":1.968,"15min":1.968},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.72699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2430000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.66600000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.78000000000000003,"15min":0.79500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1910000000000001,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.198,"5min":1.387,"15min":1.387},"last":0.75900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9700,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362140,"statfs":{"total":96636764160,"available":96626831360,"internally_reserved":0,"allocated":815104,"data_stored":392203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.38400000000000001,"15min":0.39400000000000002},"min":{"1min":0.24099999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.502,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52300000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.379}]},{"osd":1,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.37,"15min":0.379},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.47799999999999998,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.43099999999999999,"15min":0.436},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.624,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.32700000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.64700000000000002,"5min":1.3,"15min":1.3},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.441,"15min":0.44900000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66500000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.41999999999999998}]},{"osd":4,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.44600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90500000000000003,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.48699999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.628},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0029999999999999,"5min":1.383,"15min":1.383},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95999999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":5.2640000000000002,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":1.587,"15min":1.587},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.69699999999999995,"15min":0.67500000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":5.2510000000000003,"5min":5.2510000000000003,"15min":5.2510000000000003},"last":0.63600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9844,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361996,"statfs":{"total":96636764160,"available":96626683904,"internally_reserved":0,"allocated":831488,"data_stored":393289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.349,"5min":0.67800000000000005,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":14.449999999999999,"5min":14.449999999999999,"15min":14.449999999999999},"last":0.69099999999999995}]},{"osd":1,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":0.64700000000000002,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.686,"5min":10.686,"15min":10.686},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.53600000000000003,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":3.9060000000000001,"5min":3.9060000000000001,"15min":3.9060000000000001},"last":0.71099999999999997}]},{"osd":2,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.42499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65800000000000003,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.61799999999999999,"15min":0.58299999999999996},"min":{"1min":0.48199999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":4.6379999999999999,"5min":4.6379999999999999,"15min":4.6379999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.44800000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.65900000000000003,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.7389999999999999,"5min":6.7389999999999999,"15min":6.7389999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.57599999999999996,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.5910000000000002,"5min":4.5910000000000002,"15min":4.5910000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38600000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.47899999999999998}]},{"osd":6,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.64900000000000002,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":4.6749999999999998,"5min":4.6749999999999998,"15min":4.6749999999999998},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.66700000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.49299999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.54200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9568,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362272,"statfs":{"total":96636764160,"available":96626966528,"internally_reserved":0,"allocated":811008,"data_stored":390710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.626}]},{"osd":2,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76000000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76900000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.78500000000000003,"5min":0.88,"15min":0.88},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67500000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.746},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82599999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.72799999999999998,"5min":0.747,"15min":0.747},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.64300000000000002,"15min":0.65100000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:26:00.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:26:00.370 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.368+0000 7f5849845700 1 Processor -- start 2023-03-03T06:26:00.371 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.369+0000 7f5849845700 1 -- start start 2023-03-03T06:26:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.369+0000 7f5849845700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f58440b8940 0x7f584406ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.369+0000 7f5849845700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584406c830 0x7f58440d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.369+0000 7f5849845700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584415ce30 con 0x7f58440cf310 2023-03-03T06:26:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.369+0000 7f5849845700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58440d2f10 con 0x7f58440b8940 2023-03-03T06:26:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.369+0000 7f5849845700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58440b8d10 con 0x7f584406c830 2023-03-03T06:26:00.374 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.369+0000 7f58427fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f58440cf310 0x7f584406c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35360/0 (socket says 172.21.15.5:35360) 2023-03-03T06:26:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f58427fc700 1 -- 172.21.15.5:0/681484140 learned_addr learned my addr 172.21.15.5:0/681484140 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890279862 0 0) 0x7f582c001110 con 0x7f58440cf310 2023-03-03T06:26:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f58437fe700 1 --2- 172.21.15.5:0/681484140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584406c830 0x7f58440d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5842ffd700 1 --2- 172.21.15.5:0/681484140 >> v2:172.21.15.191:3300/0 conn(0x7f58440b8940 0x7f584406ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58300035b0 con 0x7f58440cf310 2023-03-03T06:26:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 186965183 0 0) 0x7f58300035b0 con 0x7f58440cf310 2023-03-03T06:26:00.375 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584406c830 msgr2=0x7f58440d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:00.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 --2- 172.21.15.5:0/681484140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584406c830 0x7f58440d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 >> v2:172.21.15.191:3300/0 conn(0x7f58440b8940 msgr2=0x7f584406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:00.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 --2- 172.21.15.5:0/681484140 >> v2:172.21.15.191:3300/0 conn(0x7f58440b8940 0x7f584406ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58440cdd60 con 0x7f58440cf310 2023-03-03T06:26:00.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f582c001800 con 0x7f58440cf310 2023-03-03T06:26:00.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 >> v1:172.21.15.5:6789/0 conn(0x7f58440cf310 legacy=0x7f584406c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:00.376 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 --2- 172.21.15.5:0/681484140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5830003a70 0x7f5830003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 --2- 172.21.15.5:0/681484140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5830004850 0x7f5830004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 --2- 172.21.15.5:0/681484140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584406c830 0x7f5830005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58440d2f10 con 0x7f5830003a70 2023-03-03T06:26:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58440b8d10 con 0x7f5830004850 2023-03-03T06:26:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583000ba10 con 0x7f584406c830 2023-03-03T06:26:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f5842ffd700 1 --2- 172.21.15.5:0/681484140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5830003a70 0x7f5830003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f58437fe700 1 --2- 172.21.15.5:0/681484140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584406c830 0x7f5830005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.370+0000 7f58427fc700 1 --2- 172.21.15.5:0/681484140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5830004850 0x7f5830004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.371+0000 7f5842ffd700 1 -- 172.21.15.5:0/681484140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584406c830 msgr2=0x7f5830005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.371+0000 7f5842ffd700 1 --2- 172.21.15.5:0/681484140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584406c830 0x7f5830005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.371+0000 7f5842ffd700 1 -- 172.21.15.5:0/681484140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5830004850 msgr2=0x7f5830004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.371+0000 7f5842ffd700 1 --2- 172.21.15.5:0/681484140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5830004850 0x7f5830004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.371+0000 7f5842ffd700 1 -- 172.21.15.5:0/681484140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58300035b0 con 0x7f5830003a70 2023-03-03T06:26:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.371+0000 7f58427fc700 1 --2- 172.21.15.5:0/681484140 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5830004850 0x7f5830004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.371+0000 7f5842ffd700 1 --2- 172.21.15.5:0/681484140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5830003a70 0x7f5830003e80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f5834009b90 tx=0x7f5830005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d680e3ccf5d72cc6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:00.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.371+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583400e6c0 con 0x7f5830003a70 2023-03-03T06:26:00.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.371+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583400e820 con 0x7f5830003a70 2023-03-03T06:26:00.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.371+0000 7f5841ffb700 1 -- 172.21.15.5:0/681484140 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583400eb90 con 0x7f5830003a70 2023-03-03T06:26:00.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.371+0000 7f5849845700 1 -- 172.21.15.5:0/681484140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5830003a70 msgr2=0x7f5830003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:00.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.371+0000 7f5849845700 1 --2- 172.21.15.5:0/681484140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5830003a70 0x7f5830003e80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f5834009b90 tx=0x7f5830005880 comp rx=0 tx=0).stop 2023-03-03T06:26:00.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.371+0000 7f58437fe700 1 -- 172.21.15.5:0/681484140 reap_dead start 2023-03-03T06:26:00.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.372+0000 7f5849845700 1 -- 172.21.15.5:0/681484140 shutdown_connections 2023-03-03T06:26:00.379 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.372+0000 7f5849845700 1 -- 172.21.15.5:0/681484140 >> 172.21.15.5:0/681484140 conn(0x7f58440d0660 msgr2=0x7f58440d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.372+0000 7f5849845700 1 -- 172.21.15.5:0/681484140 shutdown_connections 2023-03-03T06:26:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.372+0000 7f5849845700 1 -- 172.21.15.5:0/681484140 wait complete. 2023-03-03T06:26:00.382 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.373+0000 7f5849845700 1 Processor -- start 2023-03-03T06:26:00.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.373+0000 7f5849845700 1 -- start start 2023-03-03T06:26:00.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5849845700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5830003a70 0x7f5844151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5849845700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5844151250 0x7f5844150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5849845700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584415f7d0 0x7f58440b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5849845700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5844150f50 con 0x7f5830003a70 2023-03-03T06:26:00.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5849845700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584415e730 con 0x7f5844151250 2023-03-03T06:26:00.383 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5849845700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584415ea10 con 0x7f584415f7d0 2023-03-03T06:26:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5842ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5830003a70 0x7f5844151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5842ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5830003a70 0x7f5844151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45528/0 (socket says 172.21.15.5:45528) 2023-03-03T06:26:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5842ffd700 1 -- 172.21.15.5:0/2468031337 learned_addr learned my addr 172.21.15.5:0/2468031337 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f58437fe700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584415f7d0 0x7f58440b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f58427fc700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5844151250 0x7f5844150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5842ffd700 1 -- 172.21.15.5:0/2468031337 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584415f7d0 msgr2=0x7f58440b70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5842ffd700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584415f7d0 0x7f58440b70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5842ffd700 1 -- 172.21.15.5:0/2468031337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5844151250 msgr2=0x7f5844150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:00.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5842ffd700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5844151250 0x7f5844150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5842ffd700 1 -- 172.21.15.5:0/2468031337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58440d2c30 con 0x7f5830003a70 2023-03-03T06:26:00.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f5842ffd700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5830003a70 0x7f5844151680 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5830004710 tx=0x7f58340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:00.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f583bfff700 1 -- 172.21.15.5:0/2468031337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583400e6c0 con 0x7f5830003a70 2023-03-03T06:26:00.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f583bfff700 1 -- 172.21.15.5:0/2468031337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5834003ab0 con 0x7f5830003a70 2023-03-03T06:26:00.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.374+0000 7f583bfff700 1 -- 172.21.15.5:0/2468031337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834003e60 con 0x7f5830003a70 2023-03-03T06:26:00.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.375+0000 7f5849845700 1 -- 172.21.15.5:0/2468031337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58440d2950 con 0x7f5830003a70 2023-03-03T06:26:00.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.375+0000 7f5849845700 1 -- 172.21.15.5:0/2468031337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58440cd840 con 0x7f5830003a70 2023-03-03T06:26:00.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.376+0000 7f5849845700 1 -- 172.21.15.5:0/2468031337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5844067660 con 0x7f5830003a70 2023-03-03T06:26:00.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.376+0000 7f583bfff700 1 -- 172.21.15.5:0/2468031337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5834025070 con 0x7f5830003a70 2023-03-03T06:26:00.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.376+0000 7f583bfff700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5824068320 0x7f582406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.376+0000 7f583bfff700 1 -- 172.21.15.5:0/2468031337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f58340877d0 con 0x7f5830003a70 2023-03-03T06:26:00.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.376+0000 7f58427fc700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5824068320 0x7f582406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.377+0000 7f58427fc700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5824068320 0x7f582406a7d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f582c001a70 tx=0x7f582c0019c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:00.386 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.381+0000 7f583bfff700 1 -- 172.21.15.5:0/2468031337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5834053d90 con 0x7f5830003a70 2023-03-03T06:26:00.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.570+0000 7f5849845700 1 -- 172.21.15.5:0/2468031337 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5844150f50 con 0x7f5824068320 2023-03-03T06:26:00.582 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.580+0000 7f583bfff700 1 -- 172.21.15.5:0/2468031337 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392678 (secure 0 0 0) 0x7f5844150f50 con 0x7f5824068320 2023-03-03T06:26:00.586 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:00.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.584+0000 7f5849845700 1 -- 172.21.15.5:0/2468031337 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5824068320 msgr2=0x7f582406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:00.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.584+0000 7f5849845700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5824068320 0x7f582406a7d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f582c001a70 tx=0x7f582c0019c0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.588 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.584+0000 7f5849845700 1 -- 172.21.15.5:0/2468031337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5830003a70 msgr2=0x7f5844151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:00.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.584+0000 7f5849845700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5830003a70 0x7f5844151680 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5830004710 tx=0x7f58340047c0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.584+0000 7f5849845700 1 -- 172.21.15.5:0/2468031337 shutdown_connections 2023-03-03T06:26:00.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.584+0000 7f5849845700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5824068320 0x7f582406a7d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.584+0000 7f5849845700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f584415f7d0 0x7f58440b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.584+0000 7f5849845700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5830003a70 0x7f5844151680 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.584+0000 7f5849845700 1 --2- 172.21.15.5:0/2468031337 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5844151250 0x7f5844150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.584+0000 7f5849845700 1 -- 172.21.15.5:0/2468031337 >> 172.21.15.5:0/2468031337 conn(0x7f58440d0660 msgr2=0x7f584406c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.584+0000 7f5849845700 1 -- 172.21.15.5:0/2468031337 shutdown_connections 2023-03-03T06:26:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.584+0000 7f5849845700 1 -- 172.21.15.5:0/2468031337 wait complete. 2023-03-03T06:26:00.590 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:26:00.598 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2023-03-03T06:25:59.490877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":79372,"kb_used_data":7564,"kb_used_omap":0,"kb_used_meta":71744,"kb_avail":754895348,"statfs":{"total":773094113280,"available":773012836352,"internally_reserved":0,"allocated":7745536,"data_stored":4323896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73465856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.841178"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203460+0000","last_change":"2023-03-03T06:25:56.106643+0000","last_active":"2023-03-03T06:25:57.203460+0000","last_peered":"2023-03-03T06:25:57.203460+0000","last_clean":"2023-03-03T06:25:57.203460+0000","last_became_active":"2023-03-03T06:25:56.106358+0000","last_became_peered":"2023-03-03T06:25:56.106358+0000","last_unstale":"2023-03-03T06:25:57.203460+0000","last_undegraded":"2023-03-03T06:25:57.203460+0000","last_fullsized":"2023-03-03T06:25:57.203460+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:52:19.009495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496839+0000","last_change":"2023-03-03T06:25:56.099884+0000","last_active":"2023-03-03T06:25:57.496839+0000","last_peered":"2023-03-03T06:25:57.496839+0000","last_clean":"2023-03-03T06:25:57.496839+0000","last_became_active":"2023-03-03T06:25:56.097121+0000","last_became_peered":"2023-03-03T06:25:56.097121+0000","last_unstale":"2023-03-03T06:25:57.496839+0000","last_undegraded":"2023-03-03T06:25:57.496839+0000","last_fullsized":"2023-03-03T06:25:57.496839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:46:02.587487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495596+0000","last_change":"2023-03-03T06:25:56.085066+0000","last_active":"2023-03-03T06:25:57.495596+0000","last_peered":"2023-03-03T06:25:57.495596+0000","last_clean":"2023-03-03T06:25:57.495596+0000","last_became_active":"2023-03-03T06:25:56.084827+0000","last_became_peered":"2023-03-03T06:25:56.084827+0000","last_unstale":"2023-03-03T06:25:57.495596+0000","last_undegraded":"2023-03-03T06:25:57.495596+0000","last_fullsized":"2023-03-03T06:25:57.495596+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:29:37.913800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494605+0000","last_change":"2023-03-03T06:25:56.092061+0000","last_active":"2023-03-03T06:25:57.494605+0000","last_peered":"2023-03-03T06:25:57.494605+0000","last_clean":"2023-03-03T06:25:57.494605+0000","last_became_active":"2023-03-03T06:25:56.091797+0000","last_became_peered":"2023-03-03T06:25:56.091797+0000","last_unstale":"2023-03-03T06:25:57.494605+0000","last_undegraded":"2023-03-03T06:25:57.494605+0000","last_fullsized":"2023-03-03T06:25:57.494605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:46:31.226919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079353+0000","last_change":"2023-03-03T06:25:56.104486+0000","last_active":"2023-03-03T06:25:57.079353+0000","last_peered":"2023-03-03T06:25:57.079353+0000","last_clean":"2023-03-03T06:25:57.079353+0000","last_became_active":"2023-03-03T06:25:56.104227+0000","last_became_peered":"2023-03-03T06:25:56.104227+0000","last_unstale":"2023-03-03T06:25:57.079353+0000","last_undegraded":"2023-03-03T06:25:57.079353+0000","last_fullsized":"2023-03-03T06:25:57.079353+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:50:19.944317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496611+0000","last_change":"2023-03-03T06:25:56.104229+0000","last_active":"2023-03-03T06:25:57.496611+0000","last_peered":"2023-03-03T06:25:57.496611+0000","last_clean":"2023-03-03T06:25:57.496611+0000","last_became_active":"2023-03-03T06:25:56.103532+0000","last_became_peered":"2023-03-03T06:25:56.103532+0000","last_unstale":"2023-03-03T06:25:57.496611+0000","last_undegraded":"2023-03-03T06:25:57.496611+0000","last_fullsized":"2023-03-03T06:25:57.496611+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:04:58.315586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082735+0000","last_change":"2023-03-03T06:25:56.109358+0000","last_active":"2023-03-03T06:25:57.082735+0000","last_peered":"2023-03-03T06:25:57.082735+0000","last_clean":"2023-03-03T06:25:57.082735+0000","last_became_active":"2023-03-03T06:25:56.109051+0000","last_became_peered":"2023-03-03T06:25:56.109051+0000","last_unstale":"2023-03-03T06:25:57.082735+0000","last_undegraded":"2023-03-03T06:25:57.082735+0000","last_fullsized":"2023-03-03T06:25:57.082735+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:16:36.237179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.078750+0000","last_change":"2023-03-03T06:25:56.099455+0000","last_active":"2023-03-03T06:25:57.078750+0000","last_peered":"2023-03-03T06:25:57.078750+0000","last_clean":"2023-03-03T06:25:57.078750+0000","last_became_active":"2023-03-03T06:25:56.099215+0000","last_became_peered":"2023-03-03T06:25:56.099215+0000","last_unstale":"2023-03-03T06:25:57.078750+0000","last_undegraded":"2023-03-03T06:25:57.078750+0000","last_fullsized":"2023-03-03T06:25:57.078750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:20:21.387826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080676+0000","last_change":"2023-03-03T06:25:56.097222+0000","last_active":"2023-03-03T06:25:57.080676+0000","last_peered":"2023-03-03T06:25:57.080676+0000","last_clean":"2023-03-03T06:25:57.080676+0000","last_became_active":"2023-03-03T06:25:56.096904+0000","last_became_peered":"2023-03-03T06:25:56.096904+0000","last_unstale":"2023-03-03T06:25:57.080676+0000","last_undegraded":"2023-03-03T06:25:57.080676+0000","last_fullsized":"2023-03-03T06:25:57.080676+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:28.378207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494685+0000","last_change":"2023-03-03T06:25:56.095548+0000","last_active":"2023-03-03T06:25:57.494685+0000","last_peered":"2023-03-03T06:25:57.494685+0000","last_clean":"2023-03-03T06:25:57.494685+0000","last_became_active":"2023-03-03T06:25:56.095279+0000","last_became_peered":"2023-03-03T06:25:56.095279+0000","last_unstale":"2023-03-03T06:25:57.494685+0000","last_undegraded":"2023-03-03T06:25:57.494685+0000","last_fullsized":"2023-03-03T06:25:57.494685+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:08:55.169820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495664+0000","last_change":"2023-03-03T06:25:56.100217+0000","last_active":"2023-03-03T06:25:57.495664+0000","last_peered":"2023-03-03T06:25:57.495664+0000","last_clean":"2023-03-03T06:25:57.495664+0000","last_became_active":"2023-03-03T06:25:56.099807+0000","last_became_peered":"2023-03-03T06:25:56.099807+0000","last_unstale":"2023-03-03T06:25:57.495664+0000","last_undegraded":"2023-03-03T06:25:57.495664+0000","last_fullsized":"2023-03-03T06:25:57.495664+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:46:48.117716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494899+0000","last_change":"2023-03-03T06:25:56.103210+0000","last_active":"2023-03-03T06:25:57.494899+0000","last_peered":"2023-03-03T06:25:57.494899+0000","last_clean":"2023-03-03T06:25:57.494899+0000","last_became_active":"2023-03-03T06:25:56.102700+0000","last_became_peered":"2023-03-03T06:25:56.102700+0000","last_unstale":"2023-03-03T06:25:57.494899+0000","last_undegraded":"2023-03-03T06:25:57.494899+0000","last_fullsized":"2023-03-03T06:25:57.494899+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:42:30.715793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079255+0000","last_change":"2023-03-03T06:25:56.093713+0000","last_active":"2023-03-03T06:25:57.079255+0000","last_peered":"2023-03-03T06:25:57.079255+0000","last_clean":"2023-03-03T06:25:57.079255+0000","last_became_active":"2023-03-03T06:25:56.093383+0000","last_became_peered":"2023-03-03T06:25:56.093383+0000","last_unstale":"2023-03-03T06:25:57.079255+0000","last_undegraded":"2023-03-03T06:25:57.079255+0000","last_fullsized":"2023-03-03T06:25:57.079255+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:27:45.323242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496535+0000","last_change":"2023-03-03T06:25:56.104385+0000","last_active":"2023-03-03T06:25:57.496535+0000","last_peered":"2023-03-03T06:25:57.496535+0000","last_clean":"2023-03-03T06:25:57.496535+0000","last_became_active":"2023-03-03T06:25:56.103881+0000","last_became_peered":"2023-03-03T06:25:56.103881+0000","last_unstale":"2023-03-03T06:25:57.496535+0000","last_undegraded":"2023-03-03T06:25:57.496535+0000","last_fullsized":"2023-03-03T06:25:57.496535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:52:23.249309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495264+0000","last_change":"2023-03-03T06:25:56.097832+0000","last_active":"2023-03-03T06:25:57.495264+0000","last_peered":"2023-03-03T06:25:57.495264+0000","last_clean":"2023-03-03T06:25:57.495264+0000","last_became_active":"2023-03-03T06:25:56.097237+0000","last_became_peered":"2023-03-03T06:25:56.097237+0000","last_unstale":"2023-03-03T06:25:57.495264+0000","last_undegraded":"2023-03-03T06:25:57.495264+0000","last_fullsized":"2023-03-03T06:25:57.495264+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:03:22.983718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.202826+0000","last_change":"2023-03-03T06:25:56.104268+0000","last_active":"2023-03-03T06:25:57.202826+0000","last_peered":"2023-03-03T06:25:57.202826+0000","last_clean":"2023-03-03T06:25:57.202826+0000","last_became_active":"2023-03-03T06:25:56.103986+0000","last_became_peered":"2023-03-03T06:25:56.103986+0000","last_unstale":"2023-03-03T06:25:57.202826+0000","last_undegraded":"2023-03-03T06:25:57.202826+0000","last_fullsized":"2023-03-03T06:25:57.202826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:47.353315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079501+0000","last_change":"2023-03-03T06:25:56.106890+0000","last_active":"2023-03-03T06:25:57.079501+0000","last_peered":"2023-03-03T06:25:57.079501+0000","last_clean":"2023-03-03T06:25:57.079501+0000","last_became_active":"2023-03-03T06:25:56.106625+0000","last_became_peered":"2023-03-03T06:25:56.106625+0000","last_unstale":"2023-03-03T06:25:57.079501+0000","last_undegraded":"2023-03-03T06:25:57.079501+0000","last_fullsized":"2023-03-03T06:25:57.079501+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:50:17.765713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495573+0000","last_change":"2023-03-03T06:25:56.096272+0000","last_active":"2023-03-03T06:25:57.495573+0000","last_peered":"2023-03-03T06:25:57.495573+0000","last_clean":"2023-03-03T06:25:57.495573+0000","last_became_active":"2023-03-03T06:25:56.092063+0000","last_became_peered":"2023-03-03T06:25:56.092063+0000","last_unstale":"2023-03-03T06:25:57.495573+0000","last_undegraded":"2023-03-03T06:25:57.495573+0000","last_fullsized":"2023-03-03T06:25:57.495573+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:53:12.251213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496509+0000","last_change":"2023-03-03T06:25:56.093667+0000","last_active":"2023-03-03T06:25:57.496509+0000","last_peered":"2023-03-03T06:25:57.496509+0000","last_clean":"2023-03-03T06:25:57.496509+0000","last_became_active":"2023-03-03T06:25:56.093420+0000","last_became_peered":"2023-03-03T06:25:56.093420+0000","last_unstale":"2023-03-03T06:25:57.496509+0000","last_undegraded":"2023-03-03T06:25:57.496509+0000","last_fullsized":"2023-03-03T06:25:57.496509+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:16:39.291453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079116+0000","last_change":"2023-03-03T06:25:56.091330+0000","last_active":"2023-03-03T06:25:57.079116+0000","last_peered":"2023-03-03T06:25:57.079116+0000","last_clean":"2023-03-03T06:25:57.079116+0000","last_became_active":"2023-03-03T06:25:56.091044+0000","last_became_peered":"2023-03-03T06:25:56.091044+0000","last_unstale":"2023-03-03T06:25:57.079116+0000","last_undegraded":"2023-03-03T06:25:57.079116+0000","last_fullsized":"2023-03-03T06:25:57.079116+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:23:34.085580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080217+0000","last_change":"2023-03-03T06:25:56.098685+0000","last_active":"2023-03-03T06:25:57.080217+0000","last_peered":"2023-03-03T06:25:57.080217+0000","last_clean":"2023-03-03T06:25:57.080217+0000","last_became_active":"2023-03-03T06:25:56.098411+0000","last_became_peered":"2023-03-03T06:25:56.098411+0000","last_unstale":"2023-03-03T06:25:57.080217+0000","last_undegraded":"2023-03-03T06:25:57.080217+0000","last_fullsized":"2023-03-03T06:25:57.080217+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:42:30.715793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.078960+0000","last_change":"2023-03-03T06:25:56.093796+0000","last_active":"2023-03-03T06:25:57.078960+0000","last_peered":"2023-03-03T06:25:57.078960+0000","last_clean":"2023-03-03T06:25:57.078960+0000","last_became_active":"2023-03-03T06:25:56.093529+0000","last_became_peered":"2023-03-03T06:25:56.093529+0000","last_unstale":"2023-03-03T06:25:57.078960+0000","last_undegraded":"2023-03-03T06:25:57.078960+0000","last_fullsized":"2023-03-03T06:25:57.078960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:17.826074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080136+0000","last_change":"2023-03-03T06:25:56.095604+0000","last_active":"2023-03-03T06:25:57.080136+0000","last_peered":"2023-03-03T06:25:57.080136+0000","last_clean":"2023-03-03T06:25:57.080136+0000","last_became_active":"2023-03-03T06:25:56.095321+0000","last_became_peered":"2023-03-03T06:25:56.095321+0000","last_unstale":"2023-03-03T06:25:57.080136+0000","last_undegraded":"2023-03-03T06:25:57.080136+0000","last_fullsized":"2023-03-03T06:25:57.080136+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:46:31.226919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495141+0000","last_change":"2023-03-03T06:25:56.097846+0000","last_active":"2023-03-03T06:25:57.495141+0000","last_peered":"2023-03-03T06:25:57.495141+0000","last_clean":"2023-03-03T06:25:57.495141+0000","last_became_active":"2023-03-03T06:25:56.097566+0000","last_became_peered":"2023-03-03T06:25:56.097566+0000","last_unstale":"2023-03-03T06:25:57.495141+0000","last_undegraded":"2023-03-03T06:25:57.495141+0000","last_fullsized":"2023-03-03T06:25:57.495141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:42:58.683886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496948+0000","last_change":"2023-03-03T06:25:56.103079+0000","last_active":"2023-03-03T06:25:57.496948+0000","last_peered":"2023-03-03T06:25:57.496948+0000","last_clean":"2023-03-03T06:25:57.496948+0000","last_became_active":"2023-03-03T06:25:56.102814+0000","last_became_peered":"2023-03-03T06:25:56.102814+0000","last_unstale":"2023-03-03T06:25:57.496948+0000","last_undegraded":"2023-03-03T06:25:57.496948+0000","last_fullsized":"2023-03-03T06:25:57.496948+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:28.378207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494720+0000","last_change":"2023-03-03T06:25:56.103181+0000","last_active":"2023-03-03T06:25:57.494720+0000","last_peered":"2023-03-03T06:25:57.494720+0000","last_clean":"2023-03-03T06:25:57.494720+0000","last_became_active":"2023-03-03T06:25:56.102890+0000","last_became_peered":"2023-03-03T06:25:56.102890+0000","last_unstale":"2023-03-03T06:25:57.494720+0000","last_undegraded":"2023-03-03T06:25:57.494720+0000","last_fullsized":"2023-03-03T06:25:57.494720+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:20:50.411879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203193+0000","last_change":"2023-03-03T06:25:56.097911+0000","last_active":"2023-03-03T06:25:57.203193+0000","last_peered":"2023-03-03T06:25:57.203193+0000","last_clean":"2023-03-03T06:25:57.203193+0000","last_became_active":"2023-03-03T06:25:56.097360+0000","last_became_peered":"2023-03-03T06:25:56.097360+0000","last_unstale":"2023-03-03T06:25:57.203193+0000","last_undegraded":"2023-03-03T06:25:57.203193+0000","last_fullsized":"2023-03-03T06:25:57.203193+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:09.797200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.078972+0000","last_change":"2023-03-03T06:25:56.091302+0000","last_active":"2023-03-03T06:25:57.078972+0000","last_peered":"2023-03-03T06:25:57.078972+0000","last_clean":"2023-03-03T06:25:57.078972+0000","last_became_active":"2023-03-03T06:25:56.090753+0000","last_became_peered":"2023-03-03T06:25:56.090753+0000","last_unstale":"2023-03-03T06:25:57.078972+0000","last_undegraded":"2023-03-03T06:25:57.078972+0000","last_fullsized":"2023-03-03T06:25:57.078972+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:33:34.709353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495813+0000","last_change":"2023-03-03T06:25:56.100190+0000","last_active":"2023-03-03T06:25:57.495813+0000","last_peered":"2023-03-03T06:25:57.495813+0000","last_clean":"2023-03-03T06:25:57.495813+0000","last_became_active":"2023-03-03T06:25:56.099924+0000","last_became_peered":"2023-03-03T06:25:56.099924+0000","last_unstale":"2023-03-03T06:25:57.495813+0000","last_undegraded":"2023-03-03T06:25:57.495813+0000","last_fullsized":"2023-03-03T06:25:57.495813+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:40:15.714529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.202977+0000","last_change":"2023-03-03T06:25:56.101020+0000","last_active":"2023-03-03T06:25:57.202977+0000","last_peered":"2023-03-03T06:25:57.202977+0000","last_clean":"2023-03-03T06:25:57.202977+0000","last_became_active":"2023-03-03T06:25:56.100807+0000","last_became_peered":"2023-03-03T06:25:56.100807+0000","last_unstale":"2023-03-03T06:25:57.202977+0000","last_undegraded":"2023-03-03T06:25:57.202977+0000","last_fullsized":"2023-03-03T06:25:57.202977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:49:27.238328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494832+0000","last_change":"2023-03-03T06:25:56.101134+0000","last_active":"2023-03-03T06:25:57.494832+0000","last_peered":"2023-03-03T06:25:57.494832+0000","last_clean":"2023-03-03T06:25:57.494832+0000","last_became_active":"2023-03-03T06:25:56.100876+0000","last_became_peered":"2023-03-03T06:25:56.100876+0000","last_unstale":"2023-03-03T06:25:57.494832+0000","last_undegraded":"2023-03-03T06:25:57.494832+0000","last_fullsized":"2023-03-03T06:25:57.494832+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:21:22.017295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.202921+0000","last_change":"2023-03-03T06:25:56.105988+0000","last_active":"2023-03-03T06:25:57.202921+0000","last_peered":"2023-03-03T06:25:57.202921+0000","last_clean":"2023-03-03T06:25:57.202921+0000","last_became_active":"2023-03-03T06:25:56.105719+0000","last_became_peered":"2023-03-03T06:25:56.105719+0000","last_unstale":"2023-03-03T06:25:57.202921+0000","last_undegraded":"2023-03-03T06:25:57.202921+0000","last_fullsized":"2023-03-03T06:25:57.202921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:13:44.325287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082808+0000","last_change":"2023-03-03T06:25:56.101182+0000","last_active":"2023-03-03T06:25:57.082808+0000","last_peered":"2023-03-03T06:25:57.082808+0000","last_clean":"2023-03-03T06:25:57.082808+0000","last_became_active":"2023-03-03T06:25:56.100912+0000","last_became_peered":"2023-03-03T06:25:56.100912+0000","last_unstale":"2023-03-03T06:25:57.082808+0000","last_undegraded":"2023-03-03T06:25:57.082808+0000","last_fullsized":"2023-03-03T06:25:57.082808+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:25:54.177340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203104+0000","last_change":"2023-03-03T06:25:55.679799+0000","last_active":"2023-03-03T06:25:57.203104+0000","last_peered":"2023-03-03T06:25:57.203104+0000","last_clean":"2023-03-03T06:25:57.203104+0000","last_became_active":"2023-03-03T06:25:55.679576+0000","last_became_peered":"2023-03-03T06:25:55.679576+0000","last_unstale":"2023-03-03T06:25:57.203104+0000","last_undegraded":"2023-03-03T06:25:57.203104+0000","last_fullsized":"2023-03-03T06:25:57.203104+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:25:41.983780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.078519+0000","last_change":"2023-03-03T06:25:05.635776+0000","last_active":"2023-03-03T06:25:56.078519+0000","last_peered":"2023-03-03T06:25:56.078519+0000","last_clean":"2023-03-03T06:25:56.078519+0000","last_became_active":"2023-03-03T06:25:04.444243+0000","last_became_peered":"2023-03-03T06:25:04.444243+0000","last_unstale":"2023-03-03T06:25:56.078519+0000","last_undegraded":"2023-03-03T06:25:56.078519+0000","last_fullsized":"2023-03-03T06:25:56.078519+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:00:41.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066956899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494621+0000","last_change":"2023-03-03T06:25:56.094983+0000","last_active":"2023-03-03T06:25:57.494621+0000","last_peered":"2023-03-03T06:25:57.494621+0000","last_clean":"2023-03-03T06:25:57.494621+0000","last_became_active":"2023-03-03T06:25:56.094511+0000","last_became_peered":"2023-03-03T06:25:56.094511+0000","last_unstale":"2023-03-03T06:25:57.494621+0000","last_undegraded":"2023-03-03T06:25:57.494621+0000","last_fullsized":"2023-03-03T06:25:57.494621+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:52:04.016434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"67'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494436+0000","last_change":"2023-03-03T06:25:55.667137+0000","last_active":"2023-03-03T06:25:57.494436+0000","last_peered":"2023-03-03T06:25:57.494436+0000","last_clean":"2023-03-03T06:25:57.494436+0000","last_became_active":"2023-03-03T06:25:55.666830+0000","last_became_peered":"2023-03-03T06:25:55.666830+0000","last_unstale":"2023-03-03T06:25:57.494436+0000","last_undegraded":"2023-03-03T06:25:57.494436+0000","last_fullsized":"2023-03-03T06:25:57.494436+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:52:18.007639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.093511+0000","last_change":"2023-03-03T06:25:05.615550+0000","last_active":"2023-03-03T06:25:56.093511+0000","last_peered":"2023-03-03T06:25:56.093511+0000","last_clean":"2023-03-03T06:25:56.093511+0000","last_became_active":"2023-03-03T06:25:04.445574+0000","last_became_peered":"2023-03-03T06:25:04.445574+0000","last_unstale":"2023-03-03T06:25:56.093511+0000","last_undegraded":"2023-03-03T06:25:56.093511+0000","last_fullsized":"2023-03-03T06:25:56.093511+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:15:06.370284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061229600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.083064+0000","last_change":"2023-03-03T06:25:56.095900+0000","last_active":"2023-03-03T06:25:57.083064+0000","last_peered":"2023-03-03T06:25:57.083064+0000","last_clean":"2023-03-03T06:25:57.083064+0000","last_became_active":"2023-03-03T06:25:56.095612+0000","last_became_peered":"2023-03-03T06:25:56.095612+0000","last_unstale":"2023-03-03T06:25:57.083064+0000","last_undegraded":"2023-03-03T06:25:57.083064+0000","last_fullsized":"2023-03-03T06:25:57.083064+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:31:28.438828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"67'8","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495927+0000","last_change":"2023-03-03T06:25:55.667014+0000","last_active":"2023-03-03T06:25:57.495927+0000","last_peered":"2023-03-03T06:25:57.495927+0000","last_clean":"2023-03-03T06:25:57.495927+0000","last_became_active":"2023-03-03T06:25:55.666717+0000","last_became_peered":"2023-03-03T06:25:55.666717+0000","last_unstale":"2023-03-03T06:25:57.495927+0000","last_undegraded":"2023-03-03T06:25:57.495927+0000","last_fullsized":"2023-03-03T06:25:57.495927+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:29.938169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":38,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.089324+0000","last_change":"2023-03-03T06:25:05.431475+0000","last_active":"2023-03-03T06:25:56.089324+0000","last_peered":"2023-03-03T06:25:56.089324+0000","last_clean":"2023-03-03T06:25:56.089324+0000","last_became_active":"2023-03-03T06:25:04.596724+0000","last_became_peered":"2023-03-03T06:25:04.596724+0000","last_unstale":"2023-03-03T06:25:56.089324+0000","last_undegraded":"2023-03-03T06:25:56.089324+0000","last_fullsized":"2023-03-03T06:25:56.089324+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015785179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082871+0000","last_change":"2023-03-03T06:25:56.102616+0000","last_active":"2023-03-03T06:25:57.082871+0000","last_peered":"2023-03-03T06:25:57.082871+0000","last_clean":"2023-03-03T06:25:57.082871+0000","last_became_active":"2023-03-03T06:25:56.102361+0000","last_became_peered":"2023-03-03T06:25:56.102361+0000","last_unstale":"2023-03-03T06:25:57.082871+0000","last_undegraded":"2023-03-03T06:25:57.082871+0000","last_fullsized":"2023-03-03T06:25:57.082871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:15:55.501403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.078821+0000","last_change":"2023-03-03T06:25:55.672747+0000","last_active":"2023-03-03T06:25:57.078821+0000","last_peered":"2023-03-03T06:25:57.078821+0000","last_clean":"2023-03-03T06:25:57.078821+0000","last_became_active":"2023-03-03T06:25:55.672334+0000","last_became_peered":"2023-03-03T06:25:55.672334+0000","last_unstale":"2023-03-03T06:25:57.078821+0000","last_undegraded":"2023-03-03T06:25:57.078821+0000","last_fullsized":"2023-03-03T06:25:57.078821+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:30.822215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":35,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.088896+0000","last_change":"2023-03-03T06:25:05.796744+0000","last_active":"2023-03-03T06:25:56.088896+0000","last_peered":"2023-03-03T06:25:56.088896+0000","last_clean":"2023-03-03T06:25:56.088896+0000","last_became_active":"2023-03-03T06:25:04.444571+0000","last_became_peered":"2023-03-03T06:25:04.444571+0000","last_unstale":"2023-03-03T06:25:56.088896+0000","last_undegraded":"2023-03-03T06:25:56.088896+0000","last_fullsized":"2023-03-03T06:25:56.088896+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:46:48.500233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050328500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494911+0000","last_change":"2023-03-03T06:25:56.093921+0000","last_active":"2023-03-03T06:25:57.494911+0000","last_peered":"2023-03-03T06:25:57.494911+0000","last_clean":"2023-03-03T06:25:57.494911+0000","last_became_active":"2023-03-03T06:25:56.093622+0000","last_became_peered":"2023-03-03T06:25:56.093622+0000","last_unstale":"2023-03-03T06:25:57.494911+0000","last_undegraded":"2023-03-03T06:25:57.494911+0000","last_fullsized":"2023-03-03T06:25:57.494911+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:44:53.606330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494779+0000","last_change":"2023-03-03T06:25:55.672493+0000","last_active":"2023-03-03T06:25:57.494779+0000","last_peered":"2023-03-03T06:25:57.494779+0000","last_clean":"2023-03-03T06:25:57.494779+0000","last_became_active":"2023-03-03T06:25:55.672194+0000","last_became_peered":"2023-03-03T06:25:55.672194+0000","last_unstale":"2023-03-03T06:25:57.494779+0000","last_undegraded":"2023-03-03T06:25:57.494779+0000","last_fullsized":"2023-03-03T06:25:57.494779+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:08.795345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.088445+0000","last_change":"2023-03-03T06:25:05.615943+0000","last_active":"2023-03-03T06:25:56.088445+0000","last_peered":"2023-03-03T06:25:56.088445+0000","last_clean":"2023-03-03T06:25:56.088445+0000","last_became_active":"2023-03-03T06:25:04.443824+0000","last_became_peered":"2023-03-03T06:25:04.443824+0000","last_unstale":"2023-03-03T06:25:56.088445+0000","last_undegraded":"2023-03-03T06:25:56.088445+0000","last_fullsized":"2023-03-03T06:25:56.088445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:11.723607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059238800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495147+0000","last_change":"2023-03-03T06:25:56.107463+0000","last_active":"2023-03-03T06:25:57.495147+0000","last_peered":"2023-03-03T06:25:57.495147+0000","last_clean":"2023-03-03T06:25:57.495147+0000","last_became_active":"2023-03-03T06:25:56.107214+0000","last_became_peered":"2023-03-03T06:25:56.107214+0000","last_unstale":"2023-03-03T06:25:57.495147+0000","last_undegraded":"2023-03-03T06:25:57.495147+0000","last_fullsized":"2023-03-03T06:25:57.495147+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:19:49.766279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203439+0000","last_change":"2023-03-03T06:25:55.678109+0000","last_active":"2023-03-03T06:25:57.203439+0000","last_peered":"2023-03-03T06:25:57.203439+0000","last_clean":"2023-03-03T06:25:57.203439+0000","last_became_active":"2023-03-03T06:25:55.677807+0000","last_became_peered":"2023-03-03T06:25:55.677807+0000","last_unstale":"2023-03-03T06:25:57.203439+0000","last_undegraded":"2023-03-03T06:25:57.203439+0000","last_fullsized":"2023-03-03T06:25:57.203439+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:16:35.235324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.085430+0000","last_change":"2023-03-03T06:25:05.430594+0000","last_active":"2023-03-03T06:25:56.085430+0000","last_peered":"2023-03-03T06:25:56.085430+0000","last_clean":"2023-03-03T06:25:56.085430+0000","last_became_active":"2023-03-03T06:25:04.435012+0000","last_became_peered":"2023-03-03T06:25:04.435012+0000","last_unstale":"2023-03-03T06:25:56.085430+0000","last_undegraded":"2023-03-03T06:25:56.085430+0000","last_fullsized":"2023-03-03T06:25:56.085430+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052988999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494885+0000","last_change":"2023-03-03T06:25:56.107656+0000","last_active":"2023-03-03T06:25:57.494885+0000","last_peered":"2023-03-03T06:25:57.494885+0000","last_clean":"2023-03-03T06:25:57.494885+0000","last_became_active":"2023-03-03T06:25:56.107398+0000","last_became_peered":"2023-03-03T06:25:56.107398+0000","last_unstale":"2023-03-03T06:25:57.494885+0000","last_undegraded":"2023-03-03T06:25:57.494885+0000","last_fullsized":"2023-03-03T06:25:57.494885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:11:52.602772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"67'6","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082913+0000","last_change":"2023-03-03T06:25:55.667072+0000","last_active":"2023-03-03T06:25:57.082913+0000","last_peered":"2023-03-03T06:25:57.082913+0000","last_clean":"2023-03-03T06:25:57.082913+0000","last_became_active":"2023-03-03T06:25:55.666796+0000","last_became_peered":"2023-03-03T06:25:55.666796+0000","last_unstale":"2023-03-03T06:25:57.082913+0000","last_undegraded":"2023-03-03T06:25:57.082913+0000","last_fullsized":"2023-03-03T06:25:57.082913+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:01:20.131181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.099011+0000","last_change":"2023-03-03T06:25:05.616017+0000","last_active":"2023-03-03T06:25:56.099011+0000","last_peered":"2023-03-03T06:25:56.099011+0000","last_clean":"2023-03-03T06:25:56.099011+0000","last_became_active":"2023-03-03T06:25:04.443176+0000","last_became_peered":"2023-03-03T06:25:04.443176+0000","last_unstale":"2023-03-03T06:25:56.099011+0000","last_undegraded":"2023-03-03T06:25:56.099011+0000","last_fullsized":"2023-03-03T06:25:56.099011+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:38:47.576162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034461600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496495+0000","last_change":"2023-03-03T06:25:56.100653+0000","last_active":"2023-03-03T06:25:57.496495+0000","last_peered":"2023-03-03T06:25:57.496495+0000","last_clean":"2023-03-03T06:25:57.496495+0000","last_became_active":"2023-03-03T06:25:56.100383+0000","last_became_peered":"2023-03-03T06:25:56.100383+0000","last_unstale":"2023-03-03T06:25:57.496495+0000","last_undegraded":"2023-03-03T06:25:57.496495+0000","last_fullsized":"2023-03-03T06:25:57.496495+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:52:02.544501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"67'3","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079191+0000","last_change":"2023-03-03T06:25:55.669256+0000","last_active":"2023-03-03T06:25:57.079191+0000","last_peered":"2023-03-03T06:25:57.079191+0000","last_clean":"2023-03-03T06:25:57.079191+0000","last_became_active":"2023-03-03T06:25:55.668948+0000","last_became_peered":"2023-03-03T06:25:55.668948+0000","last_unstale":"2023-03-03T06:25:57.079191+0000","last_undegraded":"2023-03-03T06:25:57.079191+0000","last_fullsized":"2023-03-03T06:25:57.079191+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:39.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":38,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.089677+0000","last_change":"2023-03-03T06:25:05.431768+0000","last_active":"2023-03-03T06:25:56.089677+0000","last_peered":"2023-03-03T06:25:56.089677+0000","last_clean":"2023-03-03T06:25:56.089677+0000","last_became_active":"2023-03-03T06:25:04.596711+0000","last_became_peered":"2023-03-03T06:25:04.596711+0000","last_unstale":"2023-03-03T06:25:56.089677+0000","last_undegraded":"2023-03-03T06:25:56.089677+0000","last_fullsized":"2023-03-03T06:25:56.089677+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001569261,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495493+0000","last_change":"2023-03-03T06:25:56.100049+0000","last_active":"2023-03-03T06:25:57.495493+0000","last_peered":"2023-03-03T06:25:57.495493+0000","last_clean":"2023-03-03T06:25:57.495493+0000","last_became_active":"2023-03-03T06:25:56.099480+0000","last_became_peered":"2023-03-03T06:25:56.099480+0000","last_unstale":"2023-03-03T06:25:57.495493+0000","last_undegraded":"2023-03-03T06:25:57.495493+0000","last_fullsized":"2023-03-03T06:25:57.495493+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:49:48.201810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"67'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494438+0000","last_change":"2023-03-03T06:25:55.675963+0000","last_active":"2023-03-03T06:25:57.494438+0000","last_peered":"2023-03-03T06:25:57.494438+0000","last_clean":"2023-03-03T06:25:57.494438+0000","last_became_active":"2023-03-03T06:25:55.675408+0000","last_became_peered":"2023-03-03T06:25:55.675408+0000","last_unstale":"2023-03-03T06:25:57.494438+0000","last_undegraded":"2023-03-03T06:25:57.494438+0000","last_fullsized":"2023-03-03T06:25:57.494438+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:56:15.985732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.078421+0000","last_change":"2023-03-03T06:25:05.635716+0000","last_active":"2023-03-03T06:25:56.078421+0000","last_peered":"2023-03-03T06:25:56.078421+0000","last_clean":"2023-03-03T06:25:56.078421+0000","last_became_active":"2023-03-03T06:25:04.433896+0000","last_became_peered":"2023-03-03T06:25:04.433896+0000","last_unstale":"2023-03-03T06:25:56.078421+0000","last_undegraded":"2023-03-03T06:25:56.078421+0000","last_fullsized":"2023-03-03T06:25:56.078421+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:35.209807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060132199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495318+0000","last_change":"2023-03-03T06:25:56.100653+0000","last_active":"2023-03-03T06:25:57.495318+0000","last_peered":"2023-03-03T06:25:57.495318+0000","last_clean":"2023-03-03T06:25:57.495318+0000","last_became_active":"2023-03-03T06:25:56.098319+0000","last_became_peered":"2023-03-03T06:25:56.098319+0000","last_unstale":"2023-03-03T06:25:57.495318+0000","last_undegraded":"2023-03-03T06:25:57.495318+0000","last_fullsized":"2023-03-03T06:25:57.495318+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:17:09.456011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"67'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080769+0000","last_change":"2023-03-03T06:25:55.673555+0000","last_active":"2023-03-03T06:25:57.080769+0000","last_peered":"2023-03-03T06:25:57.080769+0000","last_clean":"2023-03-03T06:25:57.080769+0000","last_became_active":"2023-03-03T06:25:55.672936+0000","last_became_peered":"2023-03-03T06:25:55.672936+0000","last_unstale":"2023-03-03T06:25:57.080769+0000","last_undegraded":"2023-03-03T06:25:57.080769+0000","last_fullsized":"2023-03-03T06:25:57.080769+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:59:41.826231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.086306+0000","last_change":"2023-03-03T06:25:05.429739+0000","last_active":"2023-03-03T06:25:56.086306+0000","last_peered":"2023-03-03T06:25:56.086306+0000","last_clean":"2023-03-03T06:25:56.086306+0000","last_became_active":"2023-03-03T06:25:04.438903+0000","last_became_peered":"2023-03-03T06:25:04.438903+0000","last_unstale":"2023-03-03T06:25:56.086306+0000","last_undegraded":"2023-03-03T06:25:56.086306+0000","last_fullsized":"2023-03-03T06:25:56.086306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040434999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082998+0000","last_change":"2023-03-03T06:25:56.109030+0000","last_active":"2023-03-03T06:25:57.082998+0000","last_peered":"2023-03-03T06:25:57.082998+0000","last_clean":"2023-03-03T06:25:57.082998+0000","last_became_active":"2023-03-03T06:25:56.108725+0000","last_became_peered":"2023-03-03T06:25:56.108725+0000","last_unstale":"2023-03-03T06:25:57.082998+0000","last_undegraded":"2023-03-03T06:25:57.082998+0000","last_fullsized":"2023-03-03T06:25:57.082998+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:20:38.452147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.078833+0000","last_change":"2023-03-03T06:25:55.668379+0000","last_active":"2023-03-03T06:25:57.078833+0000","last_peered":"2023-03-03T06:25:57.078833+0000","last_clean":"2023-03-03T06:25:57.078833+0000","last_became_active":"2023-03-03T06:25:55.667272+0000","last_became_peered":"2023-03-03T06:25:55.667272+0000","last_unstale":"2023-03-03T06:25:57.078833+0000","last_undegraded":"2023-03-03T06:25:57.078833+0000","last_fullsized":"2023-03-03T06:25:57.078833+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:30:27.305804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.087199+0000","last_change":"2023-03-03T06:25:05.430443+0000","last_active":"2023-03-03T06:25:56.087199+0000","last_peered":"2023-03-03T06:25:56.087199+0000","last_clean":"2023-03-03T06:25:56.087199+0000","last_became_active":"2023-03-03T06:25:04.596481+0000","last_became_peered":"2023-03-03T06:25:04.596481+0000","last_unstale":"2023-03-03T06:25:56.087199+0000","last_undegraded":"2023-03-03T06:25:56.087199+0000","last_fullsized":"2023-03-03T06:25:56.087199+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044860800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080439+0000","last_change":"2023-03-03T06:25:56.096695+0000","last_active":"2023-03-03T06:25:57.080439+0000","last_peered":"2023-03-03T06:25:57.080439+0000","last_clean":"2023-03-03T06:25:57.080439+0000","last_became_active":"2023-03-03T06:25:56.096174+0000","last_became_peered":"2023-03-03T06:25:56.096174+0000","last_unstale":"2023-03-03T06:25:57.080439+0000","last_undegraded":"2023-03-03T06:25:57.080439+0000","last_fullsized":"2023-03-03T06:25:57.080439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:52:04.016434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495311+0000","last_change":"2023-03-03T06:25:55.674908+0000","last_active":"2023-03-03T06:25:57.495311+0000","last_peered":"2023-03-03T06:25:57.495311+0000","last_clean":"2023-03-03T06:25:57.495311+0000","last_became_active":"2023-03-03T06:25:55.674628+0000","last_became_peered":"2023-03-03T06:25:55.674628+0000","last_unstale":"2023-03-03T06:25:57.495311+0000","last_undegraded":"2023-03-03T06:25:57.495311+0000","last_fullsized":"2023-03-03T06:25:57.495311+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:41:46.351459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.093284+0000","last_change":"2023-03-03T06:25:05.431490+0000","last_active":"2023-03-03T06:25:56.093284+0000","last_peered":"2023-03-03T06:25:56.093284+0000","last_clean":"2023-03-03T06:25:56.093284+0000","last_became_active":"2023-03-03T06:25:04.443163+0000","last_became_peered":"2023-03-03T06:25:04.443163+0000","last_unstale":"2023-03-03T06:25:56.093284+0000","last_undegraded":"2023-03-03T06:25:56.093284+0000","last_fullsized":"2023-03-03T06:25:56.093284+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020118839999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495412+0000","last_change":"2023-03-03T06:25:56.098001+0000","last_active":"2023-03-03T06:25:57.495412+0000","last_peered":"2023-03-03T06:25:57.495412+0000","last_clean":"2023-03-03T06:25:57.495412+0000","last_became_active":"2023-03-03T06:25:56.097577+0000","last_became_peered":"2023-03-03T06:25:56.097577+0000","last_unstale":"2023-03-03T06:25:57.495412+0000","last_undegraded":"2023-03-03T06:25:57.495412+0000","last_fullsized":"2023-03-03T06:25:57.495412+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:04:58.315586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"67'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203358+0000","last_change":"2023-03-03T06:25:55.674231+0000","last_active":"2023-03-03T06:25:57.203358+0000","last_peered":"2023-03-03T06:25:57.203358+0000","last_clean":"2023-03-03T06:25:57.203358+0000","last_became_active":"2023-03-03T06:25:55.673938+0000","last_became_peered":"2023-03-03T06:25:55.673938+0000","last_unstale":"2023-03-03T06:25:57.203358+0000","last_undegraded":"2023-03-03T06:25:57.203358+0000","last_fullsized":"2023-03-03T06:25:57.203358+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:23:52.309851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.086458+0000","last_change":"2023-03-03T06:25:05.432139+0000","last_active":"2023-03-03T06:25:56.086458+0000","last_peered":"2023-03-03T06:25:56.086458+0000","last_clean":"2023-03-03T06:25:56.086458+0000","last_became_active":"2023-03-03T06:25:04.435759+0000","last_became_peered":"2023-03-03T06:25:04.435759+0000","last_unstale":"2023-03-03T06:25:56.086458+0000","last_undegraded":"2023-03-03T06:25:56.086458+0000","last_fullsized":"2023-03-03T06:25:56.086458+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001646893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494676+0000","last_change":"2023-03-03T06:25:56.092274+0000","last_active":"2023-03-03T06:25:57.494676+0000","last_peered":"2023-03-03T06:25:57.494676+0000","last_clean":"2023-03-03T06:25:57.494676+0000","last_became_active":"2023-03-03T06:25:56.091998+0000","last_became_peered":"2023-03-03T06:25:56.091998+0000","last_unstale":"2023-03-03T06:25:57.494676+0000","last_undegraded":"2023-03-03T06:25:57.494676+0000","last_fullsized":"2023-03-03T06:25:57.494676+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:27:53.405992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"67'4","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079401+0000","last_change":"2023-03-03T06:25:55.672634+0000","last_active":"2023-03-03T06:25:57.079401+0000","last_peered":"2023-03-03T06:25:57.079401+0000","last_clean":"2023-03-03T06:25:57.079401+0000","last_became_active":"2023-03-03T06:25:55.672083+0000","last_became_peered":"2023-03-03T06:25:55.672083+0000","last_unstale":"2023-03-03T06:25:57.079401+0000","last_undegraded":"2023-03-03T06:25:57.079401+0000","last_fullsized":"2023-03-03T06:25:57.079401+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:29:15.920867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.079202+0000","last_change":"2023-03-03T06:25:05.635968+0000","last_active":"2023-03-03T06:25:56.079202+0000","last_peered":"2023-03-03T06:25:56.079202+0000","last_clean":"2023-03-03T06:25:56.079202+0000","last_became_active":"2023-03-03T06:25:04.443619+0000","last_became_peered":"2023-03-03T06:25:04.443619+0000","last_unstale":"2023-03-03T06:25:56.079202+0000","last_undegraded":"2023-03-03T06:25:56.079202+0000","last_fullsized":"2023-03-03T06:25:56.079202+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:51:15.780667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077929799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080470+0000","last_change":"2023-03-03T06:25:56.098564+0000","last_active":"2023-03-03T06:25:57.080470+0000","last_peered":"2023-03-03T06:25:57.080470+0000","last_clean":"2023-03-03T06:25:57.080470+0000","last_became_active":"2023-03-03T06:25:56.098089+0000","last_became_peered":"2023-03-03T06:25:56.098089+0000","last_unstale":"2023-03-03T06:25:57.080470+0000","last_undegraded":"2023-03-03T06:25:57.080470+0000","last_fullsized":"2023-03-03T06:25:57.080470+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:20:50.411879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"67'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082810+0000","last_change":"2023-03-03T06:25:55.671232+0000","last_active":"2023-03-03T06:25:57.082810+0000","last_peered":"2023-03-03T06:25:57.082810+0000","last_clean":"2023-03-03T06:25:57.082810+0000","last_became_active":"2023-03-03T06:25:55.670879+0000","last_became_peered":"2023-03-03T06:25:55.670879+0000","last_unstale":"2023-03-03T06:25:57.082810+0000","last_undegraded":"2023-03-03T06:25:57.082810+0000","last_fullsized":"2023-03-03T06:25:57.082810+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:05:52.789527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.092396+0000","last_change":"2023-03-03T06:25:05.432320+0000","last_active":"2023-03-03T06:25:56.092396+0000","last_peered":"2023-03-03T06:25:56.092396+0000","last_clean":"2023-03-03T06:25:56.092396+0000","last_became_active":"2023-03-03T06:25:04.436727+0000","last_became_peered":"2023-03-03T06:25:04.436727+0000","last_unstale":"2023-03-03T06:25:56.092396+0000","last_undegraded":"2023-03-03T06:25:56.092396+0000","last_fullsized":"2023-03-03T06:25:56.092396+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014361980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080332+0000","last_change":"2023-03-03T06:25:56.101790+0000","last_active":"2023-03-03T06:25:57.080332+0000","last_peered":"2023-03-03T06:25:57.080332+0000","last_clean":"2023-03-03T06:25:57.080332+0000","last_became_active":"2023-03-03T06:25:56.101402+0000","last_became_peered":"2023-03-03T06:25:56.101402+0000","last_unstale":"2023-03-03T06:25:57.080332+0000","last_undegraded":"2023-03-03T06:25:57.080332+0000","last_fullsized":"2023-03-03T06:25:57.080332+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:52:02.544501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"67'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203346+0000","last_change":"2023-03-03T06:25:55.678435+0000","last_active":"2023-03-03T06:25:57.203346+0000","last_peered":"2023-03-03T06:25:57.203346+0000","last_clean":"2023-03-03T06:25:57.203346+0000","last_became_active":"2023-03-03T06:25:55.678211+0000","last_became_peered":"2023-03-03T06:25:55.678211+0000","last_unstale":"2023-03-03T06:25:57.203346+0000","last_undegraded":"2023-03-03T06:25:57.203346+0000","last_fullsized":"2023-03-03T06:25:57.203346+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:26:15.352266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":38,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.089752+0000","last_change":"2023-03-03T06:25:05.431681+0000","last_active":"2023-03-03T06:25:56.089752+0000","last_peered":"2023-03-03T06:25:56.089752+0000","last_clean":"2023-03-03T06:25:56.089752+0000","last_became_active":"2023-03-03T06:25:04.443599+0000","last_became_peered":"2023-03-03T06:25:04.443599+0000","last_unstale":"2023-03-03T06:25:56.089752+0000","last_undegraded":"2023-03-03T06:25:56.089752+0000","last_fullsized":"2023-03-03T06:25:56.089752+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001546473,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082941+0000","last_change":"2023-03-03T06:25:56.109044+0000","last_active":"2023-03-03T06:25:57.082941+0000","last_peered":"2023-03-03T06:25:57.082941+0000","last_clean":"2023-03-03T06:25:57.082941+0000","last_became_active":"2023-03-03T06:25:56.108798+0000","last_became_peered":"2023-03-03T06:25:56.108798+0000","last_unstale":"2023-03-03T06:25:57.082941+0000","last_undegraded":"2023-03-03T06:25:57.082941+0000","last_fullsized":"2023-03-03T06:25:57.082941+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:32:14.455577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079055+0000","last_change":"2023-03-03T06:25:55.675443+0000","last_active":"2023-03-03T06:25:57.079055+0000","last_peered":"2023-03-03T06:25:57.079055+0000","last_clean":"2023-03-03T06:25:57.079055+0000","last_became_active":"2023-03-03T06:25:55.675149+0000","last_became_peered":"2023-03-03T06:25:55.675149+0000","last_unstale":"2023-03-03T06:25:57.079055+0000","last_undegraded":"2023-03-03T06:25:57.079055+0000","last_fullsized":"2023-03-03T06:25:57.079055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:07:21.821141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.079797+0000","last_change":"2023-03-03T06:25:05.796211+0000","last_active":"2023-03-03T06:25:56.079797+0000","last_peered":"2023-03-03T06:25:56.079797+0000","last_clean":"2023-03-03T06:25:56.079797+0000","last_became_active":"2023-03-03T06:25:04.436647+0000","last_became_peered":"2023-03-03T06:25:04.436647+0000","last_unstale":"2023-03-03T06:25:56.079797+0000","last_undegraded":"2023-03-03T06:25:56.079797+0000","last_fullsized":"2023-03-03T06:25:56.079797+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:07.330548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082835+0000","last_change":"2023-03-03T06:25:56.097677+0000","last_active":"2023-03-03T06:25:57.082835+0000","last_peered":"2023-03-03T06:25:57.082835+0000","last_clean":"2023-03-03T06:25:57.082835+0000","last_became_active":"2023-03-03T06:25:56.097328+0000","last_became_peered":"2023-03-03T06:25:56.097328+0000","last_unstale":"2023-03-03T06:25:57.082835+0000","last_undegraded":"2023-03-03T06:25:57.082835+0000","last_fullsized":"2023-03-03T06:25:57.082835+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:23:53.311706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082679+0000","last_change":"2023-03-03T06:25:55.670533+0000","last_active":"2023-03-03T06:25:57.082679+0000","last_peered":"2023-03-03T06:25:57.082679+0000","last_clean":"2023-03-03T06:25:57.082679+0000","last_became_active":"2023-03-03T06:25:55.670202+0000","last_became_peered":"2023-03-03T06:25:55.670202+0000","last_unstale":"2023-03-03T06:25:57.082679+0000","last_undegraded":"2023-03-03T06:25:57.082679+0000","last_fullsized":"2023-03-03T06:25:57.082679+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:14:26.183601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":38,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.087221+0000","last_change":"2023-03-03T06:25:05.431187+0000","last_active":"2023-03-03T06:25:56.087221+0000","last_peered":"2023-03-03T06:25:56.087221+0000","last_clean":"2023-03-03T06:25:56.087221+0000","last_became_active":"2023-03-03T06:25:04.442929+0000","last_became_peered":"2023-03-03T06:25:04.442929+0000","last_unstale":"2023-03-03T06:25:56.087221+0000","last_undegraded":"2023-03-03T06:25:56.087221+0000","last_fullsized":"2023-03-03T06:25:56.087221+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001551871,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495751+0000","last_change":"2023-03-03T06:25:56.107191+0000","last_active":"2023-03-03T06:25:57.495751+0000","last_peered":"2023-03-03T06:25:57.495751+0000","last_clean":"2023-03-03T06:25:57.495751+0000","last_became_active":"2023-03-03T06:25:56.106888+0000","last_became_peered":"2023-03-03T06:25:56.106888+0000","last_unstale":"2023-03-03T06:25:57.495751+0000","last_undegraded":"2023-03-03T06:25:57.495751+0000","last_fullsized":"2023-03-03T06:25:57.495751+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:20:38.452147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494685+0000","last_change":"2023-03-03T06:25:55.674595+0000","last_active":"2023-03-03T06:25:57.494685+0000","last_peered":"2023-03-03T06:25:57.494685+0000","last_clean":"2023-03-03T06:25:57.494685+0000","last_became_active":"2023-03-03T06:25:55.674276+0000","last_became_peered":"2023-03-03T06:25:55.674276+0000","last_unstale":"2023-03-03T06:25:57.494685+0000","last_undegraded":"2023-03-03T06:25:57.494685+0000","last_fullsized":"2023-03-03T06:25:57.494685+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:14:26.183601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.080590+0000","last_change":"2023-03-03T06:25:05.796890+0000","last_active":"2023-03-03T06:25:56.080590+0000","last_peered":"2023-03-03T06:25:56.080590+0000","last_clean":"2023-03-03T06:25:56.080590+0000","last_became_active":"2023-03-03T06:25:04.437104+0000","last_became_peered":"2023-03-03T06:25:04.437104+0000","last_unstale":"2023-03-03T06:25:56.080590+0000","last_undegraded":"2023-03-03T06:25:56.080590+0000","last_fullsized":"2023-03-03T06:25:56.080590+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:10:21.043057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027269099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495625+0000","last_change":"2023-03-03T06:25:56.106615+0000","last_active":"2023-03-03T06:25:57.495625+0000","last_peered":"2023-03-03T06:25:57.495625+0000","last_clean":"2023-03-03T06:25:57.495625+0000","last_became_active":"2023-03-03T06:25:56.106329+0000","last_became_peered":"2023-03-03T06:25:56.106329+0000","last_unstale":"2023-03-03T06:25:57.495625+0000","last_undegraded":"2023-03-03T06:25:57.495625+0000","last_fullsized":"2023-03-03T06:25:57.495625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:51:52.135207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082549+0000","last_change":"2023-03-03T06:25:55.664299+0000","last_active":"2023-03-03T06:25:57.082549+0000","last_peered":"2023-03-03T06:25:57.082549+0000","last_clean":"2023-03-03T06:25:57.082549+0000","last_became_active":"2023-03-03T06:25:55.663980+0000","last_became_peered":"2023-03-03T06:25:55.663980+0000","last_unstale":"2023-03-03T06:25:57.082549+0000","last_undegraded":"2023-03-03T06:25:57.082549+0000","last_fullsized":"2023-03-03T06:25:57.082549+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:18:06.584599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.090614+0000","last_change":"2023-03-03T06:25:05.429793+0000","last_active":"2023-03-03T06:25:56.090614+0000","last_peered":"2023-03-03T06:25:56.090614+0000","last_clean":"2023-03-03T06:25:56.090614+0000","last_became_active":"2023-03-03T06:25:04.436400+0000","last_became_peered":"2023-03-03T06:25:04.436400+0000","last_unstale":"2023-03-03T06:25:56.090614+0000","last_undegraded":"2023-03-03T06:25:56.090614+0000","last_fullsized":"2023-03-03T06:25:56.090614+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038039399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.082651+0000","last_change":"2023-03-03T06:25:56.100449+0000","last_active":"2023-03-03T06:25:57.082651+0000","last_peered":"2023-03-03T06:25:57.082651+0000","last_clean":"2023-03-03T06:25:57.082651+0000","last_became_active":"2023-03-03T06:25:56.100084+0000","last_became_peered":"2023-03-03T06:25:56.100084+0000","last_unstale":"2023-03-03T06:25:57.082651+0000","last_undegraded":"2023-03-03T06:25:57.082651+0000","last_fullsized":"2023-03-03T06:25:57.082651+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:59:31.195287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496927+0000","last_change":"2023-03-03T06:25:55.679196+0000","last_active":"2023-03-03T06:25:57.496927+0000","last_peered":"2023-03-03T06:25:57.496927+0000","last_clean":"2023-03-03T06:25:57.496927+0000","last_became_active":"2023-03-03T06:25:55.678807+0000","last_became_peered":"2023-03-03T06:25:55.678807+0000","last_unstale":"2023-03-03T06:25:57.496927+0000","last_undegraded":"2023-03-03T06:25:57.496927+0000","last_fullsized":"2023-03-03T06:25:57.496927+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:13:43.323432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":35,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.094821+0000","last_change":"2023-03-03T06:25:05.797098+0000","last_active":"2023-03-03T06:25:56.094821+0000","last_peered":"2023-03-03T06:25:56.094821+0000","last_clean":"2023-03-03T06:25:56.094821+0000","last_became_active":"2023-03-03T06:25:04.446290+0000","last_became_peered":"2023-03-03T06:25:04.446290+0000","last_unstale":"2023-03-03T06:25:56.094821+0000","last_undegraded":"2023-03-03T06:25:56.094821+0000","last_fullsized":"2023-03-03T06:25:56.094821+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:23:37.795335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050239399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080023+0000","last_change":"2023-03-03T06:25:56.097458+0000","last_active":"2023-03-03T06:25:57.080023+0000","last_peered":"2023-03-03T06:25:57.080023+0000","last_clean":"2023-03-03T06:25:57.080023+0000","last_became_active":"2023-03-03T06:25:56.097168+0000","last_became_peered":"2023-03-03T06:25:56.097168+0000","last_unstale":"2023-03-03T06:25:57.080023+0000","last_undegraded":"2023-03-03T06:25:57.080023+0000","last_fullsized":"2023-03-03T06:25:57.080023+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:42:58.683886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"67'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.494884+0000","last_change":"2023-03-03T06:25:55.677103+0000","last_active":"2023-03-03T06:25:57.494884+0000","last_peered":"2023-03-03T06:25:57.494884+0000","last_clean":"2023-03-03T06:25:57.494884+0000","last_became_active":"2023-03-03T06:25:55.676800+0000","last_became_peered":"2023-03-03T06:25:55.676800+0000","last_unstale":"2023-03-03T06:25:57.494884+0000","last_undegraded":"2023-03-03T06:25:57.494884+0000","last_fullsized":"2023-03-03T06:25:57.494884+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:29.938169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.079271+0000","last_change":"2023-03-03T06:25:05.636038+0000","last_active":"2023-03-03T06:25:56.079271+0000","last_peered":"2023-03-03T06:25:56.079271+0000","last_clean":"2023-03-03T06:25:56.079271+0000","last_became_active":"2023-03-03T06:25:04.433771+0000","last_became_peered":"2023-03-03T06:25:04.433771+0000","last_unstale":"2023-03-03T06:25:56.079271+0000","last_undegraded":"2023-03-03T06:25:56.079271+0000","last_fullsized":"2023-03-03T06:25:56.079271+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:33:58.284544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079784699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495860+0000","last_change":"2023-03-03T06:25:56.104660+0000","last_active":"2023-03-03T06:25:57.495860+0000","last_peered":"2023-03-03T06:25:57.495860+0000","last_clean":"2023-03-03T06:25:57.495860+0000","last_became_active":"2023-03-03T06:25:56.104377+0000","last_became_peered":"2023-03-03T06:25:56.104377+0000","last_unstale":"2023-03-03T06:25:57.495860+0000","last_undegraded":"2023-03-03T06:25:57.495860+0000","last_fullsized":"2023-03-03T06:25:57.495860+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:16:11.562031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203118+0000","last_change":"2023-03-03T06:25:55.678062+0000","last_active":"2023-03-03T06:25:57.203118+0000","last_peered":"2023-03-03T06:25:57.203118+0000","last_clean":"2023-03-03T06:25:57.203118+0000","last_became_active":"2023-03-03T06:25:55.677794+0000","last_became_peered":"2023-03-03T06:25:55.677794+0000","last_unstale":"2023-03-03T06:25:57.203118+0000","last_undegraded":"2023-03-03T06:25:57.203118+0000","last_fullsized":"2023-03-03T06:25:57.203118+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:31:27.436973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.081352+0000","last_change":"2023-03-03T06:25:05.797366+0000","last_active":"2023-03-03T06:25:56.081352+0000","last_peered":"2023-03-03T06:25:56.081352+0000","last_clean":"2023-03-03T06:25:56.081352+0000","last_became_active":"2023-03-03T06:25:04.439424+0000","last_became_peered":"2023-03-03T06:25:04.439424+0000","last_unstale":"2023-03-03T06:25:56.081352+0000","last_undegraded":"2023-03-03T06:25:56.081352+0000","last_fullsized":"2023-03-03T06:25:56.081352+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:12.599265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020575500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080449+0000","last_change":"2023-03-03T06:25:56.097268+0000","last_active":"2023-03-03T06:25:57.080449+0000","last_peered":"2023-03-03T06:25:57.080449+0000","last_clean":"2023-03-03T06:25:57.080449+0000","last_became_active":"2023-03-03T06:25:56.096845+0000","last_became_peered":"2023-03-03T06:25:56.096845+0000","last_unstale":"2023-03-03T06:25:57.080449+0000","last_undegraded":"2023-03-03T06:25:57.080449+0000","last_fullsized":"2023-03-03T06:25:57.080449+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:25:58.703587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203254+0000","last_change":"2023-03-03T06:25:55.672756+0000","last_active":"2023-03-03T06:25:57.203254+0000","last_peered":"2023-03-03T06:25:57.203254+0000","last_clean":"2023-03-03T06:25:57.203254+0000","last_became_active":"2023-03-03T06:25:55.672422+0000","last_became_peered":"2023-03-03T06:25:55.672422+0000","last_unstale":"2023-03-03T06:25:57.203254+0000","last_undegraded":"2023-03-03T06:25:57.203254+0000","last_fullsized":"2023-03-03T06:25:57.203254+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:14:13.671591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.094042+0000","last_change":"2023-03-03T06:25:05.431441+0000","last_active":"2023-03-03T06:25:56.094042+0000","last_peered":"2023-03-03T06:25:56.094042+0000","last_clean":"2023-03-03T06:25:56.094042+0000","last_became_active":"2023-03-03T06:25:04.443840+0000","last_became_peered":"2023-03-03T06:25:04.443840+0000","last_unstale":"2023-03-03T06:25:56.094042+0000","last_undegraded":"2023-03-03T06:25:56.094042+0000","last_fullsized":"2023-03-03T06:25:56.094042+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017814980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495247+0000","last_change":"2023-03-03T06:25:56.093414+0000","last_active":"2023-03-03T06:25:57.495247+0000","last_peered":"2023-03-03T06:25:57.495247+0000","last_clean":"2023-03-03T06:25:57.495247+0000","last_became_active":"2023-03-03T06:25:56.093165+0000","last_became_peered":"2023-03-03T06:25:56.093165+0000","last_unstale":"2023-03-03T06:25:57.495247+0000","last_undegraded":"2023-03-03T06:25:57.495247+0000","last_fullsized":"2023-03-03T06:25:57.495247+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:27.345875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"67'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203527+0000","last_change":"2023-03-03T06:25:55.676939+0000","last_active":"2023-03-03T06:25:57.203527+0000","last_peered":"2023-03-03T06:25:57.203527+0000","last_clean":"2023-03-03T06:25:57.203527+0000","last_became_active":"2023-03-03T06:25:55.676631+0000","last_became_peered":"2023-03-03T06:25:55.676631+0000","last_unstale":"2023-03-03T06:25:57.203527+0000","last_undegraded":"2023-03-03T06:25:57.203527+0000","last_fullsized":"2023-03-03T06:25:57.203527+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:25:53.175485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.092236+0000","last_change":"2023-03-03T06:25:05.431854+0000","last_active":"2023-03-03T06:25:56.092236+0000","last_peered":"2023-03-03T06:25:56.092236+0000","last_clean":"2023-03-03T06:25:56.092236+0000","last_became_active":"2023-03-03T06:25:04.438570+0000","last_became_peered":"2023-03-03T06:25:04.438570+0000","last_unstale":"2023-03-03T06:25:56.092236+0000","last_undegraded":"2023-03-03T06:25:56.092236+0000","last_fullsized":"2023-03-03T06:25:56.092236+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.084716+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:25:56.084716+0000","last_peered":"2023-03-03T06:25:56.084716+0000","last_clean":"2023-03-03T06:25:56.084716+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:25:56.084716+0000","last_undegraded":"2023-03-03T06:25:56.084716+0000","last_fullsized":"2023-03-03T06:25:56.084716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.078818+0000","last_change":"2023-03-03T06:25:56.106706+0000","last_active":"2023-03-03T06:25:57.078818+0000","last_peered":"2023-03-03T06:25:57.078818+0000","last_clean":"2023-03-03T06:25:57.078818+0000","last_became_active":"2023-03-03T06:25:56.106438+0000","last_became_peered":"2023-03-03T06:25:56.106438+0000","last_unstale":"2023-03-03T06:25:57.078818+0000","last_undegraded":"2023-03-03T06:25:57.078818+0000","last_fullsized":"2023-03-03T06:25:57.078818+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:41:04.088891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"67'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.080628+0000","last_change":"2023-03-03T06:25:55.676180+0000","last_active":"2023-03-03T06:25:57.080628+0000","last_peered":"2023-03-03T06:25:57.080628+0000","last_clean":"2023-03-03T06:25:57.080628+0000","last_became_active":"2023-03-03T06:25:55.675982+0000","last_became_peered":"2023-03-03T06:25:55.675982+0000","last_unstale":"2023-03-03T06:25:57.080628+0000","last_undegraded":"2023-03-03T06:25:57.080628+0000","last_fullsized":"2023-03-03T06:25:57.080628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:52:18.007639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.078802+0000","last_change":"2023-03-03T06:25:05.636335+0000","last_active":"2023-03-03T06:25:56.078802+0000","last_peered":"2023-03-03T06:25:56.078802+0000","last_clean":"2023-03-03T06:25:56.078802+0000","last_became_active":"2023-03-03T06:25:04.443299+0000","last_became_peered":"2023-03-03T06:25:04.443299+0000","last_unstale":"2023-03-03T06:25:56.078802+0000","last_undegraded":"2023-03-03T06:25:56.078802+0000","last_fullsized":"2023-03-03T06:25:56.078802+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:13:38.046974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090290399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":59,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.089058+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:25:56.089058+0000","last_peered":"2023-03-03T06:25:56.089058+0000","last_clean":"2023-03-03T06:25:56.089058+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:25:56.089058+0000","last_undegraded":"2023-03-03T06:25:56.089058+0000","last_fullsized":"2023-03-03T06:25:56.089058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496878+0000","last_change":"2023-03-03T06:25:56.099670+0000","last_active":"2023-03-03T06:25:57.496878+0000","last_peered":"2023-03-03T06:25:57.496878+0000","last_clean":"2023-03-03T06:25:57.496878+0000","last_became_active":"2023-03-03T06:25:56.097776+0000","last_became_peered":"2023-03-03T06:25:56.097776+0000","last_unstale":"2023-03-03T06:25:57.496878+0000","last_undegraded":"2023-03-03T06:25:57.496878+0000","last_fullsized":"2023-03-03T06:25:57.496878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:16:39.291453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496289+0000","last_change":"2023-03-03T06:25:55.670679+0000","last_active":"2023-03-03T06:25:57.496289+0000","last_peered":"2023-03-03T06:25:57.496289+0000","last_clean":"2023-03-03T06:25:57.496289+0000","last_became_active":"2023-03-03T06:25:55.670397+0000","last_became_peered":"2023-03-03T06:25:55.670397+0000","last_unstale":"2023-03-03T06:25:57.496289+0000","last_undegraded":"2023-03-03T06:25:57.496289+0000","last_fullsized":"2023-03-03T06:25:57.496289+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:47.422230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.079654+0000","last_change":"2023-03-03T06:25:05.796271+0000","last_active":"2023-03-03T06:25:56.079654+0000","last_peered":"2023-03-03T06:25:56.079654+0000","last_clean":"2023-03-03T06:25:56.079654+0000","last_became_active":"2023-03-03T06:25:04.595414+0000","last_became_peered":"2023-03-03T06:25:04.595414+0000","last_unstale":"2023-03-03T06:25:56.079654+0000","last_undegraded":"2023-03-03T06:25:56.079654+0000","last_fullsized":"2023-03-03T06:25:56.079654+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:07:03.140630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027036600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":54,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.080662+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:25:56.080662+0000","last_peered":"2023-03-03T06:25:56.080662+0000","last_clean":"2023-03-03T06:25:56.080662+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:25:56.080662+0000","last_undegraded":"2023-03-03T06:25:56.080662+0000","last_fullsized":"2023-03-03T06:25:56.080662+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":202,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.093350+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:25:56.093350+0000","last_peered":"2023-03-03T06:25:56.093350+0000","last_clean":"2023-03-03T06:25:56.093350+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:25:56.093350+0000","last_undegraded":"2023-03-03T06:25:56.093350+0000","last_fullsized":"2023-03-03T06:25:56.093350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.083035+0000","last_change":"2023-03-03T06:25:56.101341+0000","last_active":"2023-03-03T06:25:57.083035+0000","last_peered":"2023-03-03T06:25:57.083035+0000","last_clean":"2023-03-03T06:25:57.083035+0000","last_became_active":"2023-03-03T06:25:56.101052+0000","last_became_peered":"2023-03-03T06:25:56.101052+0000","last_unstale":"2023-03-03T06:25:57.083035+0000","last_undegraded":"2023-03-03T06:25:57.083035+0000","last_fullsized":"2023-03-03T06:25:57.083035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:31:03.940981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495186+0000","last_change":"2023-03-03T06:25:55.670469+0000","last_active":"2023-03-03T06:25:57.495186+0000","last_peered":"2023-03-03T06:25:57.495186+0000","last_clean":"2023-03-03T06:25:57.495186+0000","last_became_active":"2023-03-03T06:25:55.670156+0000","last_became_peered":"2023-03-03T06:25:55.670156+0000","last_unstale":"2023-03-03T06:25:57.495186+0000","last_undegraded":"2023-03-03T06:25:57.495186+0000","last_fullsized":"2023-03-03T06:25:57.495186+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:44:52.604474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":38,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.089256+0000","last_change":"2023-03-03T06:25:05.431373+0000","last_active":"2023-03-03T06:25:56.089256+0000","last_peered":"2023-03-03T06:25:56.089256+0000","last_clean":"2023-03-03T06:25:56.089256+0000","last_became_active":"2023-03-03T06:25:04.445948+0000","last_became_peered":"2023-03-03T06:25:04.445948+0000","last_unstale":"2023-03-03T06:25:56.089256+0000","last_undegraded":"2023-03-03T06:25:56.089256+0000","last_fullsized":"2023-03-03T06:25:56.089256+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001717028,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.088125+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:25:56.088125+0000","last_peered":"2023-03-03T06:25:56.088125+0000","last_clean":"2023-03-03T06:25:56.088125+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:25:56.088125+0000","last_undegraded":"2023-03-03T06:25:56.088125+0000","last_fullsized":"2023-03-03T06:25:56.088125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.203293+0000","last_change":"2023-03-03T06:25:56.098087+0000","last_active":"2023-03-03T06:25:57.203293+0000","last_peered":"2023-03-03T06:25:57.203293+0000","last_clean":"2023-03-03T06:25:57.203293+0000","last_became_active":"2023-03-03T06:25:56.097655+0000","last_became_peered":"2023-03-03T06:25:56.097655+0000","last_unstale":"2023-03-03T06:25:57.203293+0000","last_undegraded":"2023-03-03T06:25:57.203293+0000","last_fullsized":"2023-03-03T06:25:57.203293+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:30.940024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496379+0000","last_change":"2023-03-03T06:25:55.675032+0000","last_active":"2023-03-03T06:25:57.496379+0000","last_peered":"2023-03-03T06:25:57.496379+0000","last_clean":"2023-03-03T06:25:57.496379+0000","last_became_active":"2023-03-03T06:25:55.673914+0000","last_became_peered":"2023-03-03T06:25:55.673914+0000","last_unstale":"2023-03-03T06:25:57.496379+0000","last_undegraded":"2023-03-03T06:25:57.496379+0000","last_fullsized":"2023-03-03T06:25:57.496379+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:30:49.557933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":35,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.092715+0000","last_change":"2023-03-03T06:25:05.796597+0000","last_active":"2023-03-03T06:25:56.092715+0000","last_peered":"2023-03-03T06:25:56.092715+0000","last_clean":"2023-03-03T06:25:56.092715+0000","last_became_active":"2023-03-03T06:25:04.442672+0000","last_became_peered":"2023-03-03T06:25:04.442672+0000","last_unstale":"2023-03-03T06:25:56.092715+0000","last_undegraded":"2023-03-03T06:25:56.092715+0000","last_fullsized":"2023-03-03T06:25:56.092715+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.033310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000479903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.093435+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:25:56.093435+0000","last_peered":"2023-03-03T06:25:56.093435+0000","last_clean":"2023-03-03T06:25:56.093435+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:25:56.093435+0000","last_undegraded":"2023-03-03T06:25:56.093435+0000","last_fullsized":"2023-03-03T06:25:56.093435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495485+0000","last_change":"2023-03-03T06:25:56.100030+0000","last_active":"2023-03-03T06:25:57.495485+0000","last_peered":"2023-03-03T06:25:57.495485+0000","last_clean":"2023-03-03T06:25:57.495485+0000","last_became_active":"2023-03-03T06:25:56.098649+0000","last_became_peered":"2023-03-03T06:25:56.098649+0000","last_unstale":"2023-03-03T06:25:57.495485+0000","last_undegraded":"2023-03-03T06:25:57.495485+0000","last_fullsized":"2023-03-03T06:25:57.495485+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:27.345875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"67'2","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496487+0000","last_change":"2023-03-03T06:25:55.676505+0000","last_active":"2023-03-03T06:25:57.496487+0000","last_peered":"2023-03-03T06:25:57.496487+0000","last_clean":"2023-03-03T06:25:57.496487+0000","last_became_active":"2023-03-03T06:25:55.676135+0000","last_became_peered":"2023-03-03T06:25:55.676135+0000","last_unstale":"2023-03-03T06:25:57.496487+0000","last_undegraded":"2023-03-03T06:25:57.496487+0000","last_fullsized":"2023-03-03T06:25:57.496487+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:42:57.682030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.078421+0000","last_change":"2023-03-03T06:25:05.636259+0000","last_active":"2023-03-03T06:25:56.078421+0000","last_peered":"2023-03-03T06:25:56.078421+0000","last_clean":"2023-03-03T06:25:56.078421+0000","last_became_active":"2023-03-03T06:25:04.438244+0000","last_became_peered":"2023-03-03T06:25:04.438244+0000","last_unstale":"2023-03-03T06:25:56.078421+0000","last_undegraded":"2023-03-03T06:25:56.078421+0000","last_fullsized":"2023-03-03T06:25:56.078421+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:36.640289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001044636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":57,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.078423+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:25:56.078423+0000","last_peered":"2023-03-03T06:25:56.078423+0000","last_clean":"2023-03-03T06:25:56.078423+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:25:56.078423+0000","last_undegraded":"2023-03-03T06:25:56.078423+0000","last_fullsized":"2023-03-03T06:25:56.078423+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.496407+0000","last_change":"2023-03-03T06:25:56.093749+0000","last_active":"2023-03-03T06:25:57.496407+0000","last_peered":"2023-03-03T06:25:57.496407+0000","last_clean":"2023-03-03T06:25:57.496407+0000","last_became_active":"2023-03-03T06:25:56.093067+0000","last_became_peered":"2023-03-03T06:25:56.093067+0000","last_unstale":"2023-03-03T06:25:57.496407+0000","last_undegraded":"2023-03-03T06:25:57.496407+0000","last_fullsized":"2023-03-03T06:25:57.496407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:40:15.714529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.495472+0000","last_change":"2023-03-03T06:25:55.666614+0000","last_active":"2023-03-03T06:25:57.495472+0000","last_peered":"2023-03-03T06:25:57.495472+0000","last_clean":"2023-03-03T06:25:57.495472+0000","last_became_active":"2023-03-03T06:25:55.666305+0000","last_became_peered":"2023-03-03T06:25:55.666305+0000","last_unstale":"2023-03-03T06:25:57.495472+0000","last_undegraded":"2023-03-03T06:25:57.495472+0000","last_fullsized":"2023-03-03T06:25:57.495472+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:01:20.131181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":38,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.092375+0000","last_change":"2023-03-03T06:25:05.432050+0000","last_active":"2023-03-03T06:25:56.092375+0000","last_peered":"2023-03-03T06:25:56.092375+0000","last_clean":"2023-03-03T06:25:56.092375+0000","last_became_active":"2023-03-03T06:25:04.595433+0000","last_became_peered":"2023-03-03T06:25:04.595433+0000","last_unstale":"2023-03-03T06:25:56.092375+0000","last_undegraded":"2023-03-03T06:25:56.092375+0000","last_fullsized":"2023-03-03T06:25:56.092375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016573409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.089725+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:25:56.089725+0000","last_peered":"2023-03-03T06:25:56.089725+0000","last_clean":"2023-03-03T06:25:56.089725+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:25:56.089725+0000","last_undegraded":"2023-03-03T06:25:56.089725+0000","last_fullsized":"2023-03-03T06:25:56.089725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079010+0000","last_change":"2023-03-03T06:25:56.098552+0000","last_active":"2023-03-03T06:25:57.079010+0000","last_peered":"2023-03-03T06:25:57.079010+0000","last_clean":"2023-03-03T06:25:57.079010+0000","last_became_active":"2023-03-03T06:25:56.098294+0000","last_became_peered":"2023-03-03T06:25:56.098294+0000","last_unstale":"2023-03-03T06:25:57.079010+0000","last_undegraded":"2023-03-03T06:25:57.079010+0000","last_fullsized":"2023-03-03T06:25:57.079010+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:55.649293+0000","last_clean_scrub_stamp":"2023-03-03T06:25:55.649293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:11:27.945471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"67'1","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-03-03T06:25:57.079289+0000","last_change":"2023-03-03T06:25:55.666353+0000","last_active":"2023-03-03T06:25:57.079289+0000","last_peered":"2023-03-03T06:25:57.079289+0000","last_clean":"2023-03-03T06:25:57.079289+0000","last_became_active":"2023-03-03T06:25:55.666024+0000","last_became_peered":"2023-03-03T06:25:55.666024+0000","last_unstale":"2023-03-03T06:25:57.079289+0000","last_undegraded":"2023-03-03T06:25:57.079289+0000","last_fullsized":"2023-03-03T06:25:57.079289+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:54.647438+0000","last_clean_scrub_stamp":"2023-03-03T06:25:54.647438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:00:42.974313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":34,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.094123+0000","last_change":"2023-03-03T06:25:05.431790+0000","last_active":"2023-03-03T06:25:56.094123+0000","last_peered":"2023-03-03T06:25:56.094123+0000","last_clean":"2023-03-03T06:25:56.094123+0000","last_became_active":"2023-03-03T06:25:04.595837+0000","last_became_peered":"2023-03-03T06:25:04.595837+0000","last_unstale":"2023-03-03T06:25:56.094123+0000","last_undegraded":"2023-03-03T06:25:56.094123+0000","last_fullsized":"2023-03-03T06:25:56.094123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:08:49.614056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019659870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":53,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-03-03T06:25:56.090031+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:25:56.090031+0000","last_peered":"2023-03-03T06:25:56.090031+0000","last_clean":"2023-03-03T06:25:56.090031+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:25:56.090031+0000","last_undegraded":"2023-03-03T06:25:56.090031+0000","last_fullsized":"2023-03-03T06:25:56.090031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10792,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":9408,"kb_avail":94361048,"statfs":{"total":96636764160,"available":96625713152,"internally_reserved":0,"allocated":1409024,"data_stored":982027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9633792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71099999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.61799999999999999}]},{"osd":1,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.64900000000000002,"5min":0.745,"15min":0.745},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70399999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68200000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72799999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.63800000000000001}]},{"osd":4,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63400000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70699999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70899999999999996,"5min":0.746,"15min":0.746},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.38500000000000001}]},{"osd":6,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71299999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85399999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.46899999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9580,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362260,"statfs":{"total":96636764160,"available":96626954240,"internally_reserved":0,"allocated":823296,"data_stored":393185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76700000000000002,"5min":2.278,"15min":2.278},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":3.109,"5min":3.109,"15min":3.109},"last":0.57999999999999996}]},{"osd":1,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.70999999999999996,"5min":0.751,"15min":0.751},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.622}]},{"osd":3,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.74399999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.47299999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.623,"15min":0.625},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83299999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.59199999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10732,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361108,"statfs":{"total":96636764160,"available":96625774592,"internally_reserved":0,"allocated":1413120,"data_stored":982117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35199999999999998,"15min":0.35299999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52000000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.193},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.34799999999999998,"15min":0.34499999999999997},"min":{"1min":0.28199999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.47299999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.33300000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.314,"15min":0.312},"min":{"1min":0.25600000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.372,"15min":0.37},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.253}]},{"osd":3,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.27100000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48799999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.372,"15min":0.375},"min":{"1min":0.23999999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.502,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.28399999999999997}]},{"osd":4,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.41999999999999998}]},{"osd":5,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80800000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.31}]},{"osd":6,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.443,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.49099999999999999}]},{"osd":7,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.503,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82299999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9692,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362148,"statfs":{"total":96636764160,"available":96626839552,"internally_reserved":0,"allocated":806912,"data_stored":390676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.41199999999999998,"15min":0.42799999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.50700000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.252},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52000000000000002,"5min":1.827,"15min":1.827},"last":0.40799999999999997}]},{"osd":2,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.41999999999999998,"15min":0.432},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65600000000000003,"5min":1.722,"15min":1.722},"last":0.308},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.44700000000000001,"15min":0.46100000000000002},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61799999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.38400000000000001}]},{"osd":3,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.47499999999999998,"15min":0.49199999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.58799999999999997,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.1870000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.434,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84699999999999998,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.53400000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.45700000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92000000000000004,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.502},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86799999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82199999999999995,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.67600000000000005,"15min":0.68999999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81100000000000005,"5min":1.835,"15min":1.835},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.66400000000000003,"15min":0.67600000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88400000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.746,"5min":1.732,"15min":1.732},"last":0.45900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9464,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362376,"statfs":{"total":96636764160,"available":96627073024,"internally_reserved":0,"allocated":835584,"data_stored":399689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33100000000000002},"min":{"1min":0.23899999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.28299999999999997}]},{"osd":1,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.70599999999999996,"15min":0.75},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.238,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.313}]},{"osd":3,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.52100000000000002,"15min":0.46400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":8.6039999999999992,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.76300000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1240000000000001,"5min":1.224,"15min":1.224},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.69699999999999995},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4359999999999999,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1479999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73399999999999999,"15min":0.72999999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.597,"5min":1.968,"15min":1.968},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.72699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2430000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.66600000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.78000000000000003,"15min":0.79500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1910000000000001,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.198,"5min":1.387,"15min":1.387},"last":0.75900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9700,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362140,"statfs":{"total":96636764160,"available":96626831360,"internally_reserved":0,"allocated":815104,"data_stored":392203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.38400000000000001,"15min":0.39400000000000002},"min":{"1min":0.24099999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.502,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52300000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.379}]},{"osd":1,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.37,"15min":0.379},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.47799999999999998,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.43099999999999999,"15min":0.436},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.624,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.32700000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.64700000000000002,"5min":1.3,"15min":1.3},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.441,"15min":0.44900000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66500000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.41999999999999998}]},{"osd":4,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.44600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90500000000000003,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.48699999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.628},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0029999999999999,"5min":1.383,"15min":1.383},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95999999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":5.2640000000000002,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":1.587,"15min":1.587},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.69699999999999995,"15min":0.67500000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":5.2510000000000003,"5min":5.2510000000000003,"15min":5.2510000000000003},"last":0.63600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9844,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361996,"statfs":{"total":96636764160,"available":96626683904,"internally_reserved":0,"allocated":831488,"data_stored":393289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.349,"5min":0.67800000000000005,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":14.449999999999999,"5min":14.449999999999999,"15min":14.449999999999999},"last":0.69099999999999995}]},{"osd":1,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":0.64700000000000002,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.686,"5min":10.686,"15min":10.686},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.53600000000000003,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":3.9060000000000001,"5min":3.9060000000000001,"15min":3.9060000000000001},"last":0.71099999999999997}]},{"osd":2,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.42499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65800000000000003,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.61799999999999999,"15min":0.58299999999999996},"min":{"1min":0.48199999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":4.6379999999999999,"5min":4.6379999999999999,"15min":4.6379999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.44800000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.65900000000000003,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.7389999999999999,"5min":6.7389999999999999,"15min":6.7389999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.57599999999999996,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.5910000000000002,"5min":4.5910000000000002,"15min":4.5910000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38600000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.47899999999999998}]},{"osd":6,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.64900000000000002,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":4.6749999999999998,"5min":4.6749999999999998,"15min":4.6749999999999998},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.66700000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.49299999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.54200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9568,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362272,"statfs":{"total":96636764160,"available":96626966528,"internally_reserved":0,"allocated":811008,"data_stored":390710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.626}]},{"osd":2,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76000000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76900000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.78500000000000003,"5min":0.88,"15min":0.88},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67500000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.746},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82599999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.72799999999999998,"5min":0.747,"15min":0.747},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.64300000000000002,"15min":0.65100000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:26:00.607 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-03T06:26:00.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-03-03T06:26:00.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.769+0000 7fd50b763700 1 Processor -- start 2023-03-03T06:26:00.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.769+0000 7fd50b763700 1 -- start start 2023-03-03T06:26:00.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd50b763700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd5040af110 0x7fd5040cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd50b763700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5040b2250 0x7fd5040cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd50b763700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5040cb810 con 0x7fd5040cb3b0 2023-03-03T06:26:00.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd50b763700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5040cd990 con 0x7fd5040b2250 2023-03-03T06:26:00.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd50b763700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5040cdf50 con 0x7fd5040af110 2023-03-03T06:26:00.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd508cfe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5040b2250 0x7fd5040cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd508cfe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd5040b2250 0x7fd5040cae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45536/0 (socket says 172.21.15.5:45536) 2023-03-03T06:26:00.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd508cfe700 1 -- 172.21.15.5:0/4145572465 learned_addr learned my addr 172.21.15.5:0/4145572465 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:00.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd5094ff700 1 --2- 172.21.15.5:0/4145572465 >> v2:172.21.15.191:3300/0 conn(0x7fd5040af110 0x7fd5040cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd508cfe700 1 -- 172.21.15.5:0/4145572465 >> v2:172.21.15.191:3300/0 conn(0x7fd5040af110 msgr2=0x7fd5040cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:00.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd508cfe700 1 --2- 172.21.15.5:0/4145572465 >> v2:172.21.15.191:3300/0 conn(0x7fd5040af110 0x7fd5040cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd508cfe700 1 -- 172.21.15.5:0/4145572465 >> v1:172.21.15.191:6789/0 conn(0x7fd5040cb3b0 legacy=0x7fd5040ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:00.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd508cfe700 1 -- 172.21.15.5:0/4145572465 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5040cf690 con 0x7fd5040b2250 2023-03-03T06:26:00.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.770+0000 7fd508cfe700 1 --2- 172.21.15.5:0/4145572465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5040b2250 0x7fd5040cae70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd504071b00 tx=0x7fd500009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66549bebe04045c8 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:00.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.771+0000 7fd4fbfff700 1 -- 172.21.15.5:0/4145572465 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500004230 con 0x7fd5040b2250 2023-03-03T06:26:00.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.771+0000 7fd4fbfff700 1 -- 172.21.15.5:0/4145572465 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd500004390 con 0x7fd5040b2250 2023-03-03T06:26:00.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.771+0000 7fd4fbfff700 1 -- 172.21.15.5:0/4145572465 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5000036a0 con 0x7fd5040b2250 2023-03-03T06:26:00.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.771+0000 7fd50b763700 1 -- 172.21.15.5:0/4145572465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5040b2250 msgr2=0x7fd5040cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:00.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.771+0000 7fd50b763700 1 --2- 172.21.15.5:0/4145572465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5040b2250 0x7fd5040cae70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd504071b00 tx=0x7fd500009bd0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.771+0000 7fd50b763700 1 -- 172.21.15.5:0/4145572465 shutdown_connections 2023-03-03T06:26:00.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.771+0000 7fd50b763700 1 --2- 172.21.15.5:0/4145572465 >> v2:172.21.15.191:3300/0 conn(0x7fd5040af110 0x7fd5040cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.771+0000 7fd50b763700 1 --2- 172.21.15.5:0/4145572465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5040b2250 0x7fd5040cae70 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.771+0000 7fd50b763700 1 -- 172.21.15.5:0/4145572465 >> 172.21.15.5:0/4145572465 conn(0x7fd5040cc840 msgr2=0x7fd5040ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:00.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.771+0000 7fd50b763700 1 -- 172.21.15.5:0/4145572465 shutdown_connections 2023-03-03T06:26:00.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.771+0000 7fd50b763700 1 -- 172.21.15.5:0/4145572465 wait complete. 2023-03-03T06:26:00.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.772+0000 7fd50b763700 1 Processor -- start 2023-03-03T06:26:00.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.773+0000 7fd50b763700 1 -- start start 2023-03-03T06:26:00.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.773+0000 7fd50b763700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5040af110 0x7fd50406bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.773+0000 7fd50b763700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5040b2250 0x7fd5041f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.773+0000 7fd50b763700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5040cb3b0 0x7fd5041f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.773+0000 7fd50b763700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5040b40f0 con 0x7fd5040b2250 2023-03-03T06:26:00.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.773+0000 7fd50b763700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5041f70f0 con 0x7fd5040af110 2023-03-03T06:26:00.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.773+0000 7fd50b763700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5041f6e10 con 0x7fd5040cb3b0 2023-03-03T06:26:00.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.773+0000 7fd508cfe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5040b2250 0x7fd5041f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.773+0000 7fd508cfe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5040b2250 0x7fd5041f62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45542/0 (socket says 172.21.15.5:45542) 2023-03-03T06:26:00.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.773+0000 7fd508cfe700 1 -- 172.21.15.5:0/875891317 learned_addr learned my addr 172.21.15.5:0/875891317 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:00.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd5094ff700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5040af110 0x7fd50406bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd509d00700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5040cb3b0 0x7fd5041f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd508cfe700 1 -- 172.21.15.5:0/875891317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5040cb3b0 msgr2=0x7fd5041f67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:00.780 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd508cfe700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5040cb3b0 0x7fd5041f67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd508cfe700 1 -- 172.21.15.5:0/875891317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5040af110 msgr2=0x7fd50406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:00.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd508cfe700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5040af110 0x7fd50406bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:00.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd508cfe700 1 -- 172.21.15.5:0/875891317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd500009550 con 0x7fd5040b2250 2023-03-03T06:26:00.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd509d00700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5040cb3b0 0x7fd5041f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:00.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd508cfe700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5040b2250 0x7fd5041f62a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd504068620 tx=0x7fd500004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:00.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd4f9ffb700 1 -- 172.21.15.5:0/875891317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500011630 con 0x7fd5040b2250 2023-03-03T06:26:00.781 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd4f9ffb700 1 -- 172.21.15.5:0/875891317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd500011790 con 0x7fd5040b2250 2023-03-03T06:26:00.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd50b763700 1 -- 172.21.15.5:0/875891317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5040cdbe0 con 0x7fd5040b2250 2023-03-03T06:26:00.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd4f9ffb700 1 -- 172.21.15.5:0/875891317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500011b40 con 0x7fd5040b2250 2023-03-03T06:26:00.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.774+0000 7fd50b763700 1 -- 172.21.15.5:0/875891317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50406c850 con 0x7fd5040b2250 2023-03-03T06:26:00.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.775+0000 7fd50b763700 1 -- 172.21.15.5:0/875891317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50406d3d0 con 0x7fd5040b2250 2023-03-03T06:26:00.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.776+0000 7fd4f9ffb700 1 -- 172.21.15.5:0/875891317 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd500017020 con 0x7fd5040b2250 2023-03-03T06:26:00.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.776+0000 7fd4f9ffb700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd4e80682f0 0x7fd4e806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:00.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.776+0000 7fd4f9ffb700 1 -- 172.21.15.5:0/875891317 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd500087470 con 0x7fd5040b2250 2023-03-03T06:26:00.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.776+0000 7fd5094ff700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd4e80682f0 0x7fd4e806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:00.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.777+0000 7fd5094ff700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd4e80682f0 0x7fd4e806a7a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400a950 tx=0x7fd4f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:00.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:00.781+0000 7fd4f9ffb700 1 -- 172.21.15.5:0/875891317 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd500053a30 con 0x7fd5040b2250 2023-03-03T06:26:01.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.053+0000 7fd50b763700 1 -- 172.21.15.5:0/875891317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7fd5041545e0 con 0x7fd5040b2250 2023-03-03T06:26:01.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.056+0000 7fd4f9ffb700 1 -- 172.21.15.5:0/875891317 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd500057050 con 0x7fd5040b2250 2023-03-03T06:26:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.058+0000 7fd50b763700 1 -- 172.21.15.5:0/875891317 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd4e80682f0 msgr2=0x7fd4e806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.058+0000 7fd50b763700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd4e80682f0 0x7fd4e806a7a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400a950 tx=0x7fd4f4008040 comp rx=0 tx=0).stop 2023-03-03T06:26:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.058+0000 7fd50b763700 1 -- 172.21.15.5:0/875891317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5040b2250 msgr2=0x7fd5041f62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.058+0000 7fd50b763700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5040b2250 0x7fd5041f62a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd504068620 tx=0x7fd500004750 comp rx=0 tx=0).stop 2023-03-03T06:26:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.058+0000 7fd50b763700 1 -- 172.21.15.5:0/875891317 shutdown_connections 2023-03-03T06:26:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.058+0000 7fd50b763700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd4e80682f0 0x7fd4e806a7a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.058+0000 7fd50b763700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd5040cb3b0 0x7fd5041f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.061 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.058+0000 7fd50b763700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5040af110 0x7fd50406bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.058+0000 7fd50b763700 1 --2- 172.21.15.5:0/875891317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5040b2250 0x7fd5041f62a0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.058+0000 7fd50b763700 1 -- 172.21.15.5:0/875891317 >> 172.21.15.5:0/875891317 conn(0x7fd5040cc840 msgr2=0x7fd50415f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.058+0000 7fd50b763700 1 -- 172.21.15.5:0/875891317 shutdown_connections 2023-03-03T06:26:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.058+0000 7fd50b763700 1 -- 172.21.15.5:0/875891317 wait complete. 2023-03-03T06:26:01.062 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-03-03T06:26:01.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:26:01.198 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.196+0000 7fea7a831700 1 Processor -- start 2023-03-03T06:26:01.199 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.196+0000 7fea7a831700 1 -- start start 2023-03-03T06:26:01.200 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.197+0000 7fea7a831700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fea740cb710 0x7fea740cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:01.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.197+0000 7fea7a831700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea740cff20 0x7fea740b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:01.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.197+0000 7fea7a831700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea740cbae0 0x7fea740b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:01.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.197+0000 7fea7a831700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea740cd820 con 0x7fea740cbae0 2023-03-03T06:26:01.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.197+0000 7fea7a831700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7415f2a0 con 0x7fea740cb710 2023-03-03T06:26:01.201 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.197+0000 7fea7a831700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea740cf550 con 0x7fea740cff20 2023-03-03T06:26:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.197+0000 7fea78dce700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea740cbae0 0x7fea740b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.197+0000 7fea78dce700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea740cbae0 0x7fea740b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45548/0 (socket says 172.21.15.5:45548) 2023-03-03T06:26:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.197+0000 7fea78dce700 1 -- 172.21.15.5:0/3102902845 learned_addr learned my addr 172.21.15.5:0/3102902845 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea73fff700 1 --2- 172.21.15.5:0/3102902845 >> v2:172.21.15.191:3300/0 conn(0x7fea740cb710 0x7fea740cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea737fe700 1 --2- 172.21.15.5:0/3102902845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea740cff20 0x7fea740b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea78dce700 1 -- 172.21.15.5:0/3102902845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea740cff20 msgr2=0x7fea740b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:01.202 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea78dce700 1 --2- 172.21.15.5:0/3102902845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea740cff20 0x7fea740b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea78dce700 1 -- 172.21.15.5:0/3102902845 >> v2:172.21.15.191:3300/0 conn(0x7fea740cb710 msgr2=0x7fea740cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:01.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea78dce700 1 --2- 172.21.15.5:0/3102902845 >> v2:172.21.15.191:3300/0 conn(0x7fea740cb710 0x7fea740cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea78dce700 1 -- 172.21.15.5:0/3102902845 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7415efc0 con 0x7fea740cbae0 2023-03-03T06:26:01.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea737fe700 1 --2- 172.21.15.5:0/3102902845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea740cff20 0x7fea740b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:01.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea73fff700 1 --2- 172.21.15.5:0/3102902845 >> v2:172.21.15.191:3300/0 conn(0x7fea740cb710 0x7fea740cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:01.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea78dce700 1 --2- 172.21.15.5:0/3102902845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cbae0 0x7fea740b41e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fea74068620 tx=0x7fea6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf2ef320ea21693 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:01.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea72ffd700 1 -- 172.21.15.5:0/3102902845 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c00e070 con 0x7fea740cbae0 2023-03-03T06:26:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea72ffd700 1 -- 172.21.15.5:0/3102902845 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c00b9c0 con 0x7fea740cbae0 2023-03-03T06:26:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea72ffd700 1 -- 172.21.15.5:0/3102902845 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c00bd70 con 0x7fea740cbae0 2023-03-03T06:26:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea7a831700 1 -- 172.21.15.5:0/3102902845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cbae0 msgr2=0x7fea740b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.198+0000 7fea7a831700 1 --2- 172.21.15.5:0/3102902845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cbae0 0x7fea740b41e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fea74068620 tx=0x7fea6c00b330 comp rx=0 tx=0).stop 2023-03-03T06:26:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.199+0000 7fea7a831700 1 -- 172.21.15.5:0/3102902845 shutdown_connections 2023-03-03T06:26:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.199+0000 7fea7a831700 1 --2- 172.21.15.5:0/3102902845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cbae0 0x7fea740b41e0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.199+0000 7fea7a831700 1 --2- 172.21.15.5:0/3102902845 >> v2:172.21.15.191:3300/0 conn(0x7fea740cb710 0x7fea740cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.199+0000 7fea7a831700 1 --2- 172.21.15.5:0/3102902845 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea740cff20 0x7fea740b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.199+0000 7fea7a831700 1 -- 172.21.15.5:0/3102902845 >> 172.21.15.5:0/3102902845 conn(0x7fea74070050 msgr2=0x7fea74070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:01.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.199+0000 7fea7a831700 1 -- 172.21.15.5:0/3102902845 shutdown_connections 2023-03-03T06:26:01.205 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.199+0000 7fea7a831700 1 -- 172.21.15.5:0/3102902845 wait complete. 2023-03-03T06:26:01.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.200+0000 7fea7a831700 1 Processor -- start 2023-03-03T06:26:01.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.200+0000 7fea7a831700 1 -- start start 2023-03-03T06:26:01.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.201+0000 7fea7a831700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea740cb710 0x7fea740c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:01.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.201+0000 7fea7a831700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cbae0 0x7fea740c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:01.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.201+0000 7fea7a831700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea740cff20 0x7fea7415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:01.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.201+0000 7fea7a831700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7415bc80 con 0x7fea740cbae0 2023-03-03T06:26:01.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.201+0000 7fea7a831700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7415bed0 con 0x7fea740cff20 2023-03-03T06:26:01.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.201+0000 7fea7a831700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7415c1b0 con 0x7fea740cb710 2023-03-03T06:26:01.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.201+0000 7fea737fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cbae0 0x7fea740c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:01.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.201+0000 7fea737fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cbae0 0x7fea740c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45556/0 (socket says 172.21.15.5:45556) 2023-03-03T06:26:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.201+0000 7fea737fe700 1 -- 172.21.15.5:0/1340999820 learned_addr learned my addr 172.21.15.5:0/1340999820 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.202+0000 7fea78dce700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea740cff20 0x7fea7415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.202+0000 7fea73fff700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea740cb710 0x7fea740c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:01.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.202+0000 7fea737fe700 1 -- 172.21.15.5:0/1340999820 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea740cb710 msgr2=0x7fea740c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.202+0000 7fea737fe700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea740cb710 0x7fea740c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.202+0000 7fea737fe700 1 -- 172.21.15.5:0/1340999820 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea740cff20 msgr2=0x7fea7415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:01.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.202+0000 7fea737fe700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea740cff20 0x7fea7415cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.202+0000 7fea737fe700 1 -- 172.21.15.5:0/1340999820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c009b30 con 0x7fea740cbae0 2023-03-03T06:26:01.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.202+0000 7fea737fe700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cbae0 0x7fea740c5390 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fea6800c7f0 tx=0x7fea6800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:01.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.202+0000 7fea70ff9700 1 -- 172.21.15.5:0/1340999820 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea68011800 con 0x7fea740cbae0 2023-03-03T06:26:01.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.202+0000 7fea70ff9700 1 -- 172.21.15.5:0/1340999820 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea68011960 con 0x7fea740cbae0 2023-03-03T06:26:01.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.202+0000 7fea7a831700 1 -- 172.21.15.5:0/1340999820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea740cf1e0 con 0x7fea740cbae0 2023-03-03T06:26:01.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.202+0000 7fea70ff9700 1 -- 172.21.15.5:0/1340999820 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea68011d10 con 0x7fea740cbae0 2023-03-03T06:26:01.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.202+0000 7fea7a831700 1 -- 172.21.15.5:0/1340999820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea740cef00 con 0x7fea740cbae0 2023-03-03T06:26:01.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.203+0000 7fea7a831700 1 -- 172.21.15.5:0/1340999820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7415e3b0 con 0x7fea740cbae0 2023-03-03T06:26:01.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.204+0000 7fea70ff9700 1 -- 172.21.15.5:0/1340999820 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fea68021070 con 0x7fea740cbae0 2023-03-03T06:26:01.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.204+0000 7fea70ff9700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea600682f0 0x7fea6006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:01.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.204+0000 7fea70ff9700 1 -- 172.21.15.5:0/1340999820 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fea68085df0 con 0x7fea740cbae0 2023-03-03T06:26:01.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.204+0000 7fea73fff700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea600682f0 0x7fea6006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:01.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.205+0000 7fea73fff700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea600682f0 0x7fea6006a7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fea64006ba0 tx=0x7fea64008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:01.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.208+0000 7fea70ff9700 1 -- 172.21.15.5:0/1340999820 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fea680523b0 con 0x7fea740cbae0 2023-03-03T06:26:01.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.448+0000 7fea7a831700 1 -- 172.21.15.5:0/1340999820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea7404e6e0 con 0x7fea740cbae0 2023-03-03T06:26:01.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.449+0000 7fea70ff9700 1 -- 172.21.15.5:0/1340999820 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4647 (secure 0 0 0) 0x7fea680559d0 con 0x7fea740cbae0 2023-03-03T06:26:01.452 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:01.452 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3446616567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3446616567},{"type":"v1","addr":"172.21.15.5:6836","nonce":3446616567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/430214005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":430214005},{"type":"v1","addr":"172.21.15.5:6837","nonce":430214005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6198,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/3308805305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":3308805305},{"type":"v1","addr":"172.21.15.191:6834","nonce":3308805305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:25:56.073978+0000","modified":"2023-03-03T06:25:59.082181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6201":{"gid":6201,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1046120178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":1046120178},{"type":"v1","addr":"172.21.15.191:6835","nonce":1046120178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-03-03T06:26:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.451+0000 7fea7a831700 1 -- 172.21.15.5:0/1340999820 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea600682f0 msgr2=0x7fea6006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:01.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.451+0000 7fea7a831700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea600682f0 0x7fea6006a7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fea64006ba0 tx=0x7fea64008040 comp rx=0 tx=0).stop 2023-03-03T06:26:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.451+0000 7fea7a831700 1 -- 172.21.15.5:0/1340999820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cbae0 msgr2=0x7fea740c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.451+0000 7fea7a831700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cbae0 0x7fea740c5390 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fea6800c7f0 tx=0x7fea6800cbb0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.451+0000 7fea7a831700 1 -- 172.21.15.5:0/1340999820 shutdown_connections 2023-03-03T06:26:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.451+0000 7fea7a831700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea740cff20 0x7fea7415cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.451+0000 7fea7a831700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea600682f0 0x7fea6006a7a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.451+0000 7fea7a831700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea740cb710 0x7fea740c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.451+0000 7fea7a831700 1 --2- 172.21.15.5:0/1340999820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea740cbae0 0x7fea740c5390 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.451+0000 7fea7a831700 1 -- 172.21.15.5:0/1340999820 >> 172.21.15.5:0/1340999820 conn(0x7fea74070050 msgr2=0x7fea740b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.451+0000 7fea7a831700 1 -- 172.21.15.5:0/1340999820 shutdown_connections 2023-03-03T06:26:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.451+0000 7fea7a831700 1 -- 172.21.15.5:0/1340999820 wait complete. 2023-03-03T06:26:01.455 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-03-03T06:26:01.868 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-03T06:25:56.073978+0000', 'modified': '2023-03-03T06:25:59.082181+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6201}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6201': {'gid': 6201, 'name': 'd', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.191:6835/1046120178', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6833', 'nonce': 1046120178}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 1046120178}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-03T06:26:01.869 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-03T06:26:01.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-03-03T06:26:01.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.995+0000 7fda0f0e4700 1 Processor -- start 2023-03-03T06:26:01.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.995+0000 7fda0f0e4700 1 -- start start 2023-03-03T06:26:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.996+0000 7fda0f0e4700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fda080ca210 0x7fda08160360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.996+0000 7fda0f0e4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda0806dc90 0x7fda080cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.996+0000 7fda0f0e4700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda08161290 con 0x7fda08146100 2023-03-03T06:26:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.996+0000 7fda0f0e4700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda080cd520 con 0x7fda0806dc90 2023-03-03T06:26:02.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.996+0000 7fda0f0e4700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda08160cd0 con 0x7fda080ca210 2023-03-03T06:26:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.996+0000 7fda0d681700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda0806dc90 0x7fda080cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.996+0000 7fda0d681700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fda0806dc90 0x7fda080cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45566/0 (socket says 172.21.15.5:45566) 2023-03-03T06:26:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.996+0000 7fda0d681700 1 -- 172.21.15.5:0/1725101672 learned_addr learned my addr 172.21.15.5:0/1725101672 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.996+0000 7fda0ce80700 1 --2- 172.21.15.5:0/1725101672 >> v2:172.21.15.191:3300/0 conn(0x7fda080ca210 0x7fda08160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.997+0000 7fda0d681700 1 -- 172.21.15.5:0/1725101672 >> v2:172.21.15.191:3300/0 conn(0x7fda080ca210 msgr2=0x7fda08160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.997+0000 7fda0d681700 1 --2- 172.21.15.5:0/1725101672 >> v2:172.21.15.191:3300/0 conn(0x7fda080ca210 0x7fda08160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.001 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.997+0000 7fda0d681700 1 -- 172.21.15.5:0/1725101672 >> v1:172.21.15.191:6789/0 conn(0x7fda08146100 legacy=0x7fda0806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.997+0000 7fda0d681700 1 -- 172.21.15.5:0/1725101672 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda08160fb0 con 0x7fda0806dc90 2023-03-03T06:26:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.997+0000 7fda0ce80700 1 --2- 172.21.15.5:0/1725101672 >> v2:172.21.15.191:3300/0 conn(0x7fda080ca210 0x7fda08160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.997+0000 7fda0d681700 1 --2- 172.21.15.5:0/1725101672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda0806dc90 0x7fda080cd9b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fda08146650 tx=0x7fda0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84db8306bbac959 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.997+0000 7fda077fe700 1 -- 172.21.15.5:0/1725101672 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0000e070 con 0x7fda0806dc90 2023-03-03T06:26:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.997+0000 7fda077fe700 1 -- 172.21.15.5:0/1725101672 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0000b9c0 con 0x7fda0806dc90 2023-03-03T06:26:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.997+0000 7fda077fe700 1 -- 172.21.15.5:0/1725101672 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0000bd70 con 0x7fda0806dc90 2023-03-03T06:26:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.997+0000 7fda0f0e4700 1 -- 172.21.15.5:0/1725101672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda0806dc90 msgr2=0x7fda080cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.998+0000 7fda0f0e4700 1 --2- 172.21.15.5:0/1725101672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda0806dc90 0x7fda080cd9b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fda08146650 tx=0x7fda0000b330 comp rx=0 tx=0).stop 2023-03-03T06:26:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.998+0000 7fda0f0e4700 1 -- 172.21.15.5:0/1725101672 shutdown_connections 2023-03-03T06:26:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.998+0000 7fda0f0e4700 1 --2- 172.21.15.5:0/1725101672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda0806dc90 0x7fda080cd9b0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.998+0000 7fda0f0e4700 1 --2- 172.21.15.5:0/1725101672 >> v2:172.21.15.191:3300/0 conn(0x7fda080ca210 0x7fda08160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.998+0000 7fda0f0e4700 1 -- 172.21.15.5:0/1725101672 >> 172.21.15.5:0/1725101672 conn(0x7fda080cf4b0 msgr2=0x7fda080cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.998+0000 7fda0f0e4700 1 -- 172.21.15.5:0/1725101672 shutdown_connections 2023-03-03T06:26:02.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.998+0000 7fda0f0e4700 1 -- 172.21.15.5:0/1725101672 wait complete. 2023-03-03T06:26:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.999+0000 7fda0f0e4700 1 Processor -- start 2023-03-03T06:26:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:01.999+0000 7fda0f0e4700 1 -- start start 2023-03-03T06:26:02.005 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0f0e4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda0806dc90 0x7fda080c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0f0e4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda080ca210 0x7fda081f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0f0e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda08146100 0x7fda0815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0f0e4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda080b1820 con 0x7fda08146100 2023-03-03T06:26:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0f0e4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda080c54c0 con 0x7fda0806dc90 2023-03-03T06:26:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0f0e4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda080c57a0 con 0x7fda080ca210 2023-03-03T06:26:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0d681700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda08146100 0x7fda0815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.006 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0d681700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda08146100 0x7fda0815b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45572/0 (socket says 172.21.15.5:45572) 2023-03-03T06:26:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0d681700 1 -- 172.21.15.5:0/2388594574 learned_addr learned my addr 172.21.15.5:0/2388594574 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda07fff700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda080ca210 0x7fda081f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0ce80700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda0806dc90 0x7fda080c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0d681700 1 -- 172.21.15.5:0/2388594574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda080ca210 msgr2=0x7fda081f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0d681700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda080ca210 0x7fda081f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0d681700 1 -- 172.21.15.5:0/2388594574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda0806dc90 msgr2=0x7fda080c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0d681700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda0806dc90 0x7fda080c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0d681700 1 -- 172.21.15.5:0/2388594574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda00009b30 con 0x7fda08146100 2023-03-03T06:26:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda0d681700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda08146100 0x7fda0815b000 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fda00012000 tx=0x7fda00004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.000+0000 7fda057fa700 1 -- 172.21.15.5:0/2388594574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda000099b0 con 0x7fda08146100 2023-03-03T06:26:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.001+0000 7fda057fa700 1 -- 172.21.15.5:0/2388594574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda000092e0 con 0x7fda08146100 2023-03-03T06:26:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.001+0000 7fda0f0e4700 1 -- 172.21.15.5:0/2388594574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda080ca5e0 con 0x7fda08146100 2023-03-03T06:26:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.001+0000 7fda057fa700 1 -- 172.21.15.5:0/2388594574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0001b630 con 0x7fda08146100 2023-03-03T06:26:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.001+0000 7fda0f0e4700 1 -- 172.21.15.5:0/2388594574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda080cd1b0 con 0x7fda08146100 2023-03-03T06:26:02.008 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.002+0000 7fda057fa700 1 -- 172.21.15.5:0/2388594574 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fda00021030 con 0x7fda08146100 2023-03-03T06:26:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.003+0000 7fda057fa700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9ec0682f0 0x7fd9ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.003+0000 7fda057fa700 1 -- 172.21.15.5:0/2388594574 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fda000873c0 con 0x7fda08146100 2023-03-03T06:26:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.003+0000 7fda0ce80700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9ec0682f0 0x7fd9ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.009 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.003+0000 7fda0ce80700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9ec0682f0 0x7fd9ec06a7a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009990 tx=0x7fd9fc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:02.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.005+0000 7fda1b26db80 1 Processor -- start 2023-03-03T06:26:02.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.005+0000 7fda1b26db80 1 -- start start 2023-03-03T06:26:02.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.005+0000 7fda1b26db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3279dd70 0x559a3277f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.005+0000 7fda1b26db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 0x559a3279e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.005+0000 7fda1b26db80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a327a9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.005+0000 7fda1b26db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a32668bc0 con 0x559a3277c2e0 2023-03-03T06:26:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.005+0000 7fda1b26db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a326d7350 con 0x559a3279dd70 2023-03-03T06:26:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.005+0000 7fda1b26db80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a326d0880 con 0x559a327a8c20 2023-03-03T06:26:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fda07fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 0x559a3279e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fda07fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 0x559a3279e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45578/0 (socket says 172.21.15.5:45578) 2023-03-03T06:26:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fda07fff700 1 -- 172.21.15.5:0/2049532002 learned_addr learned my addr 172.21.15.5:0/2049532002 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fda0ce80700 1 --2- 172.21.15.5:0/2049532002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3279dd70 0x559a3277f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fda0d681700 1 --2- 172.21.15.5:0/2049532002 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a327a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fda07fff700 1 -- 172.21.15.5:0/2049532002 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 msgr2=0x559a327a9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:02.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fda07fff700 1 --2- 172.21.15.5:0/2049532002 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a327a9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fda07fff700 1 -- 172.21.15.5:0/2049532002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3279dd70 msgr2=0x559a3277f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:02.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fda07fff700 1 --2- 172.21.15.5:0/2049532002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3279dd70 0x559a3277f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fda07fff700 1 -- 172.21.15.5:0/2049532002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a325525e0 con 0x559a3277c2e0 2023-03-03T06:26:02.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fda0ce80700 1 --2- 172.21.15.5:0/2049532002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3279dd70 0x559a3277f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:02.016 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fda07fff700 1 --2- 172.21.15.5:0/2049532002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 0x559a3279e140 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4001650 tx=0x7fd9f4001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32bd1e27714fc12 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fd9f27fc700 1 -- 172.21.15.5:0/2049532002 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f40052e0 con 0x559a3277c2e0 2023-03-03T06:26:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fd9f27fc700 1 -- 172.21.15.5:0/2049532002 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f4005440 con 0x559a3277c2e0 2023-03-03T06:26:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.006+0000 7fd9f27fc700 1 -- 172.21.15.5:0/2049532002 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4006a80 con 0x559a3277c2e0 2023-03-03T06:26:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.007+0000 7fda1b26db80 1 -- 172.21.15.5:0/2049532002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 msgr2=0x559a3279e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.007+0000 7fda1b26db80 1 --2- 172.21.15.5:0/2049532002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 0x559a3279e140 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4001650 tx=0x7fd9f4001960 comp rx=0 tx=0).stop 2023-03-03T06:26:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.007+0000 7fda1b26db80 1 -- 172.21.15.5:0/2049532002 shutdown_connections 2023-03-03T06:26:02.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.007+0000 7fda1b26db80 1 --2- 172.21.15.5:0/2049532002 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a327a9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.007+0000 7fda1b26db80 1 --2- 172.21.15.5:0/2049532002 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3279dd70 0x559a3277f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.007+0000 7fda1b26db80 1 --2- 172.21.15.5:0/2049532002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 0x559a3279e140 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.007+0000 7fda1b26db80 1 -- 172.21.15.5:0/2049532002 >> 172.21.15.5:0/2049532002 conn(0x559a32773720 msgr2=0x559a32778c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.007+0000 7fda1b26db80 1 -- 172.21.15.5:0/2049532002 shutdown_connections 2023-03-03T06:26:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.007+0000 7fda1b26db80 1 -- 172.21.15.5:0/2049532002 wait complete. 2023-03-03T06:26:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.007+0000 7fda1b26db80 1 -- start start 2023-03-03T06:26:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.008+0000 7fda1b26db80 1 Processor -- start 2023-03-03T06:26:02.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda1b26db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3277c2e0 0x559a3279f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda1b26db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 0x559a3278f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda1b26db80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a3277aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda1b26db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a325548d0 con 0x559a3279dd70 2023-03-03T06:26:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda1b26db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a3278fca0 con 0x559a3277c2e0 2023-03-03T06:26:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda1b26db80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a3279e660 con 0x559a327a8c20 2023-03-03T06:26:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda1b26db80 10 client.0 _ll_register_callbacks cb 0x559a3266e630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T06:26:02.019 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda07fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 0x559a3278f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda07fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 0x559a3278f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45584/0 (socket says 172.21.15.5:45584) 2023-03-03T06:26:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda07fff700 1 -- 172.21.15.5:0/3121207546 learned_addr learned my addr 172.21.15.5:0/3121207546 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda0ce80700 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3277c2e0 0x559a3279f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda0d681700 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a3277aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda07fff700 1 -- 172.21.15.5:0/3121207546 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 msgr2=0x559a3277aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda07fff700 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a3277aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda07fff700 1 -- 172.21.15.5:0/3121207546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3277c2e0 msgr2=0x559a3279f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:02.020 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda07fff700 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3277c2e0 0x559a3279f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda07fff700 1 -- 172.21.15.5:0/3121207546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f400f040 con 0x559a3279dd70 2023-03-03T06:26:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.009+0000 7fda0ce80700 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3277c2e0 0x559a3279f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fda07fff700 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 0x559a3278f020 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4001620 tx=0x7fd9f4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a504bdbd24680e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fd9e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-03-03T06:26:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fd9e77fe700 1 -- 172.21.15.5:0/3121207546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f400b040 con 0x559a3279dd70 2023-03-03T06:26:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fd9e77fe700 1 -- 172.21.15.5:0/3121207546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd9f4006a60 con 0x559a3279dd70 2023-03-03T06:26:02.021 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fda1b26db80 1 -- 172.21.15.5:0/3121207546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a3269e140 con 0x559a3279dd70 2023-03-03T06:26:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fd9e77fe700 1 -- 172.21.15.5:0/3121207546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9f4006c20 con 0x559a3279dd70 2023-03-03T06:26:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fda1b26db80 10 client.6351 fetch_fsmap learned FSMap version 32 2023-03-03T06:26:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fda1b26db80 1 -- 172.21.15.5:0/3121207546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x559a324fed90 con 0x559a3279dd70 2023-03-03T06:26:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fd9e77fe700 1 -- 172.21.15.5:0/3121207546 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559a3269e140 con 0x559a3279dd70 2023-03-03T06:26:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fd9e77fe700 1 -- 172.21.15.5:0/3121207546 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd9f4007030 con 0x559a3279dd70 2023-03-03T06:26:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fda1b26db80 10 client.6351 fetch_fsmap finished waiting for FSMap version 32 2023-03-03T06:26:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fda1b26db80 10 client.6351 resolve_mds: resolved name 'd' to daemon mds.d 2023-03-03T06:26:02.022 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fda1b26db80 20 client.6351 populate_metadata read hostname 'smithi005' 2023-03-03T06:26:02.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fda1b26db80 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.191:6833/1046120178,v1:172.21.15.191:6835/1046120178] conn(0x559a327c0b20 0x559a327c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fda1b26db80 4 client.6351 mds_command: new command op to 6201 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-03T06:26:02.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fda1b26db80 1 -- 172.21.15.5:0/3121207546 --> [v2:172.21.15.191:6833/1046120178,v1:172.21.15.191:6835/1046120178] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a32554f10 con 0x559a327c0b20 2023-03-03T06:26:02.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.010+0000 7fda0ce80700 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.191:6833/1046120178,v1:172.21.15.191:6835/1046120178] conn(0x559a327c0b20 0x559a327c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.011+0000 7fd9e77fe700 10 client.6351 ms_handle_connect on v2:172.21.15.191:6833/1046120178 2023-03-03T06:26:02.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.011+0000 7fda0ce80700 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.191:6833/1046120178,v1:172.21.15.191:6835/1046120178] conn(0x559a327c0b20 0x559a327c0ef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bcf6304899f4129 server_cookie=c1246ea8f92b8ccf in_seq=0 out_seq=0 2023-03-03T06:26:02.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.011+0000 7fd9e77fe700 1 -- 172.21.15.5:0/3121207546 <== mds.0 v2:172.21.15.191:6833/1046120178 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x559a32554f10 con 0x559a327c0b20 2023-03-03T06:26:02.023 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.011+0000 7fd9e77fe700 10 client.6351 handle_command_reply: tid=0 2023-03-03T06:26:02.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.012+0000 7fda1b26db80 1 client.6351 shutdown 2023-03-03T06:26:02.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.012+0000 7fda1b26db80 1 -- 172.21.15.5:0/3121207546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 msgr2=0x559a3278f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.012+0000 7fda1b26db80 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 0x559a3278f020 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4001620 tx=0x7fd9f4000ed0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.012+0000 7fda1b26db80 1 -- 172.21.15.5:0/3121207546 shutdown_connections 2023-03-03T06:26:02.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.012+0000 7fda1b26db80 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.191:6833/1046120178,v1:172.21.15.191:6835/1046120178] conn(0x559a327c0b20 0x559a327c0ef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.012+0000 7fda1b26db80 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a3277aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.024 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.012+0000 7fd9e77fe700 0 client.6351 ms_handle_reset on v2:172.21.15.191:6833/1046120178 2023-03-03T06:26:02.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.012+0000 7fda1b26db80 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3277c2e0 0x559a3279f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.012+0000 7fda1b26db80 1 --2- 172.21.15.5:0/3121207546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 0x559a3278f020 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.012+0000 7fda1b26db80 1 -- 172.21.15.5:0/3121207546 >> 172.21.15.5:0/3121207546 conn(0x559a32773720 msgr2=0x559a32778b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:02.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.012+0000 7fda1b26db80 1 -- 172.21.15.5:0/3121207546 shutdown_connections 2023-03-03T06:26:02.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.012+0000 7fda1b26db80 1 -- 172.21.15.5:0/3121207546 wait complete. 2023-03-03T06:26:02.025 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.012+0000 7fda1b26db80 20 client.6351 trim_cache size 0 max 16384 2023-03-03T06:26:02.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.030+0000 7fda1b26db80 1 Processor -- start 2023-03-03T06:26:02.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.030+0000 7fda1b26db80 1 -- start start 2023-03-03T06:26:02.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda1b26db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3277c2e0 0x559a32770870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda1b26db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 0x559a3278f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda1b26db80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a32779de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda1b26db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a3277ac00 con 0x559a3279dd70 2023-03-03T06:26:02.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda1b26db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a327c3e70 con 0x559a3277c2e0 2023-03-03T06:26:02.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda1b26db80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a327c0340 con 0x559a327a8c20 2023-03-03T06:26:02.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda07fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 0x559a3278f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda07fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 0x559a3278f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45592/0 (socket says 172.21.15.5:45592) 2023-03-03T06:26:02.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda07fff700 1 -- 172.21.15.5:0/1834862616 learned_addr learned my addr 172.21.15.5:0/1834862616 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:02.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda0ce80700 1 --2- 172.21.15.5:0/1834862616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3277c2e0 0x559a32770870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda0d681700 1 --2- 172.21.15.5:0/1834862616 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a32779de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda07fff700 1 -- 172.21.15.5:0/1834862616 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 msgr2=0x559a32779de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:02.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda07fff700 1 --2- 172.21.15.5:0/1834862616 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a32779de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda07fff700 1 -- 172.21.15.5:0/1834862616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3277c2e0 msgr2=0x559a32770870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda07fff700 1 --2- 172.21.15.5:0/1834862616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3277c2e0 0x559a32770870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda07fff700 1 -- 172.21.15.5:0/1834862616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a32697140 con 0x559a3279dd70 2023-03-03T06:26:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fda07fff700 1 --2- 172.21.15.5:0/1834862616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 0x559a3278f220 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4000ee0 tx=0x7fd9f401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9082128a56c76d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fd9f2ffd700 1 -- 172.21.15.5:0/1834862616 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f40074f0 con 0x559a3279dd70 2023-03-03T06:26:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fd9f2ffd700 1 -- 172.21.15.5:0/1834862616 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f4006e50 con 0x559a3279dd70 2023-03-03T06:26:02.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.031+0000 7fd9f2ffd700 1 -- 172.21.15.5:0/1834862616 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4006860 con 0x559a3279dd70 2023-03-03T06:26:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.032+0000 7fda1b26db80 1 -- 172.21.15.5:0/1834862616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 msgr2=0x559a3278f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.032+0000 7fda1b26db80 1 --2- 172.21.15.5:0/1834862616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 0x559a3278f220 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4000ee0 tx=0x7fd9f401c000 comp rx=0 tx=0).stop 2023-03-03T06:26:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.032+0000 7fda1b26db80 1 -- 172.21.15.5:0/1834862616 shutdown_connections 2023-03-03T06:26:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.032+0000 7fda1b26db80 1 --2- 172.21.15.5:0/1834862616 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a32779de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.032+0000 7fda1b26db80 1 --2- 172.21.15.5:0/1834862616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3277c2e0 0x559a32770870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.032+0000 7fda1b26db80 1 --2- 172.21.15.5:0/1834862616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3279dd70 0x559a3278f220 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.032+0000 7fda1b26db80 1 -- 172.21.15.5:0/1834862616 >> 172.21.15.5:0/1834862616 conn(0x559a32773720 msgr2=0x559a327bfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:02.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.032+0000 7fda1b26db80 1 -- 172.21.15.5:0/1834862616 shutdown_connections 2023-03-03T06:26:02.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.032+0000 7fda1b26db80 1 -- 172.21.15.5:0/1834862616 wait complete. 2023-03-03T06:26:02.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.032+0000 7fda1b26db80 1 -- start start 2023-03-03T06:26:02.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.033+0000 7fda1b26db80 1 Processor -- start 2023-03-03T06:26:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.033+0000 7fda1b26db80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 0x559a327d59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.033+0000 7fda1b26db80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3279dd70 0x559a327b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.033+0000 7fda1b26db80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a3279f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.033+0000 7fda1b26db80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a327bd530 con 0x559a3277c2e0 2023-03-03T06:26:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.033+0000 7fda1b26db80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a327794e0 con 0x559a3279dd70 2023-03-03T06:26:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.033+0000 7fda1b26db80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a327d6170 con 0x559a327a8c20 2023-03-03T06:26:02.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.033+0000 7fda1b26db80 10 client.0 _ll_register_callbacks cb 0x559a3266e630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T06:26:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.033+0000 7fda0ce80700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 0x559a327d59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.033+0000 7fda0ce80700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 0x559a327d59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45596/0 (socket says 172.21.15.5:45596) 2023-03-03T06:26:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.033+0000 7fda0ce80700 1 -- 172.21.15.5:0/1970108821 learned_addr learned my addr 172.21.15.5:0/1970108821 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fda0d681700 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a3279f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fda07fff700 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3279dd70 0x559a327b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fda0ce80700 1 -- 172.21.15.5:0/1970108821 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 msgr2=0x559a3279f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:02.042 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fda0ce80700 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a3279f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fda0ce80700 1 -- 172.21.15.5:0/1970108821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3279dd70 msgr2=0x559a327b95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fda0ce80700 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3279dd70 0x559a327b95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fda0ce80700 1 -- 172.21.15.5:0/1970108821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559a324fed90 con 0x559a3277c2e0 2023-03-03T06:26:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fda07fff700 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3279dd70 0x559a327b95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fda0ce80700 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 0x559a327d59b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009450 tx=0x7fd9fc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1953067ed00b88 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fd9e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-03-03T06:26:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fd9e77fe700 1 -- 172.21.15.5:0/1970108821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc00fed0 con 0x559a3277c2e0 2023-03-03T06:26:02.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fd9e77fe700 1 -- 172.21.15.5:0/1970108821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd9fc027130 con 0x559a3277c2e0 2023-03-03T06:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fda1b26db80 1 -- 172.21.15.5:0/1970108821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a3268e160 con 0x559a3277c2e0 2023-03-03T06:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fd9e77fe700 1 -- 172.21.15.5:0/1970108821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9fc0272f0 con 0x559a3277c2e0 2023-03-03T06:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fda1b26db80 10 client.6357 fetch_fsmap learned FSMap version 32 2023-03-03T06:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fda1b26db80 1 -- 172.21.15.5:0/1970108821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x559a32525200 con 0x559a3277c2e0 2023-03-03T06:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fd9e77fe700 1 -- 172.21.15.5:0/1970108821 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559a3268e160 con 0x559a3277c2e0 2023-03-03T06:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.034+0000 7fd9e77fe700 1 -- 172.21.15.5:0/1970108821 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fd9fc027450 con 0x559a3277c2e0 2023-03-03T06:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.035+0000 7fda1b26db80 10 client.6357 fetch_fsmap finished waiting for FSMap version 32 2023-03-03T06:26:02.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.035+0000 7fda1b26db80 10 client.6357 resolve_mds: resolved name 'd' to daemon mds.d 2023-03-03T06:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.035+0000 7fda1b26db80 20 client.6357 populate_metadata read hostname 'smithi005' 2023-03-03T06:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.035+0000 7fda1b26db80 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.191:6833/1046120178,v1:172.21.15.191:6835/1046120178] conn(0x559a3277d680 0x559a327c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.035+0000 7fda1b26db80 4 client.6357 mds_command: new command op to 6201 tid=0[{"prefix": "status"}] 2023-03-03T06:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.035+0000 7fda1b26db80 1 -- 172.21.15.5:0/1970108821 --> [v2:172.21.15.191:6833/1046120178,v1:172.21.15.191:6835/1046120178] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559a32678170 con 0x559a3277d680 2023-03-03T06:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.035+0000 7fda07fff700 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.191:6833/1046120178,v1:172.21.15.191:6835/1046120178] conn(0x559a3277d680 0x559a327c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.035+0000 7fd9e77fe700 10 client.6357 ms_handle_connect on v2:172.21.15.191:6833/1046120178 2023-03-03T06:26:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.035+0000 7fda07fff700 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.191:6833/1046120178,v1:172.21.15.191:6835/1046120178] conn(0x559a3277d680 0x559a327c6d30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b32e1b3263417915 server_cookie=32355cf9d2018511 in_seq=0 out_seq=0 2023-03-03T06:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.035+0000 7fd9e77fe700 1 -- 172.21.15.5:0/1970108821 <== mds.0 v2:172.21.15.191:6833/1046120178 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x559a32678170 con 0x559a3277d680 2023-03-03T06:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.035+0000 7fd9e77fe700 10 client.6357 handle_command_reply: tid=0 2023-03-03T06:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.035+0000 7fda1b26db80 1 client.6357 shutdown 2023-03-03T06:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda1b26db80 1 -- 172.21.15.5:0/1970108821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 msgr2=0x559a327d59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda1b26db80 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 0x559a327d59b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009450 tx=0x7fd9fc0047c0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda1b26db80 1 -- 172.21.15.5:0/1970108821 shutdown_connections 2023-03-03T06:26:02.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda1b26db80 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.191:6833/1046120178,v1:172.21.15.191:6835/1046120178] conn(0x559a3277d680 0x559a327c6d30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda1b26db80 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x559a327a8c20 0x559a3279f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fd9e77fe700 0 client.6357 ms_handle_reset on v2:172.21.15.191:6833/1046120178 2023-03-03T06:26:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda1b26db80 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559a3277c2e0 0x559a327d59b0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda1b26db80 1 --2- 172.21.15.5:0/1970108821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559a3279dd70 0x559a327b95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda1b26db80 1 -- 172.21.15.5:0/1970108821 >> 172.21.15.5:0/1970108821 conn(0x559a32773720 msgr2=0x559a327a5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda1b26db80 1 -- 172.21.15.5:0/1970108821 shutdown_connections 2023-03-03T06:26:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda1b26db80 1 -- 172.21.15.5:0/1970108821 wait complete. 2023-03-03T06:26:02.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda1b26db80 20 client.6357 trim_cache size 0 max 16384 2023-03-03T06:26:02.048 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-03-03T06:26:02.048 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6", 2023-03-03T06:26:02.048 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-03-03T06:26:02.048 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6201, 2023-03-03T06:26:02.048 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-03-03T06:26:02.049 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-03-03T06:26:02.049 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-03-03T06:26:02.049 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.9609445210000001, 2023-03-03T06:26:02.049 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 32, 2023-03-03T06:26:02.049 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 68, 2023-03-03T06:26:02.049 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 68, 2023-03-03T06:26:02.049 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 11.289661239999999 2023-03-03T06:26:02.050 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-03-03T06:26:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda0f0e4700 1 -- 172.21.15.5:0/2388594574 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9ec0682f0 msgr2=0x7fd9ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda0f0e4700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9ec0682f0 0x7fd9ec06a7a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009990 tx=0x7fd9fc008040 comp rx=0 tx=0).stop 2023-03-03T06:26:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda0f0e4700 1 -- 172.21.15.5:0/2388594574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda08146100 msgr2=0x7fda0815b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda0f0e4700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda08146100 0x7fda0815b000 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fda00012000 tx=0x7fda00004ad0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda0f0e4700 1 -- 172.21.15.5:0/2388594574 shutdown_connections 2023-03-03T06:26:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda0f0e4700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda08146100 0x7fda0815b000 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda0f0e4700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda0806dc90 0x7fda080c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda0f0e4700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9ec0682f0 0x7fd9ec06a7a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda0f0e4700 1 --2- 172.21.15.5:0/2388594574 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda080ca210 0x7fda081f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda0f0e4700 1 -- 172.21.15.5:0/2388594574 >> 172.21.15.5:0/2388594574 conn(0x7fda080cf4b0 msgr2=0x7fda0815edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda0f0e4700 1 -- 172.21.15.5:0/2388594574 shutdown_connections 2023-03-03T06:26:02.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.036+0000 7fda0f0e4700 1 -- 172.21.15.5:0/2388594574 wait complete. 2023-03-03T06:26:02.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-03T06:26:02.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.175+0000 7fd892bdf700 1 Processor -- start 2023-03-03T06:26:02.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.175+0000 7fd892bdf700 1 -- start start 2023-03-03T06:26:02.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.176+0000 7fd892bdf700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd88c0ca210 0x7fd88c160360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.176+0000 7fd892bdf700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88c161290 con 0x7fd88c146100 2023-03-03T06:26:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.176+0000 7fd892bdf700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88c0cd520 con 0x7fd88c06dc90 2023-03-03T06:26:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.176+0000 7fd892bdf700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88c160cd0 con 0x7fd88c0ca210 2023-03-03T06:26:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.176+0000 7fd88bfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd88c146100 0x7fd88c06d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35448/0 (socket says 172.21.15.5:35448) 2023-03-03T06:26:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.176+0000 7fd88bfff700 1 -- 172.21.15.5:0/4102249834 learned_addr learned my addr 172.21.15.5:0/4102249834 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:02.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd89097b700 1 --2- 172.21.15.5:0/4102249834 >> v2:172.21.15.191:3300/0 conn(0x7fd88c0ca210 0x7fd88c160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160934385 0 0) 0x7fd88c161290 con 0x7fd88c146100 2023-03-03T06:26:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd87c0035b0 con 0x7fd88c146100 2023-03-03T06:26:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961506446 0 0) 0x7fd88c0cd520 con 0x7fd88c06dc90 2023-03-03T06:26:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd88c161290 con 0x7fd88c06dc90 2023-03-03T06:26:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2439763520 0 0) 0x7fd87c0035b0 con 0x7fd88c146100 2023-03-03T06:26:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 >> v2:172.21.15.191:3300/0 conn(0x7fd88c0ca210 msgr2=0x7fd88c160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:02.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 --2- 172.21.15.5:0/4102249834 >> v2:172.21.15.191:3300/0 conn(0x7fd88c0ca210 0x7fd88c160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 >> v1:172.21.15.191:6789/0 conn(0x7fd88c06dc90 legacy=0x7fd88c0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c160fb0 con 0x7fd88c146100 2023-03-03T06:26:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fd878001670 con 0x7fd88c146100 2023-03-03T06:26:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 >> v1:172.21.15.5:6789/0 conn(0x7fd88c146100 legacy=0x7fd88c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 --2- 172.21.15.5:0/4102249834 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd87c003c50 0x7fd87c004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 --2- 172.21.15.5:0/4102249834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd87c004850 0x7fd87c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 --2- 172.21.15.5:0/4102249834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd87c0052c0 0x7fd87c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c160cd0 con 0x7fd87c004850 2023-03-03T06:26:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c00c1e0 con 0x7fd87c0052c0 2023-03-03T06:26:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c00c3a0 con 0x7fd87c003c50 2023-03-03T06:26:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd88bfff700 1 --2- 172.21.15.5:0/4102249834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd87c004850 0x7fd87c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd89097b700 1 --2- 172.21.15.5:0/4102249834 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd87c003c50 0x7fd87c004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.177+0000 7fd89117c700 1 --2- 172.21.15.5:0/4102249834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd87c0052c0 0x7fd87c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd88bfff700 1 -- 172.21.15.5:0/4102249834 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd87c003c50 msgr2=0x7fd87c004040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:02.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd88bfff700 1 --2- 172.21.15.5:0/4102249834 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd87c003c50 0x7fd87c004040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd88bfff700 1 -- 172.21.15.5:0/4102249834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd87c0052c0 msgr2=0x7fd87c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd88bfff700 1 --2- 172.21.15.5:0/4102249834 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd87c0052c0 0x7fd87c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd88bfff700 1 -- 172.21.15.5:0/4102249834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c0035b0 con 0x7fd87c004850 2023-03-03T06:26:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd89117c700 1 -- 172.21.15.5:0/4102249834 reap_dead start 2023-03-03T06:26:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd88bfff700 1 --2- 172.21.15.5:0/4102249834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd87c004850 0x7fd87c004cc0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c160 tx=0x7fd87c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79aaaa5b00839459 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87800cc40 con 0x7fd87c004850 2023-03-03T06:26:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87800cda0 con 0x7fd87c004850 2023-03-03T06:26:02.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd88b7fe700 1 -- 172.21.15.5:0/4102249834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878005ba0 con 0x7fd87c004850 2023-03-03T06:26:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd892bdf700 1 -- 172.21.15.5:0/4102249834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd87c004850 msgr2=0x7fd87c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd892bdf700 1 --2- 172.21.15.5:0/4102249834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd87c004850 0x7fd87c004cc0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd87800c160 tx=0x7fd87c005880 comp rx=0 tx=0).stop 2023-03-03T06:26:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd892bdf700 1 -- 172.21.15.5:0/4102249834 shutdown_connections 2023-03-03T06:26:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd892bdf700 1 --2- 172.21.15.5:0/4102249834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd87c004850 0x7fd87c004cc0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.178+0000 7fd892bdf700 1 -- 172.21.15.5:0/4102249834 >> 172.21.15.5:0/4102249834 conn(0x7fd88c0cf4b0 msgr2=0x7fd88c0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.179+0000 7fd892bdf700 1 -- 172.21.15.5:0/4102249834 shutdown_connections 2023-03-03T06:26:02.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.179+0000 7fd892bdf700 1 -- 172.21.15.5:0/4102249834 wait complete. 2023-03-03T06:26:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.180+0000 7fd892bdf700 1 Processor -- start 2023-03-03T06:26:02.188 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.180+0000 7fd892bdf700 1 -- start start 2023-03-03T06:26:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd892bdf700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd87c004850 0x7fd88c0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd892bdf700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd88c06be00 0x7fd88c0c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd892bdf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88c0b44b0 0x7fd88c0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd892bdf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c0b4e60 con 0x7fd88c0b44b0 2023-03-03T06:26:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd892bdf700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c0c93e0 con 0x7fd87c004850 2023-03-03T06:26:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd892bdf700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88c0c5890 con 0x7fd88c06be00 2023-03-03T06:26:02.189 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd89117c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88c0b44b0 0x7fd88c0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd89117c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88c0b44b0 0x7fd88c0b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45620/0 (socket says 172.21.15.5:45620) 2023-03-03T06:26:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd89117c700 1 -- 172.21.15.5:0/3267762059 learned_addr learned my addr 172.21.15.5:0/3267762059 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd88bfff700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd88c06be00 0x7fd88c0c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd89097b700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd87c004850 0x7fd88c0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd89117c700 1 -- 172.21.15.5:0/3267762059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd88c06be00 msgr2=0x7fd88c0c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd89117c700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd88c06be00 0x7fd88c0c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd89117c700 1 -- 172.21.15.5:0/3267762059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd87c004850 msgr2=0x7fd88c0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd89117c700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd87c004850 0x7fd88c0c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd89117c700 1 -- 172.21.15.5:0/3267762059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c0ca5e0 con 0x7fd88c0b44b0 2023-03-03T06:26:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd89117c700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88c0b44b0 0x7fd88c0b4920 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd88c06e080 tx=0x7fd88400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd8897fa700 1 -- 172.21.15.5:0/3267762059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd884003cd0 con 0x7fd88c0b44b0 2023-03-03T06:26:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd8897fa700 1 -- 172.21.15.5:0/3267762059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd884003e30 con 0x7fd88c0b44b0 2023-03-03T06:26:02.191 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd8897fa700 1 -- 172.21.15.5:0/3267762059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88400dc00 con 0x7fd88c0b44b0 2023-03-03T06:26:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.181+0000 7fd892bdf700 1 -- 172.21.15.5:0/3267762059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88c0cd1b0 con 0x7fd88c0b44b0 2023-03-03T06:26:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.182+0000 7fd892bdf700 1 -- 172.21.15.5:0/3267762059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88c0ca770 con 0x7fd88c0b44b0 2023-03-03T06:26:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.182+0000 7fd892bdf700 1 -- 172.21.15.5:0/3267762059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88c04e6e0 con 0x7fd88c0b44b0 2023-03-03T06:26:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.183+0000 7fd8897fa700 1 -- 172.21.15.5:0/3267762059 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd88400dd60 con 0x7fd88c0b44b0 2023-03-03T06:26:02.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.183+0000 7fd8897fa700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd870068320 0x7fd87006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:02.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.183+0000 7fd8897fa700 1 -- 172.21.15.5:0/3267762059 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd884086420 con 0x7fd88c0b44b0 2023-03-03T06:26:02.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.183+0000 7fd89097b700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd870068320 0x7fd87006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:02.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.184+0000 7fd89097b700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd870068320 0x7fd87006a7d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd880009ac0 tx=0x7fd880008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:02.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.188+0000 7fd8897fa700 1 -- 172.21.15.5:0/3267762059 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd8840529e0 con 0x7fd88c0b44b0 2023-03-03T06:26:02.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.428+0000 7fd892bdf700 1 -- 172.21.15.5:0/3267762059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd88c06e620 con 0x7fd88c0b44b0 2023-03-03T06:26:02.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.429+0000 7fd8897fa700 1 -- 172.21.15.5:0/3267762059 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd884056000 con 0x7fd88c0b44b0 2023-03-03T06:26:02.431 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-03T06:26:02.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.431+0000 7fd892bdf700 1 -- 172.21.15.5:0/3267762059 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd870068320 msgr2=0x7fd87006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.431+0000 7fd892bdf700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd870068320 0x7fd87006a7d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd880009ac0 tx=0x7fd880008040 comp rx=0 tx=0).stop 2023-03-03T06:26:02.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.431+0000 7fd892bdf700 1 -- 172.21.15.5:0/3267762059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88c0b44b0 msgr2=0x7fd88c0b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:02.433 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.431+0000 7fd892bdf700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88c0b44b0 0x7fd88c0b4920 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd88c06e080 tx=0x7fd88400d430 comp rx=0 tx=0).stop 2023-03-03T06:26:02.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.431+0000 7fd892bdf700 1 -- 172.21.15.5:0/3267762059 shutdown_connections 2023-03-03T06:26:02.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.431+0000 7fd892bdf700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd88c0b44b0 0x7fd88c0b4920 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.431+0000 7fd892bdf700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd87c004850 0x7fd88c0c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.431+0000 7fd892bdf700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd870068320 0x7fd87006a7d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.431+0000 7fd892bdf700 1 --2- 172.21.15.5:0/3267762059 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd88c06be00 0x7fd88c0c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:02.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.431+0000 7fd892bdf700 1 -- 172.21.15.5:0/3267762059 >> 172.21.15.5:0/3267762059 conn(0x7fd88c0cf4b0 msgr2=0x7fd88c15f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:02.434 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.431+0000 7fd892bdf700 1 -- 172.21.15.5:0/3267762059 shutdown_connections 2023-03-03T06:26:02.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:02.431+0000 7fd892bdf700 1 -- 172.21.15.5:0/3267762059 wait complete. 2023-03-03T06:26:02.445 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-03-03T06:26:02.445 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-03T06:26:02.446 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-03-03T06:26:02.446 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-03T06:26:02.446 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-03T06:26:02.447 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-03-03T06:26:02.447 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-03-03T06:26:02.447 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-03T06:26:02.447 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:26:02.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:02.448 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-03-03T06:26:02.465 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T06:26:02.466 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T06:26:02.466 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T06:26:02.466 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:02.466 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-03-03T06:26:02.466 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:02.466 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:26:02.466 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-03-03T06:26:02.467 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:26:02.467 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-03-03T06:26:02.467 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-03T06:26:02.467 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:26:02.467 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-03-03T06:26:02.467 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42381sec preferred_lft 42381sec 2023-03-03T06:26:02.467 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-03-03T06:26:02.468 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:02.468 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:26:02.468 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:26:02.468 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-03T06:26:02.468 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 6a:b3:10:0c:df:06 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:26:02.468 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-03-03T06:26:02.468 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:02.468 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::3415:96ff:fe7c:a178/64 scope link 2023-03-03T06:26:02.469 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:02.469 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-03T06:26:02.469 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 76:7c:c4:80:40:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-03T06:26:02.469 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::747c:c4ff:fe80:40be/64 scope link 2023-03-03T06:26:02.469 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:02.470 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-03T06:26:02.470 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 6a:b3:10:0c:df:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-03-03T06:26:02.470 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::68b3:10ff:fe0c:df06/64 scope link 2023-03-03T06:26:02.470 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:02.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:02.471 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-03T06:26:02.532 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-03-03T06:26:02.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:02.534 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-03-03T06:26:02.593 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-03-03T06:26:02.593 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-03T06:26:02.593 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-03-03T06:26:02.593 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-03-03T06:26:02.594 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-03T06:26:02.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:02.594 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:26:02.595 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:26:02.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-03-03T06:26:02.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-03-03T06:26:02.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-03-03T06:26:02.596 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:26:02.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:02.700 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-03-03T06:26:02.717 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-03-03T06:26:02.717 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-03-03T06:26:02.718 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:26:02.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:02.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-03-03T06:26:02.784 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:26:02.785 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-03T06:26:02.842 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:26:02.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:26:02.844 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-03T06:26:02.899 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-03-03T06:26:02.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:02.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:26:02.985 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:26:02.985 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:26:03.015 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:26:03.015 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:26:03.015 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:26:03.015 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:26:03.015 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:26:03.016 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:26:03.016 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:26:03.016 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:26:03.089 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:26:03.089 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:26:03.089 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:26:03.089 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:26:03.089 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:26:03.090 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:26:03.090 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:26:03.090 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:26:03.090 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790" 2023-03-03T06:26:03.090 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2023-03-03T06:26:03.090 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6" will pass to kernel 2023-03-03T06:26:03.092 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-03T06:26:03.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:03.092 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-03T06:26:03.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:03.121 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:26:03.208 INFO:teuthology.orchestra.run.smithi005.stdout:client5809 2023-03-03T06:26:03.209 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:26:03.210 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:26:03.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_data_pool 2023-03-03T06:26:03.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.392+0000 7f0632a03700 1 Processor -- start 2023-03-03T06:26:03.394 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.392+0000 7f0632a03700 1 -- start start 2023-03-03T06:26:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.393+0000 7f0632a03700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c15a8d0 0x7f062c0cb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.393+0000 7f0632a03700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f062c06d580 0x7f062c06da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.393+0000 7f0632a03700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062c0c9f70 con 0x7f062c15e230 2023-03-03T06:26:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.393+0000 7f0632a03700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062c06df40 con 0x7f062c06d580 2023-03-03T06:26:03.396 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.393+0000 7f0632a03700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0b2a10 con 0x7f062c15a8d0 2023-03-03T06:26:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.393+0000 7f0630fa0700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f062c06d580 0x7f062c06da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.393+0000 7f062bfff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c15a8d0 0x7f062c0cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.393+0000 7f0630fa0700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f062c06d580 0x7f062c06da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:45992/0 (socket says 172.21.15.5:45992) 2023-03-03T06:26:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.393+0000 7f0630fa0700 1 -- 172.21.15.5:0/1609699382 learned_addr learned my addr 172.21.15.5:0/1609699382 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.393+0000 7f062bfff700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c15a8d0 0x7f062c0cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:43706/0 (socket says 172.21.15.5:43706) 2023-03-03T06:26:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.394+0000 7f0630fa0700 1 -- 172.21.15.5:0/1609699382 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c15a8d0 msgr2=0x7f062c0cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:03.397 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.394+0000 7f0630fa0700 1 --2- 172.21.15.5:0/1609699382 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c15a8d0 0x7f062c0cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.394+0000 7f0630fa0700 1 -- 172.21.15.5:0/1609699382 >> v1:172.21.15.191:6789/0 conn(0x7f062c15e230 legacy=0x7f062c0b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.394+0000 7f0630fa0700 1 -- 172.21.15.5:0/1609699382 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c15e7a0 con 0x7f062c06d580 2023-03-03T06:26:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.394+0000 7f062bfff700 1 --2- 172.21.15.5:0/1609699382 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c15a8d0 0x7f062c0cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:26:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.394+0000 7f0630fa0700 1 --2- 172.21.15.5:0/1609699382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c06d580 0x7f062c06da00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0624009e50 tx=0x7f062400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8766fed4582e7bb6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.394+0000 7f062affd700 1 -- 172.21.15.5:0/1609699382 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062400e070 con 0x7f062c06d580 2023-03-03T06:26:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.394+0000 7f062affd700 1 -- 172.21.15.5:0/1609699382 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062400b910 con 0x7f062c06d580 2023-03-03T06:26:03.398 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.394+0000 7f062affd700 1 -- 172.21.15.5:0/1609699382 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062400bcc0 con 0x7f062c06d580 2023-03-03T06:26:03.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.395+0000 7f0632a03700 1 -- 172.21.15.5:0/1609699382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c06d580 msgr2=0x7f062c06da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:03.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.395+0000 7f0632a03700 1 --2- 172.21.15.5:0/1609699382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c06d580 0x7f062c06da00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0624009e50 tx=0x7f062400b330 comp rx=0 tx=0).stop 2023-03-03T06:26:03.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.395+0000 7f0632a03700 1 -- 172.21.15.5:0/1609699382 shutdown_connections 2023-03-03T06:26:03.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.395+0000 7f0632a03700 1 --2- 172.21.15.5:0/1609699382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c06d580 0x7f062c06da00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:03.401 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.395+0000 7f0632a03700 1 --2- 172.21.15.5:0/1609699382 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c15a8d0 0x7f062c0cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.395+0000 7f0632a03700 1 -- 172.21.15.5:0/1609699382 >> 172.21.15.5:0/1609699382 conn(0x7f062c0cf4b0 msgr2=0x7f062c0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.395+0000 7f0632a03700 1 -- 172.21.15.5:0/1609699382 shutdown_connections 2023-03-03T06:26:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.395+0000 7f0632a03700 1 -- 172.21.15.5:0/1609699382 wait complete. 2023-03-03T06:26:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.396+0000 7f0632a03700 1 Processor -- start 2023-03-03T06:26:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.396+0000 7f0632a03700 1 -- start start 2023-03-03T06:26:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f0632a03700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f062c06d580 0x7f062c144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f0632a03700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c15a8d0 0x7f062c158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:03.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f0632a03700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c15e230 0x7f062c15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:03.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f0632a03700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0c6700 con 0x7f062c06d580 2023-03-03T06:26:03.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f0632a03700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0c69e0 con 0x7f062c15e230 2023-03-03T06:26:03.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f0632a03700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0c6cc0 con 0x7f062c15a8d0 2023-03-03T06:26:03.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f062bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f062c06d580 0x7f062c144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:03.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f062bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f062c06d580 0x7f062c144830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45634/0 (socket says 172.21.15.5:45634) 2023-03-03T06:26:03.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f062bfff700 1 -- 172.21.15.5:0/1040549681 learned_addr learned my addr 172.21.15.5:0/1040549681 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:03.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f0630fa0700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c15e230 0x7f062c15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f062b7fe700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c15a8d0 0x7f062c158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f062bfff700 1 -- 172.21.15.5:0/1040549681 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c15a8d0 msgr2=0x7f062c158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f062bfff700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c15a8d0 0x7f062c158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f062bfff700 1 -- 172.21.15.5:0/1040549681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c15e230 msgr2=0x7f062c15cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f062bfff700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c15e230 0x7f062c15cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f062bfff700 1 -- 172.21.15.5:0/1040549681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c0094a0 con 0x7f062c06d580 2023-03-03T06:26:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.397+0000 7f062bfff700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f062c06d580 0x7f062c144830 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f061c00ebe0 tx=0x7f061c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:03.404 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.398+0000 7f0628ff9700 1 -- 172.21.15.5:0/1040549681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c00c910 con 0x7f062c06d580 2023-03-03T06:26:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.398+0000 7f0628ff9700 1 -- 172.21.15.5:0/1040549681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c00ca70 con 0x7f062c06d580 2023-03-03T06:26:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.398+0000 7f0632a03700 1 -- 172.21.15.5:0/1040549681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0624009b30 con 0x7f062c06d580 2023-03-03T06:26:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.398+0000 7f0628ff9700 1 -- 172.21.15.5:0/1040549681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c00cde0 con 0x7f062c06d580 2023-03-03T06:26:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.398+0000 7f0632a03700 1 -- 172.21.15.5:0/1040549681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062c15ed60 con 0x7f062c06d580 2023-03-03T06:26:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.399+0000 7f0632a03700 1 -- 172.21.15.5:0/1040549681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062c15ea80 con 0x7f062c06d580 2023-03-03T06:26:03.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.399+0000 7f0628ff9700 1 -- 172.21.15.5:0/1040549681 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f061c019030 con 0x7f062c06d580 2023-03-03T06:26:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.399+0000 7f0628ff9700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0618068320 0x7f061806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.400+0000 7f0628ff9700 1 -- 172.21.15.5:0/1040549681 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f061c085fc0 con 0x7f062c06d580 2023-03-03T06:26:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.400+0000 7f062b7fe700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0618068320 0x7f061806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.400+0000 7f062b7fe700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0618068320 0x7f061806a7d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f062c14f3c0 tx=0x7f0620009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.404+0000 7f0628ff9700 1 -- 172.21.15.5:0/1040549681 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f061c0524f0 con 0x7f062c06d580 2023-03-03T06:26:03.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:03.597+0000 7f0632a03700 1 -- 172.21.15.5:0/1040549681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_data_pool"} v 0) v1 -- 0x7f062c15f040 con 0x7f062c06d580 2023-03-03T06:26:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.432+0000 7f0628ff9700 1 -- 172.21.15.5:0/1040549681 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_data_pool"}]=0 pool 'test_data_pool' created v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7f061c0210a0 con 0x7f062c06d580 2023-03-03T06:26:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.436+0000 7f0632a03700 1 -- 172.21.15.5:0/1040549681 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0618068320 msgr2=0x7f061806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.436+0000 7f0632a03700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0618068320 0x7f061806a7d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f062c14f3c0 tx=0x7f0620009040 comp rx=0 tx=0).stop 2023-03-03T06:26:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.436+0000 7f0632a03700 1 -- 172.21.15.5:0/1040549681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f062c06d580 msgr2=0x7f062c144830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.436+0000 7f0632a03700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f062c06d580 0x7f062c144830 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f061c00ebe0 tx=0x7f061c009ec0 comp rx=0 tx=0).stop 2023-03-03T06:26:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.437+0000 7f0632a03700 1 -- 172.21.15.5:0/1040549681 shutdown_connections 2023-03-03T06:26:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.437+0000 7f0632a03700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f062c15e230 0x7f062c15cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.437+0000 7f0632a03700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f062c06d580 0x7f062c144830 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.437+0000 7f0632a03700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0618068320 0x7f061806a7d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.437+0000 7f0632a03700 1 --2- 172.21.15.5:0/1040549681 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f062c15a8d0 0x7f062c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.437+0000 7f0632a03700 1 -- 172.21.15.5:0/1040549681 >> 172.21.15.5:0/1040549681 conn(0x7f062c0cf4b0 msgr2=0x7f062c071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.438+0000 7f0632a03700 1 -- 172.21.15.5:0/1040549681 shutdown_connections 2023-03-03T06:26:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.438+0000 7f0632a03700 1 -- 172.21.15.5:0/1040549681 wait complete. 2023-03-03T06:26:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'test_data_pool' created 2023-03-03T06:26:04.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_metadata_pool 2023-03-03T06:26:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.587+0000 7f502e981700 1 Processor -- start 2023-03-03T06:26:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.587+0000 7f502e981700 1 -- start start 2023-03-03T06:26:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f502e981700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50280b55b0 0x7f502815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f502e981700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f50280cd500 0x7f50280b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f502e981700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50280b1e10 0x7f502806bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f502e981700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502815e290 con 0x7f50280b55b0 2023-03-03T06:26:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f502e981700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50280b2290 con 0x7f50280cd500 2023-03-03T06:26:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f502e981700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50280cc5d0 con 0x7f50280b1e10 2023-03-03T06:26:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f5027fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50280b55b0 0x7f502815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f5027fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f50280b55b0 0x7f502815dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45642/0 (socket says 172.21.15.5:45642) 2023-03-03T06:26:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f5027fff700 1 -- 172.21.15.5:0/3078698143 learned_addr learned my addr 172.21.15.5:0/3078698143 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f50277fe700 1 --2- 172.21.15.5:0/3078698143 >> v2:172.21.15.191:3300/0 conn(0x7f50280cd500 0x7f50280b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f502cf1e700 1 --2- 172.21.15.5:0/3078698143 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50280b1e10 0x7f502806bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f5027fff700 1 -- 172.21.15.5:0/3078698143 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50280b1e10 msgr2=0x7f502806bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f5027fff700 1 --2- 172.21.15.5:0/3078698143 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50280b1e10 0x7f502806bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f5027fff700 1 -- 172.21.15.5:0/3078698143 >> v2:172.21.15.191:3300/0 conn(0x7f50280cd500 msgr2=0x7f50280b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f5027fff700 1 --2- 172.21.15.5:0/3078698143 >> v2:172.21.15.191:3300/0 conn(0x7f50280cd500 0x7f50280b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f5027fff700 1 -- 172.21.15.5:0/3078698143 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5028159c30 con 0x7f50280b55b0 2023-03-03T06:26:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.588+0000 7f5027fff700 1 --2- 172.21.15.5:0/3078698143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50280b55b0 0x7f502815dd50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f50280714a0 tx=0x7f5010009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6358907f09dbae server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.589+0000 7f5026ffd700 1 -- 172.21.15.5:0/3078698143 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501000b870 con 0x7f50280b55b0 2023-03-03T06:26:04.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.589+0000 7f5026ffd700 1 -- 172.21.15.5:0/3078698143 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501000b9d0 con 0x7f50280b55b0 2023-03-03T06:26:04.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.589+0000 7f5026ffd700 1 -- 172.21.15.5:0/3078698143 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501000bd60 con 0x7f50280b55b0 2023-03-03T06:26:04.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.589+0000 7f502e981700 1 -- 172.21.15.5:0/3078698143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50280b55b0 msgr2=0x7f502815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:04.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.589+0000 7f502e981700 1 --2- 172.21.15.5:0/3078698143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50280b55b0 0x7f502815dd50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f50280714a0 tx=0x7f5010009bd0 comp rx=0 tx=0).stop 2023-03-03T06:26:04.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.589+0000 7f502e981700 1 -- 172.21.15.5:0/3078698143 shutdown_connections 2023-03-03T06:26:04.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.589+0000 7f502e981700 1 --2- 172.21.15.5:0/3078698143 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50280b1e10 0x7f502806bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:04.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.589+0000 7f502e981700 1 --2- 172.21.15.5:0/3078698143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50280b55b0 0x7f502815dd50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:04.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.589+0000 7f502e981700 1 --2- 172.21.15.5:0/3078698143 >> v2:172.21.15.191:3300/0 conn(0x7f50280cd500 0x7f50280b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.589+0000 7f502e981700 1 -- 172.21.15.5:0/3078698143 >> 172.21.15.5:0/3078698143 conn(0x7f50280cc8d0 msgr2=0x7f50280cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.589+0000 7f502e981700 1 -- 172.21.15.5:0/3078698143 shutdown_connections 2023-03-03T06:26:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.589+0000 7f502e981700 1 -- 172.21.15.5:0/3078698143 wait complete. 2023-03-03T06:26:04.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.591+0000 7f502e981700 1 Processor -- start 2023-03-03T06:26:04.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.591+0000 7f502e981700 1 -- start start 2023-03-03T06:26:04.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502e981700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50280b1e10 0x7f5028146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:04.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502e981700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50280b55b0 0x7f502815c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:04.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502e981700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50280cd500 0x7f502806bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:04.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502e981700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50280c4410 con 0x7f50280cd500 2023-03-03T06:26:04.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502e981700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50280c3ae0 con 0x7f50280b55b0 2023-03-03T06:26:04.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502e981700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50280c3dc0 con 0x7f50280b1e10 2023-03-03T06:26:04.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502cf1e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50280cd500 0x7f502806bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:04.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502cf1e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50280cd500 0x7f502806bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45652/0 (socket says 172.21.15.5:45652) 2023-03-03T06:26:04.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502cf1e700 1 -- 172.21.15.5:0/1608752044 learned_addr learned my addr 172.21.15.5:0/1608752044 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:04.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f50277fe700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50280b55b0 0x7f502815c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:04.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f5027fff700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50280b1e10 0x7f5028146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:04.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502cf1e700 1 -- 172.21.15.5:0/1608752044 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50280b1e10 msgr2=0x7f5028146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:04.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502cf1e700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50280b1e10 0x7f5028146100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:04.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502cf1e700 1 -- 172.21.15.5:0/1608752044 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50280b55b0 msgr2=0x7f502815c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:04.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502cf1e700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50280b55b0 0x7f502815c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:04.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.592+0000 7f502cf1e700 1 -- 172.21.15.5:0/1608752044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5010009550 con 0x7f50280cd500 2023-03-03T06:26:04.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.593+0000 7f502cf1e700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50280cd500 0x7f502806bcd0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5020007ef0 tx=0x7f50200105d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:04.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.593+0000 7f5024ff9700 1 -- 172.21.15.5:0/1608752044 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020013470 con 0x7f50280cd500 2023-03-03T06:26:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.593+0000 7f5024ff9700 1 -- 172.21.15.5:0/1608752044 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50200135f0 con 0x7f50280cd500 2023-03-03T06:26:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.593+0000 7f502e981700 1 -- 172.21.15.5:0/1608752044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50280cb9c0 con 0x7f50280cd500 2023-03-03T06:26:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.593+0000 7f5024ff9700 1 -- 172.21.15.5:0/1608752044 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50200139a0 con 0x7f50280cd500 2023-03-03T06:26:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.593+0000 7f502e981700 1 -- 172.21.15.5:0/1608752044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50280b5980 con 0x7f50280cd500 2023-03-03T06:26:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.594+0000 7f502e981700 1 -- 172.21.15.5:0/1608752044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50280cbca0 con 0x7f50280cd500 2023-03-03T06:26:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.594+0000 7f5024ff9700 1 -- 172.21.15.5:0/1608752044 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5020024070 con 0x7f50280cd500 2023-03-03T06:26:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.595+0000 7f5024ff9700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f50080682f0 0x7f500806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:04.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.595+0000 7f5024ff9700 1 -- 172.21.15.5:0/1608752044 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 7088+0+0 (secure 0 0 0) 0x7f5020088e60 con 0x7f50280cd500 2023-03-03T06:26:04.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.595+0000 7f5027fff700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f50080682f0 0x7f500806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:04.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.595+0000 7f5027fff700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f50080682f0 0x7f500806a7a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5010000c00 tx=0x7f5010008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:04.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.600+0000 7f5024ff9700 1 -- 172.21.15.5:0/1608752044 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5020055230 con 0x7f50280cd500 2023-03-03T06:26:04.797 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:04.795+0000 7f502e981700 1 -- 172.21.15.5:0/1608752044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f502804e6e0 con 0x7f50280cd500 2023-03-03T06:26:05.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.434+0000 7f5024ff9700 1 -- 172.21.15.5:0/1608752044 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_metadata_pool"}]=0 pool 'test_metadata_pool' created v70) v1 ==== 126+0+0 (secure 0 0 0) 0x7f5020022070 con 0x7f50280cd500 2023-03-03T06:26:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.446+0000 7f502e981700 1 -- 172.21.15.5:0/1608752044 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f50080682f0 msgr2=0x7f500806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.446+0000 7f502e981700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f50080682f0 0x7f500806a7a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5010000c00 tx=0x7f5010008030 comp rx=0 tx=0).stop 2023-03-03T06:26:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.446+0000 7f502e981700 1 -- 172.21.15.5:0/1608752044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50280cd500 msgr2=0x7f502806bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:05.448 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.446+0000 7f502e981700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50280cd500 0x7f502806bcd0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5020007ef0 tx=0x7f50200105d0 comp rx=0 tx=0).stop 2023-03-03T06:26:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.446+0000 7f502e981700 1 -- 172.21.15.5:0/1608752044 shutdown_connections 2023-03-03T06:26:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.446+0000 7f502e981700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50280cd500 0x7f502806bcd0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.446+0000 7f502e981700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f50080682f0 0x7f500806a7a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.446+0000 7f502e981700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50280b1e10 0x7f5028146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:05.449 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.446+0000 7f502e981700 1 --2- 172.21.15.5:0/1608752044 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50280b55b0 0x7f502815c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:05.450 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.447+0000 7f502e981700 1 -- 172.21.15.5:0/1608752044 >> 172.21.15.5:0/1608752044 conn(0x7f50280cc8d0 msgr2=0x7f50280b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:05.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.450+0000 7f502e981700 1 -- 172.21.15.5:0/1608752044 shutdown_connections 2023-03-03T06:26:05.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.450+0000 7f502e981700 1 -- 172.21.15.5:0/1608752044 wait complete. 2023-03-03T06:26:05.456 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'test_metadata_pool' created 2023-03-03T06:26:05.471 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool mksnap snap4 2023-03-03T06:26:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.515+0000 7fc891b92080 1 Processor -- start 2023-03-03T06:26:05.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.515+0000 7fc891b92080 1 -- start start 2023-03-03T06:26:05.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc891b92080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b314560 0x561e9b3a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:05.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc891b92080 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e9b39faa0 0x561e9b2cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:05.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc891b92080 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561e9b3a5d20 0x561e9b3a47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:05.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc891b92080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b204fe0 con 0x561e9b314560 2023-03-03T06:26:05.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc891b92080 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b3a1e00 con 0x561e9b39faa0 2023-03-03T06:26:05.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc891b92080 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e9b39e480 con 0x561e9b3a5d20 2023-03-03T06:26:05.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc887c95700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b314560 0x561e9b3a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:05.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc887c95700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b314560 0x561e9b3a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45662/0 (socket says 172.21.15.5:45662) 2023-03-03T06:26:05.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc887c95700 1 -- 172.21.15.5:0/3426521719 learned_addr learned my addr 172.21.15.5:0/3426521719 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:05.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc887494700 1 --2- 172.21.15.5:0/3426521719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e9b39faa0 0x561e9b2cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:05.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc888496700 1 --2- 172.21.15.5:0/3426521719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561e9b3a5d20 0x561e9b3a47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:05.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc887c95700 1 -- 172.21.15.5:0/3426521719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561e9b3a5d20 msgr2=0x561e9b3a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc887c95700 1 --2- 172.21.15.5:0/3426521719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561e9b3a5d20 0x561e9b3a47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc887c95700 1 -- 172.21.15.5:0/3426521719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e9b39faa0 msgr2=0x561e9b2cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc887c95700 1 --2- 172.21.15.5:0/3426521719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e9b39faa0 0x561e9b2cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc887c95700 1 -- 172.21.15.5:0/3426521719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88000a1c0 con 0x561e9b314560 2023-03-03T06:26:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc887494700 1 --2- 172.21.15.5:0/3426521719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e9b39faa0 0x561e9b2cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc887c95700 1 --2- 172.21.15.5:0/3426521719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b314560 0x561e9b3a1520 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc87800c7e0 tx=0x7fc87800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6296ef8abc36cae8 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc886492700 1 -- 172.21.15.5:0/3426521719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800a860 con 0x561e9b314560 2023-03-03T06:26:05.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc886492700 1 -- 172.21.15.5:0/3426521719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87800a9c0 con 0x561e9b314560 2023-03-03T06:26:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.516+0000 7fc886492700 1 -- 172.21.15.5:0/3426521719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800ad70 con 0x561e9b314560 2023-03-03T06:26:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.517+0000 7fc891b92080 1 -- 172.21.15.5:0/3426521719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b314560 msgr2=0x561e9b3a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.517+0000 7fc891b92080 1 --2- 172.21.15.5:0/3426521719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b314560 0x561e9b3a1520 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc87800c7e0 tx=0x7fc87800c810 comp rx=0 tx=0).stop 2023-03-03T06:26:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.517+0000 7fc891b92080 1 -- 172.21.15.5:0/3426521719 shutdown_connections 2023-03-03T06:26:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.517+0000 7fc891b92080 1 --2- 172.21.15.5:0/3426521719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561e9b3a5d20 0x561e9b3a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.517+0000 7fc891b92080 1 --2- 172.21.15.5:0/3426521719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b314560 0x561e9b3a1520 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.517+0000 7fc891b92080 1 --2- 172.21.15.5:0/3426521719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e9b39faa0 0x561e9b2cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:05.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.517+0000 7fc891b92080 1 -- 172.21.15.5:0/3426521719 >> 172.21.15.5:0/3426521719 conn(0x561e9b2cc1b0 msgr2=0x561e9b39ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.517+0000 7fc891b92080 1 -- 172.21.15.5:0/3426521719 shutdown_connections 2023-03-03T06:26:05.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.517+0000 7fc891b92080 1 -- 172.21.15.5:0/3426521719 wait complete. 2023-03-03T06:26:05.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.518+0000 7fc891b92080 1 Processor -- start 2023-03-03T06:26:05.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.518+0000 7fc891b92080 1 -- start start 2023-03-03T06:26:05.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.518+0000 7fc891b92080 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e9b314560 0x561e9b2c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:05.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.518+0000 7fc891b92080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b39faa0 0x561e9b2fa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:05.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.518+0000 7fc891b92080 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561e9b3a5d20 0x561e9b2fad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:05.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.518+0000 7fc891b92080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b3a3920 con 0x561e9b39faa0 2023-03-03T06:26:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.518+0000 7fc891b92080 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e9b30cf40 con 0x561e9b314560 2023-03-03T06:26:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.518+0000 7fc891b92080 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e9b3a3b70 con 0x561e9b3a5d20 2023-03-03T06:26:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc887494700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b39faa0 0x561e9b2fa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc887494700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b39faa0 0x561e9b2fa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45670/0 (socket says 172.21.15.5:45670) 2023-03-03T06:26:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc887494700 1 -- 172.21.15.5:0/2078385711 learned_addr learned my addr 172.21.15.5:0/2078385711 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc887c95700 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e9b314560 0x561e9b2c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:05.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc888496700 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561e9b3a5d20 0x561e9b2fad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc887494700 1 -- 172.21.15.5:0/2078385711 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561e9b3a5d20 msgr2=0x561e9b2fad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc887494700 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561e9b3a5d20 0x561e9b2fad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc887494700 1 -- 172.21.15.5:0/2078385711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e9b314560 msgr2=0x561e9b2c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc887494700 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e9b314560 0x561e9b2c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc887494700 1 -- 172.21.15.5:0/2078385711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87800c440 con 0x561e9b39faa0 2023-03-03T06:26:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc887c95700 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e9b314560 0x561e9b2c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc887494700 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b39faa0 0x561e9b2fa800 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00df90 tx=0x7fc87c00b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:05.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc885490700 1 -- 172.21.15.5:0/2078385711 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c011440 con 0x561e9b39faa0 2023-03-03T06:26:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc885490700 1 -- 172.21.15.5:0/2078385711 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c008040 con 0x561e9b39faa0 2023-03-03T06:26:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc891b92080 1 -- 172.21.15.5:0/2078385711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e9b21d120 con 0x561e9b39faa0 2023-03-03T06:26:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc885490700 1 -- 172.21.15.5:0/2078385711 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0117e0 con 0x561e9b39faa0 2023-03-03T06:26:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.519+0000 7fc891b92080 1 -- 172.21.15.5:0/2078385711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e9b210830 con 0x561e9b39faa0 2023-03-03T06:26:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.521+0000 7fc885490700 1 -- 172.21.15.5:0/2078385711 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc87c020070 con 0x561e9b39faa0 2023-03-03T06:26:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.521+0000 7fc885490700 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc874066c10 0x7fc8740690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.521+0000 7fc885490700 1 -- 172.21.15.5:0/2078385711 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 7445+0+0 (secure 0 0 0) 0x7fc87c084d50 con 0x561e9b39faa0 2023-03-03T06:26:05.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.521+0000 7fc887c95700 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc874066c10 0x7fc8740690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.522+0000 7fc891b92080 1 -- 172.21.15.5:0/2078385711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- pool_op(create snap pool 13 tid 1 name snap4 v0) v4 -- 0x561e9b27b7c0 con 0x561e9b39faa0 2023-03-03T06:26:05.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:05.522+0000 7fc887c95700 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc874066c10 0x7fc8740690c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc87800c850 tx=0x7fc87800a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:06.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.434+0000 7fc885490700 1 -- 172.21.15.5:0/2078385711 <== mon.0 v2:172.21.15.5:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v71) v1 ==== 43+0+0 (secure 0 0 0) 0x7fc87c050f50 con 0x561e9b39faa0 2023-03-03T06:26:06.436 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.434+0000 7fc885490700 1 -- 172.21.15.5:0/2078385711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7fc8740719e0 con 0x561e9b39faa0 2023-03-03T06:26:06.437 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.435+0000 7fc885490700 1 -- 172.21.15.5:0/2078385711 <== mon.0 v2:172.21.15.5:3300/0 7 ==== osd_map(71..71 src has 1..71) v4 ==== 718+0+0 (secure 0 0 0) 0x7fc87c05cca0 con 0x561e9b39faa0 2023-03-03T06:26:06.438 INFO:teuthology.orchestra.run.smithi005.stdout:created pool test_data_pool snap snap4 2023-03-03T06:26:06.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.436+0000 7fc891b92080 1 -- 172.21.15.5:0/2078385711 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc874066c10 msgr2=0x7fc8740690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:06.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.436+0000 7fc891b92080 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc874066c10 0x7fc8740690c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc87800c850 tx=0x7fc87800a000 comp rx=0 tx=0).stop 2023-03-03T06:26:06.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.436+0000 7fc891b92080 1 -- 172.21.15.5:0/2078385711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b39faa0 msgr2=0x561e9b2fa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:06.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.436+0000 7fc891b92080 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b39faa0 0x561e9b2fa800 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00df90 tx=0x7fc87c00b4c0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.436+0000 7fc891b92080 1 -- 172.21.15.5:0/2078385711 shutdown_connections 2023-03-03T06:26:06.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.436+0000 7fc891b92080 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc874066c10 0x7fc8740690c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.436+0000 7fc891b92080 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x561e9b3a5d20 0x561e9b2fad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.436+0000 7fc891b92080 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561e9b314560 0x561e9b2c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.436+0000 7fc891b92080 1 --2- 172.21.15.5:0/2078385711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e9b39faa0 0x561e9b2fa800 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.436+0000 7fc891b92080 1 -- 172.21.15.5:0/2078385711 >> 172.21.15.5:0/2078385711 conn(0x561e9b2cc1b0 msgr2=0x561e9b39ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:06.445 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.443+0000 7fc891b92080 1 -- 172.21.15.5:0/2078385711 shutdown_connections 2023-03-03T06:26:06.446 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.444+0000 7fc891b92080 1 -- 172.21.15.5:0/2078385711 wait complete. 2023-03-03T06:26:06.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testfs test_metadata_pool test_data_pool 2023-03-03T06:26:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.591+0000 7f3a0e4c7700 1 Processor -- start 2023-03-03T06:26:06.593 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.591+0000 7f3a0e4c7700 1 -- start start 2023-03-03T06:26:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a0e4c7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a080af450 0x7f3a0806c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a0e4c7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3a080cb6d0 0x7f3a0806cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a0e4c7700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a080cd990 con 0x7f3a080af080 2023-03-03T06:26:06.595 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a0e4c7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0806d290 con 0x7f3a080cb6d0 2023-03-03T06:26:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a0e4c7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0806d540 con 0x7f3a080af450 2023-03-03T06:26:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a0ca64700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3a080cb6d0 0x7f3a0806cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a0ca64700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3a080cb6d0 0x7f3a0806cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45678/0 (socket says 172.21.15.5:45678) 2023-03-03T06:26:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a0ca64700 1 -- 172.21.15.5:0/516075992 learned_addr learned my addr 172.21.15.5:0/516075992 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a077fe700 1 --2- 172.21.15.5:0/516075992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a080af450 0x7f3a0806c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a0ca64700 1 -- 172.21.15.5:0/516075992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a080af450 msgr2=0x7f3a0806c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:06.596 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a0ca64700 1 --2- 172.21.15.5:0/516075992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a080af450 0x7f3a0806c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a0ca64700 1 -- 172.21.15.5:0/516075992 >> v1:172.21.15.191:6789/0 conn(0x7f3a080af080 legacy=0x7f3a080cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a0ca64700 1 -- 172.21.15.5:0/516075992 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080cdbe0 con 0x7f3a080cb6d0 2023-03-03T06:26:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.592+0000 7f3a0ca64700 1 --2- 172.21.15.5:0/516075992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a080cb6d0 0x7f3a0806cd50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009e50 tx=0x7f3a0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b649344aa6ee46da server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.593+0000 7f3a06ffd700 1 -- 172.21.15.5:0/516075992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0000e070 con 0x7f3a080cb6d0 2023-03-03T06:26:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.593+0000 7f3a06ffd700 1 -- 172.21.15.5:0/516075992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a00003a20 con 0x7f3a080cb6d0 2023-03-03T06:26:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.593+0000 7f3a06ffd700 1 -- 172.21.15.5:0/516075992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a00003dd0 con 0x7f3a080cb6d0 2023-03-03T06:26:06.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.593+0000 7f3a0e4c7700 1 -- 172.21.15.5:0/516075992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a080cb6d0 msgr2=0x7f3a0806cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.593+0000 7f3a0e4c7700 1 --2- 172.21.15.5:0/516075992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a080cb6d0 0x7f3a0806cd50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009e50 tx=0x7f3a0000b330 comp rx=0 tx=0).stop 2023-03-03T06:26:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.593+0000 7f3a0e4c7700 1 -- 172.21.15.5:0/516075992 shutdown_connections 2023-03-03T06:26:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.593+0000 7f3a0e4c7700 1 --2- 172.21.15.5:0/516075992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a080cb6d0 0x7f3a0806cd50 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.593+0000 7f3a0e4c7700 1 --2- 172.21.15.5:0/516075992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a080af450 0x7f3a0806c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.593+0000 7f3a0e4c7700 1 -- 172.21.15.5:0/516075992 >> 172.21.15.5:0/516075992 conn(0x7f3a080cc840 msgr2=0x7f3a080ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.593+0000 7f3a0e4c7700 1 -- 172.21.15.5:0/516075992 shutdown_connections 2023-03-03T06:26:06.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.593+0000 7f3a0e4c7700 1 -- 172.21.15.5:0/516075992 wait complete. 2023-03-03T06:26:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.594+0000 7f3a0e4c7700 1 Processor -- start 2023-03-03T06:26:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.595+0000 7f3a0e4c7700 1 -- start start 2023-03-03T06:26:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.595+0000 7f3a0e4c7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a080af080 0x7f3a081f2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.595+0000 7f3a0e4c7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a080af450 0x7f3a081f5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.595+0000 7f3a0e4c7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a080cb6d0 0x7f3a0815a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.595+0000 7f3a0e4c7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a081f2d50 con 0x7f3a080af080 2023-03-03T06:26:06.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.595+0000 7f3a0e4c7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a081f54b0 con 0x7f3a080cb6d0 2023-03-03T06:26:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.595+0000 7f3a0e4c7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080aba00 con 0x7f3a080af450 2023-03-03T06:26:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.595+0000 7f3a07fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a080af080 0x7f3a081f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.595+0000 7f3a07fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a080af080 0x7f3a081f2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45680/0 (socket says 172.21.15.5:45680) 2023-03-03T06:26:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a07fff700 1 -- 172.21.15.5:0/1908573004 learned_addr learned my addr 172.21.15.5:0/1908573004 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a077fe700 1 --2- 172.21.15.5:0/1908573004 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a080af450 0x7f3a081f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a0ca64700 1 --2- 172.21.15.5:0/1908573004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a080cb6d0 0x7f3a0815a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:06.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a07fff700 1 -- 172.21.15.5:0/1908573004 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a080af450 msgr2=0x7f3a081f5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a07fff700 1 --2- 172.21.15.5:0/1908573004 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a080af450 0x7f3a081f5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a07fff700 1 -- 172.21.15.5:0/1908573004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a080cb6d0 msgr2=0x7f3a0815a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a07fff700 1 --2- 172.21.15.5:0/1908573004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a080cb6d0 0x7f3a0815a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a07fff700 1 -- 172.21.15.5:0/1908573004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a00009b30 con 0x7f3a080af080 2023-03-03T06:26:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a077fe700 1 --2- 172.21.15.5:0/1908573004 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f3a080af450 0x7f3a081f5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a0ca64700 1 --2- 172.21.15.5:0/1908573004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a080cb6d0 0x7f3a0815a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a07fff700 1 --2- 172.21.15.5:0/1908573004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a080af080 0x7f3a081f2810 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f39f800c4d0 tx=0x7f39f800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:06.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a04ff9700 1 -- 172.21.15.5:0/1908573004 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8011790 con 0x7f3a080af080 2023-03-03T06:26:06.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a04ff9700 1 -- 172.21.15.5:0/1908573004 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f80118f0 con 0x7f3a080af080 2023-03-03T06:26:06.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a0e4c7700 1 -- 172.21.15.5:0/1908573004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a080ce1a0 con 0x7f3a080af080 2023-03-03T06:26:06.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a04ff9700 1 -- 172.21.15.5:0/1908573004 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8011ca0 con 0x7f3a080af080 2023-03-03T06:26:06.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.596+0000 7f3a0e4c7700 1 -- 172.21.15.5:0/1908573004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a080cdec0 con 0x7f3a080af080 2023-03-03T06:26:06.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.597+0000 7f3a0e4c7700 1 -- 172.21.15.5:0/1908573004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a080ce6c0 con 0x7f3a080af080 2023-03-03T06:26:06.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.598+0000 7f3a04ff9700 1 -- 172.21.15.5:0/1908573004 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f39f8010050 con 0x7f3a080af080 2023-03-03T06:26:06.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.598+0000 7f3a04ff9700 1 --2- 172.21.15.5:0/1908573004 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f39e80682f0 0x7f39e806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:06.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.598+0000 7f3a04ff9700 1 -- 172.21.15.5:0/1908573004 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7484+0+0 (secure 0 0 0) 0x7f39f8085fa0 con 0x7f3a080af080 2023-03-03T06:26:06.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.598+0000 7f3a077fe700 1 --2- 172.21.15.5:0/1908573004 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f39e80682f0 0x7f39e806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:06.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.598+0000 7f3a077fe700 1 --2- 172.21.15.5:0/1908573004 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f39e80682f0 0x7f39e806a7a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3a080aec00 tx=0x7f39f0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:06.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.603+0000 7f3a04ff9700 1 -- 172.21.15.5:0/1908573004 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f39f8052270 con 0x7f3a080af080 2023-03-03T06:26:06.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.842+0000 7f3a0e4c7700 1 -- 172.21.15.5:0/1908573004 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"} v 0) v1 -- 0x7f3a0804e6e0 con 0x7f3a080af080 2023-03-03T06:26:06.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.842+0000 7f3a04ff9700 1 -- 172.21.15.5:0/1908573004 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"}]=-95 pool(13) already has mon-managed snaps; can't attach pool to fs v32) v1 ==== 198+0+0 (secure 0 0 0) 0x7f39f8055890 con 0x7f3a080af080 2023-03-03T06:26:06.846 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENOTSUP: pool(13) already has mon-managed snaps; can't attach pool to fs 2023-03-03T06:26:06.849 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-03-03T06:26:06.850 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool rmsnap snap4 2023-03-03T06:26:06.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.891+0000 7fd716b60080 1 Processor -- start 2023-03-03T06:26:06.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.891+0000 7fd716b60080 1 -- start start 2023-03-03T06:26:06.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd716b60080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 0x5627e0da68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:06.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd716b60080 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627e0e4c0f0 0x5627e0e500f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:06.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd716b60080 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627e0e4cfb0 0x5627e0d8fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:06.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd716b60080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627e0d1e000 con 0x5627e0d762e0 2023-03-03T06:26:06.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd716b60080 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627e0cb0fe0 con 0x5627e0e4cfb0 2023-03-03T06:26:06.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd716b60080 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627e0da5b00 con 0x5627e0e4c0f0 2023-03-03T06:26:06.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd70cc63700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 0x5627e0da68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:06.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd70cc63700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 0x5627e0da68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45694/0 (socket says 172.21.15.5:45694) 2023-03-03T06:26:06.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd70cc63700 1 -- 172.21.15.5:0/2949709064 learned_addr learned my addr 172.21.15.5:0/2949709064 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:06.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd707fff700 1 --2- 172.21.15.5:0/2949709064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627e0e4c0f0 0x5627e0e500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:06.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd70d464700 1 --2- 172.21.15.5:0/2949709064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627e0e4cfb0 0x5627e0d8fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:06.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd70cc63700 1 -- 172.21.15.5:0/2949709064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627e0e4c0f0 msgr2=0x5627e0e500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:06.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd70cc63700 1 --2- 172.21.15.5:0/2949709064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627e0e4c0f0 0x5627e0e500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd70cc63700 1 -- 172.21.15.5:0/2949709064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627e0e4cfb0 msgr2=0x5627e0d8fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:06.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd70cc63700 1 --2- 172.21.15.5:0/2949709064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627e0e4cfb0 0x5627e0d8fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd70cc63700 1 -- 172.21.15.5:0/2949709064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd700005d20 con 0x5627e0d762e0 2023-03-03T06:26:06.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.892+0000 7fd70cc63700 1 --2- 172.21.15.5:0/2949709064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 0x5627e0da68d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x5627e0dc27f0 tx=0x7fd70000d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151265c801671b14 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:06.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.893+0000 7fd706ffd700 1 -- 172.21.15.5:0/2949709064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700005ba0 con 0x5627e0d762e0 2023-03-03T06:26:06.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.893+0000 7fd706ffd700 1 -- 172.21.15.5:0/2949709064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd700008d30 con 0x5627e0d762e0 2023-03-03T06:26:06.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.893+0000 7fd706ffd700 1 -- 172.21.15.5:0/2949709064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700008ea0 con 0x5627e0d762e0 2023-03-03T06:26:06.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.893+0000 7fd716b60080 1 -- 172.21.15.5:0/2949709064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 msgr2=0x5627e0da68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:06.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.893+0000 7fd716b60080 1 --2- 172.21.15.5:0/2949709064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 0x5627e0da68d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x5627e0dc27f0 tx=0x7fd70000d000 comp rx=0 tx=0).stop 2023-03-03T06:26:06.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.893+0000 7fd716b60080 1 -- 172.21.15.5:0/2949709064 shutdown_connections 2023-03-03T06:26:06.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.893+0000 7fd716b60080 1 --2- 172.21.15.5:0/2949709064 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627e0e4cfb0 0x5627e0d8fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.893+0000 7fd716b60080 1 --2- 172.21.15.5:0/2949709064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 0x5627e0da68d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.893+0000 7fd716b60080 1 --2- 172.21.15.5:0/2949709064 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627e0e4c0f0 0x5627e0e500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.893+0000 7fd716b60080 1 -- 172.21.15.5:0/2949709064 >> 172.21.15.5:0/2949709064 conn(0x5627e0dc18e0 msgr2=0x5627e0e4efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:06.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.893+0000 7fd716b60080 1 -- 172.21.15.5:0/2949709064 shutdown_connections 2023-03-03T06:26:06.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.893+0000 7fd716b60080 1 -- 172.21.15.5:0/2949709064 wait complete. 2023-03-03T06:26:06.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.894+0000 7fd716b60080 1 Processor -- start 2023-03-03T06:26:06.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.894+0000 7fd716b60080 1 -- start start 2023-03-03T06:26:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.894+0000 7fd716b60080 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 0x5627e0e46ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd716b60080 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627e0e4c0f0 0x5627e0d91f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd716b60080 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627e0e4cfb0 0x5627e0d924a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd716b60080 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627e0da0be0 con 0x5627e0d762e0 2023-03-03T06:26:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd716b60080 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627e0e473e0 con 0x5627e0e4cfb0 2023-03-03T06:26:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd716b60080 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627e0da5530 con 0x5627e0e4c0f0 2023-03-03T06:26:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd70cc63700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 0x5627e0e46ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:06.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd70cc63700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 0x5627e0e46ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45700/0 (socket says 172.21.15.5:45700) 2023-03-03T06:26:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd70cc63700 1 -- 172.21.15.5:0/754303746 learned_addr learned my addr 172.21.15.5:0/754303746 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd707fff700 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627e0e4c0f0 0x5627e0d91f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd70d464700 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627e0e4cfb0 0x5627e0d924a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd70cc63700 1 -- 172.21.15.5:0/754303746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627e0e4c0f0 msgr2=0x5627e0d91f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd70cc63700 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627e0e4c0f0 0x5627e0d91f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd70cc63700 1 -- 172.21.15.5:0/754303746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627e0e4cfb0 msgr2=0x5627e0d924a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd70cc63700 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627e0e4cfb0 0x5627e0d924a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd70cc63700 1 -- 172.21.15.5:0/754303746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627e0cc9120 con 0x5627e0d762e0 2023-03-03T06:26:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd70cc63700 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 0x5627e0e46ba0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd70000a440 tx=0x7fd700002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd705ffb700 1 -- 172.21.15.5:0/754303746 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70001d9f0 con 0x5627e0d762e0 2023-03-03T06:26:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd705ffb700 1 -- 172.21.15.5:0/754303746 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70001db50 con 0x5627e0d762e0 2023-03-03T06:26:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd716b60080 1 -- 172.21.15.5:0/754303746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5627e0cbc830 con 0x5627e0d762e0 2023-03-03T06:26:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd705ffb700 1 -- 172.21.15.5:0/754303746 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700012400 con 0x5627e0d762e0 2023-03-03T06:26:06.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.895+0000 7fd716b60080 1 -- 172.21.15.5:0/754303746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627e0cc9360 con 0x5627e0d762e0 2023-03-03T06:26:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.897+0000 7fd705ffb700 1 -- 172.21.15.5:0/754303746 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd700023070 con 0x5627e0d762e0 2023-03-03T06:26:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.897+0000 7fd705ffb700 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd6f0066c10 0x7fd6f00690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.897+0000 7fd705ffb700 1 -- 172.21.15.5:0/754303746 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 7484+0+0 (secure 0 0 0) 0x7fd700087d50 con 0x5627e0d762e0 2023-03-03T06:26:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.897+0000 7fd707fff700 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd6f0066c10 0x7fd6f00690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.897+0000 7fd716b60080 1 -- 172.21.15.5:0/754303746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- pool_op(delete snap pool 13 tid 1 name snap4 v0) v4 -- 0x5627e0d277c0 con 0x5627e0d762e0 2023-03-03T06:26:06.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:06.897+0000 7fd707fff700 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd6f0066c10 0x7fd6f00690c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x5627e0d78fb0 tx=0x7fd6f8001790 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd705ffb700 1 -- 172.21.15.5:0/754303746 <== mon.0 v2:172.21.15.5:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v72) v1 ==== 43+0+0 (secure 0 0 0) 0x7fd700054020 con 0x5627e0d762e0 2023-03-03T06:26:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd705ffb700 1 -- 172.21.15.5:0/754303746 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7fd6f0071a40 con 0x5627e0d762e0 2023-03-03T06:26:07.438 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd705ffb700 1 -- 172.21.15.5:0/754303746 <== mon.0 v2:172.21.15.5:3300/0 7 ==== osd_map(72..72 src has 1..72) v4 ==== 970+0+0 (secure 0 0 0) 0x7fd70005fd70 con 0x5627e0d762e0 2023-03-03T06:26:07.438 INFO:teuthology.orchestra.run.smithi005.stdout:removed pool test_data_pool snap snap4 2023-03-03T06:26:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd716b60080 1 -- 172.21.15.5:0/754303746 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd6f0066c10 msgr2=0x7fd6f00690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:07.439 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd716b60080 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd6f0066c10 0x7fd6f00690c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x5627e0d78fb0 tx=0x7fd6f8001790 comp rx=0 tx=0).stop 2023-03-03T06:26:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd716b60080 1 -- 172.21.15.5:0/754303746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 msgr2=0x5627e0e46ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd716b60080 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 0x5627e0e46ba0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd70000a440 tx=0x7fd700002fb0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd716b60080 1 -- 172.21.15.5:0/754303746 shutdown_connections 2023-03-03T06:26:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd716b60080 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5627e0e4cfb0 0x5627e0d924a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd716b60080 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5627e0d762e0 0x5627e0e46ba0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd716b60080 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd6f0066c10 0x7fd6f00690c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd716b60080 1 --2- 172.21.15.5:0/754303746 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x5627e0e4c0f0 0x5627e0d91f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.440 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd716b60080 1 -- 172.21.15.5:0/754303746 >> 172.21.15.5:0/754303746 conn(0x5627e0dc18e0 msgr2=0x5627e0e4b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd716b60080 1 -- 172.21.15.5:0/754303746 shutdown_connections 2023-03-03T06:26:07.441 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.436+0000 7fd716b60080 1 -- 172.21.15.5:0/754303746 wait complete. 2023-03-03T06:26:07.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_data_pool 2023-03-03T06:26:07.623 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.621+0000 7f0fa8a21700 1 Processor -- start 2023-03-03T06:26:07.624 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.621+0000 7f0fa8a21700 1 -- start start 2023-03-03T06:26:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.622+0000 7f0fa8a21700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0fa415a830 0x7f0fa40cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.622+0000 7f0fa8a21700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0fa40b01a0 0x7f0fa40cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.622+0000 7f0fa8a21700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa40d16a0 con 0x7f0fa415a460 2023-03-03T06:26:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.622+0000 7f0fa8a21700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa40cb4a0 con 0x7f0fa415a830 2023-03-03T06:26:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.622+0000 7f0fa8a21700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa40cbc70 con 0x7f0fa40b01a0 2023-03-03T06:26:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa1d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0fa415a830 0x7f0fa40cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa1d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0fa415a830 0x7f0fa40cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45710/0 (socket says 172.21.15.5:45710) 2023-03-03T06:26:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa259c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0fa415a460 0x7f0fa40cd110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35550/0 (socket says 172.21.15.5:35550) 2023-03-03T06:26:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa1d9b700 1 -- 172.21.15.5:0/1053811178 learned_addr learned my addr 172.21.15.5:0/1053811178 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:07.626 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa2d9d700 1 --2- 172.21.15.5:0/1053811178 >> v2:172.21.15.191:3300/0 conn(0x7f0fa40b01a0 0x7f0fa40cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa1d9b700 1 -- 172.21.15.5:0/1053811178 >> v2:172.21.15.191:3300/0 conn(0x7f0fa40b01a0 msgr2=0x7f0fa40cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa1d9b700 1 --2- 172.21.15.5:0/1053811178 >> v2:172.21.15.191:3300/0 conn(0x7f0fa40b01a0 0x7f0fa40cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa1d9b700 1 -- 172.21.15.5:0/1053811178 >> v1:172.21.15.5:6789/0 conn(0x7f0fa415a460 legacy=0x7f0fa40cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa1d9b700 1 -- 172.21.15.5:0/1053811178 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa40cb6b0 con 0x7f0fa415a830 2023-03-03T06:26:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa159a700 1 -- 172.21.15.5:0/1053811178 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097111897 0 0) 0x7f0fa40d16a0 con 0x7f0fa415a460 2023-03-03T06:26:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa1d9b700 1 --2- 172.21.15.5:0/1053811178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa415a830 0x7f0fa40cd860 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0fa408a280 tx=0x7f0f98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92662a2a191e0fda server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa159a700 1 -- 172.21.15.5:0/1053811178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800b870 con 0x7f0fa415a830 2023-03-03T06:26:07.627 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa159a700 1 -- 172.21.15.5:0/1053811178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9800b9d0 con 0x7f0fa415a830 2023-03-03T06:26:07.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.623+0000 7f0fa159a700 1 -- 172.21.15.5:0/1053811178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800bd60 con 0x7f0fa415a830 2023-03-03T06:26:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.624+0000 7f0fa8a21700 1 -- 172.21.15.5:0/1053811178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa415a830 msgr2=0x7f0fa40cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.624+0000 7f0fa8a21700 1 --2- 172.21.15.5:0/1053811178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa415a830 0x7f0fa40cd860 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0fa408a280 tx=0x7f0f98009bd0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.624+0000 7f0fa8a21700 1 -- 172.21.15.5:0/1053811178 shutdown_connections 2023-03-03T06:26:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.624+0000 7f0fa8a21700 1 --2- 172.21.15.5:0/1053811178 >> v2:172.21.15.191:3300/0 conn(0x7f0fa40b01a0 0x7f0fa40cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.624+0000 7f0fa8a21700 1 --2- 172.21.15.5:0/1053811178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa415a830 0x7f0fa40cd860 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.624+0000 7f0fa8a21700 1 -- 172.21.15.5:0/1053811178 >> 172.21.15.5:0/1053811178 conn(0x7f0fa406f3c0 msgr2=0x7f0fa406f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.624+0000 7f0fa8a21700 1 -- 172.21.15.5:0/1053811178 shutdown_connections 2023-03-03T06:26:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.624+0000 7f0fa8a21700 1 -- 172.21.15.5:0/1053811178 wait complete. 2023-03-03T06:26:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.625+0000 7f0fa8a21700 1 Processor -- start 2023-03-03T06:26:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.625+0000 7f0fa8a21700 1 -- start start 2023-03-03T06:26:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.626+0000 7f0fa8a21700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40b01a0 0x7f0fa40c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.626+0000 7f0fa8a21700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0fa415a460 0x7f0fa40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.626+0000 7f0fa8a21700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fa415a830 0x7f0fa4157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.631 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.626+0000 7f0fa8a21700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa41f0130 con 0x7f0fa40b01a0 2023-03-03T06:26:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.626+0000 7f0fa8a21700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40c4e60 con 0x7f0fa415a830 2023-03-03T06:26:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.626+0000 7f0fa8a21700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40c7a90 con 0x7f0fa415a460 2023-03-03T06:26:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.626+0000 7f0fa259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40b01a0 0x7f0fa40c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.626+0000 7f0fa259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40b01a0 0x7f0fa40c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45714/0 (socket says 172.21.15.5:45714) 2023-03-03T06:26:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.626+0000 7f0fa259c700 1 -- 172.21.15.5:0/2429125338 learned_addr learned my addr 172.21.15.5:0/2429125338 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0fa1d9b700 1 --2- 172.21.15.5:0/2429125338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0fa415a460 0x7f0fa40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0fa2d9d700 1 --2- 172.21.15.5:0/2429125338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fa415a830 0x7f0fa4157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0fa259c700 1 -- 172.21.15.5:0/2429125338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0fa415a460 msgr2=0x7f0fa40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0fa259c700 1 --2- 172.21.15.5:0/2429125338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0fa415a460 0x7f0fa40c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0fa259c700 1 -- 172.21.15.5:0/2429125338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fa415a830 msgr2=0x7f0fa4157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0fa259c700 1 --2- 172.21.15.5:0/2429125338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0fa415a830 0x7f0fa4157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0fa259c700 1 -- 172.21.15.5:0/2429125338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f98009550 con 0x7f0fa40b01a0 2023-03-03T06:26:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0fa1d9b700 1 --2- 172.21.15.5:0/2429125338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0fa415a460 0x7f0fa40c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0fa259c700 1 --2- 172.21.15.5:0/2429125338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fa40b01a0 0x7f0fa40c6e40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400c750 tx=0x7f0f9400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:07.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0f92ffd700 1 -- 172.21.15.5:0/2429125338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94004c80 con 0x7f0fa40b01a0 2023-03-03T06:26:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0f92ffd700 1 -- 172.21.15.5:0/2429125338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f94004e00 con 0x7f0fa40b01a0 2023-03-03T06:26:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0fa8a21700 1 -- 172.21.15.5:0/2429125338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa40d1940 con 0x7f0fa40b01a0 2023-03-03T06:26:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0f92ffd700 1 -- 172.21.15.5:0/2429125338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94007310 con 0x7f0fa40b01a0 2023-03-03T06:26:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.627+0000 7f0fa8a21700 1 -- 172.21.15.5:0/2429125338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa40cb990 con 0x7f0fa40b01a0 2023-03-03T06:26:07.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.628+0000 7f0fa8a21700 1 -- 172.21.15.5:0/2429125338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa40cea20 con 0x7f0fa40b01a0 2023-03-03T06:26:07.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.628+0000 7f0f92ffd700 1 -- 172.21.15.5:0/2429125338 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0f9401a020 con 0x7f0fa40b01a0 2023-03-03T06:26:07.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.629+0000 7f0f92ffd700 1 --2- 172.21.15.5:0/2429125338 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0f840682f0 0x7f0f8406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.629+0000 7f0f92ffd700 1 -- 172.21.15.5:0/2429125338 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f0f94085e10 con 0x7f0fa40b01a0 2023-03-03T06:26:07.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.629+0000 7f0fa1d9b700 1 --2- 172.21.15.5:0/2429125338 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0f840682f0 0x7f0f8406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.629+0000 7f0fa1d9b700 1 --2- 172.21.15.5:0/2429125338 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0f840682f0 0x7f0f8406a7a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0fa415ac50 tx=0x7f0f98008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:07.636 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.633+0000 7f0f92ffd700 1 -- 172.21.15.5:0/2429125338 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0f940520d0 con 0x7f0fa40b01a0 2023-03-03T06:26:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.829+0000 7f0fa8a21700 1 -- 172.21.15.5:0/2429125338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_data_pool"} v 0) v1 -- 0x7f0fa404e6e0 con 0x7f0fa40b01a0 2023-03-03T06:26:07.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.829+0000 7f0f92ffd700 1 -- 172.21.15.5:0/2429125338 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_data_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v72) v1 ==== 296+0+0 (secure 0 0 0) 0x7f0f940556f0 con 0x7f0fa40b01a0 2023-03-03T06:26:07.833 INFO:teuthology.orchestra.run.smithi005.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-03-03T06:26:07.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T06:26:07.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_metadata_pool 2023-03-03T06:26:07.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.963+0000 7f54b26a5700 1 Processor -- start 2023-03-03T06:26:07.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.963+0000 7f54b26a5700 1 -- start start 2023-03-03T06:26:07.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54b26a5700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f54ac0cb410 0x7f54ac0714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54b26a5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ac06c230 0x7f54ac071a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54b26a5700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ac0cab30 con 0x7f54ac159660 2023-03-03T06:26:07.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54b26a5700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ac06bda0 con 0x7f54ac0cb410 2023-03-03T06:26:07.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54b26a5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac0cb8c0 con 0x7f54ac06c230 2023-03-03T06:26:07.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54abfff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f54ac159660 0x7f54ac0cad00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35564/0 (socket says 172.21.15.5:35564) 2023-03-03T06:26:07.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54abfff700 1 -- 172.21.15.5:0/869734470 learned_addr learned my addr 172.21.15.5:0/869734470 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:07.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54ab7fe700 1 --2- 172.21.15.5:0/869734470 >> v2:172.21.15.191:3300/0 conn(0x7f54ac0cb410 0x7f54ac0714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54b0c42700 1 --2- 172.21.15.5:0/869734470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ac06c230 0x7f54ac071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968108060 0 0) 0x7f54ac0cab30 con 0x7f54ac159660 2023-03-03T06:26:07.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54940035b0 con 0x7f54ac159660 2023-03-03T06:26:07.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2431239024 0 0) 0x7f54940035b0 con 0x7f54ac159660 2023-03-03T06:26:07.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ac06c230 msgr2=0x7f54ac071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:07.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54aaffd700 1 --2- 172.21.15.5:0/869734470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ac06c230 0x7f54ac071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 >> v2:172.21.15.191:3300/0 conn(0x7f54ac0cb410 msgr2=0x7f54ac0714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:07.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54aaffd700 1 --2- 172.21.15.5:0/869734470 >> v2:172.21.15.191:3300/0 conn(0x7f54ac0cb410 0x7f54ac0714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac06b1d0 con 0x7f54ac159660 2023-03-03T06:26:07.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f549c001670 con 0x7f54ac159660 2023-03-03T06:26:07.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 >> v1:172.21.15.5:6789/0 conn(0x7f54ac159660 legacy=0x7f54ac0cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:07.970 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54aaffd700 1 --2- 172.21.15.5:0/869734470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5494003a00 0x7f5494003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.964+0000 7f54aaffd700 1 --2- 172.21.15.5:0/869734470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5494004430 0x7f54940048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54aaffd700 1 --2- 172.21.15.5:0/869734470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ac06c230 0x7f5494005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac06bda0 con 0x7f5494003a00 2023-03-03T06:26:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac0cb8c0 con 0x7f5494004430 2023-03-03T06:26:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549400ba10 con 0x7f54ac06c230 2023-03-03T06:26:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54abfff700 1 --2- 172.21.15.5:0/869734470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5494003a00 0x7f5494003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.971 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54ab7fe700 1 --2- 172.21.15.5:0/869734470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5494004430 0x7f54940048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54b0c42700 1 --2- 172.21.15.5:0/869734470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ac06c230 0x7f5494005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54abfff700 1 -- 172.21.15.5:0/869734470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ac06c230 msgr2=0x7f5494005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54abfff700 1 --2- 172.21.15.5:0/869734470 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ac06c230 0x7f5494005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54abfff700 1 -- 172.21.15.5:0/869734470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5494004430 msgr2=0x7f54940048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54abfff700 1 --2- 172.21.15.5:0/869734470 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5494004430 0x7f54940048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54abfff700 1 -- 172.21.15.5:0/869734470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54940035b0 con 0x7f5494003a00 2023-03-03T06:26:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54abfff700 1 --2- 172.21.15.5:0/869734470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5494003a00 0x7f5494003e10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c3a0 tx=0x7f5494005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d9712b95c557bb server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:07.972 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c007c60 con 0x7f5494003a00 2023-03-03T06:26:07.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c005960 con 0x7f5494003a00 2023-03-03T06:26:07.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.965+0000 7f54aaffd700 1 -- 172.21.15.5:0/869734470 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00cea0 con 0x7f5494003a00 2023-03-03T06:26:07.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.966+0000 7f54b26a5700 1 -- 172.21.15.5:0/869734470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5494003a00 msgr2=0x7f5494003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:07.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.966+0000 7f54b26a5700 1 --2- 172.21.15.5:0/869734470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5494003a00 0x7f5494003e10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c3a0 tx=0x7f5494005880 comp rx=0 tx=0).stop 2023-03-03T06:26:07.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.966+0000 7f54b0c42700 1 -- 172.21.15.5:0/869734470 reap_dead start 2023-03-03T06:26:07.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.966+0000 7f54b26a5700 1 -- 172.21.15.5:0/869734470 shutdown_connections 2023-03-03T06:26:07.973 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.966+0000 7f54b26a5700 1 -- 172.21.15.5:0/869734470 >> 172.21.15.5:0/869734470 conn(0x7f54ac0cf4b0 msgr2=0x7f54ac0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:07.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.966+0000 7f54b26a5700 1 -- 172.21.15.5:0/869734470 shutdown_connections 2023-03-03T06:26:07.974 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.966+0000 7f54b26a5700 1 -- 172.21.15.5:0/869734470 wait complete. 2023-03-03T06:26:07.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.967+0000 7f54b26a5700 1 Processor -- start 2023-03-03T06:26:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.967+0000 7f54b26a5700 1 -- start start 2023-03-03T06:26:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54b26a5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5494003a00 0x7f54ac0aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54b26a5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54ac145f20 0x7f54ac0b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54b26a5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ac1459d0 0x7f54ac0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.976 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54b26a5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac15bc60 con 0x7f5494003a00 2023-03-03T06:26:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54b26a5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac1446b0 con 0x7f54ac145f20 2023-03-03T06:26:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54b26a5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac154df0 con 0x7f54ac1459d0 2023-03-03T06:26:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54abfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5494003a00 0x7f54ac0aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54abfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5494003a00 0x7f54ac0aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45734/0 (socket says 172.21.15.5:45734) 2023-03-03T06:26:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54abfff700 1 -- 172.21.15.5:0/3496164719 learned_addr learned my addr 172.21.15.5:0/3496164719 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54b0c42700 1 --2- 172.21.15.5:0/3496164719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ac1459d0 0x7f54ac0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.977 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54ab7fe700 1 --2- 172.21.15.5:0/3496164719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54ac145f20 0x7f54ac0b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54abfff700 1 -- 172.21.15.5:0/3496164719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ac1459d0 msgr2=0x7f54ac0b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54abfff700 1 --2- 172.21.15.5:0/3496164719 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f54ac1459d0 0x7f54ac0b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54abfff700 1 -- 172.21.15.5:0/3496164719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54ac145f20 msgr2=0x7f54ac0b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54abfff700 1 --2- 172.21.15.5:0/3496164719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f54ac145f20 0x7f54ac0b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.968+0000 7f54abfff700 1 -- 172.21.15.5:0/3496164719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac06b470 con 0x7f5494003a00 2023-03-03T06:26:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.969+0000 7f54abfff700 1 --2- 172.21.15.5:0/3496164719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5494003a00 0x7f54ac0aebd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f549c001930 tx=0x7f549c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:07.978 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.969+0000 7f54a8ff9700 1 -- 172.21.15.5:0/3496164719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c004870 con 0x7f5494003a00 2023-03-03T06:26:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.969+0000 7f54a8ff9700 1 -- 172.21.15.5:0/3496164719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0049d0 con 0x7f5494003a00 2023-03-03T06:26:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.969+0000 7f54a8ff9700 1 -- 172.21.15.5:0/3496164719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c004d80 con 0x7f5494003a00 2023-03-03T06:26:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.969+0000 7f54b26a5700 1 -- 172.21.15.5:0/3496164719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ac159a30 con 0x7f5494003a00 2023-03-03T06:26:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.969+0000 7f54b26a5700 1 -- 172.21.15.5:0/3496164719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ac06b750 con 0x7f5494003a00 2023-03-03T06:26:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.970+0000 7f54b26a5700 1 -- 172.21.15.5:0/3496164719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ac144990 con 0x7f5494003a00 2023-03-03T06:26:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.970+0000 7f54a8ff9700 1 -- 172.21.15.5:0/3496164719 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f549c010070 con 0x7f5494003a00 2023-03-03T06:26:07.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.971+0000 7f54a8ff9700 1 --2- 172.21.15.5:0/3496164719 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f54980682f0 0x7f549806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.971+0000 7f54a8ff9700 1 -- 172.21.15.5:0/3496164719 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f549c0872b0 con 0x7f5494003a00 2023-03-03T06:26:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.971+0000 7f54ab7fe700 1 --2- 172.21.15.5:0/3496164719 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f54980682f0 0x7f549806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.971+0000 7f54ab7fe700 1 --2- 172.21.15.5:0/3496164719 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f54980682f0 0x7f549806a7a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f54ac071ad0 tx=0x7f54a0009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:07.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:07.975+0000 7f54a8ff9700 1 -- 172.21.15.5:0/3496164719 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f549c053570 con 0x7f5494003a00 2023-03-03T06:26:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.168+0000 7f54b26a5700 1 -- 172.21.15.5:0/3496164719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f54ac04e6e0 con 0x7f5494003a00 2023-03-03T06:26:08.171 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.169+0000 7f54a8ff9700 1 -- 172.21.15.5:0/3496164719 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_metadata_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v72) v1 ==== 304+0+0 (secure 0 0 0) 0x7f549c007dc0 con 0x7f5494003a00 2023-03-03T06:26:08.172 INFO:teuthology.orchestra.run.smithi005.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-03-03T06:26:08.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T06:26:08.176 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-03-03T06:26:08.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:26:08.213 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:26:08.261 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-03-03T06:26:08.262 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:26:08.262 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:26:08.280 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:26:08.280 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:26:08.338 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:26:08.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.502+0000 7f2e9b0f7700 1 Processor -- start 2023-03-03T06:26:08.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.502+0000 7f2e9b0f7700 1 -- start start 2023-03-03T06:26:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.503+0000 7f2e9b0f7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e94159550 0x7f2e9415dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.503+0000 7f2e9b0f7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2e940cebc0 0x7f2e940cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.503+0000 7f2e9b0f7700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9406e3f0 con 0x7f2e9406d1b0 2023-03-03T06:26:08.506 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.503+0000 7f2e9b0f7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e940cf580 con 0x7f2e940cebc0 2023-03-03T06:26:08.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.503+0000 7f2e9b0f7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9406e6d0 con 0x7f2e94159550 2023-03-03T06:26:08.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.503+0000 7f2e93fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2e9406d1b0 0x7f2e9406dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35584/0 (socket says 172.21.15.5:35584) 2023-03-03T06:26:08.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.503+0000 7f2e93fff700 1 -- 172.21.15.5:0/1968515409 learned_addr learned my addr 172.21.15.5:0/1968515409 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:08.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.503+0000 7f2e98e93700 1 --2- 172.21.15.5:0/1968515409 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e94159550 0x7f2e9415dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:08.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.503+0000 7f2e99694700 1 --2- 172.21.15.5:0/1968515409 >> v2:172.21.15.191:3300/0 conn(0x7f2e940cebc0 0x7f2e940cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:08.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.503+0000 7f2e937fe700 1 -- 172.21.15.5:0/1968515409 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664697164 0 0) 0x7f2e9406e3f0 con 0x7f2e9406d1b0 2023-03-03T06:26:08.507 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.503+0000 7f2e937fe700 1 -- 172.21.15.5:0/1968515409 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e840035b0 con 0x7f2e9406d1b0 2023-03-03T06:26:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.504+0000 7f2e937fe700 1 -- 172.21.15.5:0/1968515409 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 493928124 0 0) 0x7f2e840035b0 con 0x7f2e9406d1b0 2023-03-03T06:26:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.504+0000 7f2e99694700 1 -- 172.21.15.5:0/1968515409 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e94159550 msgr2=0x7f2e9415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.504+0000 7f2e99694700 1 --2- 172.21.15.5:0/1968515409 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e94159550 0x7f2e9415dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.504+0000 7f2e99694700 1 -- 172.21.15.5:0/1968515409 >> v1:172.21.15.5:6789/0 conn(0x7f2e9406d1b0 legacy=0x7f2e9406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.504+0000 7f2e99694700 1 -- 172.21.15.5:0/1968515409 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9406c6d0 con 0x7f2e940cebc0 2023-03-03T06:26:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.504+0000 7f2e98e93700 1 --2- 172.21.15.5:0/1968515409 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e94159550 0x7f2e9415dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:26:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.504+0000 7f2e99694700 1 --2- 172.21.15.5:0/1968515409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e940cebc0 0x7f2e940cf040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009d90 tx=0x7f2e8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2be7ee71600fb1a5 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.504+0000 7f2e937fe700 1 -- 172.21.15.5:0/1968515409 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00e070 con 0x7f2e940cebc0 2023-03-03T06:26:08.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.504+0000 7f2e937fe700 1 -- 172.21.15.5:0/1968515409 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c003a20 con 0x7f2e940cebc0 2023-03-03T06:26:08.509 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.504+0000 7f2e937fe700 1 -- 172.21.15.5:0/1968515409 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80001670 con 0x7f2e940cebc0 2023-03-03T06:26:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.505+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/1968515409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e940cebc0 msgr2=0x7f2e940cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.505+0000 7f2e9b0f7700 1 --2- 172.21.15.5:0/1968515409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e940cebc0 0x7f2e940cf040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009d90 tx=0x7f2e8c00b330 comp rx=0 tx=0).stop 2023-03-03T06:26:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.505+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/1968515409 shutdown_connections 2023-03-03T06:26:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.505+0000 7f2e9b0f7700 1 --2- 172.21.15.5:0/1968515409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e940cebc0 0x7f2e940cf040 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.505+0000 7f2e9b0f7700 1 --2- 172.21.15.5:0/1968515409 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e94159550 0x7f2e9415dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.505+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/1968515409 >> 172.21.15.5:0/1968515409 conn(0x7f2e940cfd00 msgr2=0x7f2e940d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:08.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.505+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/1968515409 shutdown_connections 2023-03-03T06:26:08.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.505+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/1968515409 wait complete. 2023-03-03T06:26:08.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.506+0000 7f2e9b0f7700 1 Processor -- start 2023-03-03T06:26:08.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.506+0000 7f2e9b0f7700 1 -- start start 2023-03-03T06:26:08.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.507+0000 7f2e9b0f7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9406d1b0 0x7f2e940c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:08.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.507+0000 7f2e9b0f7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e940cebc0 0x7f2e941f1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:08.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.507+0000 7f2e9b0f7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e94159550 0x7f2e94155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:08.512 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.507+0000 7f2e9b0f7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94154ee0 con 0x7f2e9406d1b0 2023-03-03T06:26:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.507+0000 7f2e9b0f7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e941550f0 con 0x7f2e94159550 2023-03-03T06:26:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e9b0f7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e941553d0 con 0x7f2e940cebc0 2023-03-03T06:26:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e98e93700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9406d1b0 0x7f2e940c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e98e93700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9406d1b0 0x7f2e940c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45748/0 (socket says 172.21.15.5:45748) 2023-03-03T06:26:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e98e93700 1 -- 172.21.15.5:0/3380344050 learned_addr learned my addr 172.21.15.5:0/3380344050 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e98e93700 1 -- 172.21.15.5:0/3380344050 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e940cebc0 msgr2=0x7f2e941f1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:08.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e99694700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e94159550 0x7f2e94155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e93fff700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e940cebc0 0x7f2e941f1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e98e93700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e940cebc0 0x7f2e941f1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e98e93700 1 -- 172.21.15.5:0/3380344050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e94159550 msgr2=0x7f2e94155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e98e93700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e94159550 0x7f2e94155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e98e93700 1 -- 172.21.15.5:0/3380344050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e880094a0 con 0x7f2e9406d1b0 2023-03-03T06:26:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e98e93700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9406d1b0 0x7f2e940c9860 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800ebe0 tx=0x7f2e88009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e917fa700 1 -- 172.21.15.5:0/3380344050 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800c8b0 con 0x7f2e9406d1b0 2023-03-03T06:26:08.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e917fa700 1 -- 172.21.15.5:0/3380344050 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8800ca10 con 0x7f2e9406d1b0 2023-03-03T06:26:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/3380344050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c009a70 con 0x7f2e9406d1b0 2023-03-03T06:26:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e917fa700 1 -- 172.21.15.5:0/3380344050 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800cda0 con 0x7f2e9406d1b0 2023-03-03T06:26:08.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.508+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/3380344050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9406cc90 con 0x7f2e9406d1b0 2023-03-03T06:26:08.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.509+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/3380344050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9406c9b0 con 0x7f2e9406d1b0 2023-03-03T06:26:08.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.510+0000 7f2e917fa700 1 -- 172.21.15.5:0/3380344050 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2e88019030 con 0x7f2e9406d1b0 2023-03-03T06:26:08.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.510+0000 7f2e917fa700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2e780682f0 0x7f2e7806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:08.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.510+0000 7f2e917fa700 1 -- 172.21.15.5:0/3380344050 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f2e88086230 con 0x7f2e9406d1b0 2023-03-03T06:26:08.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.510+0000 7f2e93fff700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2e780682f0 0x7f2e7806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:08.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.510+0000 7f2e93fff700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2e780682f0 0x7f2e7806a7a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2e800011e0 tx=0x7f2e80009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:08.517 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.514+0000 7f2e917fa700 1 -- 172.21.15.5:0/3380344050 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2e880524f0 con 0x7f2e9406d1b0 2023-03-03T06:26:08.713 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.711+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/3380344050 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e9406d840 con 0x7f2e9406d1b0 2023-03-03T06:26:08.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.713+0000 7f2e917fa700 1 -- 172.21.15.5:0/3380344050 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+23317 (secure 0 0 0) 0x7f2e88055b10 con 0x7f2e9406d1b0 2023-03-03T06:26:08.715 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:08.715 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":72,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:26:07.433188+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:54.356683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:55.044358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_data_pool","create_time":"2023-03-03T06:26:03.629103+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":72,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"test_metadata_pool","create_time":"2023-03-03T06:26:04.826705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":13,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":13,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:26:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.715+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/3380344050 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2e780682f0 msgr2=0x7f2e7806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.715+0000 7f2e9b0f7700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2e780682f0 0x7f2e7806a7a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2e800011e0 tx=0x7f2e80009040 comp rx=0 tx=0).stop 2023-03-03T06:26:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.715+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/3380344050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9406d1b0 msgr2=0x7f2e940c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.715+0000 7f2e9b0f7700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9406d1b0 0x7f2e940c9860 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800ebe0 tx=0x7f2e88009e20 comp rx=0 tx=0).stop 2023-03-03T06:26:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.715+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/3380344050 shutdown_connections 2023-03-03T06:26:08.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.715+0000 7f2e9b0f7700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2e94159550 0x7f2e94155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.715+0000 7f2e9b0f7700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2e9406d1b0 0x7f2e940c9860 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.715+0000 7f2e9b0f7700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2e780682f0 0x7f2e7806a7a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.715+0000 7f2e9b0f7700 1 --2- 172.21.15.5:0/3380344050 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2e940cebc0 0x7f2e941f1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.715+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/3380344050 >> 172.21.15.5:0/3380344050 conn(0x7f2e940cfd00 msgr2=0x7f2e940b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.715+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/3380344050 shutdown_connections 2023-03-03T06:26:08.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.715+0000 7f2e9b0f7700 1 -- 172.21.15.5:0/3380344050 wait complete. 2023-03-03T06:26:08.729 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'snap-test-pool', 'create_time': '2023-03-03T06:25:02.648527+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:25:54.356683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:25:55.044358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_data_pool', 'create_time': '2023-03-03T06:26:03.629103+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 72, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'test_metadata_pool', 'create_time': '2023-03-03T06:26:04.826705+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T06:26:08.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:26:08.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.856+0000 7f61cba4b700 1 Processor -- start 2023-03-03T06:26:08.858 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.856+0000 7f61cba4b700 1 -- start start 2023-03-03T06:26:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61cba4b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61c4158c00 0x7f61c415d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61cba4b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f61c40ca030 0x7f61c406d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61cba4b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f61c406dbe0 0x7f61c4071590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61cba4b700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c406e060 con 0x7f61c406dbe0 2023-03-03T06:26:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61cba4b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c415d750 con 0x7f61c40ca030 2023-03-03T06:26:08.860 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61cba4b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c406afa0 con 0x7f61c4158c00 2023-03-03T06:26:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61c9fe8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f61c406dbe0 0x7f61c4071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61c9fe8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f61c406dbe0 0x7f61c4071590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45760/0 (socket says 172.21.15.5:45760) 2023-03-03T06:26:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61c9fe8700 1 -- 172.21.15.5:0/3009789190 learned_addr learned my addr 172.21.15.5:0/3009789190 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61c97e7700 1 --2- 172.21.15.5:0/3009789190 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61c4158c00 0x7f61c415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61c8fe6700 1 --2- 172.21.15.5:0/3009789190 >> v2:172.21.15.191:3300/0 conn(0x7f61c40ca030 0x7f61c406d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61c9fe8700 1 -- 172.21.15.5:0/3009789190 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61c4158c00 msgr2=0x7f61c415d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:08.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61c9fe8700 1 --2- 172.21.15.5:0/3009789190 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61c4158c00 0x7f61c415d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61c9fe8700 1 -- 172.21.15.5:0/3009789190 >> v2:172.21.15.191:3300/0 conn(0x7f61c40ca030 msgr2=0x7f61c406d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:08.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61c9fe8700 1 --2- 172.21.15.5:0/3009789190 >> v2:172.21.15.191:3300/0 conn(0x7f61c40ca030 0x7f61c406d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61c9fe8700 1 -- 172.21.15.5:0/3009789190 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c40cb400 con 0x7f61c406dbe0 2023-03-03T06:26:08.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.857+0000 7f61c97e7700 1 --2- 172.21.15.5:0/3009789190 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61c4158c00 0x7f61c415d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:08.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.858+0000 7f61c9fe8700 1 --2- 172.21.15.5:0/3009789190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c406dbe0 0x7f61c4071590 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f61c40702d0 tx=0x7f61bc00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b59878e784aa02 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:08.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.858+0000 7f61bbfff700 1 -- 172.21.15.5:0/3009789190 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc010070 con 0x7f61c406dbe0 2023-03-03T06:26:08.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.858+0000 7f61bbfff700 1 -- 172.21.15.5:0/3009789190 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc00dd80 con 0x7f61c406dbe0 2023-03-03T06:26:08.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.858+0000 7f61bbfff700 1 -- 172.21.15.5:0/3009789190 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc00b310 con 0x7f61c406dbe0 2023-03-03T06:26:08.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.858+0000 7f61cba4b700 1 -- 172.21.15.5:0/3009789190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c406dbe0 msgr2=0x7f61c4071590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:08.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.858+0000 7f61cba4b700 1 --2- 172.21.15.5:0/3009789190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c406dbe0 0x7f61c4071590 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f61c40702d0 tx=0x7f61bc00d460 comp rx=0 tx=0).stop 2023-03-03T06:26:08.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.858+0000 7f61cba4b700 1 -- 172.21.15.5:0/3009789190 shutdown_connections 2023-03-03T06:26:08.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.858+0000 7f61cba4b700 1 --2- 172.21.15.5:0/3009789190 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61c4158c00 0x7f61c415d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.858+0000 7f61cba4b700 1 --2- 172.21.15.5:0/3009789190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c406dbe0 0x7f61c4071590 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.858+0000 7f61cba4b700 1 --2- 172.21.15.5:0/3009789190 >> v2:172.21.15.191:3300/0 conn(0x7f61c40ca030 0x7f61c406d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.858+0000 7f61cba4b700 1 -- 172.21.15.5:0/3009789190 >> 172.21.15.5:0/3009789190 conn(0x7f61c40b1c50 msgr2=0x7f61c40cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:08.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.858+0000 7f61cba4b700 1 -- 172.21.15.5:0/3009789190 shutdown_connections 2023-03-03T06:26:08.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.858+0000 7f61cba4b700 1 -- 172.21.15.5:0/3009789190 wait complete. 2023-03-03T06:26:08.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.860+0000 7f61cba4b700 1 Processor -- start 2023-03-03T06:26:08.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.860+0000 7f61cba4b700 1 -- start start 2023-03-03T06:26:08.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.860+0000 7f61cba4b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61c406dbe0 0x7f61c415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:08.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.860+0000 7f61cba4b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c40ca030 0x7f61c4159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:08.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.860+0000 7f61cba4b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61c4158c00 0x7f61c40c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:08.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.860+0000 7f61cba4b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40c3560 con 0x7f61c40ca030 2023-03-03T06:26:08.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.860+0000 7f61cba4b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c415bef0 con 0x7f61c406dbe0 2023-03-03T06:26:08.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.860+0000 7f61cba4b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40c37b0 con 0x7f61c4158c00 2023-03-03T06:26:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.860+0000 7f61c8fe6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c40ca030 0x7f61c4159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.860+0000 7f61c8fe6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c40ca030 0x7f61c4159240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45764/0 (socket says 172.21.15.5:45764) 2023-03-03T06:26:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.860+0000 7f61c8fe6700 1 -- 172.21.15.5:0/247918720 learned_addr learned my addr 172.21.15.5:0/247918720 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.861+0000 7f61c9fe8700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61c4158c00 0x7f61c40c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.861+0000 7f61c97e7700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61c406dbe0 0x7f61c415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.861+0000 7f61c8fe6700 1 -- 172.21.15.5:0/247918720 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61c4158c00 msgr2=0x7f61c40c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:08.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.861+0000 7f61c8fe6700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61c4158c00 0x7f61c40c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.861+0000 7f61c8fe6700 1 -- 172.21.15.5:0/247918720 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61c406dbe0 msgr2=0x7f61c415b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:08.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.861+0000 7f61c8fe6700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61c406dbe0 0x7f61c415b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:08.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.861+0000 7f61c8fe6700 1 -- 172.21.15.5:0/247918720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc00bd40 con 0x7f61c40ca030 2023-03-03T06:26:08.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.861+0000 7f61c8fe6700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c40ca030 0x7f61c4159240 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f61b400e810 tx=0x7f61b400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:08.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.861+0000 7f61b9ffb700 1 -- 172.21.15.5:0/247918720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b400c070 con 0x7f61c40ca030 2023-03-03T06:26:08.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.861+0000 7f61b9ffb700 1 -- 172.21.15.5:0/247918720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b4013610 con 0x7f61c40ca030 2023-03-03T06:26:08.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.861+0000 7f61cba4b700 1 -- 172.21.15.5:0/247918720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c40caad0 con 0x7f61c40ca030 2023-03-03T06:26:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.861+0000 7f61b9ffb700 1 -- 172.21.15.5:0/247918720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b40139c0 con 0x7f61c40ca030 2023-03-03T06:26:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.861+0000 7f61cba4b700 1 -- 172.21.15.5:0/247918720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c40ca7f0 con 0x7f61c40ca030 2023-03-03T06:26:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.862+0000 7f61cba4b700 1 -- 172.21.15.5:0/247918720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c40cadb0 con 0x7f61c40ca030 2023-03-03T06:26:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.863+0000 7f61b9ffb700 1 -- 172.21.15.5:0/247918720 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f61b4023070 con 0x7f61c40ca030 2023-03-03T06:26:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.863+0000 7f61b9ffb700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61a80682f0 0x7f61a806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.863+0000 7f61b9ffb700 1 -- 172.21.15.5:0/247918720 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f61b4085fd0 con 0x7f61c40ca030 2023-03-03T06:26:08.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.863+0000 7f61c97e7700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61a80682f0 0x7f61a806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.864+0000 7f61c97e7700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61a80682f0 0x7f61a806a7a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f61c0006fd0 tx=0x7f61c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:08.872 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:08.867+0000 7f61b9ffb700 1 -- 172.21.15.5:0/247918720 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f61b4052210 con 0x7f61c40ca030 2023-03-03T06:26:09.062 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.060+0000 7f61cba4b700 1 -- 172.21.15.5:0/247918720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f61c404e6e0 con 0x7f61c40ca030 2023-03-03T06:26:09.063 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.061+0000 7f61b9ffb700 1 -- 172.21.15.5:0/247918720 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v72) v1 ==== 92+0+10 (secure 0 0 0) 0x7f61b400f040 con 0x7f61c40ca030 2023-03-03T06:26:09.063 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:26:09.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.062+0000 7f61cba4b700 1 -- 172.21.15.5:0/247918720 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61a80682f0 msgr2=0x7f61a806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.062+0000 7f61cba4b700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61a80682f0 0x7f61a806a7a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f61c0006fd0 tx=0x7f61c0008040 comp rx=0 tx=0).stop 2023-03-03T06:26:09.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.063+0000 7f61cba4b700 1 -- 172.21.15.5:0/247918720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c40ca030 msgr2=0x7f61c4159240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.065 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.063+0000 7f61cba4b700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c40ca030 0x7f61c4159240 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f61b400e810 tx=0x7f61b400eb20 comp rx=0 tx=0).stop 2023-03-03T06:26:09.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.063+0000 7f61cba4b700 1 -- 172.21.15.5:0/247918720 shutdown_connections 2023-03-03T06:26:09.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.063+0000 7f61cba4b700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f61a80682f0 0x7f61a806a7a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.063+0000 7f61cba4b700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f61c4158c00 0x7f61c40c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.063+0000 7f61cba4b700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61c406dbe0 0x7f61c415b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.063+0000 7f61cba4b700 1 --2- 172.21.15.5:0/247918720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61c40ca030 0x7f61c4159240 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.063+0000 7f61cba4b700 1 -- 172.21.15.5:0/247918720 >> 172.21.15.5:0/247918720 conn(0x7f61c40b1c50 msgr2=0x7f61c40cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:09.066 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.063+0000 7f61cba4b700 1 -- 172.21.15.5:0/247918720 shutdown_connections 2023-03-03T06:26:09.067 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.063+0000 7f61cba4b700 1 -- 172.21.15.5:0/247918720 wait complete. 2023-03-03T06:26:09.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:26:09.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.202+0000 7fc9c0369700 1 Processor -- start 2023-03-03T06:26:09.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.202+0000 7fc9c0369700 1 -- start start 2023-03-03T06:26:09.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9c0369700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9b815a7b0 0x7fc9b815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9c0369700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9b80cde30 0x7fc9b80cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9c0369700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc9b806b700 0x7fc9b806bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9c0369700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b806c040 con 0x7fc9b80cde30 2023-03-03T06:26:09.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9c0369700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b80cf5c0 con 0x7fc9b806b700 2023-03-03T06:26:09.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9c0369700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80cf8a0 con 0x7fc9b815a7b0 2023-03-03T06:26:09.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9bd904700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9b80cde30 0x7fc9b80cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9bd904700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc9b80cde30 0x7fc9b80cec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45770/0 (socket says 172.21.15.5:45770) 2023-03-03T06:26:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9bd904700 1 -- 172.21.15.5:0/1433441180 learned_addr learned my addr 172.21.15.5:0/1433441180 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9be105700 1 --2- 172.21.15.5:0/1433441180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9b815a7b0 0x7fc9b815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9be906700 1 --2- 172.21.15.5:0/1433441180 >> v2:172.21.15.191:3300/0 conn(0x7fc9b806b700 0x7fc9b806bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9bd904700 1 -- 172.21.15.5:0/1433441180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9b815a7b0 msgr2=0x7fc9b815ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9bd904700 1 --2- 172.21.15.5:0/1433441180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9b815a7b0 0x7fc9b815ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9bd904700 1 -- 172.21.15.5:0/1433441180 >> v2:172.21.15.191:3300/0 conn(0x7fc9b806b700 msgr2=0x7fc9b806bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9bd904700 1 --2- 172.21.15.5:0/1433441180 >> v2:172.21.15.191:3300/0 conn(0x7fc9b806b700 0x7fc9b806bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.203+0000 7fc9bd904700 1 -- 172.21.15.5:0/1433441180 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80cfb80 con 0x7fc9b80cde30 2023-03-03T06:26:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.204+0000 7fc9bd904700 1 --2- 172.21.15.5:0/1433441180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80cde30 0x7fc9b80cec70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80c6eb0 tx=0x7fc9b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b232d0f583fb52 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.204+0000 7fc9bd103700 1 -- 172.21.15.5:0/1433441180 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400b870 con 0x7fc9b80cde30 2023-03-03T06:26:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.204+0000 7fc9bd103700 1 -- 172.21.15.5:0/1433441180 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b400b9d0 con 0x7fc9b80cde30 2023-03-03T06:26:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.204+0000 7fc9bd103700 1 -- 172.21.15.5:0/1433441180 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400bd60 con 0x7fc9b80cde30 2023-03-03T06:26:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.204+0000 7fc9c0369700 1 -- 172.21.15.5:0/1433441180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80cde30 msgr2=0x7fc9b80cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.204+0000 7fc9c0369700 1 --2- 172.21.15.5:0/1433441180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80cde30 0x7fc9b80cec70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80c6eb0 tx=0x7fc9b4009bd0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.204+0000 7fc9c0369700 1 -- 172.21.15.5:0/1433441180 shutdown_connections 2023-03-03T06:26:09.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.204+0000 7fc9c0369700 1 --2- 172.21.15.5:0/1433441180 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9b815a7b0 0x7fc9b815ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.204+0000 7fc9c0369700 1 --2- 172.21.15.5:0/1433441180 >> v2:172.21.15.191:3300/0 conn(0x7fc9b806b700 0x7fc9b806bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.204+0000 7fc9c0369700 1 --2- 172.21.15.5:0/1433441180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b80cde30 0x7fc9b80cec70 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.204+0000 7fc9c0369700 1 -- 172.21.15.5:0/1433441180 >> 172.21.15.5:0/1433441180 conn(0x7fc9b80cc8d0 msgr2=0x7fc9b80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:09.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.204+0000 7fc9c0369700 1 -- 172.21.15.5:0/1433441180 shutdown_connections 2023-03-03T06:26:09.210 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.204+0000 7fc9c0369700 1 -- 172.21.15.5:0/1433441180 wait complete. 2023-03-03T06:26:09.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.206+0000 7fc9c0369700 1 Processor -- start 2023-03-03T06:26:09.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.206+0000 7fc9c0369700 1 -- start start 2023-03-03T06:26:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.207+0000 7fc9c0369700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9b806b700 0x7fc9b80af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.207+0000 7fc9c0369700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9b80cde30 0x7fc9b8148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.207+0000 7fc9c0369700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b815a7b0 0x7fc9b80b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.207+0000 7fc9c0369700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80c9a50 con 0x7fc9b815a7b0 2023-03-03T06:26:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.207+0000 7fc9c0369700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80c95c0 con 0x7fc9b806b700 2023-03-03T06:26:09.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.207+0000 7fc9c0369700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8149470 con 0x7fc9b80cde30 2023-03-03T06:26:09.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.207+0000 7fc9be906700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b815a7b0 0x7fc9b80b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.207+0000 7fc9be906700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b815a7b0 0x7fc9b80b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45778/0 (socket says 172.21.15.5:45778) 2023-03-03T06:26:09.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.207+0000 7fc9be906700 1 -- 172.21.15.5:0/3156653724 learned_addr learned my addr 172.21.15.5:0/3156653724 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:09.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.207+0000 7fc9bd904700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9b80cde30 0x7fc9b8148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.207+0000 7fc9be105700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9b806b700 0x7fc9b80af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.207+0000 7fc9be906700 1 -- 172.21.15.5:0/3156653724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9b80cde30 msgr2=0x7fc9b8148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.207+0000 7fc9be906700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9b80cde30 0x7fc9b8148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.208+0000 7fc9be906700 1 -- 172.21.15.5:0/3156653724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9b806b700 msgr2=0x7fc9b80af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.208+0000 7fc9be906700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9b806b700 0x7fc9b80af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.208+0000 7fc9be906700 1 -- 172.21.15.5:0/3156653724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b4009550 con 0x7fc9b815a7b0 2023-03-03T06:26:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.208+0000 7fc9be105700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9b806b700 0x7fc9b80af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.208+0000 7fc9bd904700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9b80cde30 0x7fc9b8148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.208+0000 7fc9be906700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b815a7b0 0x7fc9b80b1b70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0007d20 tx=0x7fc9b000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:09.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.208+0000 7fc9aeffd700 1 -- 172.21.15.5:0/3156653724 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b000ede0 con 0x7fc9b815a7b0 2023-03-03T06:26:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.208+0000 7fc9aeffd700 1 -- 172.21.15.5:0/3156653724 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b0014420 con 0x7fc9b815a7b0 2023-03-03T06:26:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.208+0000 7fc9c0369700 1 -- 172.21.15.5:0/3156653724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b80b3020 con 0x7fc9b815a7b0 2023-03-03T06:26:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.208+0000 7fc9aeffd700 1 -- 172.21.15.5:0/3156653724 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00147d0 con 0x7fc9b815a7b0 2023-03-03T06:26:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.208+0000 7fc9c0369700 1 -- 172.21.15.5:0/3156653724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b80b2d40 con 0x7fc9b815a7b0 2023-03-03T06:26:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.209+0000 7fc9c0369700 1 -- 172.21.15.5:0/3156653724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b80cf1b0 con 0x7fc9b815a7b0 2023-03-03T06:26:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.209+0000 7fc9aeffd700 1 -- 172.21.15.5:0/3156653724 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc9b0012050 con 0x7fc9b815a7b0 2023-03-03T06:26:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.210+0000 7fc9aeffd700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc99c0682f0 0x7fc99c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.210+0000 7fc9aeffd700 1 -- 172.21.15.5:0/3156653724 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7fc9b0086810 con 0x7fc9b815a7b0 2023-03-03T06:26:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.210+0000 7fc9be105700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc99c0682f0 0x7fc99c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.210+0000 7fc9be105700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc99c0682f0 0x7fc99c06a7a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80099f0 tx=0x7fc9a8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:09.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.214+0000 7fc9aeffd700 1 -- 172.21.15.5:0/3156653724 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc9b0052a70 con 0x7fc9b815a7b0 2023-03-03T06:26:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.407+0000 7fc9c0369700 1 -- 172.21.15.5:0/3156653724 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9b80c9770 con 0x7fc9b815a7b0 2023-03-03T06:26:09.409 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.407+0000 7fc9aeffd700 1 -- 172.21.15.5:0/3156653724 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9b80c9770 con 0x7fc9b815a7b0 2023-03-03T06:26:09.410 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:26:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.409+0000 7fc9c0369700 1 -- 172.21.15.5:0/3156653724 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc99c0682f0 msgr2=0x7fc99c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.411 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.409+0000 7fc9c0369700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc99c0682f0 0x7fc99c06a7a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80099f0 tx=0x7fc9a8008040 comp rx=0 tx=0).stop 2023-03-03T06:26:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.409+0000 7fc9c0369700 1 -- 172.21.15.5:0/3156653724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b815a7b0 msgr2=0x7fc9b80b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.409+0000 7fc9c0369700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b815a7b0 0x7fc9b80b1b70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0007d20 tx=0x7fc9b000e3c0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.409+0000 7fc9c0369700 1 -- 172.21.15.5:0/3156653724 shutdown_connections 2023-03-03T06:26:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.409+0000 7fc9c0369700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9b815a7b0 0x7fc9b80b1b70 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.409+0000 7fc9c0369700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9b806b700 0x7fc9b80af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.409+0000 7fc9c0369700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc99c0682f0 0x7fc99c06a7a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.412 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.409+0000 7fc9c0369700 1 --2- 172.21.15.5:0/3156653724 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc9b80cde30 0x7fc9b8148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.409+0000 7fc9c0369700 1 -- 172.21.15.5:0/3156653724 >> 172.21.15.5:0/3156653724 conn(0x7fc9b80cc8d0 msgr2=0x7fc9b81e3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.409+0000 7fc9c0369700 1 -- 172.21.15.5:0/3156653724 shutdown_connections 2023-03-03T06:26:09.413 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.409+0000 7fc9c0369700 1 -- 172.21.15.5:0/3156653724 wait complete. 2023-03-03T06:26:09.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-03-03T06:26:09.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.549+0000 7f426bee0700 1 Processor -- start 2023-03-03T06:26:09.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.550+0000 7f426bee0700 1 -- start start 2023-03-03T06:26:09.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.550+0000 7f426bee0700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f426415c950 0x7f4264160da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.550+0000 7f426bee0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640cb420 0x7f42640cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.550+0000 7f426bee0700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426415d020 con 0x7f426415d4b0 2023-03-03T06:26:09.555 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.550+0000 7f426bee0700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426415cd20 con 0x7f426415c950 2023-03-03T06:26:09.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.550+0000 7f426bee0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42641612e0 con 0x7f42640cb420 2023-03-03T06:26:09.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.551+0000 7f4269c7c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f426415c950 0x7f4264160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.551+0000 7f426a47d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f426415d4b0 0x7f42640ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35628/0 (socket says 172.21.15.5:35628) 2023-03-03T06:26:09.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.551+0000 7f426a47d700 1 -- 172.21.15.5:0/1277424011 learned_addr learned my addr 172.21.15.5:0/1277424011 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:09.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.551+0000 7f426947b700 1 --2- 172.21.15.5:0/1277424011 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640cb420 0x7f42640cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.551+0000 7f4269c7c700 1 -- 172.21.15.5:0/1277424011 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640cb420 msgr2=0x7f42640cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:09.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.551+0000 7f4269c7c700 1 --2- 172.21.15.5:0/1277424011 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640cb420 0x7f42640cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.551+0000 7f4269c7c700 1 -- 172.21.15.5:0/1277424011 >> v1:172.21.15.5:6789/0 conn(0x7f426415d4b0 legacy=0x7f42640ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.551+0000 7f4269c7c700 1 -- 172.21.15.5:0/1277424011 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640b2bf0 con 0x7f426415c950 2023-03-03T06:26:09.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.551+0000 7f426947b700 1 --2- 172.21.15.5:0/1277424011 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640cb420 0x7f42640cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:09.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.551+0000 7f4269c7c700 1 --2- 172.21.15.5:0/1277424011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f426415c950 0x7f4264160da0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4254009840 tx=0x7f4254009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7554388e03e359 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:09.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.551+0000 7f4268c7a700 1 -- 172.21.15.5:0/1277424011 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4254011830 con 0x7f426415c950 2023-03-03T06:26:09.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.551+0000 7f4268c7a700 1 -- 172.21.15.5:0/1277424011 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4254011990 con 0x7f426415c950 2023-03-03T06:26:09.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.551+0000 7f4268c7a700 1 -- 172.21.15.5:0/1277424011 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4254011d20 con 0x7f426415c950 2023-03-03T06:26:09.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.552+0000 7f426bee0700 1 -- 172.21.15.5:0/1277424011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f426415c950 msgr2=0x7f4264160da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.552+0000 7f426bee0700 1 --2- 172.21.15.5:0/1277424011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f426415c950 0x7f4264160da0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4254009840 tx=0x7f4254009b50 comp rx=0 tx=0).stop 2023-03-03T06:26:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.552+0000 7f426bee0700 1 -- 172.21.15.5:0/1277424011 shutdown_connections 2023-03-03T06:26:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.552+0000 7f426bee0700 1 --2- 172.21.15.5:0/1277424011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f426415c950 0x7f4264160da0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.552+0000 7f426bee0700 1 --2- 172.21.15.5:0/1277424011 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42640cb420 0x7f42640cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.552+0000 7f426bee0700 1 -- 172.21.15.5:0/1277424011 >> 172.21.15.5:0/1277424011 conn(0x7f4264070010 msgr2=0x7f42640cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.552+0000 7f426bee0700 1 -- 172.21.15.5:0/1277424011 shutdown_connections 2023-03-03T06:26:09.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.552+0000 7f426bee0700 1 -- 172.21.15.5:0/1277424011 wait complete. 2023-03-03T06:26:09.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.553+0000 7f426bee0700 1 Processor -- start 2023-03-03T06:26:09.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.553+0000 7f426bee0700 1 -- start start 2023-03-03T06:26:09.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426bee0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42640cb420 0x7f42640b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426bee0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f426415c950 0x7f42640c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426bee0700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f426415d4b0 0x7f42641f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426bee0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42641f58b0 con 0x7f426415c950 2023-03-03T06:26:09.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426bee0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640b6130 con 0x7f42640cb420 2023-03-03T06:26:09.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426bee0700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640c9c70 con 0x7f426415d4b0 2023-03-03T06:26:09.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426947b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f426415c950 0x7f42640c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426947b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f426415c950 0x7f42640c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45790/0 (socket says 172.21.15.5:45790) 2023-03-03T06:26:09.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426947b700 1 -- 172.21.15.5:0/2457818029 learned_addr learned my addr 172.21.15.5:0/2457818029 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:09.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f4269c7c700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42640cb420 0x7f42640b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426a47d700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f426415d4b0 0x7f42641f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426947b700 1 -- 172.21.15.5:0/2457818029 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f426415d4b0 msgr2=0x7f42641f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426947b700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f426415d4b0 0x7f42641f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426947b700 1 -- 172.21.15.5:0/2457818029 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42640cb420 msgr2=0x7f42640b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426947b700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42640cb420 0x7f42640b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.554+0000 7f426947b700 1 -- 172.21.15.5:0/2457818029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42540094a0 con 0x7f426415c950 2023-03-03T06:26:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.555+0000 7f426947b700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f426415c950 0x7f42640c9730 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f426000c780 tx=0x7f426000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.555+0000 7f425a7fc700 1 -- 172.21.15.5:0/2457818029 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260011800 con 0x7f426415c950 2023-03-03T06:26:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.555+0000 7f425a7fc700 1 -- 172.21.15.5:0/2457818029 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4260011960 con 0x7f426415c950 2023-03-03T06:26:09.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.555+0000 7f426bee0700 1 -- 172.21.15.5:0/2457818029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42640b31b0 con 0x7f426415c950 2023-03-03T06:26:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.555+0000 7f425a7fc700 1 -- 172.21.15.5:0/2457818029 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260011cd0 con 0x7f426415c950 2023-03-03T06:26:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.555+0000 7f426bee0700 1 -- 172.21.15.5:0/2457818029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42640b2ed0 con 0x7f426415c950 2023-03-03T06:26:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.556+0000 7f426bee0700 1 -- 172.21.15.5:0/2457818029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42640b0520 con 0x7f426415c950 2023-03-03T06:26:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.556+0000 7f425a7fc700 1 -- 172.21.15.5:0/2457818029 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4260020070 con 0x7f426415c950 2023-03-03T06:26:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.556+0000 7f425a7fc700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42480682f0 0x7f424806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.557+0000 7f425a7fc700 1 -- 172.21.15.5:0/2457818029 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f4260086130 con 0x7f426415c950 2023-03-03T06:26:09.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.557+0000 7f4269c7c700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42480682f0 0x7f424806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.557+0000 7f4269c7c700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42480682f0 0x7f424806a7a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f42540090b0 tx=0x7f4254008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:09.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.561+0000 7f425a7fc700 1 -- 172.21.15.5:0/2457818029 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4260052370 con 0x7f426415c950 2023-03-03T06:26:09.755 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.753+0000 7f426bee0700 1 -- 172.21.15.5:0/2457818029 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f426404e6e0 con 0x7f426415c950 2023-03-03T06:26:09.756 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.753+0000 7f425a7fc700 1 -- 172.21.15.5:0/2457818029 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v72) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4260055990 con 0x7f426415c950 2023-03-03T06:26:09.756 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:26:09.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.755+0000 7f426bee0700 1 -- 172.21.15.5:0/2457818029 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42480682f0 msgr2=0x7f424806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.755+0000 7f426bee0700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42480682f0 0x7f424806a7a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f42540090b0 tx=0x7f4254008030 comp rx=0 tx=0).stop 2023-03-03T06:26:09.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.755+0000 7f426bee0700 1 -- 172.21.15.5:0/2457818029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f426415c950 msgr2=0x7f42640c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.755+0000 7f426bee0700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f426415c950 0x7f42640c9730 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f426000c780 tx=0x7f426000cb40 comp rx=0 tx=0).stop 2023-03-03T06:26:09.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.755+0000 7f426bee0700 1 -- 172.21.15.5:0/2457818029 shutdown_connections 2023-03-03T06:26:09.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.755+0000 7f426bee0700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42480682f0 0x7f424806a7a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.755+0000 7f426bee0700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f426415d4b0 0x7f42641f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.755+0000 7f426bee0700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42640cb420 0x7f42640b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.755+0000 7f426bee0700 1 --2- 172.21.15.5:0/2457818029 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f426415c950 0x7f42640c9730 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.756+0000 7f426bee0700 1 -- 172.21.15.5:0/2457818029 >> 172.21.15.5:0/2457818029 conn(0x7f4264070010 msgr2=0x7f42640b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:09.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.756+0000 7f426bee0700 1 -- 172.21.15.5:0/2457818029 shutdown_connections 2023-03-03T06:26:09.760 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.756+0000 7f426bee0700 1 -- 172.21.15.5:0/2457818029 wait complete. 2023-03-03T06:26:09.769 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:26:09.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.895+0000 7fbff3294700 1 Processor -- start 2023-03-03T06:26:09.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.895+0000 7fbff3294700 1 -- start start 2023-03-03T06:26:09.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.896+0000 7fbff3294700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfec0cc460 0x7fbfec0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.896+0000 7fbff3294700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfec06bcd0 con 0x7fbfec1597d0 2023-03-03T06:26:09.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.896+0000 7fbff3294700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfec06cce0 con 0x7fbfec0b1f50 2023-03-03T06:26:09.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.896+0000 7fbff3294700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfec06bf20 con 0x7fbfec0cc460 2023-03-03T06:26:09.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.896+0000 7fbff1831700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfec0cc460 0x7fbfec0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.896+0000 7fbff1030700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbfec1597d0 0x7fbfec0b1840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35638/0 (socket says 172.21.15.5:35638) 2023-03-03T06:26:09.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.896+0000 7fbff1030700 1 -- 172.21.15.5:0/4090359934 learned_addr learned my addr 172.21.15.5:0/4090359934 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:09.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.896+0000 7fbff1831700 1 -- 172.21.15.5:0/4090359934 >> v1:172.21.15.191:6789/0 conn(0x7fbfec0b1f50 legacy=0x7fbfec0b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.896+0000 7fbff1831700 1 -- 172.21.15.5:0/4090359934 >> v1:172.21.15.5:6789/0 conn(0x7fbfec1597d0 legacy=0x7fbfec0b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.896+0000 7fbff1831700 1 -- 172.21.15.5:0/4090359934 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec06c200 con 0x7fbfec0cc460 2023-03-03T06:26:09.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.896+0000 7fbfe3fff700 1 -- 172.21.15.5:0/4090359934 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210022887 0 0) 0x7fbfec06bcd0 con 0x7fbfec1597d0 2023-03-03T06:26:09.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.897+0000 7fbff1831700 1 --2- 172.21.15.5:0/4090359934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfec0cc460 0x7fbfec0b58a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009d90 tx=0x7fbfe400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324aad3ac03bfaf1 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:09.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.897+0000 7fbfe3fff700 1 -- 172.21.15.5:0/4090359934 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe400e070 con 0x7fbfec0cc460 2023-03-03T06:26:09.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.897+0000 7fbfe3fff700 1 -- 172.21.15.5:0/4090359934 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe400bbd0 con 0x7fbfec0cc460 2023-03-03T06:26:09.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.897+0000 7fbfe3fff700 1 -- 172.21.15.5:0/4090359934 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4012430 con 0x7fbfec0cc460 2023-03-03T06:26:09.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.897+0000 7fbff3294700 1 -- 172.21.15.5:0/4090359934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfec0cc460 msgr2=0x7fbfec0b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.897+0000 7fbff3294700 1 --2- 172.21.15.5:0/4090359934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfec0cc460 0x7fbfec0b58a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009d90 tx=0x7fbfe400b330 comp rx=0 tx=0).stop 2023-03-03T06:26:09.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.897+0000 7fbff3294700 1 -- 172.21.15.5:0/4090359934 shutdown_connections 2023-03-03T06:26:09.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.897+0000 7fbff3294700 1 --2- 172.21.15.5:0/4090359934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfec0cc460 0x7fbfec0b58a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.897+0000 7fbff3294700 1 -- 172.21.15.5:0/4090359934 >> 172.21.15.5:0/4090359934 conn(0x7fbfec0cc840 msgr2=0x7fbfec0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:09.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.897+0000 7fbff3294700 1 -- 172.21.15.5:0/4090359934 shutdown_connections 2023-03-03T06:26:09.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.897+0000 7fbff3294700 1 -- 172.21.15.5:0/4090359934 wait complete. 2023-03-03T06:26:09.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.899+0000 7fbff3294700 1 Processor -- start 2023-03-03T06:26:09.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.899+0000 7fbff3294700 1 -- start start 2023-03-03T06:26:09.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.899+0000 7fbff3294700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfec0b1f50 0x7fbfec15ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.899+0000 7fbff3294700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfec1597d0 0x7fbfec148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.899+0000 7fbff3294700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfec157dd0 0x7fbfec158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.899+0000 7fbff3294700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec15c130 con 0x7fbfec0b1f50 2023-03-03T06:26:09.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.899+0000 7fbff3294700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec158780 con 0x7fbfec1597d0 2023-03-03T06:26:09.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.899+0000 7fbff3294700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec150580 con 0x7fbfec157dd0 2023-03-03T06:26:09.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff1030700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfec0b1f50 0x7fbfec15ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff1030700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfec0b1f50 0x7fbfec15ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45802/0 (socket says 172.21.15.5:45802) 2023-03-03T06:26:09.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff1030700 1 -- 172.21.15.5:0/3868269935 learned_addr learned my addr 172.21.15.5:0/3868269935 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:09.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff082f700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfec1597d0 0x7fbfec148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff1831700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfec157dd0 0x7fbfec158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff1030700 1 -- 172.21.15.5:0/3868269935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfec157dd0 msgr2=0x7fbfec158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff1030700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfec157dd0 0x7fbfec158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff1030700 1 -- 172.21.15.5:0/3868269935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfec1597d0 msgr2=0x7fbfec148020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:09.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff1030700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfec1597d0 0x7fbfec148020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:09.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff1030700 1 -- 172.21.15.5:0/3868269935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe4009a70 con 0x7fbfec0b1f50 2023-03-03T06:26:09.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff082f700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfec1597d0 0x7fbfec148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:09.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff1030700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfec0b1f50 0x7fbfec15ae40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00c520 tx=0x7fbfdc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:09.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbfe1ffb700 1 -- 172.21.15.5:0/3868269935 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc004c80 con 0x7fbfec0b1f50 2023-03-03T06:26:09.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbfe1ffb700 1 -- 172.21.15.5:0/3868269935 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc004e00 con 0x7fbfec0b1f50 2023-03-03T06:26:09.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff3294700 1 -- 172.21.15.5:0/3868269935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfec06c7c0 con 0x7fbfec0b1f50 2023-03-03T06:26:09.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbfe1ffb700 1 -- 172.21.15.5:0/3868269935 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc007310 con 0x7fbfec0b1f50 2023-03-03T06:26:09.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.900+0000 7fbff3294700 1 -- 172.21.15.5:0/3868269935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfec06c4e0 con 0x7fbfec0b1f50 2023-03-03T06:26:09.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.901+0000 7fbff3294700 1 -- 172.21.15.5:0/3868269935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfec159ba0 con 0x7fbfec0b1f50 2023-03-03T06:26:09.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.902+0000 7fbfe1ffb700 1 -- 172.21.15.5:0/3868269935 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbfdc01a020 con 0x7fbfec0b1f50 2023-03-03T06:26:09.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.902+0000 7fbfe1ffb700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbfd00682f0 0x7fbfd006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:09.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.902+0000 7fbfe1ffb700 1 -- 172.21.15.5:0/3868269935 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7fbfdc085e30 con 0x7fbfec0b1f50 2023-03-03T06:26:09.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.902+0000 7fbff082f700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbfd00682f0 0x7fbfd006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:09.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.903+0000 7fbff082f700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbfd00682f0 0x7fbfd006a7a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0c68d0 tx=0x7fbfe8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:09.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:09.907+0000 7fbfe1ffb700 1 -- 172.21.15.5:0/3868269935 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbfdc0520f0 con 0x7fbfec0b1f50 2023-03-03T06:26:10.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.101+0000 7fbff3294700 1 -- 172.21.15.5:0/3868269935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbfec15c270 con 0x7fbfec0b1f50 2023-03-03T06:26:10.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.101+0000 7fbfe1ffb700 1 -- 172.21.15.5:0/3868269935 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbfdc055710 con 0x7fbfec0b1f50 2023-03-03T06:26:10.104 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:26:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.103+0000 7fbff3294700 1 -- 172.21.15.5:0/3868269935 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbfd00682f0 msgr2=0x7fbfd006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.103+0000 7fbff3294700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbfd00682f0 0x7fbfd006a7a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0c68d0 tx=0x7fbfe8009040 comp rx=0 tx=0).stop 2023-03-03T06:26:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.103+0000 7fbff3294700 1 -- 172.21.15.5:0/3868269935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfec0b1f50 msgr2=0x7fbfec15ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.103+0000 7fbff3294700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfec0b1f50 0x7fbfec15ae40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00c520 tx=0x7fbfdc00c8e0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.104+0000 7fbff3294700 1 -- 172.21.15.5:0/3868269935 shutdown_connections 2023-03-03T06:26:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.104+0000 7fbff3294700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbfd00682f0 0x7fbfd006a7a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.104+0000 7fbff3294700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfec157dd0 0x7fbfec158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.104+0000 7fbff3294700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfec0b1f50 0x7fbfec15ae40 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.104+0000 7fbff3294700 1 --2- 172.21.15.5:0/3868269935 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfec1597d0 0x7fbfec148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.104+0000 7fbff3294700 1 -- 172.21.15.5:0/3868269935 >> 172.21.15.5:0/3868269935 conn(0x7fbfec0cc840 msgr2=0x7fbfec0b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:10.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.104+0000 7fbff3294700 1 -- 172.21.15.5:0/3868269935 shutdown_connections 2023-03-03T06:26:10.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.104+0000 7fbff3294700 1 -- 172.21.15.5:0/3868269935 wait complete. 2023-03-03T06:26:10.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:26:10.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.243+0000 7f02977f8700 1 Processor -- start 2023-03-03T06:26:10.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.243+0000 7f02977f8700 1 -- start start 2023-03-03T06:26:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.244+0000 7f02977f8700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f02900b1fe0 0x7f029015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.244+0000 7f02977f8700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02900cc5d0 con 0x7f02900cd500 2023-03-03T06:26:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.244+0000 7f02977f8700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0290159c30 con 0x7f02900b55b0 2023-03-03T06:26:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.244+0000 7f02977f8700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029015e290 con 0x7f02900b1fe0 2023-03-03T06:26:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.244+0000 7f0294d93700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f02900cd500 0x7f02900cdf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35652/0 (socket says 172.21.15.5:35652) 2023-03-03T06:26:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.244+0000 7f0294d93700 1 -- 172.21.15.5:0/3125640008 learned_addr learned my addr 172.21.15.5:0/3125640008 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.244+0000 7f0295d95700 1 --2- 172.21.15.5:0/3125640008 >> v2:172.21.15.191:3300/0 conn(0x7f02900b1fe0 0x7f029015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.244+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163695504 0 0) 0x7f02900cc5d0 con 0x7f02900cd500 2023-03-03T06:26:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.244+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f027c0035b0 con 0x7f02900cd500 2023-03-03T06:26:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1252200753 0 0) 0x7f027c0035b0 con 0x7f02900cd500 2023-03-03T06:26:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 >> v2:172.21.15.191:3300/0 conn(0x7f02900b1fe0 msgr2=0x7f029015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 --2- 172.21.15.5:0/3125640008 >> v2:172.21.15.191:3300/0 conn(0x7f02900b1fe0 0x7f029015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 >> v1:172.21.15.191:6789/0 conn(0x7f02900b55b0 legacy=0x7f02900b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02900b5980 con 0x7f02900cd500 2023-03-03T06:26:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f028c001670 con 0x7f02900cd500 2023-03-03T06:26:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 >> v1:172.21.15.5:6789/0 conn(0x7f02900cd500 legacy=0x7f02900cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 --2- 172.21.15.5:0/3125640008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f027c003a00 0x7f027c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 --2- 172.21.15.5:0/3125640008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f027c004850 0x7f027c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 --2- 172.21.15.5:0/3125640008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f027c005200 0x7f027c00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c00e260 con 0x7f027c003a00 2023-03-03T06:26:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c00e3d0 con 0x7f027c005200 2023-03-03T06:26:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c00e590 con 0x7f027c004850 2023-03-03T06:26:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0295594700 1 --2- 172.21.15.5:0/3125640008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f027c003a00 0x7f027c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0294d93700 1 --2- 172.21.15.5:0/3125640008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f027c004850 0x7f027c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0295d95700 1 --2- 172.21.15.5:0/3125640008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f027c005200 0x7f027c00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0295594700 1 -- 172.21.15.5:0/3125640008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f027c004850 msgr2=0x7f027c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0295594700 1 --2- 172.21.15.5:0/3125640008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f027c004850 0x7f027c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0295594700 1 -- 172.21.15.5:0/3125640008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f027c005200 msgr2=0x7f027c00dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0295594700 1 --2- 172.21.15.5:0/3125640008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f027c005200 0x7f027c00dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0295d95700 1 -- 172.21.15.5:0/3125640008 reap_dead start 2023-03-03T06:26:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0295594700 1 -- 172.21.15.5:0/3125640008 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0035b0 con 0x7f027c003a00 2023-03-03T06:26:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0295594700 1 --2- 172.21.15.5:0/3125640008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f027c003a00 0x7f027c003e10 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f02800017c0 tx=0x7f027c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c880ce9d5ef9b02f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02800052d0 con 0x7f027c003a00 2023-03-03T06:26:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0280005450 con 0x7f027c003a00 2023-03-03T06:26:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.245+0000 7f0287fff700 1 -- 172.21.15.5:0/3125640008 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02800038c0 con 0x7f027c003a00 2023-03-03T06:26:10.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.246+0000 7f02977f8700 1 -- 172.21.15.5:0/3125640008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f027c003a00 msgr2=0x7f027c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.246+0000 7f02977f8700 1 --2- 172.21.15.5:0/3125640008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f027c003a00 0x7f027c003e10 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f02800017c0 tx=0x7f027c005880 comp rx=0 tx=0).stop 2023-03-03T06:26:10.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.246+0000 7f02977f8700 1 -- 172.21.15.5:0/3125640008 shutdown_connections 2023-03-03T06:26:10.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.246+0000 7f02977f8700 1 --2- 172.21.15.5:0/3125640008 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f027c003a00 0x7f027c003e10 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.246+0000 7f02977f8700 1 -- 172.21.15.5:0/3125640008 >> 172.21.15.5:0/3125640008 conn(0x7f02900cc8d0 msgr2=0x7f02900cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:10.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.246+0000 7f02977f8700 1 -- 172.21.15.5:0/3125640008 shutdown_connections 2023-03-03T06:26:10.255 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.246+0000 7f02977f8700 1 -- 172.21.15.5:0/3125640008 wait complete. 2023-03-03T06:26:10.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.247+0000 7f02977f8700 1 Processor -- start 2023-03-03T06:26:10.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.247+0000 7f02977f8700 1 -- start start 2023-03-03T06:26:10.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f02977f8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f027c003a00 0x7f0290154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f02977f8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02900aec30 0x7f029006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f02977f8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02900af0a0 0x7f029006c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f02977f8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02900c9f80 con 0x7f02900aec30 2023-03-03T06:26:10.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f02977f8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02900c90d0 con 0x7f027c003a00 2023-03-03T06:26:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f02977f8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02900c9370 con 0x7f02900af0a0 2023-03-03T06:26:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f0294d93700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02900aec30 0x7f029006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f0294d93700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02900aec30 0x7f029006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45824/0 (socket says 172.21.15.5:45824) 2023-03-03T06:26:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f0294d93700 1 -- 172.21.15.5:0/2669885609 learned_addr learned my addr 172.21.15.5:0/2669885609 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f0295594700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f027c003a00 0x7f0290154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f0295d95700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02900af0a0 0x7f029006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f0294d93700 1 -- 172.21.15.5:0/2669885609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02900af0a0 msgr2=0x7f029006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f0294d93700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02900af0a0 0x7f029006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f0294d93700 1 -- 172.21.15.5:0/2669885609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f027c003a00 msgr2=0x7f0290154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f0294d93700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f027c003a00 0x7f0290154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f0294d93700 1 -- 172.21.15.5:0/2669885609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02900cbca0 con 0x7f02900aec30 2023-03-03T06:26:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.248+0000 7f0295d95700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02900af0a0 0x7f029006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.249+0000 7f0294d93700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02900aec30 0x7f029006bc10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f028c0072c0 tx=0x7f028c0075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.249+0000 7f0285ffb700 1 -- 172.21.15.5:0/2669885609 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c00f6c0 con 0x7f02900aec30 2023-03-03T06:26:10.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.249+0000 7f0285ffb700 1 -- 172.21.15.5:0/2669885609 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c00f860 con 0x7f02900aec30 2023-03-03T06:26:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.249+0000 7f0285ffb700 1 -- 172.21.15.5:0/2669885609 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c00fc10 con 0x7f02900aec30 2023-03-03T06:26:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.249+0000 7f02977f8700 1 -- 172.21.15.5:0/2669885609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02900cb9c0 con 0x7f02900aec30 2023-03-03T06:26:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.249+0000 7f02977f8700 1 -- 172.21.15.5:0/2669885609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02900cbf80 con 0x7f02900aec30 2023-03-03T06:26:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.250+0000 7f02977f8700 1 -- 172.21.15.5:0/2669885609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029004e6e0 con 0x7f02900aec30 2023-03-03T06:26:10.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.250+0000 7f0285ffb700 1 -- 172.21.15.5:0/2669885609 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f028c00fd70 con 0x7f02900aec30 2023-03-03T06:26:10.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.251+0000 7f0285ffb700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02740682f0 0x7f027406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.251+0000 7f0285ffb700 1 -- 172.21.15.5:0/2669885609 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f028c086270 con 0x7f02900aec30 2023-03-03T06:26:10.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.251+0000 7f0295594700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02740682f0 0x7f027406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.251+0000 7f0295594700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02740682f0 0x7f027406a7a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0280000c00 tx=0x7f0280009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:10.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.255+0000 7f0285ffb700 1 -- 172.21.15.5:0/2669885609 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f028c0525f0 con 0x7f02900aec30 2023-03-03T06:26:10.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.449+0000 7f02977f8700 1 -- 172.21.15.5:0/2669885609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f029015ce30 con 0x7f02900aec30 2023-03-03T06:26:10.452 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.449+0000 7f0285ffb700 1 -- 172.21.15.5:0/2669885609 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f028c055c10 con 0x7f02900aec30 2023-03-03T06:26:10.453 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:26:10.454 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.451+0000 7f02977f8700 1 -- 172.21.15.5:0/2669885609 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02740682f0 msgr2=0x7f027406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.451+0000 7f02977f8700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02740682f0 0x7f027406a7a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0280000c00 tx=0x7f0280009030 comp rx=0 tx=0).stop 2023-03-03T06:26:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.451+0000 7f02977f8700 1 -- 172.21.15.5:0/2669885609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02900aec30 msgr2=0x7f029006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.451+0000 7f02977f8700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02900aec30 0x7f029006bc10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f028c0072c0 tx=0x7f028c0075d0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.451+0000 7f02977f8700 1 -- 172.21.15.5:0/2669885609 shutdown_connections 2023-03-03T06:26:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.451+0000 7f02977f8700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02740682f0 0x7f027406a7a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.451+0000 7f02977f8700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f02900af0a0 0x7f029006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.451+0000 7f02977f8700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f027c003a00 0x7f0290154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.451+0000 7f02977f8700 1 --2- 172.21.15.5:0/2669885609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02900aec30 0x7f029006bc10 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.451+0000 7f02977f8700 1 -- 172.21.15.5:0/2669885609 >> 172.21.15.5:0/2669885609 conn(0x7f02900cc8d0 msgr2=0x7f029015d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:10.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.451+0000 7f02977f8700 1 -- 172.21.15.5:0/2669885609 shutdown_connections 2023-03-03T06:26:10.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.452+0000 7f02977f8700 1 -- 172.21.15.5:0/2669885609 wait complete. 2023-03-03T06:26:10.466 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-03-03T06:26:10.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.592+0000 7f96f854a700 1 Processor -- start 2023-03-03T06:26:10.594 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.592+0000 7f96f854a700 1 -- start start 2023-03-03T06:26:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f854a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f96f01597d0 0x7f96f00b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f854a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96f00b1d80 0x7f96f00b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f854a700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f006bcd0 con 0x7f96f00b56d0 2023-03-03T06:26:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f854a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f00b21f0 con 0x7f96f01597d0 2023-03-03T06:26:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f854a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f006cce0 con 0x7f96f00b1d80 2023-03-03T06:26:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f6ae7700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f96f00b56d0 0x7f96f00cd990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35676/0 (socket says 172.21.15.5:35676) 2023-03-03T06:26:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f6ae7700 1 -- 172.21.15.5:0/2103138515 learned_addr learned my addr 172.21.15.5:0/2103138515 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945924509 0 0) 0x7f96f006bcd0 con 0x7f96f00b56d0 2023-03-03T06:26:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96dc0035b0 con 0x7f96f00b56d0 2023-03-03T06:26:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f5ae5700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96f00b1d80 0x7f96f00b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f62e6700 1 --2- 172.21.15.5:0/2103138515 >> v2:172.21.15.191:3300/0 conn(0x7f96f01597d0 0x7f96f00b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2245563547 0 0) 0x7f96dc0035b0 con 0x7f96f00b56d0 2023-03-03T06:26:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96f00b1d80 msgr2=0x7f96f00b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f52e4700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96f00b1d80 0x7f96f00b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 >> v2:172.21.15.191:3300/0 conn(0x7f96f01597d0 msgr2=0x7f96f00b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f52e4700 1 --2- 172.21.15.5:0/2103138515 >> v2:172.21.15.191:3300/0 conn(0x7f96f01597d0 0x7f96f00b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f006bf20 con 0x7f96f00b56d0 2023-03-03T06:26:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f96e80019f0 con 0x7f96f00b56d0 2023-03-03T06:26:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 >> v1:172.21.15.5:6789/0 conn(0x7f96f00b56d0 legacy=0x7f96f00cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f52e4700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96dc003a00 0x7f96dc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.593+0000 7f96f52e4700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96f00b1d80 0x7f96dc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f52e4700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96dc004d90 0x7f96dc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00b21f0 con 0x7f96dc004d90 2023-03-03T06:26:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f006cce0 con 0x7f96dc003a00 2023-03-03T06:26:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc00ba10 con 0x7f96f00b1d80 2023-03-03T06:26:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f6ae7700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96dc004d90 0x7f96dc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f62e6700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96dc003a00 0x7f96dc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f5ae5700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96f00b1d80 0x7f96dc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f6ae7700 1 -- 172.21.15.5:0/2103138515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96f00b1d80 msgr2=0x7f96dc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f6ae7700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96f00b1d80 0x7f96dc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f6ae7700 1 -- 172.21.15.5:0/2103138515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96dc003a00 msgr2=0x7f96dc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f6ae7700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96dc003a00 0x7f96dc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f6ae7700 1 -- 172.21.15.5:0/2103138515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc0035b0 con 0x7f96dc004d90 2023-03-03T06:26:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f5ae5700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96f00b1d80 0x7f96dc004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f62e6700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96dc003a00 0x7f96dc003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f6ae7700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96dc004d90 0x7f96dc005200 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f96e800a8d0 tx=0x7f96dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da15784f86c8e5ab server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800a340 con 0x7f96dc004d90 2023-03-03T06:26:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e8012600 con 0x7f96dc004d90 2023-03-03T06:26:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.594+0000 7f96f52e4700 1 -- 172.21.15.5:0/2103138515 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e80129b0 con 0x7f96dc004d90 2023-03-03T06:26:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.595+0000 7f96f854a700 1 -- 172.21.15.5:0/2103138515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96dc004d90 msgr2=0x7f96dc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.595+0000 7f96f854a700 1 --2- 172.21.15.5:0/2103138515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96dc004d90 0x7f96dc005200 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f96e800a8d0 tx=0x7f96dc005880 comp rx=0 tx=0).stop 2023-03-03T06:26:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.595+0000 7f96f6ae7700 1 -- 172.21.15.5:0/2103138515 reap_dead start 2023-03-03T06:26:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.595+0000 7f96f854a700 1 -- 172.21.15.5:0/2103138515 shutdown_connections 2023-03-03T06:26:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.595+0000 7f96f854a700 1 -- 172.21.15.5:0/2103138515 >> 172.21.15.5:0/2103138515 conn(0x7f96f00cc840 msgr2=0x7f96f00ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.595+0000 7f96f854a700 1 -- 172.21.15.5:0/2103138515 shutdown_connections 2023-03-03T06:26:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.595+0000 7f96f854a700 1 -- 172.21.15.5:0/2103138515 wait complete. 2023-03-03T06:26:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.596+0000 7f96f854a700 1 Processor -- start 2023-03-03T06:26:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.596+0000 7f96f854a700 1 -- start start 2023-03-03T06:26:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f854a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96dc004d90 0x7f96f00b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f854a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96f00af6d0 0x7f96f00b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f854a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96f00c3000 0x7f96f01450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f854a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00c6050 con 0x7f96dc004d90 2023-03-03T06:26:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f854a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00b1a60 con 0x7f96f00af6d0 2023-03-03T06:26:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f854a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00afbd0 con 0x7f96f00c3000 2023-03-03T06:26:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f62e6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96dc004d90 0x7f96f00b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f62e6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96dc004d90 0x7f96f00b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45842/0 (socket says 172.21.15.5:45842) 2023-03-03T06:26:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f62e6700 1 -- 172.21.15.5:0/4151902601 learned_addr learned my addr 172.21.15.5:0/4151902601 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f62e6700 1 -- 172.21.15.5:0/4151902601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96f00c3000 msgr2=0x7f96f01450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f62e6700 1 --2- 172.21.15.5:0/4151902601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96f00c3000 0x7f96f01450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f62e6700 1 -- 172.21.15.5:0/4151902601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96f00af6d0 msgr2=0x7f96f00b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f62e6700 1 --2- 172.21.15.5:0/4151902601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96f00af6d0 0x7f96f00b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f62e6700 1 -- 172.21.15.5:0/4151902601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f006c4e0 con 0x7f96dc004d90 2023-03-03T06:26:10.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f62e6700 1 --2- 172.21.15.5:0/4151902601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96dc004d90 0x7f96f00b0c70 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f96ec010930 tx=0x7f96ec010cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96e6ffd700 1 -- 172.21.15.5:0/4151902601 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec004020 con 0x7f96dc004d90 2023-03-03T06:26:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96e6ffd700 1 -- 172.21.15.5:0/4151902601 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec004180 con 0x7f96dc004d90 2023-03-03T06:26:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96e6ffd700 1 -- 172.21.15.5:0/4151902601 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec004530 con 0x7f96dc004d90 2023-03-03T06:26:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.597+0000 7f96f854a700 1 -- 172.21.15.5:0/4151902601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f006c200 con 0x7f96dc004d90 2023-03-03T06:26:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.598+0000 7f96f854a700 1 -- 172.21.15.5:0/4151902601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f006c7c0 con 0x7f96dc004d90 2023-03-03T06:26:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.598+0000 7f96f854a700 1 -- 172.21.15.5:0/4151902601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f004e6e0 con 0x7f96dc004d90 2023-03-03T06:26:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.599+0000 7f96e6ffd700 1 -- 172.21.15.5:0/4151902601 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f96ec025070 con 0x7f96dc004d90 2023-03-03T06:26:10.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.599+0000 7f96e6ffd700 1 --2- 172.21.15.5:0/4151902601 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f96d40682f0 0x7f96d406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.599+0000 7f96e6ffd700 1 -- 172.21.15.5:0/4151902601 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f96ec086420 con 0x7f96dc004d90 2023-03-03T06:26:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.599+0000 7f96f5ae5700 1 --2- 172.21.15.5:0/4151902601 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f96d40682f0 0x7f96d406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.600+0000 7f96f5ae5700 1 --2- 172.21.15.5:0/4151902601 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f96d40682f0 0x7f96d406a7a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f96f00afb00 tx=0x7f96e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:10.609 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.604+0000 7f96e6ffd700 1 -- 172.21.15.5:0/4151902601 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f96ec0526e0 con 0x7f96dc004d90 2023-03-03T06:26:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.802+0000 7f96f854a700 1 -- 172.21.15.5:0/4151902601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f96f00b3940 con 0x7f96dc004d90 2023-03-03T06:26:10.804 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.802+0000 7f96e6ffd700 1 -- 172.21.15.5:0/4151902601 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v72) v1 ==== 103+0+11 (secure 0 0 0) 0x7f96ec023020 con 0x7f96dc004d90 2023-03-03T06:26:10.804 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:26:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.804+0000 7f96f854a700 1 -- 172.21.15.5:0/4151902601 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f96d40682f0 msgr2=0x7f96d406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.804+0000 7f96f854a700 1 --2- 172.21.15.5:0/4151902601 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f96d40682f0 0x7f96d406a7a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f96f00afb00 tx=0x7f96e0008040 comp rx=0 tx=0).stop 2023-03-03T06:26:10.806 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.804+0000 7f96f854a700 1 -- 172.21.15.5:0/4151902601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96dc004d90 msgr2=0x7f96f00b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.804+0000 7f96f854a700 1 --2- 172.21.15.5:0/4151902601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96dc004d90 0x7f96f00b0c70 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f96ec010930 tx=0x7f96ec010cf0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.804+0000 7f96f854a700 1 -- 172.21.15.5:0/4151902601 shutdown_connections 2023-03-03T06:26:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.804+0000 7f96f854a700 1 --2- 172.21.15.5:0/4151902601 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f96d40682f0 0x7f96d406a7a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.804+0000 7f96f854a700 1 --2- 172.21.15.5:0/4151902601 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f96f00c3000 0x7f96f01450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.807 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.804+0000 7f96f854a700 1 --2- 172.21.15.5:0/4151902601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f96dc004d90 0x7f96f00b0c70 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.804+0000 7f96f854a700 1 --2- 172.21.15.5:0/4151902601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96f00af6d0 0x7f96f00b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.804+0000 7f96f854a700 1 -- 172.21.15.5:0/4151902601 >> 172.21.15.5:0/4151902601 conn(0x7f96f00cc840 msgr2=0x7f96f00ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.804+0000 7f96f854a700 1 -- 172.21.15.5:0/4151902601 shutdown_connections 2023-03-03T06:26:10.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.804+0000 7f96f854a700 1 -- 172.21.15.5:0/4151902601 wait complete. 2023-03-03T06:26:10.818 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-03-03T06:26:10.945 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.943+0000 7fda3bbbe700 1 Processor -- start 2023-03-03T06:26:10.946 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.943+0000 7fda3bbbe700 1 -- start start 2023-03-03T06:26:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.944+0000 7fda3bbbe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda340cb410 0x7fda340714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.944+0000 7fda3bbbe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fda3406c230 0x7fda34071a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.944+0000 7fda3bbbe700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda340cab30 con 0x7fda34159660 2023-03-03T06:26:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.944+0000 7fda3bbbe700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3406bda0 con 0x7fda3406c230 2023-03-03T06:26:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.944+0000 7fda3bbbe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda340cb8c0 con 0x7fda340cb410 2023-03-03T06:26:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda3a15b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fda3406c230 0x7fda34071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda39159700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda340cb410 0x7fda340714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda3995a700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fda34159660 0x7fda340cad00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:50220/0 (socket says 172.21.15.5:50220) 2023-03-03T06:26:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda3995a700 1 -- 172.21.15.5:0/4117474612 learned_addr learned my addr 172.21.15.5:0/4117474612 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda38958700 1 -- 172.21.15.5:0/4117474612 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26020520 0 0) 0x7fda340cab30 con 0x7fda34159660 2023-03-03T06:26:10.955 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda38958700 1 -- 172.21.15.5:0/4117474612 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda200035b0 con 0x7fda34159660 2023-03-03T06:26:10.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda39159700 1 -- 172.21.15.5:0/4117474612 >> v2:172.21.15.191:3300/0 conn(0x7fda3406c230 msgr2=0x7fda34071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:10.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda39159700 1 --2- 172.21.15.5:0/4117474612 >> v2:172.21.15.191:3300/0 conn(0x7fda3406c230 0x7fda34071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda39159700 1 -- 172.21.15.5:0/4117474612 >> v1:172.21.15.191:6789/0 conn(0x7fda34159660 legacy=0x7fda340cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.956 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda39159700 1 -- 172.21.15.5:0/4117474612 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3406b1d0 con 0x7fda340cb410 2023-03-03T06:26:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda3a15b700 1 --2- 172.21.15.5:0/4117474612 >> v2:172.21.15.191:3300/0 conn(0x7fda3406c230 0x7fda34071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:26:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda39159700 1 --2- 172.21.15.5:0/4117474612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda340cb410 0x7fda340714c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fda28009840 tx=0x7fda28009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eed17b953acebf2c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda38958700 1 -- 172.21.15.5:0/4117474612 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28011830 con 0x7fda340cb410 2023-03-03T06:26:10.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda38958700 1 -- 172.21.15.5:0/4117474612 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda28011990 con 0x7fda340cb410 2023-03-03T06:26:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.945+0000 7fda38958700 1 -- 172.21.15.5:0/4117474612 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28011d20 con 0x7fda340cb410 2023-03-03T06:26:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.946+0000 7fda3bbbe700 1 -- 172.21.15.5:0/4117474612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda340cb410 msgr2=0x7fda340714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.946+0000 7fda3bbbe700 1 --2- 172.21.15.5:0/4117474612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda340cb410 0x7fda340714c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fda28009840 tx=0x7fda28009b50 comp rx=0 tx=0).stop 2023-03-03T06:26:10.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.946+0000 7fda3bbbe700 1 -- 172.21.15.5:0/4117474612 shutdown_connections 2023-03-03T06:26:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.946+0000 7fda3bbbe700 1 --2- 172.21.15.5:0/4117474612 >> v2:172.21.15.191:3300/0 conn(0x7fda3406c230 0x7fda34071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.946+0000 7fda3bbbe700 1 --2- 172.21.15.5:0/4117474612 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda340cb410 0x7fda340714c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.946+0000 7fda3bbbe700 1 -- 172.21.15.5:0/4117474612 >> 172.21.15.5:0/4117474612 conn(0x7fda340cf4b0 msgr2=0x7fda340cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:10.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.946+0000 7fda3bbbe700 1 -- 172.21.15.5:0/4117474612 shutdown_connections 2023-03-03T06:26:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.946+0000 7fda3bbbe700 1 -- 172.21.15.5:0/4117474612 wait complete. 2023-03-03T06:26:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.947+0000 7fda3bbbe700 1 Processor -- start 2023-03-03T06:26:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.947+0000 7fda3bbbe700 1 -- start start 2023-03-03T06:26:10.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.948+0000 7fda3bbbe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda3406c230 0x7fda341575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.948+0000 7fda3bbbe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340cb410 0x7fda340b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.948+0000 7fda3bbbe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda34159660 0x7fda34152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.948+0000 7fda3bbbe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda341f5480 con 0x7fda340cb410 2023-03-03T06:26:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.948+0000 7fda3bbbe700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340abdc0 con 0x7fda3406c230 2023-03-03T06:26:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.948+0000 7fda3bbbe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda34156250 con 0x7fda34159660 2023-03-03T06:26:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.948+0000 7fda39159700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340cb410 0x7fda340b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.962 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.948+0000 7fda39159700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340cb410 0x7fda340b4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45858/0 (socket says 172.21.15.5:45858) 2023-03-03T06:26:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.948+0000 7fda39159700 1 -- 172.21.15.5:0/1686390666 learned_addr learned my addr 172.21.15.5:0/1686390666 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.948+0000 7fda3995a700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda3406c230 0x7fda341575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.948+0000 7fda3a15b700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda34159660 0x7fda34152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.963 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.948+0000 7fda39159700 1 -- 172.21.15.5:0/1686390666 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda34159660 msgr2=0x7fda34152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.948+0000 7fda39159700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda34159660 0x7fda34152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.949+0000 7fda39159700 1 -- 172.21.15.5:0/1686390666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda3406c230 msgr2=0x7fda341575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.949+0000 7fda39159700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda3406c230 0x7fda341575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:10.964 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.949+0000 7fda39159700 1 -- 172.21.15.5:0/1686390666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c00bc80 con 0x7fda340cb410 2023-03-03T06:26:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.949+0000 7fda39159700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340cb410 0x7fda340b4cb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fda28000c00 tx=0x7fda28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.949+0000 7fda267fc700 1 -- 172.21.15.5:0/1686390666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda280036a0 con 0x7fda340cb410 2023-03-03T06:26:10.965 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.949+0000 7fda267fc700 1 -- 172.21.15.5:0/1686390666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2801f070 con 0x7fda340cb410 2023-03-03T06:26:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.949+0000 7fda3bbbe700 1 -- 172.21.15.5:0/1686390666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda280094a0 con 0x7fda340cb410 2023-03-03T06:26:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.949+0000 7fda267fc700 1 -- 172.21.15.5:0/1686390666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28003a60 con 0x7fda340cb410 2023-03-03T06:26:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.949+0000 7fda3bbbe700 1 -- 172.21.15.5:0/1686390666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3406b470 con 0x7fda340cb410 2023-03-03T06:26:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.950+0000 7fda3bbbe700 1 -- 172.21.15.5:0/1686390666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda34159a30 con 0x7fda340cb410 2023-03-03T06:26:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.950+0000 7fda267fc700 1 -- 172.21.15.5:0/1686390666 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fda2800f050 con 0x7fda340cb410 2023-03-03T06:26:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.951+0000 7fda267fc700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda180682f0 0x7fda1806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.951+0000 7fda267fc700 1 -- 172.21.15.5:0/1686390666 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7fda28021070 con 0x7fda340cb410 2023-03-03T06:26:10.967 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.951+0000 7fda3995a700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda180682f0 0x7fda1806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:10.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.951+0000 7fda3995a700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda180682f0 0x7fda1806a7a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fda30007fd0 tx=0x7fda30007dc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:10.969 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:10.955+0000 7fda267fc700 1 -- 172.21.15.5:0/1686390666 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fda28053d30 con 0x7fda340cb410 2023-03-03T06:26:11.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.146+0000 7fda3bbbe700 1 -- 172.21.15.5:0/1686390666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fda3406b750 con 0x7fda340cb410 2023-03-03T06:26:11.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.146+0000 7fda267fc700 1 -- 172.21.15.5:0/1686390666 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v72) v1 ==== 107+0+11 (secure 0 0 0) 0x7fda28057350 con 0x7fda340cb410 2023-03-03T06:26:11.149 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:26:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.148+0000 7fda3bbbe700 1 -- 172.21.15.5:0/1686390666 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda180682f0 msgr2=0x7fda1806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:11.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.148+0000 7fda3bbbe700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda180682f0 0x7fda1806a7a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fda30007fd0 tx=0x7fda30007dc0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.148+0000 7fda3bbbe700 1 -- 172.21.15.5:0/1686390666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340cb410 msgr2=0x7fda340b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.148+0000 7fda3bbbe700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340cb410 0x7fda340b4cb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fda28000c00 tx=0x7fda28004750 comp rx=0 tx=0).stop 2023-03-03T06:26:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.148+0000 7fda3bbbe700 1 -- 172.21.15.5:0/1686390666 shutdown_connections 2023-03-03T06:26:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.148+0000 7fda3bbbe700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fda180682f0 0x7fda1806a7a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.148+0000 7fda3bbbe700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fda34159660 0x7fda34152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.148+0000 7fda3bbbe700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda3406c230 0x7fda341575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.151 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.148+0000 7fda3bbbe700 1 --2- 172.21.15.5:0/1686390666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda340cb410 0x7fda340b4cb0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.148+0000 7fda3bbbe700 1 -- 172.21.15.5:0/1686390666 >> 172.21.15.5:0/1686390666 conn(0x7fda340cf4b0 msgr2=0x7fda340c45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.148+0000 7fda3bbbe700 1 -- 172.21.15.5:0/1686390666 shutdown_connections 2023-03-03T06:26:11.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.148+0000 7fda3bbbe700 1 -- 172.21.15.5:0/1686390666 wait complete. 2023-03-03T06:26:11.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-03-03T06:26:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.286+0000 7f898f578700 1 Processor -- start 2023-03-03T06:26:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.286+0000 7f898f578700 1 -- start start 2023-03-03T06:26:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.287+0000 7f898f578700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8988144150 0x7f898815ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.287+0000 7f898f578700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f898815b930 0x7f898806b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.287+0000 7f898f578700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898806ba80 con 0x7f898806dc00 2023-03-03T06:26:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.287+0000 7f898f578700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898806bd00 con 0x7f8988144150 2023-03-03T06:26:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.287+0000 7f898f578700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898815ae50 con 0x7f898815b930 2023-03-03T06:26:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.287+0000 7f898d314700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8988144150 0x7f898815ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.291 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.287+0000 7f898d314700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8988144150 0x7f898815ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45864/0 (socket says 172.21.15.5:45864) 2023-03-03T06:26:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.287+0000 7f898d314700 1 -- 172.21.15.5:0/3047774338 learned_addr learned my addr 172.21.15.5:0/3047774338 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.288+0000 7f898cb13700 1 --2- 172.21.15.5:0/3047774338 >> v2:172.21.15.191:3300/0 conn(0x7f898815b930 0x7f898806b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.288+0000 7f898d314700 1 -- 172.21.15.5:0/3047774338 >> v2:172.21.15.191:3300/0 conn(0x7f898815b930 msgr2=0x7f898806b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.288+0000 7f898d314700 1 --2- 172.21.15.5:0/3047774338 >> v2:172.21.15.191:3300/0 conn(0x7f898815b930 0x7f898806b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.288+0000 7f898d314700 1 -- 172.21.15.5:0/3047774338 >> v1:172.21.15.191:6789/0 conn(0x7f898806dc00 legacy=0x7f8988157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.288+0000 7f898d314700 1 -- 172.21.15.5:0/3047774338 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898815b130 con 0x7f8988144150 2023-03-03T06:26:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.288+0000 7f898d314700 1 --2- 172.21.15.5:0/3047774338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8988144150 0x7f898815ed40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f898806ee20 tx=0x7f8978009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3955e9b6096e6eb8 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:11.292 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.288+0000 7f897ffff700 1 -- 172.21.15.5:0/3047774338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978011830 con 0x7f8988144150 2023-03-03T06:26:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.288+0000 7f897ffff700 1 -- 172.21.15.5:0/3047774338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8978011990 con 0x7f8988144150 2023-03-03T06:26:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.288+0000 7f897ffff700 1 -- 172.21.15.5:0/3047774338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978011d20 con 0x7f8988144150 2023-03-03T06:26:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.289+0000 7f898f578700 1 -- 172.21.15.5:0/3047774338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8988144150 msgr2=0x7f898815ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.289+0000 7f898f578700 1 --2- 172.21.15.5:0/3047774338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8988144150 0x7f898815ed40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f898806ee20 tx=0x7f8978009bd0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.289+0000 7f898f578700 1 -- 172.21.15.5:0/3047774338 shutdown_connections 2023-03-03T06:26:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.289+0000 7f898f578700 1 --2- 172.21.15.5:0/3047774338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8988144150 0x7f898815ed40 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.289+0000 7f898f578700 1 --2- 172.21.15.5:0/3047774338 >> v2:172.21.15.191:3300/0 conn(0x7f898815b930 0x7f898806b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.289+0000 7f898f578700 1 -- 172.21.15.5:0/3047774338 >> 172.21.15.5:0/3047774338 conn(0x7f89880cfd00 msgr2=0x7f89880d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.289+0000 7f898f578700 1 -- 172.21.15.5:0/3047774338 shutdown_connections 2023-03-03T06:26:11.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.289+0000 7f898f578700 1 -- 172.21.15.5:0/3047774338 wait complete. 2023-03-03T06:26:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.290+0000 7f898f578700 1 Processor -- start 2023-03-03T06:26:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.290+0000 7f898f578700 1 -- start start 2023-03-03T06:26:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.291+0000 7f898f578700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f898806dc00 0x7f89881efe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.291+0000 7f898f578700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8988144150 0x7f898815cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.291+0000 7f898f578700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f898815b930 0x7f89880c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.291+0000 7f898f578700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89880c34f0 con 0x7f898815b930 2023-03-03T06:26:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.291+0000 7f898f578700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898815d280 con 0x7f898806dc00 2023-03-03T06:26:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.291+0000 7f898f578700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89880c27e0 con 0x7f8988144150 2023-03-03T06:26:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f898db15700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f898815b930 0x7f89880c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f898db15700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f898815b930 0x7f89880c22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45874/0 (socket says 172.21.15.5:45874) 2023-03-03T06:26:11.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f898db15700 1 -- 172.21.15.5:0/2809261388 learned_addr learned my addr 172.21.15.5:0/2809261388 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f898d314700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f898806dc00 0x7f89881efe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f898cb13700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8988144150 0x7f898815cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f898db15700 1 -- 172.21.15.5:0/2809261388 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8988144150 msgr2=0x7f898815cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f898db15700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8988144150 0x7f898815cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f898db15700 1 -- 172.21.15.5:0/2809261388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f898806dc00 msgr2=0x7f89881efe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f898db15700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f898806dc00 0x7f89881efe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f898db15700 1 -- 172.21.15.5:0/2809261388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978009550 con 0x7f898815b930 2023-03-03T06:26:11.298 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f898db15700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f898815b930 0x7f89880c22a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f898000cc50 tx=0x7f898000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f897dffb700 1 -- 172.21.15.5:0/2809261388 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980003c00 con 0x7f898815b930 2023-03-03T06:26:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f897dffb700 1 -- 172.21.15.5:0/2809261388 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8980003d60 con 0x7f898815b930 2023-03-03T06:26:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f898f578700 1 -- 172.21.15.5:0/2809261388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8988144520 con 0x7f898815b930 2023-03-03T06:26:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f897dffb700 1 -- 172.21.15.5:0/2809261388 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898000aab0 con 0x7f898815b930 2023-03-03T06:26:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.292+0000 7f898f578700 1 -- 172.21.15.5:0/2809261388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898815b410 con 0x7f898815b930 2023-03-03T06:26:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.293+0000 7f898f578700 1 -- 172.21.15.5:0/2809261388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898806bfe0 con 0x7f898815b930 2023-03-03T06:26:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.294+0000 7f897dffb700 1 -- 172.21.15.5:0/2809261388 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8980010050 con 0x7f898815b930 2023-03-03T06:26:11.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.294+0000 7f897dffb700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f896c0682f0 0x7f896c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.294+0000 7f897dffb700 1 -- 172.21.15.5:0/2809261388 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f89800860c0 con 0x7f898815b930 2023-03-03T06:26:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.294+0000 7f898d314700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f896c0682f0 0x7f896c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.294+0000 7f898d314700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f896c0682f0 0x7f896c06a7a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8978009c10 tx=0x7f8978008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:11.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.298+0000 7f897dffb700 1 -- 172.21.15.5:0/2809261388 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8980052380 con 0x7f898815b930 2023-03-03T06:26:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.508+0000 7f898f578700 1 -- 172.21.15.5:0/2809261388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f898806d840 con 0x7f898815b930 2023-03-03T06:26:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.509+0000 7f897dffb700 1 -- 172.21.15.5:0/2809261388 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) v1 ==== 80+0+0 (secure 0 0 0) 0x7f89800559a0 con 0x7f898815b930 2023-03-03T06:26:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.511+0000 7f898f578700 1 -- 172.21.15.5:0/2809261388 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f896c0682f0 msgr2=0x7f896c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.511+0000 7f898f578700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f896c0682f0 0x7f896c06a7a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8978009c10 tx=0x7f8978008030 comp rx=0 tx=0).stop 2023-03-03T06:26:11.513 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.511+0000 7f898f578700 1 -- 172.21.15.5:0/2809261388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f898815b930 msgr2=0x7f89880c22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.511+0000 7f898f578700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f898815b930 0x7f89880c22a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f898000cc50 tx=0x7f898000cf60 comp rx=0 tx=0).stop 2023-03-03T06:26:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.511+0000 7f898f578700 1 -- 172.21.15.5:0/2809261388 shutdown_connections 2023-03-03T06:26:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.511+0000 7f898f578700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f898815b930 0x7f89880c22a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.511+0000 7f898f578700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f898806dc00 0x7f89881efe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.511+0000 7f898f578700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f896c0682f0 0x7f896c06a7a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.511+0000 7f898f578700 1 --2- 172.21.15.5:0/2809261388 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8988144150 0x7f898815cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.511+0000 7f898f578700 1 -- 172.21.15.5:0/2809261388 >> 172.21.15.5:0/2809261388 conn(0x7f89880cfd00 msgr2=0x7f89880ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.511+0000 7f898f578700 1 -- 172.21.15.5:0/2809261388 shutdown_connections 2023-03-03T06:26:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.511+0000 7f898f578700 1 -- 172.21.15.5:0/2809261388 wait complete. 2023-03-03T06:26:11.515 INFO:teuthology.orchestra.run.smithi005.stderr:listed 0 entries 2023-03-03T06:26:11.525 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-03-03T06:26:11.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:11.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-03-03T06:26:11.570 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2023-03-03T06:26:11.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:11.571 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-03-03T06:26:11.628 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:26:11.628 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:26:11.650 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-03-03T06:26:11.650 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:26:11.651 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:26:11.687 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287360k,nr_inodes=4071840,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19712 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-03-03T06:26:11.687 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:26:11.688 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:26:11.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-03-03T06:26:11.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:26:11.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.850+0000 7faa30a8b700 1 Processor -- start 2023-03-03T06:26:11.852 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.850+0000 7faa30a8b700 1 -- start start 2023-03-03T06:26:11.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa30a8b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7faa2c06d1f0 0x7faa2c06b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa30a8b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2c160c40 con 0x7faa2c06b860 2023-03-03T06:26:11.861 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa30a8b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2c160ea0 con 0x7faa2c15c980 2023-03-03T06:26:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa30a8b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2c161460 con 0x7faa2c06d1f0 2023-03-03T06:26:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa2ad9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7faa2c06b860 0x7faa2c06dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35724/0 (socket says 172.21.15.5:35724) 2023-03-03T06:26:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa2ad9d700 1 -- 172.21.15.5:0/3140847689 learned_addr learned my addr 172.21.15.5:0/3140847689 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa29d9b700 1 --2- 172.21.15.5:0/3140847689 >> v2:172.21.15.191:3300/0 conn(0x7faa2c06d1f0 0x7faa2c06b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298723468 0 0) 0x7faa2c160c40 con 0x7faa2c06b860 2023-03-03T06:26:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa140035b0 con 0x7faa2c06b860 2023-03-03T06:26:11.862 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3440070478 0 0) 0x7faa140035b0 con 0x7faa2c06b860 2023-03-03T06:26:11.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 >> v2:172.21.15.191:3300/0 conn(0x7faa2c06d1f0 msgr2=0x7faa2c06b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:11.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa2959a700 1 --2- 172.21.15.5:0/3140847689 >> v2:172.21.15.191:3300/0 conn(0x7faa2c06d1f0 0x7faa2c06b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 >> v1:172.21.15.191:6789/0 conn(0x7faa2c15c980 legacy=0x7faa2c160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:11.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c161180 con 0x7faa2c06b860 2023-03-03T06:26:11.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.851+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7faa240019f0 con 0x7faa2c06b860 2023-03-03T06:26:11.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 >> v1:172.21.15.5:6789/0 conn(0x7faa2c06b860 legacy=0x7faa2c06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:11.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2959a700 1 --2- 172.21.15.5:0/3140847689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa14003a70 0x7faa14003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.863 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2959a700 1 --2- 172.21.15.5:0/3140847689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa14004850 0x7faa14004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2959a700 1 --2- 172.21.15.5:0/3140847689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa14005250 0x7faa1400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c161460 con 0x7faa14003a70 2023-03-03T06:26:11.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1400c190 con 0x7faa14004850 2023-03-03T06:26:11.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1400c350 con 0x7faa14005250 2023-03-03T06:26:11.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2a59c700 1 --2- 172.21.15.5:0/3140847689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa14003a70 0x7faa14003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa29d9b700 1 --2- 172.21.15.5:0/3140847689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa14004850 0x7faa14004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.864 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2ad9d700 1 --2- 172.21.15.5:0/3140847689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa14005250 0x7faa1400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2a59c700 1 -- 172.21.15.5:0/3140847689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa14005250 msgr2=0x7faa1400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:11.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2a59c700 1 --2- 172.21.15.5:0/3140847689 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa14005250 0x7faa1400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2a59c700 1 -- 172.21.15.5:0/3140847689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa14004850 msgr2=0x7faa14004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:11.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2a59c700 1 --2- 172.21.15.5:0/3140847689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa14004850 0x7faa14004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2a59c700 1 -- 172.21.15.5:0/3140847689 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa140035b0 con 0x7faa14003a70 2023-03-03T06:26:11.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2ad9d700 1 -- 172.21.15.5:0/3140847689 reap_dead start 2023-03-03T06:26:11.865 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa29d9b700 1 --2- 172.21.15.5:0/3140847689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa14004850 0x7faa14004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2a59c700 1 --2- 172.21.15.5:0/3140847689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa14003a70 0x7faa14003e80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7faa1c007fd0 tx=0x7faa14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f935a1ce7b63b9b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c0052d0 con 0x7faa14003a70 2023-03-03T06:26:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1c005470 con 0x7faa14003a70 2023-03-03T06:26:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.852+0000 7faa2959a700 1 -- 172.21.15.5:0/3140847689 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c0038c0 con 0x7faa14003a70 2023-03-03T06:26:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.853+0000 7faa30a8b700 1 -- 172.21.15.5:0/3140847689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa14003a70 msgr2=0x7faa14003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.853+0000 7faa30a8b700 1 --2- 172.21.15.5:0/3140847689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa14003a70 0x7faa14003e80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7faa1c007fd0 tx=0x7faa14005880 comp rx=0 tx=0).stop 2023-03-03T06:26:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.853+0000 7faa30a8b700 1 -- 172.21.15.5:0/3140847689 shutdown_connections 2023-03-03T06:26:11.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.853+0000 7faa30a8b700 1 --2- 172.21.15.5:0/3140847689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa14003a70 0x7faa14003e80 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.853+0000 7faa30a8b700 1 -- 172.21.15.5:0/3140847689 >> 172.21.15.5:0/3140847689 conn(0x7faa2c0cfd00 msgr2=0x7faa2c0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:11.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.853+0000 7faa30a8b700 1 -- 172.21.15.5:0/3140847689 shutdown_connections 2023-03-03T06:26:11.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.853+0000 7faa30a8b700 1 -- 172.21.15.5:0/3140847689 wait complete. 2023-03-03T06:26:11.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.854+0000 7faa30a8b700 1 Processor -- start 2023-03-03T06:26:11.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.854+0000 7faa30a8b700 1 -- start start 2023-03-03T06:26:11.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa30a8b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa14003a70 0x7faa2c0c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.867 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa30a8b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa2c15cfd0 0x7faa2c150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa30a8b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa2c15f270 0x7faa2c15f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa30a8b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c15fc30 con 0x7faa2c15f270 2023-03-03T06:26:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa30a8b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c15d7b0 con 0x7faa2c15cfd0 2023-03-03T06:26:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa30a8b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c15da90 con 0x7faa14003a70 2023-03-03T06:26:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa2ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa2c15f270 0x7faa2c15f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa2ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa2c15f270 0x7faa2c15f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45894/0 (socket says 172.21.15.5:45894) 2023-03-03T06:26:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa2ad9d700 1 -- 172.21.15.5:0/3748549872 learned_addr learned my addr 172.21.15.5:0/3748549872 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:11.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa2a59c700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa14003a70 0x7faa2c0c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa29d9b700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa2c15cfd0 0x7faa2c150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa2ad9d700 1 -- 172.21.15.5:0/3748549872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa14003a70 msgr2=0x7faa2c0c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:11.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa2ad9d700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa14003a70 0x7faa2c0c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa2ad9d700 1 -- 172.21.15.5:0/3748549872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa2c15cfd0 msgr2=0x7faa2c150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:11.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.855+0000 7faa2ad9d700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa2c15cfd0 0x7faa2c150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:11.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.856+0000 7faa2ad9d700 1 -- 172.21.15.5:0/3748549872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c0ceb70 con 0x7faa2c15f270 2023-03-03T06:26:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.856+0000 7faa2ad9d700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa2c15f270 0x7faa2c15f6f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0cdd00 tx=0x7faa2400e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.856+0000 7faa1affd700 1 -- 172.21.15.5:0/3748549872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2400ed20 con 0x7faa2c15f270 2023-03-03T06:26:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.856+0000 7faa1affd700 1 -- 172.21.15.5:0/3748549872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2400eea0 con 0x7faa2c15f270 2023-03-03T06:26:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.856+0000 7faa30a8b700 1 -- 172.21.15.5:0/3748549872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2c0ce890 con 0x7faa2c15f270 2023-03-03T06:26:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.856+0000 7faa1affd700 1 -- 172.21.15.5:0/3748549872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa24013660 con 0x7faa2c15f270 2023-03-03T06:26:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.856+0000 7faa30a8b700 1 -- 172.21.15.5:0/3748549872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2c15cd50 con 0x7faa2c15f270 2023-03-03T06:26:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.857+0000 7faa30a8b700 1 -- 172.21.15.5:0/3748549872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2c15e6a0 con 0x7faa2c15f270 2023-03-03T06:26:11.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.857+0000 7faa1affd700 1 -- 172.21.15.5:0/3748549872 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7faa240137c0 con 0x7faa2c15f270 2023-03-03T06:26:11.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.858+0000 7faa1affd700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7faa0c0682f0 0x7faa0c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:11.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.858+0000 7faa1affd700 1 -- 172.21.15.5:0/3748549872 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7faa240869c0 con 0x7faa2c15f270 2023-03-03T06:26:11.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.858+0000 7faa2a59c700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7faa0c0682f0 0x7faa0c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:11.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.858+0000 7faa2a59c700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7faa0c0682f0 0x7faa0c06a7a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faa1c007fd0 tx=0x7faa1c009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:11.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:11.862+0000 7faa1affd700 1 -- 172.21.15.5:0/3748549872 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7faa24052c80 con 0x7faa2c15f270 2023-03-03T06:26:12.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.102+0000 7faa30a8b700 1 -- 172.21.15.5:0/3748549872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa2c04e6e0 con 0x7faa2c15f270 2023-03-03T06:26:12.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.103+0000 7faa1affd700 1 -- 172.21.15.5:0/3748549872 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4647 (secure 0 0 0) 0x7faa240562a0 con 0x7faa2c15f270 2023-03-03T06:26:12.105 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:12.106 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3446616567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3446616567},{"type":"v1","addr":"172.21.15.5:6836","nonce":3446616567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/430214005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":430214005},{"type":"v1","addr":"172.21.15.5:6837","nonce":430214005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6198,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/3308805305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":3308805305},{"type":"v1","addr":"172.21.15.191:6834","nonce":3308805305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:25:56.073978+0000","modified":"2023-03-03T06:25:59.082181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6201":{"gid":6201,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1046120178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":1046120178},{"type":"v1","addr":"172.21.15.191:6835","nonce":1046120178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-03-03T06:26:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.105+0000 7faa30a8b700 1 -- 172.21.15.5:0/3748549872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7faa0c0682f0 msgr2=0x7faa0c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.105+0000 7faa30a8b700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7faa0c0682f0 0x7faa0c06a7a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faa1c007fd0 tx=0x7faa1c009030 comp rx=0 tx=0).stop 2023-03-03T06:26:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.105+0000 7faa30a8b700 1 -- 172.21.15.5:0/3748549872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa2c15f270 msgr2=0x7faa2c15f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.105+0000 7faa30a8b700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa2c15f270 0x7faa2c15f6f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0cdd00 tx=0x7faa2400e4f0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.105+0000 7faa30a8b700 1 -- 172.21.15.5:0/3748549872 shutdown_connections 2023-03-03T06:26:12.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.105+0000 7faa30a8b700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa2c15f270 0x7faa2c15f6f0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.105+0000 7faa30a8b700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7faa0c0682f0 0x7faa0c06a7a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.105+0000 7faa30a8b700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa14003a70 0x7faa2c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.105+0000 7faa30a8b700 1 --2- 172.21.15.5:0/3748549872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa2c15cfd0 0x7faa2c150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.105+0000 7faa30a8b700 1 -- 172.21.15.5:0/3748549872 >> 172.21.15.5:0/3748549872 conn(0x7faa2c0cfd00 msgr2=0x7faa2c0cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.105+0000 7faa30a8b700 1 -- 172.21.15.5:0/3748549872 shutdown_connections 2023-03-03T06:26:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.105+0000 7faa30a8b700 1 -- 172.21.15.5:0/3748549872 wait complete. 2023-03-03T06:26:12.109 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-03-03T06:26:12.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:26:12.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.242+0000 7f42e7d27700 1 Processor -- start 2023-03-03T06:26:12.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.243+0000 7f42e7d27700 1 -- start start 2023-03-03T06:26:12.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.243+0000 7f42e7d27700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f42e00af080 0x7f42e00cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.243+0000 7f42e7d27700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e006b590 con 0x7f42e00af450 2023-03-03T06:26:12.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.243+0000 7f42e7d27700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e006b870 con 0x7f42e00b1f80 2023-03-03T06:26:12.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.243+0000 7f42e7d27700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e006bb50 con 0x7f42e00af080 2023-03-03T06:26:12.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e52c2700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f42e00af450 0x7f42e00b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35742/0 (socket says 172.21.15.5:35742) 2023-03-03T06:26:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e52c2700 1 -- 172.21.15.5:0/1214117055 learned_addr learned my addr 172.21.15.5:0/1214117055 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e5ac3700 1 --2- 172.21.15.5:0/1214117055 >> v2:172.21.15.191:3300/0 conn(0x7f42e00af080 0x7f42e00cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581173561 0 0) 0x7f42e006b590 con 0x7f42e00af450 2023-03-03T06:26:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42cc0035b0 con 0x7f42e00af450 2023-03-03T06:26:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2207828585 0 0) 0x7f42cc0035b0 con 0x7f42e00af450 2023-03-03T06:26:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 >> v2:172.21.15.191:3300/0 conn(0x7f42e00af080 msgr2=0x7f42e00cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:12.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 --2- 172.21.15.5:0/1214117055 >> v2:172.21.15.191:3300/0 conn(0x7f42e00af080 0x7f42e00cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 >> v1:172.21.15.191:6789/0 conn(0x7f42e00b1f80 legacy=0x7f42e00cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e006be30 con 0x7f42e00af450 2023-03-03T06:26:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f42dc001670 con 0x7f42e00af450 2023-03-03T06:26:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 >> v1:172.21.15.5:6789/0 conn(0x7f42e00af450 legacy=0x7f42e00b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 --2- 172.21.15.5:0/1214117055 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42cc003a70 0x7f42cc003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 --2- 172.21.15.5:0/1214117055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc004850 0x7f42cc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 --2- 172.21.15.5:0/1214117055 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42cc005200 0x7f42cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e006bb50 con 0x7f42cc004850 2023-03-03T06:26:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc00c0f0 con 0x7f42cc003a70 2023-03-03T06:26:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc00c2b0 con 0x7f42cc005200 2023-03-03T06:26:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e52c2700 1 --2- 172.21.15.5:0/1214117055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc004850 0x7f42cc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e5ac3700 1 --2- 172.21.15.5:0/1214117055 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42cc003a70 0x7f42cc003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.244+0000 7f42e62c4700 1 --2- 172.21.15.5:0/1214117055 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42cc005200 0x7f42cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e52c2700 1 -- 172.21.15.5:0/1214117055 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42cc005200 msgr2=0x7f42cc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e52c2700 1 --2- 172.21.15.5:0/1214117055 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42cc005200 0x7f42cc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e52c2700 1 -- 172.21.15.5:0/1214117055 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42cc003a70 msgr2=0x7f42cc003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e52c2700 1 --2- 172.21.15.5:0/1214117055 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42cc003a70 0x7f42cc003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e52c2700 1 -- 172.21.15.5:0/1214117055 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc0035b0 con 0x7f42cc004850 2023-03-03T06:26:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e62c4700 1 -- 172.21.15.5:0/1214117055 reap_dead start 2023-03-03T06:26:12.252 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e52c2700 1 --2- 172.21.15.5:0/1214117055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc004850 0x7f42cc004cc0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00c240 tx=0x7f42cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5166be099af32557 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc007c10 con 0x7f42cc004850 2023-03-03T06:26:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc00ce00 con 0x7f42cc004850 2023-03-03T06:26:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e4ac1700 1 -- 172.21.15.5:0/1214117055 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc005ba0 con 0x7f42cc004850 2023-03-03T06:26:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e7d27700 1 -- 172.21.15.5:0/1214117055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc004850 msgr2=0x7f42cc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e7d27700 1 --2- 172.21.15.5:0/1214117055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc004850 0x7f42cc004cc0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f42dc00c240 tx=0x7f42cc005880 comp rx=0 tx=0).stop 2023-03-03T06:26:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e7d27700 1 -- 172.21.15.5:0/1214117055 shutdown_connections 2023-03-03T06:26:12.253 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e7d27700 1 --2- 172.21.15.5:0/1214117055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42cc004850 0x7f42cc004cc0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e7d27700 1 -- 172.21.15.5:0/1214117055 >> 172.21.15.5:0/1214117055 conn(0x7f42e006ea70 msgr2=0x7f42e00cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.245+0000 7f42e7d27700 1 -- 172.21.15.5:0/1214117055 shutdown_connections 2023-03-03T06:26:12.254 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.246+0000 7f42e7d27700 1 -- 172.21.15.5:0/1214117055 wait complete. 2023-03-03T06:26:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.247+0000 7f42e7d27700 1 Processor -- start 2023-03-03T06:26:12.256 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.247+0000 7f42e7d27700 1 -- start start 2023-03-03T06:26:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.247+0000 7f42e7d27700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42cc004850 0x7f42e015d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e7d27700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e01f1ca0 0x7f42e01f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e7d27700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42e01f20f0 0x7f42e01f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e7d27700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e0152b60 con 0x7f42e01f1ca0 2023-03-03T06:26:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e7d27700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e01f2610 con 0x7f42cc004850 2023-03-03T06:26:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e7d27700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e01f28f0 con 0x7f42e01f20f0 2023-03-03T06:26:12.257 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e52c2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e01f1ca0 0x7f42e01f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e52c2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e01f1ca0 0x7f42e01f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45912/0 (socket says 172.21.15.5:45912) 2023-03-03T06:26:12.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e52c2700 1 -- 172.21.15.5:0/4229912848 learned_addr learned my addr 172.21.15.5:0/4229912848 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:12.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e5ac3700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42cc004850 0x7f42e015d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e62c4700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42e01f20f0 0x7f42e01f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e52c2700 1 -- 172.21.15.5:0/4229912848 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42e01f20f0 msgr2=0x7f42e01f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e52c2700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42e01f20f0 0x7f42e01f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.258 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e52c2700 1 -- 172.21.15.5:0/4229912848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42cc004850 msgr2=0x7f42e015d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e52c2700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42cc004850 0x7f42e015d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e52c2700 1 -- 172.21.15.5:0/4229912848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e006d370 con 0x7f42e01f1ca0 2023-03-03T06:26:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e5ac3700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42cc004850 0x7f42e015d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e52c2700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e01f1ca0 0x7f42e01f58c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00c0c0 tx=0x7f42dc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42d67fc700 1 -- 172.21.15.5:0/4229912848 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc001670 con 0x7f42e01f1ca0 2023-03-03T06:26:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42d67fc700 1 -- 172.21.15.5:0/4229912848 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc0070d0 con 0x7f42e01f1ca0 2023-03-03T06:26:12.259 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42d67fc700 1 -- 172.21.15.5:0/4229912848 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc007480 con 0x7f42e01f1ca0 2023-03-03T06:26:12.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e7d27700 1 -- 172.21.15.5:0/4229912848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e006c110 con 0x7f42e01f1ca0 2023-03-03T06:26:12.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.248+0000 7f42e7d27700 1 -- 172.21.15.5:0/4229912848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e006cb70 con 0x7f42e01f1ca0 2023-03-03T06:26:12.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.249+0000 7f42e7d27700 1 -- 172.21.15.5:0/4229912848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e004e6e0 con 0x7f42e01f1ca0 2023-03-03T06:26:12.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.250+0000 7f42d67fc700 1 -- 172.21.15.5:0/4229912848 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f42dc024070 con 0x7f42e01f1ca0 2023-03-03T06:26:12.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.250+0000 7f42d67fc700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42c40682f0 0x7f42c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.250+0000 7f42d67fc700 1 -- 172.21.15.5:0/4229912848 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f42dc087210 con 0x7f42e01f1ca0 2023-03-03T06:26:12.260 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.250+0000 7f42e5ac3700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42c40682f0 0x7f42c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.250+0000 7f42e5ac3700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42c40682f0 0x7f42c406a7a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009ce0 tx=0x7f42d0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:12.261 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.254+0000 7f42d67fc700 1 -- 172.21.15.5:0/4229912848 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f42dc0534d0 con 0x7f42e01f1ca0 2023-03-03T06:26:12.451 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.449+0000 7f42e7d27700 1 -- 172.21.15.5:0/4229912848 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42e0152b40 con 0x7f42e01f1ca0 2023-03-03T06:26:12.453 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.451+0000 7f42d67fc700 1 -- 172.21.15.5:0/4229912848 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+23317 (secure 0 0 0) 0x7f42dc056af0 con 0x7f42e01f1ca0 2023-03-03T06:26:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:12.454 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":72,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:26:07.433188+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:54.356683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:55.044358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_data_pool","create_time":"2023-03-03T06:26:03.629103+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":72,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"test_metadata_pool","create_time":"2023-03-03T06:26:04.826705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":13,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":13,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:26:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.453+0000 7f42e7d27700 1 -- 172.21.15.5:0/4229912848 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42c40682f0 msgr2=0x7f42c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.453+0000 7f42e7d27700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42c40682f0 0x7f42c406a7a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009ce0 tx=0x7f42d0008040 comp rx=0 tx=0).stop 2023-03-03T06:26:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.453+0000 7f42e7d27700 1 -- 172.21.15.5:0/4229912848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e01f1ca0 msgr2=0x7f42e01f58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.453+0000 7f42e7d27700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e01f1ca0 0x7f42e01f58c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00c0c0 tx=0x7f42dc001a00 comp rx=0 tx=0).stop 2023-03-03T06:26:12.457 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.453+0000 7f42e7d27700 1 -- 172.21.15.5:0/4229912848 shutdown_connections 2023-03-03T06:26:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.453+0000 7f42e7d27700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42c40682f0 0x7f42c406a7a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.453+0000 7f42e7d27700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42e01f20f0 0x7f42e01f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.453+0000 7f42e7d27700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42cc004850 0x7f42e015d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.458 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.453+0000 7f42e7d27700 1 --2- 172.21.15.5:0/4229912848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42e01f1ca0 0x7f42e01f58c0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.453+0000 7f42e7d27700 1 -- 172.21.15.5:0/4229912848 >> 172.21.15.5:0/4229912848 conn(0x7f42e006ea70 msgr2=0x7f42e00afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.453+0000 7f42e7d27700 1 -- 172.21.15.5:0/4229912848 shutdown_connections 2023-03-03T06:26:12.459 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.453+0000 7f42e7d27700 1 -- 172.21.15.5:0/4229912848 wait complete. 2023-03-03T06:26:12.467 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'snap-test-pool', 'create_time': '2023-03-03T06:25:02.648527+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-03-03T06:25:54.356683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-03-03T06:25:55.044358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_data_pool', 'create_time': '2023-03-03T06:26:03.629103+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 72, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'test_metadata_pool', 'create_time': '2023-03-03T06:26:04.826705+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T06:26:12.469 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:26:12.598 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.596+0000 7f097aca2700 1 Processor -- start 2023-03-03T06:26:12.599 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.596+0000 7f097aca2700 1 -- start start 2023-03-03T06:26:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.597+0000 7f097aca2700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f097406dc00 0x7f097406e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.597+0000 7f097aca2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0974160c40 con 0x7f097406d1f0 2023-03-03T06:26:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.597+0000 7f097aca2700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097406e560 con 0x7f097415c980 2023-03-03T06:26:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.597+0000 7f097aca2700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0974161460 con 0x7f097406dc00 2023-03-03T06:26:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.597+0000 7f0973fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f097406d1f0 0x7f097406b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35762/0 (socket says 172.21.15.5:35762) 2023-03-03T06:26:12.602 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.597+0000 7f0973fff700 1 -- 172.21.15.5:0/1009720212 learned_addr learned my addr 172.21.15.5:0/1009720212 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f097923f700 1 --2- 172.21.15.5:0/1009720212 >> v2:172.21.15.191:3300/0 conn(0x7f097406dc00 0x7f097406e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305240993 0 0) 0x7f0974160c40 con 0x7f097406d1f0 2023-03-03T06:26:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09640035b0 con 0x7f097406d1f0 2023-03-03T06:26:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084620108 0 0) 0x7f097406e560 con 0x7f097415c980 2023-03-03T06:26:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0974160c40 con 0x7f097415c980 2023-03-03T06:26:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 206399706 0 0) 0x7f09640035b0 con 0x7f097406d1f0 2023-03-03T06:26:12.603 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 >> v2:172.21.15.191:3300/0 conn(0x7f097406dc00 msgr2=0x7f097406e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:12.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 --2- 172.21.15.5:0/1009720212 >> v2:172.21.15.191:3300/0 conn(0x7f097406dc00 0x7f097406e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 >> v1:172.21.15.191:6789/0 conn(0x7f097415c980 legacy=0x7f0974160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0974160ea0 con 0x7f097406d1f0 2023-03-03T06:26:12.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f0960001670 con 0x7f097406d1f0 2023-03-03T06:26:12.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 >> v1:172.21.15.5:6789/0 conn(0x7f097406d1f0 legacy=0x7f097406b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 --2- 172.21.15.5:0/1009720212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0964003be0 0x7f0964003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.604 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 --2- 172.21.15.5:0/1009720212 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0964004850 0x7f0964004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 --2- 172.21.15.5:0/1009720212 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0964005250 0x7f096400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0974161460 con 0x7f0964003be0 2023-03-03T06:26:12.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096400c160 con 0x7f0964004850 2023-03-03T06:26:12.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096400c320 con 0x7f0964005250 2023-03-03T06:26:12.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f0978a3e700 1 --2- 172.21.15.5:0/1009720212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0964003be0 0x7f0964003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f0973fff700 1 --2- 172.21.15.5:0/1009720212 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0964004850 0x7f0964004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.605 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.598+0000 7f097923f700 1 --2- 172.21.15.5:0/1009720212 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0964005250 0x7f096400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f0978a3e700 1 -- 172.21.15.5:0/1009720212 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0964005250 msgr2=0x7f096400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:12.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f0978a3e700 1 --2- 172.21.15.5:0/1009720212 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0964005250 0x7f096400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f0978a3e700 1 -- 172.21.15.5:0/1009720212 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0964004850 msgr2=0x7f0964004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:12.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f0978a3e700 1 --2- 172.21.15.5:0/1009720212 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0964004850 0x7f0964004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f0978a3e700 1 -- 172.21.15.5:0/1009720212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09640035b0 con 0x7f0964003be0 2023-03-03T06:26:12.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f097923f700 1 -- 172.21.15.5:0/1009720212 reap_dead start 2023-03-03T06:26:12.606 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f0978a3e700 1 --2- 172.21.15.5:0/1009720212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0964003be0 0x7f0964003fd0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0968007fd0 tx=0x7f0964005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97dddcc36e1c4255 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:12.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968001430 con 0x7f0964003be0 2023-03-03T06:26:12.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09680052d0 con 0x7f0964003be0 2023-03-03T06:26:12.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f09737fe700 1 -- 172.21.15.5:0/1009720212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968001d40 con 0x7f0964003be0 2023-03-03T06:26:12.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f097aca2700 1 -- 172.21.15.5:0/1009720212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0964003be0 msgr2=0x7f0964003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f097aca2700 1 --2- 172.21.15.5:0/1009720212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0964003be0 0x7f0964003fd0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0968007fd0 tx=0x7f0964005880 comp rx=0 tx=0).stop 2023-03-03T06:26:12.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f097aca2700 1 -- 172.21.15.5:0/1009720212 shutdown_connections 2023-03-03T06:26:12.607 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f097aca2700 1 --2- 172.21.15.5:0/1009720212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0964003be0 0x7f0964003fd0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f097aca2700 1 -- 172.21.15.5:0/1009720212 >> 172.21.15.5:0/1009720212 conn(0x7f09740cfd00 msgr2=0x7f09740d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:12.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f097aca2700 1 -- 172.21.15.5:0/1009720212 shutdown_connections 2023-03-03T06:26:12.608 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.599+0000 7f097aca2700 1 -- 172.21.15.5:0/1009720212 wait complete. 2023-03-03T06:26:12.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.601+0000 7f097aca2700 1 Processor -- start 2023-03-03T06:26:12.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.601+0000 7f097aca2700 1 -- start start 2023-03-03T06:26:12.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f097aca2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0964003be0 0x7f09740b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.610 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f097aca2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f097415dcb0 0x7f09741511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f097aca2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09740c9610 0x7f09740b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f097aca2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09740b3a20 con 0x7f0964003be0 2023-03-03T06:26:12.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f097aca2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09740b3c70 con 0x7f09740c9610 2023-03-03T06:26:12.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f097aca2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09740c6f50 con 0x7f097415dcb0 2023-03-03T06:26:12.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f0978a3e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0964003be0 0x7f09740b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f0978a3e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0964003be0 0x7f09740b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45930/0 (socket says 172.21.15.5:45930) 2023-03-03T06:26:12.611 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f0978a3e700 1 -- 172.21.15.5:0/2919486703 learned_addr learned my addr 172.21.15.5:0/2919486703 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:12.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f0973fff700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f097415dcb0 0x7f09741511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f097923f700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09740c9610 0x7f09740b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f0978a3e700 1 -- 172.21.15.5:0/2919486703 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f097415dcb0 msgr2=0x7f09741511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f0978a3e700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f097415dcb0 0x7f09741511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f0978a3e700 1 -- 172.21.15.5:0/2919486703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09740c9610 msgr2=0x7f09740b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.612 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f0978a3e700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09740c9610 0x7f09740b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f0978a3e700 1 -- 172.21.15.5:0/2919486703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09740ce890 con 0x7f0964003be0 2023-03-03T06:26:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f097923f700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09740c9610 0x7f09740b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f0978a3e700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0964003be0 0x7f09740b34e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0968005040 tx=0x7f09680012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f09717fa700 1 -- 172.21.15.5:0/2919486703 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09680013d0 con 0x7f0964003be0 2023-03-03T06:26:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f09717fa700 1 -- 172.21.15.5:0/2919486703 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09680050d0 con 0x7f0964003be0 2023-03-03T06:26:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f09717fa700 1 -- 172.21.15.5:0/2919486703 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968007280 con 0x7f0964003be0 2023-03-03T06:26:12.613 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.602+0000 7f097aca2700 1 -- 172.21.15.5:0/2919486703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0974161180 con 0x7f0964003be0 2023-03-03T06:26:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.603+0000 7f097aca2700 1 -- 172.21.15.5:0/2919486703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09740ceb70 con 0x7f0964003be0 2023-03-03T06:26:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.603+0000 7f097aca2700 1 -- 172.21.15.5:0/2919486703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097406e4b0 con 0x7f0964003be0 2023-03-03T06:26:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.604+0000 7f09717fa700 1 -- 172.21.15.5:0/2919486703 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f096802d070 con 0x7f0964003be0 2023-03-03T06:26:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.604+0000 7f09717fa700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f09580682f0 0x7f095806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.604+0000 7f09717fa700 1 -- 172.21.15.5:0/2919486703 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f0968086c70 con 0x7f0964003be0 2023-03-03T06:26:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.604+0000 7f0973fff700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f09580682f0 0x7f095806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.614 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.605+0000 7f0973fff700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f09580682f0 0x7f095806a7a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f097415ff00 tx=0x7f0960009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:12.615 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.609+0000 7f09717fa700 1 -- 172.21.15.5:0/2919486703 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0968052e40 con 0x7f0964003be0 2023-03-03T06:26:12.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.803+0000 7f097aca2700 1 -- 172.21.15.5:0/2919486703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09740c6db0 con 0x7f0964003be0 2023-03-03T06:26:12.805 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.803+0000 7f09717fa700 1 -- 172.21.15.5:0/2919486703 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v72) v1 ==== 92+0+10 (secure 0 0 0) 0x7f09740c6db0 con 0x7f0964003be0 2023-03-03T06:26:12.806 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:26:12.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.805+0000 7f097aca2700 1 -- 172.21.15.5:0/2919486703 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f09580682f0 msgr2=0x7f095806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.805+0000 7f097aca2700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f09580682f0 0x7f095806a7a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f097415ff00 tx=0x7f0960009040 comp rx=0 tx=0).stop 2023-03-03T06:26:12.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.805+0000 7f097aca2700 1 -- 172.21.15.5:0/2919486703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0964003be0 msgr2=0x7f09740b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.805+0000 7f097aca2700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0964003be0 0x7f09740b34e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0968005040 tx=0x7f09680012d0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.806+0000 7f097aca2700 1 -- 172.21.15.5:0/2919486703 shutdown_connections 2023-03-03T06:26:12.808 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.806+0000 7f097aca2700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09740c9610 0x7f09740b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.806+0000 7f097aca2700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0964003be0 0x7f09740b34e0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.806+0000 7f097aca2700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f09580682f0 0x7f095806a7a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.806+0000 7f097aca2700 1 --2- 172.21.15.5:0/2919486703 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f097415dcb0 0x7f09741511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.806+0000 7f097aca2700 1 -- 172.21.15.5:0/2919486703 >> 172.21.15.5:0/2919486703 conn(0x7f09740cfd00 msgr2=0x7f097406c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:12.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.806+0000 7f097aca2700 1 -- 172.21.15.5:0/2919486703 shutdown_connections 2023-03-03T06:26:12.809 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.806+0000 7f097aca2700 1 -- 172.21.15.5:0/2919486703 wait complete. 2023-03-03T06:26:12.820 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:26:12.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.946+0000 7f83c24e1700 1 Processor -- start 2023-03-03T06:26:12.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.946+0000 7f83c24e1700 1 -- start start 2023-03-03T06:26:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.946+0000 7f83c24e1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83bc15cd40 0x7f83bc0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.946+0000 7f83c24e1700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f83bc0cd3e0 0x7f83bc0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.946+0000 7f83c24e1700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83bc0cb9d0 0x7f83bc160720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.950 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.946+0000 7f83c24e1700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc0cd870 con 0x7f83bc0cb9d0 2023-03-03T06:26:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.946+0000 7f83c24e1700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc15e160 con 0x7f83bc0cd3e0 2023-03-03T06:26:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.946+0000 7f83c24e1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc15d110 con 0x7f83bc15cd40 2023-03-03T06:26:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83c0a7e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83bc0cb9d0 0x7f83bc160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83c0a7e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83bc0cb9d0 0x7f83bc160720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45942/0 (socket says 172.21.15.5:45942) 2023-03-03T06:26:12.951 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83c0a7e700 1 -- 172.21.15.5:0/1996889262 learned_addr learned my addr 172.21.15.5:0/1996889262 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83bb7fe700 1 --2- 172.21.15.5:0/1996889262 >> v2:172.21.15.191:3300/0 conn(0x7f83bc0cd3e0 0x7f83bc0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83bbfff700 1 --2- 172.21.15.5:0/1996889262 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83bc15cd40 0x7f83bc0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83c0a7e700 1 -- 172.21.15.5:0/1996889262 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83bc15cd40 msgr2=0x7f83bc0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83c0a7e700 1 --2- 172.21.15.5:0/1996889262 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83bc15cd40 0x7f83bc0b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83c0a7e700 1 -- 172.21.15.5:0/1996889262 >> v2:172.21.15.191:3300/0 conn(0x7f83bc0cd3e0 msgr2=0x7f83bc0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:12.952 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83c0a7e700 1 --2- 172.21.15.5:0/1996889262 >> v2:172.21.15.191:3300/0 conn(0x7f83bc0cd3e0 0x7f83bc0b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83c0a7e700 1 -- 172.21.15.5:0/1996889262 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc15d3c0 con 0x7f83bc0cb9d0 2023-03-03T06:26:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83c0a7e700 1 --2- 172.21.15.5:0/1996889262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc0cb9d0 0x7f83bc160720 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f83bc068700 tx=0x7f83b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb460f923c68467 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83baffd700 1 -- 172.21.15.5:0/1996889262 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b400e070 con 0x7f83bc0cb9d0 2023-03-03T06:26:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83baffd700 1 -- 172.21.15.5:0/1996889262 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b400b910 con 0x7f83bc0cb9d0 2023-03-03T06:26:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.947+0000 7f83baffd700 1 -- 172.21.15.5:0/1996889262 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b400bcc0 con 0x7f83bc0cb9d0 2023-03-03T06:26:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.948+0000 7f83c24e1700 1 -- 172.21.15.5:0/1996889262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc0cb9d0 msgr2=0x7f83bc160720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.948+0000 7f83c24e1700 1 --2- 172.21.15.5:0/1996889262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc0cb9d0 0x7f83bc160720 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f83bc068700 tx=0x7f83b400b330 comp rx=0 tx=0).stop 2023-03-03T06:26:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.948+0000 7f83c24e1700 1 -- 172.21.15.5:0/1996889262 shutdown_connections 2023-03-03T06:26:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.948+0000 7f83c24e1700 1 --2- 172.21.15.5:0/1996889262 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83bc15cd40 0x7f83bc0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.948+0000 7f83c24e1700 1 --2- 172.21.15.5:0/1996889262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc0cb9d0 0x7f83bc160720 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.948+0000 7f83c24e1700 1 --2- 172.21.15.5:0/1996889262 >> v2:172.21.15.191:3300/0 conn(0x7f83bc0cd3e0 0x7f83bc0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.948+0000 7f83c24e1700 1 -- 172.21.15.5:0/1996889262 >> 172.21.15.5:0/1996889262 conn(0x7f83bc0cc8d0 msgr2=0x7f83bc0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.948+0000 7f83c24e1700 1 -- 172.21.15.5:0/1996889262 shutdown_connections 2023-03-03T06:26:12.954 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.948+0000 7f83c24e1700 1 -- 172.21.15.5:0/1996889262 wait complete. 2023-03-03T06:26:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.949+0000 7f83c24e1700 1 Processor -- start 2023-03-03T06:26:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.949+0000 7f83c24e1700 1 -- start start 2023-03-03T06:26:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.950+0000 7f83c24e1700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83bc0cb9d0 0x7f83bc155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.950+0000 7f83c24e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc0cd3e0 0x7f83bc0c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.950+0000 7f83c24e1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83bc15cd40 0x7f83bc0b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.950+0000 7f83c24e1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0c8440 con 0x7f83bc0cd3e0 2023-03-03T06:26:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.950+0000 7f83c24e1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc156830 con 0x7f83bc15cd40 2023-03-03T06:26:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.950+0000 7f83c24e1700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc1562b0 con 0x7f83bc0cb9d0 2023-03-03T06:26:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.950+0000 7f83bb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc0cd3e0 0x7f83bc0c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.950+0000 7f83bb7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc0cd3e0 0x7f83bc0c61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45946/0 (socket says 172.21.15.5:45946) 2023-03-03T06:26:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.950+0000 7f83bb7fe700 1 -- 172.21.15.5:0/1433832287 learned_addr learned my addr 172.21.15.5:0/1433832287 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.950+0000 7f83bbfff700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83bc0cb9d0 0x7f83bc155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.950+0000 7f83c0a7e700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83bc15cd40 0x7f83bc0b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.951+0000 7f83bb7fe700 1 -- 172.21.15.5:0/1433832287 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83bc0cb9d0 msgr2=0x7f83bc155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.951+0000 7f83bb7fe700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83bc0cb9d0 0x7f83bc155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.951+0000 7f83bb7fe700 1 -- 172.21.15.5:0/1433832287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83bc15cd40 msgr2=0x7f83bc0b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.951+0000 7f83bb7fe700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83bc15cd40 0x7f83bc0b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.951+0000 7f83bb7fe700 1 -- 172.21.15.5:0/1433832287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b4009b30 con 0x7f83bc0cd3e0 2023-03-03T06:26:12.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.951+0000 7f83bb7fe700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc0cd3e0 0x7f83bc0c61b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f83b000e870 tx=0x7f83b000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.951+0000 7f83b8ff9700 1 -- 172.21.15.5:0/1433832287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0013680 con 0x7f83bc0cd3e0 2023-03-03T06:26:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.951+0000 7f83b8ff9700 1 -- 172.21.15.5:0/1433832287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b00137e0 con 0x7f83bc0cd3e0 2023-03-03T06:26:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.951+0000 7f83c24e1700 1 -- 172.21.15.5:0/1433832287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc15d980 con 0x7f83bc0cd3e0 2023-03-03T06:26:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.951+0000 7f83b8ff9700 1 -- 172.21.15.5:0/1433832287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0013b90 con 0x7f83bc0cd3e0 2023-03-03T06:26:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.951+0000 7f83c24e1700 1 -- 172.21.15.5:0/1433832287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc15d6a0 con 0x7f83bc0cd3e0 2023-03-03T06:26:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.952+0000 7f83c24e1700 1 -- 172.21.15.5:0/1433832287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc15dc60 con 0x7f83bc0cd3e0 2023-03-03T06:26:12.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.952+0000 7f83b8ff9700 1 -- 172.21.15.5:0/1433832287 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f83b0019030 con 0x7f83bc0cd3e0 2023-03-03T06:26:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.953+0000 7f83b8ff9700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83a80682f0 0x7f83a806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.953+0000 7f83b8ff9700 1 -- 172.21.15.5:0/1433832287 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f83b0085ef0 con 0x7f83bc0cd3e0 2023-03-03T06:26:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.953+0000 7f83bbfff700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83a80682f0 0x7f83a806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.953+0000 7f83bbfff700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83a80682f0 0x7f83a806a7a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009be0 tx=0x7f83ac009210 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:12.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:12.957+0000 7f83b8ff9700 1 -- 172.21.15.5:0/1433832287 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f83b0052150 con 0x7f83bc0cd3e0 2023-03-03T06:26:13.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.147+0000 7f83c24e1700 1 -- 172.21.15.5:0/1433832287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83bc04e6e0 con 0x7f83bc0cd3e0 2023-03-03T06:26:13.150 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.148+0000 7f83b8ff9700 1 -- 172.21.15.5:0/1433832287 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83b0055770 con 0x7f83bc0cd3e0 2023-03-03T06:26:13.150 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:26:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.150+0000 7f83c24e1700 1 -- 172.21.15.5:0/1433832287 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83a80682f0 msgr2=0x7f83a806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.150+0000 7f83c24e1700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83a80682f0 0x7f83a806a7a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009be0 tx=0x7f83ac009210 comp rx=0 tx=0).stop 2023-03-03T06:26:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.150+0000 7f83c24e1700 1 -- 172.21.15.5:0/1433832287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc0cd3e0 msgr2=0x7f83bc0c61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.152 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.150+0000 7f83c24e1700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc0cd3e0 0x7f83bc0c61b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f83b000e870 tx=0x7f83b000eb80 comp rx=0 tx=0).stop 2023-03-03T06:26:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.150+0000 7f83c24e1700 1 -- 172.21.15.5:0/1433832287 shutdown_connections 2023-03-03T06:26:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.150+0000 7f83c24e1700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83bc15cd40 0x7f83bc0b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.150+0000 7f83c24e1700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83a80682f0 0x7f83a806a7a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.150+0000 7f83c24e1700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83bc0cb9d0 0x7f83bc155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.150+0000 7f83c24e1700 1 --2- 172.21.15.5:0/1433832287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83bc0cd3e0 0x7f83bc0c61b0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.150+0000 7f83c24e1700 1 -- 172.21.15.5:0/1433832287 >> 172.21.15.5:0/1433832287 conn(0x7f83bc0cc8d0 msgr2=0x7f83bc06cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:13.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.150+0000 7f83c24e1700 1 -- 172.21.15.5:0/1433832287 shutdown_connections 2023-03-03T06:26:13.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.150+0000 7f83c24e1700 1 -- 172.21.15.5:0/1433832287 wait complete. 2023-03-03T06:26:13.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-03-03T06:26:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.291+0000 7f34e1084700 1 Processor -- start 2023-03-03T06:26:13.293 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.291+0000 7f34e1084700 1 -- start start 2023-03-03T06:26:13.294 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.291+0000 7f34e1084700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f34dc0b8720 0x7f34dc06bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.291+0000 7f34e1084700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34dc0cd850 0x7f34dc160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.291+0000 7f34e1084700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34dc0d2d60 con 0x7f34dc06c120 2023-03-03T06:26:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.291+0000 7f34e1084700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34dc1612d0 con 0x7f34dc0b8720 2023-03-03T06:26:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.292+0000 7f34e1084700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0cf400 con 0x7f34dc0cd850 2023-03-03T06:26:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.292+0000 7f34dad9d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f34dc0b8720 0x7f34dc06bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.295 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.292+0000 7f34da59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34dc0cd850 0x7f34dc160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.292+0000 7f34dad9d700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f34dc0b8720 0x7f34dc06bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:46312/0 (socket says 172.21.15.5:46312) 2023-03-03T06:26:13.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.292+0000 7f34db59e700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f34dc06c120 0x7f34dc0d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:50326/0 (socket says 172.21.15.5:50326) 2023-03-03T06:26:13.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.292+0000 7f34dad9d700 1 -- 172.21.15.5:0/2941428893 learned_addr learned my addr 172.21.15.5:0/2941428893 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:13.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.292+0000 7f34da59c700 1 -- 172.21.15.5:0/2941428893 >> v2:172.21.15.191:3300/0 conn(0x7f34dc0b8720 msgr2=0x7f34dc06bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:13.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.292+0000 7f34da59c700 1 --2- 172.21.15.5:0/2941428893 >> v2:172.21.15.191:3300/0 conn(0x7f34dc0b8720 0x7f34dc06bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.292+0000 7f34da59c700 1 -- 172.21.15.5:0/2941428893 >> v1:172.21.15.191:6789/0 conn(0x7f34dc06c120 legacy=0x7f34dc0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.296 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.292+0000 7f34da59c700 1 -- 172.21.15.5:0/2941428893 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc0cf6e0 con 0x7f34dc0cd850 2023-03-03T06:26:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.292+0000 7f34da59c700 1 --2- 172.21.15.5:0/2941428893 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34dc0cd850 0x7f34dc160d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009840 tx=0x7f34d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d12e4d612956a0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.293+0000 7f34d9d9b700 1 -- 172.21.15.5:0/2941428893 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0011830 con 0x7f34dc0cd850 2023-03-03T06:26:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.293+0000 7f34d9d9b700 1 -- 172.21.15.5:0/2941428893 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d0011990 con 0x7f34dc0cd850 2023-03-03T06:26:13.297 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.293+0000 7f34d9d9b700 1 -- 172.21.15.5:0/2941428893 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0011d20 con 0x7f34dc0cd850 2023-03-03T06:26:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.293+0000 7f34e1084700 1 -- 172.21.15.5:0/2941428893 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34dc0cd850 msgr2=0x7f34dc160d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.299 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.293+0000 7f34e1084700 1 --2- 172.21.15.5:0/2941428893 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34dc0cd850 0x7f34dc160d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009840 tx=0x7f34d0009b50 comp rx=0 tx=0).stop 2023-03-03T06:26:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.293+0000 7f34e1084700 1 -- 172.21.15.5:0/2941428893 shutdown_connections 2023-03-03T06:26:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.293+0000 7f34e1084700 1 --2- 172.21.15.5:0/2941428893 >> v2:172.21.15.191:3300/0 conn(0x7f34dc0b8720 0x7f34dc06bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.293+0000 7f34e1084700 1 --2- 172.21.15.5:0/2941428893 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34dc0cd850 0x7f34dc160d90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.293+0000 7f34e1084700 1 -- 172.21.15.5:0/2941428893 >> 172.21.15.5:0/2941428893 conn(0x7f34dc0d0590 msgr2=0x7f34dc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.293+0000 7f34e1084700 1 -- 172.21.15.5:0/2941428893 shutdown_connections 2023-03-03T06:26:13.300 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.293+0000 7f34e1084700 1 -- 172.21.15.5:0/2941428893 wait complete. 2023-03-03T06:26:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.295+0000 7f34e1084700 1 Processor -- start 2023-03-03T06:26:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.295+0000 7f34e1084700 1 -- start start 2023-03-03T06:26:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.295+0000 7f34e1084700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34dc06c120 0x7f34dc1f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.295+0000 7f34e1084700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34dc0b8720 0x7f34dc1f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.295+0000 7f34e1084700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34dc0cd850 0x7f34dc06c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.295+0000 7f34e1084700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc15dcc0 con 0x7f34dc0b8720 2023-03-03T06:26:13.301 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.295+0000 7f34e1084700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc1f6a50 con 0x7f34dc0cd850 2023-03-03T06:26:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.295+0000 7f34e1084700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc1f2b20 con 0x7f34dc06c120 2023-03-03T06:26:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.295+0000 7f34da59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34dc0b8720 0x7f34dc1f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34da59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34dc0b8720 0x7f34dc1f6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45960/0 (socket says 172.21.15.5:45960) 2023-03-03T06:26:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34da59c700 1 -- 172.21.15.5:0/3931120011 learned_addr learned my addr 172.21.15.5:0/3931120011 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34dad9d700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34dc06c120 0x7f34dc1f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34db59e700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34dc0cd850 0x7f34dc06c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.302 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34da59c700 1 -- 172.21.15.5:0/3931120011 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34dc06c120 msgr2=0x7f34dc1f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34da59c700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34dc06c120 0x7f34dc1f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34da59c700 1 -- 172.21.15.5:0/3931120011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34dc0cd850 msgr2=0x7f34dc06c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34da59c700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34dc0cd850 0x7f34dc06c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34da59c700 1 -- 172.21.15.5:0/3931120011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d00094a0 con 0x7f34dc0b8720 2023-03-03T06:26:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34db59e700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34dc0cd850 0x7f34dc06c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34dad9d700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34dc06c120 0x7f34dc1f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:13.303 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34da59c700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34dc0b8720 0x7f34dc1f6510 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f34d0000c00 tx=0x7f34d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:13.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34c37fe700 1 -- 172.21.15.5:0/3931120011 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d00036a0 con 0x7f34dc0b8720 2023-03-03T06:26:13.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34e1084700 1 -- 172.21.15.5:0/3931120011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc0cdcc0 con 0x7f34dc0b8720 2023-03-03T06:26:13.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34c37fe700 1 -- 172.21.15.5:0/3931120011 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d001f070 con 0x7f34dc0b8720 2023-03-03T06:26:13.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34c37fe700 1 -- 172.21.15.5:0/3931120011 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0003a00 con 0x7f34dc0b8720 2023-03-03T06:26:13.304 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.296+0000 7f34e1084700 1 -- 172.21.15.5:0/3931120011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34dc0d29f0 con 0x7f34dc0b8720 2023-03-03T06:26:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.297+0000 7f34e1084700 1 -- 172.21.15.5:0/3931120011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34dc0b8af0 con 0x7f34dc0b8720 2023-03-03T06:26:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.298+0000 7f34c37fe700 1 -- 172.21.15.5:0/3931120011 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f34d000f050 con 0x7f34dc0b8720 2023-03-03T06:26:13.305 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.298+0000 7f34c37fe700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f34c80682f0 0x7f34c806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.298+0000 7f34c37fe700 1 -- 172.21.15.5:0/3931120011 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f34d0021070 con 0x7f34dc0b8720 2023-03-03T06:26:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.298+0000 7f34dad9d700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f34c80682f0 0x7f34c806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.299+0000 7f34dad9d700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f34c80682f0 0x7f34c806a7a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009b80 tx=0x7f34cc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:13.306 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.302+0000 7f34c37fe700 1 -- 172.21.15.5:0/3931120011 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f34d0053da0 con 0x7f34dc0b8720 2023-03-03T06:26:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.496+0000 7f34e1084700 1 -- 172.21.15.5:0/3931120011 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f34dc1f2c60 con 0x7f34dc0b8720 2023-03-03T06:26:13.498 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.496+0000 7f34c37fe700 1 -- 172.21.15.5:0/3931120011 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v72) v1 ==== 103+0+11 (secure 0 0 0) 0x7f34dc1f2c60 con 0x7f34dc0b8720 2023-03-03T06:26:13.498 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:26:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.498+0000 7f34e1084700 1 -- 172.21.15.5:0/3931120011 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f34c80682f0 msgr2=0x7f34c806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.498+0000 7f34e1084700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f34c80682f0 0x7f34c806a7a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009b80 tx=0x7f34cc008040 comp rx=0 tx=0).stop 2023-03-03T06:26:13.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.498+0000 7f34e1084700 1 -- 172.21.15.5:0/3931120011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34dc0b8720 msgr2=0x7f34dc1f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.498+0000 7f34e1084700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34dc0b8720 0x7f34dc1f6510 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f34d0000c00 tx=0x7f34d0004750 comp rx=0 tx=0).stop 2023-03-03T06:26:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.498+0000 7f34e1084700 1 -- 172.21.15.5:0/3931120011 shutdown_connections 2023-03-03T06:26:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.498+0000 7f34e1084700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f34dc0cd850 0x7f34dc06c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.498+0000 7f34e1084700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f34c80682f0 0x7f34c806a7a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.498+0000 7f34e1084700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f34dc06c120 0x7f34dc1f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.498+0000 7f34e1084700 1 --2- 172.21.15.5:0/3931120011 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34dc0b8720 0x7f34dc1f6510 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.498+0000 7f34e1084700 1 -- 172.21.15.5:0/3931120011 >> 172.21.15.5:0/3931120011 conn(0x7f34dc0d0590 msgr2=0x7f34dc0b78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.498+0000 7f34e1084700 1 -- 172.21.15.5:0/3931120011 shutdown_connections 2023-03-03T06:26:13.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.498+0000 7f34e1084700 1 -- 172.21.15.5:0/3931120011 wait complete. 2023-03-03T06:26:13.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-03-03T06:26:13.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.638+0000 7fa069f71700 1 Processor -- start 2023-03-03T06:26:13.640 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.638+0000 7fa069f71700 1 -- start start 2023-03-03T06:26:13.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.638+0000 7fa069f71700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0640cd500 0x7fa06415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.643 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.638+0000 7fa069f71700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa0640b1fe0 0x7fa0640cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.638+0000 7fa069f71700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0640cc5d0 con 0x7fa0640b55b0 2023-03-03T06:26:13.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.638+0000 7fa069f71700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06415e290 con 0x7fa0640b1fe0 2023-03-03T06:26:13.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.638+0000 7fa069f71700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa064159c30 con 0x7fa0640cd500 2023-03-03T06:26:13.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0637fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa0640b55b0 0x7fa0640b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35808/0 (socket says 172.21.15.5:35808) 2023-03-03T06:26:13.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0637fe700 1 -- 172.21.15.5:0/564163527 learned_addr learned my addr 172.21.15.5:0/564163527 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:13.644 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa063fff700 1 --2- 172.21.15.5:0/564163527 >> v2:172.21.15.191:3300/0 conn(0x7fa0640b1fe0 0x7fa0640cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa062ffd700 1 --2- 172.21.15.5:0/564163527 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0640cd500 0x7fa06415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462067248 0 0) 0x7fa0640cc5d0 con 0x7fa0640b55b0 2023-03-03T06:26:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa04c0057c0 con 0x7fa0640b55b0 2023-03-03T06:26:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1876089123 0 0) 0x7fa04c0057c0 con 0x7fa0640b55b0 2023-03-03T06:26:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0640cd500 msgr2=0x7fa06415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 --2- 172.21.15.5:0/564163527 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0640cd500 0x7fa06415dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.645 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 >> v2:172.21.15.191:3300/0 conn(0x7fa0640b1fe0 msgr2=0x7fa0640cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:13.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 --2- 172.21.15.5:0/564163527 >> v2:172.21.15.191:3300/0 conn(0x7fa0640b1fe0 0x7fa0640cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0640b5980 con 0x7fa0640b55b0 2023-03-03T06:26:13.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fa054001670 con 0x7fa0640b55b0 2023-03-03T06:26:13.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 >> v1:172.21.15.5:6789/0 conn(0x7fa0640b55b0 legacy=0x7fa0640b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 --2- 172.21.15.5:0/564163527 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0640cd500 0x7fa04c005c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 --2- 172.21.15.5:0/564163527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04c006190 0x7fa04c006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.646 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 --2- 172.21.15.5:0/564163527 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa04c006fa0 0x7fa04c007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa064159c30 con 0x7fa04c006190 2023-03-03T06:26:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c00dc20 con 0x7fa04c006fa0 2023-03-03T06:26:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c00dd60 con 0x7fa0640cd500 2023-03-03T06:26:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa062ffd700 1 --2- 172.21.15.5:0/564163527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04c006190 0x7fa04c006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa0637fe700 1 --2- 172.21.15.5:0/564163527 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0640cd500 0x7fa04c005c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.647 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.639+0000 7fa063fff700 1 --2- 172.21.15.5:0/564163527 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa04c006fa0 0x7fa04c007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.640+0000 7fa062ffd700 1 -- 172.21.15.5:0/564163527 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0640cd500 msgr2=0x7fa04c005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:13.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.640+0000 7fa062ffd700 1 --2- 172.21.15.5:0/564163527 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0640cd500 0x7fa04c005c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.648 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.640+0000 7fa062ffd700 1 -- 172.21.15.5:0/564163527 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa04c006fa0 msgr2=0x7fa04c007410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.640+0000 7fa062ffd700 1 --2- 172.21.15.5:0/564163527 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa04c006fa0 0x7fa04c007410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.640+0000 7fa062ffd700 1 -- 172.21.15.5:0/564163527 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c0057c0 con 0x7fa04c006190 2023-03-03T06:26:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.640+0000 7fa062ffd700 1 --2- 172.21.15.5:0/564163527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04c006190 0x7fa04c006a60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa058009b60 tx=0x7fa04c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0f95d96232fd20 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.640+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05800e6c0 con 0x7fa04c006190 2023-03-03T06:26:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.640+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05800e820 con 0x7fa04c006190 2023-03-03T06:26:13.649 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.640+0000 7fa0627fc700 1 -- 172.21.15.5:0/564163527 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05800eb90 con 0x7fa04c006190 2023-03-03T06:26:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.640+0000 7fa069f71700 1 -- 172.21.15.5:0/564163527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04c006190 msgr2=0x7fa04c006a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.640+0000 7fa069f71700 1 --2- 172.21.15.5:0/564163527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04c006190 0x7fa04c006a60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa058009b60 tx=0x7fa04c007a90 comp rx=0 tx=0).stop 2023-03-03T06:26:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.640+0000 7fa063fff700 1 -- 172.21.15.5:0/564163527 reap_dead start 2023-03-03T06:26:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.641+0000 7fa069f71700 1 -- 172.21.15.5:0/564163527 shutdown_connections 2023-03-03T06:26:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.641+0000 7fa069f71700 1 -- 172.21.15.5:0/564163527 >> 172.21.15.5:0/564163527 conn(0x7fa0640cc8d0 msgr2=0x7fa0640cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.641+0000 7fa069f71700 1 -- 172.21.15.5:0/564163527 shutdown_connections 2023-03-03T06:26:13.650 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.641+0000 7fa069f71700 1 -- 172.21.15.5:0/564163527 wait complete. 2023-03-03T06:26:13.652 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.642+0000 7fa069f71700 1 Processor -- start 2023-03-03T06:26:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.642+0000 7fa069f71700 1 -- start start 2023-03-03T06:26:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa069f71700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04c006190 0x7fa06414d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa069f71700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0640c5c30 0x7fa0640c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa069f71700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0640b0770 0x7fa0640b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa069f71700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640c65e0 con 0x7fa04c006190 2023-03-03T06:26:13.653 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa069f71700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640afbe0 con 0x7fa0640b0770 2023-03-03T06:26:13.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa069f71700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640c6f20 con 0x7fa0640c5c30 2023-03-03T06:26:13.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa0637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04c006190 0x7fa06414d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa0637fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04c006190 0x7fa06414d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45978/0 (socket says 172.21.15.5:45978) 2023-03-03T06:26:13.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa0637fe700 1 -- 172.21.15.5:0/2219355871 learned_addr learned my addr 172.21.15.5:0/2219355871 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:13.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa063fff700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0640b0770 0x7fa0640b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.654 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa062ffd700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0640c5c30 0x7fa0640c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa0637fe700 1 -- 172.21.15.5:0/2219355871 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0640c5c30 msgr2=0x7fa0640c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa0637fe700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0640c5c30 0x7fa0640c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa0637fe700 1 -- 172.21.15.5:0/2219355871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0640b0770 msgr2=0x7fa0640b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa0637fe700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0640b0770 0x7fa0640b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa0637fe700 1 -- 172.21.15.5:0/2219355871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0640cbca0 con 0x7fa04c006190 2023-03-03T06:26:13.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa0637fe700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04c006190 0x7fa06414d230 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa054007340 tx=0x7fa054007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:13.655 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa04bfff700 1 -- 172.21.15.5:0/2219355871 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054007ca0 con 0x7fa04c006190 2023-03-03T06:26:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa04bfff700 1 -- 172.21.15.5:0/2219355871 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05400f8d0 con 0x7fa04c006190 2023-03-03T06:26:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa04bfff700 1 -- 172.21.15.5:0/2219355871 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05400fc80 con 0x7fa04c006190 2023-03-03T06:26:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.643+0000 7fa069f71700 1 -- 172.21.15.5:0/2219355871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0640cb9c0 con 0x7fa04c006190 2023-03-03T06:26:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.644+0000 7fa069f71700 1 -- 172.21.15.5:0/2219355871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0640cbf80 con 0x7fa04c006190 2023-03-03T06:26:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.645+0000 7fa069f71700 1 -- 172.21.15.5:0/2219355871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0640b1120 con 0x7fa04c006190 2023-03-03T06:26:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.645+0000 7fa04bfff700 1 -- 172.21.15.5:0/2219355871 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa05401d360 con 0x7fa04c006190 2023-03-03T06:26:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.645+0000 7fa04bfff700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0500682f0 0x7fa05006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.645+0000 7fa04bfff700 1 -- 172.21.15.5:0/2219355871 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7fa054085c90 con 0x7fa04c006190 2023-03-03T06:26:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.645+0000 7fa062ffd700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0500682f0 0x7fa05006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.646+0000 7fa062ffd700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0500682f0 0x7fa05006a7a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa0580090b0 tx=0x7fa058008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:13.657 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.650+0000 7fa04bfff700 1 -- 172.21.15.5:0/2219355871 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa054051ef0 con 0x7fa04c006190 2023-03-03T06:26:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.843+0000 7fa069f71700 1 -- 172.21.15.5:0/2219355871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa06404e6e0 con 0x7fa04c006190 2023-03-03T06:26:13.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.843+0000 7fa04bfff700 1 -- 172.21.15.5:0/2219355871 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa054055510 con 0x7fa04c006190 2023-03-03T06:26:13.846 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:26:13.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.845+0000 7fa069f71700 1 -- 172.21.15.5:0/2219355871 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0500682f0 msgr2=0x7fa05006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.845+0000 7fa069f71700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0500682f0 0x7fa05006a7a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa0580090b0 tx=0x7fa058008030 comp rx=0 tx=0).stop 2023-03-03T06:26:13.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.845+0000 7fa069f71700 1 -- 172.21.15.5:0/2219355871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04c006190 msgr2=0x7fa06414d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.845+0000 7fa069f71700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04c006190 0x7fa06414d230 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa054007340 tx=0x7fa054007650 comp rx=0 tx=0).stop 2023-03-03T06:26:13.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.845+0000 7fa069f71700 1 -- 172.21.15.5:0/2219355871 shutdown_connections 2023-03-03T06:26:13.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.845+0000 7fa069f71700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0640b0770 0x7fa0640b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.845+0000 7fa069f71700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa04c006190 0x7fa06414d230 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.845+0000 7fa069f71700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa0500682f0 0x7fa05006a7a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.845+0000 7fa069f71700 1 --2- 172.21.15.5:0/2219355871 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0640c5c30 0x7fa0640c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.845+0000 7fa069f71700 1 -- 172.21.15.5:0/2219355871 >> 172.21.15.5:0/2219355871 conn(0x7fa0640cc8d0 msgr2=0x7fa06406c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.846+0000 7fa069f71700 1 -- 172.21.15.5:0/2219355871 shutdown_connections 2023-03-03T06:26:13.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.846+0000 7fa069f71700 1 -- 172.21.15.5:0/2219355871 wait complete. 2023-03-03T06:26:13.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-03-03T06:26:13.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.985+0000 7fb620aca700 1 Processor -- start 2023-03-03T06:26:13.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.985+0000 7fb620aca700 1 -- start start 2023-03-03T06:26:13.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb620aca700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb61c15cbf0 0x7fb61c160560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb620aca700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb61c160aa0 0x7fb61c06b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb620aca700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61c0af5d0 con 0x7fb61c06b860 2023-03-03T06:26:13.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb620aca700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61c0ce760 con 0x7fb61c160aa0 2023-03-03T06:26:13.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb620aca700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c0ced20 con 0x7fb61c15cbf0 2023-03-03T06:26:13.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb619d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb61c160aa0 0x7fb61c06b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb61ad9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb61c06b860 0x7fb61c06dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35828/0 (socket says 172.21.15.5:35828) 2023-03-03T06:26:13.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb61ad9d700 1 -- 172.21.15.5:0/1306898181 learned_addr learned my addr 172.21.15.5:0/1306898181 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:13.990 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb619d9b700 1 -- 172.21.15.5:0/1306898181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb61c15cbf0 msgr2=0x7fb61c160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:13.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb61a59c700 1 --2- 172.21.15.5:0/1306898181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb61c15cbf0 0x7fb61c160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb619d9b700 1 --2- 172.21.15.5:0/1306898181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb61c15cbf0 0x7fb61c160560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb61959a700 1 -- 172.21.15.5:0/1306898181 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501448547 0 0) 0x7fb61c0af5d0 con 0x7fb61c06b860 2023-03-03T06:26:13.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb619d9b700 1 -- 172.21.15.5:0/1306898181 >> v1:172.21.15.5:6789/0 conn(0x7fb61c06b860 legacy=0x7fb61c06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.986+0000 7fb619d9b700 1 -- 172.21.15.5:0/1306898181 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c160fb0 con 0x7fb61c160aa0 2023-03-03T06:26:13.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.987+0000 7fb619d9b700 1 --2- 172.21.15.5:0/1306898181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c160aa0 0x7fb61c06b320 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009840 tx=0x7fb60c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472ee18c90f967ba server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:13.991 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.987+0000 7fb61959a700 1 -- 172.21.15.5:0/1306898181 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c011830 con 0x7fb61c160aa0 2023-03-03T06:26:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.987+0000 7fb61959a700 1 -- 172.21.15.5:0/1306898181 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c011990 con 0x7fb61c160aa0 2023-03-03T06:26:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.987+0000 7fb61959a700 1 -- 172.21.15.5:0/1306898181 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c011d20 con 0x7fb61c160aa0 2023-03-03T06:26:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.987+0000 7fb620aca700 1 -- 172.21.15.5:0/1306898181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c160aa0 msgr2=0x7fb61c06b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.987+0000 7fb620aca700 1 --2- 172.21.15.5:0/1306898181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c160aa0 0x7fb61c06b320 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009840 tx=0x7fb60c009b50 comp rx=0 tx=0).stop 2023-03-03T06:26:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.987+0000 7fb620aca700 1 -- 172.21.15.5:0/1306898181 shutdown_connections 2023-03-03T06:26:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.987+0000 7fb620aca700 1 --2- 172.21.15.5:0/1306898181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb61c15cbf0 0x7fb61c160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.992 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.987+0000 7fb620aca700 1 --2- 172.21.15.5:0/1306898181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c160aa0 0x7fb61c06b320 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.987+0000 7fb620aca700 1 -- 172.21.15.5:0/1306898181 >> 172.21.15.5:0/1306898181 conn(0x7fb61c0cfd00 msgr2=0x7fb61c0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.987+0000 7fb620aca700 1 -- 172.21.15.5:0/1306898181 shutdown_connections 2023-03-03T06:26:13.993 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.987+0000 7fb620aca700 1 -- 172.21.15.5:0/1306898181 wait complete. 2023-03-03T06:26:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.989+0000 7fb620aca700 1 Processor -- start 2023-03-03T06:26:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.989+0000 7fb620aca700 1 -- start start 2023-03-03T06:26:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.989+0000 7fb620aca700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c06b860 0x7fb61c154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.989+0000 7fb620aca700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb61c15cbf0 0x7fb61c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.989+0000 7fb620aca700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb61c160aa0 0x7fb61c0c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.995 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.989+0000 7fb620aca700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c0c7310 con 0x7fb61c06b860 2023-03-03T06:26:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.989+0000 7fb620aca700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c0c7de0 con 0x7fb61c160aa0 2023-03-03T06:26:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.989+0000 7fb620aca700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c0c7540 con 0x7fb61c15cbf0 2023-03-03T06:26:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb61a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c06b860 0x7fb61c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb61a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c06b860 0x7fb61c154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45990/0 (socket says 172.21.15.5:45990) 2023-03-03T06:26:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb61a59c700 1 -- 172.21.15.5:0/1854978954 learned_addr learned my addr 172.21.15.5:0/1854978954 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb619d9b700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb61c15cbf0 0x7fb61c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.996 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb61ad9d700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb61c160aa0 0x7fb61c0c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb61a59c700 1 -- 172.21.15.5:0/1854978954 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb61c15cbf0 msgr2=0x7fb61c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb61a59c700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb61c15cbf0 0x7fb61c15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb61a59c700 1 -- 172.21.15.5:0/1854978954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb61c160aa0 msgr2=0x7fb61c0c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb61a59c700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb61c160aa0 0x7fb61c0c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb61a59c700 1 -- 172.21.15.5:0/1854978954 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c0094a0 con 0x7fb61c06b860 2023-03-03T06:26:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb619d9b700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb61c15cbf0 0x7fb61c15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb61ad9d700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb61c160aa0 0x7fb61c0c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb61a59c700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c06b860 0x7fb61c154730 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb61000c7f0 tx=0x7fb61000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb60affd700 1 -- 172.21.15.5:0/1854978954 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb610011800 con 0x7fb61c06b860 2023-03-03T06:26:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb60affd700 1 -- 172.21.15.5:0/1854978954 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb610011960 con 0x7fb61c06b860 2023-03-03T06:26:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb620aca700 1 -- 172.21.15.5:0/1854978954 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61c0ce9b0 con 0x7fb61c06b860 2023-03-03T06:26:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb60affd700 1 -- 172.21.15.5:0/1854978954 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb610011cf0 con 0x7fb61c06b860 2023-03-03T06:26:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.990+0000 7fb620aca700 1 -- 172.21.15.5:0/1854978954 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61c161290 con 0x7fb61c06b860 2023-03-03T06:26:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.991+0000 7fb620aca700 1 -- 172.21.15.5:0/1854978954 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61c06d350 con 0x7fb61c06b860 2023-03-03T06:26:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.992+0000 7fb60affd700 1 -- 172.21.15.5:0/1854978954 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb610021070 con 0x7fb61c06b860 2023-03-03T06:26:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.992+0000 7fb60affd700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5fc0682f0 0x7fb5fc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.992+0000 7fb60affd700 1 -- 172.21.15.5:0/1854978954 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7fb6100861d0 con 0x7fb61c06b860 2023-03-03T06:26:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.992+0000 7fb619d9b700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5fc0682f0 0x7fb5fc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.993+0000 7fb619d9b700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5fc0682f0 0x7fb5fc06a7a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0090b0 tx=0x7fb60c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:13.996+0000 7fb60affd700 1 -- 172.21.15.5:0/1854978954 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb610052410 con 0x7fb61c06b860 2023-03-03T06:26:14.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.188+0000 7fb620aca700 1 -- 172.21.15.5:0/1854978954 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb61c04e6e0 con 0x7fb61c06b860 2023-03-03T06:26:14.190 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.188+0000 7fb60affd700 1 -- 172.21.15.5:0/1854978954 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb61001f030 con 0x7fb61c06b860 2023-03-03T06:26:14.190 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2023-03-03T06:26:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.190+0000 7fb620aca700 1 -- 172.21.15.5:0/1854978954 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5fc0682f0 msgr2=0x7fb5fc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.190+0000 7fb620aca700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5fc0682f0 0x7fb5fc06a7a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0090b0 tx=0x7fb60c008030 comp rx=0 tx=0).stop 2023-03-03T06:26:14.192 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.190+0000 7fb620aca700 1 -- 172.21.15.5:0/1854978954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c06b860 msgr2=0x7fb61c154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.190+0000 7fb620aca700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c06b860 0x7fb61c154730 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb61000c7f0 tx=0x7fb61000cbb0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.190+0000 7fb620aca700 1 -- 172.21.15.5:0/1854978954 shutdown_connections 2023-03-03T06:26:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.190+0000 7fb620aca700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb61c160aa0 0x7fb61c0c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.190+0000 7fb620aca700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb61c06b860 0x7fb61c154730 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.190+0000 7fb620aca700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb5fc0682f0 0x7fb5fc06a7a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.190+0000 7fb620aca700 1 --2- 172.21.15.5:0/1854978954 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb61c15cbf0 0x7fb61c15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.193 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.190+0000 7fb620aca700 1 -- 172.21.15.5:0/1854978954 >> 172.21.15.5:0/1854978954 conn(0x7fb61c0cfd00 msgr2=0x7fb61c15bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.190+0000 7fb620aca700 1 -- 172.21.15.5:0/1854978954 shutdown_connections 2023-03-03T06:26:14.194 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.190+0000 7fb620aca700 1 -- 172.21.15.5:0/1854978954 wait complete. 2023-03-03T06:26:14.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-03-03T06:26:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.330+0000 7fb5657a2700 1 Processor -- start 2023-03-03T06:26:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.330+0000 7fb5657a2700 1 -- start start 2023-03-03T06:26:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.330+0000 7fb5657a2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5600cdfb0 0x7fb5601677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.330+0000 7fb5657a2700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56006c230 con 0x7fb56015cb20 2023-03-03T06:26:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.330+0000 7fb5657a2700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56006bee0 con 0x7fb56015c750 2023-03-03T06:26:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.330+0000 7fb5657a2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600b3470 con 0x7fb5600cdfb0 2023-03-03T06:26:14.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.331+0000 7fb55e7fc700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fb56015cb20 0x7fb5600d09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35842/0 (socket says 172.21.15.5:35842) 2023-03-03T06:26:14.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.331+0000 7fb55e7fc700 1 -- 172.21.15.5:0/1437721804 learned_addr learned my addr 172.21.15.5:0/1437721804 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:14.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.331+0000 7fb55f7fe700 1 --2- 172.21.15.5:0/1437721804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5600cdfb0 0x7fb5601677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:14.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.331+0000 7fb55dffb700 1 -- 172.21.15.5:0/1437721804 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758002987 0 0) 0x7fb56006c230 con 0x7fb56015cb20 2023-03-03T06:26:14.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.331+0000 7fb55dffb700 1 -- 172.21.15.5:0/1437721804 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb54c0035b0 con 0x7fb56015cb20 2023-03-03T06:26:14.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.331+0000 7fb55dffb700 1 -- 172.21.15.5:0/1437721804 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594358280 0 0) 0x7fb56006bee0 con 0x7fb56015c750 2023-03-03T06:26:14.335 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.331+0000 7fb55dffb700 1 -- 172.21.15.5:0/1437721804 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb56006c230 con 0x7fb56015c750 2023-03-03T06:26:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.331+0000 7fb55dffb700 1 -- 172.21.15.5:0/1437721804 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4093928243 0 0) 0x7fb54c0035b0 con 0x7fb56015cb20 2023-03-03T06:26:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.331+0000 7fb55f7fe700 1 -- 172.21.15.5:0/1437721804 >> v1:172.21.15.191:6789/0 conn(0x7fb56015c750 legacy=0x7fb5600cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.331+0000 7fb55f7fe700 1 -- 172.21.15.5:0/1437721804 >> v1:172.21.15.5:6789/0 conn(0x7fb56015cb20 legacy=0x7fb5600d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.331+0000 7fb55f7fe700 1 -- 172.21.15.5:0/1437721804 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5600d1630 con 0x7fb5600cdfb0 2023-03-03T06:26:14.336 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.331+0000 7fb55f7fe700 1 --2- 172.21.15.5:0/1437721804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5600cdfb0 0x7fb5601677a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb558009dc0 tx=0x7fb55800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7db87c97bf42687 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:14.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.332+0000 7fb55dffb700 1 -- 172.21.15.5:0/1437721804 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55800e070 con 0x7fb5600cdfb0 2023-03-03T06:26:14.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.332+0000 7fb55dffb700 1 -- 172.21.15.5:0/1437721804 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb558003a20 con 0x7fb5600cdfb0 2023-03-03T06:26:14.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.332+0000 7fb55dffb700 1 -- 172.21.15.5:0/1437721804 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548001670 con 0x7fb5600cdfb0 2023-03-03T06:26:14.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.332+0000 7fb5657a2700 1 -- 172.21.15.5:0/1437721804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5600cdfb0 msgr2=0x7fb5601677a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.332+0000 7fb5657a2700 1 --2- 172.21.15.5:0/1437721804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5600cdfb0 0x7fb5601677a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb558009dc0 tx=0x7fb55800b330 comp rx=0 tx=0).stop 2023-03-03T06:26:14.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.332+0000 7fb5657a2700 1 -- 172.21.15.5:0/1437721804 shutdown_connections 2023-03-03T06:26:14.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.332+0000 7fb5657a2700 1 --2- 172.21.15.5:0/1437721804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5600cdfb0 0x7fb5601677a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.337 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.332+0000 7fb5657a2700 1 -- 172.21.15.5:0/1437721804 >> 172.21.15.5:0/1437721804 conn(0x7fb56006dee0 msgr2=0x7fb56006e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.332+0000 7fb5657a2700 1 -- 172.21.15.5:0/1437721804 shutdown_connections 2023-03-03T06:26:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.332+0000 7fb5657a2700 1 -- 172.21.15.5:0/1437721804 wait complete. 2023-03-03T06:26:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.334+0000 7fb5657a2700 1 Processor -- start 2023-03-03T06:26:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.334+0000 7fb5657a2700 1 -- start start 2023-03-03T06:26:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.334+0000 7fb5657a2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5600cdfb0 0x7fb5600b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.334+0000 7fb5657a2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb56015c750 0x7fb560149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.334+0000 7fb5657a2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56015cb20 0x7fb5600ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.334+0000 7fb5657a2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5600b4250 con 0x7fb56015cb20 2023-03-03T06:26:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.334+0000 7fb5657a2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5601497d0 con 0x7fb56015c750 2023-03-03T06:26:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.334+0000 7fb5657a2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5601537d0 con 0x7fb5600cdfb0 2023-03-03T06:26:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.334+0000 7fb55f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56015cb20 0x7fb5600ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb55f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56015cb20 0x7fb5600ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46008/0 (socket says 172.21.15.5:46008) 2023-03-03T06:26:14.341 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb55f7fe700 1 -- 172.21.15.5:0/3444917206 learned_addr learned my addr 172.21.15.5:0/3444917206 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:14.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb55e7fc700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb56015c750 0x7fb560149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:14.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb55effd700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5600cdfb0 0x7fb5600b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:14.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb55f7fe700 1 -- 172.21.15.5:0/3444917206 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5600cdfb0 msgr2=0x7fb5600b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb55f7fe700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5600cdfb0 0x7fb5600b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb55f7fe700 1 -- 172.21.15.5:0/3444917206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb56015c750 msgr2=0x7fb560149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb55f7fe700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb56015c750 0x7fb560149290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.342 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb55f7fe700 1 -- 172.21.15.5:0/3444917206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558009a70 con 0x7fb56015cb20 2023-03-03T06:26:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb55f7fe700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56015cb20 0x7fb5600ca750 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb558009d90 tx=0x7fb558004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb5577fe700 1 -- 172.21.15.5:0/3444917206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558004540 con 0x7fb56015cb20 2023-03-03T06:26:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb5577fe700 1 -- 172.21.15.5:0/3444917206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5580046a0 con 0x7fb56015cb20 2023-03-03T06:26:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb5657a2700 1 -- 172.21.15.5:0/3444917206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5600d1bf0 con 0x7fb56015cb20 2023-03-03T06:26:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb5577fe700 1 -- 172.21.15.5:0/3444917206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55801d470 con 0x7fb56015cb20 2023-03-03T06:26:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.335+0000 7fb5657a2700 1 -- 172.21.15.5:0/3444917206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5600d1910 con 0x7fb56015cb20 2023-03-03T06:26:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.336+0000 7fb5657a2700 1 -- 172.21.15.5:0/3444917206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56006d6d0 con 0x7fb56015cb20 2023-03-03T06:26:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.337+0000 7fb5577fe700 1 -- 172.21.15.5:0/3444917206 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb558023030 con 0x7fb56015cb20 2023-03-03T06:26:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.337+0000 7fb5577fe700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb540068340 0x7fb54006a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.337+0000 7fb5577fe700 1 -- 172.21.15.5:0/3444917206 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7fb558087d80 con 0x7fb56015cb20 2023-03-03T06:26:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.337+0000 7fb55effd700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb540068340 0x7fb54006a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.338+0000 7fb55effd700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb540068340 0x7fb54006a7f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb550001220 tx=0x7fb550009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.341+0000 7fb5577fe700 1 -- 172.21.15.5:0/3444917206 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb558054040 con 0x7fb56015cb20 2023-03-03T06:26:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.537+0000 7fb5657a2700 1 -- 172.21.15.5:0/3444917206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fb56004e6e0 con 0x7fb56015cb20 2023-03-03T06:26:14.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.537+0000 7fb5577fe700 1 -- 172.21.15.5:0/3444917206 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v72) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb558057660 con 0x7fb56015cb20 2023-03-03T06:26:14.539 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:26:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.539+0000 7fb5657a2700 1 -- 172.21.15.5:0/3444917206 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb540068340 msgr2=0x7fb54006a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.539+0000 7fb5657a2700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb540068340 0x7fb54006a7f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb550001220 tx=0x7fb550009040 comp rx=0 tx=0).stop 2023-03-03T06:26:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.539+0000 7fb5657a2700 1 -- 172.21.15.5:0/3444917206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56015cb20 msgr2=0x7fb5600ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.539+0000 7fb5657a2700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56015cb20 0x7fb5600ca750 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb558009d90 tx=0x7fb558004ad0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.539+0000 7fb5657a2700 1 -- 172.21.15.5:0/3444917206 shutdown_connections 2023-03-03T06:26:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.539+0000 7fb5657a2700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb56015cb20 0x7fb5600ca750 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.539+0000 7fb5657a2700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb540068340 0x7fb54006a7f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.539+0000 7fb5657a2700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb5600cdfb0 0x7fb5600b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.539+0000 7fb5657a2700 1 --2- 172.21.15.5:0/3444917206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb56015c750 0x7fb560149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.539+0000 7fb5657a2700 1 -- 172.21.15.5:0/3444917206 >> 172.21.15.5:0/3444917206 conn(0x7fb56006dee0 msgr2=0x7fb5600d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.539+0000 7fb5657a2700 1 -- 172.21.15.5:0/3444917206 shutdown_connections 2023-03-03T06:26:14.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.539+0000 7fb5657a2700 1 -- 172.21.15.5:0/3444917206 wait complete. 2023-03-03T06:26:14.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-03-03T06:26:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.679+0000 7f7f60d3a700 1 Processor -- start 2023-03-03T06:26:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.679+0000 7f7f60d3a700 1 -- start start 2023-03-03T06:26:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.680+0000 7f7f60d3a700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f5c1597d0 0x7f7f5c0b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.680+0000 7f7f60d3a700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7f5c0b1d80 0x7f7f5c0b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.680+0000 7f7f60d3a700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5c06bcd0 con 0x7f7f5c0b56d0 2023-03-03T06:26:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.680+0000 7f7f60d3a700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c0b21f0 con 0x7f7f5c1597d0 2023-03-03T06:26:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.680+0000 7f7f60d3a700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c06cce0 con 0x7f7f5c0b1d80 2023-03-03T06:26:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.680+0000 7f7f5a59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f5c1597d0 0x7f7f5c0b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.681+0000 7f7f5a59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7f5c1597d0 0x7f7f5c0b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46012/0 (socket says 172.21.15.5:46012) 2023-03-03T06:26:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.681+0000 7f7f5a59c700 1 -- 172.21.15.5:0/2548465738 learned_addr learned my addr 172.21.15.5:0/2548465738 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.681+0000 7f7f59d9b700 1 --2- 172.21.15.5:0/2548465738 >> v2:172.21.15.191:3300/0 conn(0x7f7f5c0b1d80 0x7f7f5c0b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.681+0000 7f7f5a59c700 1 -- 172.21.15.5:0/2548465738 >> v2:172.21.15.191:3300/0 conn(0x7f7f5c0b1d80 msgr2=0x7f7f5c0b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.681+0000 7f7f5a59c700 1 --2- 172.21.15.5:0/2548465738 >> v2:172.21.15.191:3300/0 conn(0x7f7f5c0b1d80 0x7f7f5c0b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.681+0000 7f7f5a59c700 1 -- 172.21.15.5:0/2548465738 >> v1:172.21.15.191:6789/0 conn(0x7f7f5c0b56d0 legacy=0x7f7f5c0cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.681+0000 7f7f5a59c700 1 -- 172.21.15.5:0/2548465738 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c06bf20 con 0x7f7f5c1597d0 2023-03-03T06:26:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.681+0000 7f7f5a59c700 1 --2- 172.21.15.5:0/2548465738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5c1597d0 0x7f7f5c0b1840 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c06fa50 tx=0x7f7f50009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc50a67cf49906f server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.681+0000 7f7f5959a700 1 -- 172.21.15.5:0/2548465738 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000b870 con 0x7f7f5c1597d0 2023-03-03T06:26:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.681+0000 7f7f5959a700 1 -- 172.21.15.5:0/2548465738 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5000b9d0 con 0x7f7f5c1597d0 2023-03-03T06:26:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.681+0000 7f7f5959a700 1 -- 172.21.15.5:0/2548465738 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000bd60 con 0x7f7f5c1597d0 2023-03-03T06:26:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.682+0000 7f7f60d3a700 1 -- 172.21.15.5:0/2548465738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5c1597d0 msgr2=0x7f7f5c0b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.682+0000 7f7f60d3a700 1 --2- 172.21.15.5:0/2548465738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5c1597d0 0x7f7f5c0b1840 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c06fa50 tx=0x7f7f50009bd0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.682+0000 7f7f60d3a700 1 -- 172.21.15.5:0/2548465738 shutdown_connections 2023-03-03T06:26:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.682+0000 7f7f60d3a700 1 --2- 172.21.15.5:0/2548465738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5c1597d0 0x7f7f5c0b1840 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.682+0000 7f7f60d3a700 1 --2- 172.21.15.5:0/2548465738 >> v2:172.21.15.191:3300/0 conn(0x7f7f5c0b1d80 0x7f7f5c0b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.682+0000 7f7f60d3a700 1 -- 172.21.15.5:0/2548465738 >> 172.21.15.5:0/2548465738 conn(0x7f7f5c0cc840 msgr2=0x7f7f5c0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.682+0000 7f7f60d3a700 1 -- 172.21.15.5:0/2548465738 shutdown_connections 2023-03-03T06:26:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.682+0000 7f7f60d3a700 1 -- 172.21.15.5:0/2548465738 wait complete. 2023-03-03T06:26:14.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.683+0000 7f7f60d3a700 1 Processor -- start 2023-03-03T06:26:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.683+0000 7f7f60d3a700 1 -- start start 2023-03-03T06:26:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f60d3a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f5c0b1d80 0x7f7f5c0c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f60d3a700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f5c0b56d0 0x7f7f5c1472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f60d3a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5c1597d0 0x7f7f5c0b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f60d3a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c78a0 con 0x7f7f5c1597d0 2023-03-03T06:26:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f60d3a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c3ab0 con 0x7f7f5c0b1d80 2023-03-03T06:26:14.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f60d3a700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c73d0 con 0x7f7f5c0b56d0 2023-03-03T06:26:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f5ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5c1597d0 0x7f7f5c0b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f5ad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5c1597d0 0x7f7f5c0b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46022/0 (socket says 172.21.15.5:46022) 2023-03-03T06:26:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f5ad9d700 1 -- 172.21.15.5:0/3883274439 learned_addr learned my addr 172.21.15.5:0/3883274439 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f5a59c700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f5c0b1d80 0x7f7f5c0c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f59d9b700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f5c0b56d0 0x7f7f5c1472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f5ad9d700 1 -- 172.21.15.5:0/3883274439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f5c0b56d0 msgr2=0x7f7f5c1472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f5ad9d700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f5c0b56d0 0x7f7f5c1472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f5ad9d700 1 -- 172.21.15.5:0/3883274439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f5c0b1d80 msgr2=0x7f7f5c0c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f5ad9d700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f5c0b1d80 0x7f7f5c0c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f5ad9d700 1 -- 172.21.15.5:0/3883274439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f50009550 con 0x7f7f5c1597d0 2023-03-03T06:26:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f5a59c700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f5c0b1d80 0x7f7f5c0c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.684+0000 7f7f59d9b700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f5c0b56d0 0x7f7f5c1472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.685+0000 7f7f5ad9d700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5c1597d0 0x7f7f5c0b0830 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400cc80 tx=0x7f7f5400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.685+0000 7f7f4affd700 1 -- 172.21.15.5:0/3883274439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5400ad40 con 0x7f7f5c1597d0 2023-03-03T06:26:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.685+0000 7f7f4affd700 1 -- 172.21.15.5:0/3883274439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5400ce80 con 0x7f7f5c1597d0 2023-03-03T06:26:14.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.685+0000 7f7f60d3a700 1 -- 172.21.15.5:0/3883274439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5c06c4e0 con 0x7f7f5c1597d0 2023-03-03T06:26:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.685+0000 7f7f4affd700 1 -- 172.21.15.5:0/3883274439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5400aea0 con 0x7f7f5c1597d0 2023-03-03T06:26:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.685+0000 7f7f60d3a700 1 -- 172.21.15.5:0/3883274439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5c06c200 con 0x7f7f5c1597d0 2023-03-03T06:26:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.686+0000 7f7f60d3a700 1 -- 172.21.15.5:0/3883274439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5c06c7c0 con 0x7f7f5c1597d0 2023-03-03T06:26:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.686+0000 7f7f4affd700 1 -- 172.21.15.5:0/3883274439 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7f54010050 con 0x7f7f5c1597d0 2023-03-03T06:26:14.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.686+0000 7f7f4affd700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7f3c0682f0 0x7f7f3c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.687+0000 7f7f4affd700 1 -- 172.21.15.5:0/3883274439 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f7f54086270 con 0x7f7f5c1597d0 2023-03-03T06:26:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.687+0000 7f7f5a59c700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7f3c0682f0 0x7f7f3c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.687+0000 7f7f5a59c700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7f3c0682f0 0x7f7f3c06a7a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0b3220 tx=0x7f7f50008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.691+0000 7f7f4affd700 1 -- 172.21.15.5:0/3883274439 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7f540524d0 con 0x7f7f5c1597d0 2023-03-03T06:26:14.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.885+0000 7f7f60d3a700 1 -- 172.21.15.5:0/3883274439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f7f5c04e6e0 con 0x7f7f5c1597d0 2023-03-03T06:26:14.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.886+0000 7f7f4affd700 1 -- 172.21.15.5:0/3883274439 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v72) v1 ==== 107+0+11 (secure 0 0 0) 0x7f7f54055af0 con 0x7f7f5c1597d0 2023-03-03T06:26:14.888 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:26:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.888+0000 7f7f60d3a700 1 -- 172.21.15.5:0/3883274439 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7f3c0682f0 msgr2=0x7f7f3c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.888+0000 7f7f60d3a700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7f3c0682f0 0x7f7f3c06a7a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0b3220 tx=0x7f7f50008030 comp rx=0 tx=0).stop 2023-03-03T06:26:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.888+0000 7f7f60d3a700 1 -- 172.21.15.5:0/3883274439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5c1597d0 msgr2=0x7f7f5c0b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.888+0000 7f7f60d3a700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5c1597d0 0x7f7f5c0b0830 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400cc80 tx=0x7f7f5400a340 comp rx=0 tx=0).stop 2023-03-03T06:26:14.890 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.888+0000 7f7f60d3a700 1 -- 172.21.15.5:0/3883274439 shutdown_connections 2023-03-03T06:26:14.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.888+0000 7f7f60d3a700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f5c1597d0 0x7f7f5c0b0830 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.888+0000 7f7f60d3a700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7f5c0b1d80 0x7f7f5c0c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.888+0000 7f7f60d3a700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7f3c0682f0 0x7f7f3c06a7a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.888+0000 7f7f60d3a700 1 --2- 172.21.15.5:0/3883274439 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7f5c0b56d0 0x7f7f5c1472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:14.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.888+0000 7f7f60d3a700 1 -- 172.21.15.5:0/3883274439 >> 172.21.15.5:0/3883274439 conn(0x7f7f5c0cc840 msgr2=0x7f7f5c0b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:14.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.888+0000 7f7f60d3a700 1 -- 172.21.15.5:0/3883274439 shutdown_connections 2023-03-03T06:26:14.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:14.888+0000 7f7f60d3a700 1 -- 172.21.15.5:0/3883274439 wait complete. 2023-03-03T06:26:14.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:26:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.026+0000 7f2497103700 1 Processor -- start 2023-03-03T06:26:15.028 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.026+0000 7f2497103700 1 -- start start 2023-03-03T06:26:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.027+0000 7f2497103700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f24900b1fe0 0x7f24900cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.027+0000 7f2497103700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24901577c0 con 0x7f24901573f0 2023-03-03T06:26:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.027+0000 7f2497103700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2490159e60 con 0x7f249015d320 2023-03-03T06:26:15.029 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.027+0000 7f2497103700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24900cc6e0 con 0x7f24900b1fe0 2023-03-03T06:26:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.027+0000 7f2494e9f700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f24901573f0 0x7f24900cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35868/0 (socket says 172.21.15.5:35868) 2023-03-03T06:26:15.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.027+0000 7f2494e9f700 1 -- 172.21.15.5:0/117526481 learned_addr learned my addr 172.21.15.5:0/117526481 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.028+0000 7f24956a0700 1 --2- 172.21.15.5:0/117526481 >> v2:172.21.15.191:3300/0 conn(0x7f24900b1fe0 0x7f24900cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.028+0000 7f248f7fe700 1 -- 172.21.15.5:0/117526481 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925900094 0 0) 0x7f24901577c0 con 0x7f24901573f0 2023-03-03T06:26:15.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.028+0000 7f248f7fe700 1 -- 172.21.15.5:0/117526481 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24800035b0 con 0x7f24901573f0 2023-03-03T06:26:15.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.028+0000 7f24956a0700 1 -- 172.21.15.5:0/117526481 >> v1:172.21.15.191:6789/0 conn(0x7f249015d320 legacy=0x7f24900b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.028+0000 7f248f7fe700 1 -- 172.21.15.5:0/117526481 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1789212556 0 0) 0x7f24800035b0 con 0x7f24901573f0 2023-03-03T06:26:15.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.028+0000 7f24956a0700 1 -- 172.21.15.5:0/117526481 >> v1:172.21.15.5:6789/0 conn(0x7f24901573f0 legacy=0x7f24900cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.028+0000 7f24956a0700 1 -- 172.21.15.5:0/117526481 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24900ce460 con 0x7f24900b1fe0 2023-03-03T06:26:15.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.028+0000 7f24956a0700 1 --2- 172.21.15.5:0/117526481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24900b1fe0 0x7f24900cc1a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2488009d90 tx=0x7f248800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e43a789fe4a438d8 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:15.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.028+0000 7f248f7fe700 1 -- 172.21.15.5:0/117526481 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248800e070 con 0x7f24900b1fe0 2023-03-03T06:26:15.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.028+0000 7f248f7fe700 1 -- 172.21.15.5:0/117526481 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2488003a20 con 0x7f24900b1fe0 2023-03-03T06:26:15.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.028+0000 7f248f7fe700 1 -- 172.21.15.5:0/117526481 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484001670 con 0x7f24900b1fe0 2023-03-03T06:26:15.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.029+0000 7f2497103700 1 -- 172.21.15.5:0/117526481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24900b1fe0 msgr2=0x7f24900cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.029+0000 7f2497103700 1 --2- 172.21.15.5:0/117526481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24900b1fe0 0x7f24900cc1a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2488009d90 tx=0x7f248800b330 comp rx=0 tx=0).stop 2023-03-03T06:26:15.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.029+0000 7f2497103700 1 -- 172.21.15.5:0/117526481 shutdown_connections 2023-03-03T06:26:15.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.029+0000 7f2497103700 1 --2- 172.21.15.5:0/117526481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f24900b1fe0 0x7f24900cc1a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.029+0000 7f2497103700 1 -- 172.21.15.5:0/117526481 >> 172.21.15.5:0/117526481 conn(0x7f24900cc8d0 msgr2=0x7f24900cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:15.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.029+0000 7f2497103700 1 -- 172.21.15.5:0/117526481 shutdown_connections 2023-03-03T06:26:15.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.029+0000 7f2497103700 1 -- 172.21.15.5:0/117526481 wait complete. 2023-03-03T06:26:15.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.030+0000 7f2497103700 1 Processor -- start 2023-03-03T06:26:15.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.031+0000 7f2497103700 1 -- start start 2023-03-03T06:26:15.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2497103700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24900b1fe0 0x7f24900b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2497103700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24901573f0 0x7f24901efb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2497103700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f249015d320 0x7f24900b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2497103700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24900c62b0 con 0x7f24900b1fe0 2023-03-03T06:26:15.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2497103700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2490153e00 con 0x7f249015d320 2023-03-03T06:26:15.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2497103700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24900c3980 con 0x7f24901573f0 2023-03-03T06:26:15.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2494e9f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24900b1fe0 0x7f24900b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2494e9f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24900b1fe0 0x7f24900b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46030/0 (socket says 172.21.15.5:46030) 2023-03-03T06:26:15.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2494e9f700 1 -- 172.21.15.5:0/1545295449 learned_addr learned my addr 172.21.15.5:0/1545295449 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:15.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f24956a0700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f249015d320 0x7f24900b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f248ffff700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24901573f0 0x7f24901efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2494e9f700 1 -- 172.21.15.5:0/1545295449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24901573f0 msgr2=0x7f24901efb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2494e9f700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24901573f0 0x7f24901efb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2494e9f700 1 -- 172.21.15.5:0/1545295449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f249015d320 msgr2=0x7f24900b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2494e9f700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f249015d320 0x7f24900b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2494e9f700 1 -- 172.21.15.5:0/1545295449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2488009a70 con 0x7f24900b1fe0 2023-03-03T06:26:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f248ffff700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24901573f0 0x7f24901efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f2494e9f700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24900b1fe0 0x7f24900b4ac0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f248400c700 tx=0x7f248400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.032+0000 7f248d7fa700 1 -- 172.21.15.5:0/1545295449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484004c80 con 0x7f24900b1fe0 2023-03-03T06:26:15.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.033+0000 7f248d7fa700 1 -- 172.21.15.5:0/1545295449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2484004e00 con 0x7f24900b1fe0 2023-03-03T06:26:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.033+0000 7f248d7fa700 1 -- 172.21.15.5:0/1545295449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484007310 con 0x7f24900b1fe0 2023-03-03T06:26:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.033+0000 7f2497103700 1 -- 172.21.15.5:0/1545295449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249015dbe0 con 0x7f24900b1fe0 2023-03-03T06:26:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.033+0000 7f2497103700 1 -- 172.21.15.5:0/1545295449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249015d900 con 0x7f24900b1fe0 2023-03-03T06:26:15.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.034+0000 7f2497103700 1 -- 172.21.15.5:0/1545295449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249015dec0 con 0x7f24900b1fe0 2023-03-03T06:26:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.034+0000 7f248d7fa700 1 -- 172.21.15.5:0/1545295449 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f248401a020 con 0x7f24900b1fe0 2023-03-03T06:26:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.034+0000 7f248d7fa700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f24740682f0 0x7f247406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.035+0000 7f248d7fa700 1 -- 172.21.15.5:0/1545295449 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f2484085f30 con 0x7f24900b1fe0 2023-03-03T06:26:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.035+0000 7f248ffff700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f24740682f0 0x7f247406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.035+0000 7f248ffff700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f24740682f0 0x7f247406a7a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f24900cf230 tx=0x7f247c007e10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:15.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.039+0000 7f248d7fa700 1 -- 172.21.15.5:0/1545295449 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2484052170 con 0x7f24900b1fe0 2023-03-03T06:26:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.276+0000 7f2497103700 1 -- 172.21.15.5:0/1545295449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f249004e6e0 con 0x7f24900b1fe0 2023-03-03T06:26:15.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.276+0000 7f248d7fa700 1 -- 172.21.15.5:0/1545295449 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f2484055790 con 0x7f24900b1fe0 2023-03-03T06:26:15.279 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:15.279 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3446616567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3446616567},{"type":"v1","addr":"172.21.15.5:6836","nonce":3446616567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/430214005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":430214005},{"type":"v1","addr":"172.21.15.5:6837","nonce":430214005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6198,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/3308805305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":3308805305},{"type":"v1","addr":"172.21.15.191:6834","nonce":3308805305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:25:56.073978+0000","modified":"2023-03-03T06:25:59.082181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6201":{"gid":6201,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1046120178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":1046120178},{"type":"v1","addr":"172.21.15.191:6835","nonce":1046120178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-03-03T06:26:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.279+0000 7f2497103700 1 -- 172.21.15.5:0/1545295449 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f24740682f0 msgr2=0x7f247406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.279+0000 7f2497103700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f24740682f0 0x7f247406a7a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f24900cf230 tx=0x7f247c007e10 comp rx=0 tx=0).stop 2023-03-03T06:26:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.279+0000 7f2497103700 1 -- 172.21.15.5:0/1545295449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24900b1fe0 msgr2=0x7f24900b4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.279+0000 7f2497103700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24900b1fe0 0x7f24900b4ac0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f248400c700 tx=0x7f248400ca10 comp rx=0 tx=0).stop 2023-03-03T06:26:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.279+0000 7f2497103700 1 -- 172.21.15.5:0/1545295449 shutdown_connections 2023-03-03T06:26:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.279+0000 7f2497103700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f249015d320 0x7f24900b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.279+0000 7f2497103700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24900b1fe0 0x7f24900b4ac0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.279+0000 7f2497103700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f24740682f0 0x7f247406a7a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.279+0000 7f2497103700 1 --2- 172.21.15.5:0/1545295449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f24901573f0 0x7f24901efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.279+0000 7f2497103700 1 -- 172.21.15.5:0/1545295449 >> 172.21.15.5:0/1545295449 conn(0x7f24900cc8d0 msgr2=0x7f24900cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.279+0000 7f2497103700 1 -- 172.21.15.5:0/1545295449 shutdown_connections 2023-03-03T06:26:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.279+0000 7f2497103700 1 -- 172.21.15.5:0/1545295449 wait complete. 2023-03-03T06:26:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-03-03T06:26:15.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:26:15.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.417+0000 7ff5fa20c700 1 Processor -- start 2023-03-03T06:26:15.420 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.417+0000 7ff5fa20c700 1 -- start start 2023-03-03T06:26:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.418+0000 7ff5fa20c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff5f415cd40 0x7ff5f40b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.418+0000 7ff5fa20c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f41615b0 con 0x7ff5f40cba50 2023-03-03T06:26:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.418+0000 7ff5fa20c700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f415d4e0 con 0x7ff5f40cef60 2023-03-03T06:26:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.418+0000 7ff5fa20c700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f415d7c0 con 0x7ff5f415cd40 2023-03-03T06:26:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.418+0000 7ff5f2ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff5f40cba50 0x7ff5f4160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35882/0 (socket says 172.21.15.5:35882) 2023-03-03T06:26:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.418+0000 7ff5f2ffd700 1 -- 172.21.15.5:0/2427036100 learned_addr learned my addr 172.21.15.5:0/2427036100 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.418+0000 7ff5f37fe700 1 --2- 172.21.15.5:0/2427036100 >> v2:172.21.15.191:3300/0 conn(0x7ff5f415cd40 0x7ff5f40b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.419+0000 7ff5f27fc700 1 -- 172.21.15.5:0/2427036100 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282084546 0 0) 0x7ff5f41615b0 con 0x7ff5f40cba50 2023-03-03T06:26:15.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.419+0000 7ff5f27fc700 1 -- 172.21.15.5:0/2427036100 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5dc0035b0 con 0x7ff5f40cba50 2023-03-03T06:26:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.419+0000 7ff5f37fe700 1 -- 172.21.15.5:0/2427036100 >> v1:172.21.15.191:6789/0 conn(0x7ff5f40cef60 legacy=0x7ff5f4160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.419+0000 7ff5f27fc700 1 -- 172.21.15.5:0/2427036100 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233031555 0 0) 0x7ff5f415d4e0 con 0x7ff5f40cef60 2023-03-03T06:26:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.419+0000 7ff5f37fe700 1 -- 172.21.15.5:0/2427036100 >> v1:172.21.15.5:6789/0 conn(0x7ff5f40cba50 legacy=0x7ff5f4160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.419+0000 7ff5f37fe700 1 -- 172.21.15.5:0/2427036100 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f415daa0 con 0x7ff5f415cd40 2023-03-03T06:26:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.419+0000 7ff5f37fe700 1 --2- 172.21.15.5:0/2427036100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f415cd40 0x7ff5f40b18d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009840 tx=0x7ff5e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb4a1ed51136b5df server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.419+0000 7ff5f27fc700 1 -- 172.21.15.5:0/2427036100 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4011830 con 0x7ff5f415cd40 2023-03-03T06:26:15.423 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.419+0000 7ff5f27fc700 1 -- 172.21.15.5:0/2427036100 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4011990 con 0x7ff5f415cd40 2023-03-03T06:26:15.424 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.419+0000 7ff5f27fc700 1 -- 172.21.15.5:0/2427036100 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4011d20 con 0x7ff5f415cd40 2023-03-03T06:26:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.420+0000 7ff5fa20c700 1 -- 172.21.15.5:0/2427036100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f415cd40 msgr2=0x7ff5f40b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.420+0000 7ff5fa20c700 1 --2- 172.21.15.5:0/2427036100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f415cd40 0x7ff5f40b18d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009840 tx=0x7ff5e4009b50 comp rx=0 tx=0).stop 2023-03-03T06:26:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.420+0000 7ff5fa20c700 1 -- 172.21.15.5:0/2427036100 shutdown_connections 2023-03-03T06:26:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.420+0000 7ff5fa20c700 1 --2- 172.21.15.5:0/2427036100 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f415cd40 0x7ff5f40b18d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.426 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.420+0000 7ff5fa20c700 1 -- 172.21.15.5:0/2427036100 >> 172.21.15.5:0/2427036100 conn(0x7ff5f40cc8d0 msgr2=0x7ff5f40cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.420+0000 7ff5fa20c700 1 -- 172.21.15.5:0/2427036100 shutdown_connections 2023-03-03T06:26:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.420+0000 7ff5fa20c700 1 -- 172.21.15.5:0/2427036100 wait complete. 2023-03-03T06:26:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.421+0000 7ff5fa20c700 1 Processor -- start 2023-03-03T06:26:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.422+0000 7ff5fa20c700 1 -- start start 2023-03-03T06:26:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5fa20c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f40cba50 0x7ff5f4154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5fa20c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f40cef60 0x7ff5f40c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.427 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5fa20c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f415cd40 0x7ff5f406c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5fa20c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f4154c90 con 0x7ff5f415cd40 2023-03-03T06:26:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5fa20c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f40c40e0 con 0x7ff5f40cef60 2023-03-03T06:26:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5fa20c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f40c7d30 con 0x7ff5f40cba50 2023-03-03T06:26:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5f3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f415cd40 0x7ff5f406c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5f3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f415cd40 0x7ff5f406c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46048/0 (socket says 172.21.15.5:46048) 2023-03-03T06:26:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5f3fff700 1 -- 172.21.15.5:0/1229068203 learned_addr learned my addr 172.21.15.5:0/1229068203 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:15.428 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5f2ffd700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f40cef60 0x7ff5f40c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5f37fe700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f40cba50 0x7ff5f4154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5f3fff700 1 -- 172.21.15.5:0/1229068203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f40cba50 msgr2=0x7ff5f4154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5f3fff700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f40cba50 0x7ff5f4154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5f3fff700 1 -- 172.21.15.5:0/1229068203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f40cef60 msgr2=0x7ff5f40c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.429 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5f3fff700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f40cef60 0x7ff5f40c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5f3fff700 1 -- 172.21.15.5:0/1229068203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e40094a0 con 0x7ff5f415cd40 2023-03-03T06:26:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.423+0000 7ff5f3fff700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f415cd40 0x7ff5f406c5b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00c870 tx=0x7ff5ec00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.424+0000 7ff5dbfff700 1 -- 172.21.15.5:0/1229068203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec003e30 con 0x7ff5f415cd40 2023-03-03T06:26:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.424+0000 7ff5dbfff700 1 -- 172.21.15.5:0/1229068203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec005070 con 0x7ff5f415cd40 2023-03-03T06:26:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.424+0000 7ff5fa20c700 1 -- 172.21.15.5:0/1229068203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f415e060 con 0x7ff5f415cd40 2023-03-03T06:26:15.430 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.424+0000 7ff5dbfff700 1 -- 172.21.15.5:0/1229068203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec005420 con 0x7ff5f415cd40 2023-03-03T06:26:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.424+0000 7ff5fa20c700 1 -- 172.21.15.5:0/1229068203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f415dd80 con 0x7ff5f415cd40 2023-03-03T06:26:15.431 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.424+0000 7ff5fa20c700 1 -- 172.21.15.5:0/1229068203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f40ca530 con 0x7ff5f415cd40 2023-03-03T06:26:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.425+0000 7ff5dbfff700 1 -- 172.21.15.5:0/1229068203 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff5ec019030 con 0x7ff5f415cd40 2023-03-03T06:26:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.425+0000 7ff5dbfff700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff5e00682f0 0x7ff5e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.426+0000 7ff5f37fe700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff5e00682f0 0x7ff5e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.426+0000 7ff5dbfff700 1 -- 172.21.15.5:0/1229068203 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7ff5ec085700 con 0x7ff5f415cd40 2023-03-03T06:26:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.426+0000 7ff5f37fe700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff5e00682f0 0x7ff5e006a7a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009fd0 tx=0x7ff5e401c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:15.432 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.430+0000 7ff5dbfff700 1 -- 172.21.15.5:0/1229068203 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff5ec0519c0 con 0x7ff5f415cd40 2023-03-03T06:26:15.628 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.626+0000 7ff5fa20c700 1 -- 172.21.15.5:0/1229068203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5f404e6e0 con 0x7ff5f415cd40 2023-03-03T06:26:15.630 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.628+0000 7ff5dbfff700 1 -- 172.21.15.5:0/1229068203 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+23317 (secure 0 0 0) 0x7ff5ec017090 con 0x7ff5f415cd40 2023-03-03T06:26:15.630 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:15.631 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":72,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:26:07.433188+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:54.356683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:55.044358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_data_pool","create_time":"2023-03-03T06:26:03.629103+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":72,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"test_metadata_pool","create_time":"2023-03-03T06:26:04.826705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":13,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":13,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:26:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.630+0000 7ff5fa20c700 1 -- 172.21.15.5:0/1229068203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff5e00682f0 msgr2=0x7ff5e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.632 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.630+0000 7ff5fa20c700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff5e00682f0 0x7ff5e006a7a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009fd0 tx=0x7ff5e401c040 comp rx=0 tx=0).stop 2023-03-03T06:26:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.630+0000 7ff5fa20c700 1 -- 172.21.15.5:0/1229068203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f415cd40 msgr2=0x7ff5f406c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.630+0000 7ff5fa20c700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f415cd40 0x7ff5f406c5b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00c870 tx=0x7ff5ec00cb80 comp rx=0 tx=0).stop 2023-03-03T06:26:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.630+0000 7ff5fa20c700 1 -- 172.21.15.5:0/1229068203 shutdown_connections 2023-03-03T06:26:15.633 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.630+0000 7ff5fa20c700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5f415cd40 0x7ff5f406c5b0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.630+0000 7ff5fa20c700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7ff5e00682f0 0x7ff5e006a7a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.630+0000 7ff5fa20c700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff5f40cba50 0x7ff5f4154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.630+0000 7ff5fa20c700 1 --2- 172.21.15.5:0/1229068203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff5f40cef60 0x7ff5f40c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.630+0000 7ff5fa20c700 1 -- 172.21.15.5:0/1229068203 >> 172.21.15.5:0/1229068203 conn(0x7ff5f40cc8d0 msgr2=0x7ff5f40b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:15.634 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.630+0000 7ff5fa20c700 1 -- 172.21.15.5:0/1229068203 shutdown_connections 2023-03-03T06:26:15.635 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.630+0000 7ff5fa20c700 1 -- 172.21.15.5:0/1229068203 wait complete. 2023-03-03T06:26:15.645 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-03-03T06:26:15.645 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:26:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.767+0000 7f93e48f7700 1 Processor -- start 2023-03-03T06:26:15.770 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.767+0000 7f93e48f7700 1 -- start start 2023-03-03T06:26:15.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.768+0000 7f93e48f7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f93e00b87b0 0x7f93e0160d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.768+0000 7f93e48f7700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93e00d2b60 0x7f93e00b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.773 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.768+0000 7f93e48f7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93e00b5010 0x7f93e006a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.768+0000 7f93e48f7700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e00b5470 con 0x7f93e00d2b60 2023-03-03T06:26:15.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.768+0000 7f93e48f7700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e00cf2a0 con 0x7f93e00b87b0 2023-03-03T06:26:15.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.768+0000 7f93e48f7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0161240 con 0x7f93e00b5010 2023-03-03T06:26:15.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93ddd9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93e00d2b60 0x7f93e00b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.774 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93ddd9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93e00d2b60 0x7f93e00b4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46052/0 (socket says 172.21.15.5:46052) 2023-03-03T06:26:15.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93ddd9b700 1 -- 172.21.15.5:0/1669123655 learned_addr learned my addr 172.21.15.5:0/1669123655 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:15.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93de59c700 1 --2- 172.21.15.5:0/1669123655 >> v2:172.21.15.191:3300/0 conn(0x7f93e00b87b0 0x7f93e0160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93ded9d700 1 --2- 172.21.15.5:0/1669123655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93e00b5010 0x7f93e006a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.775 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93ddd9b700 1 -- 172.21.15.5:0/1669123655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93e00b5010 msgr2=0x7f93e006a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:15.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93ddd9b700 1 --2- 172.21.15.5:0/1669123655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93e00b5010 0x7f93e006a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93ddd9b700 1 -- 172.21.15.5:0/1669123655 >> v2:172.21.15.191:3300/0 conn(0x7f93e00b87b0 msgr2=0x7f93e0160d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:15.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93ddd9b700 1 --2- 172.21.15.5:0/1669123655 >> v2:172.21.15.191:3300/0 conn(0x7f93e00b87b0 0x7f93e0160d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93ddd9b700 1 -- 172.21.15.5:0/1669123655 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e00cf520 con 0x7f93e00d2b60 2023-03-03T06:26:15.776 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93de59c700 1 --2- 172.21.15.5:0/1669123655 >> v2:172.21.15.191:3300/0 conn(0x7f93e00b87b0 0x7f93e0160d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:15.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93ddd9b700 1 --2- 172.21.15.5:0/1669123655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e00d2b60 0x7f93e00b4ad0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f93e008c2c0 tx=0x7f93d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442e6205f192b445 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:15.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93dd59a700 1 -- 172.21.15.5:0/1669123655 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000b870 con 0x7f93e00d2b60 2023-03-03T06:26:15.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93dd59a700 1 -- 172.21.15.5:0/1669123655 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d000b9d0 con 0x7f93e00d2b60 2023-03-03T06:26:15.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.769+0000 7f93dd59a700 1 -- 172.21.15.5:0/1669123655 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000bd60 con 0x7f93e00d2b60 2023-03-03T06:26:15.777 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.770+0000 7f93e48f7700 1 -- 172.21.15.5:0/1669123655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e00d2b60 msgr2=0x7f93e00b4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.770+0000 7f93e48f7700 1 --2- 172.21.15.5:0/1669123655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e00d2b60 0x7f93e00b4ad0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f93e008c2c0 tx=0x7f93d0009bd0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.770+0000 7f93e48f7700 1 -- 172.21.15.5:0/1669123655 shutdown_connections 2023-03-03T06:26:15.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.770+0000 7f93e48f7700 1 --2- 172.21.15.5:0/1669123655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93e00b5010 0x7f93e006a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.770+0000 7f93e48f7700 1 --2- 172.21.15.5:0/1669123655 >> v2:172.21.15.191:3300/0 conn(0x7f93e00b87b0 0x7f93e0160d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.778 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.770+0000 7f93e48f7700 1 --2- 172.21.15.5:0/1669123655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e00d2b60 0x7f93e00b4ad0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.770+0000 7f93e48f7700 1 -- 172.21.15.5:0/1669123655 >> 172.21.15.5:0/1669123655 conn(0x7f93e006d0b0 msgr2=0x7f93e00cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:15.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.770+0000 7f93e48f7700 1 -- 172.21.15.5:0/1669123655 shutdown_connections 2023-03-03T06:26:15.779 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.770+0000 7f93e48f7700 1 -- 172.21.15.5:0/1669123655 wait complete. 2023-03-03T06:26:15.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.771+0000 7f93e48f7700 1 Processor -- start 2023-03-03T06:26:15.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.771+0000 7f93e48f7700 1 -- start start 2023-03-03T06:26:15.782 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93e48f7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e00b5010 0x7f93e00c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93e48f7700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93e00b87b0 0x7f93e00b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93e48f7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93e00d2b60 0x7f93e0153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93e48f7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00ca7f0 con 0x7f93e00b5010 2023-03-03T06:26:15.783 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93e48f7700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00caad0 con 0x7f93e00b87b0 2023-03-03T06:26:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93e48f7700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00cadb0 con 0x7f93e00d2b60 2023-03-03T06:26:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93de59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e00b5010 0x7f93e00c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93de59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e00b5010 0x7f93e00c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46056/0 (socket says 172.21.15.5:46056) 2023-03-03T06:26:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93de59c700 1 -- 172.21.15.5:0/3309598665 learned_addr learned my addr 172.21.15.5:0/3309598665 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93ddd9b700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93e00b87b0 0x7f93e00b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93ded9d700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93e00d2b60 0x7f93e0153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93de59c700 1 -- 172.21.15.5:0/3309598665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93e00d2b60 msgr2=0x7f93e0153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93de59c700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93e00d2b60 0x7f93e0153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93de59c700 1 -- 172.21.15.5:0/3309598665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93e00b87b0 msgr2=0x7f93e00b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93de59c700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93e00b87b0 0x7f93e00b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.772+0000 7f93de59c700 1 -- 172.21.15.5:0/3309598665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d0009550 con 0x7f93e00b5010 2023-03-03T06:26:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.773+0000 7f93de59c700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e00b5010 0x7f93e00c7550 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f93d400c7f0 tx=0x7f93d400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.773+0000 7f93ceffd700 1 -- 172.21.15.5:0/3309598665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4011800 con 0x7f93e00b5010 2023-03-03T06:26:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.773+0000 7f93ceffd700 1 -- 172.21.15.5:0/3309598665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d4011960 con 0x7f93e00b5010 2023-03-03T06:26:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.773+0000 7f93e48f7700 1 -- 172.21.15.5:0/3309598665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e00cd740 con 0x7f93e00b5010 2023-03-03T06:26:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.773+0000 7f93ceffd700 1 -- 172.21.15.5:0/3309598665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4011d10 con 0x7f93e00b5010 2023-03-03T06:26:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.773+0000 7f93e48f7700 1 -- 172.21.15.5:0/3309598665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e00cf800 con 0x7f93e00b5010 2023-03-03T06:26:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.774+0000 7f93e48f7700 1 -- 172.21.15.5:0/3309598665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e00cda20 con 0x7f93e00b5010 2023-03-03T06:26:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.774+0000 7f93ceffd700 1 -- 172.21.15.5:0/3309598665 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f93d4021070 con 0x7f93e00b5010 2023-03-03T06:26:15.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.775+0000 7f93ceffd700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f93c00682f0 0x7f93c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:15.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.775+0000 7f93ceffd700 1 -- 172.21.15.5:0/3309598665 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f93d40861a0 con 0x7f93e00b5010 2023-03-03T06:26:15.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.775+0000 7f93ddd9b700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f93c00682f0 0x7f93c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:15.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.775+0000 7f93ddd9b700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f93c00682f0 0x7f93c006a7a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f93d0000c00 tx=0x7f93d0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:15.788 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:15.779+0000 7f93ceffd700 1 -- 172.21.15.5:0/3309598665 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f93d4052370 con 0x7f93e00b5010 2023-03-03T06:26:16.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.012+0000 7f93e48f7700 1 -- 172.21.15.5:0/3309598665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93e004e6e0 con 0x7f93e00b5010 2023-03-03T06:26:16.015 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.013+0000 7f93ceffd700 1 -- 172.21.15.5:0/3309598665 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f93d4055990 con 0x7f93e00b5010 2023-03-03T06:26:16.015 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:16.015 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3446616567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3446616567},{"type":"v1","addr":"172.21.15.5:6836","nonce":3446616567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/430214005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":430214005},{"type":"v1","addr":"172.21.15.5:6837","nonce":430214005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6198,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/3308805305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":3308805305},{"type":"v1","addr":"172.21.15.191:6834","nonce":3308805305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:25:56.073978+0000","modified":"2023-03-03T06:25:59.082181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6201":{"gid":6201,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1046120178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":1046120178},{"type":"v1","addr":"172.21.15.191:6835","nonce":1046120178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-03-03T06:26:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.015+0000 7f93e48f7700 1 -- 172.21.15.5:0/3309598665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f93c00682f0 msgr2=0x7f93c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.015+0000 7f93e48f7700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f93c00682f0 0x7f93c006a7a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f93d0000c00 tx=0x7f93d0008030 comp rx=0 tx=0).stop 2023-03-03T06:26:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.015+0000 7f93e48f7700 1 -- 172.21.15.5:0/3309598665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e00b5010 msgr2=0x7f93e00c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.015+0000 7f93e48f7700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e00b5010 0x7f93e00c7550 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f93d400c7f0 tx=0x7f93d400cbb0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.015+0000 7f93e48f7700 1 -- 172.21.15.5:0/3309598665 shutdown_connections 2023-03-03T06:26:16.017 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.015+0000 7f93e48f7700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f93c00682f0 0x7f93c006a7a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.015+0000 7f93e48f7700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f93e00d2b60 0x7f93e0153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.015+0000 7f93e48f7700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93e00b5010 0x7f93e00c7550 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.015+0000 7f93e48f7700 1 --2- 172.21.15.5:0/3309598665 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93e00b87b0 0x7f93e00b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.015+0000 7f93e48f7700 1 -- 172.21.15.5:0/3309598665 >> 172.21.15.5:0/3309598665 conn(0x7f93e006d0b0 msgr2=0x7f93e00b5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:16.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.015+0000 7f93e48f7700 1 -- 172.21.15.5:0/3309598665 shutdown_connections 2023-03-03T06:26:16.018 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.015+0000 7f93e48f7700 1 -- 172.21.15.5:0/3309598665 wait complete. 2023-03-03T06:26:16.018 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-03-03T06:26:16.030 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:26:16.154 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.152+0000 7f86cbf00700 1 Processor -- start 2023-03-03T06:26:16.155 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.153+0000 7f86cbf00700 1 -- start start 2023-03-03T06:26:16.156 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.153+0000 7f86cbf00700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f86c40cb690 0x7f86c415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.153+0000 7f86cbf00700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86c415ef50 0x7f86c406a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.153+0000 7f86cbf00700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c415e580 con 0x7f86c415a7d0 2023-03-03T06:26:16.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.153+0000 7f86cbf00700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c40ca710 con 0x7f86c40cb690 2023-03-03T06:26:16.157 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.153+0000 7f86cbf00700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40ca9f0 con 0x7f86c415ef50 2023-03-03T06:26:16.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.154+0000 7f86c949b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f86c40cb690 0x7f86c415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.154+0000 7f86ca49d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86c415ef50 0x7f86c406a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.154+0000 7f86c949b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f86c40cb690 0x7f86c415ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:46426/0 (socket says 172.21.15.5:46426) 2023-03-03T06:26:16.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.154+0000 7f86c949b700 1 -- 172.21.15.5:0/605854584 learned_addr learned my addr 172.21.15.5:0/605854584 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:16.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.154+0000 7f86ca49d700 1 -- 172.21.15.5:0/605854584 >> v2:172.21.15.191:3300/0 conn(0x7f86c40cb690 msgr2=0x7f86c415ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:16.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.154+0000 7f86ca49d700 1 --2- 172.21.15.5:0/605854584 >> v2:172.21.15.191:3300/0 conn(0x7f86c40cb690 0x7f86c415ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.154+0000 7f86ca49d700 1 -- 172.21.15.5:0/605854584 >> v1:172.21.15.191:6789/0 conn(0x7f86c415a7d0 legacy=0x7f86c40c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.158 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.154+0000 7f86ca49d700 1 -- 172.21.15.5:0/605854584 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c40cacd0 con 0x7f86c415ef50 2023-03-03T06:26:16.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.154+0000 7f86c949b700 1 --2- 172.21.15.5:0/605854584 >> v2:172.21.15.191:3300/0 conn(0x7f86c40cb690 0x7f86c415ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:26:16.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.154+0000 7f86ca49d700 1 --2- 172.21.15.5:0/605854584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86c415ef50 0x7f86c406a330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009d90 tx=0x7f86bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9402f7cacdaae50c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:16.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.155+0000 7f86c8c9a700 1 -- 172.21.15.5:0/605854584 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc00e070 con 0x7f86c415ef50 2023-03-03T06:26:16.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.155+0000 7f86c8c9a700 1 -- 172.21.15.5:0/605854584 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc00bb20 con 0x7f86c415ef50 2023-03-03T06:26:16.159 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.155+0000 7f86c8c9a700 1 -- 172.21.15.5:0/605854584 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc012430 con 0x7f86c415ef50 2023-03-03T06:26:16.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.155+0000 7f86cbf00700 1 -- 172.21.15.5:0/605854584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86c415ef50 msgr2=0x7f86c406a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.155+0000 7f86cbf00700 1 --2- 172.21.15.5:0/605854584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86c415ef50 0x7f86c406a330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009d90 tx=0x7f86bc00b330 comp rx=0 tx=0).stop 2023-03-03T06:26:16.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.155+0000 7f86cbf00700 1 -- 172.21.15.5:0/605854584 shutdown_connections 2023-03-03T06:26:16.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.155+0000 7f86cbf00700 1 --2- 172.21.15.5:0/605854584 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86c415ef50 0x7f86c406a330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.155+0000 7f86cbf00700 1 --2- 172.21.15.5:0/605854584 >> v2:172.21.15.191:3300/0 conn(0x7f86c40cb690 0x7f86c415ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.162 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.155+0000 7f86cbf00700 1 -- 172.21.15.5:0/605854584 >> 172.21.15.5:0/605854584 conn(0x7f86c40cf4b0 msgr2=0x7f86c40cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:16.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.155+0000 7f86cbf00700 1 -- 172.21.15.5:0/605854584 shutdown_connections 2023-03-03T06:26:16.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.155+0000 7f86cbf00700 1 -- 172.21.15.5:0/605854584 wait complete. 2023-03-03T06:26:16.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.156+0000 7f86cbf00700 1 Processor -- start 2023-03-03T06:26:16.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.156+0000 7f86cbf00700 1 -- start start 2023-03-03T06:26:16.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.157+0000 7f86cbf00700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86c40cb690 0x7f86c40ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.157+0000 7f86cbf00700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86c415a7d0 0x7f86c40c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.157+0000 7f86cbf00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c415ef50 0x7f86c41ef8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.163 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.157+0000 7f86cbf00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40c7db0 con 0x7f86c415ef50 2023-03-03T06:26:16.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.157+0000 7f86cbf00700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40c7fe0 con 0x7f86c40cb690 2023-03-03T06:26:16.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.157+0000 7f86cbf00700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40c82c0 con 0x7f86c415a7d0 2023-03-03T06:26:16.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.157+0000 7f86ca49d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c415ef50 0x7f86c41ef8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.157+0000 7f86ca49d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c415ef50 0x7f86c41ef8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46074/0 (socket says 172.21.15.5:46074) 2023-03-03T06:26:16.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.157+0000 7f86ca49d700 1 -- 172.21.15.5:0/1793147299 learned_addr learned my addr 172.21.15.5:0/1793147299 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:16.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.157+0000 7f86c949b700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86c415a7d0 0x7f86c40c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.157+0000 7f86c9c9c700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86c40cb690 0x7f86c40ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.164 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.158+0000 7f86ca49d700 1 -- 172.21.15.5:0/1793147299 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86c415a7d0 msgr2=0x7f86c40c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.158+0000 7f86ca49d700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86c415a7d0 0x7f86c40c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.158+0000 7f86ca49d700 1 -- 172.21.15.5:0/1793147299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86c40cb690 msgr2=0x7f86c40ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.158+0000 7f86ca49d700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86c40cb690 0x7f86c40ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.158+0000 7f86ca49d700 1 -- 172.21.15.5:0/1793147299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c0009550 con 0x7f86c415ef50 2023-03-03T06:26:16.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.158+0000 7f86ca49d700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c415ef50 0x7f86c41ef8b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f86bc014040 tx=0x7f86bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:16.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.158+0000 7f86ba7fc700 1 -- 172.21.15.5:0/1793147299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc012430 con 0x7f86c415ef50 2023-03-03T06:26:16.165 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.158+0000 7f86ba7fc700 1 -- 172.21.15.5:0/1793147299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc020070 con 0x7f86c415ef50 2023-03-03T06:26:16.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.158+0000 7f86cbf00700 1 -- 172.21.15.5:0/1793147299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86bc009a70 con 0x7f86c415ef50 2023-03-03T06:26:16.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.158+0000 7f86ba7fc700 1 -- 172.21.15.5:0/1793147299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc003ea0 con 0x7f86c415ef50 2023-03-03T06:26:16.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.158+0000 7f86cbf00700 1 -- 172.21.15.5:0/1793147299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c406a870 con 0x7f86c415ef50 2023-03-03T06:26:16.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.159+0000 7f86cbf00700 1 -- 172.21.15.5:0/1793147299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c415e210 con 0x7f86c415ef50 2023-03-03T06:26:16.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.159+0000 7f86ba7fc700 1 -- 172.21.15.5:0/1793147299 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f86bc02e070 con 0x7f86c415ef50 2023-03-03T06:26:16.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.160+0000 7f86ba7fc700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86a80682f0 0x7f86a806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.160+0000 7f86ba7fc700 1 -- 172.21.15.5:0/1793147299 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f86bc022070 con 0x7f86c415ef50 2023-03-03T06:26:16.166 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.160+0000 7f86c9c9c700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86a80682f0 0x7f86a806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.160+0000 7f86c9c9c700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86a80682f0 0x7f86a806a7a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f86b4007fd0 tx=0x7f86b4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:16.167 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.164+0000 7f86ba7fc700 1 -- 172.21.15.5:0/1793147299 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f86bc054150 con 0x7f86c415ef50 2023-03-03T06:26:16.402 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.400+0000 7f86cbf00700 1 -- 172.21.15.5:0/1793147299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86c406aa00 con 0x7f86c415ef50 2023-03-03T06:26:16.403 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.401+0000 7f86ba7fc700 1 -- 172.21.15.5:0/1793147299 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f86bc02c090 con 0x7f86c415ef50 2023-03-03T06:26:16.403 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:16.403 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3446616567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3446616567},{"type":"v1","addr":"172.21.15.5:6836","nonce":3446616567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/430214005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":430214005},{"type":"v1","addr":"172.21.15.5:6837","nonce":430214005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6198,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/3308805305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":3308805305},{"type":"v1","addr":"172.21.15.191:6834","nonce":3308805305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:25:56.073978+0000","modified":"2023-03-03T06:25:59.082181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6201},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6201":{"gid":6201,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.191:6835/1046120178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":1046120178},{"type":"v1","addr":"172.21.15.191:6835","nonce":1046120178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-03-03T06:26:16.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.403+0000 7f86cbf00700 1 -- 172.21.15.5:0/1793147299 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86a80682f0 msgr2=0x7f86a806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.403+0000 7f86cbf00700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86a80682f0 0x7f86a806a7a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f86b4007fd0 tx=0x7f86b4009040 comp rx=0 tx=0).stop 2023-03-03T06:26:16.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.403+0000 7f86cbf00700 1 -- 172.21.15.5:0/1793147299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c415ef50 msgr2=0x7f86c41ef8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.403+0000 7f86cbf00700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c415ef50 0x7f86c41ef8b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f86bc014040 tx=0x7f86bc004ad0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.405 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.403+0000 7f86cbf00700 1 -- 172.21.15.5:0/1793147299 shutdown_connections 2023-03-03T06:26:16.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.403+0000 7f86cbf00700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86c415ef50 0x7f86c41ef8b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.403+0000 7f86cbf00700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86c40cb690 0x7f86c40ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.403+0000 7f86cbf00700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f86a80682f0 0x7f86a806a7a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.403+0000 7f86cbf00700 1 --2- 172.21.15.5:0/1793147299 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86c415a7d0 0x7f86c40c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.403+0000 7f86cbf00700 1 -- 172.21.15.5:0/1793147299 >> 172.21.15.5:0/1793147299 conn(0x7f86c40cf4b0 msgr2=0x7f86c40cf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:16.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.403+0000 7f86cbf00700 1 -- 172.21.15.5:0/1793147299 shutdown_connections 2023-03-03T06:26:16.406 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.403+0000 7f86cbf00700 1 -- 172.21.15.5:0/1793147299 wait complete. 2023-03-03T06:26:16.407 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2023-03-03T06:26:16.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:26:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.541+0000 7f68fb79e700 1 Processor -- start 2023-03-03T06:26:16.544 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.542+0000 7f68fb79e700 1 -- start start 2023-03-03T06:26:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.542+0000 7f68fb79e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f415d320 0x7f68f40cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.542+0000 7f68fb79e700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f41577c0 con 0x7f68f41573f0 2023-03-03T06:26:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.542+0000 7f68fb79e700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f4159e60 con 0x7f68f40b18d0 2023-03-03T06:26:16.548 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68fb79e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f40cc6e0 con 0x7f68f415d320 2023-03-03T06:26:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68f953a700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f68f41573f0 0x7f68f40cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35920/0 (socket says 172.21.15.5:35920) 2023-03-03T06:26:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68f953a700 1 -- 172.21.15.5:0/3837440256 learned_addr learned my addr 172.21.15.5:0/3837440256 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68f8d39700 1 --2- 172.21.15.5:0/3837440256 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f415d320 0x7f68f40cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226264951 0 0) 0x7f68f41577c0 con 0x7f68f41573f0 2023-03-03T06:26:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68e00035b0 con 0x7f68f41573f0 2023-03-03T06:26:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1765649239 0 0) 0x7f68e00035b0 con 0x7f68f41573f0 2023-03-03T06:26:16.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f415d320 msgr2=0x7f68f40cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 --2- 172.21.15.5:0/3837440256 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f415d320 0x7f68f40cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 >> v1:172.21.15.191:6789/0 conn(0x7f68f40b18d0 legacy=0x7f68f415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f40ce460 con 0x7f68f41573f0 2023-03-03T06:26:16.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f68e8001670 con 0x7f68f41573f0 2023-03-03T06:26:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 >> v1:172.21.15.5:6789/0 conn(0x7f68f41573f0 legacy=0x7f68f40cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 --2- 172.21.15.5:0/3837440256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e0003aa0 0x7f68e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 --2- 172.21.15.5:0/3837440256 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f415d320 0x7f68e0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 --2- 172.21.15.5:0/3837440256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68e0004d90 0x7f68e0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e000bac0 con 0x7f68e0004d90 2023-03-03T06:26:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e000bc00 con 0x7f68e0003aa0 2023-03-03T06:26:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e000df80 con 0x7f68f415d320 2023-03-03T06:26:16.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68f9d3b700 1 --2- 172.21.15.5:0/3837440256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68e0004d90 0x7f68e0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68f8d39700 1 --2- 172.21.15.5:0/3837440256 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f415d320 0x7f68e0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.543+0000 7f68f953a700 1 --2- 172.21.15.5:0/3837440256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e0003aa0 0x7f68e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.544+0000 7f68f9d3b700 1 -- 172.21.15.5:0/3837440256 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f415d320 msgr2=0x7f68e0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.544+0000 7f68f9d3b700 1 --2- 172.21.15.5:0/3837440256 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f415d320 0x7f68e0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.544+0000 7f68f9d3b700 1 -- 172.21.15.5:0/3837440256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e0003aa0 msgr2=0x7f68e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.544+0000 7f68f9d3b700 1 --2- 172.21.15.5:0/3837440256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e0003aa0 0x7f68e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.544+0000 7f68f9d3b700 1 -- 172.21.15.5:0/3837440256 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e00035b0 con 0x7f68e0004d90 2023-03-03T06:26:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.544+0000 7f68f8d39700 1 --2- 172.21.15.5:0/3837440256 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f415d320 0x7f68e0004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:26:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.544+0000 7f68f9d3b700 1 --2- 172.21.15.5:0/3837440256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68e0004d90 0x7f68e0005200 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c290 tx=0x7f68e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3e49e91fd5f2b9 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.544+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec001e70 con 0x7f68e0004d90 2023-03-03T06:26:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.544+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec00cdf0 con 0x7f68e0004d90 2023-03-03T06:26:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.544+0000 7f68e7fff700 1 -- 172.21.15.5:0/3837440256 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec012660 con 0x7f68e0004d90 2023-03-03T06:26:16.553 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.545+0000 7f68fb79e700 1 -- 172.21.15.5:0/3837440256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68e0004d90 msgr2=0x7f68e0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.545+0000 7f68fb79e700 1 --2- 172.21.15.5:0/3837440256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68e0004d90 0x7f68e0005200 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c290 tx=0x7f68e0005880 comp rx=0 tx=0).stop 2023-03-03T06:26:16.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.545+0000 7f68f9d3b700 1 -- 172.21.15.5:0/3837440256 reap_dead start 2023-03-03T06:26:16.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.545+0000 7f68fb79e700 1 -- 172.21.15.5:0/3837440256 shutdown_connections 2023-03-03T06:26:16.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.545+0000 7f68fb79e700 1 -- 172.21.15.5:0/3837440256 >> 172.21.15.5:0/3837440256 conn(0x7f68f40cc8d0 msgr2=0x7f68f40cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:16.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.545+0000 7f68fb79e700 1 -- 172.21.15.5:0/3837440256 shutdown_connections 2023-03-03T06:26:16.554 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.545+0000 7f68fb79e700 1 -- 172.21.15.5:0/3837440256 wait complete. 2023-03-03T06:26:16.556 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.546+0000 7f68fb79e700 1 Processor -- start 2023-03-03T06:26:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.546+0000 7f68fb79e700 1 -- start start 2023-03-03T06:26:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.547+0000 7f68fb79e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f41ed490 0x7f68f40c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.547+0000 7f68fb79e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f4152b50 0x7f68f41ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.547+0000 7f68fb79e700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f4151fc0 0x7f68f40c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.557 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.547+0000 7f68fb79e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f41edda0 con 0x7f68f41ed490 2023-03-03T06:26:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.547+0000 7f68fb79e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f40b40a0 con 0x7f68f4152b50 2023-03-03T06:26:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.547+0000 7f68fb79e700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f4152730 con 0x7f68f4151fc0 2023-03-03T06:26:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.547+0000 7f68f953a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f41ed490 0x7f68f40c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68f953a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f41ed490 0x7f68f40c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46090/0 (socket says 172.21.15.5:46090) 2023-03-03T06:26:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68f953a700 1 -- 172.21.15.5:0/2183238191 learned_addr learned my addr 172.21.15.5:0/2183238191 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68f8d39700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f4152b50 0x7f68f41ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68f953a700 1 -- 172.21.15.5:0/2183238191 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f4151fc0 msgr2=0x7f68f40c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68f9d3b700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f4151fc0 0x7f68f40c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68f953a700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f4151fc0 0x7f68f40c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68f953a700 1 -- 172.21.15.5:0/2183238191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f4152b50 msgr2=0x7f68f41ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68f953a700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f4152b50 0x7f68f41ed860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68f953a700 1 -- 172.21.15.5:0/2183238191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f415dbe0 con 0x7f68f41ed490 2023-03-03T06:26:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68f8d39700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f4152b50 0x7f68f41ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68f953a700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f41ed490 0x7f68f40c63e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f68e80018a0 tx=0x7f68e8007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:16.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68e5ffb700 1 -- 172.21.15.5:0/2183238191 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8007800 con 0x7f68f41ed490 2023-03-03T06:26:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68e5ffb700 1 -- 172.21.15.5:0/2183238191 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e800f8a0 con 0x7f68f41ed490 2023-03-03T06:26:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68e5ffb700 1 -- 172.21.15.5:0/2183238191 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e800fc50 con 0x7f68f41ed490 2023-03-03T06:26:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68fb79e700 1 -- 172.21.15.5:0/2183238191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f415d900 con 0x7f68f41ed490 2023-03-03T06:26:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.548+0000 7f68fb79e700 1 -- 172.21.15.5:0/2183238191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f415dec0 con 0x7f68f41ed490 2023-03-03T06:26:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.549+0000 7f68fb79e700 1 -- 172.21.15.5:0/2183238191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f404e6e0 con 0x7f68f41ed490 2023-03-03T06:26:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.550+0000 7f68e5ffb700 1 -- 172.21.15.5:0/2183238191 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f68e800fdb0 con 0x7f68f41ed490 2023-03-03T06:26:16.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.550+0000 7f68e5ffb700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f68d80682f0 0x7f68d806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.550+0000 7f68e5ffb700 1 -- 172.21.15.5:0/2183238191 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 7473+0+0 (secure 0 0 0) 0x7f68e80864a0 con 0x7f68f41ed490 2023-03-03T06:26:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.550+0000 7f68f8d39700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f68d80682f0 0x7f68d806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.551+0000 7f68f8d39700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f68d80682f0 0x7f68d806a7a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f68f40c5050 tx=0x7f68f0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:16.561 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.554+0000 7f68e5ffb700 1 -- 172.21.15.5:0/2183238191 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f68e80526e0 con 0x7f68f41ed490 2023-03-03T06:26:16.752 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.751+0000 7f68fb79e700 1 -- 172.21.15.5:0/2183238191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68f40b25b0 con 0x7f68f41ed490 2023-03-03T06:26:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.752+0000 7f68e5ffb700 1 -- 172.21.15.5:0/2183238191 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+23273 (secure 0 0 0) 0x7f68e8055d00 con 0x7f68f41ed490 2023-03-03T06:26:16.755 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:16.755 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":73,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:26:16.419341+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:25:54.356683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-03-03T06:25:55.044358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_data_pool","create_time":"2023-03-03T06:26:03.629103+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":72,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"test_metadata_pool","create_time":"2023-03-03T06:26:04.826705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":13,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:26:16.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.754+0000 7f68fb79e700 1 -- 172.21.15.5:0/2183238191 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f68d80682f0 msgr2=0x7f68d806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.754+0000 7f68fb79e700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f68d80682f0 0x7f68d806a7a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f68f40c5050 tx=0x7f68f0008040 comp rx=0 tx=0).stop 2023-03-03T06:26:16.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.754+0000 7f68fb79e700 1 -- 172.21.15.5:0/2183238191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f41ed490 msgr2=0x7f68f40c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.754+0000 7f68fb79e700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f41ed490 0x7f68f40c63e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f68e80018a0 tx=0x7f68e8007620 comp rx=0 tx=0).stop 2023-03-03T06:26:16.757 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.754+0000 7f68fb79e700 1 -- 172.21.15.5:0/2183238191 shutdown_connections 2023-03-03T06:26:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.754+0000 7f68fb79e700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f68d80682f0 0x7f68d806a7a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.754+0000 7f68fb79e700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68f4151fc0 0x7f68f40c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.754+0000 7f68fb79e700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f68f41ed490 0x7f68f40c63e0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.754+0000 7f68fb79e700 1 --2- 172.21.15.5:0/2183238191 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68f4152b50 0x7f68f41ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.754+0000 7f68fb79e700 1 -- 172.21.15.5:0/2183238191 >> 172.21.15.5:0/2183238191 conn(0x7f68f40cc8d0 msgr2=0x7f68f40cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:16.758 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.754+0000 7f68fb79e700 1 -- 172.21.15.5:0/2183238191 shutdown_connections 2023-03-03T06:26:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.754+0000 7f68fb79e700 1 -- 172.21.15.5:0/2183238191 wait complete. 2023-03-03T06:26:16.769 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-03-03T06:26:16.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.894+0000 7fded94e4700 1 Processor -- start 2023-03-03T06:26:16.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.894+0000 7fded94e4700 1 -- start start 2023-03-03T06:26:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.894+0000 7fded94e4700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fded406d1f0 0x7fded406b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.894+0000 7fded94e4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded406b860 0x7fded406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded94e4700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded4160c40 con 0x7fded415c980 2023-03-03T06:26:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded94e4700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded4161460 con 0x7fded406d1f0 2023-03-03T06:26:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded94e4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded4160ea0 con 0x7fded406b860 2023-03-03T06:26:16.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded2ffd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fded415c980 0x7fded4160530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35940/0 (socket says 172.21.15.5:35940) 2023-03-03T06:26:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded2ffd700 1 -- 172.21.15.5:0/3754409145 learned_addr learned my addr 172.21.15.5:0/3754409145 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381374575 0 0) 0x7fded4160c40 con 0x7fded415c980 2023-03-03T06:26:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdebc0035b0 con 0x7fded415c980 2023-03-03T06:26:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded37fe700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded406b860 0x7fded406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded27fc700 1 --2- 172.21.15.5:0/3754409145 >> v2:172.21.15.191:3300/0 conn(0x7fded406d1f0 0x7fded406b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2740128949 0 0) 0x7fdebc0035b0 con 0x7fded415c980 2023-03-03T06:26:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded406b860 msgr2=0x7fded406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded406b860 0x7fded406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 >> v2:172.21.15.191:3300/0 conn(0x7fded406d1f0 msgr2=0x7fded406b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 --2- 172.21.15.5:0/3754409145 >> v2:172.21.15.191:3300/0 conn(0x7fded406d1f0 0x7fded406b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4161180 con 0x7fded415c980 2023-03-03T06:26:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7fdec4001670 con 0x7fded415c980 2023-03-03T06:26:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 >> v1:172.21.15.5:6789/0 conn(0x7fded415c980 legacy=0x7fded4160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc003a70 0x7fdebc003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdebc004850 0x7fdebc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded406b860 0x7fdebc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded4161460 con 0x7fdebc003a70 2023-03-03T06:26:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded4160ea0 con 0x7fdebc004850 2023-03-03T06:26:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc00ba40 con 0x7fded406b860 2023-03-03T06:26:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.895+0000 7fded2ffd700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc003a70 0x7fdebc003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.896+0000 7fded27fc700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdebc004850 0x7fdebc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.896+0000 7fded37fe700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded406b860 0x7fdebc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.896+0000 7fded2ffd700 1 -- 172.21.15.5:0/3754409145 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded406b860 msgr2=0x7fdebc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.896+0000 7fded2ffd700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded406b860 0x7fdebc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.896+0000 7fded2ffd700 1 -- 172.21.15.5:0/3754409145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdebc004850 msgr2=0x7fdebc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.896+0000 7fded2ffd700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdebc004850 0x7fdebc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.896+0000 7fded2ffd700 1 -- 172.21.15.5:0/3754409145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc0035b0 con 0x7fdebc003a70 2023-03-03T06:26:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.896+0000 7fded37fe700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded406b860 0x7fdebc005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.896+0000 7fded27fc700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdebc004850 0x7fdebc004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.896+0000 7fded2ffd700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc003a70 0x7fdebc003e80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fdec400c370 tx=0x7fdebc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba233ba955b9c79e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.896+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4007c60 con 0x7fdebc003a70 2023-03-03T06:26:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.896+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec4005960 con 0x7fdebc003a70 2023-03-03T06:26:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.896+0000 7fded1ffb700 1 -- 172.21.15.5:0/3754409145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec4005d10 con 0x7fdebc003a70 2023-03-03T06:26:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.897+0000 7fded94e4700 1 -- 172.21.15.5:0/3754409145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc003a70 msgr2=0x7fdebc003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.897+0000 7fded94e4700 1 --2- 172.21.15.5:0/3754409145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdebc003a70 0x7fdebc003e80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fdec400c370 tx=0x7fdebc005880 comp rx=0 tx=0).stop 2023-03-03T06:26:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.897+0000 7fded37fe700 1 -- 172.21.15.5:0/3754409145 reap_dead start 2023-03-03T06:26:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.897+0000 7fded94e4700 1 -- 172.21.15.5:0/3754409145 shutdown_connections 2023-03-03T06:26:16.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.897+0000 7fded94e4700 1 -- 172.21.15.5:0/3754409145 >> 172.21.15.5:0/3754409145 conn(0x7fded40cfd00 msgr2=0x7fded40d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:16.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.897+0000 7fded94e4700 1 -- 172.21.15.5:0/3754409145 shutdown_connections 2023-03-03T06:26:16.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.897+0000 7fded94e4700 1 -- 172.21.15.5:0/3754409145 wait complete. 2023-03-03T06:26:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.898+0000 7fded94e4700 1 Processor -- start 2023-03-03T06:26:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.898+0000 7fded94e4700 1 -- start start 2023-03-03T06:26:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded94e4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded4159bd0 0x7fded40ad310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded94e4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded40b4d60 0x7fded40ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded94e4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fded415cfc0 0x7fded415d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded94e4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded40b40c0 con 0x7fded40b4d60 2023-03-03T06:26:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded94e4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded40b3510 con 0x7fded415cfc0 2023-03-03T06:26:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded94e4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded40b3790 con 0x7fded4159bd0 2023-03-03T06:26:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded27fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded40b4d60 0x7fded40ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded27fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded40b4d60 0x7fded40ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46112/0 (socket says 172.21.15.5:46112) 2023-03-03T06:26:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded27fc700 1 -- 172.21.15.5:0/1368554687 learned_addr learned my addr 172.21.15.5:0/1368554687 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded2ffd700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded4159bd0 0x7fded40ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded37fe700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fded415cfc0 0x7fded415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded27fc700 1 -- 172.21.15.5:0/1368554687 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded4159bd0 msgr2=0x7fded40ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded27fc700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded4159bd0 0x7fded40ad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded27fc700 1 -- 172.21.15.5:0/1368554687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fded415cfc0 msgr2=0x7fded415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded27fc700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fded415cfc0 0x7fded415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded27fc700 1 -- 172.21.15.5:0/1368554687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded40ceb70 con 0x7fded40b4d60 2023-03-03T06:26:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.899+0000 7fded27fc700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded40b4d60 0x7fded40ad850 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fdec80108a0 tx=0x7fdec8010bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.900+0000 7fdebb7fe700 1 -- 172.21.15.5:0/1368554687 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8004020 con 0x7fded40b4d60 2023-03-03T06:26:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.900+0000 7fdebb7fe700 1 -- 172.21.15.5:0/1368554687 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec8004180 con 0x7fded40b4d60 2023-03-03T06:26:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.900+0000 7fded94e4700 1 -- 172.21.15.5:0/1368554687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded40ce890 con 0x7fded40b4d60 2023-03-03T06:26:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.900+0000 7fdebb7fe700 1 -- 172.21.15.5:0/1368554687 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8004510 con 0x7fded40b4d60 2023-03-03T06:26:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.900+0000 7fded94e4700 1 -- 172.21.15.5:0/1368554687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded415cd50 con 0x7fded40b4d60 2023-03-03T06:26:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.901+0000 7fded94e4700 1 -- 172.21.15.5:0/1368554687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded40b4270 con 0x7fded40b4d60 2023-03-03T06:26:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.901+0000 7fdebb7fe700 1 -- 172.21.15.5:0/1368554687 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdec8025070 con 0x7fded40b4d60 2023-03-03T06:26:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.901+0000 7fdebb7fe700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdec00682f0 0x7fdec006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.902+0000 7fdebb7fe700 1 -- 172.21.15.5:0/1368554687 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 7473+0+0 (secure 0 0 0) 0x7fdec8086280 con 0x7fded40b4d60 2023-03-03T06:26:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.902+0000 7fded2ffd700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdec00682f0 0x7fdec006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.902+0000 7fded2ffd700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdec00682f0 0x7fdec006a7a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fded40709c0 tx=0x7fdec400a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:16.906+0000 7fdebb7fe700 1 -- 172.21.15.5:0/1368554687 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fded40b4270 con 0x7fded40b4d60 2023-03-03T06:26:17.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.146+0000 7fded94e4700 1 -- 172.21.15.5:0/1368554687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fded40b4270 con 0x7fded40b4d60 2023-03-03T06:26:17.495 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T06:26:17.493+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-03-03T06:26:17.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.499+0000 7fdebb7fe700 1 -- 172.21.15.5:0/1368554687 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7fded40b4270 con 0x7fded40b4d60 2023-03-03T06:26:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.501+0000 7fded94e4700 1 -- 172.21.15.5:0/1368554687 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdec00682f0 msgr2=0x7fdec006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.501+0000 7fded94e4700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdec00682f0 0x7fdec006a7a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fded40709c0 tx=0x7fdec400a000 comp rx=0 tx=0).stop 2023-03-03T06:26:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.501+0000 7fded94e4700 1 -- 172.21.15.5:0/1368554687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded40b4d60 msgr2=0x7fded40ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.501+0000 7fded94e4700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded40b4d60 0x7fded40ad850 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fdec80108a0 tx=0x7fdec8010bb0 comp rx=0 tx=0).stop 2023-03-03T06:26:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.501+0000 7fded94e4700 1 -- 172.21.15.5:0/1368554687 shutdown_connections 2023-03-03T06:26:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.501+0000 7fded94e4700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fded415cfc0 0x7fded415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.501+0000 7fded94e4700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fdec00682f0 0x7fdec006a7a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.501+0000 7fded94e4700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fded4159bd0 0x7fded40ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.501+0000 7fded94e4700 1 --2- 172.21.15.5:0/1368554687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fded40b4d60 0x7fded40ad850 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:17.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.501+0000 7fded94e4700 1 -- 172.21.15.5:0/1368554687 >> 172.21.15.5:0/1368554687 conn(0x7fded40cfd00 msgr2=0x7fded406fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.501+0000 7fded94e4700 1 -- 172.21.15.5:0/1368554687 shutdown_connections 2023-03-03T06:26:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.501+0000 7fded94e4700 1 -- 172.21.15.5:0/1368554687 wait complete. 2023-03-03T06:26:17.505 INFO:tasks.ceph.mds.d.smithi191.stderr: -2989> 2023-03-03T06:25:56.648+0000 7f3e9dfed700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-03T06:26:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-03-03T06:26:17.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:26:17.514 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:26:17.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-03-03T06:26:17.536 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-03-03T06:26:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.681+0000 7fe7bafac700 1 Processor -- start 2023-03-03T06:26:17.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.681+0000 7fe7bafac700 1 -- start start 2023-03-03T06:26:17.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.682+0000 7fe7bafac700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7b415dd40 0x7fe7b40cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:17.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.682+0000 7fe7bafac700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7b40b1f50 0x7fe7b40ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:17.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.682+0000 7fe7bafac700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b40cbaa0 con 0x7fe7b40ca410 2023-03-03T06:26:17.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.682+0000 7fe7bafac700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b406cbf0 con 0x7fe7b40b1f50 2023-03-03T06:26:17.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.682+0000 7fe7bafac700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b415e110 con 0x7fe7b415dd40 2023-03-03T06:26:17.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.682+0000 7fe7b9549700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe7b40b1f50 0x7fe7b40ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:17.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.682+0000 7fe7b3fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe7b40ca410 0x7fe7b40b1840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:35960/0 (socket says 172.21.15.5:35960) 2023-03-03T06:26:17.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.682+0000 7fe7b3fff700 1 -- 172.21.15.5:0/4214635646 learned_addr learned my addr 172.21.15.5:0/4214635646 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:17.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.682+0000 7fe7b37fe700 1 -- 172.21.15.5:0/4214635646 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269814382 0 0) 0x7fe7b40cbaa0 con 0x7fe7b40ca410 2023-03-03T06:26:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.682+0000 7fe7b37fe700 1 -- 172.21.15.5:0/4214635646 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a40035b0 con 0x7fe7b40ca410 2023-03-03T06:26:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.682+0000 7fe7b8d48700 1 --2- 172.21.15.5:0/4214635646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7b415dd40 0x7fe7b40cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7b9549700 1 -- 172.21.15.5:0/4214635646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7b415dd40 msgr2=0x7fe7b40cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7b9549700 1 --2- 172.21.15.5:0/4214635646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7b415dd40 0x7fe7b40cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7b9549700 1 -- 172.21.15.5:0/4214635646 >> v1:172.21.15.5:6789/0 conn(0x7fe7b40ca410 legacy=0x7fe7b40b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7b9549700 1 -- 172.21.15.5:0/4214635646 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40cae90 con 0x7fe7b40b1f50 2023-03-03T06:26:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7b9549700 1 --2- 172.21.15.5:0/4214635646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b40b1f50 0x7fe7b40ca880 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009d90 tx=0x7fe7ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a45ecf5e09fb85 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7b37fe700 1 -- 172.21.15.5:0/4214635646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00e070 con 0x7fe7b40b1f50 2023-03-03T06:26:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7b37fe700 1 -- 172.21.15.5:0/4214635646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac00bb20 con 0x7fe7b40b1f50 2023-03-03T06:26:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7b37fe700 1 -- 172.21.15.5:0/4214635646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac012430 con 0x7fe7b40b1f50 2023-03-03T06:26:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7bafac700 1 -- 172.21.15.5:0/4214635646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b40b1f50 msgr2=0x7fe7b40ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7bafac700 1 --2- 172.21.15.5:0/4214635646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b40b1f50 0x7fe7b40ca880 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009d90 tx=0x7fe7ac00b330 comp rx=0 tx=0).stop 2023-03-03T06:26:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7bafac700 1 -- 172.21.15.5:0/4214635646 shutdown_connections 2023-03-03T06:26:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7bafac700 1 --2- 172.21.15.5:0/4214635646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b40b1f50 0x7fe7b40ca880 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7bafac700 1 --2- 172.21.15.5:0/4214635646 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7b415dd40 0x7fe7b40cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7bafac700 1 -- 172.21.15.5:0/4214635646 >> 172.21.15.5:0/4214635646 conn(0x7fe7b40cc840 msgr2=0x7fe7b40ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:17.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7bafac700 1 -- 172.21.15.5:0/4214635646 shutdown_connections 2023-03-03T06:26:17.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.683+0000 7fe7bafac700 1 -- 172.21.15.5:0/4214635646 wait complete. 2023-03-03T06:26:17.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.685+0000 7fe7bafac700 1 Processor -- start 2023-03-03T06:26:17.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.685+0000 7fe7bafac700 1 -- start start 2023-03-03T06:26:17.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7bafac700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7b40b1f50 0x7fe7b414f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:17.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7bafac700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7b40ca410 0x7fe7b414db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:17.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7bafac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b415dd40 0x7fe7b414e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:17.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7bafac700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40c8870 con 0x7fe7b415dd40 2023-03-03T06:26:17.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7bafac700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40c7bf0 con 0x7fe7b40b1f50 2023-03-03T06:26:17.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7bafac700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40c7ed0 con 0x7fe7b40ca410 2023-03-03T06:26:17.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b9549700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b415dd40 0x7fe7b414e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:17.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b9549700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b415dd40 0x7fe7b414e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46128/0 (socket says 172.21.15.5:46128) 2023-03-03T06:26:17.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b9549700 1 -- 172.21.15.5:0/302401884 learned_addr learned my addr 172.21.15.5:0/302401884 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:17.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b3fff700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7b40ca410 0x7fe7b414db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:17.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b9549700 1 -- 172.21.15.5:0/302401884 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7b40ca410 msgr2=0x7fe7b414db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:17.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b9549700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7b40ca410 0x7fe7b414db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:17.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b8d48700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7b40b1f50 0x7fe7b414f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:17.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b9549700 1 -- 172.21.15.5:0/302401884 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7b40b1f50 msgr2=0x7fe7b414f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:17.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b9549700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7b40b1f50 0x7fe7b414f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:17.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b9549700 1 -- 172.21.15.5:0/302401884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac009a70 con 0x7fe7b415dd40 2023-03-03T06:26:17.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b9549700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b415dd40 0x7fe7b414e0c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac00b370 tx=0x7fe7ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:17.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b17fa700 1 -- 172.21.15.5:0/302401884 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac012430 con 0x7fe7b415dd40 2023-03-03T06:26:17.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b17fa700 1 -- 172.21.15.5:0/302401884 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac020070 con 0x7fe7b415dd40 2023-03-03T06:26:17.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7bafac700 1 -- 172.21.15.5:0/302401884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b40cb450 con 0x7fe7b415dd40 2023-03-03T06:26:17.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7b17fa700 1 -- 172.21.15.5:0/302401884 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac004280 con 0x7fe7b415dd40 2023-03-03T06:26:17.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.686+0000 7fe7bafac700 1 -- 172.21.15.5:0/302401884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b40cb170 con 0x7fe7b415dd40 2023-03-03T06:26:17.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.687+0000 7fe7bafac700 1 -- 172.21.15.5:0/302401884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b40cb730 con 0x7fe7b415dd40 2023-03-03T06:26:17.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.688+0000 7fe7b17fa700 1 -- 172.21.15.5:0/302401884 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe7ac02e070 con 0x7fe7b415dd40 2023-03-03T06:26:17.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.689+0000 7fe7b17fa700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe7980682f0 0x7fe79806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:17.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.689+0000 7fe7b17fa700 1 -- 172.21.15.5:0/302401884 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 7531+0+0 (secure 0 0 0) 0x7fe7ac022070 con 0x7fe7b415dd40 2023-03-03T06:26:17.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.689+0000 7fe7b8d48700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe7980682f0 0x7fe79806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:17.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.689+0000 7fe7b8d48700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe7980682f0 0x7fe79806a7a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800b840 tx=0x7fe7a8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:17.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.693+0000 7fe7b17fa700 1 -- 172.21.15.5:0/302401884 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe7ac054990 con 0x7fe7b415dd40 2023-03-03T06:26:17.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:17.933+0000 7fe7bafac700 1 -- 172.21.15.5:0/302401884 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe7b404e6e0 con 0x7fe7b415dd40 2023-03-03T06:26:18.511 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.509+0000 7fe7b17fa700 1 -- 172.21.15.5:0/302401884 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe7ac02c0a0 con 0x7fe7b415dd40 2023-03-03T06:26:18.514 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.512+0000 7fe7bafac700 1 -- 172.21.15.5:0/302401884 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe7980682f0 msgr2=0x7fe79806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.512+0000 7fe7bafac700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe7980682f0 0x7fe79806a7a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800b840 tx=0x7fe7a8008040 comp rx=0 tx=0).stop 2023-03-03T06:26:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.512+0000 7fe7bafac700 1 -- 172.21.15.5:0/302401884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b415dd40 msgr2=0x7fe7b414e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.512+0000 7fe7bafac700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b415dd40 0x7fe7b414e0c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac00b370 tx=0x7fe7ac004ad0 comp rx=0 tx=0).stop 2023-03-03T06:26:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.512+0000 7fe7bafac700 1 -- 172.21.15.5:0/302401884 shutdown_connections 2023-03-03T06:26:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.512+0000 7fe7bafac700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7b415dd40 0x7fe7b414e0c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.512+0000 7fe7bafac700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7b40b1f50 0x7fe7b414f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:18.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.512+0000 7fe7bafac700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fe7980682f0 0x7fe79806a7a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.512+0000 7fe7bafac700 1 --2- 172.21.15.5:0/302401884 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe7b40ca410 0x7fe7b414db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.512+0000 7fe7bafac700 1 -- 172.21.15.5:0/302401884 >> 172.21.15.5:0/302401884 conn(0x7fe7b40cc840 msgr2=0x7fe7b40b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.512+0000 7fe7bafac700 1 -- 172.21.15.5:0/302401884 shutdown_connections 2023-03-03T06:26:18.516 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.513+0000 7fe7bafac700 1 -- 172.21.15.5:0/302401884 wait complete. 2023-03-03T06:26:18.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-03-03T06:26:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.664+0000 7fa3bf0c8700 1 Processor -- start 2023-03-03T06:26:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.664+0000 7fa3bf0c8700 1 -- start start 2023-03-03T06:26:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.665+0000 7fa3bf0c8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b8159a00 0x7fa3b80ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.665+0000 7fa3bf0c8700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3b80cf030 0x7fa3b80714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.665+0000 7fa3bf0c8700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b815cff0 con 0x7fa3b8150490 2023-03-03T06:26:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.665+0000 7fa3bf0c8700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b80ca190 con 0x7fa3b80cf030 2023-03-03T06:26:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.665+0000 7fa3bf0c8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8150860 con 0x7fa3b8159a00 2023-03-03T06:26:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.665+0000 7fa3bd665700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3b80cf030 0x7fa3b80714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.665+0000 7fa3bd665700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa3b80cf030 0x7fa3b80714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46136/0 (socket says 172.21.15.5:46136) 2023-03-03T06:26:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.665+0000 7fa3bd665700 1 -- 172.21.15.5:0/2793649056 learned_addr learned my addr 172.21.15.5:0/2793649056 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.666+0000 7fa3b7fff700 1 --2- 172.21.15.5:0/2793649056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b8159a00 0x7fa3b80ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.666+0000 7fa3bd665700 1 -- 172.21.15.5:0/2793649056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b8159a00 msgr2=0x7fa3b80ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.666+0000 7fa3bd665700 1 --2- 172.21.15.5:0/2793649056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b8159a00 0x7fa3b80ceaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.666+0000 7fa3bd665700 1 -- 172.21.15.5:0/2793649056 >> v1:172.21.15.191:6789/0 conn(0x7fa3b8150490 legacy=0x7fa3b80c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:18.670 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.666+0000 7fa3bd665700 1 -- 172.21.15.5:0/2793649056 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b8159f00 con 0x7fa3b80cf030 2023-03-03T06:26:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.666+0000 7fa3bd665700 1 --2- 172.21.15.5:0/2793649056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b80cf030 0x7fa3b80714a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009e50 tx=0x7fa3b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba043f8bf1fe538 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.666+0000 7fa3b77fe700 1 -- 172.21.15.5:0/2793649056 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000e070 con 0x7fa3b80cf030 2023-03-03T06:26:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.666+0000 7fa3b77fe700 1 -- 172.21.15.5:0/2793649056 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b0003a20 con 0x7fa3b80cf030 2023-03-03T06:26:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.666+0000 7fa3b77fe700 1 -- 172.21.15.5:0/2793649056 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0003dd0 con 0x7fa3b80cf030 2023-03-03T06:26:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.666+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2793649056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b80cf030 msgr2=0x7fa3b80714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.666+0000 7fa3bf0c8700 1 --2- 172.21.15.5:0/2793649056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b80cf030 0x7fa3b80714a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009e50 tx=0x7fa3b000b330 comp rx=0 tx=0).stop 2023-03-03T06:26:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.667+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2793649056 shutdown_connections 2023-03-03T06:26:18.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.667+0000 7fa3bf0c8700 1 --2- 172.21.15.5:0/2793649056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b80cf030 0x7fa3b80714a0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.667+0000 7fa3bf0c8700 1 --2- 172.21.15.5:0/2793649056 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b8159a00 0x7fa3b80ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.667+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2793649056 >> 172.21.15.5:0/2793649056 conn(0x7fa3b80b1bd0 msgr2=0x7fa3b80cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.667+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2793649056 shutdown_connections 2023-03-03T06:26:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.667+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2793649056 wait complete. 2023-03-03T06:26:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.668+0000 7fa3bf0c8700 1 Processor -- start 2023-03-03T06:26:18.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.668+0000 7fa3bf0c8700 1 -- start start 2023-03-03T06:26:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bf0c8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3b80cf030 0x7fa3b80c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bf0c8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b8150490 0x7fa3b80b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bf0c8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b8159a00 0x7fa3b80c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bf0c8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80b4510 con 0x7fa3b8159a00 2023-03-03T06:26:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bf0c8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80b47f0 con 0x7fa3b80cf030 2023-03-03T06:26:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bf0c8700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b80b4ad0 con 0x7fa3b8150490 2023-03-03T06:26:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bd665700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b8159a00 0x7fa3b80c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bd665700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b8159a00 0x7fa3b80c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46142/0 (socket says 172.21.15.5:46142) 2023-03-03T06:26:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bd665700 1 -- 172.21.15.5:0/2895171208 learned_addr learned my addr 172.21.15.5:0/2895171208 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bd665700 1 -- 172.21.15.5:0/2895171208 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b8150490 msgr2=0x7fa3b80b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3b7fff700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b8150490 0x7fa3b80b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bce64700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3b80cf030 0x7fa3b80c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bd665700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b8150490 0x7fa3b80b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bd665700 1 -- 172.21.15.5:0/2895171208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3b80cf030 msgr2=0x7fa3b80c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bd665700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3b80cf030 0x7fa3b80c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bd665700 1 -- 172.21.15.5:0/2895171208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0009b30 con 0x7fa3b8159a00 2023-03-03T06:26:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3b7fff700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b8150490 0x7fa3b80b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bce64700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3b80cf030 0x7fa3b80c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bd665700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b8159a00 0x7fa3b80c95c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0004000 tx=0x7fa3b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3b57fa700 1 -- 172.21.15.5:0/2895171208 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0004440 con 0x7fa3b8159a00 2023-03-03T06:26:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3b57fa700 1 -- 172.21.15.5:0/2895171208 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b00045a0 con 0x7fa3b8159a00 2023-03-03T06:26:18.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2895171208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b815a4c0 con 0x7fa3b8159a00 2023-03-03T06:26:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3b57fa700 1 -- 172.21.15.5:0/2895171208 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0004950 con 0x7fa3b8159a00 2023-03-03T06:26:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.669+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2895171208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b815a1e0 con 0x7fa3b8159a00 2023-03-03T06:26:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.670+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2895171208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b815a7a0 con 0x7fa3b8159a00 2023-03-03T06:26:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.671+0000 7fa3b57fa700 1 -- 172.21.15.5:0/2895171208 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa3b0022030 con 0x7fa3b8159a00 2023-03-03T06:26:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.671+0000 7fa3b57fa700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa39c0682f0 0x7fa39c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.671+0000 7fa3b57fa700 1 -- 172.21.15.5:0/2895171208 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 7531+0+0 (secure 0 0 0) 0x7fa3b00876b0 con 0x7fa3b8159a00 2023-03-03T06:26:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.671+0000 7fa3bce64700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa39c0682f0 0x7fa39c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.672+0000 7fa3bce64700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa39c0682f0 0x7fa39c06a7a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac003f40 tx=0x7fa3ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:18.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.676+0000 7fa3b57fa700 1 -- 172.21.15.5:0/2895171208 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa3b0053860 con 0x7fa3b8159a00 2023-03-03T06:26:18.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:18.870+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2895171208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa3b806c180 con 0x7fa3b8159a00 2023-03-03T06:26:19.515 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.513+0000 7fa3b57fa700 1 -- 172.21.15.5:0/2895171208 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v75) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa3b002c300 con 0x7fa3b8159a00 2023-03-03T06:26:19.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.516+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2895171208 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa39c0682f0 msgr2=0x7fa39c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:19.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.516+0000 7fa3bf0c8700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa39c0682f0 0x7fa39c06a7a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac003f40 tx=0x7fa3ac009040 comp rx=0 tx=0).stop 2023-03-03T06:26:19.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.516+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2895171208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b8159a00 msgr2=0x7fa3b80c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:19.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.516+0000 7fa3bf0c8700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b8159a00 0x7fa3b80c95c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0004000 tx=0x7fa3b0004ad0 comp rx=0 tx=0).stop 2023-03-03T06:26:19.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.516+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2895171208 shutdown_connections 2023-03-03T06:26:19.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.516+0000 7fa3bf0c8700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3b8159a00 0x7fa3b80c95c0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:19.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.516+0000 7fa3bf0c8700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3b80cf030 0x7fa3b80c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.516+0000 7fa3bf0c8700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa39c0682f0 0x7fa39c06a7a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.516+0000 7fa3bf0c8700 1 --2- 172.21.15.5:0/2895171208 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3b8150490 0x7fa3b80b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.516+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2895171208 >> 172.21.15.5:0/2895171208 conn(0x7fa3b80b1bd0 msgr2=0x7fa3b80cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.516+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2895171208 shutdown_connections 2023-03-03T06:26:19.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.516+0000 7fa3bf0c8700 1 -- 172.21.15.5:0/2895171208 wait complete. 2023-03-03T06:26:19.523 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2023-03-03T06:26:19.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-03-03T06:26:19.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.679+0000 7f136b694700 1 Processor -- start 2023-03-03T06:26:19.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.679+0000 7f136b694700 1 -- start start 2023-03-03T06:26:19.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f136b694700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f13640af110 0x7f13640cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:19.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f136b694700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13640cb580 0x7f136406b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:19.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f136b694700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13640cd990 con 0x7f13640b2250 2023-03-03T06:26:19.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f136b694700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13640cdf50 con 0x7f13640cb580 2023-03-03T06:26:19.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f136b694700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13640cf3f0 con 0x7f13640af110 2023-03-03T06:26:19.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f1369c31700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13640cb580 0x7f136406b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:19.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f1369c31700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f13640cb580 0x7f136406b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46150/0 (socket says 172.21.15.5:46150) 2023-03-03T06:26:19.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f1369c31700 1 -- 172.21.15.5:0/176292326 learned_addr learned my addr 172.21.15.5:0/176292326 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:19.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f1369430700 1 --2- 172.21.15.5:0/176292326 >> v2:172.21.15.191:3300/0 conn(0x7f13640af110 0x7f13640cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:19.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f1369c31700 1 -- 172.21.15.5:0/176292326 >> v2:172.21.15.191:3300/0 conn(0x7f13640af110 msgr2=0x7f13640cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:19.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f1369c31700 1 --2- 172.21.15.5:0/176292326 >> v2:172.21.15.191:3300/0 conn(0x7f13640af110 0x7f13640cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:19.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f1369c31700 1 -- 172.21.15.5:0/176292326 >> v1:172.21.15.191:6789/0 conn(0x7f13640b2250 legacy=0x7f13640cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:19.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f1369c31700 1 -- 172.21.15.5:0/176292326 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13640cf690 con 0x7f13640cb580 2023-03-03T06:26:19.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f1369430700 1 --2- 172.21.15.5:0/176292326 >> v2:172.21.15.191:3300/0 conn(0x7f13640af110 0x7f13640cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:19.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.680+0000 7f1369c31700 1 --2- 172.21.15.5:0/176292326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13640cb580 0x7f136406b460 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1364071b00 tx=0x7f135c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268488557413d406 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:19.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.681+0000 7f135bfff700 1 -- 172.21.15.5:0/176292326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c00e070 con 0x7f13640cb580 2023-03-03T06:26:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.681+0000 7f135bfff700 1 -- 172.21.15.5:0/176292326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c003a20 con 0x7f13640cb580 2023-03-03T06:26:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.681+0000 7f135bfff700 1 -- 172.21.15.5:0/176292326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c003dd0 con 0x7f13640cb580 2023-03-03T06:26:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.681+0000 7f136b694700 1 -- 172.21.15.5:0/176292326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13640cb580 msgr2=0x7f136406b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.681+0000 7f136b694700 1 --2- 172.21.15.5:0/176292326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13640cb580 0x7f136406b460 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f1364071b00 tx=0x7f135c00b330 comp rx=0 tx=0).stop 2023-03-03T06:26:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.681+0000 7f136b694700 1 -- 172.21.15.5:0/176292326 shutdown_connections 2023-03-03T06:26:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.681+0000 7f136b694700 1 --2- 172.21.15.5:0/176292326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13640cb580 0x7f136406b460 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.681+0000 7f136b694700 1 --2- 172.21.15.5:0/176292326 >> v2:172.21.15.191:3300/0 conn(0x7f13640af110 0x7f13640cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:19.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.681+0000 7f136b694700 1 -- 172.21.15.5:0/176292326 >> 172.21.15.5:0/176292326 conn(0x7f13640cc840 msgr2=0x7f13640ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:19.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.681+0000 7f136b694700 1 -- 172.21.15.5:0/176292326 shutdown_connections 2023-03-03T06:26:19.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.681+0000 7f136b694700 1 -- 172.21.15.5:0/176292326 wait complete. 2023-03-03T06:26:19.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.683+0000 7f136b694700 1 Processor -- start 2023-03-03T06:26:19.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.683+0000 7f136b694700 1 -- start start 2023-03-03T06:26:19.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f136b694700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13640af110 0x7f1364152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:19.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f136b694700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13640b2250 0x7f136415f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f136b694700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13640cb580 0x7f136415a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f136b694700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13640c9010 con 0x7f13640af110 2023-03-03T06:26:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f136b694700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13641528a0 con 0x7f13640cb580 2023-03-03T06:26:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f136b694700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13640c8400 con 0x7f13640b2250 2023-03-03T06:26:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f1369430700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13640af110 0x7f1364152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f1369430700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13640af110 0x7f1364152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46152/0 (socket says 172.21.15.5:46152) 2023-03-03T06:26:19.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f1369430700 1 -- 172.21.15.5:0/1373414410 learned_addr learned my addr 172.21.15.5:0/1373414410 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f1368c2f700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13640b2250 0x7f136415f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f1369c31700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13640cb580 0x7f136415a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f1369430700 1 -- 172.21.15.5:0/1373414410 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13640b2250 msgr2=0x7f136415f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f1369430700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13640b2250 0x7f136415f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f1369430700 1 -- 172.21.15.5:0/1373414410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13640cb580 msgr2=0x7f136415a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f1369430700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13640cb580 0x7f136415a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.684+0000 7f1369430700 1 -- 172.21.15.5:0/1373414410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c009b30 con 0x7f13640af110 2023-03-03T06:26:19.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.685+0000 7f1369430700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13640af110 0x7f1364152360 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f136000c7f0 tx=0x7f136000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:19.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.685+0000 7f1359ffb700 1 -- 172.21.15.5:0/1373414410 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360011800 con 0x7f13640af110 2023-03-03T06:26:19.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.685+0000 7f1359ffb700 1 -- 172.21.15.5:0/1373414410 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1360011960 con 0x7f13640af110 2023-03-03T06:26:19.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.685+0000 7f136b694700 1 -- 172.21.15.5:0/1373414410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13640cdbe0 con 0x7f13640af110 2023-03-03T06:26:19.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.685+0000 7f1359ffb700 1 -- 172.21.15.5:0/1373414410 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360011d10 con 0x7f13640af110 2023-03-03T06:26:19.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.685+0000 7f136b694700 1 -- 172.21.15.5:0/1373414410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136406c850 con 0x7f13640af110 2023-03-03T06:26:19.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.686+0000 7f136b694700 1 -- 172.21.15.5:0/1373414410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136406d3d0 con 0x7f13640af110 2023-03-03T06:26:19.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.686+0000 7f1359ffb700 1 -- 172.21.15.5:0/1373414410 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1360021070 con 0x7f13640af110 2023-03-03T06:26:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.687+0000 7f1359ffb700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13480682f0 0x7f134806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.687+0000 7f1359ffb700 1 -- 172.21.15.5:0/1373414410 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f1360085f20 con 0x7f13640af110 2023-03-03T06:26:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.687+0000 7f1368c2f700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13480682f0 0x7f134806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.687+0000 7f1368c2f700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13480682f0 0x7f134806a7a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1354007fd0 tx=0x7f1354009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.691+0000 7f1359ffb700 1 -- 172.21.15.5:0/1373414410 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1360052370 con 0x7f13640af110 2023-03-03T06:26:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:19.887+0000 7f136b694700 1 -- 172.21.15.5:0/1373414410 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f13640cc100 con 0x7f13640af110 2023-03-03T06:26:20.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.522+0000 7f1359ffb700 1 -- 172.21.15.5:0/1373414410 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v76) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1360055990 con 0x7f13640af110 2023-03-03T06:26:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.527+0000 7f136b694700 1 -- 172.21.15.5:0/1373414410 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13480682f0 msgr2=0x7f134806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.527+0000 7f136b694700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13480682f0 0x7f134806a7a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1354007fd0 tx=0x7f1354009040 comp rx=0 tx=0).stop 2023-03-03T06:26:20.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.527+0000 7f136b694700 1 -- 172.21.15.5:0/1373414410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13640af110 msgr2=0x7f1364152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.527+0000 7f136b694700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13640af110 0x7f1364152360 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f136000c7f0 tx=0x7f136000cbb0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.527+0000 7f136b694700 1 -- 172.21.15.5:0/1373414410 shutdown_connections 2023-03-03T06:26:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.527+0000 7f136b694700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f13640cb580 0x7f136415a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.527+0000 7f136b694700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13640af110 0x7f1364152360 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.527+0000 7f136b694700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f13480682f0 0x7f134806a7a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.527+0000 7f136b694700 1 --2- 172.21.15.5:0/1373414410 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f13640b2250 0x7f136415f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.527+0000 7f136b694700 1 -- 172.21.15.5:0/1373414410 >> 172.21.15.5:0/1373414410 conn(0x7f13640cc840 msgr2=0x7f13640b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:20.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.528+0000 7f136b694700 1 -- 172.21.15.5:0/1373414410 shutdown_connections 2023-03-03T06:26:20.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.528+0000 7f136b694700 1 -- 172.21.15.5:0/1373414410 wait complete. 2023-03-03T06:26:20.531 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2023-03-03T06:26:20.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-03-03T06:26:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.682+0000 7f1df0819700 1 Processor -- start 2023-03-03T06:26:20.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.682+0000 7f1df0819700 1 -- start start 2023-03-03T06:26:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1df0819700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1dec0b55b0 0x7f1dec15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:20.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1df0819700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1dec0cd500 0x7f1dec0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1df0819700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dec0cc5d0 con 0x7f1dec0b1e10 2023-03-03T06:26:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1df0819700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dec15e290 con 0x7f1dec0b55b0 2023-03-03T06:26:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1df0819700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec0b2290 con 0x7f1dec0cd500 2023-03-03T06:26:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1dea59c700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1dec0b55b0 0x7f1dec15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1dead9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1dec0b1e10 0x7f1dec06bcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36004/0 (socket says 172.21.15.5:36004) 2023-03-03T06:26:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1dead9d700 1 -- 172.21.15.5:0/1432497485 learned_addr learned my addr 172.21.15.5:0/1432497485 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:20.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1de9d9b700 1 --2- 172.21.15.5:0/1432497485 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1dec0cd500 0x7f1dec0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1dea59c700 1 -- 172.21.15.5:0/1432497485 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1dec0cd500 msgr2=0x7f1dec0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1dea59c700 1 --2- 172.21.15.5:0/1432497485 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1dec0cd500 0x7f1dec0b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1dea59c700 1 -- 172.21.15.5:0/1432497485 >> v1:172.21.15.5:6789/0 conn(0x7f1dec0b1e10 legacy=0x7f1dec06bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1dea59c700 1 -- 172.21.15.5:0/1432497485 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec159c30 con 0x7f1dec0b55b0 2023-03-03T06:26:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.683+0000 7f1de959a700 1 -- 172.21.15.5:0/1432497485 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540468795 0 0) 0x7f1dec0cc5d0 con 0x7f1dec0b1e10 2023-03-03T06:26:20.688 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.684+0000 7f1dea59c700 1 --2- 172.21.15.5:0/1432497485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dec0b55b0 0x7f1dec15dd50 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009840 tx=0x7f1de0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fac1fd77c0e45ff server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.684+0000 7f1de959a700 1 -- 172.21.15.5:0/1432497485 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0011830 con 0x7f1dec0b55b0 2023-03-03T06:26:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.684+0000 7f1de959a700 1 -- 172.21.15.5:0/1432497485 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de0011990 con 0x7f1dec0b55b0 2023-03-03T06:26:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.684+0000 7f1de959a700 1 -- 172.21.15.5:0/1432497485 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0011d20 con 0x7f1dec0b55b0 2023-03-03T06:26:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.684+0000 7f1df0819700 1 -- 172.21.15.5:0/1432497485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dec0b55b0 msgr2=0x7f1dec15dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.684+0000 7f1df0819700 1 --2- 172.21.15.5:0/1432497485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dec0b55b0 0x7f1dec15dd50 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009840 tx=0x7f1de0009b50 comp rx=0 tx=0).stop 2023-03-03T06:26:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.684+0000 7f1df0819700 1 -- 172.21.15.5:0/1432497485 shutdown_connections 2023-03-03T06:26:20.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.684+0000 7f1df0819700 1 --2- 172.21.15.5:0/1432497485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dec0b55b0 0x7f1dec15dd50 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.684+0000 7f1df0819700 1 --2- 172.21.15.5:0/1432497485 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1dec0cd500 0x7f1dec0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.684+0000 7f1df0819700 1 -- 172.21.15.5:0/1432497485 >> 172.21.15.5:0/1432497485 conn(0x7f1dec0cc8d0 msgr2=0x7f1dec0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:20.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.684+0000 7f1df0819700 1 -- 172.21.15.5:0/1432497485 shutdown_connections 2023-03-03T06:26:20.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.684+0000 7f1df0819700 1 -- 172.21.15.5:0/1432497485 wait complete. 2023-03-03T06:26:20.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.686+0000 7f1df0819700 1 Processor -- start 2023-03-03T06:26:20.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.686+0000 7f1df0819700 1 -- start start 2023-03-03T06:26:20.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.686+0000 7f1df0819700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1dec0b1e10 0x7f1dec1f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:20.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.686+0000 7f1df0819700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dec0b55b0 0x7f1dec0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:20.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.686+0000 7f1df0819700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dec0cd500 0x7f1dec1f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:20.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.686+0000 7f1df0819700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec1f12f0 con 0x7f1dec0b55b0 2023-03-03T06:26:20.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.686+0000 7f1df0819700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec1f0330 con 0x7f1dec0cd500 2023-03-03T06:26:20.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.686+0000 7f1df0819700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec0ca220 con 0x7f1dec0b1e10 2023-03-03T06:26:20.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1de9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dec0b55b0 0x7f1dec0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1de9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dec0b55b0 0x7f1dec0c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46168/0 (socket says 172.21.15.5:46168) 2023-03-03T06:26:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1de9d9b700 1 -- 172.21.15.5:0/3071296361 learned_addr learned my addr 172.21.15.5:0/3071296361 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1dea59c700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1dec0b1e10 0x7f1dec1f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1dead9d700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dec0cd500 0x7f1dec1f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1de9d9b700 1 -- 172.21.15.5:0/3071296361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1dec0b1e10 msgr2=0x7f1dec1f0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:20.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1de9d9b700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1dec0b1e10 0x7f1dec1f0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1de9d9b700 1 -- 172.21.15.5:0/3071296361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dec0cd500 msgr2=0x7f1dec1f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1de9d9b700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dec0cd500 0x7f1dec1f3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1de9d9b700 1 -- 172.21.15.5:0/3071296361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de00094a0 con 0x7f1dec0b55b0 2023-03-03T06:26:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1de9d9b700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dec0b55b0 0x7f1dec0c9ce0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00d800 tx=0x7f1ddc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1ddaffd700 1 -- 172.21.15.5:0/3071296361 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc0125f0 con 0x7f1dec0b55b0 2023-03-03T06:26:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1ddaffd700 1 -- 172.21.15.5:0/3071296361 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc012750 con 0x7f1dec0b55b0 2023-03-03T06:26:20.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1ddaffd700 1 -- 172.21.15.5:0/3071296361 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc012b00 con 0x7f1dec0b55b0 2023-03-03T06:26:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1df0819700 1 -- 172.21.15.5:0/3071296361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dec0cb9c0 con 0x7f1dec0b55b0 2023-03-03T06:26:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.687+0000 7f1df0819700 1 -- 172.21.15.5:0/3071296361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dec0b5980 con 0x7f1dec0b55b0 2023-03-03T06:26:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.688+0000 7f1df0819700 1 -- 172.21.15.5:0/3071296361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dec0cbca0 con 0x7f1dec0b55b0 2023-03-03T06:26:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.689+0000 7f1ddaffd700 1 -- 172.21.15.5:0/3071296361 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1ddc012c60 con 0x7f1dec0b55b0 2023-03-03T06:26:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.689+0000 7f1ddaffd700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1dcc0682f0 0x7f1dcc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.689+0000 7f1ddaffd700 1 -- 172.21.15.5:0/3071296361 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6679+0+0 (secure 0 0 0) 0x7f1ddc0860a0 con 0x7f1dec0b55b0 2023-03-03T06:26:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.689+0000 7f1dea59c700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1dcc0682f0 0x7f1dcc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:20.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.690+0000 7f1dea59c700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1dcc0682f0 0x7f1dcc06a7a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1de00090b0 tx=0x7f1de0008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:20.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.693+0000 7f1ddaffd700 1 -- 172.21.15.5:0/3071296361 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1ddc052690 con 0x7f1dec0b55b0 2023-03-03T06:26:20.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.885+0000 7f1df0819700 1 -- 172.21.15.5:0/3071296361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1dec04e6e0 con 0x7f1dec0b55b0 2023-03-03T06:26:20.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.889+0000 7f1ddaffd700 1 -- 172.21.15.5:0/3071296361 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1ddc055cb0 con 0x7f1dec0b55b0 2023-03-03T06:26:20.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.891+0000 7f1df0819700 1 -- 172.21.15.5:0/3071296361 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1dcc0682f0 msgr2=0x7f1dcc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:20.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.891+0000 7f1df0819700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1dcc0682f0 0x7f1dcc06a7a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1de00090b0 tx=0x7f1de0008030 comp rx=0 tx=0).stop 2023-03-03T06:26:20.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.891+0000 7f1df0819700 1 -- 172.21.15.5:0/3071296361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dec0b55b0 msgr2=0x7f1dec0c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:20.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.891+0000 7f1df0819700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dec0b55b0 0x7f1dec0c9ce0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00d800 tx=0x7f1ddc00db10 comp rx=0 tx=0).stop 2023-03-03T06:26:20.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.891+0000 7f1df0819700 1 -- 172.21.15.5:0/3071296361 shutdown_connections 2023-03-03T06:26:20.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.891+0000 7f1df0819700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1dec0cd500 0x7f1dec1f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.891+0000 7f1df0819700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f1dcc0682f0 0x7f1dcc06a7a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.891+0000 7f1df0819700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1dec0b1e10 0x7f1dec1f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.891+0000 7f1df0819700 1 --2- 172.21.15.5:0/3071296361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1dec0b55b0 0x7f1dec0c9ce0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:20.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.891+0000 7f1df0819700 1 -- 172.21.15.5:0/3071296361 >> 172.21.15.5:0/3071296361 conn(0x7f1dec0cc8d0 msgr2=0x7f1dec0b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:20.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.891+0000 7f1df0819700 1 -- 172.21.15.5:0/3071296361 shutdown_connections 2023-03-03T06:26:20.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:20.891+0000 7f1df0819700 1 -- 172.21.15.5:0/3071296361 wait complete. 2023-03-03T06:26:20.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-03-03T06:26:21.030 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.028+0000 7fcdc4beb700 1 Processor -- start 2023-03-03T06:26:21.031 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.028+0000 7fcdc4beb700 1 -- start start 2023-03-03T06:26:21.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.029+0000 7fcdc4beb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcdc015cd40 0x7fcdc00b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:21.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.029+0000 7fcdc4beb700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcdc00cef60 0x7fcdc00b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:21.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.029+0000 7fcdc4beb700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc015d4e0 con 0x7fcdc00cba50 2023-03-03T06:26:21.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.029+0000 7fcdc4beb700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc015d7c0 con 0x7fcdc00cef60 2023-03-03T06:26:21.034 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.029+0000 7fcdc4beb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc015daa0 con 0x7fcdc015cd40 2023-03-03T06:26:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.029+0000 7fcdbdd9b700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcdc00cba50 0x7fcdc0160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36016/0 (socket says 172.21.15.5:36016) 2023-03-03T06:26:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.029+0000 7fcdbdd9b700 1 -- 172.21.15.5:0/3024911384 learned_addr learned my addr 172.21.15.5:0/3024911384 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:21.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.029+0000 7fcdbed9d700 1 --2- 172.21.15.5:0/3024911384 >> v2:172.21.15.191:3300/0 conn(0x7fcdc00cef60 0x7fcdc00b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:21.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.030+0000 7fcdbe59c700 1 --2- 172.21.15.5:0/3024911384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcdc015cd40 0x7fcdc00b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:21.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.030+0000 7fcdbd59a700 1 -- 172.21.15.5:0/3024911384 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515816824 0 0) 0x7fcdc015d4e0 con 0x7fcdc00cba50 2023-03-03T06:26:21.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.030+0000 7fcdbd59a700 1 -- 172.21.15.5:0/3024911384 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcda80035b0 con 0x7fcdc00cba50 2023-03-03T06:26:21.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.030+0000 7fcdbd59a700 1 -- 172.21.15.5:0/3024911384 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1504516490 0 0) 0x7fcda80035b0 con 0x7fcdc00cba50 2023-03-03T06:26:21.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.030+0000 7fcdbed9d700 1 -- 172.21.15.5:0/3024911384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcdc015cd40 msgr2=0x7fcdc00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:21.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.030+0000 7fcdbed9d700 1 --2- 172.21.15.5:0/3024911384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcdc015cd40 0x7fcdc00b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.030+0000 7fcdbed9d700 1 -- 172.21.15.5:0/3024911384 >> v1:172.21.15.5:6789/0 conn(0x7fcdc00cba50 legacy=0x7fcdc0160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:21.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.030+0000 7fcdbed9d700 1 -- 172.21.15.5:0/3024911384 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc015dd80 con 0x7fcdc00cef60 2023-03-03T06:26:21.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.030+0000 7fcdbe59c700 1 --2- 172.21.15.5:0/3024911384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcdc015cd40 0x7fcdc00b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:26:21.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.030+0000 7fcdbed9d700 1 --2- 172.21.15.5:0/3024911384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcdc00cef60 0x7fcdc00b1e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009d90 tx=0x7fcdb800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a5ea8e68fcc296c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:21.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.030+0000 7fcdbd59a700 1 -- 172.21.15.5:0/3024911384 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb800e070 con 0x7fcdc00cef60 2023-03-03T06:26:21.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.030+0000 7fcdbd59a700 1 -- 172.21.15.5:0/3024911384 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb8003a20 con 0x7fcdc00cef60 2023-03-03T06:26:21.038 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.030+0000 7fcdbd59a700 1 -- 172.21.15.5:0/3024911384 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb00017f0 con 0x7fcdc00cef60 2023-03-03T06:26:21.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.031+0000 7fcdc4beb700 1 -- 172.21.15.5:0/3024911384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcdc00cef60 msgr2=0x7fcdc00b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:21.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.031+0000 7fcdc4beb700 1 --2- 172.21.15.5:0/3024911384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcdc00cef60 0x7fcdc00b1e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009d90 tx=0x7fcdb800b330 comp rx=0 tx=0).stop 2023-03-03T06:26:21.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.031+0000 7fcdc4beb700 1 -- 172.21.15.5:0/3024911384 shutdown_connections 2023-03-03T06:26:21.039 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.031+0000 7fcdc4beb700 1 --2- 172.21.15.5:0/3024911384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcdc00cef60 0x7fcdc00b1e10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.031+0000 7fcdc4beb700 1 --2- 172.21.15.5:0/3024911384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcdc015cd40 0x7fcdc00b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.031+0000 7fcdc4beb700 1 -- 172.21.15.5:0/3024911384 >> 172.21.15.5:0/3024911384 conn(0x7fcdc00cc8d0 msgr2=0x7fcdc00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:21.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.031+0000 7fcdc4beb700 1 -- 172.21.15.5:0/3024911384 shutdown_connections 2023-03-03T06:26:21.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.031+0000 7fcdc4beb700 1 -- 172.21.15.5:0/3024911384 wait complete. 2023-03-03T06:26:21.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.032+0000 7fcdc4beb700 1 Processor -- start 2023-03-03T06:26:21.043 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.032+0000 7fcdc4beb700 1 -- start start 2023-03-03T06:26:21.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.033+0000 7fcdc4beb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcdc00cba50 0x7fcdc00adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:21.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.033+0000 7fcdc4beb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc00cef60 0x7fcdc00c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:21.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.033+0000 7fcdc4beb700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcdc015cd40 0x7fcdc0154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:21.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.033+0000 7fcdc4beb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc00c7ab0 con 0x7fcdc00cef60 2023-03-03T06:26:21.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.033+0000 7fcdc4beb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc00c7d90 con 0x7fcdc00cba50 2023-03-03T06:26:21.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.033+0000 7fcdc4beb700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc00c8070 con 0x7fcdc015cd40 2023-03-03T06:26:21.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.033+0000 7fcdbdd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc00cef60 0x7fcdc00c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:21.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.033+0000 7fcdbdd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc00cef60 0x7fcdc00c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46178/0 (socket says 172.21.15.5:46178) 2023-03-03T06:26:21.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.033+0000 7fcdbdd9b700 1 -- 172.21.15.5:0/2878206557 learned_addr learned my addr 172.21.15.5:0/2878206557 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:21.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.033+0000 7fcdbe59c700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcdc00cba50 0x7fcdc00adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:21.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.033+0000 7fcdbed9d700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcdc015cd40 0x7fcdc0154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:21.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.033+0000 7fcdbdd9b700 1 -- 172.21.15.5:0/2878206557 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcdc015cd40 msgr2=0x7fcdc0154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:21.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.034+0000 7fcdbdd9b700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcdc015cd40 0x7fcdc0154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.034+0000 7fcdbdd9b700 1 -- 172.21.15.5:0/2878206557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcdc00cba50 msgr2=0x7fcdc00adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:21.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.034+0000 7fcdbdd9b700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcdc00cba50 0x7fcdc00adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.034+0000 7fcdbdd9b700 1 -- 172.21.15.5:0/2878206557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb40094a0 con 0x7fcdc00cef60 2023-03-03T06:26:21.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.034+0000 7fcdbe59c700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcdc00cba50 0x7fcdc00adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.034+0000 7fcdbdd9b700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc00cef60 0x7fcdc00c9650 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000c6d0 tx=0x7fcdb000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.034+0000 7fcdaeffd700 1 -- 172.21.15.5:0/2878206557 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb00074e0 con 0x7fcdc00cef60 2023-03-03T06:26:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.034+0000 7fcdaeffd700 1 -- 172.21.15.5:0/2878206557 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb0007640 con 0x7fcdc00cef60 2023-03-03T06:26:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.034+0000 7fcdc4beb700 1 -- 172.21.15.5:0/2878206557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb8009a70 con 0x7fcdc00cef60 2023-03-03T06:26:21.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.034+0000 7fcdaeffd700 1 -- 172.21.15.5:0/2878206557 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0005a70 con 0x7fcdc00cef60 2023-03-03T06:26:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.034+0000 7fcdc4beb700 1 -- 172.21.15.5:0/2878206557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc00ca530 con 0x7fcdc00cef60 2023-03-03T06:26:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.035+0000 7fcdc4beb700 1 -- 172.21.15.5:0/2878206557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc015e060 con 0x7fcdc00cef60 2023-03-03T06:26:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.035+0000 7fcdaeffd700 1 -- 172.21.15.5:0/2878206557 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fcdb0019030 con 0x7fcdc00cef60 2023-03-03T06:26:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.036+0000 7fcdaeffd700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcda00682f0 0x7fcda006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:21.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.036+0000 7fcdaeffd700 1 -- 172.21.15.5:0/2878206557 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6679+0+0 (secure 0 0 0) 0x7fcdb0085240 con 0x7fcdc00cef60 2023-03-03T06:26:21.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.036+0000 7fcdbe59c700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcda00682f0 0x7fcda006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:21.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.036+0000 7fcdbe59c700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcda00682f0 0x7fcda006a7a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00c89d0 tx=0x7fcdb4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:21.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.040+0000 7fcdaeffd700 1 -- 172.21.15.5:0/2878206557 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fcdb0051830 con 0x7fcdc00cef60 2023-03-03T06:26:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.313+0000 7fcdc4beb700 1 -- 172.21.15.5:0/2878206557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7fcdc015d110 con 0x7fcdc00cef60 2023-03-03T06:26:21.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.525+0000 7fcdaeffd700 1 -- 172.21.15.5:0/2878206557 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v173) v1 ==== 173+0+0 (secure 0 0 0) 0x7fcdb00170f0 con 0x7fcdc00cef60 2023-03-03T06:26:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.527+0000 7fcdc4beb700 1 -- 172.21.15.5:0/2878206557 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcda00682f0 msgr2=0x7fcda006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.527+0000 7fcdc4beb700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcda00682f0 0x7fcda006a7a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00c89d0 tx=0x7fcdb4008040 comp rx=0 tx=0).stop 2023-03-03T06:26:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.527+0000 7fcdc4beb700 1 -- 172.21.15.5:0/2878206557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc00cef60 msgr2=0x7fcdc00c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.527+0000 7fcdc4beb700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc00cef60 0x7fcdc00c9650 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000c6d0 tx=0x7fcdb000c9e0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.527+0000 7fcdc4beb700 1 -- 172.21.15.5:0/2878206557 shutdown_connections 2023-03-03T06:26:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.527+0000 7fcdc4beb700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fcda00682f0 0x7fcda006a7a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.527+0000 7fcdc4beb700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcdc015cd40 0x7fcdc0154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.527+0000 7fcdc4beb700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcdc00cba50 0x7fcdc00adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.527+0000 7fcdc4beb700 1 --2- 172.21.15.5:0/2878206557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcdc00cef60 0x7fcdc00c9650 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.527+0000 7fcdc4beb700 1 -- 172.21.15.5:0/2878206557 >> 172.21.15.5:0/2878206557 conn(0x7fcdc00cc8d0 msgr2=0x7fcdc00af480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:21.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.527+0000 7fcdc4beb700 1 -- 172.21.15.5:0/2878206557 shutdown_connections 2023-03-03T06:26:21.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.527+0000 7fcdc4beb700 1 -- 172.21.15.5:0/2878206557 wait complete. 2023-03-03T06:26:21.542 INFO:tasks.cephfs_test_runner:test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) ... ok 2023-03-03T06:26:21.543 INFO:tasks.cephfs_test_runner:Starting test: test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) 2023-03-03T06:26:21.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-03-03T06:26:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.667+0000 7f42ceada700 1 Processor -- start 2023-03-03T06:26:21.669 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.667+0000 7f42ceada700 1 -- start start 2023-03-03T06:26:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42ceada700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f42c815cd40 0x7f42c80b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42ceada700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42c80cef60 0x7f42c80b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:21.671 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42ceada700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c815d4e0 con 0x7f42c80cba50 2023-03-03T06:26:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42ceada700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c815d7c0 con 0x7f42c80cef60 2023-03-03T06:26:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42ceada700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c815daa0 con 0x7f42c815cd40 2023-03-03T06:26:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42cd077700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f42c80cef60 0x7f42c80b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42c7fff700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f42c80cba50 0x7f42c8160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36028/0 (socket says 172.21.15.5:36028) 2023-03-03T06:26:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42c7fff700 1 -- 172.21.15.5:0/195997687 learned_addr learned my addr 172.21.15.5:0/195997687 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:21.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42cd077700 1 -- 172.21.15.5:0/195997687 >> v2:172.21.15.191:3300/0 conn(0x7f42c815cd40 msgr2=0x7f42c80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:21.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42cd077700 1 --2- 172.21.15.5:0/195997687 >> v2:172.21.15.191:3300/0 conn(0x7f42c815cd40 0x7f42c80b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42cd077700 1 -- 172.21.15.5:0/195997687 >> v1:172.21.15.5:6789/0 conn(0x7f42c80cba50 legacy=0x7f42c8160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:21.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42cd077700 1 -- 172.21.15.5:0/195997687 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c815dd80 con 0x7f42c80cef60 2023-03-03T06:26:21.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42c77fe700 1 -- 172.21.15.5:0/195997687 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294105790 0 0) 0x7f42c815d4e0 con 0x7f42c80cba50 2023-03-03T06:26:21.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.668+0000 7f42cd077700 1 --2- 172.21.15.5:0/195997687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80cef60 0x7f42c80b1e10 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f42c8071020 tx=0x7f42c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8efcf3acc603502 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:21.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.669+0000 7f42c77fe700 1 -- 172.21.15.5:0/195997687 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000e070 con 0x7f42c80cef60 2023-03-03T06:26:21.673 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.669+0000 7f42c77fe700 1 -- 172.21.15.5:0/195997687 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c000bbd0 con 0x7f42c80cef60 2023-03-03T06:26:21.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.669+0000 7f42c77fe700 1 -- 172.21.15.5:0/195997687 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c0012430 con 0x7f42c80cef60 2023-03-03T06:26:21.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.669+0000 7f42ceada700 1 -- 172.21.15.5:0/195997687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80cef60 msgr2=0x7f42c80b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:21.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.669+0000 7f42ceada700 1 --2- 172.21.15.5:0/195997687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80cef60 0x7f42c80b1e10 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f42c8071020 tx=0x7f42c000b330 comp rx=0 tx=0).stop 2023-03-03T06:26:21.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.669+0000 7f42ceada700 1 -- 172.21.15.5:0/195997687 shutdown_connections 2023-03-03T06:26:21.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.669+0000 7f42ceada700 1 --2- 172.21.15.5:0/195997687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80cef60 0x7f42c80b1e10 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.669+0000 7f42ceada700 1 --2- 172.21.15.5:0/195997687 >> v2:172.21.15.191:3300/0 conn(0x7f42c815cd40 0x7f42c80b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.669+0000 7f42ceada700 1 -- 172.21.15.5:0/195997687 >> 172.21.15.5:0/195997687 conn(0x7f42c80cc8d0 msgr2=0x7f42c80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:21.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.669+0000 7f42ceada700 1 -- 172.21.15.5:0/195997687 shutdown_connections 2023-03-03T06:26:21.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.669+0000 7f42ceada700 1 -- 172.21.15.5:0/195997687 wait complete. 2023-03-03T06:26:21.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.670+0000 7f42ceada700 1 Processor -- start 2023-03-03T06:26:21.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.670+0000 7f42ceada700 1 -- start start 2023-03-03T06:26:21.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.671+0000 7f42ceada700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80cba50 0x7f42c80ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:21.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.671+0000 7f42ceada700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80cef60 0x7f42c80ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:21.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.671+0000 7f42ceada700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42c815cd40 0x7f42c8154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:21.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.671+0000 7f42ceada700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c8154c90 con 0x7f42c80cef60 2023-03-03T06:26:21.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.671+0000 7f42ceada700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c81f2300 con 0x7f42c80cba50 2023-03-03T06:26:21.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.671+0000 7f42ceada700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c80adef0 con 0x7f42c815cd40 2023-03-03T06:26:21.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.671+0000 7f42c7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80cef60 0x7f42c80ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:21.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42c7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80cef60 0x7f42c80ae370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46194/0 (socket says 172.21.15.5:46194) 2023-03-03T06:26:21.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42c7fff700 1 -- 172.21.15.5:0/1241951750 learned_addr learned my addr 172.21.15.5:0/1241951750 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:21.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42cc876700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80cba50 0x7f42c80ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:21.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42cd077700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42c815cd40 0x7f42c8154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:21.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42c7fff700 1 -- 172.21.15.5:0/1241951750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42c815cd40 msgr2=0x7f42c8154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:21.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42c7fff700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42c815cd40 0x7f42c8154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42c7fff700 1 -- 172.21.15.5:0/1241951750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80cba50 msgr2=0x7f42c80ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:21.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42c7fff700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80cba50 0x7f42c80ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:21.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42c7fff700 1 -- 172.21.15.5:0/1241951750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c0009a70 con 0x7f42c80cef60 2023-03-03T06:26:21.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42c7fff700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80cef60 0x7f42c80ae370 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f42b400c6d0 tx=0x7f42b400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:21.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42c57fa700 1 -- 172.21.15.5:0/1241951750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b40074e0 con 0x7f42c80cef60 2023-03-03T06:26:21.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42c57fa700 1 -- 172.21.15.5:0/1241951750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b4007660 con 0x7f42c80cef60 2023-03-03T06:26:21.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42ceada700 1 -- 172.21.15.5:0/1241951750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c80ca530 con 0x7f42c80cef60 2023-03-03T06:26:21.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42c57fa700 1 -- 172.21.15.5:0/1241951750 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4005a70 con 0x7f42c80cef60 2023-03-03T06:26:21.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.672+0000 7f42ceada700 1 -- 172.21.15.5:0/1241951750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c815e060 con 0x7f42c80cef60 2023-03-03T06:26:21.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.673+0000 7f42ceada700 1 -- 172.21.15.5:0/1241951750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c815d110 con 0x7f42c80cef60 2023-03-03T06:26:21.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.674+0000 7f42c57fa700 1 -- 172.21.15.5:0/1241951750 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f42b4019030 con 0x7f42c80cef60 2023-03-03T06:26:21.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.674+0000 7f42c57fa700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42ac0682f0 0x7f42ac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:21.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.674+0000 7f42c57fa700 1 -- 172.21.15.5:0/1241951750 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6679+0+0 (secure 0 0 0) 0x7f42b4085310 con 0x7f42c80cef60 2023-03-03T06:26:21.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.674+0000 7f42cc876700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42ac0682f0 0x7f42ac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:21.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.675+0000 7f42cc876700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42ac0682f0 0x7f42ac06a7a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f42bc006fd0 tx=0x7f42bc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:21.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.678+0000 7f42c57fa700 1 -- 172.21.15.5:0/1241951750 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f42b4051900 con 0x7f42c80cef60 2023-03-03T06:26:21.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:21.955+0000 7f42ceada700 1 -- 172.21.15.5:0/1241951750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7f42c804e6e0 con 0x7f42c80cef60 2023-03-03T06:26:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.526+0000 7f42c57fa700 1 -- 172.21.15.5:0/1241951750 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v174) v1 ==== 151+0+0 (secure 0 0 0) 0x7f42b4054f20 con 0x7f42c80cef60 2023-03-03T06:26:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.529+0000 7f42ceada700 1 -- 172.21.15.5:0/1241951750 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42ac0682f0 msgr2=0x7f42ac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.529+0000 7f42ceada700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42ac0682f0 0x7f42ac06a7a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f42bc006fd0 tx=0x7f42bc008040 comp rx=0 tx=0).stop 2023-03-03T06:26:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.529+0000 7f42ceada700 1 -- 172.21.15.5:0/1241951750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80cef60 msgr2=0x7f42c80ae370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.529+0000 7f42ceada700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80cef60 0x7f42c80ae370 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f42b400c6d0 tx=0x7f42b400ca90 comp rx=0 tx=0).stop 2023-03-03T06:26:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.529+0000 7f42ceada700 1 -- 172.21.15.5:0/1241951750 shutdown_connections 2023-03-03T06:26:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.529+0000 7f42ceada700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f42ac0682f0 0x7f42ac06a7a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.529+0000 7f42ceada700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f42c815cd40 0x7f42c8154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.529+0000 7f42ceada700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f42c80cba50 0x7f42c80ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.529+0000 7f42ceada700 1 --2- 172.21.15.5:0/1241951750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42c80cef60 0x7f42c80ae370 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.529+0000 7f42ceada700 1 -- 172.21.15.5:0/1241951750 >> 172.21.15.5:0/1241951750 conn(0x7f42c80cc8d0 msgr2=0x7f42c806b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:22.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.529+0000 7f42ceada700 1 -- 172.21.15.5:0/1241951750 shutdown_connections 2023-03-03T06:26:22.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.529+0000 7f42ceada700 1 -- 172.21.15.5:0/1241951750 wait complete. 2023-03-03T06:26:22.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-03-03T06:26:22.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.673+0000 7f166e291700 1 Processor -- start 2023-03-03T06:26:22.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.673+0000 7f166e291700 1 -- start start 2023-03-03T06:26:22.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.674+0000 7f166e291700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f166815a7b0 0x7f166815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:22.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.674+0000 7f166e291700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f16680cde30 0x7f16680cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:22.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.674+0000 7f166e291700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16680cf5c0 con 0x7f166806b700 2023-03-03T06:26:22.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.674+0000 7f166e291700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16680cf8a0 con 0x7f166815a7b0 2023-03-03T06:26:22.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.674+0000 7f166e291700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16680cfb80 con 0x7f16680cde30 2023-03-03T06:26:22.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.674+0000 7f1667fff700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f166815a7b0 0x7f166815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:22.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.674+0000 7f166c82e700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f166806b700 0x7f166806bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36046/0 (socket says 172.21.15.5:36046) 2023-03-03T06:26:22.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.674+0000 7f166c82e700 1 -- 172.21.15.5:0/313339036 learned_addr learned my addr 172.21.15.5:0/313339036 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:22.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f1667fff700 1 -- 172.21.15.5:0/313339036 >> v2:172.21.15.191:3300/0 conn(0x7f16680cde30 msgr2=0x7f16680cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:22.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f1667fff700 1 --2- 172.21.15.5:0/313339036 >> v2:172.21.15.191:3300/0 conn(0x7f16680cde30 0x7f16680cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f1667fff700 1 -- 172.21.15.5:0/313339036 >> v1:172.21.15.5:6789/0 conn(0x7f166806b700 legacy=0x7f166806bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:22.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f1667fff700 1 -- 172.21.15.5:0/313339036 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16680b2d40 con 0x7f166815a7b0 2023-03-03T06:26:22.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f1666ffd700 1 -- 172.21.15.5:0/313339036 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389185205 0 0) 0x7f16680cf5c0 con 0x7f166806b700 2023-03-03T06:26:22.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f1667fff700 1 --2- 172.21.15.5:0/313339036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166815a7b0 0x7f166815ab80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f16680cc750 tx=0x7f1650009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a7a2971eabb258 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:22.679 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f1666ffd700 1 -- 172.21.15.5:0/313339036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650011830 con 0x7f166815a7b0 2023-03-03T06:26:22.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f1666ffd700 1 -- 172.21.15.5:0/313339036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1650011990 con 0x7f166815a7b0 2023-03-03T06:26:22.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f1666ffd700 1 -- 172.21.15.5:0/313339036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650011d20 con 0x7f166815a7b0 2023-03-03T06:26:22.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f166e291700 1 -- 172.21.15.5:0/313339036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166815a7b0 msgr2=0x7f166815ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:22.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f166e291700 1 --2- 172.21.15.5:0/313339036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166815a7b0 0x7f166815ab80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f16680cc750 tx=0x7f1650009b20 comp rx=0 tx=0).stop 2023-03-03T06:26:22.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f166e291700 1 -- 172.21.15.5:0/313339036 shutdown_connections 2023-03-03T06:26:22.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f166e291700 1 --2- 172.21.15.5:0/313339036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f166815a7b0 0x7f166815ab80 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f166e291700 1 --2- 172.21.15.5:0/313339036 >> v2:172.21.15.191:3300/0 conn(0x7f16680cde30 0x7f16680cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.675+0000 7f166e291700 1 -- 172.21.15.5:0/313339036 >> 172.21.15.5:0/313339036 conn(0x7f16680cc8d0 msgr2=0x7f16680cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:22.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.676+0000 7f166e291700 1 -- 172.21.15.5:0/313339036 shutdown_connections 2023-03-03T06:26:22.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.676+0000 7f166e291700 1 -- 172.21.15.5:0/313339036 wait complete. 2023-03-03T06:26:22.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.677+0000 7f166e291700 1 Processor -- start 2023-03-03T06:26:22.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.677+0000 7f166e291700 1 -- start start 2023-03-03T06:26:22.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f166e291700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f166806b700 0x7f16681456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:22.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f166e291700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16680cde30 0x7f16680b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:22.683 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f166e291700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f166815a7b0 0x7f16680b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:22.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f166e291700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1668146910 con 0x7f16680cde30 2023-03-03T06:26:22.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f166e291700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16680c64b0 con 0x7f166806b700 2023-03-03T06:26:22.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f166e291700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1668155820 con 0x7f166815a7b0 2023-03-03T06:26:22.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f16677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16680cde30 0x7f16680b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:22.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f16677fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16680cde30 0x7f16680b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46208/0 (socket says 172.21.15.5:46208) 2023-03-03T06:26:22.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f16677fe700 1 -- 172.21.15.5:0/1411193437 learned_addr learned my addr 172.21.15.5:0/1411193437 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:22.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f1667fff700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f166806b700 0x7f16681456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:22.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f166c82e700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f166815a7b0 0x7f16680b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:22.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f16677fe700 1 -- 172.21.15.5:0/1411193437 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f166815a7b0 msgr2=0x7f16680b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:22.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f16677fe700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f166815a7b0 0x7f16680b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f16677fe700 1 -- 172.21.15.5:0/1411193437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f166806b700 msgr2=0x7f16681456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:22.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f16677fe700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f166806b700 0x7f16681456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f16677fe700 1 -- 172.21.15.5:0/1411193437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16500094a0 con 0x7f16680cde30 2023-03-03T06:26:22.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f16677fe700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16680cde30 0x7f16680b4920 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f165800b500 tx=0x7f165800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:22.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f1664ff9700 1 -- 172.21.15.5:0/1411193437 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658011830 con 0x7f16680cde30 2023-03-03T06:26:22.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f1664ff9700 1 -- 172.21.15.5:0/1411193437 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16580119b0 con 0x7f16680cde30 2023-03-03T06:26:22.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f1664ff9700 1 -- 172.21.15.5:0/1411193437 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658011d60 con 0x7f16680cde30 2023-03-03T06:26:22.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.678+0000 7f166e291700 1 -- 172.21.15.5:0/1411193437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16680cf1b0 con 0x7f16680cde30 2023-03-03T06:26:22.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.679+0000 7f166e291700 1 -- 172.21.15.5:0/1411193437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16680b3020 con 0x7f16680cde30 2023-03-03T06:26:22.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.680+0000 7f166e291700 1 -- 172.21.15.5:0/1411193437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16680cf340 con 0x7f16680cde30 2023-03-03T06:26:22.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.680+0000 7f1664ff9700 1 -- 172.21.15.5:0/1411193437 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1658021070 con 0x7f16680cde30 2023-03-03T06:26:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.680+0000 7f1664ff9700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f16480682f0 0x7f164806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.681+0000 7f1664ff9700 1 -- 172.21.15.5:0/1411193437 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6679+0+0 (secure 0 0 0) 0x7f1658085e90 con 0x7f16680cde30 2023-03-03T06:26:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.681+0000 7f1667fff700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f16480682f0 0x7f164806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.681+0000 7f1667fff700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f16480682f0 0x7f164806a7a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f16500090b0 tx=0x7f165001c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:22.687 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.685+0000 7f1664ff9700 1 -- 172.21.15.5:0/1411193437 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f16580523f0 con 0x7f16680cde30 2023-03-03T06:26:22.881 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.879+0000 7f166e291700 1 -- 172.21.15.5:0/1411193437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1668146a50 con 0x7f16680cde30 2023-03-03T06:26:22.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.883+0000 7f1664ff9700 1 -- 172.21.15.5:0/1411193437 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v17)=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1668146a50 con 0x7f16680cde30 2023-03-03T06:26:22.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.885+0000 7f166e291700 1 -- 172.21.15.5:0/1411193437 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f16480682f0 msgr2=0x7f164806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:22.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.885+0000 7f166e291700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f16480682f0 0x7f164806a7a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f16500090b0 tx=0x7f165001c040 comp rx=0 tx=0).stop 2023-03-03T06:26:22.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.885+0000 7f166e291700 1 -- 172.21.15.5:0/1411193437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16680cde30 msgr2=0x7f16680b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:22.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.885+0000 7f166e291700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16680cde30 0x7f16680b4920 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f165800b500 tx=0x7f165800b8c0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.885+0000 7f166e291700 1 -- 172.21.15.5:0/1411193437 shutdown_connections 2023-03-03T06:26:22.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.885+0000 7f166e291700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f16480682f0 0x7f164806a7a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.885+0000 7f166e291700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f166815a7b0 0x7f16680b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.885+0000 7f166e291700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f166806b700 0x7f16681456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.885+0000 7f166e291700 1 --2- 172.21.15.5:0/1411193437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16680cde30 0x7f16680b4920 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:22.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.885+0000 7f166e291700 1 -- 172.21.15.5:0/1411193437 >> 172.21.15.5:0/1411193437 conn(0x7f16680cc8d0 msgr2=0x7f16680ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:22.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.885+0000 7f166e291700 1 -- 172.21.15.5:0/1411193437 shutdown_connections 2023-03-03T06:26:22.889 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:22.885+0000 7f166e291700 1 -- 172.21.15.5:0/1411193437 wait complete. 2023-03-03T06:26:22.899 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-03-03T06:26:22.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:26:22.940 DEBUG:teuthology.orchestra.run.smithi191:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-03-03T06:26:22.993 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-03-03T06:26:22.994 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:26:22.994 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:26:23.011 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287360k,nr_inodes=4071840,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19712 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-03-03T06:26:23.012 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:26:23.012 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:26:23.032 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-03-03T06:26:23.033 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:26:23.033 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:26:23.069 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287360k,nr_inodes=4071840,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19712 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-03-03T06:26:23.070 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-03-03T06:26:23.070 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:26:23.090 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16682 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-03-03T06:26:23.091 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-03-03T06:26:23.091 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:26:23.232 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.230+0000 7f0ed0790700 1 Processor -- start 2023-03-03T06:26:23.233 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.230+0000 7f0ed0790700 1 -- start start 2023-03-03T06:26:23.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.231+0000 7f0ed0790700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ec80b1fe0 0x7f0ec80cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:23.234 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.231+0000 7f0ed0790700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec815d4e0 con 0x7f0ec815cd40 2023-03-03T06:26:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.231+0000 7f0ed0790700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec815d7c0 con 0x7f0ec80cba50 2023-03-03T06:26:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.231+0000 7f0ed0790700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec815daa0 con 0x7f0ec80b1fe0 2023-03-03T06:26:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.232+0000 7f0ecdd2b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0ec80b1fe0 0x7f0ec80cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:23.235 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.232+0000 7f0ece52c700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0ec815cd40 0x7f0ec80b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36056/0 (socket says 172.21.15.5:36056) 2023-03-03T06:26:23.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.232+0000 7f0ece52c700 1 -- 172.21.15.5:0/3702042677 learned_addr learned my addr 172.21.15.5:0/3702042677 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:23.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.232+0000 7f0ecdd2b700 1 -- 172.21.15.5:0/3702042677 >> v1:172.21.15.191:6789/0 conn(0x7f0ec80cba50 legacy=0x7f0ec80ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:23.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.232+0000 7f0ecdd2b700 1 -- 172.21.15.5:0/3702042677 >> v1:172.21.15.5:6789/0 conn(0x7f0ec815cd40 legacy=0x7f0ec80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:23.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.232+0000 7f0ecd52a700 1 -- 172.21.15.5:0/3702042677 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860353317 0 0) 0x7f0ec815d4e0 con 0x7f0ec815cd40 2023-03-03T06:26:23.236 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.232+0000 7f0ecdd2b700 1 -- 172.21.15.5:0/3702042677 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec815dd80 con 0x7f0ec80b1fe0 2023-03-03T06:26:23.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.232+0000 7f0ecdd2b700 1 --2- 172.21.15.5:0/3702042677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec80b1fe0 0x7f0ec80cdf50 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009820 tx=0x7f0eb8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b156b79a2307a39c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:23.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.232+0000 7f0ecd52a700 1 -- 172.21.15.5:0/3702042677 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8005e30 con 0x7f0ec80b1fe0 2023-03-03T06:26:23.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.232+0000 7f0ecd52a700 1 -- 172.21.15.5:0/3702042677 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb8004030 con 0x7f0ec80b1fe0 2023-03-03T06:26:23.237 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.232+0000 7f0ecd52a700 1 -- 172.21.15.5:0/3702042677 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb80043c0 con 0x7f0ec80b1fe0 2023-03-03T06:26:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.233+0000 7f0ed0790700 1 -- 172.21.15.5:0/3702042677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec80b1fe0 msgr2=0x7f0ec80cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.233+0000 7f0ed0790700 1 --2- 172.21.15.5:0/3702042677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec80b1fe0 0x7f0ec80cdf50 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009820 tx=0x7f0eb8009b30 comp rx=0 tx=0).stop 2023-03-03T06:26:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.233+0000 7f0ed0790700 1 -- 172.21.15.5:0/3702042677 shutdown_connections 2023-03-03T06:26:23.243 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.233+0000 7f0ed0790700 1 --2- 172.21.15.5:0/3702042677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec80b1fe0 0x7f0ec80cdf50 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:23.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.233+0000 7f0ed0790700 1 -- 172.21.15.5:0/3702042677 >> 172.21.15.5:0/3702042677 conn(0x7f0ec80cc8d0 msgr2=0x7f0ec80cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:23.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.233+0000 7f0ed0790700 1 -- 172.21.15.5:0/3702042677 shutdown_connections 2023-03-03T06:26:23.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.233+0000 7f0ed0790700 1 -- 172.21.15.5:0/3702042677 wait complete. 2023-03-03T06:26:23.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.234+0000 7f0ed0790700 1 Processor -- start 2023-03-03T06:26:23.244 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.234+0000 7f0ed0790700 1 -- start start 2023-03-03T06:26:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0ed0790700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ec80b1fe0 0x7f0ec80c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0ed0790700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ec80cba50 0x7f0ec8155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0ed0790700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec815cd40 0x7f0ec80cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0ed0790700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80c8870 con 0x7f0ec815cd40 2023-03-03T06:26:23.245 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0ed0790700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80c8b50 con 0x7f0ec80cba50 2023-03-03T06:26:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0ed0790700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80c8e30 con 0x7f0ec80b1fe0 2023-03-03T06:26:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0eced2d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec815cd40 0x7f0ec80cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0eced2d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec815cd40 0x7f0ec80cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46224/0 (socket says 172.21.15.5:46224) 2023-03-03T06:26:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0eced2d700 1 -- 172.21.15.5:0/3531887272 learned_addr learned my addr 172.21.15.5:0/3531887272 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:23.246 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0ecdd2b700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ec80cba50 0x7f0ec8155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0ece52c700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ec80b1fe0 0x7f0ec80c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0eced2d700 1 -- 172.21.15.5:0/3531887272 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ec80b1fe0 msgr2=0x7f0ec80c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0eced2d700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ec80b1fe0 0x7f0ec80c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0eced2d700 1 -- 172.21.15.5:0/3531887272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ec80cba50 msgr2=0x7f0ec8155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:23.247 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0eced2d700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ec80cba50 0x7f0ec8155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0eced2d700 1 -- 172.21.15.5:0/3531887272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb8009430 con 0x7f0ec815cd40 2023-03-03T06:26:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.235+0000 7f0ecdd2b700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ec80cba50 0x7f0ec8155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.236+0000 7f0eced2d700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec815cd40 0x7f0ec80cec40 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000cc10 tx=0x7f0ec000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.236+0000 7f0ebeffd700 1 -- 172.21.15.5:0/3531887272 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000ab10 con 0x7f0ec815cd40 2023-03-03T06:26:23.248 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.236+0000 7f0ed0790700 1 -- 172.21.15.5:0/3531887272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec80ca530 con 0x7f0ec815cd40 2023-03-03T06:26:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.236+0000 7f0ebeffd700 1 -- 172.21.15.5:0/3531887272 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec000ac70 con 0x7f0ec815cd40 2023-03-03T06:26:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.236+0000 7f0ebeffd700 1 -- 172.21.15.5:0/3531887272 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0012420 con 0x7f0ec815cd40 2023-03-03T06:26:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.236+0000 7f0ed0790700 1 -- 172.21.15.5:0/3531887272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec815e060 con 0x7f0ec815cd40 2023-03-03T06:26:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.237+0000 7f0ed0790700 1 -- 172.21.15.5:0/3531887272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec815d110 con 0x7f0ec815cd40 2023-03-03T06:26:23.249 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.237+0000 7f0ebeffd700 1 -- 172.21.15.5:0/3531887272 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0ec0010050 con 0x7f0ec815cd40 2023-03-03T06:26:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.238+0000 7f0ebeffd700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0eac0682f0 0x7f0eac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.238+0000 7f0ebeffd700 1 -- 172.21.15.5:0/3531887272 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6679+0+0 (secure 0 0 0) 0x7f0ec00861d0 con 0x7f0ec815cd40 2023-03-03T06:26:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.238+0000 7f0ece52c700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0eac0682f0 0x7f0eac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:23.250 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.238+0000 7f0ece52c700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0eac0682f0 0x7f0eac06a7a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4000f60 tx=0x7f0ec4007e70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:23.251 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.243+0000 7f0ebeffd700 1 -- 172.21.15.5:0/3531887272 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0ec0052740 con 0x7f0ec815cd40 2023-03-03T06:26:23.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.477+0000 7f0ed0790700 1 -- 172.21.15.5:0/3531887272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ec804e6e0 con 0x7f0ec815cd40 2023-03-03T06:26:23.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.478+0000 7f0ebeffd700 1 -- 172.21.15.5:0/3531887272 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f0ec0055d60 con 0x7f0ec815cd40 2023-03-03T06:26:23.480 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:23.481 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5600,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/4074242566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":4074242566},{"type":"v1","addr":"172.21.15.191:6835","nonce":4074242566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/3446616567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":3446616567},{"type":"v1","addr":"172.21.15.5:6836","nonce":3446616567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/430214005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":430214005},{"type":"v1","addr":"172.21.15.5:6837","nonce":430214005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6198,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/3308805305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":3308805305},{"type":"v1","addr":"172.21.15.191:6834","nonce":3308805305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[]} 2023-03-03T06:26:23.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.480+0000 7f0ed0790700 1 -- 172.21.15.5:0/3531887272 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0eac0682f0 msgr2=0x7f0eac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:23.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.480+0000 7f0ed0790700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0eac0682f0 0x7f0eac06a7a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4000f60 tx=0x7f0ec4007e70 comp rx=0 tx=0).stop 2023-03-03T06:26:23.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.480+0000 7f0ed0790700 1 -- 172.21.15.5:0/3531887272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec815cd40 msgr2=0x7f0ec80cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:23.482 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.480+0000 7f0ed0790700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec815cd40 0x7f0ec80cec40 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000cc10 tx=0x7f0ec000cf20 comp rx=0 tx=0).stop 2023-03-03T06:26:23.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.480+0000 7f0ed0790700 1 -- 172.21.15.5:0/3531887272 shutdown_connections 2023-03-03T06:26:23.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.480+0000 7f0ed0790700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0ec815cd40 0x7f0ec80cec40 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:23.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.480+0000 7f0ed0790700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f0eac0682f0 0x7f0eac06a7a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:23.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.480+0000 7f0ed0790700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0ec80b1fe0 0x7f0ec80c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:23.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.480+0000 7f0ed0790700 1 --2- 172.21.15.5:0/3531887272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0ec80cba50 0x7f0ec8155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:23.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.480+0000 7f0ed0790700 1 -- 172.21.15.5:0/3531887272 >> 172.21.15.5:0/3531887272 conn(0x7f0ec80cc8d0 msgr2=0x7f0ec806ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:23.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.480+0000 7f0ed0790700 1 -- 172.21.15.5:0/3531887272 shutdown_connections 2023-03-03T06:26:23.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.480+0000 7f0ed0790700 1 -- 172.21.15.5:0/3531887272 wait complete. 2023-03-03T06:26:23.484 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2023-03-03T06:26:23.494 INFO:tasks.ceph.mds.a:Restarting daemon 2023-03-03T06:26:23.494 INFO:tasks.ceph.mds.a:Stopping old one... 2023-03-03T06:26:23.495 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-03-03T06:26:23.495 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:26:23.495 INFO:tasks.ceph.mds.c:Restarting daemon 2023-03-03T06:26:23.496 INFO:tasks.ceph.mds.c:Stopping old one... 2023-03-03T06:26:23.496 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-03-03T06:26:23.496 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:26:23.496 INFO:tasks.ceph.mds.b:Restarting daemon 2023-03-03T06:26:23.497 INFO:tasks.ceph.mds.b:Stopping old one... 2023-03-03T06:26:23.497 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-03-03T06:26:23.497 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:26:23.497 INFO:tasks.ceph.mds.d:Restarting daemon 2023-03-03T06:26:23.497 INFO:tasks.ceph.mds.d:Stopping old one... 2023-03-03T06:26:23.498 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-03-03T06:26:23.498 INFO:teuthology.orchestra.run:waiting for 300 2023-03-03T06:26:23.503 INFO:tasks.ceph.mds.a:Stopped 2023-03-03T06:26:23.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-03-03T06:26:23.505 INFO:tasks.ceph.mds.c:Stopped 2023-03-03T06:26:23.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-03-03T06:26:23.508 INFO:tasks.ceph.mds.b:Stopped 2023-03-03T06:26:23.508 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-03-03T06:26:23.509 INFO:tasks.ceph.mds.d:Stopped 2023-03-03T06:26:23.509 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-03-03T06:26:23.546 INFO:tasks.ceph.mds.a:Started 2023-03-03T06:26:23.547 DEBUG:teuthology.parallel:result is None 2023-03-03T06:26:23.548 INFO:tasks.ceph.mds.c:Started 2023-03-03T06:26:23.548 DEBUG:teuthology.parallel:result is None 2023-03-03T06:26:23.550 INFO:tasks.ceph.mds.b:Started 2023-03-03T06:26:23.551 DEBUG:teuthology.parallel:result is None 2023-03-03T06:26:23.551 INFO:tasks.ceph.mds.d:Started 2023-03-03T06:26:23.552 DEBUG:teuthology.parallel:result is None 2023-03-03T06:26:23.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-03-03T06:26:23.628 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-03-03T06:26:23.629 INFO:tasks.ceph.mds.c.smithi005.stdout:starting mds.c at 2023-03-03T06:26:23.637 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2023-03-03T06:26:23.638 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2023-03-03T06:26:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.687+0000 7f18c0395700 1 Processor -- start 2023-03-03T06:26:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.687+0000 7f18c0395700 1 -- start start 2023-03-03T06:26:23.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.687+0000 7f18c0395700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18b80cd860 0x7f18b80cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:23.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.687+0000 7f18c0395700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18b8161000 0x7f18b815da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:23.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18c0395700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b81605b0 con 0x7f18b80cdc30 2023-03-03T06:26:23.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18c0395700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b8160b70 con 0x7f18b80cd860 2023-03-03T06:26:23.691 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18c0395700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b815dfc0 con 0x7f18b8161000 2023-03-03T06:26:23.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18be131700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18b80cd860 0x7f18b80cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:23.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18be131700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f18b80cd860 0x7f18b80cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46252/0 (socket says 172.21.15.5:46252) 2023-03-03T06:26:23.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18be131700 1 -- 172.21.15.5:0/645961404 learned_addr learned my addr 172.21.15.5:0/645961404 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:23.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18bd930700 1 --2- 172.21.15.5:0/645961404 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18b8161000 0x7f18b815da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:23.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18be131700 1 -- 172.21.15.5:0/645961404 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18b8161000 msgr2=0x7f18b815da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:23.692 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18be131700 1 --2- 172.21.15.5:0/645961404 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18b8161000 0x7f18b815da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:23.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18be131700 1 -- 172.21.15.5:0/645961404 >> v1:172.21.15.191:6789/0 conn(0x7f18b80cdc30 legacy=0x7f18b806c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:23.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18be131700 1 -- 172.21.15.5:0/645961404 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b80cf0b0 con 0x7f18b80cd860 2023-03-03T06:26:23.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18be131700 1 --2- 172.21.15.5:0/645961404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80cd860 0x7f18b80cea20 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f18b40098f0 tx=0x7f18b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3542516856453d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:23.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18bd12f700 1 -- 172.21.15.5:0/645961404 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b400b8a0 con 0x7f18b80cd860 2023-03-03T06:26:23.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18bd12f700 1 -- 172.21.15.5:0/645961404 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b400ba00 con 0x7f18b80cd860 2023-03-03T06:26:23.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.688+0000 7f18bd12f700 1 -- 172.21.15.5:0/645961404 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b400bd90 con 0x7f18b80cd860 2023-03-03T06:26:23.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.689+0000 7f18c0395700 1 -- 172.21.15.5:0/645961404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80cd860 msgr2=0x7f18b80cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:23.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.689+0000 7f18c0395700 1 --2- 172.21.15.5:0/645961404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80cd860 0x7f18b80cea20 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f18b40098f0 tx=0x7f18b4009c00 comp rx=0 tx=0).stop 2023-03-03T06:26:23.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.689+0000 7f18c0395700 1 -- 172.21.15.5:0/645961404 shutdown_connections 2023-03-03T06:26:23.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.689+0000 7f18c0395700 1 --2- 172.21.15.5:0/645961404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80cd860 0x7f18b80cea20 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:23.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.689+0000 7f18c0395700 1 --2- 172.21.15.5:0/645961404 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18b8161000 0x7f18b815da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:23.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.689+0000 7f18c0395700 1 -- 172.21.15.5:0/645961404 >> 172.21.15.5:0/645961404 conn(0x7f18b8070050 msgr2=0x7f18b8070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:23.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.689+0000 7f18c0395700 1 -- 172.21.15.5:0/645961404 shutdown_connections 2023-03-03T06:26:23.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.689+0000 7f18c0395700 1 -- 172.21.15.5:0/645961404 wait complete. 2023-03-03T06:26:23.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.690+0000 7f18c0395700 1 Processor -- start 2023-03-03T06:26:23.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.690+0000 7f18c0395700 1 -- start start 2023-03-03T06:26:23.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18c0395700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80cd860 0x7f18b80c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:23.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18c0395700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18b80cdc30 0x7f18b8150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:23.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18c0395700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18b8161000 0x7f18b8151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:23.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18c0395700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80b5580 con 0x7f18b80cd860 2023-03-03T06:26:23.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18c0395700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80b5e20 con 0x7f18b8161000 2023-03-03T06:26:23.697 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18c0395700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80c7620 con 0x7f18b80cdc30 2023-03-03T06:26:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18be131700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80cd860 0x7f18b80c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18be131700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80cd860 0x7f18b80c6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46258/0 (socket says 172.21.15.5:46258) 2023-03-03T06:26:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18be131700 1 -- 172.21.15.5:0/4056727655 learned_addr learned my addr 172.21.15.5:0/4056727655 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18bd930700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18b80cdc30 0x7f18b8150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18be932700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18b8161000 0x7f18b8151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18be131700 1 -- 172.21.15.5:0/4056727655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18b80cdc30 msgr2=0x7f18b8150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:23.698 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18be131700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18b80cdc30 0x7f18b8150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:23.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18be131700 1 -- 172.21.15.5:0/4056727655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18b8161000 msgr2=0x7f18b8151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:23.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18be131700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18b8161000 0x7f18b8151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:23.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18be131700 1 -- 172.21.15.5:0/4056727655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b4009550 con 0x7f18b80cd860 2023-03-03T06:26:23.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.691+0000 7f18be131700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80cd860 0x7f18b80c6ff0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009c40 tx=0x7f18b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:23.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.692+0000 7f18aaffd700 1 -- 172.21.15.5:0/4056727655 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4004300 con 0x7f18b80cd860 2023-03-03T06:26:23.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.692+0000 7f18aaffd700 1 -- 172.21.15.5:0/4056727655 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b401f070 con 0x7f18b80cd860 2023-03-03T06:26:23.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.692+0000 7f18aaffd700 1 -- 172.21.15.5:0/4056727655 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b40036a0 con 0x7f18b80cd860 2023-03-03T06:26:23.699 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.692+0000 7f18c0395700 1 -- 172.21.15.5:0/4056727655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b8160800 con 0x7f18b80cd860 2023-03-03T06:26:23.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.692+0000 7f18c0395700 1 -- 172.21.15.5:0/4056727655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b80cf390 con 0x7f18b80cd860 2023-03-03T06:26:23.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.693+0000 7f18c0395700 1 -- 172.21.15.5:0/4056727655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b8161470 con 0x7f18b80cd860 2023-03-03T06:26:23.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.693+0000 7f18aaffd700 1 -- 172.21.15.5:0/4056727655 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f18b402a020 con 0x7f18b80cd860 2023-03-03T06:26:23.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.694+0000 7f18aaffd700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f189c0682f0 0x7f189c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:23.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.694+0000 7f18aaffd700 1 -- 172.21.15.5:0/4056727655 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6679+0+0 (secure 0 0 0) 0x7f18b4087300 con 0x7f18b80cd860 2023-03-03T06:26:23.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.694+0000 7f18bd930700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f189c0682f0 0x7f189c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:23.700 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.694+0000 7f18bd930700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f189c0682f0 0x7f189c06a7a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f18b81f5ef0 tx=0x7f18ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:23.701 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.699+0000 7f18aaffd700 1 -- 172.21.15.5:0/4056727655 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f18b40538f0 con 0x7f18b80cd860 2023-03-03T06:26:23.910 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:23.909+0000 7f18c0395700 1 -- 172.21.15.5:0/4056727655 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f18b804e6e0 con 0x7f18b80cd860 2023-03-03T06:26:24.888 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:24.887+0000 7f18aaffd700 1 -- 172.21.15.5:0/4056727655 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) v1 ==== 97+0+0 (secure 0 0 0) 0x7f18b4056f10 con 0x7f18b80cd860 2023-03-03T06:26:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:24.890+0000 7f18c0395700 1 -- 172.21.15.5:0/4056727655 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f189c0682f0 msgr2=0x7f189c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:24.890+0000 7f18c0395700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f189c0682f0 0x7f189c06a7a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f18b81f5ef0 tx=0x7f18ac008040 comp rx=0 tx=0).stop 2023-03-03T06:26:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:24.890+0000 7f18c0395700 1 -- 172.21.15.5:0/4056727655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80cd860 msgr2=0x7f18b80c6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:24.891 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:24.890+0000 7f18c0395700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80cd860 0x7f18b80c6ff0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009c40 tx=0x7f18b4004750 comp rx=0 tx=0).stop 2023-03-03T06:26:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:24.890+0000 7f18c0395700 1 -- 172.21.15.5:0/4056727655 shutdown_connections 2023-03-03T06:26:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:24.890+0000 7f18c0395700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18b8161000 0x7f18b8151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:24.890+0000 7f18c0395700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18b80cd860 0x7f18b80c6ff0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:24.890+0000 7f18c0395700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f189c0682f0 0x7f189c06a7a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:24.890+0000 7f18c0395700 1 --2- 172.21.15.5:0/4056727655 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f18b80cdc30 0x7f18b8150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:24.890+0000 7f18c0395700 1 -- 172.21.15.5:0/4056727655 >> 172.21.15.5:0/4056727655 conn(0x7f18b8070050 msgr2=0x7f18b815f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:24.892 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:24.890+0000 7f18c0395700 1 -- 172.21.15.5:0/4056727655 shutdown_connections 2023-03-03T06:26:24.893 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:24.890+0000 7f18c0395700 1 -- 172.21.15.5:0/4056727655 wait complete. 2023-03-03T06:26:24.893 INFO:teuthology.orchestra.run.smithi005.stderr: removed all blocklist entries 2023-03-03T06:26:24.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-03-03T06:26:25.040 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.039+0000 7f4a6017b700 1 Processor -- start 2023-03-03T06:26:25.041 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.039+0000 7f4a6017b700 1 -- start start 2023-03-03T06:26:25.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.040+0000 7f4a6017b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4a581573f0 0x7f4a5815d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.040+0000 7f4a6017b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a580b18d0 0x7f4a580b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.044 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.040+0000 7f4a6017b700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a581577c0 con 0x7f4a580cc1a0 2023-03-03T06:26:25.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.040+0000 7f4a6017b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a580cd790 con 0x7f4a581573f0 2023-03-03T06:26:25.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.040+0000 7f4a6017b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a58159e60 con 0x7f4a580b18d0 2023-03-03T06:26:25.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.040+0000 7f4a5d716700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4a580cc1a0 0x7f4a580cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36112/0 (socket says 172.21.15.5:36112) 2023-03-03T06:26:25.045 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.040+0000 7f4a5d716700 1 -- 172.21.15.5:0/3794473271 learned_addr learned my addr 172.21.15.5:0/3794473271 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5e718700 1 --2- 172.21.15.5:0/3794473271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a580b18d0 0x7f4a580b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5df17700 1 --2- 172.21.15.5:0/3794473271 >> v2:172.21.15.191:3300/0 conn(0x7f4a581573f0 0x7f4a5815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473973311 0 0) 0x7f4a581577c0 con 0x7f4a580cc1a0 2023-03-03T06:26:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a440035b0 con 0x7f4a580cc1a0 2023-03-03T06:26:25.046 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3463249623 0 0) 0x7f4a440035b0 con 0x7f4a580cc1a0 2023-03-03T06:26:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a580b18d0 msgr2=0x7f4a580b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 --2- 172.21.15.5:0/3794473271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a580b18d0 0x7f4a580b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 >> v2:172.21.15.191:3300/0 conn(0x7f4a581573f0 msgr2=0x7f4a5815d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 --2- 172.21.15.5:0/3794473271 >> v2:172.21.15.191:3300/0 conn(0x7f4a581573f0 0x7f4a5815d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a580b2250 con 0x7f4a580cc1a0 2023-03-03T06:26:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f4a540017f0 con 0x7f4a580cc1a0 2023-03-03T06:26:25.047 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 >> v1:172.21.15.5:6789/0 conn(0x7f4a580cc1a0 legacy=0x7f4a580cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 --2- 172.21.15.5:0/3794473271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a580b18d0 0x7f4a44003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 --2- 172.21.15.5:0/3794473271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a44003ff0 0x7f4a44004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 --2- 172.21.15.5:0/3794473271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a44004d90 0x7f4a44005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580cd790 con 0x7f4a44003ff0 2023-03-03T06:26:25.048 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a58159e60 con 0x7f4a44004d90 2023-03-03T06:26:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4400ba10 con 0x7f4a580b18d0 2023-03-03T06:26:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5d716700 1 --2- 172.21.15.5:0/3794473271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a44003ff0 0x7f4a44004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5df17700 1 --2- 172.21.15.5:0/3794473271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a580b18d0 0x7f4a44003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5e718700 1 --2- 172.21.15.5:0/3794473271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a44004d90 0x7f4a44005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.049 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5d716700 1 -- 172.21.15.5:0/3794473271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a580b18d0 msgr2=0x7f4a44003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5d716700 1 --2- 172.21.15.5:0/3794473271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a580b18d0 0x7f4a44003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5d716700 1 -- 172.21.15.5:0/3794473271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a44004d90 msgr2=0x7f4a44005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5d716700 1 --2- 172.21.15.5:0/3794473271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a44004d90 0x7f4a44005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5d716700 1 -- 172.21.15.5:0/3794473271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a440035b0 con 0x7f4a44003ff0 2023-03-03T06:26:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.041+0000 7f4a5e718700 1 --2- 172.21.15.5:0/3794473271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a44004d90 0x7f4a44005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:25.050 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.042+0000 7f4a5d716700 1 --2- 172.21.15.5:0/3794473271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a44003ff0 0x7f4a44004850 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400c350 tx=0x7f4a44005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3c29f348dc28e3 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.042+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5400ce50 con 0x7f4a44003ff0 2023-03-03T06:26:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.042+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a54007bf0 con 0x7f4a44003ff0 2023-03-03T06:26:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.042+0000 7f4a5cf15700 1 -- 172.21.15.5:0/3794473271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54007310 con 0x7f4a44003ff0 2023-03-03T06:26:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.042+0000 7f4a6017b700 1 -- 172.21.15.5:0/3794473271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a44003ff0 msgr2=0x7f4a44004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.042+0000 7f4a6017b700 1 --2- 172.21.15.5:0/3794473271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a44003ff0 0x7f4a44004850 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400c350 tx=0x7f4a44005880 comp rx=0 tx=0).stop 2023-03-03T06:26:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.042+0000 7f4a5e718700 1 -- 172.21.15.5:0/3794473271 reap_dead start 2023-03-03T06:26:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.042+0000 7f4a6017b700 1 -- 172.21.15.5:0/3794473271 shutdown_connections 2023-03-03T06:26:25.051 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.042+0000 7f4a6017b700 1 -- 172.21.15.5:0/3794473271 >> 172.21.15.5:0/3794473271 conn(0x7f4a580cc8d0 msgr2=0x7f4a580cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.042+0000 7f4a6017b700 1 -- 172.21.15.5:0/3794473271 shutdown_connections 2023-03-03T06:26:25.052 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.042+0000 7f4a6017b700 1 -- 172.21.15.5:0/3794473271 wait complete. 2023-03-03T06:26:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.044+0000 7f4a6017b700 1 Processor -- start 2023-03-03T06:26:25.054 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.044+0000 7f4a6017b700 1 -- start start 2023-03-03T06:26:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.044+0000 7f4a6017b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a44003ff0 0x7f4a580c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.044+0000 7f4a6017b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a580c6290 0x7f4a581eee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.044+0000 7f4a6017b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a580c7770 0x7f4a580c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.044+0000 7f4a6017b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a581ef390 con 0x7f4a44003ff0 2023-03-03T06:26:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.044+0000 7f4a6017b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a581ef660 con 0x7f4a580c7770 2023-03-03T06:26:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.044+0000 7f4a6017b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a581ef940 con 0x7f4a580c6290 2023-03-03T06:26:25.055 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a5df17700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a44003ff0 0x7f4a580c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a5df17700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a44003ff0 0x7f4a580c9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46282/0 (socket says 172.21.15.5:46282) 2023-03-03T06:26:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a5df17700 1 -- 172.21.15.5:0/392427063 learned_addr learned my addr 172.21.15.5:0/392427063 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a5e718700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a580c7770 0x7f4a580c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a5d716700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a580c6290 0x7f4a581eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.056 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a5df17700 1 -- 172.21.15.5:0/392427063 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a580c6290 msgr2=0x7f4a581eee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a5df17700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a580c6290 0x7f4a581eee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a5df17700 1 -- 172.21.15.5:0/392427063 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a580c7770 msgr2=0x7f4a580c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a5df17700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a580c7770 0x7f4a580c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a5df17700 1 -- 172.21.15.5:0/392427063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5815d900 con 0x7f4a44003ff0 2023-03-03T06:26:25.057 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a5e718700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a580c7770 0x7f4a580c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:25.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a5df17700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a44003ff0 0x7f4a580c9800 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4a48011bb0 tx=0x7f4a48011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:25.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a4e7fc700 1 -- 172.21.15.5:0/392427063 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48016070 con 0x7f4a44003ff0 2023-03-03T06:26:25.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a4e7fc700 1 -- 172.21.15.5:0/392427063 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4800eb00 con 0x7f4a44003ff0 2023-03-03T06:26:25.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a6017b700 1 -- 172.21.15.5:0/392427063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a580ce460 con 0x7f4a44003ff0 2023-03-03T06:26:25.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a4e7fc700 1 -- 172.21.15.5:0/392427063 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4800ec70 con 0x7f4a44003ff0 2023-03-03T06:26:25.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.045+0000 7f4a6017b700 1 -- 172.21.15.5:0/392427063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5815dbe0 con 0x7f4a44003ff0 2023-03-03T06:26:25.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.046+0000 7f4a6017b700 1 -- 172.21.15.5:0/392427063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a581f0570 con 0x7f4a44003ff0 2023-03-03T06:26:25.058 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.047+0000 7f4a4e7fc700 1 -- 172.21.15.5:0/392427063 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4a48021030 con 0x7f4a44003ff0 2023-03-03T06:26:25.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.047+0000 7f4a4e7fc700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a3c0682f0 0x7f4a3c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.047+0000 7f4a4e7fc700 1 -- 172.21.15.5:0/392427063 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6593+0+0 (secure 0 0 0) 0x7f4a480877a0 con 0x7f4a44003ff0 2023-03-03T06:26:25.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.047+0000 7f4a5d716700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a3c0682f0 0x7f4a3c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.047+0000 7f4a5d716700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a3c0682f0 0x7f4a3c06a7a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4a54000c00 tx=0x7f4a5400a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:25.059 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.051+0000 7f4a4e7fc700 1 -- 172.21.15.5:0/392427063 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4a480535e0 con 0x7f4a44003ff0 2023-03-03T06:26:25.323 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.322+0000 7f4a6017b700 1 -- 172.21.15.5:0/392427063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4a5804e6e0 con 0x7f4a44003ff0 2023-03-03T06:26:25.324 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.323+0000 7f4a4e7fc700 1 -- 172.21.15.5:0/392427063 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f4a4801f090 con 0x7f4a44003ff0 2023-03-03T06:26:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:25.324 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-03-03T06:26:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_dump": [ 2023-03-03T06:26:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.a", 2023-03-03T06:26:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkziqmKRAARZXnnbV545/aKwJvt9QAgw==", 2023-03-03T06:26:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:26:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:26:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:26:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.b", 2023-03-03T06:26:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkYP9KNhAA/yyEBoBn/eJ8/6mufuiznQ==", 2023-03-03T06:26:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:26:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:26:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:26:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.c", 2023-03-03T06:26:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFk23MbMRAA1E6lR036GpHdLG9WAVzE2A==", 2023-03-03T06:26:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:26:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:26:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:26:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mds.d", 2023-03-03T06:26:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFkQYUSAhAAt9Hj4Yq5VW5NJENi11Gsag==", 2023-03-03T06:26:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:26:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:26:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:26:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.0", 2023-03-03T06:26:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA7kgFkiS2tKRAAuYbICLnn3CQtdepNk9uG7Q==", 2023-03-03T06:26:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:26:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:26:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.1", 2023-03-03T06:26:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA+kgFkpDf4KBAA77yBycaKiSFdrCP9F0C5IA==", 2023-03-03T06:26:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:26:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:26:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.2", 2023-03-03T06:26:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBBkgFk/OK7JxAAQFCaUo0b/+8gDkgP1Ifqwg==", 2023-03-03T06:26:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:26:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:26:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.3", 2023-03-03T06:26:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBEkgFkhcBFJxAA3Q62rulwQRz9/VZeV938sg==", 2023-03-03T06:26:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:26:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:26:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.4", 2023-03-03T06:26:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBKkgFkHSO9KBAATkFiqiMet/gmDP9rNTozLA==", 2023-03-03T06:26:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:26:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:26:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.336 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.5", 2023-03-03T06:26:25.336 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBNkgFkOUmVJxAA4gVwSp2IhnyXKPt+72wXOw==", 2023-03-03T06:26:25.336 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.336 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:26:25.336 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:26:25.336 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.337 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.6", 2023-03-03T06:26:25.337 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBQkgFkBHsSJxAA0kN0Sob1BvksDKPj4e/yTA==", 2023-03-03T06:26:25.337 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.337 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:26:25.337 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:26:25.338 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.338 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.338 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "osd.7", 2023-03-03T06:26:25.338 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQBTkgFkusR5JhAAsvEY2m5hImRjdFSqtEFVBw==", 2023-03-03T06:26:25.338 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.338 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow profile osd", 2023-03-03T06:26:25.339 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile osd", 2023-03-03T06:26:25.339 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.339 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.339 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.0", 2023-03-03T06:26:25.339 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFkkZyRBhAA/Q44zwMnP6p4QwYJUCk0Ow==", 2023-03-03T06:26:25.340 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.340 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:26:25.340 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow r", 2023-03-03T06:26:25.340 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rw pool=cephfs_data" 2023-03-03T06:26:25.340 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.340 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.1", 2023-03-03T06:26:25.341 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFke8dHDRAA5tXiSg31lHzCfcffU+ycDw==", 2023-03-03T06:26:25.341 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.341 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:26:25.341 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-03-03T06:26:25.341 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-03-03T06:26:25.341 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-03-03T06:26:25.341 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.342 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.2", 2023-03-03T06:26:25.342 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFk6W3zCRAAMk0SzOs1po/kkiSR41EAbA==", 2023-03-03T06:26:25.342 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.342 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:26:25.342 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-03-03T06:26:25.342 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-03-03T06:26:25.342 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-03-03T06:26:25.343 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.343 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.3", 2023-03-03T06:26:25.343 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA6kgFk4NGTEBAAQne/fOUfeZe1sWAZXnJ5Cw==", 2023-03-03T06:26:25.343 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.343 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow", 2023-03-03T06:26:25.343 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow r", 2023-03-03T06:26:25.344 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow rw", 2023-03-03T06:26:25.344 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow rwx" 2023-03-03T06:26:25.344 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.344 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "client.admin", 2023-03-03T06:26:25.344 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkrhMlDBAAIRxVSXIMLiI0L4p+Odt4AA==", 2023-03-03T06:26:25.345 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.345 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-03-03T06:26:25.345 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": "allow *", 2023-03-03T06:26:25.345 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow *", 2023-03-03T06:26:25.345 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.345 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.346 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.x", 2023-03-03T06:26:25.346 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFkRHQbJhAAq2ZAqxUiXeNQLLcfaVvj7g==", 2023-03-03T06:26:25.346 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.346 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-03-03T06:26:25.346 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-03-03T06:26:25.346 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.346 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:25.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:25.347 INFO:teuthology.orchestra.run.smithi005.stdout: "entity": "mgr.y", 2023-03-03T06:26:25.347 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "AQA5kgFktxgZIhAAsvbF/OzJf4OZ7a85LkWKtw==", 2023-03-03T06:26:25.347 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": { 2023-03-03T06:26:25.347 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": "allow *", 2023-03-03T06:26:25.347 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": "allow profile mgr", 2023-03-03T06:26:25.347 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": "allow *" 2023-03-03T06:26:25.347 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.348 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:25.348 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2023-03-03T06:26:25.348 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-03-03T06:26:25.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.324+0000 7f4a6017b700 1 -- 172.21.15.5:0/392427063 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a3c0682f0 msgr2=0x7f4a3c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.324+0000 7f4a6017b700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a3c0682f0 0x7f4a3c06a7a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4a54000c00 tx=0x7f4a5400a000 comp rx=0 tx=0).stop 2023-03-03T06:26:25.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.324+0000 7f4a6017b700 1 -- 172.21.15.5:0/392427063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a44003ff0 msgr2=0x7f4a580c9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.324+0000 7f4a6017b700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a44003ff0 0x7f4a580c9800 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4a48011bb0 tx=0x7f4a48011f70 comp rx=0 tx=0).stop 2023-03-03T06:26:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.325+0000 7f4a6017b700 1 -- 172.21.15.5:0/392427063 shutdown_connections 2023-03-03T06:26:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.325+0000 7f4a6017b700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a580c7770 0x7f4a580c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.325+0000 7f4a6017b700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a44003ff0 0x7f4a580c9800 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.325+0000 7f4a6017b700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f4a3c0682f0 0x7f4a3c06a7a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.325+0000 7f4a6017b700 1 --2- 172.21.15.5:0/392427063 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a580c6290 0x7f4a581eee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.350 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.325+0000 7f4a6017b700 1 -- 172.21.15.5:0/392427063 >> 172.21.15.5:0/392427063 conn(0x7f4a580cc8d0 msgr2=0x7f4a580ccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:25.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.325+0000 7f4a6017b700 1 -- 172.21.15.5:0/392427063 shutdown_connections 2023-03-03T06:26:25.351 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.325+0000 7f4a6017b700 1 -- 172.21.15.5:0/392427063 wait complete. 2023-03-03T06:26:25.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:26:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.475+0000 7f922c1d2700 1 Processor -- start 2023-03-03T06:26:25.476 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.475+0000 7f922c1d2700 1 -- start start 2023-03-03T06:26:25.477 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f922c1d2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f922415fef0 0x7f9224145d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f922c1d2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92241462a0 0x7f92240ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f922c1d2700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f92240ceee0 0x7f9224070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f922c1d2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92240b3490 con 0x7f922415fef0 2023-03-03T06:26:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f922c1d2700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92240cf360 con 0x7f92240ceee0 2023-03-03T06:26:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f922c1d2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92241602c0 con 0x7f92241462a0 2023-03-03T06:26:25.478 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f9229f6e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f922415fef0 0x7f9224145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f9229f6e700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f922415fef0 0x7f9224145d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46290/0 (socket says 172.21.15.5:46290) 2023-03-03T06:26:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f9229f6e700 1 -- 172.21.15.5:0/2051980805 learned_addr learned my addr 172.21.15.5:0/2051980805 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f922976d700 1 --2- 172.21.15.5:0/2051980805 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92241462a0 0x7f92240ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f922a76f700 1 --2- 172.21.15.5:0/2051980805 >> v2:172.21.15.191:3300/0 conn(0x7f92240ceee0 0x7f9224070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f9229f6e700 1 -- 172.21.15.5:0/2051980805 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92241462a0 msgr2=0x7f92240ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f9229f6e700 1 --2- 172.21.15.5:0/2051980805 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92241462a0 0x7f92240ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f9229f6e700 1 -- 172.21.15.5:0/2051980805 >> v2:172.21.15.191:3300/0 conn(0x7f92240ceee0 msgr2=0x7f9224070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f9229f6e700 1 --2- 172.21.15.5:0/2051980805 >> v2:172.21.15.191:3300/0 conn(0x7f92240ceee0 0x7f9224070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f9229f6e700 1 -- 172.21.15.5:0/2051980805 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9224161410 con 0x7f922415fef0 2023-03-03T06:26:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.476+0000 7f922a76f700 1 --2- 172.21.15.5:0/2051980805 >> v2:172.21.15.191:3300/0 conn(0x7f92240ceee0 0x7f9224070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.477+0000 7f9229f6e700 1 --2- 172.21.15.5:0/2051980805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922415fef0 0x7f9224145d60 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f92240c7e30 tx=0x7f9214009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09cb6d71edf9116 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.477+0000 7f9228f6c700 1 -- 172.21.15.5:0/2051980805 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921400b860 con 0x7f922415fef0 2023-03-03T06:26:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.477+0000 7f9228f6c700 1 -- 172.21.15.5:0/2051980805 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921400b9c0 con 0x7f922415fef0 2023-03-03T06:26:25.480 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.477+0000 7f9228f6c700 1 -- 172.21.15.5:0/2051980805 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921400bd50 con 0x7f922415fef0 2023-03-03T06:26:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.477+0000 7f922c1d2700 1 -- 172.21.15.5:0/2051980805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922415fef0 msgr2=0x7f9224145d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.477+0000 7f922c1d2700 1 --2- 172.21.15.5:0/2051980805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922415fef0 0x7f9224145d60 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f92240c7e30 tx=0x7f9214009c00 comp rx=0 tx=0).stop 2023-03-03T06:26:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.477+0000 7f922c1d2700 1 -- 172.21.15.5:0/2051980805 shutdown_connections 2023-03-03T06:26:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.477+0000 7f922c1d2700 1 --2- 172.21.15.5:0/2051980805 >> v2:172.21.15.191:3300/0 conn(0x7f92240ceee0 0x7f9224070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.477+0000 7f922c1d2700 1 --2- 172.21.15.5:0/2051980805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922415fef0 0x7f9224145d60 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.483 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.477+0000 7f922c1d2700 1 --2- 172.21.15.5:0/2051980805 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92241462a0 0x7f92240ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.477+0000 7f922c1d2700 1 -- 172.21.15.5:0/2051980805 >> 172.21.15.5:0/2051980805 conn(0x7f9224070050 msgr2=0x7f92240cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.477+0000 7f922c1d2700 1 -- 172.21.15.5:0/2051980805 shutdown_connections 2023-03-03T06:26:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.477+0000 7f922c1d2700 1 -- 172.21.15.5:0/2051980805 wait complete. 2023-03-03T06:26:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.479+0000 7f922c1d2700 1 Processor -- start 2023-03-03T06:26:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.479+0000 7f922c1d2700 1 -- start start 2023-03-03T06:26:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.479+0000 7f922c1d2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92240ceee0 0x7f9224159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.484 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.479+0000 7f922c1d2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92241462a0 0x7f92241e7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.479+0000 7f922c1d2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922415fef0 0x7f92241e76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.479+0000 7f922c1d2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92241e6590 con 0x7f922415fef0 2023-03-03T06:26:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.479+0000 7f922c1d2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92241e7d20 con 0x7f92240ceee0 2023-03-03T06:26:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.479+0000 7f922c1d2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922415a810 con 0x7f92241462a0 2023-03-03T06:26:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f922a76f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922415fef0 0x7f92241e76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f922a76f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922415fef0 0x7f92241e76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46300/0 (socket says 172.21.15.5:46300) 2023-03-03T06:26:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f922a76f700 1 -- 172.21.15.5:0/4270035240 learned_addr learned my addr 172.21.15.5:0/4270035240 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f9229f6e700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92240ceee0 0x7f9224159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f922976d700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92241462a0 0x7f92241e7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f922a76f700 1 -- 172.21.15.5:0/4270035240 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92241462a0 msgr2=0x7f92241e7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f922a76f700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92241462a0 0x7f92241e7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f922a76f700 1 -- 172.21.15.5:0/4270035240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92240ceee0 msgr2=0x7f9224159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f922a76f700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92240ceee0 0x7f9224159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f922a76f700 1 -- 172.21.15.5:0/4270035240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9214009550 con 0x7f922415fef0 2023-03-03T06:26:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f922a76f700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922415fef0 0x7f92241e76d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f921c00cef0 tx=0x7f921c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f921a7fc700 1 -- 172.21.15.5:0/4270035240 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c00add0 con 0x7f922415fef0 2023-03-03T06:26:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f921a7fc700 1 -- 172.21.15.5:0/4270035240 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c015440 con 0x7f922415fef0 2023-03-03T06:26:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f922c1d2700 1 -- 172.21.15.5:0/4270035240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9224160ae0 con 0x7f922415fef0 2023-03-03T06:26:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f921a7fc700 1 -- 172.21.15.5:0/4270035240 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c0157f0 con 0x7f922415fef0 2023-03-03T06:26:25.487 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.480+0000 7f922c1d2700 1 -- 172.21.15.5:0/4270035240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9224160800 con 0x7f922415fef0 2023-03-03T06:26:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.481+0000 7f922c1d2700 1 -- 172.21.15.5:0/4270035240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9224160dc0 con 0x7f922415fef0 2023-03-03T06:26:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.482+0000 7f921a7fc700 1 -- 172.21.15.5:0/4270035240 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f921c01c030 con 0x7f922415fef0 2023-03-03T06:26:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.482+0000 7f921a7fc700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9208068320 0x7f920806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.482+0000 7f921a7fc700 1 -- 172.21.15.5:0/4270035240 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6593+0+0 (secure 0 0 0) 0x7f921c086250 con 0x7f922415fef0 2023-03-03T06:26:25.488 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.482+0000 7f9229f6e700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9208068320 0x7f920806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.482+0000 7f9229f6e700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9208068320 0x7f920806a7d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9214000c00 tx=0x7f9214008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:25.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.486+0000 7f921a7fc700 1 -- 172.21.15.5:0/4270035240 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f921c052830 con 0x7f922415fef0 2023-03-03T06:26:25.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.680+0000 7f922c1d2700 1 -- 172.21.15.5:0/4270035240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f922404e6e0 con 0x7f922415fef0 2023-03-03T06:26:25.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.681+0000 7f921a7fc700 1 -- 172.21.15.5:0/4270035240 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+19515 (secure 0 0 0) 0x7f921c055e50 con 0x7f922415fef0 2023-03-03T06:26:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:25.682 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:26:24.883356+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_data_pool","create_time":"2023-03-03T06:26:03.629103+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":72,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"test_metadata_pool","create_time":"2023-03-03T06:26:04.826705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:26:25.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.683+0000 7f922c1d2700 1 -- 172.21.15.5:0/4270035240 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9208068320 msgr2=0x7f920806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.683+0000 7f922c1d2700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9208068320 0x7f920806a7d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9214000c00 tx=0x7f9214008030 comp rx=0 tx=0).stop 2023-03-03T06:26:25.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.683+0000 7f922c1d2700 1 -- 172.21.15.5:0/4270035240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922415fef0 msgr2=0x7f92241e76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.683+0000 7f922c1d2700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922415fef0 0x7f92241e76d0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f921c00cef0 tx=0x7f921c00a340 comp rx=0 tx=0).stop 2023-03-03T06:26:25.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.683+0000 7f922c1d2700 1 -- 172.21.15.5:0/4270035240 shutdown_connections 2023-03-03T06:26:25.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.683+0000 7f922c1d2700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f922415fef0 0x7f92241e76d0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.683+0000 7f922c1d2700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f92240ceee0 0x7f9224159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.683+0000 7f922c1d2700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f9208068320 0x7f920806a7d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.683+0000 7f922c1d2700 1 --2- 172.21.15.5:0/4270035240 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f92241462a0 0x7f92241e7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.683+0000 7f922c1d2700 1 -- 172.21.15.5:0/4270035240 >> 172.21.15.5:0/4270035240 conn(0x7f9224070050 msgr2=0x7f9224070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:25.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.683+0000 7f922c1d2700 1 -- 172.21.15.5:0/4270035240 shutdown_connections 2023-03-03T06:26:25.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.683+0000 7f922c1d2700 1 -- 172.21.15.5:0/4270035240 wait complete. 2023-03-03T06:26:25.696 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-03-03T06:23:33.030158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-03-03T06:23:33.516445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'snap-test-pool', 'create_time': '2023-03-03T06:25:02.648527+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 43, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'test_data_pool', 'create_time': '2023-03-03T06:26:03.629103+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 72, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'test_metadata_pool', 'create_time': '2023-03-03T06:26:04.826705+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-03-03T06:26:25.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-03-03T06:26:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.824+0000 7f102609c700 1 Processor -- start 2023-03-03T06:26:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.824+0000 7f102609c700 1 -- start start 2023-03-03T06:26:25.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.825+0000 7f102609c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f102015cd40 0x7f10200b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.825+0000 7f102609c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102015e160 con 0x7f10200cd3e0 2023-03-03T06:26:25.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.825+0000 7f102609c700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1020161540 con 0x7f10200cb9d0 2023-03-03T06:26:25.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.825+0000 7f102609c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10200cd870 con 0x7f102015cd40 2023-03-03T06:26:25.829 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.825+0000 7f101effd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f10200cd3e0 0x7f1020160720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36150/0 (socket says 172.21.15.5:36150) 2023-03-03T06:26:25.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.825+0000 7f101effd700 1 -- 172.21.15.5:0/733141804 learned_addr learned my addr 172.21.15.5:0/733141804 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:25.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.825+0000 7f101f7fe700 1 --2- 172.21.15.5:0/733141804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f102015cd40 0x7f10200b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971968681 0 0) 0x7f102015e160 con 0x7f10200cd3e0 2023-03-03T06:26:25.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10080035b0 con 0x7f10200cd3e0 2023-03-03T06:26:25.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 59865401 0 0) 0x7f10080035b0 con 0x7f10200cd3e0 2023-03-03T06:26:25.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f102015cd40 msgr2=0x7f10200b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:25.830 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 --2- 172.21.15.5:0/733141804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f102015cd40 0x7f10200b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 >> v1:172.21.15.191:6789/0 conn(0x7f10200cb9d0 legacy=0x7f1020160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102015d110 con 0x7f10200cd3e0 2023-03-03T06:26:25.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f1010001670 con 0x7f10200cd3e0 2023-03-03T06:26:25.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 >> v1:172.21.15.5:6789/0 conn(0x7f10200cd3e0 legacy=0x7f1020160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 --2- 172.21.15.5:0/733141804 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1008003a30 0x7f1008003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 --2- 172.21.15.5:0/733141804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f102015cd40 0x7f1008004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.831 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 --2- 172.21.15.5:0/733141804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1008004d90 0x7f1008005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10200cd870 con 0x7f1008004d90 2023-03-03T06:26:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100800bac0 con 0x7f1008003a30 2023-03-03T06:26:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100800bc50 con 0x7f102015cd40 2023-03-03T06:26:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101ffff700 1 --2- 172.21.15.5:0/733141804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1008004d90 0x7f1008005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101f7fe700 1 --2- 172.21.15.5:0/733141804 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1008003a30 0x7f1008003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101effd700 1 --2- 172.21.15.5:0/733141804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f102015cd40 0x7f1008004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.832 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101ffff700 1 -- 172.21.15.5:0/733141804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f102015cd40 msgr2=0x7f1008004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101ffff700 1 --2- 172.21.15.5:0/733141804 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f102015cd40 0x7f1008004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101ffff700 1 -- 172.21.15.5:0/733141804 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1008003a30 msgr2=0x7f1008003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101ffff700 1 --2- 172.21.15.5:0/733141804 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1008003a30 0x7f1008003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.826+0000 7f101ffff700 1 -- 172.21.15.5:0/733141804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080035b0 con 0x7f1008004d90 2023-03-03T06:26:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.827+0000 7f101ffff700 1 --2- 172.21.15.5:0/733141804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1008004d90 0x7f1008005200 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f101800c290 tx=0x7f1008005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94b289b0584dfa7 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.827+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018001e70 con 0x7f1008004d90 2023-03-03T06:26:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.827+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101800ce50 con 0x7f1008004d90 2023-03-03T06:26:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.827+0000 7f101e7fc700 1 -- 172.21.15.5:0/733141804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018012660 con 0x7f1008004d90 2023-03-03T06:26:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.827+0000 7f102609c700 1 -- 172.21.15.5:0/733141804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1008004d90 msgr2=0x7f1008005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.827+0000 7f102609c700 1 --2- 172.21.15.5:0/733141804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1008004d90 0x7f1008005200 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f101800c290 tx=0x7f1008005880 comp rx=0 tx=0).stop 2023-03-03T06:26:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.827+0000 7f101ffff700 1 -- 172.21.15.5:0/733141804 reap_dead start 2023-03-03T06:26:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.827+0000 7f102609c700 1 -- 172.21.15.5:0/733141804 shutdown_connections 2023-03-03T06:26:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.827+0000 7f102609c700 1 -- 172.21.15.5:0/733141804 >> 172.21.15.5:0/733141804 conn(0x7f10200cc8d0 msgr2=0x7f10200cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.827+0000 7f102609c700 1 -- 172.21.15.5:0/733141804 shutdown_connections 2023-03-03T06:26:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.827+0000 7f102609c700 1 -- 172.21.15.5:0/733141804 wait complete. 2023-03-03T06:26:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.829+0000 7f102609c700 1 Processor -- start 2023-03-03T06:26:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.829+0000 7f102609c700 1 -- start start 2023-03-03T06:26:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.830+0000 7f102609c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1008004d90 0x7f10201f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.830+0000 7f102609c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10201f32c0 0x7f10200c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.830+0000 7f102609c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10200c6090 0x7f10200b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.830+0000 7f102609c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10200c6530 con 0x7f10201f32c0 2023-03-03T06:26:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.830+0000 7f102609c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102015f0c0 con 0x7f1008004d90 2023-03-03T06:26:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.830+0000 7f102609c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102015f3a0 con 0x7f10200c6090 2023-03-03T06:26:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.830+0000 7f101effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10201f32c0 0x7f10200c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.830+0000 7f101effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10201f32c0 0x7f10200c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46318/0 (socket says 172.21.15.5:46318) 2023-03-03T06:26:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.830+0000 7f101effd700 1 -- 172.21.15.5:0/1009348841 learned_addr learned my addr 172.21.15.5:0/1009348841 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.830+0000 7f101f7fe700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1008004d90 0x7f10201f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.830+0000 7f101ffff700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10200c6090 0x7f10200b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.830+0000 7f101effd700 1 -- 172.21.15.5:0/1009348841 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10200c6090 msgr2=0x7f10200b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.831+0000 7f101effd700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10200c6090 0x7f10200b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.831+0000 7f101effd700 1 -- 172.21.15.5:0/1009348841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1008004d90 msgr2=0x7f10201f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.831+0000 7f101effd700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1008004d90 0x7f10201f2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.831+0000 7f101effd700 1 -- 172.21.15.5:0/1009348841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102015d6a0 con 0x7f10201f32c0 2023-03-03T06:26:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.831+0000 7f101ffff700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10200c6090 0x7f10200b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.831+0000 7f101f7fe700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1008004d90 0x7f10201f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.831+0000 7f101effd700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10201f32c0 0x7f10200c5b50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f10100017a0 tx=0x7f1010007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.831+0000 7f1007fff700 1 -- 172.21.15.5:0/1009348841 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101000f6c0 con 0x7f10201f32c0 2023-03-03T06:26:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.831+0000 7f1007fff700 1 -- 172.21.15.5:0/1009348841 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101000f840 con 0x7f10201f32c0 2023-03-03T06:26:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.831+0000 7f1007fff700 1 -- 172.21.15.5:0/1009348841 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101000fbf0 con 0x7f10201f32c0 2023-03-03T06:26:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.831+0000 7f102609c700 1 -- 172.21.15.5:0/1009348841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102015d3c0 con 0x7f10201f32c0 2023-03-03T06:26:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.831+0000 7f102609c700 1 -- 172.21.15.5:0/1009348841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102015d980 con 0x7f10201f32c0 2023-03-03T06:26:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.832+0000 7f102609c700 1 -- 172.21.15.5:0/1009348841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f102015f200 con 0x7f10201f32c0 2023-03-03T06:26:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.832+0000 7f1007fff700 1 -- 172.21.15.5:0/1009348841 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f101000fd50 con 0x7f10201f32c0 2023-03-03T06:26:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.833+0000 7f1007fff700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f100c0682f0 0x7f100c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.833+0000 7f101f7fe700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f100c0682f0 0x7f100c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.833+0000 7f1007fff700 1 -- 172.21.15.5:0/1009348841 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6593+0+0 (secure 0 0 0) 0x7f1010086030 con 0x7f10201f32c0 2023-03-03T06:26:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.833+0000 7f101f7fe700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f100c0682f0 0x7f100c06a7a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1014009c60 tx=0x7f1014008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:25.837+0000 7f1007fff700 1 -- 172.21.15.5:0/1009348841 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f102015f200 con 0x7f10201f32c0 2023-03-03T06:26:26.032 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.031+0000 7f102609c700 1 -- 172.21.15.5:0/1009348841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f102015f200 con 0x7f10201f32c0 2023-03-03T06:26:26.033 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.032+0000 7f1007fff700 1 -- 172.21.15.5:0/1009348841 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v81) v1 ==== 92+0+10 (secure 0 0 0) 0x7f102015f200 con 0x7f10201f32c0 2023-03-03T06:26:26.033 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 8 2023-03-03T06:26:26.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.034+0000 7f102609c700 1 -- 172.21.15.5:0/1009348841 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f100c0682f0 msgr2=0x7f100c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.034+0000 7f102609c700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f100c0682f0 0x7f100c06a7a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1014009c60 tx=0x7f1014008040 comp rx=0 tx=0).stop 2023-03-03T06:26:26.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.034+0000 7f102609c700 1 -- 172.21.15.5:0/1009348841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10201f32c0 msgr2=0x7f10200c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.035 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.034+0000 7f102609c700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10201f32c0 0x7f10200c5b50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f10100017a0 tx=0x7f1010007620 comp rx=0 tx=0).stop 2023-03-03T06:26:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.034+0000 7f102609c700 1 -- 172.21.15.5:0/1009348841 shutdown_connections 2023-03-03T06:26:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.034+0000 7f102609c700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f100c0682f0 0x7f100c06a7a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.034+0000 7f102609c700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10200c6090 0x7f10200b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.034+0000 7f102609c700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1008004d90 0x7f10201f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.034+0000 7f102609c700 1 --2- 172.21.15.5:0/1009348841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10201f32c0 0x7f10200c5b50 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.034+0000 7f102609c700 1 -- 172.21.15.5:0/1009348841 >> 172.21.15.5:0/1009348841 conn(0x7f10200cc8d0 msgr2=0x7f10200c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:26.036 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.034+0000 7f102609c700 1 -- 172.21.15.5:0/1009348841 shutdown_connections 2023-03-03T06:26:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.034+0000 7f102609c700 1 -- 172.21.15.5:0/1009348841 wait complete. 2023-03-03T06:26:26.047 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-03-03T06:26:26.174 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.173+0000 7f38e3e2c700 1 Processor -- start 2023-03-03T06:26:26.175 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.173+0000 7f38e3e2c700 1 -- start start 2023-03-03T06:26:26.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.174+0000 7f38e3e2c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38dc0b55b0 0x7f38dc15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.174+0000 7f38e3e2c700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f38dc0cd500 0x7f38dc0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.174+0000 7f38e3e2c700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38dc0cc5d0 con 0x7f38dc0b1e10 2023-03-03T06:26:26.176 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.174+0000 7f38e3e2c700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc15e290 con 0x7f38dc0cd500 2023-03-03T06:26:26.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.174+0000 7f38e3e2c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0b2290 con 0x7f38dc0b55b0 2023-03-03T06:26:26.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.174+0000 7f38e23c9700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f38dc0b1e10 0x7f38dc06bcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36170/0 (socket says 172.21.15.5:36170) 2023-03-03T06:26:26.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.174+0000 7f38e23c9700 1 -- 172.21.15.5:0/241235830 learned_addr learned my addr 172.21.15.5:0/241235830 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:26.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.175+0000 7f38e1bc8700 1 --2- 172.21.15.5:0/241235830 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38dc0b55b0 0x7f38dc15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.175+0000 7f38e13c7700 1 --2- 172.21.15.5:0/241235830 >> v2:172.21.15.191:3300/0 conn(0x7f38dc0cd500 0x7f38dc0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.175+0000 7f38e0bc6700 1 -- 172.21.15.5:0/241235830 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221342299 0 0) 0x7f38dc0cc5d0 con 0x7f38dc0b1e10 2023-03-03T06:26:26.177 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.175+0000 7f38e0bc6700 1 -- 172.21.15.5:0/241235830 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38c80035b0 con 0x7f38dc0b1e10 2023-03-03T06:26:26.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.175+0000 7f38e1bc8700 1 -- 172.21.15.5:0/241235830 >> v2:172.21.15.191:3300/0 conn(0x7f38dc0cd500 msgr2=0x7f38dc0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:26.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.175+0000 7f38e1bc8700 1 --2- 172.21.15.5:0/241235830 >> v2:172.21.15.191:3300/0 conn(0x7f38dc0cd500 0x7f38dc0b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.175+0000 7f38e1bc8700 1 -- 172.21.15.5:0/241235830 >> v1:172.21.15.5:6789/0 conn(0x7f38dc0b1e10 legacy=0x7f38dc06bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.175+0000 7f38e1bc8700 1 -- 172.21.15.5:0/241235830 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc159c30 con 0x7f38dc0b55b0 2023-03-03T06:26:26.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.175+0000 7f38e1bc8700 1 --2- 172.21.15.5:0/241235830 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38dc0b55b0 0x7f38dc15dd50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009840 tx=0x7f38cc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8d0d31da868dff9 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:26.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.175+0000 7f38e0bc6700 1 -- 172.21.15.5:0/241235830 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc011830 con 0x7f38dc0b55b0 2023-03-03T06:26:26.178 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.175+0000 7f38e0bc6700 1 -- 172.21.15.5:0/241235830 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc011990 con 0x7f38dc0b55b0 2023-03-03T06:26:26.179 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.175+0000 7f38e0bc6700 1 -- 172.21.15.5:0/241235830 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc011d00 con 0x7f38dc0b55b0 2023-03-03T06:26:26.180 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.176+0000 7f38e3e2c700 1 -- 172.21.15.5:0/241235830 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38dc0b55b0 msgr2=0x7f38dc15dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.176+0000 7f38e3e2c700 1 --2- 172.21.15.5:0/241235830 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38dc0b55b0 0x7f38dc15dd50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009840 tx=0x7f38cc009b50 comp rx=0 tx=0).stop 2023-03-03T06:26:26.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.176+0000 7f38e3e2c700 1 -- 172.21.15.5:0/241235830 shutdown_connections 2023-03-03T06:26:26.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.176+0000 7f38e3e2c700 1 --2- 172.21.15.5:0/241235830 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38dc0b55b0 0x7f38dc15dd50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.176+0000 7f38e3e2c700 1 --2- 172.21.15.5:0/241235830 >> v2:172.21.15.191:3300/0 conn(0x7f38dc0cd500 0x7f38dc0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.176+0000 7f38e3e2c700 1 -- 172.21.15.5:0/241235830 >> 172.21.15.5:0/241235830 conn(0x7f38dc0cc8d0 msgr2=0x7f38dc0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:26.181 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.176+0000 7f38e3e2c700 1 -- 172.21.15.5:0/241235830 shutdown_connections 2023-03-03T06:26:26.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.176+0000 7f38e3e2c700 1 -- 172.21.15.5:0/241235830 wait complete. 2023-03-03T06:26:26.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.177+0000 7f38e3e2c700 1 Processor -- start 2023-03-03T06:26:26.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.177+0000 7f38e3e2c700 1 -- start start 2023-03-03T06:26:26.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e3e2c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc0b1e10 0x7f38dc0c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e3e2c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38dc0b55b0 0x7f38dc14dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e3e2c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38dc0cd500 0x7f38dc06b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e3e2c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0c7500 con 0x7f38dc0b1e10 2023-03-03T06:26:26.182 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e3e2c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0c77e0 con 0x7f38dc0b55b0 2023-03-03T06:26:26.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e3e2c700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0c7ac0 con 0x7f38dc0cd500 2023-03-03T06:26:26.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e1bc8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc0b1e10 0x7f38dc0c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e1bc8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc0b1e10 0x7f38dc0c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46330/0 (socket says 172.21.15.5:46330) 2023-03-03T06:26:26.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e1bc8700 1 -- 172.21.15.5:0/636795350 learned_addr learned my addr 172.21.15.5:0/636795350 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:26.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e23c9700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38dc0cd500 0x7f38dc06b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e13c7700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38dc0b55b0 0x7f38dc14dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e1bc8700 1 -- 172.21.15.5:0/636795350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38dc0cd500 msgr2=0x7f38dc06b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.183 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e1bc8700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38dc0cd500 0x7f38dc06b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e1bc8700 1 -- 172.21.15.5:0/636795350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38dc0b55b0 msgr2=0x7f38dc14dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e1bc8700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38dc0b55b0 0x7f38dc14dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e1bc8700 1 -- 172.21.15.5:0/636795350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc0094a0 con 0x7f38dc0b1e10 2023-03-03T06:26:26.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.178+0000 7f38e1bc8700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc0b1e10 0x7f38dc0c6f20 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f38cc000c00 tx=0x7f38cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:26.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.179+0000 7f38d27fc700 1 -- 172.21.15.5:0/636795350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0036a0 con 0x7f38dc0b1e10 2023-03-03T06:26:26.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.179+0000 7f38d27fc700 1 -- 172.21.15.5:0/636795350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc01f070 con 0x7f38dc0b1e10 2023-03-03T06:26:26.184 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.179+0000 7f38e3e2c700 1 -- 172.21.15.5:0/636795350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38dc0cb9c0 con 0x7f38dc0b1e10 2023-03-03T06:26:26.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.179+0000 7f38d27fc700 1 -- 172.21.15.5:0/636795350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc003a00 con 0x7f38dc0b1e10 2023-03-03T06:26:26.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.179+0000 7f38e3e2c700 1 -- 172.21.15.5:0/636795350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc0b5980 con 0x7f38dc0b1e10 2023-03-03T06:26:26.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.180+0000 7f38e3e2c700 1 -- 172.21.15.5:0/636795350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc0cbca0 con 0x7f38dc0b1e10 2023-03-03T06:26:26.185 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.180+0000 7f38d27fc700 1 -- 172.21.15.5:0/636795350 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f38cc00f050 con 0x7f38dc0b1e10 2023-03-03T06:26:26.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.181+0000 7f38d27fc700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38c00682f0 0x7f38c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.181+0000 7f38e13c7700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38c00682f0 0x7f38c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.181+0000 7f38d27fc700 1 -- 172.21.15.5:0/636795350 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6593+0+0 (secure 0 0 0) 0x7f38cc021070 con 0x7f38dc0b1e10 2023-03-03T06:26:26.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.181+0000 7f38e13c7700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38c00682f0 0x7f38c006a7a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009ab0 tx=0x7f38d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:26.186 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.185+0000 7f38d27fc700 1 -- 172.21.15.5:0/636795350 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f38cc053d60 con 0x7f38dc0b1e10 2023-03-03T06:26:26.377 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.376+0000 7f38e3e2c700 1 -- 172.21.15.5:0/636795350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38dc04e6e0 con 0x7f38dc0b1e10 2023-03-03T06:26:26.378 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.377+0000 7f38d27fc700 1 -- 172.21.15.5:0/636795350 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38cc057380 con 0x7f38dc0b1e10 2023-03-03T06:26:26.378 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2023-03-03T06:26:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.379+0000 7f38e3e2c700 1 -- 172.21.15.5:0/636795350 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38c00682f0 msgr2=0x7f38c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.379+0000 7f38e3e2c700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38c00682f0 0x7f38c006a7a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009ab0 tx=0x7f38d8008040 comp rx=0 tx=0).stop 2023-03-03T06:26:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.379+0000 7f38e3e2c700 1 -- 172.21.15.5:0/636795350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc0b1e10 msgr2=0x7f38dc0c6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.379+0000 7f38e3e2c700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc0b1e10 0x7f38dc0c6f20 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f38cc000c00 tx=0x7f38cc004750 comp rx=0 tx=0).stop 2023-03-03T06:26:26.380 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.379+0000 7f38e3e2c700 1 -- 172.21.15.5:0/636795350 shutdown_connections 2023-03-03T06:26:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.379+0000 7f38e3e2c700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38c00682f0 0x7f38c006a7a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.379+0000 7f38e3e2c700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f38dc0cd500 0x7f38dc06b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.379+0000 7f38e3e2c700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38dc0b1e10 0x7f38dc0c6f20 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.379+0000 7f38e3e2c700 1 --2- 172.21.15.5:0/636795350 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38dc0b55b0 0x7f38dc14dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.379+0000 7f38e3e2c700 1 -- 172.21.15.5:0/636795350 >> 172.21.15.5:0/636795350 conn(0x7f38dc0cc8d0 msgr2=0x7f38dc0cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.379+0000 7f38e3e2c700 1 -- 172.21.15.5:0/636795350 shutdown_connections 2023-03-03T06:26:26.381 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.379+0000 7f38e3e2c700 1 -- 172.21.15.5:0/636795350 wait complete. 2023-03-03T06:26:26.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-03-03T06:26:26.519 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.518+0000 7fb445267700 1 Processor -- start 2023-03-03T06:26:26.520 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.518+0000 7fb445267700 1 -- start start 2023-03-03T06:26:26.521 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.519+0000 7fb445267700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb4400b55b0 0x7fb44015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.519+0000 7fb445267700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4400b1fe0 0x7fb4400cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.519+0000 7fb445267700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4400cc5d0 con 0x7fb4400cd500 2023-03-03T06:26:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.519+0000 7fb445267700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44015e290 con 0x7fb4400b1fe0 2023-03-03T06:26:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.519+0000 7fb445267700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb440159c30 con 0x7fb4400b55b0 2023-03-03T06:26:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.519+0000 7fb43f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4400b1fe0 0x7fb4400cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.522 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.519+0000 7fb43f7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fb4400b1fe0 0x7fb4400cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46342/0 (socket says 172.21.15.5:46342) 2023-03-03T06:26:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.519+0000 7fb43f7fe700 1 -- 172.21.15.5:0/1569081837 learned_addr learned my addr 172.21.15.5:0/1569081837 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.520+0000 7fb43effd700 1 --2- 172.21.15.5:0/1569081837 >> v2:172.21.15.191:3300/0 conn(0x7fb4400b55b0 0x7fb44015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.520+0000 7fb43f7fe700 1 -- 172.21.15.5:0/1569081837 >> v2:172.21.15.191:3300/0 conn(0x7fb4400b55b0 msgr2=0x7fb44015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.520+0000 7fb43f7fe700 1 --2- 172.21.15.5:0/1569081837 >> v2:172.21.15.191:3300/0 conn(0x7fb4400b55b0 0x7fb44015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.520+0000 7fb43f7fe700 1 -- 172.21.15.5:0/1569081837 >> v1:172.21.15.191:6789/0 conn(0x7fb4400cd500 legacy=0x7fb4400b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.520+0000 7fb43f7fe700 1 -- 172.21.15.5:0/1569081837 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4400b5980 con 0x7fb4400b1fe0 2023-03-03T06:26:26.523 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.520+0000 7fb43f7fe700 1 --2- 172.21.15.5:0/1569081837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4400b1fe0 0x7fb4400cdf90 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb440068620 tx=0x7fb43800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38a1ca6d29926c0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.520+0000 7fb43dffb700 1 -- 172.21.15.5:0/1569081837 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43800e070 con 0x7fb4400b1fe0 2023-03-03T06:26:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.520+0000 7fb43dffb700 1 -- 172.21.15.5:0/1569081837 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43800b910 con 0x7fb4400b1fe0 2023-03-03T06:26:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.520+0000 7fb43dffb700 1 -- 172.21.15.5:0/1569081837 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43800bcc0 con 0x7fb4400b1fe0 2023-03-03T06:26:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.521+0000 7fb445267700 1 -- 172.21.15.5:0/1569081837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4400b1fe0 msgr2=0x7fb4400cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.521+0000 7fb445267700 1 --2- 172.21.15.5:0/1569081837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4400b1fe0 0x7fb4400cdf90 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb440068620 tx=0x7fb43800b330 comp rx=0 tx=0).stop 2023-03-03T06:26:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.521+0000 7fb445267700 1 -- 172.21.15.5:0/1569081837 shutdown_connections 2023-03-03T06:26:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.521+0000 7fb445267700 1 --2- 172.21.15.5:0/1569081837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4400b1fe0 0x7fb4400cdf90 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.524 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.521+0000 7fb445267700 1 --2- 172.21.15.5:0/1569081837 >> v2:172.21.15.191:3300/0 conn(0x7fb4400b55b0 0x7fb44015dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.521+0000 7fb445267700 1 -- 172.21.15.5:0/1569081837 >> 172.21.15.5:0/1569081837 conn(0x7fb4400cc8d0 msgr2=0x7fb4400cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.521+0000 7fb445267700 1 -- 172.21.15.5:0/1569081837 shutdown_connections 2023-03-03T06:26:26.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.521+0000 7fb445267700 1 -- 172.21.15.5:0/1569081837 wait complete. 2023-03-03T06:26:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.522+0000 7fb445267700 1 Processor -- start 2023-03-03T06:26:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.522+0000 7fb445267700 1 -- start start 2023-03-03T06:26:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.523+0000 7fb445267700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4400b1fe0 0x7fb4401f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.527 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.523+0000 7fb445267700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4400b55b0 0x7fb440142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.523+0000 7fb445267700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4400cd500 0x7fb4400c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.523+0000 7fb445267700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb440143300 con 0x7fb4400b55b0 2023-03-03T06:26:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.523+0000 7fb445267700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44015bdf0 con 0x7fb4400b1fe0 2023-03-03T06:26:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.523+0000 7fb445267700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb440142a60 con 0x7fb4400cd500 2023-03-03T06:26:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb43e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4400b55b0 0x7fb440142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb43e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4400b55b0 0x7fb440142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46346/0 (socket says 172.21.15.5:46346) 2023-03-03T06:26:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb43e7fc700 1 -- 172.21.15.5:0/3190192110 learned_addr learned my addr 172.21.15.5:0/3190192110 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:26.528 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb43effd700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4400b1fe0 0x7fb4401f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb43f7fe700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4400cd500 0x7fb4400c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb43e7fc700 1 -- 172.21.15.5:0/3190192110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4400cd500 msgr2=0x7fb4400c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb43e7fc700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4400cd500 0x7fb4400c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb43e7fc700 1 -- 172.21.15.5:0/3190192110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4400b1fe0 msgr2=0x7fb4401f3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb43e7fc700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4400b1fe0 0x7fb4401f3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb43e7fc700 1 -- 172.21.15.5:0/3190192110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438009b30 con 0x7fb4400b55b0 2023-03-03T06:26:26.529 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb43effd700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4400b1fe0 0x7fb4401f3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb43e7fc700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4400b55b0 0x7fb440142380 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb43000c450 tx=0x7fb43000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb4277fe700 1 -- 172.21.15.5:0/3190192110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4300052d0 con 0x7fb4400b55b0 2023-03-03T06:26:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb4277fe700 1 -- 172.21.15.5:0/3190192110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb430005430 con 0x7fb4400b55b0 2023-03-03T06:26:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb445267700 1 -- 172.21.15.5:0/3190192110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4400cbca0 con 0x7fb4400b55b0 2023-03-03T06:26:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb4277fe700 1 -- 172.21.15.5:0/3190192110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4300038c0 con 0x7fb4400b55b0 2023-03-03T06:26:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.524+0000 7fb445267700 1 -- 172.21.15.5:0/3190192110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4400cb9c0 con 0x7fb4400b55b0 2023-03-03T06:26:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.525+0000 7fb445267700 1 -- 172.21.15.5:0/3190192110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4400cbf80 con 0x7fb4400b55b0 2023-03-03T06:26:26.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.526+0000 7fb4277fe700 1 -- 172.21.15.5:0/3190192110 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb430019030 con 0x7fb4400b55b0 2023-03-03T06:26:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.526+0000 7fb4277fe700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb42c0682f0 0x7fb42c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.526+0000 7fb4277fe700 1 -- 172.21.15.5:0/3190192110 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6593+0+0 (secure 0 0 0) 0x7fb4300850a0 con 0x7fb4400b55b0 2023-03-03T06:26:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.526+0000 7fb43effd700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb42c0682f0 0x7fb42c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.527+0000 7fb43effd700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb42c0682f0 0x7fb42c06a7a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb434009b60 tx=0x7fb434008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:26.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.530+0000 7fb4277fe700 1 -- 172.21.15.5:0/3190192110 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb4300516e0 con 0x7fb4400b55b0 2023-03-03T06:26:26.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.722+0000 7fb445267700 1 -- 172.21.15.5:0/3190192110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fb44004e6e0 con 0x7fb4400b55b0 2023-03-03T06:26:26.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.723+0000 7fb4277fe700 1 -- 172.21.15.5:0/3190192110 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v81) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb430054d00 con 0x7fb4400b55b0 2023-03-03T06:26:26.724 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:26:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.724+0000 7fb445267700 1 -- 172.21.15.5:0/3190192110 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb42c0682f0 msgr2=0x7fb42c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.724+0000 7fb445267700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb42c0682f0 0x7fb42c06a7a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb434009b60 tx=0x7fb434008040 comp rx=0 tx=0).stop 2023-03-03T06:26:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.724+0000 7fb445267700 1 -- 172.21.15.5:0/3190192110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4400b55b0 msgr2=0x7fb440142380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.724+0000 7fb445267700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4400b55b0 0x7fb440142380 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb43000c450 tx=0x7fb43000c810 comp rx=0 tx=0).stop 2023-03-03T06:26:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.725+0000 7fb445267700 1 -- 172.21.15.5:0/3190192110 shutdown_connections 2023-03-03T06:26:26.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.725+0000 7fb445267700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fb42c0682f0 0x7fb42c06a7a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.725+0000 7fb445267700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4400cd500 0x7fb4400c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.725+0000 7fb445267700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4400b1fe0 0x7fb4401f3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.725+0000 7fb445267700 1 --2- 172.21.15.5:0/3190192110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4400b55b0 0x7fb440142380 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.725+0000 7fb445267700 1 -- 172.21.15.5:0/3190192110 >> 172.21.15.5:0/3190192110 conn(0x7fb4400cc8d0 msgr2=0x7fb4400b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:26.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.725+0000 7fb445267700 1 -- 172.21.15.5:0/3190192110 shutdown_connections 2023-03-03T06:26:26.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.725+0000 7fb445267700 1 -- 172.21.15.5:0/3190192110 wait complete. 2023-03-03T06:26:26.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-03-03T06:26:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.865+0000 7fc3a7ce3700 1 Processor -- start 2023-03-03T06:26:26.866 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.865+0000 7fc3a7ce3700 1 -- start start 2023-03-03T06:26:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.865+0000 7fc3a7ce3700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3a015a7b0 0x7fc3a015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.865+0000 7fc3a7ce3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3a00cde30 0x7fc3a00cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a7ce3700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a00cf5c0 con 0x7fc3a006b700 2023-03-03T06:26:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a7ce3700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a00cf8a0 con 0x7fc3a015a7b0 2023-03-03T06:26:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a7ce3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a00cfb80 con 0x7fc3a00cde30 2023-03-03T06:26:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a5a7f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3a015a7b0 0x7fc3a015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a5a7f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3a015a7b0 0x7fc3a015ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46352/0 (socket says 172.21.15.5:46352) 2023-03-03T06:26:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a6280700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc3a006b700 0x7fc3a00b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36198/0 (socket says 172.21.15.5:36198) 2023-03-03T06:26:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a5a7f700 1 -- 172.21.15.5:0/3727340898 learned_addr learned my addr 172.21.15.5:0/3727340898 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a527e700 1 --2- 172.21.15.5:0/3727340898 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3a00cde30 0x7fc3a00cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a5a7f700 1 -- 172.21.15.5:0/3727340898 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3a00cde30 msgr2=0x7fc3a00cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:26.869 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a5a7f700 1 --2- 172.21.15.5:0/3727340898 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3a00cde30 0x7fc3a00cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a5a7f700 1 -- 172.21.15.5:0/3727340898 >> v1:172.21.15.5:6789/0 conn(0x7fc3a006b700 legacy=0x7fc3a00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a5a7f700 1 -- 172.21.15.5:0/3727340898 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a00b2d40 con 0x7fc3a015a7b0 2023-03-03T06:26:26.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a4a7d700 1 -- 172.21.15.5:0/3727340898 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258678707 0 0) 0x7fc3a00cf5c0 con 0x7fc3a006b700 2023-03-03T06:26:26.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a5a7f700 1 --2- 172.21.15.5:0/3727340898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3a015a7b0 0x7fc3a015ab80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc3900098f0 tx=0x7fc390009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5555ef37a46c3ab server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:26.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a4a7d700 1 -- 172.21.15.5:0/3727340898 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39000b8a0 con 0x7fc3a015a7b0 2023-03-03T06:26:26.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a4a7d700 1 -- 172.21.15.5:0/3727340898 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39000ba00 con 0x7fc3a015a7b0 2023-03-03T06:26:26.870 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.866+0000 7fc3a4a7d700 1 -- 172.21.15.5:0/3727340898 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39000bd90 con 0x7fc3a015a7b0 2023-03-03T06:26:26.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.867+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/3727340898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3a015a7b0 msgr2=0x7fc3a015ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.867+0000 7fc3a7ce3700 1 --2- 172.21.15.5:0/3727340898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3a015a7b0 0x7fc3a015ab80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc3900098f0 tx=0x7fc390009c00 comp rx=0 tx=0).stop 2023-03-03T06:26:26.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.867+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/3727340898 shutdown_connections 2023-03-03T06:26:26.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.867+0000 7fc3a7ce3700 1 --2- 172.21.15.5:0/3727340898 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3a015a7b0 0x7fc3a015ab80 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.867+0000 7fc3a7ce3700 1 --2- 172.21.15.5:0/3727340898 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3a00cde30 0x7fc3a00cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.867+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/3727340898 >> 172.21.15.5:0/3727340898 conn(0x7fc3a00cc8d0 msgr2=0x7fc3a00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:26.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.867+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/3727340898 shutdown_connections 2023-03-03T06:26:26.871 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.867+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/3727340898 wait complete. 2023-03-03T06:26:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.869+0000 7fc3a7ce3700 1 Processor -- start 2023-03-03T06:26:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.869+0000 7fc3a7ce3700 1 -- start start 2023-03-03T06:26:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a7ce3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3a006b700 0x7fc3a00c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a7ce3700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3a00cde30 0x7fc3a015c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a7ce3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3a015a7b0 0x7fc3a0158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a7ce3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a01f1040 con 0x7fc3a015a7b0 2023-03-03T06:26:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a7ce3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a015c430 con 0x7fc3a006b700 2023-03-03T06:26:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a7ce3700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a00ca310 con 0x7fc3a00cde30 2023-03-03T06:26:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a6280700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3a015a7b0 0x7fc3a0158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a6280700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3a015a7b0 0x7fc3a0158d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46362/0 (socket says 172.21.15.5:46362) 2023-03-03T06:26:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a6280700 1 -- 172.21.15.5:0/4026053444 learned_addr learned my addr 172.21.15.5:0/4026053444 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a5a7f700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3a006b700 0x7fc3a00c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a527e700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3a00cde30 0x7fc3a015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.875 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a6280700 1 -- 172.21.15.5:0/4026053444 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3a00cde30 msgr2=0x7fc3a015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a6280700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3a00cde30 0x7fc3a015c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a6280700 1 -- 172.21.15.5:0/4026053444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3a006b700 msgr2=0x7fc3a00c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a6280700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3a006b700 0x7fc3a00c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a6280700 1 -- 172.21.15.5:0/4026053444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc390009550 con 0x7fc3a015a7b0 2023-03-03T06:26:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a5a7f700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3a006b700 0x7fc3a00c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a6280700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3a015a7b0 0x7fc3a0158d70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc39800cc70 tx=0x7fc39800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:26.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3967fc700 1 -- 172.21.15.5:0/4026053444 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39800ada0 con 0x7fc3a015a7b0 2023-03-03T06:26:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3967fc700 1 -- 172.21.15.5:0/4026053444 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39800ce70 con 0x7fc3a015a7b0 2023-03-03T06:26:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/4026053444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a00cf1b0 con 0x7fc3a015a7b0 2023-03-03T06:26:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3967fc700 1 -- 172.21.15.5:0/4026053444 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980072f0 con 0x7fc3a015a7b0 2023-03-03T06:26:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.870+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/4026053444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a00b3020 con 0x7fc3a015a7b0 2023-03-03T06:26:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.871+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/4026053444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a00cf340 con 0x7fc3a015a7b0 2023-03-03T06:26:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.872+0000 7fc3967fc700 1 -- 172.21.15.5:0/4026053444 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc39801a030 con 0x7fc3a015a7b0 2023-03-03T06:26:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.872+0000 7fc3967fc700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc3840682f0 0x7fc38406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:26.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.872+0000 7fc3967fc700 1 -- 172.21.15.5:0/4026053444 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6593+0+0 (secure 0 0 0) 0x7fc398085c20 con 0x7fc3a015a7b0 2023-03-03T06:26:26.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.872+0000 7fc3a5a7f700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc3840682f0 0x7fc38406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:26.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.873+0000 7fc3a5a7f700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc3840682f0 0x7fc38406a7a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc390000c00 tx=0x7fc390008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:26.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:26.876+0000 7fc3967fc700 1 -- 172.21.15.5:0/4026053444 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc398052260 con 0x7fc3a015a7b0 2023-03-03T06:26:27.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.069+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/4026053444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fc3a015c570 con 0x7fc3a015a7b0 2023-03-03T06:26:27.070 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.069+0000 7fc3967fc700 1 -- 172.21.15.5:0/4026053444 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v81) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc3980180a0 con 0x7fc3a015a7b0 2023-03-03T06:26:27.071 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:26:27.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.071+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/4026053444 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc3840682f0 msgr2=0x7fc38406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.072 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.071+0000 7fc3a7ce3700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc3840682f0 0x7fc38406a7a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc390000c00 tx=0x7fc390008030 comp rx=0 tx=0).stop 2023-03-03T06:26:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.071+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/4026053444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3a015a7b0 msgr2=0x7fc3a0158d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.071+0000 7fc3a7ce3700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3a015a7b0 0x7fc3a0158d70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc39800cc70 tx=0x7fc39800a340 comp rx=0 tx=0).stop 2023-03-03T06:26:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.071+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/4026053444 shutdown_connections 2023-03-03T06:26:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.071+0000 7fc3a7ce3700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3a015a7b0 0x7fc3a0158d70 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.071+0000 7fc3a7ce3700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3a006b700 0x7fc3a00c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.071+0000 7fc3a7ce3700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc3840682f0 0x7fc38406a7a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.071+0000 7fc3a7ce3700 1 --2- 172.21.15.5:0/4026053444 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc3a00cde30 0x7fc3a015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.071+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/4026053444 >> 172.21.15.5:0/4026053444 conn(0x7fc3a00cc8d0 msgr2=0x7fc3a00b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.071+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/4026053444 shutdown_connections 2023-03-03T06:26:27.074 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.071+0000 7fc3a7ce3700 1 -- 172.21.15.5:0/4026053444 wait complete. 2023-03-03T06:26:27.084 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-03-03T06:26:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.211+0000 7f5830ec4700 1 Processor -- start 2023-03-03T06:26:27.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.211+0000 7f5830ec4700 1 -- start start 2023-03-03T06:26:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.212+0000 7f5830ec4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f582c0cd3e0 0x7f582c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.212+0000 7f5830ec4700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c15e160 con 0x7f582c0b1fe0 2023-03-03T06:26:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.212+0000 7f5830ec4700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c15d110 con 0x7f582c15cd40 2023-03-03T06:26:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.212+0000 7f5830ec4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0cd870 con 0x7f582c0cd3e0 2023-03-03T06:26:27.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.212+0000 7f582ad9d700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f582c0b1fe0 0x7f582c0ce290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36212/0 (socket says 172.21.15.5:36212) 2023-03-03T06:26:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.212+0000 7f582ad9d700 1 -- 172.21.15.5:0/3010794452 learned_addr learned my addr 172.21.15.5:0/3010794452 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:27.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.212+0000 7f5829d9b700 1 --2- 172.21.15.5:0/3010794452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f582c0cd3e0 0x7f582c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.212+0000 7f582959a700 1 -- 172.21.15.5:0/3010794452 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345508086 0 0) 0x7f582c15e160 con 0x7f582c0b1fe0 2023-03-03T06:26:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.212+0000 7f582959a700 1 -- 172.21.15.5:0/3010794452 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58140035b0 con 0x7f582c0b1fe0 2023-03-03T06:26:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.212+0000 7f582959a700 1 -- 172.21.15.5:0/3010794452 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573389219 0 0) 0x7f582c15d110 con 0x7f582c15cd40 2023-03-03T06:26:27.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.212+0000 7f582959a700 1 -- 172.21.15.5:0/3010794452 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f582c15e160 con 0x7f582c15cd40 2023-03-03T06:26:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.213+0000 7f5829d9b700 1 -- 172.21.15.5:0/3010794452 >> v1:172.21.15.191:6789/0 conn(0x7f582c15cd40 legacy=0x7f582c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.213+0000 7f582959a700 1 -- 172.21.15.5:0/3010794452 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4221749079 0 0) 0x7f58140035b0 con 0x7f582c0b1fe0 2023-03-03T06:26:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.213+0000 7f5829d9b700 1 -- 172.21.15.5:0/3010794452 >> v1:172.21.15.5:6789/0 conn(0x7f582c0b1fe0 legacy=0x7f582c0ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.213+0000 7f5829d9b700 1 -- 172.21.15.5:0/3010794452 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c15d3c0 con 0x7f582c0cd3e0 2023-03-03T06:26:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.213+0000 7f5829d9b700 1 --2- 172.21.15.5:0/3010794452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f582c0cd3e0 0x7f582c0cdd50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5820009870 tx=0x7f5820009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fccb9f1fc54d34b1 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.213+0000 7f582959a700 1 -- 172.21.15.5:0/3010794452 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58240019f0 con 0x7f582c0cd3e0 2023-03-03T06:26:27.216 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.213+0000 7f582959a700 1 -- 172.21.15.5:0/3010794452 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820004030 con 0x7f582c0cd3e0 2023-03-03T06:26:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.213+0000 7f582959a700 1 -- 172.21.15.5:0/3010794452 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58200043c0 con 0x7f582c0cd3e0 2023-03-03T06:26:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.213+0000 7f5830ec4700 1 -- 172.21.15.5:0/3010794452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f582c0cd3e0 msgr2=0x7f582c0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.213+0000 7f5830ec4700 1 --2- 172.21.15.5:0/3010794452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f582c0cd3e0 0x7f582c0cdd50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5820009870 tx=0x7f5820009b80 comp rx=0 tx=0).stop 2023-03-03T06:26:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.214+0000 7f5830ec4700 1 -- 172.21.15.5:0/3010794452 shutdown_connections 2023-03-03T06:26:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.214+0000 7f5830ec4700 1 --2- 172.21.15.5:0/3010794452 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f582c0cd3e0 0x7f582c0cdd50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.214+0000 7f5830ec4700 1 -- 172.21.15.5:0/3010794452 >> 172.21.15.5:0/3010794452 conn(0x7f582c0cc8d0 msgr2=0x7f582c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.214+0000 7f5830ec4700 1 -- 172.21.15.5:0/3010794452 shutdown_connections 2023-03-03T06:26:27.217 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.214+0000 7f5830ec4700 1 -- 172.21.15.5:0/3010794452 wait complete. 2023-03-03T06:26:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.215+0000 7f5830ec4700 1 Processor -- start 2023-03-03T06:26:27.219 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.215+0000 7f5830ec4700 1 -- start start 2023-03-03T06:26:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f5830ec4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f582c0b1fe0 0x7f582c14a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f5830ec4700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f582c0cd3e0 0x7f582c0c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f5830ec4700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f582c15cd40 0x7f582c1471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f5830ec4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0c84b0 con 0x7f582c0b1fe0 2023-03-03T06:26:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f5830ec4700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0c86a0 con 0x7f582c0cd3e0 2023-03-03T06:26:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f5830ec4700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0c8980 con 0x7f582c15cd40 2023-03-03T06:26:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f582a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f582c0b1fe0 0x7f582c14a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.220 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f582a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f582c0b1fe0 0x7f582c14a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46372/0 (socket says 172.21.15.5:46372) 2023-03-03T06:26:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f582a59c700 1 -- 172.21.15.5:0/3125163938 learned_addr learned my addr 172.21.15.5:0/3125163938 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f5829d9b700 1 --2- 172.21.15.5:0/3125163938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f582c0cd3e0 0x7f582c0c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f582a59c700 1 -- 172.21.15.5:0/3125163938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f582c15cd40 msgr2=0x7f582c1471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f582a59c700 1 --2- 172.21.15.5:0/3125163938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f582c15cd40 0x7f582c1471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f582a59c700 1 -- 172.21.15.5:0/3125163938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f582c0cd3e0 msgr2=0x7f582c0c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f582a59c700 1 --2- 172.21.15.5:0/3125163938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f582c0cd3e0 0x7f582c0c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.221 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f582a59c700 1 -- 172.21.15.5:0/3125163938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58200094a0 con 0x7f582c0b1fe0 2023-03-03T06:26:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f582a59c700 1 --2- 172.21.15.5:0/3125163938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f582c0b1fe0 0x7f582c14a5d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f581c00c500 tx=0x7f581c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.216+0000 7f581affd700 1 -- 172.21.15.5:0/3125163938 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0052d0 con 0x7f582c0b1fe0 2023-03-03T06:26:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.217+0000 7f581affd700 1 -- 172.21.15.5:0/3125163938 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c005450 con 0x7f582c0b1fe0 2023-03-03T06:26:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.217+0000 7f5830ec4700 1 -- 172.21.15.5:0/3125163938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c15d980 con 0x7f582c0b1fe0 2023-03-03T06:26:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.217+0000 7f581affd700 1 -- 172.21.15.5:0/3125163938 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0038c0 con 0x7f582c0b1fe0 2023-03-03T06:26:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.217+0000 7f5830ec4700 1 -- 172.21.15.5:0/3125163938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c15d6a0 con 0x7f582c0b1fe0 2023-03-03T06:26:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.217+0000 7f5830ec4700 1 -- 172.21.15.5:0/3125163938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c15dc60 con 0x7f582c0b1fe0 2023-03-03T06:26:27.222 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.218+0000 7f581affd700 1 -- 172.21.15.5:0/3125163938 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f581c019030 con 0x7f582c0b1fe0 2023-03-03T06:26:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.218+0000 7f581affd700 1 --2- 172.21.15.5:0/3125163938 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f580c0682f0 0x7f580c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.218+0000 7f581affd700 1 -- 172.21.15.5:0/3125163938 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6593+0+0 (secure 0 0 0) 0x7f581c0853c0 con 0x7f582c0b1fe0 2023-03-03T06:26:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.218+0000 7f5829d9b700 1 --2- 172.21.15.5:0/3125163938 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f580c0682f0 0x7f580c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.219+0000 7f5829d9b700 1 --2- 172.21.15.5:0/3125163938 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f580c0682f0 0x7f580c06a7a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f582c06db80 tx=0x7f5820008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:27.223 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.223+0000 7f581affd700 1 -- 172.21.15.5:0/3125163938 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f581c051890 con 0x7f582c0b1fe0 2023-03-03T06:26:27.418 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.417+0000 7f5830ec4700 1 -- 172.21.15.5:0/3125163938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f582c04e6e0 con 0x7f582c0b1fe0 2023-03-03T06:26:27.419 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.417+0000 7f581affd700 1 -- 172.21.15.5:0/3125163938 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v81) v1 ==== 107+0+11 (secure 0 0 0) 0x7f581c054eb0 con 0x7f582c0b1fe0 2023-03-03T06:26:27.419 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2023-03-03T06:26:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.419+0000 7f5830ec4700 1 -- 172.21.15.5:0/3125163938 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f580c0682f0 msgr2=0x7f580c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.419+0000 7f5830ec4700 1 --2- 172.21.15.5:0/3125163938 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f580c0682f0 0x7f580c06a7a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f582c06db80 tx=0x7f5820008030 comp rx=0 tx=0).stop 2023-03-03T06:26:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.419+0000 7f5830ec4700 1 -- 172.21.15.5:0/3125163938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f582c0b1fe0 msgr2=0x7f582c14a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.419+0000 7f5830ec4700 1 --2- 172.21.15.5:0/3125163938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f582c0b1fe0 0x7f582c14a5d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f581c00c500 tx=0x7f581c00c8c0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.420+0000 7f5830ec4700 1 -- 172.21.15.5:0/3125163938 shutdown_connections 2023-03-03T06:26:27.421 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.420+0000 7f5830ec4700 1 --2- 172.21.15.5:0/3125163938 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f580c0682f0 0x7f580c06a7a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.420+0000 7f5830ec4700 1 --2- 172.21.15.5:0/3125163938 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f582c15cd40 0x7f582c1471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.420+0000 7f5830ec4700 1 --2- 172.21.15.5:0/3125163938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f582c0b1fe0 0x7f582c14a5d0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.420+0000 7f5830ec4700 1 --2- 172.21.15.5:0/3125163938 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f582c0cd3e0 0x7f582c0c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.420+0000 7f5830ec4700 1 -- 172.21.15.5:0/3125163938 >> 172.21.15.5:0/3125163938 conn(0x7f582c0cc8d0 msgr2=0x7f582c06ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:27.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.420+0000 7f5830ec4700 1 -- 172.21.15.5:0/3125163938 shutdown_connections 2023-03-03T06:26:27.422 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.420+0000 7f5830ec4700 1 -- 172.21.15.5:0/3125163938 wait complete. 2023-03-03T06:26:27.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-03-03T06:26:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.558+0000 7feb15902700 1 Processor -- start 2023-03-03T06:26:27.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.558+0000 7feb15902700 1 -- start start 2023-03-03T06:26:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.559+0000 7feb15902700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb100cbae0 0x7feb100b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.559+0000 7feb15902700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7feb100b41e0 0x7feb1015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.559+0000 7feb15902700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1015f2a0 con 0x7feb100cb710 2023-03-03T06:26:27.562 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.559+0000 7feb15902700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb100cd820 con 0x7feb100cbae0 2023-03-03T06:26:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.559+0000 7feb15902700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb100cf550 con 0x7feb100b41e0 2023-03-03T06:26:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.559+0000 7feb0e7fc700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7feb100cbae0 0x7feb100b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.559+0000 7feb0effd700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7feb100cb710 0x7feb100cf9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36222/0 (socket says 172.21.15.5:36222) 2023-03-03T06:26:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.559+0000 7feb0effd700 1 -- 172.21.15.5:0/3525622592 learned_addr learned my addr 172.21.15.5:0/3525622592 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.560+0000 7feb0f7fe700 1 --2- 172.21.15.5:0/3525622592 >> v2:172.21.15.191:3300/0 conn(0x7feb100b41e0 0x7feb1015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.563 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.560+0000 7feb0e7fc700 1 -- 172.21.15.5:0/3525622592 >> v2:172.21.15.191:3300/0 conn(0x7feb100b41e0 msgr2=0x7feb1015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.560+0000 7feb0e7fc700 1 --2- 172.21.15.5:0/3525622592 >> v2:172.21.15.191:3300/0 conn(0x7feb100b41e0 0x7feb1015e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.560+0000 7feb0e7fc700 1 -- 172.21.15.5:0/3525622592 >> v1:172.21.15.5:6789/0 conn(0x7feb100cb710 legacy=0x7feb100cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.560+0000 7feb0e7fc700 1 -- 172.21.15.5:0/3525622592 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb100b45f0 con 0x7feb100cbae0 2023-03-03T06:26:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.560+0000 7feb0dffb700 1 -- 172.21.15.5:0/3525622592 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561005764 0 0) 0x7feb1015f2a0 con 0x7feb100cb710 2023-03-03T06:26:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.560+0000 7feb0f7fe700 1 --2- 172.21.15.5:0/3525622592 >> v2:172.21.15.191:3300/0 conn(0x7feb100b41e0 0x7feb1015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.560+0000 7feb0e7fc700 1 --2- 172.21.15.5:0/3525622592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb100cbae0 0x7feb100b3ca0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7feb1008a250 tx=0x7feb00009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efb1fe675ec9abf server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.560+0000 7feb0dffb700 1 -- 172.21.15.5:0/3525622592 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb00011830 con 0x7feb100cbae0 2023-03-03T06:26:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.560+0000 7feb0dffb700 1 -- 172.21.15.5:0/3525622592 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb00011990 con 0x7feb100cbae0 2023-03-03T06:26:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.560+0000 7feb0dffb700 1 -- 172.21.15.5:0/3525622592 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb00011d20 con 0x7feb100cbae0 2023-03-03T06:26:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.561+0000 7feb15902700 1 -- 172.21.15.5:0/3525622592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb100cbae0 msgr2=0x7feb100b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.561+0000 7feb15902700 1 --2- 172.21.15.5:0/3525622592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb100cbae0 0x7feb100b3ca0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7feb1008a250 tx=0x7feb00009b20 comp rx=0 tx=0).stop 2023-03-03T06:26:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.561+0000 7feb15902700 1 -- 172.21.15.5:0/3525622592 shutdown_connections 2023-03-03T06:26:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.561+0000 7feb15902700 1 --2- 172.21.15.5:0/3525622592 >> v2:172.21.15.191:3300/0 conn(0x7feb100b41e0 0x7feb1015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.561+0000 7feb15902700 1 --2- 172.21.15.5:0/3525622592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb100cbae0 0x7feb100b3ca0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.561+0000 7feb15902700 1 -- 172.21.15.5:0/3525622592 >> 172.21.15.5:0/3525622592 conn(0x7feb10070050 msgr2=0x7feb10070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.561+0000 7feb15902700 1 -- 172.21.15.5:0/3525622592 shutdown_connections 2023-03-03T06:26:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.561+0000 7feb15902700 1 -- 172.21.15.5:0/3525622592 wait complete. 2023-03-03T06:26:27.568 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.562+0000 7feb15902700 1 Processor -- start 2023-03-03T06:26:27.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.562+0000 7feb15902700 1 -- start start 2023-03-03T06:26:27.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb15902700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb100b41e0 0x7feb100b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb15902700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb100cb710 0x7feb100c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb15902700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb100cbae0 0x7feb100c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb15902700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb100c99f0 con 0x7feb100b41e0 2023-03-03T06:26:27.569 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb15902700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb10146db0 con 0x7feb100cbae0 2023-03-03T06:26:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb15902700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb100c9ca0 con 0x7feb100cb710 2023-03-03T06:26:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb0effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb100b41e0 0x7feb100b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb0effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb100b41e0 0x7feb100b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46386/0 (socket says 172.21.15.5:46386) 2023-03-03T06:26:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb0effd700 1 -- 172.21.15.5:0/594876432 learned_addr learned my addr 172.21.15.5:0/594876432 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb0f7fe700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb100cbae0 0x7feb100c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb0e7fc700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb100cb710 0x7feb100c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb0effd700 1 -- 172.21.15.5:0/594876432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb100cb710 msgr2=0x7feb100c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb0effd700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb100cb710 0x7feb100c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb0effd700 1 -- 172.21.15.5:0/594876432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb100cbae0 msgr2=0x7feb100c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb0effd700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb100cbae0 0x7feb100c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb0effd700 1 -- 172.21.15.5:0/594876432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb000094a0 con 0x7feb100b41e0 2023-03-03T06:26:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb0f7fe700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb100cbae0 0x7feb100c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb0e7fc700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb100cb710 0x7feb100c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feb0effd700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb100b41e0 0x7feb100b0ab0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7feb040011e0 tx=0x7feb0400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.563+0000 7feaf7fff700 1 -- 172.21.15.5:0/594876432 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04004c80 con 0x7feb100b41e0 2023-03-03T06:26:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.564+0000 7feaf7fff700 1 -- 172.21.15.5:0/594876432 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb04004e00 con 0x7feb100b41e0 2023-03-03T06:26:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.564+0000 7feb15902700 1 -- 172.21.15.5:0/594876432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb100cef00 con 0x7feb100b41e0 2023-03-03T06:26:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.564+0000 7feaf7fff700 1 -- 172.21.15.5:0/594876432 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04007310 con 0x7feb100b41e0 2023-03-03T06:26:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.564+0000 7feb15902700 1 -- 172.21.15.5:0/594876432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1015efc0 con 0x7feb100b41e0 2023-03-03T06:26:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.564+0000 7feb15902700 1 -- 172.21.15.5:0/594876432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb100cf1e0 con 0x7feb100b41e0 2023-03-03T06:26:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.565+0000 7feaf7fff700 1 -- 172.21.15.5:0/594876432 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7feb0401a020 con 0x7feb100b41e0 2023-03-03T06:26:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.565+0000 7feaf7fff700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feafc0682f0 0x7feafc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.565+0000 7feaf7fff700 1 -- 172.21.15.5:0/594876432 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6593+0+0 (secure 0 0 0) 0x7feb04085af0 con 0x7feb100b41e0 2023-03-03T06:26:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.565+0000 7feb0e7fc700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feafc0682f0 0x7feafc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.566+0000 7feb0e7fc700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feafc0682f0 0x7feafc06a7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7feb100b5b90 tx=0x7feb00008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.570+0000 7feaf7fff700 1 -- 172.21.15.5:0/594876432 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7feb040521e0 con 0x7feb100b41e0 2023-03-03T06:26:27.766 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.765+0000 7feb15902700 1 -- 172.21.15.5:0/594876432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feb1004e6e0 con 0x7feb100b41e0 2023-03-03T06:26:27.767 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.766+0000 7feaf7fff700 1 -- 172.21.15.5:0/594876432 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+348 (secure 0 0 0) 0x7feb04055800 con 0x7feb100b41e0 2023-03-03T06:26:27.767 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:27.767 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2023-03-03T06:26:27.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:27.767 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2023-03-03T06:26:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "rbd" 2023-03-03T06:26:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 2, 2023-03-03T06:26:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2023-03-03T06:26:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 8, 2023-03-03T06:26:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "snap-test-pool" 2023-03-03T06:26:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 13, 2023-03-03T06:26:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "test_data_pool" 2023-03-03T06:26:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2023-03-03T06:26:27.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2023-03-03T06:26:27.770 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 14, 2023-03-03T06:26:27.770 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": "test_metadata_pool" 2023-03-03T06:26:27.770 INFO:teuthology.orchestra.run.smithi005.stdout: } 2023-03-03T06:26:27.770 INFO:teuthology.orchestra.run.smithi005.stdout:] 2023-03-03T06:26:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.768+0000 7feb15902700 1 -- 172.21.15.5:0/594876432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feafc0682f0 msgr2=0x7feafc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.768+0000 7feb15902700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feafc0682f0 0x7feafc06a7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7feb100b5b90 tx=0x7feb00008030 comp rx=0 tx=0).stop 2023-03-03T06:26:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.768+0000 7feb15902700 1 -- 172.21.15.5:0/594876432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb100b41e0 msgr2=0x7feb100b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.771 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.768+0000 7feb15902700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb100b41e0 0x7feb100b0ab0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7feb040011e0 tx=0x7feb0400cae0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.768+0000 7feb15902700 1 -- 172.21.15.5:0/594876432 shutdown_connections 2023-03-03T06:26:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.768+0000 7feb15902700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb100cbae0 0x7feb100c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.768+0000 7feb15902700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb100b41e0 0x7feb100b0ab0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.768+0000 7feb15902700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7feafc0682f0 0x7feafc06a7a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.768+0000 7feb15902700 1 --2- 172.21.15.5:0/594876432 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feb100cb710 0x7feb100c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.768+0000 7feb15902700 1 -- 172.21.15.5:0/594876432 >> 172.21.15.5:0/594876432 conn(0x7feb10070050 msgr2=0x7feb1015e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.768+0000 7feb15902700 1 -- 172.21.15.5:0/594876432 shutdown_connections 2023-03-03T06:26:27.772 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.768+0000 7feb15902700 1 -- 172.21.15.5:0/594876432 wait complete. 2023-03-03T06:26:27.781 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-03-03T06:26:27.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-03-03T06:26:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.909+0000 7f3833252700 1 Processor -- start 2023-03-03T06:26:27.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.910+0000 7f3833252700 1 -- start start 2023-03-03T06:26:27.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.910+0000 7f3833252700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f382c143040 0x7f382c0b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.910+0000 7f3833252700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382c0b1cf0 0x7f382c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.910+0000 7f3833252700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c0cc210 con 0x7f382c15d900 2023-03-03T06:26:27.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.910+0000 7f3833252700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c06c710 con 0x7f382c143040 2023-03-03T06:26:27.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.910+0000 7f3833252700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0b2160 con 0x7f382c0b1cf0 2023-03-03T06:26:27.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.910+0000 7f3830fee700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f382c143040 0x7f382c0b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.911+0000 7f3830fee700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f382c143040 0x7f382c0b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46394/0 (socket says 172.21.15.5:46394) 2023-03-03T06:26:27.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.911+0000 7f3830fee700 1 -- 172.21.15.5:0/3100351622 learned_addr learned my addr 172.21.15.5:0/3100351622 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:27.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.911+0000 7f3830fee700 1 -- 172.21.15.5:0/3100351622 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382c0b1cf0 msgr2=0x7f382c15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:27.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.911+0000 7f3830fee700 1 --2- 172.21.15.5:0/3100351622 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382c0b1cf0 0x7f382c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.911+0000 7f3830fee700 1 -- 172.21.15.5:0/3100351622 >> v1:172.21.15.191:6789/0 conn(0x7f382c15d900 legacy=0x7f382c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:27.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.911+0000 7f3830fee700 1 -- 172.21.15.5:0/3100351622 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c15e0f0 con 0x7f382c143040 2023-03-03T06:26:27.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.911+0000 7f3830fee700 1 --2- 172.21.15.5:0/3100351622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c143040 0x7f382c0b17b0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f3820009920 tx=0x7f3820009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4549c188c55c18a0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:27.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.911+0000 7f382b7fe700 1 -- 172.21.15.5:0/3100351622 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820004230 con 0x7f382c143040 2023-03-03T06:26:27.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.911+0000 7f382b7fe700 1 -- 172.21.15.5:0/3100351622 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820004390 con 0x7f382c143040 2023-03-03T06:26:27.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.911+0000 7f382b7fe700 1 -- 172.21.15.5:0/3100351622 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820009e70 con 0x7f382c143040 2023-03-03T06:26:27.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.912+0000 7f3833252700 1 -- 172.21.15.5:0/3100351622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c143040 msgr2=0x7f382c0b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.912+0000 7f3833252700 1 --2- 172.21.15.5:0/3100351622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c143040 0x7f382c0b17b0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f3820009920 tx=0x7f3820009c30 comp rx=0 tx=0).stop 2023-03-03T06:26:27.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.912+0000 7f3833252700 1 -- 172.21.15.5:0/3100351622 shutdown_connections 2023-03-03T06:26:27.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.912+0000 7f3833252700 1 --2- 172.21.15.5:0/3100351622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c143040 0x7f382c0b17b0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.912+0000 7f3833252700 1 --2- 172.21.15.5:0/3100351622 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382c0b1cf0 0x7f382c15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.912+0000 7f3833252700 1 -- 172.21.15.5:0/3100351622 >> 172.21.15.5:0/3100351622 conn(0x7f382c0d09c0 msgr2=0x7f382c0cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:27.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.912+0000 7f3833252700 1 -- 172.21.15.5:0/3100351622 shutdown_connections 2023-03-03T06:26:27.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.912+0000 7f3833252700 1 -- 172.21.15.5:0/3100351622 wait complete. 2023-03-03T06:26:27.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.913+0000 7f3833252700 1 Processor -- start 2023-03-03T06:26:27.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.913+0000 7f3833252700 1 -- start start 2023-03-03T06:26:27.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f3833252700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f382c0b1cf0 0x7f382c0b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f3833252700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c143040 0x7f382c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f3833252700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382c15d900 0x7f382c0c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f3833252700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0c6a80 con 0x7f382c143040 2023-03-03T06:26:27.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f3833252700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c154d30 con 0x7f382c0b1cf0 2023-03-03T06:26:27.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f3833252700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c155010 con 0x7f382c15d900 2023-03-03T06:26:27.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f382bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c143040 0x7f382c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f382bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c143040 0x7f382c159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46402/0 (socket says 172.21.15.5:46402) 2023-03-03T06:26:27.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f382bfff700 1 -- 172.21.15.5:0/4182321735 learned_addr learned my addr 172.21.15.5:0/4182321735 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:27.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f382bfff700 1 -- 172.21.15.5:0/4182321735 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382c15d900 msgr2=0x7f382c0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f38317ef700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382c15d900 0x7f382c0c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f3830fee700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f382c0b1cf0 0x7f382c0b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f382bfff700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382c15d900 0x7f382c0c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f382bfff700 1 -- 172.21.15.5:0/4182321735 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f382c0b1cf0 msgr2=0x7f382c0b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:27.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f382bfff700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f382c0b1cf0 0x7f382c0b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:27.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f382bfff700 1 -- 172.21.15.5:0/4182321735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3820009550 con 0x7f382c143040 2023-03-03T06:26:27.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f3830fee700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f382c0b1cf0 0x7f382c0b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:27.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f38317ef700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382c15d900 0x7f382c0c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:27.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.914+0000 7f382bfff700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c143040 0x7f382c159d10 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f381800b4a0 tx=0x7f381800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:27.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.915+0000 7f38297fa700 1 -- 172.21.15.5:0/4182321735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818011830 con 0x7f382c143040 2023-03-03T06:26:27.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.915+0000 7f38297fa700 1 -- 172.21.15.5:0/4182321735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3818011990 con 0x7f382c143040 2023-03-03T06:26:27.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.915+0000 7f38297fa700 1 -- 172.21.15.5:0/4182321735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818011d40 con 0x7f382c143040 2023-03-03T06:26:27.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.915+0000 7f3833252700 1 -- 172.21.15.5:0/4182321735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382c06c050 con 0x7f382c143040 2023-03-03T06:26:27.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.915+0000 7f3833252700 1 -- 172.21.15.5:0/4182321735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c06bd70 con 0x7f382c143040 2023-03-03T06:26:27.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.916+0000 7f3833252700 1 -- 172.21.15.5:0/4182321735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c06c330 con 0x7f382c143040 2023-03-03T06:26:27.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.916+0000 7f38297fa700 1 -- 172.21.15.5:0/4182321735 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3818021070 con 0x7f382c143040 2023-03-03T06:26:27.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.917+0000 7f38297fa700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38100682f0 0x7f381006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:27.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.917+0000 7f3830fee700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38100682f0 0x7f381006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:27.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.917+0000 7f38297fa700 1 -- 172.21.15.5:0/4182321735 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6593+0+0 (secure 0 0 0) 0x7f3818085e20 con 0x7f382c143040 2023-03-03T06:26:27.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.917+0000 7f3830fee700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38100682f0 0x7f381006a7a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3820009c70 tx=0x7f3820008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:27.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:27.921+0000 7f38297fa700 1 -- 172.21.15.5:0/4182321735 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f38180523e0 con 0x7f382c143040 2023-03-03T06:26:28.114 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.113+0000 7f3833252700 1 -- 172.21.15.5:0/4182321735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f382c155940 con 0x7f382c143040 2023-03-03T06:26:28.546 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.544+0000 7f38297fa700 1 -- 172.21.15.5:0/4182321735 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7f38180150b0 con 0x7f382c143040 2023-03-03T06:26:28.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.547+0000 7f3833252700 1 -- 172.21.15.5:0/4182321735 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38100682f0 msgr2=0x7f381006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:28.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.547+0000 7f3833252700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38100682f0 0x7f381006a7a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3820009c70 tx=0x7f3820008030 comp rx=0 tx=0).stop 2023-03-03T06:26:28.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.547+0000 7f3833252700 1 -- 172.21.15.5:0/4182321735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c143040 msgr2=0x7f382c159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:28.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.547+0000 7f3833252700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c143040 0x7f382c159d10 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f381800b4a0 tx=0x7f381800b860 comp rx=0 tx=0).stop 2023-03-03T06:26:28.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.547+0000 7f3833252700 1 -- 172.21.15.5:0/4182321735 shutdown_connections 2023-03-03T06:26:28.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.547+0000 7f3833252700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f38100682f0 0x7f381006a7a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:28.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.547+0000 7f3833252700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f382c15d900 0x7f382c0c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:28.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.547+0000 7f3833252700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f382c0b1cf0 0x7f382c0b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:28.550 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.547+0000 7f3833252700 1 --2- 172.21.15.5:0/4182321735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c143040 0x7f382c159d10 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.547+0000 7f3833252700 1 -- 172.21.15.5:0/4182321735 >> 172.21.15.5:0/4182321735 conn(0x7f382c0d09c0 msgr2=0x7f382c0b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.547+0000 7f3833252700 1 -- 172.21.15.5:0/4182321735 shutdown_connections 2023-03-03T06:26:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.547+0000 7f3833252700 1 -- 172.21.15.5:0/4182321735 wait complete. 2023-03-03T06:26:28.551 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2023-03-03T06:26:28.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-03-03T06:26:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.701+0000 7fa2b147b700 1 Processor -- start 2023-03-03T06:26:28.703 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.701+0000 7fa2b147b700 1 -- start start 2023-03-03T06:26:28.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2b147b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2ac15c8b0 0x7fa2ac0cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:28.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2b147b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa2ac0b4b50 0x7fa2ac0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:28.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2b147b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac15cc80 con 0x7fa2ac160e30 2023-03-03T06:26:28.706 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2b147b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac0b5510 con 0x7fa2ac0b4b50 2023-03-03T06:26:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2b147b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0d1670 con 0x7fa2ac15c8b0 2023-03-03T06:26:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2aaffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2ac15c8b0 0x7fa2ac0cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2ab7fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa2ac0b4b50 0x7fa2ac0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2ab7fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa2ac0b4b50 0x7fa2ac0b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:46772/0 (socket says 172.21.15.5:46772) 2023-03-03T06:26:28.707 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2ab7fe700 1 -- 172.21.15.5:0/1426243509 learned_addr learned my addr 172.21.15.5:0/1426243509 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2aaffd700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2ac15c8b0 0x7fa2ac0cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:44486/0 (socket says 172.21.15.5:44486) 2023-03-03T06:26:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2aa7fc700 1 --1- 172.21.15.5:0/1426243509 >> v1:172.21.15.191:6789/0 conn(0x7fa2ac160e30 0x7fa2ac0d1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:50780/0 (socket says 172.21.15.5:50780) 2023-03-03T06:26:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2ab7fe700 1 -- 172.21.15.5:0/1426243509 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2ac15c8b0 msgr2=0x7fa2ac0cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:28.708 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2ab7fe700 1 --2- 172.21.15.5:0/1426243509 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2ac15c8b0 0x7fa2ac0cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:28.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2ab7fe700 1 -- 172.21.15.5:0/1426243509 >> v1:172.21.15.191:6789/0 conn(0x7fa2ac160e30 legacy=0x7fa2ac0d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:28.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2ab7fe700 1 -- 172.21.15.5:0/1426243509 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac0d2210 con 0x7fa2ac0b4b50 2023-03-03T06:26:28.709 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.702+0000 7fa2aaffd700 1 --2- 172.21.15.5:0/1426243509 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2ac15c8b0 0x7fa2ac0cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:26:28.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.703+0000 7fa2ab7fe700 1 --2- 172.21.15.5:0/1426243509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2ac0b4b50 0x7fa2ac0b4fd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009e50 tx=0x7fa2a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99487be6e65d6e8c server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:28.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.703+0000 7fa2a9ffb700 1 -- 172.21.15.5:0/1426243509 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a400e070 con 0x7fa2ac0b4b50 2023-03-03T06:26:28.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.703+0000 7fa2a9ffb700 1 -- 172.21.15.5:0/1426243509 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a400b910 con 0x7fa2ac0b4b50 2023-03-03T06:26:28.710 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.703+0000 7fa2a9ffb700 1 -- 172.21.15.5:0/1426243509 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a400bcc0 con 0x7fa2ac0b4b50 2023-03-03T06:26:28.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.703+0000 7fa2b147b700 1 -- 172.21.15.5:0/1426243509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2ac0b4b50 msgr2=0x7fa2ac0b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:28.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.703+0000 7fa2b147b700 1 --2- 172.21.15.5:0/1426243509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2ac0b4b50 0x7fa2ac0b4fd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009e50 tx=0x7fa2a400b330 comp rx=0 tx=0).stop 2023-03-03T06:26:28.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.703+0000 7fa2b147b700 1 -- 172.21.15.5:0/1426243509 shutdown_connections 2023-03-03T06:26:28.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.703+0000 7fa2b147b700 1 --2- 172.21.15.5:0/1426243509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2ac0b4b50 0x7fa2ac0b4fd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:28.711 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.703+0000 7fa2b147b700 1 --2- 172.21.15.5:0/1426243509 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2ac15c8b0 0x7fa2ac0cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:28.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.703+0000 7fa2b147b700 1 -- 172.21.15.5:0/1426243509 >> 172.21.15.5:0/1426243509 conn(0x7fa2ac0cfb50 msgr2=0x7fa2ac0cff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:28.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.703+0000 7fa2b147b700 1 -- 172.21.15.5:0/1426243509 shutdown_connections 2023-03-03T06:26:28.712 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.703+0000 7fa2b147b700 1 -- 172.21.15.5:0/1426243509 wait complete. 2023-03-03T06:26:28.714 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.705+0000 7fa2b147b700 1 Processor -- start 2023-03-03T06:26:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.705+0000 7fa2b147b700 1 -- start start 2023-03-03T06:26:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.705+0000 7fa2b147b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2ac0b4b50 0x7fa2ac149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.705+0000 7fa2b147b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2ac15c8b0 0x7fa2ac0b8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.705+0000 7fa2b147b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2ac160e30 0x7fa2ac15da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.705+0000 7fa2b147b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0cd100 con 0x7fa2ac160e30 2023-03-03T06:26:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.705+0000 7fa2b147b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac1e8aa0 con 0x7fa2ac15c8b0 2023-03-03T06:26:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.705+0000 7fa2b147b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0cc480 con 0x7fa2ac0b4b50 2023-03-03T06:26:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.705+0000 7fa2ab7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2ac160e30 0x7fa2ac15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2ab7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2ac160e30 0x7fa2ac15da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46418/0 (socket says 172.21.15.5:46418) 2023-03-03T06:26:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2ab7fe700 1 -- 172.21.15.5:0/1792850842 learned_addr learned my addr 172.21.15.5:0/1792850842 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2aaffd700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2ac0b4b50 0x7fa2ac149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2aa7fc700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2ac15c8b0 0x7fa2ac0b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2ab7fe700 1 -- 172.21.15.5:0/1792850842 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2ac0b4b50 msgr2=0x7fa2ac149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2ab7fe700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2ac0b4b50 0x7fa2ac149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2ab7fe700 1 -- 172.21.15.5:0/1792850842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2ac15c8b0 msgr2=0x7fa2ac0b8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2ab7fe700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2ac15c8b0 0x7fa2ac0b8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2ab7fe700 1 -- 172.21.15.5:0/1792850842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0094a0 con 0x7fa2ac160e30 2023-03-03T06:26:28.718 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2aa7fc700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2ac15c8b0 0x7fa2ac0b8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2ab7fe700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2ac160e30 0x7fa2ac15da70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac06d270 tx=0x7fa2a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2937fe700 1 -- 172.21.15.5:0/1792850842 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4004920 con 0x7fa2ac160e30 2023-03-03T06:26:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2937fe700 1 -- 172.21.15.5:0/1792850842 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a40099b0 con 0x7fa2ac160e30 2023-03-03T06:26:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2b147b700 1 -- 172.21.15.5:0/1792850842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a4009b30 con 0x7fa2ac160e30 2023-03-03T06:26:28.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2937fe700 1 -- 172.21.15.5:0/1792850842 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a401c680 con 0x7fa2ac160e30 2023-03-03T06:26:28.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.706+0000 7fa2b147b700 1 -- 172.21.15.5:0/1792850842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac0d0d40 con 0x7fa2ac160e30 2023-03-03T06:26:28.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.707+0000 7fa2b147b700 1 -- 172.21.15.5:0/1792850842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac0cde20 con 0x7fa2ac160e30 2023-03-03T06:26:28.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.708+0000 7fa2937fe700 1 -- 172.21.15.5:0/1792850842 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa2a402c070 con 0x7fa2ac160e30 2023-03-03T06:26:28.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.708+0000 7fa2937fe700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa2980682f0 0x7fa29806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:28.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.709+0000 7fa2937fe700 1 -- 172.21.15.5:0/1792850842 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6963+0+0 (secure 0 0 0) 0x7fa2a4088380 con 0x7fa2ac160e30 2023-03-03T06:26:28.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.709+0000 7fa2aaffd700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa2980682f0 0x7fa29806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:28.721 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.709+0000 7fa2aaffd700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa2980682f0 0x7fa29806a7a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009d00 tx=0x7fa29c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:28.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.712+0000 7fa2937fe700 1 -- 172.21.15.5:0/1792850842 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa2a4054760 con 0x7fa2ac160e30 2023-03-03T06:26:28.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:28.909+0000 7fa2b147b700 1 -- 172.21.15.5:0/1792850842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa2ac0d1020 con 0x7fa2ac160e30 2023-03-03T06:26:29.549 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.547+0000 7fa2937fe700 1 -- 172.21.15.5:0/1792850842 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa2a4057d80 con 0x7fa2ac160e30 2023-03-03T06:26:29.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.555+0000 7fa2b147b700 1 -- 172.21.15.5:0/1792850842 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa2980682f0 msgr2=0x7fa29806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:29.558 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.555+0000 7fa2b147b700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa2980682f0 0x7fa29806a7a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009d00 tx=0x7fa29c008040 comp rx=0 tx=0).stop 2023-03-03T06:26:29.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.555+0000 7fa2b147b700 1 -- 172.21.15.5:0/1792850842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2ac160e30 msgr2=0x7fa2ac15da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:29.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.555+0000 7fa2b147b700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2ac160e30 0x7fa2ac15da70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac06d270 tx=0x7fa2a4004ad0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.556+0000 7fa2b147b700 1 -- 172.21.15.5:0/1792850842 shutdown_connections 2023-03-03T06:26:29.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.556+0000 7fa2b147b700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa2ac160e30 0x7fa2ac15da70 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.556+0000 7fa2b147b700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fa2980682f0 0x7fa29806a7a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.556+0000 7fa2b147b700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa2ac0b4b50 0x7fa2ac149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.559 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.556+0000 7fa2b147b700 1 --2- 172.21.15.5:0/1792850842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2ac15c8b0 0x7fa2ac0b8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.556+0000 7fa2b147b700 1 -- 172.21.15.5:0/1792850842 >> 172.21.15.5:0/1792850842 conn(0x7fa2ac0cfb50 msgr2=0x7fa2ac15f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:29.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.556+0000 7fa2b147b700 1 -- 172.21.15.5:0/1792850842 shutdown_connections 2023-03-03T06:26:29.560 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.557+0000 7fa2b147b700 1 -- 172.21.15.5:0/1792850842 wait complete. 2023-03-03T06:26:29.568 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2023-03-03T06:26:29.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-03-03T06:26:29.719 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.717+0000 7f12d6a54700 1 Processor -- start 2023-03-03T06:26:29.720 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.717+0000 7f12d6a54700 1 -- start start 2023-03-03T06:26:29.722 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.718+0000 7f12d6a54700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f12d00b55b0 0x7f12d015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:29.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.718+0000 7f12d6a54700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d00cc5d0 con 0x7f12d00cd500 2023-03-03T06:26:29.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.718+0000 7f12d6a54700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d0159c30 con 0x7f12d00b1fe0 2023-03-03T06:26:29.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.718+0000 7f12d6a54700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d015e290 con 0x7f12d00b55b0 2023-03-03T06:26:29.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.718+0000 7f12cf7fe700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f12d00cd500 0x7f12d00b18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36266/0 (socket says 172.21.15.5:36266) 2023-03-03T06:26:29.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.718+0000 7f12cf7fe700 1 -- 172.21.15.5:0/1662836236 learned_addr learned my addr 172.21.15.5:0/1662836236 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:29.723 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.718+0000 7f12cffff700 1 --2- 172.21.15.5:0/1662836236 >> v2:172.21.15.191:3300/0 conn(0x7f12d00b55b0 0x7f12d015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329900392 0 0) 0x7f12d00cc5d0 con 0x7f12d00cd500 2023-03-03T06:26:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12bc0035b0 con 0x7f12d00cd500 2023-03-03T06:26:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553931488 0 0) 0x7f12d0159c30 con 0x7f12d00b1fe0 2023-03-03T06:26:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d00cc5d0 con 0x7f12d00b1fe0 2023-03-03T06:26:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1637900764 0 0) 0x7f12bc0035b0 con 0x7f12d00cd500 2023-03-03T06:26:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 >> v2:172.21.15.191:3300/0 conn(0x7f12d00b55b0 msgr2=0x7f12d015dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 --2- 172.21.15.5:0/1662836236 >> v2:172.21.15.191:3300/0 conn(0x7f12d00b55b0 0x7f12d015dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.724 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 >> v1:172.21.15.191:6789/0 conn(0x7f12d00b1fe0 legacy=0x7f12d00cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:29.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d00b5980 con 0x7f12d00cd500 2023-03-03T06:26:29.725 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f12b8001670 con 0x7f12d00cd500 2023-03-03T06:26:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 >> v1:172.21.15.5:6789/0 conn(0x7f12d00cd500 legacy=0x7f12d00b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 --2- 172.21.15.5:0/1662836236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12bc003b90 0x7f12bc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:29.726 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 --2- 172.21.15.5:0/1662836236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12bc004850 0x7f12bc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 --2- 172.21.15.5:0/1662836236 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12bc005200 0x7f12bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc00c030 con 0x7f12bc003b90 2023-03-03T06:26:29.727 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc00c1a0 con 0x7f12bc004850 2023-03-03T06:26:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc00c360 con 0x7f12bc005200 2023-03-03T06:26:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12cffff700 1 --2- 172.21.15.5:0/1662836236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12bc003b90 0x7f12bc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12cf7fe700 1 --2- 172.21.15.5:0/1662836236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12bc004850 0x7f12bc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12d4ff1700 1 --2- 172.21.15.5:0/1662836236 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12bc005200 0x7f12bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12cffff700 1 -- 172.21.15.5:0/1662836236 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12bc005200 msgr2=0x7f12bc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:29.728 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12cffff700 1 --2- 172.21.15.5:0/1662836236 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12bc005200 0x7f12bc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12cffff700 1 -- 172.21.15.5:0/1662836236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12bc004850 msgr2=0x7f12bc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12cffff700 1 --2- 172.21.15.5:0/1662836236 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12bc004850 0x7f12bc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12cffff700 1 -- 172.21.15.5:0/1662836236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0035b0 con 0x7f12bc003b90 2023-03-03T06:26:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12d4ff1700 1 -- 172.21.15.5:0/1662836236 reap_dead start 2023-03-03T06:26:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.719+0000 7f12cffff700 1 --2- 172.21.15.5:0/1662836236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12bc003b90 0x7f12bc003f80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f12c0009b60 tx=0x7f12bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160dff8409ccc06e server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:29.729 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.720+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c000e6c0 con 0x7f12bc003b90 2023-03-03T06:26:29.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.720+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c000e820 con 0x7f12bc003b90 2023-03-03T06:26:29.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.720+0000 7f12ceffd700 1 -- 172.21.15.5:0/1662836236 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c000eb90 con 0x7f12bc003b90 2023-03-03T06:26:29.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.720+0000 7f12d6a54700 1 -- 172.21.15.5:0/1662836236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12bc003b90 msgr2=0x7f12bc003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:29.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.720+0000 7f12d6a54700 1 --2- 172.21.15.5:0/1662836236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12bc003b90 0x7f12bc003f80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f12c0009b60 tx=0x7f12bc005880 comp rx=0 tx=0).stop 2023-03-03T06:26:29.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.720+0000 7f12d6a54700 1 -- 172.21.15.5:0/1662836236 shutdown_connections 2023-03-03T06:26:29.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.720+0000 7f12d6a54700 1 --2- 172.21.15.5:0/1662836236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12bc003b90 0x7f12bc003f80 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.720+0000 7f12d6a54700 1 -- 172.21.15.5:0/1662836236 >> 172.21.15.5:0/1662836236 conn(0x7f12d00cc8d0 msgr2=0x7f12d00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:29.730 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.720+0000 7f12d6a54700 1 -- 172.21.15.5:0/1662836236 shutdown_connections 2023-03-03T06:26:29.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.720+0000 7f12d6a54700 1 -- 172.21.15.5:0/1662836236 wait complete. 2023-03-03T06:26:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.721+0000 7f12d6a54700 1 Processor -- start 2023-03-03T06:26:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.722+0000 7f12d6a54700 1 -- start start 2023-03-03T06:26:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.722+0000 7f12d6a54700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12bc003b90 0x7f12d01f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.722+0000 7f12d6a54700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12d014f3c0 0x7f12d01f3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.722+0000 7f12d6a54700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d01f3eb0 0x7f12d0156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.722+0000 7f12d6a54700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d01f44e0 con 0x7f12d01f3eb0 2023-03-03T06:26:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.722+0000 7f12d6a54700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d01f47c0 con 0x7f12bc003b90 2023-03-03T06:26:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.722+0000 7f12d6a54700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d01f06d0 con 0x7f12d014f3c0 2023-03-03T06:26:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.722+0000 7f12d4ff1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d01f3eb0 0x7f12d0156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12d4ff1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d01f3eb0 0x7f12d0156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46438/0 (socket says 172.21.15.5:46438) 2023-03-03T06:26:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12d4ff1700 1 -- 172.21.15.5:0/1130170130 learned_addr learned my addr 172.21.15.5:0/1130170130 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12cffff700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12bc003b90 0x7f12d01f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:29.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12cf7fe700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12d014f3c0 0x7f12d01f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:29.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12d4ff1700 1 -- 172.21.15.5:0/1130170130 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12d014f3c0 msgr2=0x7f12d01f3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:29.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12d4ff1700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12d014f3c0 0x7f12d01f3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12d4ff1700 1 -- 172.21.15.5:0/1130170130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12bc003b90 msgr2=0x7f12d01f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:29.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12d4ff1700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12bc003b90 0x7f12d01f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12d4ff1700 1 -- 172.21.15.5:0/1130170130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d00cbca0 con 0x7f12d01f3eb0 2023-03-03T06:26:29.735 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12d4ff1700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d01f3eb0 0x7f12d0156bb0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f12d00cfe20 tx=0x7f12c800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12ccff9700 1 -- 172.21.15.5:0/1130170130 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8003c10 con 0x7f12d01f3eb0 2023-03-03T06:26:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12ccff9700 1 -- 172.21.15.5:0/1130170130 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c8003d90 con 0x7f12d01f3eb0 2023-03-03T06:26:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12ccff9700 1 -- 172.21.15.5:0/1130170130 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8005310 con 0x7f12d01f3eb0 2023-03-03T06:26:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12d6a54700 1 -- 172.21.15.5:0/1130170130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d00cb9c0 con 0x7f12d01f3eb0 2023-03-03T06:26:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.723+0000 7f12d6a54700 1 -- 172.21.15.5:0/1130170130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d00cbf80 con 0x7f12d01f3eb0 2023-03-03T06:26:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.724+0000 7f12d6a54700 1 -- 172.21.15.5:0/1130170130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d01f0d20 con 0x7f12d01f3eb0 2023-03-03T06:26:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.725+0000 7f12ccff9700 1 -- 172.21.15.5:0/1130170130 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f12c8005470 con 0x7f12d01f3eb0 2023-03-03T06:26:29.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.725+0000 7f12ccff9700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f12b00682f0 0x7f12b006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:29.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.725+0000 7f12ccff9700 1 -- 172.21.15.5:0/1130170130 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7345+0+0 (secure 0 0 0) 0x7f12c80862a0 con 0x7f12d01f3eb0 2023-03-03T06:26:29.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.725+0000 7f12cffff700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f12b00682f0 0x7f12b006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:29.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.726+0000 7f12cffff700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f12b00682f0 0x7f12b006a7a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f12c00090b0 tx=0x7f12c001e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:29.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.730+0000 7f12ccff9700 1 -- 172.21.15.5:0/1130170130 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f12c80525f0 con 0x7f12d01f3eb0 2023-03-03T06:26:29.968 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.966+0000 7f12d6a54700 1 -- 172.21.15.5:0/1130170130 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f12d01f0b90 con 0x7f12d01f3eb0 2023-03-03T06:26:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.974+0000 7f12ccff9700 1 -- 172.21.15.5:0/1130170130 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7f12c8055c10 con 0x7f12d01f3eb0 2023-03-03T06:26:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.982+0000 7f12d6a54700 1 -- 172.21.15.5:0/1130170130 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f12b00682f0 msgr2=0x7f12b006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.982+0000 7f12d6a54700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f12b00682f0 0x7f12b006a7a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f12c00090b0 tx=0x7f12c001e040 comp rx=0 tx=0).stop 2023-03-03T06:26:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.982+0000 7f12d6a54700 1 -- 172.21.15.5:0/1130170130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d01f3eb0 msgr2=0x7f12d0156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.982+0000 7f12d6a54700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d01f3eb0 0x7f12d0156bb0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f12d00cfe20 tx=0x7f12c800ef00 comp rx=0 tx=0).stop 2023-03-03T06:26:29.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.982+0000 7f12d6a54700 1 -- 172.21.15.5:0/1130170130 shutdown_connections 2023-03-03T06:26:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.982+0000 7f12d6a54700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d01f3eb0 0x7f12d0156bb0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.982+0000 7f12d6a54700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12bc003b90 0x7f12d01f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.982+0000 7f12d6a54700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f12b00682f0 0x7f12b006a7a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.982+0000 7f12d6a54700 1 --2- 172.21.15.5:0/1130170130 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f12d014f3c0 0x7f12d01f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:29.986 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.982+0000 7f12d6a54700 1 -- 172.21.15.5:0/1130170130 >> 172.21.15.5:0/1130170130 conn(0x7f12d00cc8d0 msgr2=0x7f12d00b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:29.987 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.985+0000 7f12d6a54700 1 -- 172.21.15.5:0/1130170130 shutdown_connections 2023-03-03T06:26:29.989 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:29.987+0000 7f12d6a54700 1 -- 172.21.15.5:0/1130170130 wait complete. 2023-03-03T06:26:29.991 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 15 and data pool 16 2023-03-03T06:26:30.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:26:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.135+0000 7f5a610fe700 1 Processor -- start 2023-03-03T06:26:30.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.135+0000 7f5a610fe700 1 -- start start 2023-03-03T06:26:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.135+0000 7f5a610fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a5c0cec00 0x7f5a5c159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.135+0000 7f5a610fe700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5a5c15a050 0x7f5a5c0714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.135+0000 7f5a610fe700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5c15aa90 con 0x7f5a5c159730 2023-03-03T06:26:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.135+0000 7f5a610fe700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5c15a4d0 con 0x7f5a5c15a050 2023-03-03T06:26:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.135+0000 7f5a610fe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c15a7b0 con 0x7f5a5c0cec00 2023-03-03T06:26:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a5a59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a5c0cec00 0x7f5a5c159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a5b59e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5a5c15a050 0x7f5a5c0714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a5a59c700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a5c0cec00 0x7f5a5c159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:44536/0 (socket says 172.21.15.5:44536) 2023-03-03T06:26:30.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a5a59c700 1 -- 172.21.15.5:0/2045335301 learned_addr learned my addr 172.21.15.5:0/2045335301 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a5b59e700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5a5c15a050 0x7f5a5c0714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:46820/0 (socket says 172.21.15.5:46820) 2023-03-03T06:26:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a5ad9d700 1 --1- 172.21.15.5:0/2045335301 >> v1:172.21.15.191:6789/0 conn(0x7f5a5c159730 0x7f5a5c15d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:50826/0 (socket says 172.21.15.5:50826) 2023-03-03T06:26:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a5b59e700 1 -- 172.21.15.5:0/2045335301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a5c0cec00 msgr2=0x7f5a5c159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a5b59e700 1 --2- 172.21.15.5:0/2045335301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a5c0cec00 0x7f5a5c159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a5b59e700 1 -- 172.21.15.5:0/2045335301 >> v1:172.21.15.191:6789/0 conn(0x7f5a5c159730 legacy=0x7f5a5c15d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a5b59e700 1 -- 172.21.15.5:0/2045335301 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c15d1f0 con 0x7f5a5c15a050 2023-03-03T06:26:30.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a5a59c700 1 --2- 172.21.15.5:0/2045335301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a5c0cec00 0x7f5a5c159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:26:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a5b59e700 1 --2- 172.21.15.5:0/2045335301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a5c15a050 0x7f5a5c0714c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009d90 tx=0x7f5a5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e32170adc46b166 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a59d9b700 1 -- 172.21.15.5:0/2045335301 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5400e070 con 0x7f5a5c15a050 2023-03-03T06:26:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.136+0000 7f5a59d9b700 1 -- 172.21.15.5:0/2045335301 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5400bb20 con 0x7f5a5c15a050 2023-03-03T06:26:30.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.137+0000 7f5a59d9b700 1 -- 172.21.15.5:0/2045335301 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54012430 con 0x7f5a5c15a050 2023-03-03T06:26:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.137+0000 7f5a610fe700 1 -- 172.21.15.5:0/2045335301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a5c15a050 msgr2=0x7f5a5c0714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.137+0000 7f5a610fe700 1 --2- 172.21.15.5:0/2045335301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a5c15a050 0x7f5a5c0714c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009d90 tx=0x7f5a5400b330 comp rx=0 tx=0).stop 2023-03-03T06:26:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.137+0000 7f5a610fe700 1 -- 172.21.15.5:0/2045335301 shutdown_connections 2023-03-03T06:26:30.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.137+0000 7f5a610fe700 1 --2- 172.21.15.5:0/2045335301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a5c15a050 0x7f5a5c0714c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.137+0000 7f5a610fe700 1 --2- 172.21.15.5:0/2045335301 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a5c0cec00 0x7f5a5c159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.137+0000 7f5a610fe700 1 -- 172.21.15.5:0/2045335301 >> 172.21.15.5:0/2045335301 conn(0x7f5a5c0cf4b0 msgr2=0x7f5a5c0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.137+0000 7f5a610fe700 1 -- 172.21.15.5:0/2045335301 shutdown_connections 2023-03-03T06:26:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.137+0000 7f5a610fe700 1 -- 172.21.15.5:0/2045335301 wait complete. 2023-03-03T06:26:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.138+0000 7f5a610fe700 1 Processor -- start 2023-03-03T06:26:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.139+0000 7f5a610fe700 1 -- start start 2023-03-03T06:26:30.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.139+0000 7f5a610fe700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a5c0cec00 0x7f5a5c14a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.139+0000 7f5a610fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a5c0c4a40 0x7f5a5c0c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.139+0000 7f5a610fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a5c0b23e0 0x7f5a5c0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.139+0000 7f5a610fe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c0c53f0 con 0x7f5a5c0c4a40 2023-03-03T06:26:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.139+0000 7f5a610fe700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c1f0410 con 0x7f5a5c0b23e0 2023-03-03T06:26:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.139+0000 7f5a610fe700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c0b31a0 con 0x7f5a5c0cec00 2023-03-03T06:26:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.139+0000 7f5a5a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a5c0c4a40 0x7f5a5c0c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.139+0000 7f5a5ad9d700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a5c0cec00 0x7f5a5c14a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.139+0000 7f5a5a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a5c0c4a40 0x7f5a5c0c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46464/0 (socket says 172.21.15.5:46464) 2023-03-03T06:26:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.139+0000 7f5a5a59c700 1 -- 172.21.15.5:0/1283700493 learned_addr learned my addr 172.21.15.5:0/1283700493 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.139+0000 7f5a5b59e700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a5c0b23e0 0x7f5a5c0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.140+0000 7f5a5ad9d700 1 -- 172.21.15.5:0/1283700493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a5c0b23e0 msgr2=0x7f5a5c0b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.140+0000 7f5a5ad9d700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a5c0b23e0 0x7f5a5c0b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.140+0000 7f5a5ad9d700 1 -- 172.21.15.5:0/1283700493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a5c0c4a40 msgr2=0x7f5a5c0c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.140+0000 7f5a5ad9d700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a5c0c4a40 0x7f5a5c0c4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.140+0000 7f5a5ad9d700 1 -- 172.21.15.5:0/1283700493 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a50009550 con 0x7f5a5c0cec00 2023-03-03T06:26:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.140+0000 7f5a5a59c700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a5c0c4a40 0x7f5a5c0c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:26:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.140+0000 7f5a5b59e700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a5c0b23e0 0x7f5a5c0b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:26:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.140+0000 7f5a5ad9d700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a5c0cec00 0x7f5a5c14a280 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00c480 tx=0x7f5a4c00c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.140+0000 7f5a437fe700 1 -- 172.21.15.5:0/1283700493 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c005cb0 con 0x7f5a5c0cec00 2023-03-03T06:26:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.140+0000 7f5a437fe700 1 -- 172.21.15.5:0/1283700493 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4c005e10 con 0x7f5a5c0cec00 2023-03-03T06:26:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.140+0000 7f5a610fe700 1 -- 172.21.15.5:0/1283700493 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a54009a70 con 0x7f5a5c0cec00 2023-03-03T06:26:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.140+0000 7f5a437fe700 1 -- 172.21.15.5:0/1283700493 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0072d0 con 0x7f5a5c0cec00 2023-03-03T06:26:30.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.140+0000 7f5a610fe700 1 -- 172.21.15.5:0/1283700493 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5c071a00 con 0x7f5a5c0cec00 2023-03-03T06:26:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.141+0000 7f5a610fe700 1 -- 172.21.15.5:0/1283700493 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5c15d4d0 con 0x7f5a5c0cec00 2023-03-03T06:26:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.142+0000 7f5a437fe700 1 -- 172.21.15.5:0/1283700493 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5a4c019030 con 0x7f5a5c0cec00 2023-03-03T06:26:30.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.142+0000 7f5a437fe700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5a480682f0 0x7f5a4806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.142+0000 7f5a437fe700 1 -- 172.21.15.5:0/1283700493 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7445+0+0 (secure 0 0 0) 0x7f5a4c0853d0 con 0x7f5a5c0cec00 2023-03-03T06:26:30.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.142+0000 7f5a5a59c700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5a480682f0 0x7f5a4806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.143+0000 7f5a5a59c700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5a480682f0 0x7f5a4806a7a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0c5860 tx=0x7f5a500092c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:30.149 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.147+0000 7f5a437fe700 1 -- 172.21.15.5:0/1283700493 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5a4c04b5e0 con 0x7f5a5c0cec00 2023-03-03T06:26:30.343 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.341+0000 7f5a610fe700 1 -- 172.21.15.5:0/1283700493 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a5c071b90 con 0x7f5a5c0cec00 2023-03-03T06:26:30.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.343+0000 7f5a437fe700 1 -- 172.21.15.5:0/1283700493 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+23170 (secure 0 0 0) 0x7f5a4c017090 con 0x7f5a5c0cec00 2023-03-03T06:26:30.345 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:30.346 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":84,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:26:29.967743+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_data_pool","create_time":"2023-03-03T06:26:03.629103+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":72,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"test_metadata_pool","create_time":"2023-03-03T06:26:04.826705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:26:28.144189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-03-03T06:26:28.941035+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:26:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.345+0000 7f5a610fe700 1 -- 172.21.15.5:0/1283700493 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5a480682f0 msgr2=0x7f5a4806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.345+0000 7f5a610fe700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5a480682f0 0x7f5a4806a7a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0c5860 tx=0x7f5a500092c0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.345+0000 7f5a610fe700 1 -- 172.21.15.5:0/1283700493 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a5c0cec00 msgr2=0x7f5a5c14a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.345+0000 7f5a610fe700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a5c0cec00 0x7f5a5c14a280 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00c480 tx=0x7f5a4c00c790 comp rx=0 tx=0).stop 2023-03-03T06:26:30.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.345+0000 7f5a610fe700 1 -- 172.21.15.5:0/1283700493 shutdown_connections 2023-03-03T06:26:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.345+0000 7f5a610fe700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a5c0b23e0 0x7f5a5c0b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.345+0000 7f5a610fe700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f5a480682f0 0x7f5a4806a7a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.345+0000 7f5a610fe700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a5c0cec00 0x7f5a5c14a280 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.345+0000 7f5a610fe700 1 --2- 172.21.15.5:0/1283700493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a5c0c4a40 0x7f5a5c0c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.345+0000 7f5a610fe700 1 -- 172.21.15.5:0/1283700493 >> 172.21.15.5:0/1283700493 conn(0x7f5a5c0cf4b0 msgr2=0x7f5a5c0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.345+0000 7f5a610fe700 1 -- 172.21.15.5:0/1283700493 shutdown_connections 2023-03-03T06:26:30.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.345+0000 7f5a610fe700 1 -- 172.21.15.5:0/1283700493 wait complete. 2023-03-03T06:26:30.360 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:26:30.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.483+0000 7f81281ea700 1 Processor -- start 2023-03-03T06:26:30.485 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.483+0000 7f81281ea700 1 -- start start 2023-03-03T06:26:30.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.484+0000 7f81281ea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81200af450 0x7f81200cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.489 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.484+0000 7f81281ea700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f81200b1f80 0x7f81200cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.484+0000 7f81281ea700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812006b590 con 0x7f81200af080 2023-03-03T06:26:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.484+0000 7f81281ea700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812006b870 con 0x7f81200b1f80 2023-03-03T06:26:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.484+0000 7f81281ea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812006bb50 con 0x7f81200af450 2023-03-03T06:26:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.484+0000 7f8125f86700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f81200af080 0x7f81200b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36312/0 (socket says 172.21.15.5:36312) 2023-03-03T06:26:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.484+0000 7f8125f86700 1 -- 172.21.15.5:0/1918599507 learned_addr learned my addr 172.21.15.5:0/1918599507 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.484+0000 7f8125785700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81200af450 0x7f81200cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.490 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.484+0000 7f8126787700 1 --2- 172.21.15.5:0/1918599507 >> v2:172.21.15.191:3300/0 conn(0x7f81200b1f80 0x7f81200cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.484+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516322667 0 0) 0x7f812006b590 con 0x7f81200af080 2023-03-03T06:26:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.484+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f810c0035b0 con 0x7f81200af080 2023-03-03T06:26:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1370655069 0 0) 0x7f810c0035b0 con 0x7f81200af080 2023-03-03T06:26:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81200af450 msgr2=0x7f81200cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81200af450 0x7f81200cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 >> v2:172.21.15.191:3300/0 conn(0x7f81200b1f80 msgr2=0x7f81200cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:30.491 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 --2- 172.21.15.5:0/1918599507 >> v2:172.21.15.191:3300/0 conn(0x7f81200b1f80 0x7f81200cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812006be30 con 0x7f81200af080 2023-03-03T06:26:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f8110001670 con 0x7f81200af080 2023-03-03T06:26:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8125785700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81200af450 0x7f81200cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:26:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 >> v1:172.21.15.5:6789/0 conn(0x7f81200af080 legacy=0x7f81200b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81200af450 0x7f810c003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f810c003fb0 0x7f810c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.492 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f810c004d90 0x7f810c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812006b870 con 0x7f810c003fb0 2023-03-03T06:26:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812006bb50 con 0x7f810c004d90 2023-03-03T06:26:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c00ba60 con 0x7f81200af450 2023-03-03T06:26:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8125785700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f810c003fb0 0x7f810c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8125f86700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81200af450 0x7f810c003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8126787700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f810c004d90 0x7f810c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.493 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8125785700 1 -- 172.21.15.5:0/1918599507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81200af450 msgr2=0x7f810c003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:30.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8125785700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81200af450 0x7f810c003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8125785700 1 -- 172.21.15.5:0/1918599507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f810c004d90 msgr2=0x7f810c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:30.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8125785700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f810c004d90 0x7f810c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8125785700 1 -- 172.21.15.5:0/1918599507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c0094a0 con 0x7f810c003fb0 2023-03-03T06:26:30.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8126787700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f810c004d90 0x7f810c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:30.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8125785700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f810c003fb0 0x7f810c004850 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f811c009d30 tx=0x7f810c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f61a86d4b82d28 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:30.494 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c009e80 con 0x7f810c003fb0 2023-03-03T06:26:30.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c00e9a0 con 0x7f810c003fb0 2023-03-03T06:26:30.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.485+0000 7f8124f84700 1 -- 172.21.15.5:0/1918599507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c00ed10 con 0x7f810c003fb0 2023-03-03T06:26:30.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.486+0000 7f81281ea700 1 -- 172.21.15.5:0/1918599507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f810c003fb0 msgr2=0x7f810c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.486+0000 7f81281ea700 1 --2- 172.21.15.5:0/1918599507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f810c003fb0 0x7f810c004850 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f811c009d30 tx=0x7f810c005880 comp rx=0 tx=0).stop 2023-03-03T06:26:30.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.486+0000 7f8126787700 1 -- 172.21.15.5:0/1918599507 reap_dead start 2023-03-03T06:26:30.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.486+0000 7f81281ea700 1 -- 172.21.15.5:0/1918599507 shutdown_connections 2023-03-03T06:26:30.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.486+0000 7f81281ea700 1 -- 172.21.15.5:0/1918599507 >> 172.21.15.5:0/1918599507 conn(0x7f812006ea70 msgr2=0x7f81200cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:30.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.486+0000 7f81281ea700 1 -- 172.21.15.5:0/1918599507 shutdown_connections 2023-03-03T06:26:30.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.486+0000 7f81281ea700 1 -- 172.21.15.5:0/1918599507 wait complete. 2023-03-03T06:26:30.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.487+0000 7f81281ea700 1 Processor -- start 2023-03-03T06:26:30.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.487+0000 7f81281ea700 1 -- start start 2023-03-03T06:26:30.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f81281ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f810c003fb0 0x7f81201523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f81281ea700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81201572c0 0x7f81200cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f81281ea700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81201587f0 0x7f812015f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f81281ea700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81201528f0 con 0x7f810c003fb0 2023-03-03T06:26:30.499 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f81281ea700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8120157750 con 0x7f81201587f0 2023-03-03T06:26:30.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f81281ea700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8120157a30 con 0x7f81201572c0 2023-03-03T06:26:30.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f8125f86700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f810c003fb0 0x7f81201523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f8125f86700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f810c003fb0 0x7f81201523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46482/0 (socket says 172.21.15.5:46482) 2023-03-03T06:26:30.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f8125f86700 1 -- 172.21.15.5:0/958718551 learned_addr learned my addr 172.21.15.5:0/958718551 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:30.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f8126787700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81201587f0 0x7f812015f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.500 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f8125785700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81201572c0 0x7f81200cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f8125f86700 1 -- 172.21.15.5:0/958718551 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81201572c0 msgr2=0x7f81200cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f8125f86700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81201572c0 0x7f81200cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f8125f86700 1 -- 172.21.15.5:0/958718551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81201587f0 msgr2=0x7f812015f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f8125f86700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81201587f0 0x7f812015f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.501 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f8125f86700 1 -- 172.21.15.5:0/958718551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812006d370 con 0x7f810c003fb0 2023-03-03T06:26:30.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f8126787700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81201587f0 0x7f812015f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:30.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.488+0000 7f8125785700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81201572c0 0x7f81200cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:30.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.489+0000 7f8125f86700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f810c003fb0 0x7f81201523b0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8110007310 tx=0x7f81100076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:30.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.489+0000 7f81167fc700 1 -- 172.21.15.5:0/958718551 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100077f0 con 0x7f810c003fb0 2023-03-03T06:26:30.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.489+0000 7f81167fc700 1 -- 172.21.15.5:0/958718551 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811000f8d0 con 0x7f810c003fb0 2023-03-03T06:26:30.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.489+0000 7f81281ea700 1 -- 172.21.15.5:0/958718551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812006c110 con 0x7f810c003fb0 2023-03-03T06:26:30.502 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.489+0000 7f81167fc700 1 -- 172.21.15.5:0/958718551 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811000fca0 con 0x7f810c003fb0 2023-03-03T06:26:30.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.489+0000 7f81281ea700 1 -- 172.21.15.5:0/958718551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812006cb70 con 0x7f810c003fb0 2023-03-03T06:26:30.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.490+0000 7f81281ea700 1 -- 172.21.15.5:0/958718551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8120067cd0 con 0x7f810c003fb0 2023-03-03T06:26:30.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.490+0000 7f81167fc700 1 -- 172.21.15.5:0/958718551 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f811001d460 con 0x7f810c003fb0 2023-03-03T06:26:30.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.491+0000 7f81167fc700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8104068320 0x7f810406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.491+0000 7f8125785700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8104068320 0x7f810406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.491+0000 7f81167fc700 1 -- 172.21.15.5:0/958718551 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7445+0+0 (secure 0 0 0) 0x7f8110086380 con 0x7f810c003fb0 2023-03-03T06:26:30.503 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.491+0000 7f8125785700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8104068320 0x7f810406a7d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8120153d70 tx=0x7f811c008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:30.504 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.495+0000 7f81167fc700 1 -- 172.21.15.5:0/958718551 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8110052610 con 0x7f810c003fb0 2023-03-03T06:26:30.689 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.687+0000 7f81281ea700 1 -- 172.21.15.5:0/958718551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f812004e6e0 con 0x7f810c003fb0 2023-03-03T06:26:30.690 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.688+0000 7f81167fc700 1 -- 172.21.15.5:0/958718551 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+23170 (secure 0 0 0) 0x7f8110055c30 con 0x7f810c003fb0 2023-03-03T06:26:30.691 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:30.692 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":84,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:26:29.967743+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_data_pool","create_time":"2023-03-03T06:26:03.629103+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":72,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"test_metadata_pool","create_time":"2023-03-03T06:26:04.826705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:26:28.144189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-03-03T06:26:28.941035+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:26:30.693 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.690+0000 7f81281ea700 1 -- 172.21.15.5:0/958718551 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8104068320 msgr2=0x7f810406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.690+0000 7f81281ea700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8104068320 0x7f810406a7d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8120153d70 tx=0x7f811c008030 comp rx=0 tx=0).stop 2023-03-03T06:26:30.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.690+0000 7f81281ea700 1 -- 172.21.15.5:0/958718551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f810c003fb0 msgr2=0x7f81201523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.690+0000 7f81281ea700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f810c003fb0 0x7f81201523b0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8110007310 tx=0x7f81100076d0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.694 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.690+0000 7f81281ea700 1 -- 172.21.15.5:0/958718551 shutdown_connections 2023-03-03T06:26:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.690+0000 7f81281ea700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81201587f0 0x7f812015f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.690+0000 7f81281ea700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f810c003fb0 0x7f81201523b0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.690+0000 7f81281ea700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f8104068320 0x7f810406a7d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.695 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.690+0000 7f81281ea700 1 --2- 172.21.15.5:0/958718551 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81201572c0 0x7f81200cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.690+0000 7f81281ea700 1 -- 172.21.15.5:0/958718551 >> 172.21.15.5:0/958718551 conn(0x7f812006ea70 msgr2=0x7f81200b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.691+0000 7f81281ea700 1 -- 172.21.15.5:0/958718551 shutdown_connections 2023-03-03T06:26:30.696 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.691+0000 7f81281ea700 1 -- 172.21.15.5:0/958718551 wait complete. 2023-03-03T06:26:30.705 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-03-03T06:26:30.833 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.831+0000 7efe68d13700 1 Processor -- start 2023-03-03T06:26:30.834 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.831+0000 7efe68d13700 1 -- start start 2023-03-03T06:26:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.832+0000 7efe68d13700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7efe640b55b0 0x7efe6415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.832+0000 7efe68d13700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe640cd500 0x7efe640b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.832+0000 7efe68d13700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe640cc5d0 con 0x7efe640b1e10 2023-03-03T06:26:30.836 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.832+0000 7efe68d13700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6415e290 con 0x7efe640cd500 2023-03-03T06:26:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.832+0000 7efe68d13700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe640b2250 con 0x7efe640b55b0 2023-03-03T06:26:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.832+0000 7efe61d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe640cd500 0x7efe640b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.832+0000 7efe61d9b700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7efe640cd500 0x7efe640b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46490/0 (socket says 172.21.15.5:46490) 2023-03-03T06:26:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.832+0000 7efe61d9b700 1 -- 172.21.15.5:0/1290263617 learned_addr learned my addr 172.21.15.5:0/1290263617 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.833+0000 7efe6259c700 1 --2- 172.21.15.5:0/1290263617 >> v2:172.21.15.191:3300/0 conn(0x7efe640b55b0 0x7efe6415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.837 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.833+0000 7efe61d9b700 1 -- 172.21.15.5:0/1290263617 >> v2:172.21.15.191:3300/0 conn(0x7efe640b55b0 msgr2=0x7efe6415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.833+0000 7efe61d9b700 1 --2- 172.21.15.5:0/1290263617 >> v2:172.21.15.191:3300/0 conn(0x7efe640b55b0 0x7efe6415dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.833+0000 7efe61d9b700 1 -- 172.21.15.5:0/1290263617 >> v1:172.21.15.191:6789/0 conn(0x7efe640b1e10 legacy=0x7efe6406bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.833+0000 7efe61d9b700 1 -- 172.21.15.5:0/1290263617 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe64159c30 con 0x7efe640cd500 2023-03-03T06:26:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.833+0000 7efe61d9b700 1 --2- 172.21.15.5:0/1290263617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe640cd500 0x7efe640b18d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7efe64068620 tx=0x7efe54009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75222bd3d84fe7ad server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.833+0000 7efe6159a700 1 -- 172.21.15.5:0/1290263617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54004230 con 0x7efe640cd500 2023-03-03T06:26:30.838 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.833+0000 7efe6159a700 1 -- 172.21.15.5:0/1290263617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe54004390 con 0x7efe640cd500 2023-03-03T06:26:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.833+0000 7efe6159a700 1 -- 172.21.15.5:0/1290263617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe540036a0 con 0x7efe640cd500 2023-03-03T06:26:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.834+0000 7efe68d13700 1 -- 172.21.15.5:0/1290263617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe640cd500 msgr2=0x7efe640b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.834+0000 7efe68d13700 1 --2- 172.21.15.5:0/1290263617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe640cd500 0x7efe640b18d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7efe64068620 tx=0x7efe54009bd0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.834+0000 7efe68d13700 1 -- 172.21.15.5:0/1290263617 shutdown_connections 2023-03-03T06:26:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.834+0000 7efe68d13700 1 --2- 172.21.15.5:0/1290263617 >> v2:172.21.15.191:3300/0 conn(0x7efe640b55b0 0x7efe6415dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.839 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.834+0000 7efe68d13700 1 --2- 172.21.15.5:0/1290263617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe640cd500 0x7efe640b18d0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.834+0000 7efe68d13700 1 -- 172.21.15.5:0/1290263617 >> 172.21.15.5:0/1290263617 conn(0x7efe640cc8d0 msgr2=0x7efe640cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.834+0000 7efe68d13700 1 -- 172.21.15.5:0/1290263617 shutdown_connections 2023-03-03T06:26:30.840 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.834+0000 7efe68d13700 1 -- 172.21.15.5:0/1290263617 wait complete. 2023-03-03T06:26:30.843 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.835+0000 7efe68d13700 1 Processor -- start 2023-03-03T06:26:30.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.835+0000 7efe68d13700 1 -- start start 2023-03-03T06:26:30.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe68d13700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe640b1e10 0x7efe640b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe68d13700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe640b55b0 0x7efe640b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe68d13700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe640cd500 0x7efe64154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe68d13700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe640b4ad0 con 0x7efe640b1e10 2023-03-03T06:26:30.844 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe68d13700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe640b47f0 con 0x7efe640cd500 2023-03-03T06:26:30.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe68d13700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe640b0620 con 0x7efe640b55b0 2023-03-03T06:26:30.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe6259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe640b1e10 0x7efe640b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe6259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe640b1e10 0x7efe640b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46496/0 (socket says 172.21.15.5:46496) 2023-03-03T06:26:30.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe6259c700 1 -- 172.21.15.5:0/2661518338 learned_addr learned my addr 172.21.15.5:0/2661518338 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:30.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe62d9d700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe640cd500 0x7efe64154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.845 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe61d9b700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe640b55b0 0x7efe640b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe6259c700 1 -- 172.21.15.5:0/2661518338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe640b55b0 msgr2=0x7efe640b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe6259c700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe640b55b0 0x7efe640b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe6259c700 1 -- 172.21.15.5:0/2661518338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe640cd500 msgr2=0x7efe64154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:30.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe6259c700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe640cd500 0x7efe64154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:30.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe6259c700 1 -- 172.21.15.5:0/2661518338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe54009550 con 0x7efe640b1e10 2023-03-03T06:26:30.846 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe62d9d700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe640cd500 0x7efe64154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:30.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe61d9b700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe640b55b0 0x7efe640b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:30.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.836+0000 7efe6259c700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe640b1e10 0x7efe640b3840 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7efe5800c7f0 tx=0x7efe5800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:30.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.837+0000 7efe52ffd700 1 -- 172.21.15.5:0/2661518338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58011800 con 0x7efe640b1e10 2023-03-03T06:26:30.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.837+0000 7efe52ffd700 1 -- 172.21.15.5:0/2661518338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58011960 con 0x7efe640b1e10 2023-03-03T06:26:30.847 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.837+0000 7efe52ffd700 1 -- 172.21.15.5:0/2661518338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58011cf0 con 0x7efe640b1e10 2023-03-03T06:26:30.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.837+0000 7efe68d13700 1 -- 172.21.15.5:0/2661518338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe640cb9c0 con 0x7efe640b1e10 2023-03-03T06:26:30.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.837+0000 7efe68d13700 1 -- 172.21.15.5:0/2661518338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe640b5980 con 0x7efe640b1e10 2023-03-03T06:26:30.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.838+0000 7efe68d13700 1 -- 172.21.15.5:0/2661518338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe640cbca0 con 0x7efe640b1e10 2023-03-03T06:26:30.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.838+0000 7efe52ffd700 1 -- 172.21.15.5:0/2661518338 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7efe58021070 con 0x7efe640b1e10 2023-03-03T06:26:30.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.838+0000 7efe52ffd700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe440682f0 0x7efe4406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:30.848 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.839+0000 7efe52ffd700 1 -- 172.21.15.5:0/2661518338 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7445+0+0 (secure 0 0 0) 0x7efe58086130 con 0x7efe640b1e10 2023-03-03T06:26:30.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.839+0000 7efe61d9b700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe440682f0 0x7efe4406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:30.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.839+0000 7efe61d9b700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe440682f0 0x7efe4406a7a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efe54009130 tx=0x7efe54008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:30.849 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:30.843+0000 7efe52ffd700 1 -- 172.21.15.5:0/2661518338 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7efe580523a0 con 0x7efe640b1e10 2023-03-03T06:26:31.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.083+0000 7efe68d13700 1 -- 172.21.15.5:0/2661518338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efe6404e6e0 con 0x7efe640b1e10 2023-03-03T06:26:31.979 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.977+0000 7efe52ffd700 1 -- 172.21.15.5:0/2661518338 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7efe5801f020 con 0x7efe640b1e10 2023-03-03T06:26:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.980+0000 7efe68d13700 1 -- 172.21.15.5:0/2661518338 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe440682f0 msgr2=0x7efe4406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.980+0000 7efe68d13700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe440682f0 0x7efe4406a7a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efe54009130 tx=0x7efe54008030 comp rx=0 tx=0).stop 2023-03-03T06:26:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.980+0000 7efe68d13700 1 -- 172.21.15.5:0/2661518338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe640b1e10 msgr2=0x7efe640b3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:31.982 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.980+0000 7efe68d13700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe640b1e10 0x7efe640b3840 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7efe5800c7f0 tx=0x7efe5800cbb0 comp rx=0 tx=0).stop 2023-03-03T06:26:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.980+0000 7efe68d13700 1 -- 172.21.15.5:0/2661518338 shutdown_connections 2023-03-03T06:26:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.980+0000 7efe68d13700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe640cd500 0x7efe64154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.980+0000 7efe68d13700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe640b1e10 0x7efe640b3840 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.980+0000 7efe68d13700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7efe440682f0 0x7efe4406a7a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.980+0000 7efe68d13700 1 --2- 172.21.15.5:0/2661518338 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe640b55b0 0x7efe640b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.980+0000 7efe68d13700 1 -- 172.21.15.5:0/2661518338 >> 172.21.15.5:0/2661518338 conn(0x7efe640cc8d0 msgr2=0x7efe640af990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.980+0000 7efe68d13700 1 -- 172.21.15.5:0/2661518338 shutdown_connections 2023-03-03T06:26:31.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:31.980+0000 7efe68d13700 1 -- 172.21.15.5:0/2661518338 wait complete. 2023-03-03T06:26:31.997 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-03-03T06:26:31.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-03-03T06:26:32.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.130+0000 7f7c6670f700 1 Processor -- start 2023-03-03T06:26:32.132 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.130+0000 7f7c6670f700 1 -- start start 2023-03-03T06:26:32.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.131+0000 7f7c6670f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c600cd3e0 0x7f7c600cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:32.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.131+0000 7f7c6670f700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6015e160 con 0x7f7c600b1fe0 2023-03-03T06:26:32.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.131+0000 7f7c6670f700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6015d110 con 0x7f7c6015cd40 2023-03-03T06:26:32.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.131+0000 7f7c6670f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c600cd870 con 0x7f7c600cd3e0 2023-03-03T06:26:32.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.131+0000 7f7c64cac700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7c600b1fe0 0x7f7c600ce290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36350/0 (socket says 172.21.15.5:36350) 2023-03-03T06:26:32.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.131+0000 7f7c64cac700 1 -- 172.21.15.5:0/3057742681 learned_addr learned my addr 172.21.15.5:0/3057742681 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:32.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.131+0000 7f7c5f7fe700 1 --2- 172.21.15.5:0/3057742681 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c600cd3e0 0x7f7c600cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:32.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.131+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251679582 0 0) 0x7f7c6015e160 con 0x7f7c600b1fe0 2023-03-03T06:26:32.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.131+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c480035b0 con 0x7f7c600b1fe0 2023-03-03T06:26:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.131+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329798433 0 0) 0x7f7c6015d110 con 0x7f7c6015cd40 2023-03-03T06:26:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.131+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c6015e160 con 0x7f7c6015cd40 2023-03-03T06:26:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2153236263 0 0) 0x7f7c480035b0 con 0x7f7c600b1fe0 2023-03-03T06:26:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c600cd3e0 msgr2=0x7f7c600cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 --2- 172.21.15.5:0/3057742681 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c600cd3e0 0x7f7c600cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 >> v1:172.21.15.191:6789/0 conn(0x7f7c6015cd40 legacy=0x7f7c600b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 --> v1:172.21.15.5:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6015d3c0 con 0x7f7c600b1fe0 2023-03-03T06:26:32.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 <== mon.0 v1:172.21.15.5:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4237789795 0 0) 0x7f7c580019f0 con 0x7f7c600b1fe0 2023-03-03T06:26:32.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 >> v1:172.21.15.5:6789/0 conn(0x7f7c600b1fe0 legacy=0x7f7c600ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:32.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 --2- 172.21.15.5:0/3057742681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c48003bc0 0x7f7c48003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:32.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 --2- 172.21.15.5:0/3057742681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c48004850 0x7f7c48004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:32.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 --2- 172.21.15.5:0/3057742681 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c600cd3e0 0x7f7c48005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:32.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c600cd870 con 0x7f7c48003bc0 2023-03-03T06:26:32.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4800bbd0 con 0x7f7c48004850 2023-03-03T06:26:32.138 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4800bd90 con 0x7f7c600cd3e0 2023-03-03T06:26:32.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5ffff700 1 --2- 172.21.15.5:0/3057742681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c48003bc0 0x7f7c48003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:32.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5f7fe700 1 --2- 172.21.15.5:0/3057742681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c48004850 0x7f7c48004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:32.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c64cac700 1 --2- 172.21.15.5:0/3057742681 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c600cd3e0 0x7f7c48005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:32.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5ffff700 1 -- 172.21.15.5:0/3057742681 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c600cd3e0 msgr2=0x7f7c48005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:32.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5ffff700 1 --2- 172.21.15.5:0/3057742681 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c600cd3e0 0x7f7c48005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:32.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5ffff700 1 -- 172.21.15.5:0/3057742681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c48004850 msgr2=0x7f7c48004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:32.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5ffff700 1 --2- 172.21.15.5:0/3057742681 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c48004850 0x7f7c48004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:32.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5ffff700 1 -- 172.21.15.5:0/3057742681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480035b0 con 0x7f7c48003bc0 2023-03-03T06:26:32.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5ffff700 1 --2- 172.21.15.5:0/3057742681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c48003bc0 0x7f7c48003fb0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7c50001940 tx=0x7f7c48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d2c9b8022a2d72 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:32.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50001430 con 0x7f7c48003bc0 2023-03-03T06:26:32.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50001d70 con 0x7f7c48003bc0 2023-03-03T06:26:32.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.132+0000 7f7c5effd700 1 -- 172.21.15.5:0/3057742681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50005510 con 0x7f7c48003bc0 2023-03-03T06:26:32.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.133+0000 7f7c6670f700 1 -- 172.21.15.5:0/3057742681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c48003bc0 msgr2=0x7f7c48003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:32.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.133+0000 7f7c6670f700 1 --2- 172.21.15.5:0/3057742681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c48003bc0 0x7f7c48003fb0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7c50001940 tx=0x7f7c48005880 comp rx=0 tx=0).stop 2023-03-03T06:26:32.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.133+0000 7f7c64cac700 1 -- 172.21.15.5:0/3057742681 reap_dead start 2023-03-03T06:26:32.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.133+0000 7f7c6670f700 1 -- 172.21.15.5:0/3057742681 shutdown_connections 2023-03-03T06:26:32.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.133+0000 7f7c6670f700 1 -- 172.21.15.5:0/3057742681 >> 172.21.15.5:0/3057742681 conn(0x7f7c600cc8d0 msgr2=0x7f7c600cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:32.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.133+0000 7f7c6670f700 1 -- 172.21.15.5:0/3057742681 shutdown_connections 2023-03-03T06:26:32.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.133+0000 7f7c6670f700 1 -- 172.21.15.5:0/3057742681 wait complete. 2023-03-03T06:26:32.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.134+0000 7f7c6670f700 1 Processor -- start 2023-03-03T06:26:32.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.134+0000 7f7c6670f700 1 -- start start 2023-03-03T06:26:32.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c6670f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c48003bc0 0x7f7c6006c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:32.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c6670f700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c60157140 0x7f7c60156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:32.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c6670f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c60157d50 0x7f7c601581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:32.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c6670f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60158710 con 0x7f7c60157d50 2023-03-03T06:26:32.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c6670f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6015ab20 con 0x7f7c48003bc0 2023-03-03T06:26:32.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c6670f700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60156f70 con 0x7f7c60157140 2023-03-03T06:26:32.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c64cac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c60157d50 0x7f7c601581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:32.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c64cac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c60157d50 0x7f7c601581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46520/0 (socket says 172.21.15.5:46520) 2023-03-03T06:26:32.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c64cac700 1 -- 172.21.15.5:0/237203493 learned_addr learned my addr 172.21.15.5:0/237203493 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:32.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c5f7fe700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c60157140 0x7f7c60156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:32.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c5ffff700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c48003bc0 0x7f7c6006c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:32.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c64cac700 1 -- 172.21.15.5:0/237203493 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c60157140 msgr2=0x7f7c60156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:32.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c64cac700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c60157140 0x7f7c60156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:32.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c64cac700 1 -- 172.21.15.5:0/237203493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c48003bc0 msgr2=0x7f7c6006c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:32.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c64cac700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c48003bc0 0x7f7c6006c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:32.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.135+0000 7f7c64cac700 1 -- 172.21.15.5:0/237203493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6015d980 con 0x7f7c60157d50 2023-03-03T06:26:32.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.136+0000 7f7c64cac700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c60157d50 0x7f7c601581d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f7c600b23d0 tx=0x7f7c5800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:32.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.136+0000 7f7c5cff9700 1 -- 172.21.15.5:0/237203493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58017070 con 0x7f7c60157d50 2023-03-03T06:26:32.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.136+0000 7f7c5cff9700 1 -- 172.21.15.5:0/237203493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5800eb50 con 0x7f7c60157d50 2023-03-03T06:26:32.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.136+0000 7f7c6670f700 1 -- 172.21.15.5:0/237203493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6015d6a0 con 0x7f7c60157d50 2023-03-03T06:26:32.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.136+0000 7f7c5cff9700 1 -- 172.21.15.5:0/237203493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5800ed00 con 0x7f7c60157d50 2023-03-03T06:26:32.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.136+0000 7f7c6670f700 1 -- 172.21.15.5:0/237203493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6015dc60 con 0x7f7c60157d50 2023-03-03T06:26:32.146 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.137+0000 7f7c6670f700 1 -- 172.21.15.5:0/237203493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6004e6e0 con 0x7f7c60157d50 2023-03-03T06:26:32.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.137+0000 7f7c5cff9700 1 -- 172.21.15.5:0/237203493 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7c58013420 con 0x7f7c60157d50 2023-03-03T06:26:32.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.138+0000 7f7c5cff9700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c4c0682f0 0x7f7c4c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:32.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.138+0000 7f7c5cff9700 1 -- 172.21.15.5:0/237203493 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7445+0+0 (secure 0 0 0) 0x7f7c58085e80 con 0x7f7c60157d50 2023-03-03T06:26:32.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.138+0000 7f7c5ffff700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c4c0682f0 0x7f7c4c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:32.147 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.138+0000 7f7c5ffff700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c4c0682f0 0x7f7c4c06a7a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7c50015040 tx=0x7f7c5000a000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:32.148 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.142+0000 7f7c5cff9700 1 -- 172.21.15.5:0/237203493 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7c58052110 con 0x7f7c60157d50 2023-03-03T06:26:32.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.381+0000 7f7c6670f700 1 -- 172.21.15.5:0/237203493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7c600b25e0 con 0x7f7c60157d50 2023-03-03T06:26:32.980 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.978+0000 7f7c5cff9700 1 -- 172.21.15.5:0/237203493 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7c58055730 con 0x7f7c60157d50 2023-03-03T06:26:32.983 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.981+0000 7f7c6670f700 1 -- 172.21.15.5:0/237203493 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c4c0682f0 msgr2=0x7f7c4c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:32.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.981+0000 7f7c6670f700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c4c0682f0 0x7f7c4c06a7a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7c50015040 tx=0x7f7c5000a000 comp rx=0 tx=0).stop 2023-03-03T06:26:32.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.981+0000 7f7c6670f700 1 -- 172.21.15.5:0/237203493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c60157d50 msgr2=0x7f7c601581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:32.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.981+0000 7f7c6670f700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c60157d50 0x7f7c601581d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f7c600b23d0 tx=0x7f7c5800e440 comp rx=0 tx=0).stop 2023-03-03T06:26:32.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.981+0000 7f7c6670f700 1 -- 172.21.15.5:0/237203493 shutdown_connections 2023-03-03T06:26:32.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.981+0000 7f7c6670f700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c60157d50 0x7f7c601581d0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:32.984 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.981+0000 7f7c6670f700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c48003bc0 0x7f7c6006c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:32.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.981+0000 7f7c6670f700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f7c4c0682f0 0x7f7c4c06a7a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:32.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.981+0000 7f7c6670f700 1 --2- 172.21.15.5:0/237203493 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7c60157140 0x7f7c60156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:32.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.981+0000 7f7c6670f700 1 -- 172.21.15.5:0/237203493 >> 172.21.15.5:0/237203493 conn(0x7f7c600cc8d0 msgr2=0x7f7c6015e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:32.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.981+0000 7f7c6670f700 1 -- 172.21.15.5:0/237203493 shutdown_connections 2023-03-03T06:26:32.985 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:32.981+0000 7f7c6670f700 1 -- 172.21.15.5:0/237203493 wait complete. 2023-03-03T06:26:32.999 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-03-03T06:26:33.000 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:26:33.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.131+0000 7f810c6d2700 1 Processor -- start 2023-03-03T06:26:33.133 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.131+0000 7f810c6d2700 1 -- start start 2023-03-03T06:26:33.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.132+0000 7f810c6d2700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f81040af080 0x7f81040cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.132+0000 7f810c6d2700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f81040b1f80 0x7f81040cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.132+0000 7f810c6d2700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810406b590 con 0x7f81040af450 2023-03-03T06:26:33.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.132+0000 7f810c6d2700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810406b870 con 0x7f81040b1f80 2023-03-03T06:26:33.135 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.132+0000 7f810c6d2700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810406bb50 con 0x7f81040af080 2023-03-03T06:26:33.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.132+0000 7f810ac6f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f81040b1f80 0x7f81040cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.132+0000 7f810ac6f700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f81040b1f80 0x7f81040cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46528/0 (socket says 172.21.15.5:46528) 2023-03-03T06:26:33.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.132+0000 7f810ac6f700 1 -- 172.21.15.5:0/2851647513 learned_addr learned my addr 172.21.15.5:0/2851647513 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:33.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.132+0000 7f810a46e700 1 --2- 172.21.15.5:0/2851647513 >> v2:172.21.15.191:3300/0 conn(0x7f81040af080 0x7f81040cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.133+0000 7f810ac6f700 1 -- 172.21.15.5:0/2851647513 >> v2:172.21.15.191:3300/0 conn(0x7f81040af080 msgr2=0x7f81040cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:33.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.133+0000 7f810ac6f700 1 --2- 172.21.15.5:0/2851647513 >> v2:172.21.15.191:3300/0 conn(0x7f81040af080 0x7f81040cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.133+0000 7f810ac6f700 1 -- 172.21.15.5:0/2851647513 >> v1:172.21.15.191:6789/0 conn(0x7f81040af450 legacy=0x7f81040b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:33.136 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.133+0000 7f810ac6f700 1 -- 172.21.15.5:0/2851647513 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810406be30 con 0x7f81040b1f80 2023-03-03T06:26:33.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.133+0000 7f810a46e700 1 --2- 172.21.15.5:0/2851647513 >> v2:172.21.15.191:3300/0 conn(0x7f81040af080 0x7f81040cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:33.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.133+0000 7f810ac6f700 1 --2- 172.21.15.5:0/2851647513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81040b1f80 0x7f81040cd9c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f81040cabf0 tx=0x7f80fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07394fd06aa4080 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:33.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.133+0000 7f810946c700 1 -- 172.21.15.5:0/2851647513 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc00e070 con 0x7f81040b1f80 2023-03-03T06:26:33.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.133+0000 7f810946c700 1 -- 172.21.15.5:0/2851647513 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc003a20 con 0x7f81040b1f80 2023-03-03T06:26:33.137 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.133+0000 7f810946c700 1 -- 172.21.15.5:0/2851647513 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc003dd0 con 0x7f81040b1f80 2023-03-03T06:26:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.133+0000 7f810c6d2700 1 -- 172.21.15.5:0/2851647513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81040b1f80 msgr2=0x7f81040cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.139 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.133+0000 7f810c6d2700 1 --2- 172.21.15.5:0/2851647513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81040b1f80 0x7f81040cd9c0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f81040cabf0 tx=0x7f80fc00b330 comp rx=0 tx=0).stop 2023-03-03T06:26:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.134+0000 7f810c6d2700 1 -- 172.21.15.5:0/2851647513 shutdown_connections 2023-03-03T06:26:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.134+0000 7f810c6d2700 1 --2- 172.21.15.5:0/2851647513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81040b1f80 0x7f81040cd9c0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.134+0000 7f810c6d2700 1 --2- 172.21.15.5:0/2851647513 >> v2:172.21.15.191:3300/0 conn(0x7f81040af080 0x7f81040cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.134+0000 7f810c6d2700 1 -- 172.21.15.5:0/2851647513 >> 172.21.15.5:0/2851647513 conn(0x7f810406ea70 msgr2=0x7f81040cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.134+0000 7f810c6d2700 1 -- 172.21.15.5:0/2851647513 shutdown_connections 2023-03-03T06:26:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.134+0000 7f810c6d2700 1 -- 172.21.15.5:0/2851647513 wait complete. 2023-03-03T06:26:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.135+0000 7f810c6d2700 1 Processor -- start 2023-03-03T06:26:33.140 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.135+0000 7f810c6d2700 1 -- start start 2023-03-03T06:26:33.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f810c6d2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81040af080 0x7f81040c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f810c6d2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81040af450 0x7f81040acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f810c6d2700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81040b1f80 0x7f81040ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f810c6d2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810415e370 con 0x7f81040af450 2023-03-03T06:26:33.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f810c6d2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81040ad600 con 0x7f81040af080 2023-03-03T06:26:33.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f810c6d2700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81040ad8b0 con 0x7f81040b1f80 2023-03-03T06:26:33.141 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f8109c6d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81040af450 0x7f81040acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f8109c6d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81040af450 0x7f81040acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46532/0 (socket says 172.21.15.5:46532) 2023-03-03T06:26:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f8109c6d700 1 -- 172.21.15.5:0/3249036186 learned_addr learned my addr 172.21.15.5:0/3249036186 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f810a46e700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81040af080 0x7f81040c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f810ac6f700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81040b1f80 0x7f81040ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f8109c6d700 1 -- 172.21.15.5:0/3249036186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81040b1f80 msgr2=0x7f81040ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f8109c6d700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81040b1f80 0x7f81040ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f8109c6d700 1 -- 172.21.15.5:0/3249036186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81040af080 msgr2=0x7f81040c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.142 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f8109c6d700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81040af080 0x7f81040c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f8109c6d700 1 -- 172.21.15.5:0/3249036186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc009b30 con 0x7f81040af450 2023-03-03T06:26:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f810a46e700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81040af080 0x7f81040c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f8109c6d700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81040af450 0x7f81040acb80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f80f400c4d0 tx=0x7f80f400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f80faffd700 1 -- 172.21.15.5:0/3249036186 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4011790 con 0x7f81040af450 2023-03-03T06:26:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f80faffd700 1 -- 172.21.15.5:0/3249036186 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f40118f0 con 0x7f81040af450 2023-03-03T06:26:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f80faffd700 1 -- 172.21.15.5:0/3249036186 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4011ca0 con 0x7f81040af450 2023-03-03T06:26:33.143 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f810c6d2700 1 -- 172.21.15.5:0/3249036186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810406d370 con 0x7f81040af450 2023-03-03T06:26:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.136+0000 7f810c6d2700 1 -- 172.21.15.5:0/3249036186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810406c110 con 0x7f81040af450 2023-03-03T06:26:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.137+0000 7f810c6d2700 1 -- 172.21.15.5:0/3249036186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810406cb70 con 0x7f81040af450 2023-03-03T06:26:33.144 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.138+0000 7f80faffd700 1 -- 172.21.15.5:0/3249036186 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f80f4010050 con 0x7f81040af450 2023-03-03T06:26:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.138+0000 7f80faffd700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f80e80682f0 0x7f80e806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.138+0000 7f80faffd700 1 -- 172.21.15.5:0/3249036186 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7445+0+0 (secure 0 0 0) 0x7f80f4085ee0 con 0x7f81040af450 2023-03-03T06:26:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.138+0000 7f810a46e700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f80e80682f0 0x7f80e806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.139+0000 7f810a46e700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f80e80682f0 0x7f80e806a7a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8100006fd0 tx=0x7f8100008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:33.145 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.143+0000 7f80faffd700 1 -- 172.21.15.5:0/3249036186 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f80f40521d0 con 0x7f81040af450 2023-03-03T06:26:33.384 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.383+0000 7f810c6d2700 1 -- 172.21.15.5:0/3249036186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f810404e6e0 con 0x7f81040af450 2023-03-03T06:26:33.385 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.383+0000 7f80faffd700 1 -- 172.21.15.5:0/3249036186 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f80f40557f0 con 0x7f81040af450 2023-03-03T06:26:33.385 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:33.386 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/4062636088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":4062636088},{"type":"v1","addr":"172.21.15.191:6835","nonce":4062636088}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/2778601100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":2778601100},{"type":"v1","addr":"172.21.15.5:6836","nonce":2778601100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/441439845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":441439845},{"type":"v1","addr":"172.21.15.191:6834","nonce":441439845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:26:29.968069+0000","modified":"2023-03-03T06:26:32.976138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6636},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6636":{"gid":6636,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6837/2017156082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2017156082},{"type":"v1","addr":"172.21.15.5:6837","nonce":2017156082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-03-03T06:26:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.385+0000 7f810c6d2700 1 -- 172.21.15.5:0/3249036186 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f80e80682f0 msgr2=0x7f80e806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.385+0000 7f810c6d2700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f80e80682f0 0x7f80e806a7a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8100006fd0 tx=0x7f8100008040 comp rx=0 tx=0).stop 2023-03-03T06:26:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.385+0000 7f810c6d2700 1 -- 172.21.15.5:0/3249036186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81040af450 msgr2=0x7f81040acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.387 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.385+0000 7f810c6d2700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81040af450 0x7f81040acb80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f80f400c4d0 tx=0x7f80f400c890 comp rx=0 tx=0).stop 2023-03-03T06:26:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.385+0000 7f810c6d2700 1 -- 172.21.15.5:0/3249036186 shutdown_connections 2023-03-03T06:26:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.385+0000 7f810c6d2700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f80e80682f0 0x7f80e806a7a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.385+0000 7f810c6d2700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f81040b1f80 0x7f81040ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.385+0000 7f810c6d2700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f81040af080 0x7f81040c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.385+0000 7f810c6d2700 1 --2- 172.21.15.5:0/3249036186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81040af450 0x7f81040acb80 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.385+0000 7f810c6d2700 1 -- 172.21.15.5:0/3249036186 >> 172.21.15.5:0/3249036186 conn(0x7f810406ea70 msgr2=0x7f81040b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.385+0000 7f810c6d2700 1 -- 172.21.15.5:0/3249036186 shutdown_connections 2023-03-03T06:26:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.385+0000 7f810c6d2700 1 -- 172.21.15.5:0/3249036186 wait complete. 2023-03-03T06:26:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 40 2023-03-03T06:26:33.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-03-03T06:26:33.525 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.523+0000 7fbb37096700 1 Processor -- start 2023-03-03T06:26:33.526 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.523+0000 7fbb37096700 1 -- start start 2023-03-03T06:26:33.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb37096700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbb3015cd40 0x7fbb300b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb37096700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb300cba50 0x7fbb300b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb37096700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb300cd3e0 0x7fbb30160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb37096700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3015d4e0 con 0x7fbb300cd3e0 2023-03-03T06:26:33.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb37096700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3015d7c0 con 0x7fbb3015cd40 2023-03-03T06:26:33.532 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb37096700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3015daa0 con 0x7fbb300cba50 2023-03-03T06:26:33.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb35633700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb300cd3e0 0x7fbb30160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb35633700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbb300cd3e0 0x7fbb30160790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46542/0 (socket says 172.21.15.5:46542) 2023-03-03T06:26:33.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb35633700 1 -- 172.21.15.5:0/971270019 learned_addr learned my addr 172.21.15.5:0/971270019 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:33.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb34e32700 1 --2- 172.21.15.5:0/971270019 >> v2:172.21.15.191:3300/0 conn(0x7fbb3015cd40 0x7fbb300b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb2ffff700 1 --2- 172.21.15.5:0/971270019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb300cba50 0x7fbb300b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb35633700 1 -- 172.21.15.5:0/971270019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb300cba50 msgr2=0x7fbb300b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb35633700 1 --2- 172.21.15.5:0/971270019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb300cba50 0x7fbb300b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb35633700 1 -- 172.21.15.5:0/971270019 >> v2:172.21.15.191:3300/0 conn(0x7fbb3015cd40 msgr2=0x7fbb300b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb35633700 1 --2- 172.21.15.5:0/971270019 >> v2:172.21.15.191:3300/0 conn(0x7fbb3015cd40 0x7fbb300b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb35633700 1 -- 172.21.15.5:0/971270019 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3015dd80 con 0x7fbb300cd3e0 2023-03-03T06:26:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb34e32700 1 --2- 172.21.15.5:0/971270019 >> v2:172.21.15.191:3300/0 conn(0x7fbb3015cd40 0x7fbb300b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb2ffff700 1 --2- 172.21.15.5:0/971270019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb300cba50 0x7fbb300b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.524+0000 7fbb35633700 1 --2- 172.21.15.5:0/971270019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb300cd3e0 0x7fbb30160790 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fbb30071020 tx=0x7fbb2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3549440de5019001 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.525+0000 7fbb2f7fe700 1 -- 172.21.15.5:0/971270019 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2800e070 con 0x7fbb300cd3e0 2023-03-03T06:26:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.525+0000 7fbb2f7fe700 1 -- 172.21.15.5:0/971270019 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2800b9c0 con 0x7fbb300cd3e0 2023-03-03T06:26:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.525+0000 7fbb2f7fe700 1 -- 172.21.15.5:0/971270019 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2800bd70 con 0x7fbb300cd3e0 2023-03-03T06:26:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.525+0000 7fbb37096700 1 -- 172.21.15.5:0/971270019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb300cd3e0 msgr2=0x7fbb30160790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.525+0000 7fbb37096700 1 --2- 172.21.15.5:0/971270019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb300cd3e0 0x7fbb30160790 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fbb30071020 tx=0x7fbb2800b330 comp rx=0 tx=0).stop 2023-03-03T06:26:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.525+0000 7fbb37096700 1 -- 172.21.15.5:0/971270019 shutdown_connections 2023-03-03T06:26:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.525+0000 7fbb37096700 1 --2- 172.21.15.5:0/971270019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb300cd3e0 0x7fbb30160790 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.525+0000 7fbb37096700 1 --2- 172.21.15.5:0/971270019 >> v2:172.21.15.191:3300/0 conn(0x7fbb3015cd40 0x7fbb300b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.525+0000 7fbb37096700 1 --2- 172.21.15.5:0/971270019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb300cba50 0x7fbb300b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.525+0000 7fbb37096700 1 -- 172.21.15.5:0/971270019 >> 172.21.15.5:0/971270019 conn(0x7fbb300cc8d0 msgr2=0x7fbb300cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.525+0000 7fbb37096700 1 -- 172.21.15.5:0/971270019 shutdown_connections 2023-03-03T06:26:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.525+0000 7fbb37096700 1 -- 172.21.15.5:0/971270019 wait complete. 2023-03-03T06:26:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.526+0000 7fbb37096700 1 Processor -- start 2023-03-03T06:26:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.526+0000 7fbb37096700 1 -- start start 2023-03-03T06:26:33.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.527+0000 7fbb37096700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb300cba50 0x7fbb300c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.527+0000 7fbb37096700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb300cd3e0 0x7fbb30149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.527+0000 7fbb37096700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb3015cd40 0x7fbb300ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.527+0000 7fbb37096700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb300c9e20 con 0x7fbb300cba50 2023-03-03T06:26:33.538 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.527+0000 7fbb37096700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3006b8f0 con 0x7fbb300cd3e0 2023-03-03T06:26:33.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.527+0000 7fbb37096700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3006bbd0 con 0x7fbb3015cd40 2023-03-03T06:26:33.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.527+0000 7fbb34e32700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb300cba50 0x7fbb300c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.527+0000 7fbb34e32700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb300cba50 0x7fbb300c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46544/0 (socket says 172.21.15.5:46544) 2023-03-03T06:26:33.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.527+0000 7fbb34e32700 1 -- 172.21.15.5:0/533613566 learned_addr learned my addr 172.21.15.5:0/533613566 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:33.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.528+0000 7fbb35633700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb3015cd40 0x7fbb300ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.528+0000 7fbb2ffff700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb300cd3e0 0x7fbb30149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.528+0000 7fbb34e32700 1 -- 172.21.15.5:0/533613566 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb3015cd40 msgr2=0x7fbb300ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.528+0000 7fbb34e32700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb3015cd40 0x7fbb300ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.528+0000 7fbb34e32700 1 -- 172.21.15.5:0/533613566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb300cd3e0 msgr2=0x7fbb30149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.528+0000 7fbb34e32700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb300cd3e0 0x7fbb30149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.528+0000 7fbb34e32700 1 -- 172.21.15.5:0/533613566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb28009b30 con 0x7fbb300cba50 2023-03-03T06:26:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.528+0000 7fbb34e32700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb300cba50 0x7fbb300c98e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400e810 tx=0x7fbb2400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.528+0000 7fbb2d7fa700 1 -- 172.21.15.5:0/533613566 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2400c020 con 0x7fbb300cba50 2023-03-03T06:26:33.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.528+0000 7fbb2d7fa700 1 -- 172.21.15.5:0/533613566 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb24004250 con 0x7fbb300cba50 2023-03-03T06:26:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.528+0000 7fbb37096700 1 -- 172.21.15.5:0/533613566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb300ca530 con 0x7fbb300cba50 2023-03-03T06:26:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.528+0000 7fbb2d7fa700 1 -- 172.21.15.5:0/533613566 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb240036a0 con 0x7fbb300cba50 2023-03-03T06:26:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.528+0000 7fbb37096700 1 -- 172.21.15.5:0/533613566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3015e060 con 0x7fbb300cba50 2023-03-03T06:26:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.529+0000 7fbb37096700 1 -- 172.21.15.5:0/533613566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3015d110 con 0x7fbb300cba50 2023-03-03T06:26:33.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.530+0000 7fbb2d7fa700 1 -- 172.21.15.5:0/533613566 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbb24003800 con 0x7fbb300cba50 2023-03-03T06:26:33.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.530+0000 7fbb2d7fa700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbb140682f0 0x7fbb1406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.530+0000 7fbb2d7fa700 1 -- 172.21.15.5:0/533613566 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7445+0+0 (secure 0 0 0) 0x7fbb24085e40 con 0x7fbb300cba50 2023-03-03T06:26:33.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.530+0000 7fbb2ffff700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbb140682f0 0x7fbb1406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.530+0000 7fbb2ffff700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbb140682f0 0x7fbb1406a7a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c006fd0 tx=0x7fbb1c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:33.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.534+0000 7fbb2d7fa700 1 -- 172.21.15.5:0/533613566 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbb24052130 con 0x7fbb300cba50 2023-03-03T06:26:33.731 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.729+0000 7fbb37096700 1 -- 172.21.15.5:0/533613566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb3004e6e0 con 0x7fbb300cba50 2023-03-03T06:26:33.733 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.731+0000 7fbb2d7fa700 1 -- 172.21.15.5:0/533613566 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+23157 (secure 0 0 0) 0x7fbb24055750 con 0x7fbb300cba50 2023-03-03T06:26:33.734 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:33.734 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":85,"fsid":"b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6","created":"2023-03-03T06:23:21.626004+0000","modified":"2023-03-03T06:26:30.969901+0000","last_up_change":"2023-03-03T06:23:31.841992+0000","last_in_change":"2023-03-03T06:23:24.168371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-03-03T06:23:33.030158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-03-03T06:23:33.516445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"snap-test-pool","create_time":"2023-03-03T06:25:02.648527+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":43,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test_data_pool","create_time":"2023-03-03T06:26:03.629103+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":72,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"test_metadata_pool","create_time":"2023-03-03T06:26:04.826705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-03-03T06:26:28.144189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-03-03T06:26:28.941035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06e0f092-7bc0-4b44-8161-959f105c6cc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":96775},{"type":"v1","addr":"172.21.15.5:6818","nonce":96775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":96775},{"type":"v1","addr":"172.21.15.5:6821","nonce":96775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":96775},{"type":"v1","addr":"172.21.15.5:6828","nonce":96775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6823","nonce":96775},{"type":"v1","addr":"172.21.15.5:6825","nonce":96775}]},"public_addr":"172.21.15.5:6818/96775","cluster_addr":"172.21.15.5:6821/96775","heartbeat_back_addr":"172.21.15.5:6828/96775","heartbeat_front_addr":"172.21.15.5:6825/96775","state":["exists","up"]},{"osd":1,"uuid":"f418f313-4365-4dcb-b1c3-fb1cd7d7d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":96772},{"type":"v1","addr":"172.21.15.5:6809","nonce":96772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":96772},{"type":"v1","addr":"172.21.15.5:6811","nonce":96772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":96772},{"type":"v1","addr":"172.21.15.5:6815","nonce":96772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":96772},{"type":"v1","addr":"172.21.15.5:6813","nonce":96772}]},"public_addr":"172.21.15.5:6809/96772","cluster_addr":"172.21.15.5:6811/96772","heartbeat_back_addr":"172.21.15.5:6815/96772","heartbeat_front_addr":"172.21.15.5:6813/96772","state":["exists","up"]},{"osd":2,"uuid":"17bea630-650a-4d58-a2d4-d3670996e8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6817","nonce":96787},{"type":"v1","addr":"172.21.15.5:6819","nonce":96787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":96787},{"type":"v1","addr":"172.21.15.5:6824","nonce":96787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":96787},{"type":"v1","addr":"172.21.15.5:6831","nonce":96787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6827","nonce":96787},{"type":"v1","addr":"172.21.15.5:6829","nonce":96787}]},"public_addr":"172.21.15.5:6819/96787","cluster_addr":"172.21.15.5:6824/96787","heartbeat_back_addr":"172.21.15.5:6831/96787","heartbeat_front_addr":"172.21.15.5:6829/96787","state":["exists","up"]},{"osd":3,"uuid":"55eebce2-ba64-423a-a787-39fe21a2975e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":96773},{"type":"v1","addr":"172.21.15.5:6801","nonce":96773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":96773},{"type":"v1","addr":"172.21.15.5:6803","nonce":96773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":96773},{"type":"v1","addr":"172.21.15.5:6807","nonce":96773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":96773},{"type":"v1","addr":"172.21.15.5:6805","nonce":96773}]},"public_addr":"172.21.15.5:6801/96773","cluster_addr":"172.21.15.5:6803/96773","heartbeat_back_addr":"172.21.15.5:6807/96773","heartbeat_front_addr":"172.21.15.5:6805/96773","state":["exists","up"]},{"osd":4,"uuid":"13d87455-2c5f-46d2-b0f7-b7f93df0556b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":97069},{"type":"v1","addr":"172.21.15.191:6810","nonce":97069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":97069},{"type":"v1","addr":"172.21.15.191:6814","nonce":97069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":97069},{"type":"v1","addr":"172.21.15.191:6823","nonce":97069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":97069},{"type":"v1","addr":"172.21.15.191:6818","nonce":97069}]},"public_addr":"172.21.15.191:6810/97069","cluster_addr":"172.21.15.191:6814/97069","heartbeat_back_addr":"172.21.15.191:6823/97069","heartbeat_front_addr":"172.21.15.191:6818/97069","state":["exists","up"]},{"osd":5,"uuid":"b342359e-e495-4668-9f25-bf6e1f7d878b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":97067},{"type":"v1","addr":"172.21.15.191:6801","nonce":97067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":97067},{"type":"v1","addr":"172.21.15.191:6803","nonce":97067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":97067},{"type":"v1","addr":"172.21.15.191:6807","nonce":97067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":97067},{"type":"v1","addr":"172.21.15.191:6805","nonce":97067}]},"public_addr":"172.21.15.191:6801/97067","cluster_addr":"172.21.15.191:6803/97067","heartbeat_back_addr":"172.21.15.191:6807/97067","heartbeat_front_addr":"172.21.15.191:6805/97067","state":["exists","up"]},{"osd":6,"uuid":"2bdd211e-4f39-42c0-bf51-3fe2c94029ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":97078},{"type":"v1","addr":"172.21.15.191:6825","nonce":97078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":97078},{"type":"v1","addr":"172.21.15.191:6827","nonce":97078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":97078},{"type":"v1","addr":"172.21.15.191:6831","nonce":97078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":97078},{"type":"v1","addr":"172.21.15.191:6829","nonce":97078}]},"public_addr":"172.21.15.191:6825/97078","cluster_addr":"172.21.15.191:6827/97078","heartbeat_back_addr":"172.21.15.191:6831/97078","heartbeat_front_addr":"172.21.15.191:6829/97078","state":["exists","up"]},{"osd":7,"uuid":"c53926ae-653b-41ec-84a5-4156012714a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":97068},{"type":"v1","addr":"172.21.15.191:6811","nonce":97068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":97068},{"type":"v1","addr":"172.21.15.191:6815","nonce":97068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":97068},{"type":"v1","addr":"172.21.15.191:6822","nonce":97068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":97068},{"type":"v1","addr":"172.21.15.191:6819","nonce":97068}]},"public_addr":"172.21.15.191:6811/97068","cluster_addr":"172.21.15.191:6815/97068","heartbeat_back_addr":"172.21.15.191:6822/97068","heartbeat_front_addr":"172.21.15.191:6819/97068","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.396273+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.407529+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.378314+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.389595+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.499975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.544658+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:29.479288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-03-03T06:23:31.563366+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-03-03T06:26:33.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.733+0000 7fbb37096700 1 -- 172.21.15.5:0/533613566 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbb140682f0 msgr2=0x7fbb1406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.736 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.733+0000 7fbb37096700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbb140682f0 0x7fbb1406a7a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c006fd0 tx=0x7fbb1c008040 comp rx=0 tx=0).stop 2023-03-03T06:26:33.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.733+0000 7fbb37096700 1 -- 172.21.15.5:0/533613566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb300cba50 msgr2=0x7fbb300c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.733+0000 7fbb37096700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb300cba50 0x7fbb300c98e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400e810 tx=0x7fbb2400eb20 comp rx=0 tx=0).stop 2023-03-03T06:26:33.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.733+0000 7fbb37096700 1 -- 172.21.15.5:0/533613566 shutdown_connections 2023-03-03T06:26:33.737 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.733+0000 7fbb37096700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fbb140682f0 0x7fbb1406a7a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.733+0000 7fbb37096700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb3015cd40 0x7fbb300ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.733+0000 7fbb37096700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb300cba50 0x7fbb300c98e0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.733+0000 7fbb37096700 1 --2- 172.21.15.5:0/533613566 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb300cd3e0 0x7fbb30149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.733+0000 7fbb37096700 1 -- 172.21.15.5:0/533613566 >> 172.21.15.5:0/533613566 conn(0x7fbb300cc8d0 msgr2=0x7fbb300ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:33.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.733+0000 7fbb37096700 1 -- 172.21.15.5:0/533613566 shutdown_connections 2023-03-03T06:26:33.738 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.733+0000 7fbb37096700 1 -- 172.21.15.5:0/533613566 wait complete. 2023-03-03T06:26:33.748 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-03-03T06:26:33.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:26:33.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.872+0000 7f03060b9700 1 Processor -- start 2023-03-03T06:26:33.874 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.872+0000 7f03060b9700 1 -- start start 2023-03-03T06:26:33.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.873+0000 7f03060b9700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f030015cd40 0x7f03000b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.876 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.873+0000 7f03060b9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03000cef60 0x7f03000b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.873+0000 7f03060b9700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030015d4e0 con 0x7f03000cba50 2023-03-03T06:26:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.873+0000 7f03060b9700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030015d7c0 con 0x7f030015cd40 2023-03-03T06:26:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.873+0000 7f03060b9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030015daa0 con 0x7f03000cef60 2023-03-03T06:26:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.873+0000 7f02ff7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f030015cd40 0x7f03000b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.873+0000 7f02ff7fe700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f030015cd40 0x7f03000b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46554/0 (socket says 172.21.15.5:46554) 2023-03-03T06:26:33.877 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.873+0000 7f02ff7fe700 1 -- 172.21.15.5:0/1339559721 learned_addr learned my addr 172.21.15.5:0/1339559721 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.873+0000 7f02fffff700 1 --2- 172.21.15.5:0/1339559721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03000cef60 0x7f03000b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.873+0000 7f02ff7fe700 1 -- 172.21.15.5:0/1339559721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03000cef60 msgr2=0x7f03000b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.873+0000 7f02ff7fe700 1 --2- 172.21.15.5:0/1339559721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03000cef60 0x7f03000b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.873+0000 7f02ff7fe700 1 -- 172.21.15.5:0/1339559721 >> v1:172.21.15.191:6789/0 conn(0x7f03000cba50 legacy=0x7f0300160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.874+0000 7f02ff7fe700 1 -- 172.21.15.5:0/1339559721 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030015dd80 con 0x7f030015cd40 2023-03-03T06:26:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.874+0000 7f02fffff700 1 --2- 172.21.15.5:0/1339559721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03000cef60 0x7f03000b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.874+0000 7f02ff7fe700 1 --2- 172.21.15.5:0/1339559721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030015cd40 0x7f03000b18d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f02e80098f0 tx=0x7f02e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05fdc79898aa9ba server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:33.878 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.874+0000 7f02fe7fc700 1 -- 172.21.15.5:0/1339559721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800b8a0 con 0x7f030015cd40 2023-03-03T06:26:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.874+0000 7f02fe7fc700 1 -- 172.21.15.5:0/1339559721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e800ba00 con 0x7f030015cd40 2023-03-03T06:26:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.874+0000 7f02fe7fc700 1 -- 172.21.15.5:0/1339559721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800bd90 con 0x7f030015cd40 2023-03-03T06:26:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.874+0000 7f03060b9700 1 -- 172.21.15.5:0/1339559721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030015cd40 msgr2=0x7f03000b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.874+0000 7f03060b9700 1 --2- 172.21.15.5:0/1339559721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030015cd40 0x7f03000b18d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f02e80098f0 tx=0x7f02e8009c00 comp rx=0 tx=0).stop 2023-03-03T06:26:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.874+0000 7f03060b9700 1 -- 172.21.15.5:0/1339559721 shutdown_connections 2023-03-03T06:26:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.874+0000 7f03060b9700 1 --2- 172.21.15.5:0/1339559721 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03000cef60 0x7f03000b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.874+0000 7f03060b9700 1 --2- 172.21.15.5:0/1339559721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030015cd40 0x7f03000b18d0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.879 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.874+0000 7f03060b9700 1 -- 172.21.15.5:0/1339559721 >> 172.21.15.5:0/1339559721 conn(0x7f03000cc8d0 msgr2=0x7f03000cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.874+0000 7f03060b9700 1 -- 172.21.15.5:0/1339559721 shutdown_connections 2023-03-03T06:26:33.880 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.875+0000 7f03060b9700 1 -- 172.21.15.5:0/1339559721 wait complete. 2023-03-03T06:26:33.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.876+0000 7f03060b9700 1 Processor -- start 2023-03-03T06:26:33.882 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.876+0000 7f03060b9700 1 -- start start 2023-03-03T06:26:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f03060b9700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03000cba50 0x7f03000c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f03060b9700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03000cef60 0x7f0300155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f03060b9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030015cd40 0x7f03001560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f03060b9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03000b5670 con 0x7f030015cd40 2023-03-03T06:26:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f03060b9700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03000c8850 con 0x7f03000cba50 2023-03-03T06:26:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f03060b9700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03000c7270 con 0x7f03000cef60 2023-03-03T06:26:33.883 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02fffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030015cd40 0x7f03001560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02fffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030015cd40 0x7f03001560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46564/0 (socket says 172.21.15.5:46564) 2023-03-03T06:26:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02fffff700 1 -- 172.21.15.5:0/159951406 learned_addr learned my addr 172.21.15.5:0/159951406 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02feffd700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03000cef60 0x7f0300155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02ff7fe700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03000cba50 0x7f03000c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02fffff700 1 -- 172.21.15.5:0/159951406 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03000cef60 msgr2=0x7f0300155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02fffff700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03000cef60 0x7f0300155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.884 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02fffff700 1 -- 172.21.15.5:0/159951406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03000cba50 msgr2=0x7f03000c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02fffff700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03000cba50 0x7f03000c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02fffff700 1 -- 172.21.15.5:0/159951406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8009550 con 0x7f030015cd40 2023-03-03T06:26:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02feffd700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03000cef60 0x7f0300155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02ff7fe700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03000cba50 0x7f03000c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02fffff700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030015cd40 0x7f03001560d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f02f8007ef0 tx=0x7f02f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02f7fff700 1 -- 172.21.15.5:0/159951406 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f800de60 con 0x7f030015cd40 2023-03-03T06:26:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02f7fff700 1 -- 172.21.15.5:0/159951406 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f800f040 con 0x7f030015cd40 2023-03-03T06:26:33.885 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f03060b9700 1 -- 172.21.15.5:0/159951406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03000ca530 con 0x7f030015cd40 2023-03-03T06:26:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.877+0000 7f02f7fff700 1 -- 172.21.15.5:0/159951406 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8003c60 con 0x7f030015cd40 2023-03-03T06:26:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.878+0000 7f03060b9700 1 -- 172.21.15.5:0/159951406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030015e060 con 0x7f030015cd40 2023-03-03T06:26:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.878+0000 7f03060b9700 1 -- 172.21.15.5:0/159951406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030015d110 con 0x7f030015cd40 2023-03-03T06:26:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.879+0000 7f02f7fff700 1 -- 172.21.15.5:0/159951406 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f02f801c030 con 0x7f030015cd40 2023-03-03T06:26:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.879+0000 7f02f7fff700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02e00682f0 0x7f02e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.879+0000 7f02f7fff700 1 -- 172.21.15.5:0/159951406 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7445+0+0 (secure 0 0 0) 0x7f02f8086290 con 0x7f030015cd40 2023-03-03T06:26:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.879+0000 7f02ff7fe700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02e00682f0 0x7f02e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:33.886 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.880+0000 7f02ff7fe700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02e00682f0 0x7f02e006a7a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f02e8014040 tx=0x7f02e8008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:33.887 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:33.883+0000 7f02f7fff700 1 -- 172.21.15.5:0/159951406 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f02f8052580 con 0x7f030015cd40 2023-03-03T06:26:34.073 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.071+0000 7f03060b9700 1 -- 172.21.15.5:0/159951406 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f030004e6e0 con 0x7f02e00682f0 2023-03-03T06:26:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.086+0000 7f02f7fff700 1 -- 172.21.15.5:0/159951406 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+554166 (secure 0 0 0) 0x7f030004e6e0 con 0x7f02e00682f0 2023-03-03T06:26:34.094 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:34.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.091+0000 7f03060b9700 1 -- 172.21.15.5:0/159951406 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02e00682f0 msgr2=0x7f02e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:34.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.091+0000 7f03060b9700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02e00682f0 0x7f02e006a7a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f02e8014040 tx=0x7f02e8008030 comp rx=0 tx=0).stop 2023-03-03T06:26:34.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.091+0000 7f03060b9700 1 -- 172.21.15.5:0/159951406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030015cd40 msgr2=0x7f03001560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:34.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.091+0000 7f03060b9700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030015cd40 0x7f03001560d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f02f8007ef0 tx=0x7f02f800d3b0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.091+0000 7f03060b9700 1 -- 172.21.15.5:0/159951406 shutdown_connections 2023-03-03T06:26:34.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.091+0000 7f03060b9700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f030015cd40 0x7f03001560d0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.091+0000 7f03060b9700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03000cba50 0x7f03000c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.091+0000 7f03060b9700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f02e00682f0 0x7f02e006a7a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.091+0000 7f03060b9700 1 --2- 172.21.15.5:0/159951406 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03000cef60 0x7f0300155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.091+0000 7f03060b9700 1 -- 172.21.15.5:0/159951406 >> 172.21.15.5:0/159951406 conn(0x7f03000cc8d0 msgr2=0x7f030015f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:34.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.091+0000 7f03060b9700 1 -- 172.21.15.5:0/159951406 shutdown_connections 2023-03-03T06:26:34.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.091+0000 7f03060b9700 1 -- 172.21.15.5:0/159951406 wait complete. 2023-03-03T06:26:34.099 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:26:34.105 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-03-03T06:26:33.498745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":367,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":84544,"kb_used_data":9344,"kb_used_omap":0,"kb_used_meta":75136,"kb_avail":754890176,"statfs":{"total":773094113280,"available":773007540224,"internally_reserved":0,"allocated":9568256,"data_stored":5409514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":76939264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.956213"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339735+0000","last_change":"2023-03-03T06:26:29.998208+0000","last_active":"2023-03-03T06:26:31.339735+0000","last_peered":"2023-03-03T06:26:31.339735+0000","last_clean":"2023-03-03T06:26:31.339735+0000","last_became_active":"2023-03-03T06:26:29.995154+0000","last_became_peered":"2023-03-03T06:26:29.995154+0000","last_unstale":"2023-03-03T06:26:31.339735+0000","last_undegraded":"2023-03-03T06:26:31.339735+0000","last_fullsized":"2023-03-03T06:26:31.339735+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:18:32.766402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.605196+0000","last_change":"2023-03-03T06:26:29.992031+0000","last_active":"2023-03-03T06:26:31.605196+0000","last_peered":"2023-03-03T06:26:31.605196+0000","last_clean":"2023-03-03T06:26:31.605196+0000","last_became_active":"2023-03-03T06:26:29.991764+0000","last_became_peered":"2023-03-03T06:26:29.991764+0000","last_unstale":"2023-03-03T06:26:31.605196+0000","last_undegraded":"2023-03-03T06:26:31.605196+0000","last_fullsized":"2023-03-03T06:26:31.605196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:11:46.953522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339783+0000","last_change":"2023-03-03T06:26:29.979390+0000","last_active":"2023-03-03T06:26:31.339783+0000","last_peered":"2023-03-03T06:26:31.339783+0000","last_clean":"2023-03-03T06:26:31.339783+0000","last_became_active":"2023-03-03T06:26:29.979179+0000","last_became_peered":"2023-03-03T06:26:29.979179+0000","last_unstale":"2023-03-03T06:26:31.339783+0000","last_undegraded":"2023-03-03T06:26:31.339783+0000","last_fullsized":"2023-03-03T06:26:31.339783+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:00:12.679159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978038+0000","last_change":"2023-03-03T06:26:29.988015+0000","last_active":"2023-03-03T06:26:30.978038+0000","last_peered":"2023-03-03T06:26:30.978038+0000","last_clean":"2023-03-03T06:26:30.978038+0000","last_became_active":"2023-03-03T06:26:29.987779+0000","last_became_peered":"2023-03-03T06:26:29.987779+0000","last_unstale":"2023-03-03T06:26:30.978038+0000","last_undegraded":"2023-03-03T06:26:30.978038+0000","last_fullsized":"2023-03-03T06:26:30.978038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:49:44.054254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601678+0000","last_change":"2023-03-03T06:26:29.995169+0000","last_active":"2023-03-03T06:26:31.601678+0000","last_peered":"2023-03-03T06:26:31.601678+0000","last_clean":"2023-03-03T06:26:31.601678+0000","last_became_active":"2023-03-03T06:26:29.994747+0000","last_became_peered":"2023-03-03T06:26:29.994747+0000","last_unstale":"2023-03-03T06:26:31.601678+0000","last_undegraded":"2023-03-03T06:26:31.601678+0000","last_fullsized":"2023-03-03T06:26:31.601678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:32:23.731039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603748+0000","last_change":"2023-03-03T06:26:29.987258+0000","last_active":"2023-03-03T06:26:31.603748+0000","last_peered":"2023-03-03T06:26:31.603748+0000","last_clean":"2023-03-03T06:26:31.603748+0000","last_became_active":"2023-03-03T06:26:29.986983+0000","last_became_peered":"2023-03-03T06:26:29.986983+0000","last_unstale":"2023-03-03T06:26:31.603748+0000","last_undegraded":"2023-03-03T06:26:31.603748+0000","last_fullsized":"2023-03-03T06:26:31.603748+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:45:01.420152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603329+0000","last_change":"2023-03-03T06:26:29.992348+0000","last_active":"2023-03-03T06:26:31.603329+0000","last_peered":"2023-03-03T06:26:31.603329+0000","last_clean":"2023-03-03T06:26:31.603329+0000","last_became_active":"2023-03-03T06:26:29.991153+0000","last_became_peered":"2023-03-03T06:26:29.991153+0000","last_unstale":"2023-03-03T06:26:31.603329+0000","last_undegraded":"2023-03-03T06:26:31.603329+0000","last_fullsized":"2023-03-03T06:26:31.603329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:59:27.261535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350246+0000","last_change":"2023-03-03T06:26:29.997045+0000","last_active":"2023-03-03T06:26:31.350246+0000","last_peered":"2023-03-03T06:26:31.350246+0000","last_clean":"2023-03-03T06:26:31.350246+0000","last_became_active":"2023-03-03T06:26:29.996741+0000","last_became_peered":"2023-03-03T06:26:29.996741+0000","last_unstale":"2023-03-03T06:26:31.350246+0000","last_undegraded":"2023-03-03T06:26:31.350246+0000","last_fullsized":"2023-03-03T06:26:31.350246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:50:07.531739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604763+0000","last_change":"2023-03-03T06:26:29.997000+0000","last_active":"2023-03-03T06:26:31.604763+0000","last_peered":"2023-03-03T06:26:31.604763+0000","last_clean":"2023-03-03T06:26:31.604763+0000","last_became_active":"2023-03-03T06:26:29.996717+0000","last_became_peered":"2023-03-03T06:26:29.996717+0000","last_unstale":"2023-03-03T06:26:31.604763+0000","last_undegraded":"2023-03-03T06:26:31.604763+0000","last_fullsized":"2023-03-03T06:26:31.604763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:31:53.054160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.602583+0000","last_change":"2023-03-03T06:26:29.993648+0000","last_active":"2023-03-03T06:26:31.602583+0000","last_peered":"2023-03-03T06:26:31.602583+0000","last_clean":"2023-03-03T06:26:31.602583+0000","last_became_active":"2023-03-03T06:26:29.993423+0000","last_became_peered":"2023-03-03T06:26:29.993423+0000","last_unstale":"2023-03-03T06:26:31.602583+0000","last_undegraded":"2023-03-03T06:26:31.602583+0000","last_fullsized":"2023-03-03T06:26:31.602583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:45:01.420152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979505+0000","last_change":"2023-03-03T06:26:29.994909+0000","last_active":"2023-03-03T06:26:30.979505+0000","last_peered":"2023-03-03T06:26:30.979505+0000","last_clean":"2023-03-03T06:26:30.979505+0000","last_became_active":"2023-03-03T06:26:29.994464+0000","last_became_peered":"2023-03-03T06:26:29.994464+0000","last_unstale":"2023-03-03T06:26:30.979505+0000","last_undegraded":"2023-03-03T06:26:30.979505+0000","last_fullsized":"2023-03-03T06:26:30.979505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:08.814698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979984+0000","last_change":"2023-03-03T06:26:29.990358+0000","last_active":"2023-03-03T06:26:30.979984+0000","last_peered":"2023-03-03T06:26:30.979984+0000","last_clean":"2023-03-03T06:26:30.979984+0000","last_became_active":"2023-03-03T06:26:29.989968+0000","last_became_peered":"2023-03-03T06:26:29.989968+0000","last_unstale":"2023-03-03T06:26:30.979984+0000","last_undegraded":"2023-03-03T06:26:30.979984+0000","last_fullsized":"2023-03-03T06:26:30.979984+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:18:29.943962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978159+0000","last_change":"2023-03-03T06:26:29.998532+0000","last_active":"2023-03-03T06:26:30.978159+0000","last_peered":"2023-03-03T06:26:30.978159+0000","last_clean":"2023-03-03T06:26:30.978159+0000","last_became_active":"2023-03-03T06:26:29.998267+0000","last_became_peered":"2023-03-03T06:26:29.998267+0000","last_unstale":"2023-03-03T06:26:30.978159+0000","last_undegraded":"2023-03-03T06:26:30.978159+0000","last_fullsized":"2023-03-03T06:26:30.978159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:57:32.411291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603479+0000","last_change":"2023-03-03T06:26:29.988538+0000","last_active":"2023-03-03T06:26:31.603479+0000","last_peered":"2023-03-03T06:26:31.603479+0000","last_clean":"2023-03-03T06:26:31.603479+0000","last_became_active":"2023-03-03T06:26:29.988275+0000","last_became_peered":"2023-03-03T06:26:29.988275+0000","last_unstale":"2023-03-03T06:26:31.603479+0000","last_undegraded":"2023-03-03T06:26:31.603479+0000","last_fullsized":"2023-03-03T06:26:31.603479+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:59:27.261535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604576+0000","last_change":"2023-03-03T06:26:29.996958+0000","last_active":"2023-03-03T06:26:31.604576+0000","last_peered":"2023-03-03T06:26:31.604576+0000","last_clean":"2023-03-03T06:26:31.604576+0000","last_became_active":"2023-03-03T06:26:29.996674+0000","last_became_peered":"2023-03-03T06:26:29.996674+0000","last_unstale":"2023-03-03T06:26:31.604576+0000","last_undegraded":"2023-03-03T06:26:31.604576+0000","last_fullsized":"2023-03-03T06:26:31.604576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:59.942632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603317+0000","last_change":"2023-03-03T06:26:29.991061+0000","last_active":"2023-03-03T06:26:31.603317+0000","last_peered":"2023-03-03T06:26:31.603317+0000","last_clean":"2023-03-03T06:26:31.603317+0000","last_became_active":"2023-03-03T06:26:29.990798+0000","last_became_peered":"2023-03-03T06:26:29.990798+0000","last_unstale":"2023-03-03T06:26:31.603317+0000","last_undegraded":"2023-03-03T06:26:31.603317+0000","last_fullsized":"2023-03-03T06:26:31.603317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:16:59.983104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.340133+0000","last_change":"2023-03-03T06:26:29.999930+0000","last_active":"2023-03-03T06:26:31.340133+0000","last_peered":"2023-03-03T06:26:31.340133+0000","last_clean":"2023-03-03T06:26:31.340133+0000","last_became_active":"2023-03-03T06:26:29.999600+0000","last_became_peered":"2023-03-03T06:26:29.999600+0000","last_unstale":"2023-03-03T06:26:31.340133+0000","last_undegraded":"2023-03-03T06:26:31.340133+0000","last_fullsized":"2023-03-03T06:26:31.340133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:33:04.879138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.605098+0000","last_change":"2023-03-03T06:26:29.994374+0000","last_active":"2023-03-03T06:26:31.605098+0000","last_peered":"2023-03-03T06:26:31.605098+0000","last_clean":"2023-03-03T06:26:31.605098+0000","last_became_active":"2023-03-03T06:26:29.994156+0000","last_became_peered":"2023-03-03T06:26:29.994156+0000","last_unstale":"2023-03-03T06:26:31.605098+0000","last_undegraded":"2023-03-03T06:26:31.605098+0000","last_fullsized":"2023-03-03T06:26:31.605098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:16:59.983104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339494+0000","last_change":"2023-03-03T06:26:29.999568+0000","last_active":"2023-03-03T06:26:31.339494+0000","last_peered":"2023-03-03T06:26:31.339494+0000","last_clean":"2023-03-03T06:26:31.339494+0000","last_became_active":"2023-03-03T06:26:29.999079+0000","last_became_peered":"2023-03-03T06:26:29.999079+0000","last_unstale":"2023-03-03T06:26:31.339494+0000","last_undegraded":"2023-03-03T06:26:31.339494+0000","last_fullsized":"2023-03-03T06:26:31.339494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:05:09.656203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979971+0000","last_change":"2023-03-03T06:26:29.985844+0000","last_active":"2023-03-03T06:26:30.979971+0000","last_peered":"2023-03-03T06:26:30.979971+0000","last_clean":"2023-03-03T06:26:30.979971+0000","last_became_active":"2023-03-03T06:26:29.985472+0000","last_became_peered":"2023-03-03T06:26:29.985472+0000","last_unstale":"2023-03-03T06:26:30.979971+0000","last_undegraded":"2023-03-03T06:26:30.979971+0000","last_fullsized":"2023-03-03T06:26:30.979971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:23:03.697201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350578+0000","last_change":"2023-03-03T06:26:29.998176+0000","last_active":"2023-03-03T06:26:31.350578+0000","last_peered":"2023-03-03T06:26:31.350578+0000","last_clean":"2023-03-03T06:26:31.350578+0000","last_became_active":"2023-03-03T06:26:29.997903+0000","last_became_peered":"2023-03-03T06:26:29.997903+0000","last_unstale":"2023-03-03T06:26:31.350578+0000","last_undegraded":"2023-03-03T06:26:31.350578+0000","last_fullsized":"2023-03-03T06:26:31.350578+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:56:43.325864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601865+0000","last_change":"2023-03-03T06:26:29.988236+0000","last_active":"2023-03-03T06:26:31.601865+0000","last_peered":"2023-03-03T06:26:31.601865+0000","last_clean":"2023-03-03T06:26:31.601865+0000","last_became_active":"2023-03-03T06:26:29.987956+0000","last_became_peered":"2023-03-03T06:26:29.987956+0000","last_unstale":"2023-03-03T06:26:31.601865+0000","last_undegraded":"2023-03-03T06:26:31.601865+0000","last_fullsized":"2023-03-03T06:26:31.601865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:15:41.761505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339239+0000","last_change":"2023-03-03T06:26:29.986847+0000","last_active":"2023-03-03T06:26:31.339239+0000","last_peered":"2023-03-03T06:26:31.339239+0000","last_clean":"2023-03-03T06:26:31.339239+0000","last_became_active":"2023-03-03T06:26:29.986600+0000","last_became_peered":"2023-03-03T06:26:29.986600+0000","last_unstale":"2023-03-03T06:26:31.339239+0000","last_undegraded":"2023-03-03T06:26:31.339239+0000","last_fullsized":"2023-03-03T06:26:31.339239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:04:07.748246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601342+0000","last_change":"2023-03-03T06:26:30.001261+0000","last_active":"2023-03-03T06:26:31.601342+0000","last_peered":"2023-03-03T06:26:31.601342+0000","last_clean":"2023-03-03T06:26:31.601342+0000","last_became_active":"2023-03-03T06:26:30.000954+0000","last_became_peered":"2023-03-03T06:26:30.000954+0000","last_unstale":"2023-03-03T06:26:31.601342+0000","last_undegraded":"2023-03-03T06:26:31.601342+0000","last_fullsized":"2023-03-03T06:26:31.601342+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:13.806900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979662+0000","last_change":"2023-03-03T06:26:29.978874+0000","last_active":"2023-03-03T06:26:30.979662+0000","last_peered":"2023-03-03T06:26:30.979662+0000","last_clean":"2023-03-03T06:26:30.979662+0000","last_became_active":"2023-03-03T06:26:29.978584+0000","last_became_peered":"2023-03-03T06:26:29.978584+0000","last_unstale":"2023-03-03T06:26:30.979662+0000","last_undegraded":"2023-03-03T06:26:30.979662+0000","last_fullsized":"2023-03-03T06:26:30.979662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:21:37.963069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979703+0000","last_change":"2023-03-03T06:26:29.988769+0000","last_active":"2023-03-03T06:26:30.979703+0000","last_peered":"2023-03-03T06:26:30.979703+0000","last_clean":"2023-03-03T06:26:30.979703+0000","last_became_active":"2023-03-03T06:26:29.987811+0000","last_became_peered":"2023-03-03T06:26:29.987811+0000","last_unstale":"2023-03-03T06:26:30.979703+0000","last_undegraded":"2023-03-03T06:26:30.979703+0000","last_fullsized":"2023-03-03T06:26:30.979703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:21:33.192200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978069+0000","last_change":"2023-03-03T06:26:29.994714+0000","last_active":"2023-03-03T06:26:30.978069+0000","last_peered":"2023-03-03T06:26:30.978069+0000","last_clean":"2023-03-03T06:26:30.978069+0000","last_became_active":"2023-03-03T06:26:29.994112+0000","last_became_peered":"2023-03-03T06:26:29.994112+0000","last_unstale":"2023-03-03T06:26:30.978069+0000","last_undegraded":"2023-03-03T06:26:30.978069+0000","last_fullsized":"2023-03-03T06:26:30.978069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:52:11.032392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604443+0000","last_change":"2023-03-03T06:26:29.998500+0000","last_active":"2023-03-03T06:26:31.604443+0000","last_peered":"2023-03-03T06:26:31.604443+0000","last_clean":"2023-03-03T06:26:31.604443+0000","last_became_active":"2023-03-03T06:26:29.997941+0000","last_became_peered":"2023-03-03T06:26:29.997941+0000","last_unstale":"2023-03-03T06:26:31.604443+0000","last_undegraded":"2023-03-03T06:26:31.604443+0000","last_fullsized":"2023-03-03T06:26:31.604443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:58.611186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350701+0000","last_change":"2023-03-03T06:26:29.990605+0000","last_active":"2023-03-03T06:26:31.350701+0000","last_peered":"2023-03-03T06:26:31.350701+0000","last_clean":"2023-03-03T06:26:31.350701+0000","last_became_active":"2023-03-03T06:26:29.990373+0000","last_became_peered":"2023-03-03T06:26:29.990373+0000","last_unstale":"2023-03-03T06:26:31.350701+0000","last_undegraded":"2023-03-03T06:26:31.350701+0000","last_fullsized":"2023-03-03T06:26:31.350701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:11:04.865446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979175+0000","last_change":"2023-03-03T06:26:29.990564+0000","last_active":"2023-03-03T06:26:30.979175+0000","last_peered":"2023-03-03T06:26:30.979175+0000","last_clean":"2023-03-03T06:26:30.979175+0000","last_became_active":"2023-03-03T06:26:29.990307+0000","last_became_peered":"2023-03-03T06:26:29.990307+0000","last_unstale":"2023-03-03T06:26:30.979175+0000","last_undegraded":"2023-03-03T06:26:30.979175+0000","last_fullsized":"2023-03-03T06:26:30.979175+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:13:06.431985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603339+0000","last_change":"2023-03-03T06:26:29.981830+0000","last_active":"2023-03-03T06:26:31.603339+0000","last_peered":"2023-03-03T06:26:31.603339+0000","last_clean":"2023-03-03T06:26:31.603339+0000","last_became_active":"2023-03-03T06:26:29.981546+0000","last_became_peered":"2023-03-03T06:26:29.981546+0000","last_unstale":"2023-03-03T06:26:31.603339+0000","last_undegraded":"2023-03-03T06:26:31.603339+0000","last_fullsized":"2023-03-03T06:26:31.603339+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:59.942632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350346+0000","last_change":"2023-03-03T06:26:29.993027+0000","last_active":"2023-03-03T06:26:31.350346+0000","last_peered":"2023-03-03T06:26:31.350346+0000","last_clean":"2023-03-03T06:26:31.350346+0000","last_became_active":"2023-03-03T06:26:29.992744+0000","last_became_peered":"2023-03-03T06:26:29.992744+0000","last_unstale":"2023-03-03T06:26:31.350346+0000","last_undegraded":"2023-03-03T06:26:31.350346+0000","last_fullsized":"2023-03-03T06:26:31.350346+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:18:22.675879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978210+0000","last_change":"2023-03-03T06:26:29.992888+0000","last_active":"2023-03-03T06:26:30.978210+0000","last_peered":"2023-03-03T06:26:30.978210+0000","last_clean":"2023-03-03T06:26:30.978210+0000","last_became_active":"2023-03-03T06:26:29.992652+0000","last_became_peered":"2023-03-03T06:26:29.992652+0000","last_unstale":"2023-03-03T06:26:30.978210+0000","last_undegraded":"2023-03-03T06:26:30.978210+0000","last_fullsized":"2023-03-03T06:26:30.978210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:49:57.004597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603915+0000","last_change":"2023-03-03T06:26:29.571025+0000","last_active":"2023-03-03T06:26:31.603915+0000","last_peered":"2023-03-03T06:26:31.603915+0000","last_clean":"2023-03-03T06:26:31.603915+0000","last_became_active":"2023-03-03T06:26:29.570424+0000","last_became_peered":"2023-03-03T06:26:29.570424+0000","last_unstale":"2023-03-03T06:26:31.603915+0000","last_undegraded":"2023-03-03T06:26:31.603915+0000","last_fullsized":"2023-03-03T06:26:31.603915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:38:28.612334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.972571+0000","last_change":"2023-03-03T06:26:06.451129+0000","last_active":"2023-03-03T06:26:29.972571+0000","last_peered":"2023-03-03T06:26:29.972571+0000","last_clean":"2023-03-03T06:26:29.972571+0000","last_became_active":"2023-03-03T06:26:06.450789+0000","last_became_peered":"2023-03-03T06:26:06.450789+0000","last_unstale":"2023-03-03T06:26:29.972571+0000","last_undegraded":"2023-03-03T06:26:29.972571+0000","last_fullsized":"2023-03-03T06:26:29.972571+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:52:27.201396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.987573+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:26:29.987573+0000","last_peered":"2023-03-03T06:26:29.987573+0000","last_clean":"2023-03-03T06:26:29.987573+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:26:29.987573+0000","last_undegraded":"2023-03-03T06:26:29.987573+0000","last_fullsized":"2023-03-03T06:26:29.987573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973480+0000","last_change":"2023-03-03T06:25:05.431790+0000","last_active":"2023-03-03T06:26:29.973480+0000","last_peered":"2023-03-03T06:26:29.973480+0000","last_clean":"2023-03-03T06:26:29.973480+0000","last_became_active":"2023-03-03T06:25:04.595837+0000","last_became_peered":"2023-03-03T06:25:04.595837+0000","last_unstale":"2023-03-03T06:26:29.973480+0000","last_undegraded":"2023-03-03T06:26:29.973480+0000","last_fullsized":"2023-03-03T06:26:29.973480+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:08:49.614056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019659870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976890+0000","last_change":"2023-03-03T06:26:07.437458+0000","last_active":"2023-03-03T06:26:29.976890+0000","last_peered":"2023-03-03T06:26:29.976890+0000","last_clean":"2023-03-03T06:26:29.976890+0000","last_became_active":"2023-03-03T06:26:05.455059+0000","last_became_peered":"2023-03-03T06:26:05.455059+0000","last_unstale":"2023-03-03T06:26:29.976890+0000","last_undegraded":"2023-03-03T06:26:29.976890+0000","last_fullsized":"2023-03-03T06:26:29.976890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:39:32.379296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076999999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.351001+0000","last_change":"2023-03-03T06:26:29.996341+0000","last_active":"2023-03-03T06:26:31.351001+0000","last_peered":"2023-03-03T06:26:31.351001+0000","last_clean":"2023-03-03T06:26:31.351001+0000","last_became_active":"2023-03-03T06:26:29.995625+0000","last_became_peered":"2023-03-03T06:26:29.995625+0000","last_unstale":"2023-03-03T06:26:31.351001+0000","last_undegraded":"2023-03-03T06:26:31.351001+0000","last_fullsized":"2023-03-03T06:26:31.351001+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:20:21.223307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350450+0000","last_change":"2023-03-03T06:26:29.573062+0000","last_active":"2023-03-03T06:26:31.350450+0000","last_peered":"2023-03-03T06:26:31.350450+0000","last_clean":"2023-03-03T06:26:31.350450+0000","last_became_active":"2023-03-03T06:26:29.572784+0000","last_became_peered":"2023-03-03T06:26:29.572784+0000","last_unstale":"2023-03-03T06:26:31.350450+0000","last_undegraded":"2023-03-03T06:26:31.350450+0000","last_fullsized":"2023-03-03T06:26:31.350450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:20:22.657411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976638+0000","last_change":"2023-03-03T06:26:06.449467+0000","last_active":"2023-03-03T06:26:29.976638+0000","last_peered":"2023-03-03T06:26:29.976638+0000","last_clean":"2023-03-03T06:26:29.976638+0000","last_became_active":"2023-03-03T06:26:06.449164+0000","last_became_peered":"2023-03-03T06:26:06.449164+0000","last_unstale":"2023-03-03T06:26:29.976638+0000","last_undegraded":"2023-03-03T06:26:29.976638+0000","last_fullsized":"2023-03-03T06:26:29.976638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:24:59.293612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.987486+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:26:29.987486+0000","last_peered":"2023-03-03T06:26:29.987486+0000","last_clean":"2023-03-03T06:26:29.987486+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:26:29.987486+0000","last_undegraded":"2023-03-03T06:26:29.987486+0000","last_fullsized":"2023-03-03T06:26:29.987486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.986204+0000","last_change":"2023-03-03T06:25:05.432050+0000","last_active":"2023-03-03T06:26:29.986204+0000","last_peered":"2023-03-03T06:26:29.986204+0000","last_clean":"2023-03-03T06:26:29.986204+0000","last_became_active":"2023-03-03T06:25:04.595433+0000","last_became_peered":"2023-03-03T06:25:04.595433+0000","last_unstale":"2023-03-03T06:26:29.986204+0000","last_undegraded":"2023-03-03T06:26:29.986204+0000","last_fullsized":"2023-03-03T06:26:29.986204+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016573409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977749+0000","last_change":"2023-03-03T06:26:08.372799+0000","last_active":"2023-03-03T06:26:29.977749+0000","last_peered":"2023-03-03T06:26:29.977749+0000","last_clean":"2023-03-03T06:26:29.977749+0000","last_became_active":"2023-03-03T06:26:05.456439+0000","last_became_peered":"2023-03-03T06:26:05.456439+0000","last_unstale":"2023-03-03T06:26:29.977749+0000","last_undegraded":"2023-03-03T06:26:29.977749+0000","last_fullsized":"2023-03-03T06:26:29.977749+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:53:21.026591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029954599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350492+0000","last_change":"2023-03-03T06:26:29.992008+0000","last_active":"2023-03-03T06:26:31.350492+0000","last_peered":"2023-03-03T06:26:31.350492+0000","last_clean":"2023-03-03T06:26:31.350492+0000","last_became_active":"2023-03-03T06:26:29.991746+0000","last_became_peered":"2023-03-03T06:26:29.991746+0000","last_unstale":"2023-03-03T06:26:31.350492+0000","last_undegraded":"2023-03-03T06:26:31.350492+0000","last_fullsized":"2023-03-03T06:26:31.350492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:23:10.925900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"84'1","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604529+0000","last_change":"2023-03-03T06:26:29.568180+0000","last_active":"2023-03-03T06:26:31.604529+0000","last_peered":"2023-03-03T06:26:31.604529+0000","last_clean":"2023-03-03T06:26:31.604529+0000","last_became_active":"2023-03-03T06:26:29.567868+0000","last_became_peered":"2023-03-03T06:26:29.567868+0000","last_unstale":"2023-03-03T06:26:31.604529+0000","last_undegraded":"2023-03-03T06:26:31.604529+0000","last_fullsized":"2023-03-03T06:26:31.604529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:10:58.998423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977339+0000","last_change":"2023-03-03T06:26:06.450751+0000","last_active":"2023-03-03T06:26:29.977339+0000","last_peered":"2023-03-03T06:26:29.977339+0000","last_clean":"2023-03-03T06:26:29.977339+0000","last_became_active":"2023-03-03T06:26:06.450457+0000","last_became_peered":"2023-03-03T06:26:06.450457+0000","last_unstale":"2023-03-03T06:26:29.977339+0000","last_undegraded":"2023-03-03T06:26:29.977339+0000","last_fullsized":"2023-03-03T06:26:29.977339+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:10:40.752610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":74,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976770+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:26:29.976770+0000","last_peered":"2023-03-03T06:26:29.976770+0000","last_clean":"2023-03-03T06:26:29.976770+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:26:29.976770+0000","last_undegraded":"2023-03-03T06:26:29.976770+0000","last_fullsized":"2023-03-03T06:26:29.976770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976656+0000","last_change":"2023-03-03T06:25:05.636259+0000","last_active":"2023-03-03T06:26:29.976656+0000","last_peered":"2023-03-03T06:26:29.976656+0000","last_clean":"2023-03-03T06:26:29.976656+0000","last_became_active":"2023-03-03T06:25:04.438244+0000","last_became_peered":"2023-03-03T06:25:04.438244+0000","last_unstale":"2023-03-03T06:26:29.976656+0000","last_undegraded":"2023-03-03T06:26:29.976656+0000","last_fullsized":"2023-03-03T06:26:29.976656+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:36.640289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001044636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975527+0000","last_change":"2023-03-03T06:26:07.442491+0000","last_active":"2023-03-03T06:26:29.975527+0000","last_peered":"2023-03-03T06:26:29.975527+0000","last_clean":"2023-03-03T06:26:29.975527+0000","last_became_active":"2023-03-03T06:26:05.446612+0000","last_became_peered":"2023-03-03T06:26:05.446612+0000","last_unstale":"2023-03-03T06:26:29.975527+0000","last_undegraded":"2023-03-03T06:26:29.975527+0000","last_fullsized":"2023-03-03T06:26:29.975527+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:27.368396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086796499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978046+0000","last_change":"2023-03-03T06:26:29.987122+0000","last_active":"2023-03-03T06:26:30.978046+0000","last_peered":"2023-03-03T06:26:30.978046+0000","last_clean":"2023-03-03T06:26:30.978046+0000","last_became_active":"2023-03-03T06:26:29.986833+0000","last_became_peered":"2023-03-03T06:26:29.986833+0000","last_unstale":"2023-03-03T06:26:30.978046+0000","last_undegraded":"2023-03-03T06:26:30.978046+0000","last_fullsized":"2023-03-03T06:26:30.978046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:35:05.098809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"84'2","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350992+0000","last_change":"2023-03-03T06:26:29.573754+0000","last_active":"2023-03-03T06:26:31.350992+0000","last_peered":"2023-03-03T06:26:31.350992+0000","last_clean":"2023-03-03T06:26:31.350992+0000","last_became_active":"2023-03-03T06:26:29.572322+0000","last_became_peered":"2023-03-03T06:26:29.572322+0000","last_unstale":"2023-03-03T06:26:31.350992+0000","last_undegraded":"2023-03-03T06:26:31.350992+0000","last_fullsized":"2023-03-03T06:26:31.350992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:17:42.347142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988574+0000","last_change":"2023-03-03T06:26:06.452897+0000","last_active":"2023-03-03T06:26:29.988574+0000","last_peered":"2023-03-03T06:26:29.988574+0000","last_clean":"2023-03-03T06:26:29.988574+0000","last_became_active":"2023-03-03T06:26:06.452623+0000","last_became_peered":"2023-03-03T06:26:06.452623+0000","last_unstale":"2023-03-03T06:26:29.988574+0000","last_undegraded":"2023-03-03T06:26:29.988574+0000","last_fullsized":"2023-03-03T06:26:29.988574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:01:06.426059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":66,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.982172+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:26:29.982172+0000","last_peered":"2023-03-03T06:26:29.982172+0000","last_clean":"2023-03-03T06:26:29.982172+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:26:29.982172+0000","last_undegraded":"2023-03-03T06:26:29.982172+0000","last_fullsized":"2023-03-03T06:26:29.982172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980141+0000","last_change":"2023-03-03T06:25:05.796597+0000","last_active":"2023-03-03T06:26:29.980141+0000","last_peered":"2023-03-03T06:26:29.980141+0000","last_clean":"2023-03-03T06:26:29.980141+0000","last_became_active":"2023-03-03T06:25:04.442672+0000","last_became_peered":"2023-03-03T06:25:04.442672+0000","last_unstale":"2023-03-03T06:26:29.980141+0000","last_undegraded":"2023-03-03T06:26:29.980141+0000","last_fullsized":"2023-03-03T06:26:29.980141+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.033310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000479903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.991024+0000","last_change":"2023-03-03T06:26:08.328330+0000","last_active":"2023-03-03T06:26:29.991024+0000","last_peered":"2023-03-03T06:26:29.991024+0000","last_clean":"2023-03-03T06:26:29.991024+0000","last_became_active":"2023-03-03T06:26:05.446246+0000","last_became_peered":"2023-03-03T06:26:05.446246+0000","last_unstale":"2023-03-03T06:26:29.991024+0000","last_undegraded":"2023-03-03T06:26:29.991024+0000","last_fullsized":"2023-03-03T06:26:29.991024+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:39.715402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041737700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601678+0000","last_change":"2023-03-03T06:26:29.997711+0000","last_active":"2023-03-03T06:26:31.601678+0000","last_peered":"2023-03-03T06:26:31.601678+0000","last_clean":"2023-03-03T06:26:31.601678+0000","last_became_active":"2023-03-03T06:26:29.997442+0000","last_became_peered":"2023-03-03T06:26:29.997442+0000","last_unstale":"2023-03-03T06:26:31.601678+0000","last_undegraded":"2023-03-03T06:26:31.601678+0000","last_fullsized":"2023-03-03T06:26:31.601678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:14:46.725540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978080+0000","last_change":"2023-03-03T06:26:29.573426+0000","last_active":"2023-03-03T06:26:30.978080+0000","last_peered":"2023-03-03T06:26:30.978080+0000","last_clean":"2023-03-03T06:26:30.978080+0000","last_became_active":"2023-03-03T06:26:29.573136+0000","last_became_peered":"2023-03-03T06:26:29.573136+0000","last_unstale":"2023-03-03T06:26:30.978080+0000","last_undegraded":"2023-03-03T06:26:30.978080+0000","last_fullsized":"2023-03-03T06:26:30.978080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:57.609446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.987488+0000","last_change":"2023-03-03T06:26:06.450956+0000","last_active":"2023-03-03T06:26:29.987488+0000","last_peered":"2023-03-03T06:26:29.987488+0000","last_clean":"2023-03-03T06:26:29.987488+0000","last_became_active":"2023-03-03T06:26:06.450642+0000","last_became_peered":"2023-03-03T06:26:06.450642+0000","last_unstale":"2023-03-03T06:26:29.987488+0000","last_undegraded":"2023-03-03T06:26:29.987488+0000","last_fullsized":"2023-03-03T06:26:29.987488+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:08.483621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":66,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980658+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:26:29.980658+0000","last_peered":"2023-03-03T06:26:29.980658+0000","last_clean":"2023-03-03T06:26:29.980658+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:26:29.980658+0000","last_undegraded":"2023-03-03T06:26:29.980658+0000","last_fullsized":"2023-03-03T06:26:29.980658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.983923+0000","last_change":"2023-03-03T06:25:05.431373+0000","last_active":"2023-03-03T06:26:29.983923+0000","last_peered":"2023-03-03T06:26:29.983923+0000","last_clean":"2023-03-03T06:26:29.983923+0000","last_became_active":"2023-03-03T06:25:04.445948+0000","last_became_peered":"2023-03-03T06:25:04.445948+0000","last_unstale":"2023-03-03T06:26:29.983923+0000","last_undegraded":"2023-03-03T06:26:29.983923+0000","last_fullsized":"2023-03-03T06:26:29.983923+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001717028,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988952+0000","last_change":"2023-03-03T06:26:07.980649+0000","last_active":"2023-03-03T06:26:29.988952+0000","last_peered":"2023-03-03T06:26:29.988952+0000","last_clean":"2023-03-03T06:26:29.988952+0000","last_became_active":"2023-03-03T06:26:05.454516+0000","last_became_peered":"2023-03-03T06:26:05.454516+0000","last_unstale":"2023-03-03T06:26:29.988952+0000","last_undegraded":"2023-03-03T06:26:29.988952+0000","last_fullsized":"2023-03-03T06:26:29.988952+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:03:31.759096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051015700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603866+0000","last_change":"2023-03-03T06:26:29.994008+0000","last_active":"2023-03-03T06:26:31.603866+0000","last_peered":"2023-03-03T06:26:31.603866+0000","last_clean":"2023-03-03T06:26:31.603866+0000","last_became_active":"2023-03-03T06:26:29.993751+0000","last_became_peered":"2023-03-03T06:26:29.993751+0000","last_unstale":"2023-03-03T06:26:31.603866+0000","last_undegraded":"2023-03-03T06:26:31.603866+0000","last_fullsized":"2023-03-03T06:26:31.603866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:18:54.135489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"84'1","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604038+0000","last_change":"2023-03-03T06:26:29.560005+0000","last_active":"2023-03-03T06:26:31.604038+0000","last_peered":"2023-03-03T06:26:31.604038+0000","last_clean":"2023-03-03T06:26:31.604038+0000","last_became_active":"2023-03-03T06:26:29.559731+0000","last_became_peered":"2023-03-03T06:26:29.559731+0000","last_unstale":"2023-03-03T06:26:31.604038+0000","last_undegraded":"2023-03-03T06:26:31.604038+0000","last_fullsized":"2023-03-03T06:26:31.604038+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:12:52.087518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973922+0000","last_change":"2023-03-03T06:26:06.451372+0000","last_active":"2023-03-03T06:26:29.973922+0000","last_peered":"2023-03-03T06:26:29.973922+0000","last_clean":"2023-03-03T06:26:29.973922+0000","last_became_active":"2023-03-03T06:26:06.450997+0000","last_became_peered":"2023-03-03T06:26:06.450997+0000","last_unstale":"2023-03-03T06:26:29.973922+0000","last_undegraded":"2023-03-03T06:26:29.973922+0000","last_fullsized":"2023-03-03T06:26:29.973922+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:01:49.694064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":216,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.982091+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:26:29.982091+0000","last_peered":"2023-03-03T06:26:29.982091+0000","last_clean":"2023-03-03T06:26:29.982091+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:26:29.982091+0000","last_undegraded":"2023-03-03T06:26:29.982091+0000","last_fullsized":"2023-03-03T06:26:29.982091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988696+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:26:29.988696+0000","last_peered":"2023-03-03T06:26:29.988696+0000","last_clean":"2023-03-03T06:26:29.988696+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:26:29.988696+0000","last_undegraded":"2023-03-03T06:26:29.988696+0000","last_fullsized":"2023-03-03T06:26:29.988696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.989232+0000","last_change":"2023-03-03T06:25:05.796271+0000","last_active":"2023-03-03T06:26:29.989232+0000","last_peered":"2023-03-03T06:26:29.989232+0000","last_clean":"2023-03-03T06:26:29.989232+0000","last_became_active":"2023-03-03T06:25:04.595414+0000","last_became_peered":"2023-03-03T06:25:04.595414+0000","last_unstale":"2023-03-03T06:26:29.989232+0000","last_undegraded":"2023-03-03T06:26:29.989232+0000","last_fullsized":"2023-03-03T06:26:29.989232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:07:03.140630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027036600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.987722+0000","last_change":"2023-03-03T06:26:07.743464+0000","last_active":"2023-03-03T06:26:29.987722+0000","last_peered":"2023-03-03T06:26:29.987722+0000","last_clean":"2023-03-03T06:26:29.987722+0000","last_became_active":"2023-03-03T06:26:05.446609+0000","last_became_peered":"2023-03-03T06:26:05.446609+0000","last_unstale":"2023-03-03T06:26:29.987722+0000","last_undegraded":"2023-03-03T06:26:29.987722+0000","last_fullsized":"2023-03-03T06:26:29.987722+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:57.199464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000302202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339661+0000","last_change":"2023-03-03T06:26:29.993832+0000","last_active":"2023-03-03T06:26:31.339661+0000","last_peered":"2023-03-03T06:26:31.339661+0000","last_clean":"2023-03-03T06:26:31.339661+0000","last_became_active":"2023-03-03T06:26:29.987404+0000","last_became_peered":"2023-03-03T06:26:29.987404+0000","last_unstale":"2023-03-03T06:26:31.339661+0000","last_undegraded":"2023-03-03T06:26:31.339661+0000","last_fullsized":"2023-03-03T06:26:31.339661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:50:11.014971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350443+0000","last_change":"2023-03-03T06:26:29.574893+0000","last_active":"2023-03-03T06:26:31.350443+0000","last_peered":"2023-03-03T06:26:31.350443+0000","last_clean":"2023-03-03T06:26:31.350443+0000","last_became_active":"2023-03-03T06:26:29.574626+0000","last_became_peered":"2023-03-03T06:26:29.574626+0000","last_unstale":"2023-03-03T06:26:31.350443+0000","last_undegraded":"2023-03-03T06:26:31.350443+0000","last_fullsized":"2023-03-03T06:26:31.350443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:16:44.453163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.972925+0000","last_change":"2023-03-03T06:26:06.452197+0000","last_active":"2023-03-03T06:26:29.972925+0000","last_peered":"2023-03-03T06:26:29.972925+0000","last_clean":"2023-03-03T06:26:29.972925+0000","last_became_active":"2023-03-03T06:26:06.451673+0000","last_became_peered":"2023-03-03T06:26:06.451673+0000","last_unstale":"2023-03-03T06:26:29.972925+0000","last_undegraded":"2023-03-03T06:26:29.972925+0000","last_fullsized":"2023-03-03T06:26:29.972925+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:20:18.222822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":75,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.985963+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:26:29.985963+0000","last_peered":"2023-03-03T06:26:29.985963+0000","last_clean":"2023-03-03T06:26:29.985963+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:26:29.985963+0000","last_undegraded":"2023-03-03T06:26:29.985963+0000","last_fullsized":"2023-03-03T06:26:29.985963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977601+0000","last_change":"2023-03-03T06:25:05.636335+0000","last_active":"2023-03-03T06:26:29.977601+0000","last_peered":"2023-03-03T06:26:29.977601+0000","last_clean":"2023-03-03T06:26:29.977601+0000","last_became_active":"2023-03-03T06:25:04.443299+0000","last_became_peered":"2023-03-03T06:25:04.443299+0000","last_unstale":"2023-03-03T06:26:29.977601+0000","last_undegraded":"2023-03-03T06:26:29.977601+0000","last_fullsized":"2023-03-03T06:26:29.977601+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:13:38.046974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090290399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.978161+0000","last_change":"2023-03-03T06:26:08.372573+0000","last_active":"2023-03-03T06:26:29.978161+0000","last_peered":"2023-03-03T06:26:29.978161+0000","last_clean":"2023-03-03T06:26:29.978161+0000","last_became_active":"2023-03-03T06:26:05.456694+0000","last_became_peered":"2023-03-03T06:26:05.456694+0000","last_unstale":"2023-03-03T06:26:29.978161+0000","last_undegraded":"2023-03-03T06:26:29.978161+0000","last_fullsized":"2023-03-03T06:26:29.978161+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:29:46.689179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000304698,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339587+0000","last_change":"2023-03-03T06:26:29.992025+0000","last_active":"2023-03-03T06:26:31.339587+0000","last_peered":"2023-03-03T06:26:31.339587+0000","last_clean":"2023-03-03T06:26:31.339587+0000","last_became_active":"2023-03-03T06:26:29.991700+0000","last_became_peered":"2023-03-03T06:26:29.991700+0000","last_unstale":"2023-03-03T06:26:31.339587+0000","last_undegraded":"2023-03-03T06:26:31.339587+0000","last_fullsized":"2023-03-03T06:26:31.339587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:37:26.220185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"84'2","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.351010+0000","last_change":"2023-03-03T06:26:29.566442+0000","last_active":"2023-03-03T06:26:31.351010+0000","last_peered":"2023-03-03T06:26:31.351010+0000","last_clean":"2023-03-03T06:26:31.351010+0000","last_became_active":"2023-03-03T06:26:29.566177+0000","last_became_peered":"2023-03-03T06:26:29.566177+0000","last_unstale":"2023-03-03T06:26:31.351010+0000","last_undegraded":"2023-03-03T06:26:31.351010+0000","last_fullsized":"2023-03-03T06:26:31.351010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:03:55.874849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976722+0000","last_change":"2023-03-03T06:26:06.443291+0000","last_active":"2023-03-03T06:26:29.976722+0000","last_peered":"2023-03-03T06:26:29.976722+0000","last_clean":"2023-03-03T06:26:29.976722+0000","last_became_active":"2023-03-03T06:26:06.442961+0000","last_became_peered":"2023-03-03T06:26:06.442961+0000","last_unstale":"2023-03-03T06:26:29.976722+0000","last_undegraded":"2023-03-03T06:26:29.976722+0000","last_fullsized":"2023-03-03T06:26:29.976722+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:10:59.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":79,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975754+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:26:29.975754+0000","last_peered":"2023-03-03T06:26:29.975754+0000","last_clean":"2023-03-03T06:26:29.975754+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:26:29.975754+0000","last_undegraded":"2023-03-03T06:26:29.975754+0000","last_fullsized":"2023-03-03T06:26:29.975754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.974370+0000","last_change":"2023-03-03T06:25:05.431854+0000","last_active":"2023-03-03T06:26:29.974370+0000","last_peered":"2023-03-03T06:26:29.974370+0000","last_clean":"2023-03-03T06:26:29.974370+0000","last_became_active":"2023-03-03T06:25:04.438570+0000","last_became_peered":"2023-03-03T06:25:04.438570+0000","last_unstale":"2023-03-03T06:26:29.974370+0000","last_undegraded":"2023-03-03T06:26:29.974370+0000","last_fullsized":"2023-03-03T06:26:29.974370+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976688+0000","last_change":"2023-03-03T06:26:07.437294+0000","last_active":"2023-03-03T06:26:29.976688+0000","last_peered":"2023-03-03T06:26:29.976688+0000","last_clean":"2023-03-03T06:26:29.976688+0000","last_became_active":"2023-03-03T06:26:05.452653+0000","last_became_peered":"2023-03-03T06:26:05.452653+0000","last_unstale":"2023-03-03T06:26:29.976688+0000","last_undegraded":"2023-03-03T06:26:29.976688+0000","last_fullsized":"2023-03-03T06:26:29.976688+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:37:33.832389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072507799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603733+0000","last_change":"2023-03-03T06:26:29.998549+0000","last_active":"2023-03-03T06:26:31.603733+0000","last_peered":"2023-03-03T06:26:31.603733+0000","last_clean":"2023-03-03T06:26:31.603733+0000","last_became_active":"2023-03-03T06:26:29.998292+0000","last_became_peered":"2023-03-03T06:26:29.998292+0000","last_unstale":"2023-03-03T06:26:31.603733+0000","last_undegraded":"2023-03-03T06:26:31.603733+0000","last_fullsized":"2023-03-03T06:26:31.603733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:58.611186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603531+0000","last_change":"2023-03-03T06:26:29.573982+0000","last_active":"2023-03-03T06:26:31.603531+0000","last_peered":"2023-03-03T06:26:31.603531+0000","last_clean":"2023-03-03T06:26:31.603531+0000","last_became_active":"2023-03-03T06:26:29.573778+0000","last_became_peered":"2023-03-03T06:26:29.573778+0000","last_unstale":"2023-03-03T06:26:31.603531+0000","last_undegraded":"2023-03-03T06:26:31.603531+0000","last_fullsized":"2023-03-03T06:26:31.603531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:18:21.674140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.978263+0000","last_change":"2023-03-03T06:26:06.453007+0000","last_active":"2023-03-03T06:26:29.978263+0000","last_peered":"2023-03-03T06:26:29.978263+0000","last_clean":"2023-03-03T06:26:29.978263+0000","last_became_active":"2023-03-03T06:26:06.452711+0000","last_became_peered":"2023-03-03T06:26:06.452711+0000","last_unstale":"2023-03-03T06:26:29.978263+0000","last_undegraded":"2023-03-03T06:26:29.978263+0000","last_fullsized":"2023-03-03T06:26:29.978263+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:31:13.721015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973414+0000","last_change":"2023-03-03T06:25:05.431441+0000","last_active":"2023-03-03T06:26:29.973414+0000","last_peered":"2023-03-03T06:26:29.973414+0000","last_clean":"2023-03-03T06:26:29.973414+0000","last_became_active":"2023-03-03T06:25:04.443840+0000","last_became_peered":"2023-03-03T06:25:04.443840+0000","last_unstale":"2023-03-03T06:26:29.973414+0000","last_undegraded":"2023-03-03T06:26:29.973414+0000","last_fullsized":"2023-03-03T06:26:29.973414+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017814980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.972996+0000","last_change":"2023-03-03T06:26:07.736641+0000","last_active":"2023-03-03T06:26:29.972996+0000","last_peered":"2023-03-03T06:26:29.972996+0000","last_clean":"2023-03-03T06:26:29.972996+0000","last_became_active":"2023-03-03T06:26:05.453335+0000","last_became_peered":"2023-03-03T06:26:05.453335+0000","last_unstale":"2023-03-03T06:26:29.972996+0000","last_undegraded":"2023-03-03T06:26:29.972996+0000","last_fullsized":"2023-03-03T06:26:29.972996+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:10:33.067696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049195100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978729+0000","last_change":"2023-03-03T06:26:29.992449+0000","last_active":"2023-03-03T06:26:30.978729+0000","last_peered":"2023-03-03T06:26:30.978729+0000","last_clean":"2023-03-03T06:26:30.978729+0000","last_became_active":"2023-03-03T06:26:29.992195+0000","last_became_peered":"2023-03-03T06:26:29.992195+0000","last_unstale":"2023-03-03T06:26:30.978729+0000","last_undegraded":"2023-03-03T06:26:30.978729+0000","last_fullsized":"2023-03-03T06:26:30.978729+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:37:03.828171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350613+0000","last_change":"2023-03-03T06:26:29.568978+0000","last_active":"2023-03-03T06:26:31.350613+0000","last_peered":"2023-03-03T06:26:31.350613+0000","last_clean":"2023-03-03T06:26:31.350613+0000","last_became_active":"2023-03-03T06:26:29.568376+0000","last_became_peered":"2023-03-03T06:26:29.568376+0000","last_unstale":"2023-03-03T06:26:31.350613+0000","last_undegraded":"2023-03-03T06:26:31.350613+0000","last_fullsized":"2023-03-03T06:26:31.350613+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:46:35.478618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.984063+0000","last_change":"2023-03-03T06:26:06.453235+0000","last_active":"2023-03-03T06:26:29.984063+0000","last_peered":"2023-03-03T06:26:29.984063+0000","last_clean":"2023-03-03T06:26:29.984063+0000","last_became_active":"2023-03-03T06:26:06.452943+0000","last_became_peered":"2023-03-03T06:26:06.452943+0000","last_unstale":"2023-03-03T06:26:29.984063+0000","last_undegraded":"2023-03-03T06:26:29.984063+0000","last_fullsized":"2023-03-03T06:26:29.984063+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:19:54.056197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988965+0000","last_change":"2023-03-03T06:25:05.797366+0000","last_active":"2023-03-03T06:26:29.988965+0000","last_peered":"2023-03-03T06:26:29.988965+0000","last_clean":"2023-03-03T06:26:29.988965+0000","last_became_active":"2023-03-03T06:25:04.439424+0000","last_became_peered":"2023-03-03T06:25:04.439424+0000","last_unstale":"2023-03-03T06:26:29.988965+0000","last_undegraded":"2023-03-03T06:26:29.988965+0000","last_fullsized":"2023-03-03T06:26:29.988965+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:12.599265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020575500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976779+0000","last_change":"2023-03-03T06:26:07.437096+0000","last_active":"2023-03-03T06:26:29.976779+0000","last_peered":"2023-03-03T06:26:29.976779+0000","last_clean":"2023-03-03T06:26:29.976779+0000","last_became_active":"2023-03-03T06:26:05.453270+0000","last_became_peered":"2023-03-03T06:26:05.453270+0000","last_unstale":"2023-03-03T06:26:29.976779+0000","last_undegraded":"2023-03-03T06:26:29.976779+0000","last_fullsized":"2023-03-03T06:26:29.976779+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:04:09.013384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047089700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350722+0000","last_change":"2023-03-03T06:26:29.996216+0000","last_active":"2023-03-03T06:26:31.350722+0000","last_peered":"2023-03-03T06:26:31.350722+0000","last_clean":"2023-03-03T06:26:31.350722+0000","last_became_active":"2023-03-03T06:26:29.995934+0000","last_became_peered":"2023-03-03T06:26:29.995934+0000","last_unstale":"2023-03-03T06:26:31.350722+0000","last_undegraded":"2023-03-03T06:26:31.350722+0000","last_fullsized":"2023-03-03T06:26:31.350722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:10:58.185189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979684+0000","last_change":"2023-03-03T06:26:29.569034+0000","last_active":"2023-03-03T06:26:30.979684+0000","last_peered":"2023-03-03T06:26:30.979684+0000","last_clean":"2023-03-03T06:26:30.979684+0000","last_became_active":"2023-03-03T06:26:29.568736+0000","last_became_peered":"2023-03-03T06:26:29.568736+0000","last_unstale":"2023-03-03T06:26:30.979684+0000","last_undegraded":"2023-03-03T06:26:30.979684+0000","last_fullsized":"2023-03-03T06:26:30.979684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:23:21.280466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.986268+0000","last_change":"2023-03-03T06:26:06.450801+0000","last_active":"2023-03-03T06:26:29.986268+0000","last_peered":"2023-03-03T06:26:29.986268+0000","last_clean":"2023-03-03T06:26:29.986268+0000","last_became_active":"2023-03-03T06:26:06.450471+0000","last_became_peered":"2023-03-03T06:26:06.450471+0000","last_unstale":"2023-03-03T06:26:29.986268+0000","last_undegraded":"2023-03-03T06:26:29.986268+0000","last_fullsized":"2023-03-03T06:26:29.986268+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:52:12.324536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977051+0000","last_change":"2023-03-03T06:25:05.636038+0000","last_active":"2023-03-03T06:26:29.977051+0000","last_peered":"2023-03-03T06:26:29.977051+0000","last_clean":"2023-03-03T06:26:29.977051+0000","last_became_active":"2023-03-03T06:25:04.433771+0000","last_became_peered":"2023-03-03T06:25:04.433771+0000","last_unstale":"2023-03-03T06:26:29.977051+0000","last_undegraded":"2023-03-03T06:26:29.977051+0000","last_fullsized":"2023-03-03T06:26:29.977051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:33:58.284544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079784699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980099+0000","last_change":"2023-03-03T06:26:07.742584+0000","last_active":"2023-03-03T06:26:29.980099+0000","last_peered":"2023-03-03T06:26:29.980099+0000","last_clean":"2023-03-03T06:26:29.980099+0000","last_became_active":"2023-03-03T06:26:05.457838+0000","last_became_peered":"2023-03-03T06:26:05.457838+0000","last_unstale":"2023-03-03T06:26:29.980099+0000","last_undegraded":"2023-03-03T06:26:29.980099+0000","last_fullsized":"2023-03-03T06:26:29.980099+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:15:50.857364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066852600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350703+0000","last_change":"2023-03-03T06:26:29.994223+0000","last_active":"2023-03-03T06:26:31.350703+0000","last_peered":"2023-03-03T06:26:31.350703+0000","last_clean":"2023-03-03T06:26:31.350703+0000","last_became_active":"2023-03-03T06:26:29.993929+0000","last_became_peered":"2023-03-03T06:26:29.993929+0000","last_unstale":"2023-03-03T06:26:31.350703+0000","last_undegraded":"2023-03-03T06:26:31.350703+0000","last_fullsized":"2023-03-03T06:26:31.350703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:30:36.430656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350556+0000","last_change":"2023-03-03T06:26:29.573287+0000","last_active":"2023-03-03T06:26:31.350556+0000","last_peered":"2023-03-03T06:26:31.350556+0000","last_clean":"2023-03-03T06:26:31.350556+0000","last_became_active":"2023-03-03T06:26:29.568854+0000","last_became_peered":"2023-03-03T06:26:29.568854+0000","last_unstale":"2023-03-03T06:26:31.350556+0000","last_undegraded":"2023-03-03T06:26:31.350556+0000","last_fullsized":"2023-03-03T06:26:31.350556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:50:21.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973123+0000","last_change":"2023-03-03T06:26:06.451985+0000","last_active":"2023-03-03T06:26:29.973123+0000","last_peered":"2023-03-03T06:26:29.973123+0000","last_clean":"2023-03-03T06:26:29.973123+0000","last_became_active":"2023-03-03T06:26:06.451325+0000","last_became_peered":"2023-03-03T06:26:06.451325+0000","last_unstale":"2023-03-03T06:26:29.973123+0000","last_undegraded":"2023-03-03T06:26:29.973123+0000","last_fullsized":"2023-03-03T06:26:29.973123+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:18:30.022652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.986746+0000","last_change":"2023-03-03T06:25:05.797098+0000","last_active":"2023-03-03T06:26:29.986746+0000","last_peered":"2023-03-03T06:26:29.986746+0000","last_clean":"2023-03-03T06:26:29.986746+0000","last_became_active":"2023-03-03T06:25:04.446290+0000","last_became_peered":"2023-03-03T06:25:04.446290+0000","last_unstale":"2023-03-03T06:26:29.986746+0000","last_undegraded":"2023-03-03T06:26:29.986746+0000","last_fullsized":"2023-03-03T06:26:29.986746+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:23:37.795335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050239399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.982016+0000","last_change":"2023-03-03T06:26:07.979900+0000","last_active":"2023-03-03T06:26:29.982016+0000","last_peered":"2023-03-03T06:26:29.982016+0000","last_clean":"2023-03-03T06:26:29.982016+0000","last_became_active":"2023-03-03T06:26:05.451502+0000","last_became_peered":"2023-03-03T06:26:05.451502+0000","last_unstale":"2023-03-03T06:26:29.982016+0000","last_undegraded":"2023-03-03T06:26:29.982016+0000","last_fullsized":"2023-03-03T06:26:29.982016+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:36.121253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075614699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.977858+0000","last_change":"2023-03-03T06:26:29.994976+0000","last_active":"2023-03-03T06:26:30.977858+0000","last_peered":"2023-03-03T06:26:30.977858+0000","last_clean":"2023-03-03T06:26:30.977858+0000","last_became_active":"2023-03-03T06:26:29.994713+0000","last_became_peered":"2023-03-03T06:26:29.994713+0000","last_unstale":"2023-03-03T06:26:30.977858+0000","last_undegraded":"2023-03-03T06:26:30.977858+0000","last_fullsized":"2023-03-03T06:26:30.977858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:35:39.394419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604175+0000","last_change":"2023-03-03T06:26:29.576059+0000","last_active":"2023-03-03T06:26:31.604175+0000","last_peered":"2023-03-03T06:26:31.604175+0000","last_clean":"2023-03-03T06:26:31.604175+0000","last_became_active":"2023-03-03T06:26:29.575819+0000","last_became_peered":"2023-03-03T06:26:29.575819+0000","last_unstale":"2023-03-03T06:26:31.604175+0000","last_undegraded":"2023-03-03T06:26:31.604175+0000","last_fullsized":"2023-03-03T06:26:31.604175+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:00:37.258566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980514+0000","last_change":"2023-03-03T06:26:06.452639+0000","last_active":"2023-03-03T06:26:29.980514+0000","last_peered":"2023-03-03T06:26:29.980514+0000","last_clean":"2023-03-03T06:26:29.980514+0000","last_became_active":"2023-03-03T06:26:06.452326+0000","last_became_peered":"2023-03-03T06:26:06.452326+0000","last_unstale":"2023-03-03T06:26:29.980514+0000","last_undegraded":"2023-03-03T06:26:29.980514+0000","last_fullsized":"2023-03-03T06:26:29.980514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:38.158241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975604+0000","last_change":"2023-03-03T06:25:05.429793+0000","last_active":"2023-03-03T06:26:29.975604+0000","last_peered":"2023-03-03T06:26:29.975604+0000","last_clean":"2023-03-03T06:26:29.975604+0000","last_became_active":"2023-03-03T06:25:04.436400+0000","last_became_peered":"2023-03-03T06:25:04.436400+0000","last_unstale":"2023-03-03T06:26:29.975604+0000","last_undegraded":"2023-03-03T06:26:29.975604+0000","last_fullsized":"2023-03-03T06:26:29.975604+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038039399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988749+0000","last_change":"2023-03-03T06:26:07.980824+0000","last_active":"2023-03-03T06:26:29.988749+0000","last_peered":"2023-03-03T06:26:29.988749+0000","last_clean":"2023-03-03T06:26:29.988749+0000","last_became_active":"2023-03-03T06:26:05.454441+0000","last_became_peered":"2023-03-03T06:26:05.454441+0000","last_unstale":"2023-03-03T06:26:29.988749+0000","last_undegraded":"2023-03-03T06:26:29.988749+0000","last_fullsized":"2023-03-03T06:26:29.988749+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:17:18.231389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000408503,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978043+0000","last_change":"2023-03-03T06:26:29.987627+0000","last_active":"2023-03-03T06:26:30.978043+0000","last_peered":"2023-03-03T06:26:30.978043+0000","last_clean":"2023-03-03T06:26:30.978043+0000","last_became_active":"2023-03-03T06:26:29.987347+0000","last_became_peered":"2023-03-03T06:26:29.987347+0000","last_unstale":"2023-03-03T06:26:30.978043+0000","last_undegraded":"2023-03-03T06:26:30.978043+0000","last_fullsized":"2023-03-03T06:26:30.978043+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:27:55.297108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601936+0000","last_change":"2023-03-03T06:26:29.571462+0000","last_active":"2023-03-03T06:26:31.601936+0000","last_peered":"2023-03-03T06:26:31.601936+0000","last_clean":"2023-03-03T06:26:31.601936+0000","last_became_active":"2023-03-03T06:26:29.571157+0000","last_became_peered":"2023-03-03T06:26:29.571157+0000","last_unstale":"2023-03-03T06:26:31.601936+0000","last_undegraded":"2023-03-03T06:26:31.601936+0000","last_fullsized":"2023-03-03T06:26:31.601936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:25:29.912343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973472+0000","last_change":"2023-03-03T06:26:06.454265+0000","last_active":"2023-03-03T06:26:29.973472+0000","last_peered":"2023-03-03T06:26:29.973472+0000","last_clean":"2023-03-03T06:26:29.973472+0000","last_became_active":"2023-03-03T06:26:06.453645+0000","last_became_peered":"2023-03-03T06:26:06.453645+0000","last_unstale":"2023-03-03T06:26:29.973472+0000","last_undegraded":"2023-03-03T06:26:29.973472+0000","last_fullsized":"2023-03-03T06:26:29.973472+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:14:22.612704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988910+0000","last_change":"2023-03-03T06:25:05.796890+0000","last_active":"2023-03-03T06:26:29.988910+0000","last_peered":"2023-03-03T06:26:29.988910+0000","last_clean":"2023-03-03T06:26:29.988910+0000","last_became_active":"2023-03-03T06:25:04.437104+0000","last_became_peered":"2023-03-03T06:25:04.437104+0000","last_unstale":"2023-03-03T06:26:29.988910+0000","last_undegraded":"2023-03-03T06:26:29.988910+0000","last_fullsized":"2023-03-03T06:26:29.988910+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:10:21.043057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027269099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977177+0000","last_change":"2023-03-03T06:26:07.442040+0000","last_active":"2023-03-03T06:26:29.977177+0000","last_peered":"2023-03-03T06:26:29.977177+0000","last_clean":"2023-03-03T06:26:29.977177+0000","last_became_active":"2023-03-03T06:26:05.449262+0000","last_became_peered":"2023-03-03T06:26:05.449262+0000","last_unstale":"2023-03-03T06:26:29.977177+0000","last_undegraded":"2023-03-03T06:26:29.977177+0000","last_fullsized":"2023-03-03T06:26:29.977177+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:24:58.288956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054354700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339034+0000","last_change":"2023-03-03T06:26:29.992649+0000","last_active":"2023-03-03T06:26:31.339034+0000","last_peered":"2023-03-03T06:26:31.339034+0000","last_clean":"2023-03-03T06:26:31.339034+0000","last_became_active":"2023-03-03T06:26:29.992397+0000","last_became_peered":"2023-03-03T06:26:29.992397+0000","last_unstale":"2023-03-03T06:26:31.339034+0000","last_undegraded":"2023-03-03T06:26:31.339034+0000","last_fullsized":"2023-03-03T06:26:31.339034+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:59:20.867226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"84'2","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.602426+0000","last_change":"2023-03-03T06:26:29.569925+0000","last_active":"2023-03-03T06:26:31.602426+0000","last_peered":"2023-03-03T06:26:31.602426+0000","last_clean":"2023-03-03T06:26:31.602426+0000","last_became_active":"2023-03-03T06:26:29.569668+0000","last_became_peered":"2023-03-03T06:26:29.569668+0000","last_unstale":"2023-03-03T06:26:31.602426+0000","last_undegraded":"2023-03-03T06:26:31.602426+0000","last_fullsized":"2023-03-03T06:26:31.602426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:56:42.324125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973335+0000","last_change":"2023-03-03T06:26:06.452106+0000","last_active":"2023-03-03T06:26:29.973335+0000","last_peered":"2023-03-03T06:26:29.973335+0000","last_clean":"2023-03-03T06:26:29.973335+0000","last_became_active":"2023-03-03T06:26:06.451741+0000","last_became_peered":"2023-03-03T06:26:06.451741+0000","last_unstale":"2023-03-03T06:26:29.973335+0000","last_undegraded":"2023-03-03T06:26:29.973335+0000","last_fullsized":"2023-03-03T06:26:29.973335+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:44:37.307316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.983796+0000","last_change":"2023-03-03T06:25:05.431187+0000","last_active":"2023-03-03T06:26:29.983796+0000","last_peered":"2023-03-03T06:26:29.983796+0000","last_clean":"2023-03-03T06:26:29.983796+0000","last_became_active":"2023-03-03T06:25:04.442929+0000","last_became_peered":"2023-03-03T06:25:04.442929+0000","last_unstale":"2023-03-03T06:26:29.983796+0000","last_undegraded":"2023-03-03T06:26:29.983796+0000","last_fullsized":"2023-03-03T06:26:29.983796+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001551871,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975613+0000","last_change":"2023-03-03T06:26:07.442810+0000","last_active":"2023-03-03T06:26:29.975613+0000","last_peered":"2023-03-03T06:26:29.975613+0000","last_clean":"2023-03-03T06:26:29.975613+0000","last_became_active":"2023-03-03T06:26:05.452515+0000","last_became_peered":"2023-03-03T06:26:05.452515+0000","last_unstale":"2023-03-03T06:26:29.975613+0000","last_undegraded":"2023-03-03T06:26:29.975613+0000","last_fullsized":"2023-03-03T06:26:29.975613+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:53:58.001196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043871,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979010+0000","last_change":"2023-03-03T06:26:29.988571+0000","last_active":"2023-03-03T06:26:30.979010+0000","last_peered":"2023-03-03T06:26:30.979010+0000","last_clean":"2023-03-03T06:26:30.979010+0000","last_became_active":"2023-03-03T06:26:29.987928+0000","last_became_peered":"2023-03-03T06:26:29.987928+0000","last_unstale":"2023-03-03T06:26:30.979010+0000","last_undegraded":"2023-03-03T06:26:30.979010+0000","last_fullsized":"2023-03-03T06:26:30.979010+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:00:44.001277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339628+0000","last_change":"2023-03-03T06:26:29.561974+0000","last_active":"2023-03-03T06:26:31.339628+0000","last_peered":"2023-03-03T06:26:31.339628+0000","last_clean":"2023-03-03T06:26:31.339628+0000","last_became_active":"2023-03-03T06:26:29.561656+0000","last_became_peered":"2023-03-03T06:26:29.561656+0000","last_unstale":"2023-03-03T06:26:31.339628+0000","last_undegraded":"2023-03-03T06:26:31.339628+0000","last_fullsized":"2023-03-03T06:26:31.339628+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:21:32.190461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977730+0000","last_change":"2023-03-03T06:26:06.445426+0000","last_active":"2023-03-03T06:26:29.977730+0000","last_peered":"2023-03-03T06:26:29.977730+0000","last_clean":"2023-03-03T06:26:29.977730+0000","last_became_active":"2023-03-03T06:26:06.445155+0000","last_became_peered":"2023-03-03T06:26:06.445155+0000","last_unstale":"2023-03-03T06:26:29.977730+0000","last_undegraded":"2023-03-03T06:26:29.977730+0000","last_fullsized":"2023-03-03T06:26:29.977730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:28.373052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.985430+0000","last_change":"2023-03-03T06:25:05.796211+0000","last_active":"2023-03-03T06:26:29.985430+0000","last_peered":"2023-03-03T06:26:29.985430+0000","last_clean":"2023-03-03T06:26:29.985430+0000","last_became_active":"2023-03-03T06:25:04.436647+0000","last_became_peered":"2023-03-03T06:25:04.436647+0000","last_unstale":"2023-03-03T06:26:29.985430+0000","last_undegraded":"2023-03-03T06:26:29.985430+0000","last_fullsized":"2023-03-03T06:26:29.985430+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:07.330548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980612+0000","last_change":"2023-03-03T06:26:07.743198+0000","last_active":"2023-03-03T06:26:29.980612+0000","last_peered":"2023-03-03T06:26:29.980612+0000","last_clean":"2023-03-03T06:26:29.980612+0000","last_became_active":"2023-03-03T06:26:05.457593+0000","last_became_peered":"2023-03-03T06:26:05.457593+0000","last_unstale":"2023-03-03T06:26:29.980612+0000","last_undegraded":"2023-03-03T06:26:29.980612+0000","last_fullsized":"2023-03-03T06:26:29.980612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:02.381708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056405099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604997+0000","last_change":"2023-03-03T06:26:29.998199+0000","last_active":"2023-03-03T06:26:31.604997+0000","last_peered":"2023-03-03T06:26:31.604997+0000","last_clean":"2023-03-03T06:26:31.604997+0000","last_became_active":"2023-03-03T06:26:29.997923+0000","last_became_peered":"2023-03-03T06:26:29.997923+0000","last_unstale":"2023-03-03T06:26:31.604997+0000","last_undegraded":"2023-03-03T06:26:31.604997+0000","last_fullsized":"2023-03-03T06:26:31.604997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:29.968161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979053+0000","last_change":"2023-03-03T06:26:29.562256+0000","last_active":"2023-03-03T06:26:30.979053+0000","last_peered":"2023-03-03T06:26:30.979053+0000","last_clean":"2023-03-03T06:26:30.979053+0000","last_became_active":"2023-03-03T06:26:29.561993+0000","last_became_peered":"2023-03-03T06:26:29.561993+0000","last_unstale":"2023-03-03T06:26:30.979053+0000","last_undegraded":"2023-03-03T06:26:30.979053+0000","last_fullsized":"2023-03-03T06:26:30.979053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:07.812959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.982937+0000","last_change":"2023-03-03T06:26:06.451152+0000","last_active":"2023-03-03T06:26:29.982937+0000","last_peered":"2023-03-03T06:26:29.982937+0000","last_clean":"2023-03-03T06:26:29.982937+0000","last_became_active":"2023-03-03T06:26:06.450402+0000","last_became_peered":"2023-03-03T06:26:06.450402+0000","last_unstale":"2023-03-03T06:26:29.982937+0000","last_undegraded":"2023-03-03T06:26:29.982937+0000","last_fullsized":"2023-03-03T06:26:29.982937+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:58.204120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.986070+0000","last_change":"2023-03-03T06:25:05.431681+0000","last_active":"2023-03-03T06:26:29.986070+0000","last_peered":"2023-03-03T06:26:29.986070+0000","last_clean":"2023-03-03T06:26:29.986070+0000","last_became_active":"2023-03-03T06:25:04.443599+0000","last_became_peered":"2023-03-03T06:25:04.443599+0000","last_unstale":"2023-03-03T06:26:29.986070+0000","last_undegraded":"2023-03-03T06:26:29.986070+0000","last_fullsized":"2023-03-03T06:26:29.986070+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001546473,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975384+0000","last_change":"2023-03-03T06:26:07.443410+0000","last_active":"2023-03-03T06:26:29.975384+0000","last_peered":"2023-03-03T06:26:29.975384+0000","last_clean":"2023-03-03T06:26:29.975384+0000","last_became_active":"2023-03-03T06:26:05.457518+0000","last_became_peered":"2023-03-03T06:26:05.457518+0000","last_unstale":"2023-03-03T06:26:29.975384+0000","last_undegraded":"2023-03-03T06:26:29.975384+0000","last_fullsized":"2023-03-03T06:26:29.975384+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:20:03.378440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000254758,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978405+0000","last_change":"2023-03-03T06:26:29.995956+0000","last_active":"2023-03-03T06:26:30.978405+0000","last_peered":"2023-03-03T06:26:30.978405+0000","last_clean":"2023-03-03T06:26:30.978405+0000","last_became_active":"2023-03-03T06:26:29.995699+0000","last_became_peered":"2023-03-03T06:26:29.995699+0000","last_unstale":"2023-03-03T06:26:30.978405+0000","last_undegraded":"2023-03-03T06:26:30.978405+0000","last_fullsized":"2023-03-03T06:26:30.978405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:17:07.516450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.977624+0000","last_change":"2023-03-03T06:26:29.568469+0000","last_active":"2023-03-03T06:26:30.977624+0000","last_peered":"2023-03-03T06:26:30.977624+0000","last_clean":"2023-03-03T06:26:30.977624+0000","last_became_active":"2023-03-03T06:26:29.566577+0000","last_became_peered":"2023-03-03T06:26:29.566577+0000","last_unstale":"2023-03-03T06:26:30.977624+0000","last_undegraded":"2023-03-03T06:26:30.977624+0000","last_fullsized":"2023-03-03T06:26:30.977624+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:02:54.108310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980036+0000","last_change":"2023-03-03T06:26:06.457581+0000","last_active":"2023-03-03T06:26:29.980036+0000","last_peered":"2023-03-03T06:26:29.980036+0000","last_clean":"2023-03-03T06:26:29.980036+0000","last_became_active":"2023-03-03T06:26:06.457382+0000","last_became_peered":"2023-03-03T06:26:06.457382+0000","last_unstale":"2023-03-03T06:26:29.980036+0000","last_undegraded":"2023-03-03T06:26:29.980036+0000","last_fullsized":"2023-03-03T06:26:29.980036+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:16:49.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.974606+0000","last_change":"2023-03-03T06:25:05.432320+0000","last_active":"2023-03-03T06:26:29.974606+0000","last_peered":"2023-03-03T06:26:29.974606+0000","last_clean":"2023-03-03T06:26:29.974606+0000","last_became_active":"2023-03-03T06:25:04.436727+0000","last_became_peered":"2023-03-03T06:25:04.436727+0000","last_unstale":"2023-03-03T06:26:29.974606+0000","last_undegraded":"2023-03-03T06:26:29.974606+0000","last_fullsized":"2023-03-03T06:26:29.974606+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014361980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.989153+0000","last_change":"2023-03-03T06:26:08.328407+0000","last_active":"2023-03-03T06:26:29.989153+0000","last_peered":"2023-03-03T06:26:29.989153+0000","last_clean":"2023-03-03T06:26:29.989153+0000","last_became_active":"2023-03-03T06:26:05.457908+0000","last_became_peered":"2023-03-03T06:26:05.457908+0000","last_unstale":"2023-03-03T06:26:29.989153+0000","last_undegraded":"2023-03-03T06:26:29.989153+0000","last_fullsized":"2023-03-03T06:26:29.989153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:52:27.784873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048973500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978050+0000","last_change":"2023-03-03T06:26:29.992919+0000","last_active":"2023-03-03T06:26:30.978050+0000","last_peered":"2023-03-03T06:26:30.978050+0000","last_clean":"2023-03-03T06:26:30.978050+0000","last_became_active":"2023-03-03T06:26:29.992622+0000","last_became_peered":"2023-03-03T06:26:29.992622+0000","last_unstale":"2023-03-03T06:26:30.978050+0000","last_undegraded":"2023-03-03T06:26:30.978050+0000","last_fullsized":"2023-03-03T06:26:30.978050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:23:22.282206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"84'1","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603484+0000","last_change":"2023-03-03T06:26:29.565602+0000","last_active":"2023-03-03T06:26:31.603484+0000","last_peered":"2023-03-03T06:26:31.603484+0000","last_clean":"2023-03-03T06:26:31.603484+0000","last_became_active":"2023-03-03T06:26:29.565302+0000","last_became_peered":"2023-03-03T06:26:29.565302+0000","last_unstale":"2023-03-03T06:26:31.603484+0000","last_undegraded":"2023-03-03T06:26:31.603484+0000","last_fullsized":"2023-03-03T06:26:31.603484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:36:30.587345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.972610+0000","last_change":"2023-03-03T06:26:06.457173+0000","last_active":"2023-03-03T06:26:29.972610+0000","last_peered":"2023-03-03T06:26:29.972610+0000","last_clean":"2023-03-03T06:26:29.972610+0000","last_became_active":"2023-03-03T06:26:06.456849+0000","last_became_peered":"2023-03-03T06:26:06.456849+0000","last_unstale":"2023-03-03T06:26:29.972610+0000","last_undegraded":"2023-03-03T06:26:29.972610+0000","last_fullsized":"2023-03-03T06:26:29.972610+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:31:59.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976990+0000","last_change":"2023-03-03T06:25:05.635968+0000","last_active":"2023-03-03T06:26:29.976990+0000","last_peered":"2023-03-03T06:26:29.976990+0000","last_clean":"2023-03-03T06:26:29.976990+0000","last_became_active":"2023-03-03T06:25:04.443619+0000","last_became_peered":"2023-03-03T06:25:04.443619+0000","last_unstale":"2023-03-03T06:26:29.976990+0000","last_undegraded":"2023-03-03T06:26:29.976990+0000","last_fullsized":"2023-03-03T06:26:29.976990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:51:15.780667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077929799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.984144+0000","last_change":"2023-03-03T06:26:07.442869+0000","last_active":"2023-03-03T06:26:29.984144+0000","last_peered":"2023-03-03T06:26:29.984144+0000","last_clean":"2023-03-03T06:26:29.984144+0000","last_became_active":"2023-03-03T06:26:05.453329+0000","last_became_peered":"2023-03-03T06:26:05.453329+0000","last_unstale":"2023-03-03T06:26:29.984144+0000","last_undegraded":"2023-03-03T06:26:29.984144+0000","last_fullsized":"2023-03-03T06:26:29.984144+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:10:58.480669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000663498,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339910+0000","last_change":"2023-03-03T06:26:29.999400+0000","last_active":"2023-03-03T06:26:31.339910+0000","last_peered":"2023-03-03T06:26:31.339910+0000","last_clean":"2023-03-03T06:26:31.339910+0000","last_became_active":"2023-03-03T06:26:29.998771+0000","last_became_peered":"2023-03-03T06:26:29.998771+0000","last_unstale":"2023-03-03T06:26:31.339910+0000","last_undegraded":"2023-03-03T06:26:31.339910+0000","last_fullsized":"2023-03-03T06:26:31.339910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:37:28.651873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"84'1","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.977292+0000","last_change":"2023-03-03T06:26:29.556472+0000","last_active":"2023-03-03T06:26:30.977292+0000","last_peered":"2023-03-03T06:26:30.977292+0000","last_clean":"2023-03-03T06:26:30.977292+0000","last_became_active":"2023-03-03T06:26:29.556199+0000","last_became_peered":"2023-03-03T06:26:29.556199+0000","last_unstale":"2023-03-03T06:26:30.977292+0000","last_undegraded":"2023-03-03T06:26:30.977292+0000","last_fullsized":"2023-03-03T06:26:30.977292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:05:34.578653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988551+0000","last_change":"2023-03-03T06:26:06.453164+0000","last_active":"2023-03-03T06:26:29.988551+0000","last_peered":"2023-03-03T06:26:29.988551+0000","last_clean":"2023-03-03T06:26:29.988551+0000","last_became_active":"2023-03-03T06:26:06.452775+0000","last_became_peered":"2023-03-03T06:26:06.452775+0000","last_unstale":"2023-03-03T06:26:29.988551+0000","last_undegraded":"2023-03-03T06:26:29.988551+0000","last_fullsized":"2023-03-03T06:26:29.988551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:31:00.339823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973767+0000","last_change":"2023-03-03T06:25:05.432139+0000","last_active":"2023-03-03T06:26:29.973767+0000","last_peered":"2023-03-03T06:26:29.973767+0000","last_clean":"2023-03-03T06:26:29.973767+0000","last_became_active":"2023-03-03T06:25:04.435759+0000","last_became_peered":"2023-03-03T06:25:04.435759+0000","last_unstale":"2023-03-03T06:26:29.973767+0000","last_undegraded":"2023-03-03T06:26:29.973767+0000","last_fullsized":"2023-03-03T06:26:29.973767+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001646893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.981872+0000","last_change":"2023-03-03T06:26:07.979888+0000","last_active":"2023-03-03T06:26:29.981872+0000","last_peered":"2023-03-03T06:26:29.981872+0000","last_clean":"2023-03-03T06:26:29.981872+0000","last_became_active":"2023-03-03T06:26:05.452094+0000","last_became_peered":"2023-03-03T06:26:05.452094+0000","last_unstale":"2023-03-03T06:26:29.981872+0000","last_undegraded":"2023-03-03T06:26:29.981872+0000","last_fullsized":"2023-03-03T06:26:29.981872+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:46:11.362865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000772757,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979184+0000","last_change":"2023-03-03T06:26:29.986369+0000","last_active":"2023-03-03T06:26:30.979184+0000","last_peered":"2023-03-03T06:26:30.979184+0000","last_clean":"2023-03-03T06:26:30.979184+0000","last_became_active":"2023-03-03T06:26:29.986106+0000","last_became_peered":"2023-03-03T06:26:29.986106+0000","last_unstale":"2023-03-03T06:26:30.979184+0000","last_undegraded":"2023-03-03T06:26:30.979184+0000","last_fullsized":"2023-03-03T06:26:30.979184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:04.123198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"84'2","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979455+0000","last_change":"2023-03-03T06:26:29.561218+0000","last_active":"2023-03-03T06:26:30.979455+0000","last_peered":"2023-03-03T06:26:30.979455+0000","last_clean":"2023-03-03T06:26:30.979455+0000","last_became_active":"2023-03-03T06:26:29.560973+0000","last_became_peered":"2023-03-03T06:26:29.560973+0000","last_unstale":"2023-03-03T06:26:30.979455+0000","last_undegraded":"2023-03-03T06:26:30.979455+0000","last_fullsized":"2023-03-03T06:26:30.979455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:35:04.097070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973843+0000","last_change":"2023-03-03T06:26:06.451616+0000","last_active":"2023-03-03T06:26:29.973843+0000","last_peered":"2023-03-03T06:26:29.973843+0000","last_clean":"2023-03-03T06:26:29.973843+0000","last_became_active":"2023-03-03T06:26:06.451034+0000","last_became_peered":"2023-03-03T06:26:06.451034+0000","last_unstale":"2023-03-03T06:26:29.973843+0000","last_undegraded":"2023-03-03T06:26:29.973843+0000","last_fullsized":"2023-03-03T06:26:29.973843+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:43:29.025900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.987804+0000","last_change":"2023-03-03T06:26:07.743530+0000","last_active":"2023-03-03T06:26:29.987804+0000","last_peered":"2023-03-03T06:26:29.987804+0000","last_clean":"2023-03-03T06:26:29.987804+0000","last_became_active":"2023-03-03T06:26:05.450200+0000","last_became_peered":"2023-03-03T06:26:05.450200+0000","last_unstale":"2023-03-03T06:26:29.987804+0000","last_undegraded":"2023-03-03T06:26:29.987804+0000","last_fullsized":"2023-03-03T06:26:29.987804+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:43:07.459264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035572099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.972769+0000","last_change":"2023-03-03T06:25:05.431490+0000","last_active":"2023-03-03T06:26:29.972769+0000","last_peered":"2023-03-03T06:26:29.972769+0000","last_clean":"2023-03-03T06:26:29.972769+0000","last_became_active":"2023-03-03T06:25:04.443163+0000","last_became_peered":"2023-03-03T06:25:04.443163+0000","last_unstale":"2023-03-03T06:26:29.972769+0000","last_undegraded":"2023-03-03T06:26:29.972769+0000","last_fullsized":"2023-03-03T06:26:29.972769+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020118839999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.977899+0000","last_change":"2023-03-03T06:26:29.989724+0000","last_active":"2023-03-03T06:26:30.977899+0000","last_peered":"2023-03-03T06:26:30.977899+0000","last_clean":"2023-03-03T06:26:30.977899+0000","last_became_active":"2023-03-03T06:26:29.989443+0000","last_became_peered":"2023-03-03T06:26:29.989443+0000","last_unstale":"2023-03-03T06:26:30.977899+0000","last_undegraded":"2023-03-03T06:26:30.977899+0000","last_fullsized":"2023-03-03T06:26:30.977899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:22:14.553934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"84'2","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601913+0000","last_change":"2023-03-03T06:26:29.561645+0000","last_active":"2023-03-03T06:26:31.601913+0000","last_peered":"2023-03-03T06:26:31.601913+0000","last_clean":"2023-03-03T06:26:31.601913+0000","last_became_active":"2023-03-03T06:26:29.561378+0000","last_became_peered":"2023-03-03T06:26:29.561378+0000","last_unstale":"2023-03-03T06:26:31.601913+0000","last_undegraded":"2023-03-03T06:26:31.601913+0000","last_fullsized":"2023-03-03T06:26:31.601913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:20:20.221568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973395+0000","last_change":"2023-03-03T06:26:06.454499+0000","last_active":"2023-03-03T06:26:29.973395+0000","last_peered":"2023-03-03T06:26:29.973395+0000","last_clean":"2023-03-03T06:26:29.973395+0000","last_became_active":"2023-03-03T06:26:06.453966+0000","last_became_peered":"2023-03-03T06:26:06.453966+0000","last_unstale":"2023-03-03T06:26:29.973395+0000","last_undegraded":"2023-03-03T06:26:29.973395+0000","last_fullsized":"2023-03-03T06:26:29.973395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:36:07.476248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977252+0000","last_change":"2023-03-03T06:26:07.442340+0000","last_active":"2023-03-03T06:26:29.977252+0000","last_peered":"2023-03-03T06:26:29.977252+0000","last_clean":"2023-03-03T06:26:29.977252+0000","last_became_active":"2023-03-03T06:26:05.447268+0000","last_became_peered":"2023-03-03T06:26:05.447268+0000","last_unstale":"2023-03-03T06:26:29.977252+0000","last_undegraded":"2023-03-03T06:26:29.977252+0000","last_fullsized":"2023-03-03T06:26:29.977252+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:10:58.480669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078222399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975224+0000","last_change":"2023-03-03T06:25:05.430443+0000","last_active":"2023-03-03T06:26:29.975224+0000","last_peered":"2023-03-03T06:26:29.975224+0000","last_clean":"2023-03-03T06:26:29.975224+0000","last_became_active":"2023-03-03T06:25:04.596481+0000","last_became_peered":"2023-03-03T06:25:04.596481+0000","last_unstale":"2023-03-03T06:26:29.975224+0000","last_undegraded":"2023-03-03T06:26:29.975224+0000","last_fullsized":"2023-03-03T06:26:29.975224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044860800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339170+0000","last_change":"2023-03-03T06:26:29.986042+0000","last_active":"2023-03-03T06:26:31.339170+0000","last_peered":"2023-03-03T06:26:31.339170+0000","last_clean":"2023-03-03T06:26:31.339170+0000","last_became_active":"2023-03-03T06:26:29.985499+0000","last_became_peered":"2023-03-03T06:26:29.985499+0000","last_unstale":"2023-03-03T06:26:31.339170+0000","last_undegraded":"2023-03-03T06:26:31.339170+0000","last_fullsized":"2023-03-03T06:26:31.339170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:27:35.210679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"84'4","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978163+0000","last_change":"2023-03-03T06:26:29.570027+0000","last_active":"2023-03-03T06:26:30.978163+0000","last_peered":"2023-03-03T06:26:30.978163+0000","last_clean":"2023-03-03T06:26:30.978163+0000","last_became_active":"2023-03-03T06:26:29.569263+0000","last_became_peered":"2023-03-03T06:26:29.569263+0000","last_unstale":"2023-03-03T06:26:30.978163+0000","last_undegraded":"2023-03-03T06:26:30.978163+0000","last_fullsized":"2023-03-03T06:26:30.978163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:30:20.418498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988860+0000","last_change":"2023-03-03T06:26:06.452412+0000","last_active":"2023-03-03T06:26:29.988860+0000","last_peered":"2023-03-03T06:26:29.988860+0000","last_clean":"2023-03-03T06:26:29.988860+0000","last_became_active":"2023-03-03T06:26:06.452090+0000","last_became_peered":"2023-03-03T06:26:06.452090+0000","last_unstale":"2023-03-03T06:26:29.988860+0000","last_undegraded":"2023-03-03T06:26:29.988860+0000","last_fullsized":"2023-03-03T06:26:29.988860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:55:25.087974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.989115+0000","last_change":"2023-03-03T06:26:07.980394+0000","last_active":"2023-03-03T06:26:29.989115+0000","last_peered":"2023-03-03T06:26:29.989115+0000","last_clean":"2023-03-03T06:26:29.989115+0000","last_became_active":"2023-03-03T06:26:05.457769+0000","last_became_peered":"2023-03-03T06:26:05.457769+0000","last_unstale":"2023-03-03T06:26:29.989115+0000","last_undegraded":"2023-03-03T06:26:29.989115+0000","last_fullsized":"2023-03-03T06:26:29.989115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:46:56.893095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059490200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.974824+0000","last_change":"2023-03-03T06:25:05.429739+0000","last_active":"2023-03-03T06:26:29.974824+0000","last_peered":"2023-03-03T06:26:29.974824+0000","last_clean":"2023-03-03T06:26:29.974824+0000","last_became_active":"2023-03-03T06:25:04.438903+0000","last_became_peered":"2023-03-03T06:25:04.438903+0000","last_unstale":"2023-03-03T06:26:29.974824+0000","last_undegraded":"2023-03-03T06:26:29.974824+0000","last_fullsized":"2023-03-03T06:26:29.974824+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040434999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350374+0000","last_change":"2023-03-03T06:26:29.988541+0000","last_active":"2023-03-03T06:26:31.350374+0000","last_peered":"2023-03-03T06:26:31.350374+0000","last_clean":"2023-03-03T06:26:31.350374+0000","last_became_active":"2023-03-03T06:26:29.988102+0000","last_became_peered":"2023-03-03T06:26:29.988102+0000","last_unstale":"2023-03-03T06:26:31.350374+0000","last_undegraded":"2023-03-03T06:26:31.350374+0000","last_fullsized":"2023-03-03T06:26:31.350374+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:25:30.914082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"84'1","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.351079+0000","last_change":"2023-03-03T06:26:29.565911+0000","last_active":"2023-03-03T06:26:31.351079+0000","last_peered":"2023-03-03T06:26:31.351079+0000","last_clean":"2023-03-03T06:26:31.351079+0000","last_became_active":"2023-03-03T06:26:29.565318+0000","last_became_peered":"2023-03-03T06:26:29.565318+0000","last_unstale":"2023-03-03T06:26:31.351079+0000","last_undegraded":"2023-03-03T06:26:31.351079+0000","last_fullsized":"2023-03-03T06:26:31.351079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:47:21.008848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975496+0000","last_change":"2023-03-03T06:26:06.456012+0000","last_active":"2023-03-03T06:26:29.975496+0000","last_peered":"2023-03-03T06:26:29.975496+0000","last_clean":"2023-03-03T06:26:29.975496+0000","last_became_active":"2023-03-03T06:26:06.455710+0000","last_became_peered":"2023-03-03T06:26:06.455710+0000","last_unstale":"2023-03-03T06:26:29.975496+0000","last_undegraded":"2023-03-03T06:26:29.975496+0000","last_fullsized":"2023-03-03T06:26:29.975496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:15:17.648669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976874+0000","last_change":"2023-03-03T06:25:05.635716+0000","last_active":"2023-03-03T06:26:29.976874+0000","last_peered":"2023-03-03T06:26:29.976874+0000","last_clean":"2023-03-03T06:26:29.976874+0000","last_became_active":"2023-03-03T06:25:04.433896+0000","last_became_peered":"2023-03-03T06:25:04.433896+0000","last_unstale":"2023-03-03T06:26:29.976874+0000","last_undegraded":"2023-03-03T06:26:29.976874+0000","last_fullsized":"2023-03-03T06:26:29.976874+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:35.209807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060132199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980556+0000","last_change":"2023-03-03T06:26:07.742995+0000","last_active":"2023-03-03T06:26:29.980556+0000","last_peered":"2023-03-03T06:26:29.980556+0000","last_clean":"2023-03-03T06:26:29.980556+0000","last_became_active":"2023-03-03T06:26:05.445510+0000","last_became_peered":"2023-03-03T06:26:05.445510+0000","last_unstale":"2023-03-03T06:26:29.980556+0000","last_undegraded":"2023-03-03T06:26:29.980556+0000","last_fullsized":"2023-03-03T06:26:29.980556+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:48:14.934957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054098000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350742+0000","last_change":"2023-03-03T06:26:29.985224+0000","last_active":"2023-03-03T06:26:31.350742+0000","last_peered":"2023-03-03T06:26:31.350742+0000","last_clean":"2023-03-03T06:26:31.350742+0000","last_became_active":"2023-03-03T06:26:29.984967+0000","last_became_peered":"2023-03-03T06:26:29.984967+0000","last_unstale":"2023-03-03T06:26:31.350742+0000","last_undegraded":"2023-03-03T06:26:31.350742+0000","last_fullsized":"2023-03-03T06:26:31.350742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:25:23.406448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350563+0000","last_change":"2023-03-03T06:26:29.569685+0000","last_active":"2023-03-03T06:26:31.350563+0000","last_peered":"2023-03-03T06:26:31.350563+0000","last_clean":"2023-03-03T06:26:31.350563+0000","last_became_active":"2023-03-03T06:26:29.567040+0000","last_became_peered":"2023-03-03T06:26:29.567040+0000","last_unstale":"2023-03-03T06:26:31.350563+0000","last_undegraded":"2023-03-03T06:26:31.350563+0000","last_fullsized":"2023-03-03T06:26:31.350563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:39:56.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.983067+0000","last_change":"2023-03-03T06:26:06.451354+0000","last_active":"2023-03-03T06:26:29.983067+0000","last_peered":"2023-03-03T06:26:29.983067+0000","last_clean":"2023-03-03T06:26:29.983067+0000","last_became_active":"2023-03-03T06:26:06.450833+0000","last_became_peered":"2023-03-03T06:26:06.450833+0000","last_unstale":"2023-03-03T06:26:29.983067+0000","last_undegraded":"2023-03-03T06:26:29.983067+0000","last_fullsized":"2023-03-03T06:26:29.983067+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:43:08.463920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.985898+0000","last_change":"2023-03-03T06:25:05.431768+0000","last_active":"2023-03-03T06:26:29.985898+0000","last_peered":"2023-03-03T06:26:29.985898+0000","last_clean":"2023-03-03T06:26:29.985898+0000","last_became_active":"2023-03-03T06:25:04.596711+0000","last_became_peered":"2023-03-03T06:25:04.596711+0000","last_unstale":"2023-03-03T06:26:29.985898+0000","last_undegraded":"2023-03-03T06:26:29.985898+0000","last_fullsized":"2023-03-03T06:26:29.985898+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001569261,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980956+0000","last_change":"2023-03-03T06:26:07.980395+0000","last_active":"2023-03-03T06:26:29.980956+0000","last_peered":"2023-03-03T06:26:29.980956+0000","last_clean":"2023-03-03T06:26:29.980956+0000","last_became_active":"2023-03-03T06:26:05.451720+0000","last_became_peered":"2023-03-03T06:26:05.451720+0000","last_unstale":"2023-03-03T06:26:29.980956+0000","last_undegraded":"2023-03-03T06:26:29.980956+0000","last_fullsized":"2023-03-03T06:26:29.980956+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:49:56.977188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081553799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.340041+0000","last_change":"2023-03-03T06:26:30.000255+0000","last_active":"2023-03-03T06:26:31.340041+0000","last_peered":"2023-03-03T06:26:31.340041+0000","last_clean":"2023-03-03T06:26:31.340041+0000","last_became_active":"2023-03-03T06:26:29.999981+0000","last_became_peered":"2023-03-03T06:26:29.999981+0000","last_unstale":"2023-03-03T06:26:31.340041+0000","last_undegraded":"2023-03-03T06:26:31.340041+0000","last_fullsized":"2023-03-03T06:26:31.340041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:23:27.191250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"84'8","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978964+0000","last_change":"2023-03-03T06:26:29.559643+0000","last_active":"2023-03-03T06:26:30.978964+0000","last_peered":"2023-03-03T06:26:30.978964+0000","last_clean":"2023-03-03T06:26:30.978964+0000","last_became_active":"2023-03-03T06:26:29.559304+0000","last_became_peered":"2023-03-03T06:26:29.559304+0000","last_unstale":"2023-03-03T06:26:30.978964+0000","last_undegraded":"2023-03-03T06:26:30.978964+0000","last_fullsized":"2023-03-03T06:26:30.978964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:34:13.624083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.974742+0000","last_change":"2023-03-03T06:26:06.452749+0000","last_active":"2023-03-03T06:26:29.974742+0000","last_peered":"2023-03-03T06:26:29.974742+0000","last_clean":"2023-03-03T06:26:29.974742+0000","last_became_active":"2023-03-03T06:26:06.452457+0000","last_became_peered":"2023-03-03T06:26:06.452457+0000","last_unstale":"2023-03-03T06:26:29.974742+0000","last_undegraded":"2023-03-03T06:26:29.974742+0000","last_fullsized":"2023-03-03T06:26:29.974742+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:25:06.801245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988820+0000","last_change":"2023-03-03T06:25:05.616017+0000","last_active":"2023-03-03T06:26:29.988820+0000","last_peered":"2023-03-03T06:26:29.988820+0000","last_clean":"2023-03-03T06:26:29.988820+0000","last_became_active":"2023-03-03T06:25:04.443176+0000","last_became_peered":"2023-03-03T06:25:04.443176+0000","last_unstale":"2023-03-03T06:26:29.988820+0000","last_undegraded":"2023-03-03T06:26:29.988820+0000","last_fullsized":"2023-03-03T06:26:29.988820+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:38:47.576162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034461600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.972534+0000","last_change":"2023-03-03T06:26:07.736472+0000","last_active":"2023-03-03T06:26:29.972534+0000","last_peered":"2023-03-03T06:26:29.972534+0000","last_clean":"2023-03-03T06:26:29.972534+0000","last_became_active":"2023-03-03T06:26:05.453291+0000","last_became_peered":"2023-03-03T06:26:05.453291+0000","last_unstale":"2023-03-03T06:26:29.972534+0000","last_undegraded":"2023-03-03T06:26:29.972534+0000","last_fullsized":"2023-03-03T06:26:29.972534+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:30:11.313163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050543599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.977784+0000","last_change":"2023-03-03T06:26:29.987064+0000","last_active":"2023-03-03T06:26:30.977784+0000","last_peered":"2023-03-03T06:26:30.977784+0000","last_clean":"2023-03-03T06:26:30.977784+0000","last_became_active":"2023-03-03T06:26:29.986772+0000","last_became_peered":"2023-03-03T06:26:29.986772+0000","last_unstale":"2023-03-03T06:26:30.977784+0000","last_undegraded":"2023-03-03T06:26:30.977784+0000","last_fullsized":"2023-03-03T06:26:30.977784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:34:14.625823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"84'2","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.602097+0000","last_change":"2023-03-03T06:26:29.571199+0000","last_active":"2023-03-03T06:26:31.602097+0000","last_peered":"2023-03-03T06:26:31.602097+0000","last_clean":"2023-03-03T06:26:31.602097+0000","last_became_active":"2023-03-03T06:26:29.570908+0000","last_became_peered":"2023-03-03T06:26:29.570908+0000","last_unstale":"2023-03-03T06:26:31.602097+0000","last_undegraded":"2023-03-03T06:26:31.602097+0000","last_fullsized":"2023-03-03T06:26:31.602097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:11:03.863707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977684+0000","last_change":"2023-03-03T06:26:06.443325+0000","last_active":"2023-03-03T06:26:29.977684+0000","last_peered":"2023-03-03T06:26:29.977684+0000","last_clean":"2023-03-03T06:26:29.977684+0000","last_became_active":"2023-03-03T06:26:06.442962+0000","last_became_peered":"2023-03-03T06:26:06.442962+0000","last_unstale":"2023-03-03T06:26:29.977684+0000","last_undegraded":"2023-03-03T06:26:29.977684+0000","last_fullsized":"2023-03-03T06:26:29.977684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:24:03.091741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976064+0000","last_change":"2023-03-03T06:25:05.430594+0000","last_active":"2023-03-03T06:26:29.976064+0000","last_peered":"2023-03-03T06:26:29.976064+0000","last_clean":"2023-03-03T06:26:29.976064+0000","last_became_active":"2023-03-03T06:25:04.435012+0000","last_became_peered":"2023-03-03T06:25:04.435012+0000","last_unstale":"2023-03-03T06:26:29.976064+0000","last_undegraded":"2023-03-03T06:26:29.976064+0000","last_fullsized":"2023-03-03T06:26:29.976064+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052988999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.984863+0000","last_change":"2023-03-03T06:26:08.327756+0000","last_active":"2023-03-03T06:26:29.984863+0000","last_peered":"2023-03-03T06:26:29.984863+0000","last_clean":"2023-03-03T06:26:29.984863+0000","last_became_active":"2023-03-03T06:26:05.445673+0000","last_became_peered":"2023-03-03T06:26:05.445673+0000","last_unstale":"2023-03-03T06:26:29.984863+0000","last_undegraded":"2023-03-03T06:26:29.984863+0000","last_fullsized":"2023-03-03T06:26:29.984863+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:13:53.100665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034731200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604233+0000","last_change":"2023-03-03T06:26:29.997825+0000","last_active":"2023-03-03T06:26:31.604233+0000","last_peered":"2023-03-03T06:26:31.604233+0000","last_clean":"2023-03-03T06:26:31.604233+0000","last_became_active":"2023-03-03T06:26:29.997550+0000","last_became_peered":"2023-03-03T06:26:29.997550+0000","last_unstale":"2023-03-03T06:26:31.604233+0000","last_undegraded":"2023-03-03T06:26:31.604233+0000","last_fullsized":"2023-03-03T06:26:31.604233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:05:35.580392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978083+0000","last_change":"2023-03-03T06:26:29.568857+0000","last_active":"2023-03-03T06:26:30.978083+0000","last_peered":"2023-03-03T06:26:30.978083+0000","last_clean":"2023-03-03T06:26:30.978083+0000","last_became_active":"2023-03-03T06:26:29.568626+0000","last_became_peered":"2023-03-03T06:26:29.568626+0000","last_unstale":"2023-03-03T06:26:30.978083+0000","last_undegraded":"2023-03-03T06:26:30.978083+0000","last_fullsized":"2023-03-03T06:26:30.978083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:07:39.572654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.979230+0000","last_change":"2023-03-03T06:26:06.447479+0000","last_active":"2023-03-03T06:26:29.979230+0000","last_peered":"2023-03-03T06:26:29.979230+0000","last_clean":"2023-03-03T06:26:29.979230+0000","last_became_active":"2023-03-03T06:26:06.447180+0000","last_became_peered":"2023-03-03T06:26:06.447180+0000","last_unstale":"2023-03-03T06:26:29.979230+0000","last_undegraded":"2023-03-03T06:26:29.979230+0000","last_fullsized":"2023-03-03T06:26:29.979230+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:31:38.218862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.989191+0000","last_change":"2023-03-03T06:25:05.615943+0000","last_active":"2023-03-03T06:26:29.989191+0000","last_peered":"2023-03-03T06:26:29.989191+0000","last_clean":"2023-03-03T06:26:29.989191+0000","last_became_active":"2023-03-03T06:25:04.443824+0000","last_became_peered":"2023-03-03T06:25:04.443824+0000","last_unstale":"2023-03-03T06:26:29.989191+0000","last_undegraded":"2023-03-03T06:26:29.989191+0000","last_fullsized":"2023-03-03T06:26:29.989191+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:11.723607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059238800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.983160+0000","last_change":"2023-03-03T06:26:08.327670+0000","last_active":"2023-03-03T06:26:29.983160+0000","last_peered":"2023-03-03T06:26:29.983160+0000","last_clean":"2023-03-03T06:26:29.983160+0000","last_became_active":"2023-03-03T06:26:05.457767+0000","last_became_peered":"2023-03-03T06:26:05.457767+0000","last_unstale":"2023-03-03T06:26:29.983160+0000","last_undegraded":"2023-03-03T06:26:29.983160+0000","last_fullsized":"2023-03-03T06:26:29.983160+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:18.572579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038899699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350450+0000","last_change":"2023-03-03T06:26:29.993824+0000","last_active":"2023-03-03T06:26:31.350450+0000","last_peered":"2023-03-03T06:26:31.350450+0000","last_clean":"2023-03-03T06:26:31.350450+0000","last_became_active":"2023-03-03T06:26:29.993553+0000","last_became_peered":"2023-03-03T06:26:29.993553+0000","last_unstale":"2023-03-03T06:26:31.350450+0000","last_undegraded":"2023-03-03T06:26:31.350450+0000","last_fullsized":"2023-03-03T06:26:31.350450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:39:50.979298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"84'3","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603866+0000","last_change":"2023-03-03T06:26:29.563874+0000","last_active":"2023-03-03T06:26:31.603866+0000","last_peered":"2023-03-03T06:26:31.603866+0000","last_clean":"2023-03-03T06:26:31.603866+0000","last_became_active":"2023-03-03T06:26:29.563679+0000","last_became_peered":"2023-03-03T06:26:29.563679+0000","last_unstale":"2023-03-03T06:26:31.603866+0000","last_undegraded":"2023-03-03T06:26:31.603866+0000","last_fullsized":"2023-03-03T06:26:31.603866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:05:35.389897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975911+0000","last_change":"2023-03-03T06:26:06.450830+0000","last_active":"2023-03-03T06:26:29.975911+0000","last_peered":"2023-03-03T06:26:29.975911+0000","last_clean":"2023-03-03T06:26:29.975911+0000","last_became_active":"2023-03-03T06:26:06.450543+0000","last_became_peered":"2023-03-03T06:26:06.450543+0000","last_unstale":"2023-03-03T06:26:29.975911+0000","last_undegraded":"2023-03-03T06:26:29.975911+0000","last_fullsized":"2023-03-03T06:26:29.975911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:56:19.213028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.986412+0000","last_change":"2023-03-03T06:25:05.796744+0000","last_active":"2023-03-03T06:26:29.986412+0000","last_peered":"2023-03-03T06:26:29.986412+0000","last_clean":"2023-03-03T06:26:29.986412+0000","last_became_active":"2023-03-03T06:25:04.444571+0000","last_became_peered":"2023-03-03T06:25:04.444571+0000","last_unstale":"2023-03-03T06:26:29.986412+0000","last_undegraded":"2023-03-03T06:26:29.986412+0000","last_fullsized":"2023-03-03T06:26:29.986412+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:46:48.500233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050328500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977762+0000","last_change":"2023-03-03T06:26:07.438150+0000","last_active":"2023-03-03T06:26:29.977762+0000","last_peered":"2023-03-03T06:26:29.977762+0000","last_clean":"2023-03-03T06:26:29.977762+0000","last_became_active":"2023-03-03T06:26:05.457047+0000","last_became_peered":"2023-03-03T06:26:05.457047+0000","last_unstale":"2023-03-03T06:26:29.977762+0000","last_undegraded":"2023-03-03T06:26:29.977762+0000","last_fullsized":"2023-03-03T06:26:29.977762+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:55:24.083318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035894099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601822+0000","last_change":"2023-03-03T06:26:29.995009+0000","last_active":"2023-03-03T06:26:31.601822+0000","last_peered":"2023-03-03T06:26:31.601822+0000","last_clean":"2023-03-03T06:26:31.601822+0000","last_became_active":"2023-03-03T06:26:29.994406+0000","last_became_peered":"2023-03-03T06:26:29.994406+0000","last_unstale":"2023-03-03T06:26:31.601822+0000","last_undegraded":"2023-03-03T06:26:31.601822+0000","last_fullsized":"2023-03-03T06:26:31.601822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:43:53.138737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"84'6","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604167+0000","last_change":"2023-03-03T06:26:29.570172+0000","last_active":"2023-03-03T06:26:31.604167+0000","last_peered":"2023-03-03T06:26:31.604167+0000","last_clean":"2023-03-03T06:26:31.604167+0000","last_became_active":"2023-03-03T06:26:29.569909+0000","last_became_peered":"2023-03-03T06:26:29.569909+0000","last_unstale":"2023-03-03T06:26:31.604167+0000","last_undegraded":"2023-03-03T06:26:31.604167+0000","last_fullsized":"2023-03-03T06:26:31.604167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:24:29.811063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.982980+0000","last_change":"2023-03-03T06:26:06.454242+0000","last_active":"2023-03-03T06:26:29.982980+0000","last_peered":"2023-03-03T06:26:29.982980+0000","last_clean":"2023-03-03T06:26:29.982980+0000","last_became_active":"2023-03-03T06:26:06.453973+0000","last_became_peered":"2023-03-03T06:26:06.453973+0000","last_unstale":"2023-03-03T06:26:29.982980+0000","last_undegraded":"2023-03-03T06:26:29.982980+0000","last_fullsized":"2023-03-03T06:26:29.982980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:04:10.018040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.984001+0000","last_change":"2023-03-03T06:25:05.431475+0000","last_active":"2023-03-03T06:26:29.984001+0000","last_peered":"2023-03-03T06:26:29.984001+0000","last_clean":"2023-03-03T06:26:29.984001+0000","last_became_active":"2023-03-03T06:25:04.596724+0000","last_became_peered":"2023-03-03T06:25:04.596724+0000","last_unstale":"2023-03-03T06:26:29.984001+0000","last_undegraded":"2023-03-03T06:26:29.984001+0000","last_fullsized":"2023-03-03T06:26:29.984001+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015785179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.985686+0000","last_change":"2023-03-03T06:26:07.443588+0000","last_active":"2023-03-03T06:26:29.985686+0000","last_peered":"2023-03-03T06:26:29.985686+0000","last_clean":"2023-03-03T06:26:29.985686+0000","last_became_active":"2023-03-03T06:26:05.450433+0000","last_became_peered":"2023-03-03T06:26:05.450433+0000","last_unstale":"2023-03-03T06:26:29.985686+0000","last_undegraded":"2023-03-03T06:26:29.985686+0000","last_fullsized":"2023-03-03T06:26:29.985686+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:27.368396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037040499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339055+0000","last_change":"2023-03-03T06:26:29.986645+0000","last_active":"2023-03-03T06:26:31.339055+0000","last_peered":"2023-03-03T06:26:31.339055+0000","last_clean":"2023-03-03T06:26:31.339055+0000","last_became_active":"2023-03-03T06:26:29.985829+0000","last_became_peered":"2023-03-03T06:26:29.985829+0000","last_unstale":"2023-03-03T06:26:31.339055+0000","last_undegraded":"2023-03-03T06:26:31.339055+0000","last_fullsized":"2023-03-03T06:26:31.339055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:40:54.496835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979955+0000","last_change":"2023-03-03T06:26:29.559592+0000","last_active":"2023-03-03T06:26:30.979955+0000","last_peered":"2023-03-03T06:26:30.979955+0000","last_clean":"2023-03-03T06:26:30.979955+0000","last_became_active":"2023-03-03T06:26:29.559285+0000","last_became_peered":"2023-03-03T06:26:29.559285+0000","last_unstale":"2023-03-03T06:26:30.979955+0000","last_undegraded":"2023-03-03T06:26:30.979955+0000","last_fullsized":"2023-03-03T06:26:30.979955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:27:54.295369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.983506+0000","last_change":"2023-03-03T06:26:06.457868+0000","last_active":"2023-03-03T06:26:29.983506+0000","last_peered":"2023-03-03T06:26:29.983506+0000","last_clean":"2023-03-03T06:26:29.983506+0000","last_became_active":"2023-03-03T06:26:06.457553+0000","last_became_peered":"2023-03-03T06:26:06.457553+0000","last_unstale":"2023-03-03T06:26:29.983506+0000","last_undegraded":"2023-03-03T06:26:29.983506+0000","last_fullsized":"2023-03-03T06:26:29.983506+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:10:34.072352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.982246+0000","last_change":"2023-03-03T06:25:05.615550+0000","last_active":"2023-03-03T06:26:29.982246+0000","last_peered":"2023-03-03T06:26:29.982246+0000","last_clean":"2023-03-03T06:26:29.982246+0000","last_became_active":"2023-03-03T06:25:04.445574+0000","last_became_peered":"2023-03-03T06:25:04.445574+0000","last_unstale":"2023-03-03T06:26:29.982246+0000","last_undegraded":"2023-03-03T06:26:29.982246+0000","last_fullsized":"2023-03-03T06:26:29.982246+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:15:06.370284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061229600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975449+0000","last_change":"2023-03-03T06:26:07.442151+0000","last_active":"2023-03-03T06:26:29.975449+0000","last_peered":"2023-03-03T06:26:29.975449+0000","last_clean":"2023-03-03T06:26:29.975449+0000","last_became_active":"2023-03-03T06:26:05.452500+0000","last_became_peered":"2023-03-03T06:26:05.452500+0000","last_unstale":"2023-03-03T06:26:29.975449+0000","last_undegraded":"2023-03-03T06:26:29.975449+0000","last_fullsized":"2023-03-03T06:26:29.975449+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:04:02.946022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068804900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601480+0000","last_change":"2023-03-03T06:26:29.994050+0000","last_active":"2023-03-03T06:26:31.601480+0000","last_peered":"2023-03-03T06:26:31.601480+0000","last_clean":"2023-03-03T06:26:31.601480+0000","last_became_active":"2023-03-03T06:26:29.993735+0000","last_became_peered":"2023-03-03T06:26:29.993735+0000","last_unstale":"2023-03-03T06:26:31.601480+0000","last_undegraded":"2023-03-03T06:26:31.601480+0000","last_fullsized":"2023-03-03T06:26:31.601480+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:52:51.314233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339739+0000","last_change":"2023-03-03T06:26:29.562511+0000","last_active":"2023-03-03T06:26:31.339739+0000","last_peered":"2023-03-03T06:26:31.339739+0000","last_clean":"2023-03-03T06:26:31.339739+0000","last_became_active":"2023-03-03T06:26:29.561255+0000","last_became_peered":"2023-03-03T06:26:29.561255+0000","last_unstale":"2023-03-03T06:26:31.339739+0000","last_undegraded":"2023-03-03T06:26:31.339739+0000","last_fullsized":"2023-03-03T06:26:31.339739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:27:59.342691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988870+0000","last_change":"2023-03-03T06:26:06.443276+0000","last_active":"2023-03-03T06:26:29.988870+0000","last_peered":"2023-03-03T06:26:29.988870+0000","last_clean":"2023-03-03T06:26:29.988870+0000","last_became_active":"2023-03-03T06:26:06.442958+0000","last_became_peered":"2023-03-03T06:26:06.442958+0000","last_unstale":"2023-03-03T06:26:29.988870+0000","last_undegraded":"2023-03-03T06:26:29.988870+0000","last_fullsized":"2023-03-03T06:26:29.988870+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:09:04.949854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976871+0000","last_change":"2023-03-03T06:25:05.635776+0000","last_active":"2023-03-03T06:26:29.976871+0000","last_peered":"2023-03-03T06:26:29.976871+0000","last_clean":"2023-03-03T06:26:29.976871+0000","last_became_active":"2023-03-03T06:25:04.444243+0000","last_became_peered":"2023-03-03T06:25:04.444243+0000","last_unstale":"2023-03-03T06:26:29.976871+0000","last_undegraded":"2023-03-03T06:26:29.976871+0000","last_fullsized":"2023-03-03T06:26:29.976871+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:00:41.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066956899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.974447+0000","last_change":"2023-03-03T06:26:07.736704+0000","last_active":"2023-03-03T06:26:29.974447+0000","last_peered":"2023-03-03T06:26:29.974447+0000","last_clean":"2023-03-03T06:26:29.974447+0000","last_became_active":"2023-03-03T06:26:05.450014+0000","last_became_peered":"2023-03-03T06:26:05.450014+0000","last_unstale":"2023-03-03T06:26:29.974447+0000","last_undegraded":"2023-03-03T06:26:29.974447+0000","last_fullsized":"2023-03-03T06:26:29.974447+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:19:56.105815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040139800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11340,"kb_used_data":1604,"kb_used_omap":0,"kb_used_meta":9728,"kb_avail":94360500,"statfs":{"total":96636764160,"available":96625152000,"internally_reserved":0,"allocated":1642496,"data_stored":1118783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9961472},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71099999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.44800000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.64900000000000002,"5min":0.745,"15min":0.745},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70399999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68200000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.379},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72799999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63400000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70699999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.439}]},{"osd":5,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70899999999999996,"5min":0.746,"15min":0.746},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71299999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85399999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.53800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10260,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361580,"statfs":{"total":96636764160,"available":96626257920,"internally_reserved":0,"allocated":1060864,"data_stored":530391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76700000000000002,"5min":2.278,"15min":2.278},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":3.109,"5min":3.109,"15min":3.109},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.70999999999999996,"5min":0.751,"15min":0.751},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.629},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58399999999999996}]},{"osd":4,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.74399999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.71199999999999997}]},{"osd":5,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.623,"15min":0.625},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83299999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.69899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11400,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":9792,"kb_avail":94360440,"statfs":{"total":96636764160,"available":96625090560,"internally_reserved":0,"allocated":1638400,"data_stored":1118657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10027008},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35199999999999998,"15min":0.35299999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52000000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.378},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.34799999999999998,"15min":0.34499999999999997},"min":{"1min":0.28199999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.47299999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.314,"15min":0.312},"min":{"1min":0.25600000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.372,"15min":0.37},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.27100000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48799999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.314},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.372,"15min":0.375},"min":{"1min":0.23999999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.502,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80800000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.623},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47299999999999998}]},{"osd":6,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.443,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.503,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82299999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10380,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361460,"statfs":{"total":96636764160,"available":96626135040,"internally_reserved":0,"allocated":1052672,"data_stored":528932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.41199999999999998,"15min":0.42799999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.50700000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52000000000000002,"5min":1.827,"15min":1.827},"last":0.252}]},{"osd":2,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.41999999999999998,"15min":0.432},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65600000000000003,"5min":1.722,"15min":1.722},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.44700000000000001,"15min":0.46100000000000002},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61799999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.47499999999999998,"15min":0.49199999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.58799999999999997,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.1870000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.37}]},{"osd":4,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.434,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84699999999999998,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.45700000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92000000000000004,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86799999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82199999999999995,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.67600000000000005,"15min":0.68999999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81100000000000005,"5min":1.835,"15min":1.835},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.66400000000000003,"15min":0.67600000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88400000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.746,"5min":1.732,"15min":1.732},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10052,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361788,"statfs":{"total":96636764160,"available":96626470912,"internally_reserved":0,"allocated":1044480,"data_stored":528289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33100000000000002},"min":{"1min":0.23899999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.26600000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.70599999999999996,"15min":0.75},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.238,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.372}]},{"osd":3,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.52100000000000002,"15min":0.46400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":8.6039999999999992,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.76300000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1240000000000001,"5min":1.224,"15min":1.224},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.69699999999999995},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4359999999999999,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.46600000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1479999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73399999999999999,"15min":0.72999999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.597,"5min":1.968,"15min":1.968},"last":0.50800000000000001}]},{"osd":6,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.72699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2430000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.439},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.66600000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.78000000000000003,"15min":0.79500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1910000000000001,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.198,"5min":1.387,"15min":1.387},"last":0.54500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10308,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":9280,"kb_avail":94361532,"statfs":{"total":96636764160,"available":96626208768,"internally_reserved":0,"allocated":1044480,"data_stored":528821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9502720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.38400000000000001,"15min":0.39400000000000002},"min":{"1min":0.24099999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.502,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52300000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.373}]},{"osd":1,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.37,"15min":0.379},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.47799999999999998,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.314},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.43099999999999999,"15min":0.436},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.624,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.32700000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.64700000000000002,"5min":1.3,"15min":1.3},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.441,"15min":0.44900000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66500000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.434}]},{"osd":4,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.44600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90500000000000003,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.497},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.48699999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.628},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0029999999999999,"5min":1.383,"15min":1.383},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95999999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":5.2640000000000002,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":1.587,"15min":1.587},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.69699999999999995,"15min":0.67500000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":5.2510000000000003,"5min":5.2510000000000003,"15min":5.2510000000000003},"last":0.70699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10568,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":9536,"kb_avail":94361272,"statfs":{"total":96636764160,"available":96625942528,"internally_reserved":0,"allocated":1048576,"data_stored":528347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9764864},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.349,"5min":0.67800000000000005,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":14.449999999999999,"5min":14.449999999999999,"15min":14.449999999999999},"last":0.64100000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":0.64700000000000002,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.686,"5min":10.686,"15min":10.686},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.53600000000000003,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":3.9060000000000001,"5min":3.9060000000000001,"15min":3.9060000000000001},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.42499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65800000000000003,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.61799999999999999,"15min":0.58299999999999996},"min":{"1min":0.48199999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":4.6379999999999999,"5min":4.6379999999999999,"15min":4.6379999999999999},"last":0.57099999999999995}]},{"osd":3,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.44800000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.65900000000000003,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.7389999999999999,"5min":6.7389999999999999,"15min":6.7389999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.57599999999999996,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.5910000000000002,"5min":4.5910000000000002,"15min":4.5910000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38600000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.432},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.64900000000000002,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":4.6749999999999998,"5min":4.6749999999999998,"15min":4.6749999999999998},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.66700000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.49299999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10236,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361604,"statfs":{"total":96636764160,"available":96626282496,"internally_reserved":0,"allocated":1036288,"data_stored":527294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.432},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53100000000000003}]},{"osd":1,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.5},{"interface":"front","average":{"1min":0.495,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54300000000000004}]},{"osd":3,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76000000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.78500000000000003,"5min":0.88,"15min":0.88},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67500000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82599999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.72799999999999998,"5min":0.747,"15min":0.747},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.64300000000000002,"15min":0.65100000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.61699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:26:34.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-03-03T06:26:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.267+0000 7f23de609700 1 Processor -- start 2023-03-03T06:26:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.267+0000 7f23de609700 1 -- start start 2023-03-03T06:26:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.268+0000 7f23de609700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23d80b1f80 0x7f23d80cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.268+0000 7f23de609700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d806b590 con 0x7f23d80af450 2023-03-03T06:26:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.268+0000 7f23de609700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d806b870 con 0x7f23d80af080 2023-03-03T06:26:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.268+0000 7f23de609700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d806bb50 con 0x7f23d80b1f80 2023-03-03T06:26:34.271 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.268+0000 7f23dcba6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23d80b1f80 0x7f23d80cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.268+0000 7f23dcba6700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f23d80b1f80 0x7f23d80cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46572/0 (socket says 172.21.15.5:46572) 2023-03-03T06:26:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.268+0000 7f23dcba6700 1 -- 172.21.15.5:0/1795035579 learned_addr learned my addr 172.21.15.5:0/1795035579 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.268+0000 7f23d77fe700 1 --1- 172.21.15.5:0/1795035579 >> v1:172.21.15.5:6789/0 conn(0x7f23d80af450 0x7f23d80cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36412/0 (socket says 172.21.15.5:36412) 2023-03-03T06:26:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.268+0000 7f23dcba6700 1 -- 172.21.15.5:0/1795035579 >> v1:172.21.15.191:6789/0 conn(0x7f23d80af080 legacy=0x7f23d80b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.268+0000 7f23dcba6700 1 -- 172.21.15.5:0/1795035579 >> v1:172.21.15.5:6789/0 conn(0x7f23d80af450 legacy=0x7f23d80cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:34.272 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.269+0000 7f23dcba6700 1 -- 172.21.15.5:0/1795035579 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d806be30 con 0x7f23d80b1f80 2023-03-03T06:26:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.269+0000 7f23d6ffd700 1 -- 172.21.15.5:0/1795035579 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240061528 0 0) 0x7f23d806b590 con 0x7f23d80af450 2023-03-03T06:26:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.269+0000 7f23dcba6700 1 --2- 172.21.15.5:0/1795035579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d80b1f80 0x7f23d80cd350 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009e50 tx=0x7f23d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbd522299c31e48 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.269+0000 7f23d6ffd700 1 -- 172.21.15.5:0/1795035579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d000e070 con 0x7f23d80b1f80 2023-03-03T06:26:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.269+0000 7f23d6ffd700 1 -- 172.21.15.5:0/1795035579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d0003a20 con 0x7f23d80b1f80 2023-03-03T06:26:34.273 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.269+0000 7f23d6ffd700 1 -- 172.21.15.5:0/1795035579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0003dd0 con 0x7f23d80b1f80 2023-03-03T06:26:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.269+0000 7f23de609700 1 -- 172.21.15.5:0/1795035579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d80b1f80 msgr2=0x7f23d80cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.269+0000 7f23de609700 1 --2- 172.21.15.5:0/1795035579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d80b1f80 0x7f23d80cd350 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009e50 tx=0x7f23d000b330 comp rx=0 tx=0).stop 2023-03-03T06:26:34.275 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.269+0000 7f23de609700 1 -- 172.21.15.5:0/1795035579 shutdown_connections 2023-03-03T06:26:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.269+0000 7f23de609700 1 --2- 172.21.15.5:0/1795035579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d80b1f80 0x7f23d80cd350 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.269+0000 7f23de609700 1 -- 172.21.15.5:0/1795035579 >> 172.21.15.5:0/1795035579 conn(0x7f23d806ea70 msgr2=0x7f23d80cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.269+0000 7f23de609700 1 -- 172.21.15.5:0/1795035579 shutdown_connections 2023-03-03T06:26:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.269+0000 7f23de609700 1 -- 172.21.15.5:0/1795035579 wait complete. 2023-03-03T06:26:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.271+0000 7f23de609700 1 Processor -- start 2023-03-03T06:26:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.271+0000 7f23de609700 1 -- start start 2023-03-03T06:26:34.276 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.271+0000 7f23de609700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d80af080 0x7f23d80b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:34.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.271+0000 7f23de609700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23d80af450 0x7f23d814fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:34.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.271+0000 7f23de609700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23d80b1f80 0x7f23d81503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:34.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.271+0000 7f23de609700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d815e140 con 0x7f23d80af080 2023-03-03T06:26:34.277 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.271+0000 7f23de609700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d815e420 con 0x7f23d80af450 2023-03-03T06:26:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.271+0000 7f23de609700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d815e700 con 0x7f23d80b1f80 2023-03-03T06:26:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23d7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d80af080 0x7f23d80b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23d7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d80af080 0x7f23d80b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46574/0 (socket says 172.21.15.5:46574) 2023-03-03T06:26:34.278 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23d7fff700 1 -- 172.21.15.5:0/1476960203 learned_addr learned my addr 172.21.15.5:0/1476960203 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23dcba6700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23d80b1f80 0x7f23d81503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23d77fe700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23d80af450 0x7f23d814fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23d7fff700 1 -- 172.21.15.5:0/1476960203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23d80b1f80 msgr2=0x7f23d81503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23d7fff700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23d80b1f80 0x7f23d81503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23d7fff700 1 -- 172.21.15.5:0/1476960203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23d80af450 msgr2=0x7f23d814fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:34.279 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23d7fff700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23d80af450 0x7f23d814fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23d7fff700 1 -- 172.21.15.5:0/1476960203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d0009b30 con 0x7f23d80af080 2023-03-03T06:26:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23d7fff700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d80af080 0x7f23d80b4cc0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f23c800c4d0 tx=0x7f23c800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23d4ff9700 1 -- 172.21.15.5:0/1476960203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8011790 con 0x7f23d80af080 2023-03-03T06:26:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23d4ff9700 1 -- 172.21.15.5:0/1476960203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c80118f0 con 0x7f23d80af080 2023-03-03T06:26:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23de609700 1 -- 172.21.15.5:0/1476960203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d806d370 con 0x7f23d80af080 2023-03-03T06:26:34.280 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23d4ff9700 1 -- 172.21.15.5:0/1476960203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8011ca0 con 0x7f23d80af080 2023-03-03T06:26:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.272+0000 7f23de609700 1 -- 172.21.15.5:0/1476960203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d806c110 con 0x7f23d80af080 2023-03-03T06:26:34.281 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.273+0000 7f23de609700 1 -- 172.21.15.5:0/1476960203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d806cb70 con 0x7f23d80af080 2023-03-03T06:26:34.282 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.274+0000 7f23d4ff9700 1 -- 172.21.15.5:0/1476960203 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f23c8010050 con 0x7f23d80af080 2023-03-03T06:26:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.274+0000 7f23d4ff9700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f23b80682f0 0x7f23b806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.274+0000 7f23d4ff9700 1 -- 172.21.15.5:0/1476960203 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7445+0+0 (secure 0 0 0) 0x7f23c8085f80 con 0x7f23d80af080 2023-03-03T06:26:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.274+0000 7f23d77fe700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f23b80682f0 0x7f23b806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:34.283 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.275+0000 7f23d77fe700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f23b80682f0 0x7f23b806a7a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f23d8150b30 tx=0x7f23c0007be0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:34.284 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.278+0000 7f23d4ff9700 1 -- 172.21.15.5:0/1476960203 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f23c8052270 con 0x7f23d80af080 2023-03-03T06:26:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.470+0000 7f23de609700 1 -- 172.21.15.5:0/1476960203 --> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23d804e6e0 con 0x7f23b80682f0 2023-03-03T06:26:34.486 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.485+0000 7f23d4ff9700 1 -- 172.21.15.5:0/1476960203 <== mgr.4099 v2:172.21.15.5:6832/96507 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+554166 (secure 0 0 0) 0x7f23d804e6e0 con 0x7f23b80682f0 2023-03-03T06:26:34.492 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.489+0000 7f23de609700 1 -- 172.21.15.5:0/1476960203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f23b80682f0 msgr2=0x7f23b806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.489+0000 7f23de609700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f23b80682f0 0x7f23b806a7a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f23d8150b30 tx=0x7f23c0007be0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.489+0000 7f23de609700 1 -- 172.21.15.5:0/1476960203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d80af080 msgr2=0x7f23d80b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:34.495 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.489+0000 7f23de609700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d80af080 0x7f23d80b4cc0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f23c800c4d0 tx=0x7f23c800c890 comp rx=0 tx=0).stop 2023-03-03T06:26:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.489+0000 7f23de609700 1 -- 172.21.15.5:0/1476960203 shutdown_connections 2023-03-03T06:26:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.489+0000 7f23de609700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f23b80682f0 0x7f23b806a7a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.489+0000 7f23de609700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23d80b1f80 0x7f23d81503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.489+0000 7f23de609700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d80af080 0x7f23d80b4cc0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.489+0000 7f23de609700 1 --2- 172.21.15.5:0/1476960203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23d80af450 0x7f23d814fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.489+0000 7f23de609700 1 -- 172.21.15.5:0/1476960203 >> 172.21.15.5:0/1476960203 conn(0x7f23d806ea70 msgr2=0x7f23d80cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:34.496 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.489+0000 7f23de609700 1 -- 172.21.15.5:0/1476960203 shutdown_connections 2023-03-03T06:26:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.489+0000 7f23de609700 1 -- 172.21.15.5:0/1476960203 wait complete. 2023-03-03T06:26:34.497 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2023-03-03T06:26:34.503 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-03-03T06:26:33.498745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":367,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":84544,"kb_used_data":9344,"kb_used_omap":0,"kb_used_meta":75136,"kb_avail":754890176,"statfs":{"total":773094113280,"available":773007540224,"internally_reserved":0,"allocated":9568256,"data_stored":5409514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":76939264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.956213"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339735+0000","last_change":"2023-03-03T06:26:29.998208+0000","last_active":"2023-03-03T06:26:31.339735+0000","last_peered":"2023-03-03T06:26:31.339735+0000","last_clean":"2023-03-03T06:26:31.339735+0000","last_became_active":"2023-03-03T06:26:29.995154+0000","last_became_peered":"2023-03-03T06:26:29.995154+0000","last_unstale":"2023-03-03T06:26:31.339735+0000","last_undegraded":"2023-03-03T06:26:31.339735+0000","last_fullsized":"2023-03-03T06:26:31.339735+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:18:32.766402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.605196+0000","last_change":"2023-03-03T06:26:29.992031+0000","last_active":"2023-03-03T06:26:31.605196+0000","last_peered":"2023-03-03T06:26:31.605196+0000","last_clean":"2023-03-03T06:26:31.605196+0000","last_became_active":"2023-03-03T06:26:29.991764+0000","last_became_peered":"2023-03-03T06:26:29.991764+0000","last_unstale":"2023-03-03T06:26:31.605196+0000","last_undegraded":"2023-03-03T06:26:31.605196+0000","last_fullsized":"2023-03-03T06:26:31.605196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:11:46.953522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339783+0000","last_change":"2023-03-03T06:26:29.979390+0000","last_active":"2023-03-03T06:26:31.339783+0000","last_peered":"2023-03-03T06:26:31.339783+0000","last_clean":"2023-03-03T06:26:31.339783+0000","last_became_active":"2023-03-03T06:26:29.979179+0000","last_became_peered":"2023-03-03T06:26:29.979179+0000","last_unstale":"2023-03-03T06:26:31.339783+0000","last_undegraded":"2023-03-03T06:26:31.339783+0000","last_fullsized":"2023-03-03T06:26:31.339783+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:00:12.679159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978038+0000","last_change":"2023-03-03T06:26:29.988015+0000","last_active":"2023-03-03T06:26:30.978038+0000","last_peered":"2023-03-03T06:26:30.978038+0000","last_clean":"2023-03-03T06:26:30.978038+0000","last_became_active":"2023-03-03T06:26:29.987779+0000","last_became_peered":"2023-03-03T06:26:29.987779+0000","last_unstale":"2023-03-03T06:26:30.978038+0000","last_undegraded":"2023-03-03T06:26:30.978038+0000","last_fullsized":"2023-03-03T06:26:30.978038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:49:44.054254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601678+0000","last_change":"2023-03-03T06:26:29.995169+0000","last_active":"2023-03-03T06:26:31.601678+0000","last_peered":"2023-03-03T06:26:31.601678+0000","last_clean":"2023-03-03T06:26:31.601678+0000","last_became_active":"2023-03-03T06:26:29.994747+0000","last_became_peered":"2023-03-03T06:26:29.994747+0000","last_unstale":"2023-03-03T06:26:31.601678+0000","last_undegraded":"2023-03-03T06:26:31.601678+0000","last_fullsized":"2023-03-03T06:26:31.601678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:32:23.731039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603748+0000","last_change":"2023-03-03T06:26:29.987258+0000","last_active":"2023-03-03T06:26:31.603748+0000","last_peered":"2023-03-03T06:26:31.603748+0000","last_clean":"2023-03-03T06:26:31.603748+0000","last_became_active":"2023-03-03T06:26:29.986983+0000","last_became_peered":"2023-03-03T06:26:29.986983+0000","last_unstale":"2023-03-03T06:26:31.603748+0000","last_undegraded":"2023-03-03T06:26:31.603748+0000","last_fullsized":"2023-03-03T06:26:31.603748+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:45:01.420152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603329+0000","last_change":"2023-03-03T06:26:29.992348+0000","last_active":"2023-03-03T06:26:31.603329+0000","last_peered":"2023-03-03T06:26:31.603329+0000","last_clean":"2023-03-03T06:26:31.603329+0000","last_became_active":"2023-03-03T06:26:29.991153+0000","last_became_peered":"2023-03-03T06:26:29.991153+0000","last_unstale":"2023-03-03T06:26:31.603329+0000","last_undegraded":"2023-03-03T06:26:31.603329+0000","last_fullsized":"2023-03-03T06:26:31.603329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:59:27.261535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350246+0000","last_change":"2023-03-03T06:26:29.997045+0000","last_active":"2023-03-03T06:26:31.350246+0000","last_peered":"2023-03-03T06:26:31.350246+0000","last_clean":"2023-03-03T06:26:31.350246+0000","last_became_active":"2023-03-03T06:26:29.996741+0000","last_became_peered":"2023-03-03T06:26:29.996741+0000","last_unstale":"2023-03-03T06:26:31.350246+0000","last_undegraded":"2023-03-03T06:26:31.350246+0000","last_fullsized":"2023-03-03T06:26:31.350246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:50:07.531739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604763+0000","last_change":"2023-03-03T06:26:29.997000+0000","last_active":"2023-03-03T06:26:31.604763+0000","last_peered":"2023-03-03T06:26:31.604763+0000","last_clean":"2023-03-03T06:26:31.604763+0000","last_became_active":"2023-03-03T06:26:29.996717+0000","last_became_peered":"2023-03-03T06:26:29.996717+0000","last_unstale":"2023-03-03T06:26:31.604763+0000","last_undegraded":"2023-03-03T06:26:31.604763+0000","last_fullsized":"2023-03-03T06:26:31.604763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:31:53.054160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.602583+0000","last_change":"2023-03-03T06:26:29.993648+0000","last_active":"2023-03-03T06:26:31.602583+0000","last_peered":"2023-03-03T06:26:31.602583+0000","last_clean":"2023-03-03T06:26:31.602583+0000","last_became_active":"2023-03-03T06:26:29.993423+0000","last_became_peered":"2023-03-03T06:26:29.993423+0000","last_unstale":"2023-03-03T06:26:31.602583+0000","last_undegraded":"2023-03-03T06:26:31.602583+0000","last_fullsized":"2023-03-03T06:26:31.602583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:45:01.420152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979505+0000","last_change":"2023-03-03T06:26:29.994909+0000","last_active":"2023-03-03T06:26:30.979505+0000","last_peered":"2023-03-03T06:26:30.979505+0000","last_clean":"2023-03-03T06:26:30.979505+0000","last_became_active":"2023-03-03T06:26:29.994464+0000","last_became_peered":"2023-03-03T06:26:29.994464+0000","last_unstale":"2023-03-03T06:26:30.979505+0000","last_undegraded":"2023-03-03T06:26:30.979505+0000","last_fullsized":"2023-03-03T06:26:30.979505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:08.814698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979984+0000","last_change":"2023-03-03T06:26:29.990358+0000","last_active":"2023-03-03T06:26:30.979984+0000","last_peered":"2023-03-03T06:26:30.979984+0000","last_clean":"2023-03-03T06:26:30.979984+0000","last_became_active":"2023-03-03T06:26:29.989968+0000","last_became_peered":"2023-03-03T06:26:29.989968+0000","last_unstale":"2023-03-03T06:26:30.979984+0000","last_undegraded":"2023-03-03T06:26:30.979984+0000","last_fullsized":"2023-03-03T06:26:30.979984+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:18:29.943962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978159+0000","last_change":"2023-03-03T06:26:29.998532+0000","last_active":"2023-03-03T06:26:30.978159+0000","last_peered":"2023-03-03T06:26:30.978159+0000","last_clean":"2023-03-03T06:26:30.978159+0000","last_became_active":"2023-03-03T06:26:29.998267+0000","last_became_peered":"2023-03-03T06:26:29.998267+0000","last_unstale":"2023-03-03T06:26:30.978159+0000","last_undegraded":"2023-03-03T06:26:30.978159+0000","last_fullsized":"2023-03-03T06:26:30.978159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:57:32.411291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603479+0000","last_change":"2023-03-03T06:26:29.988538+0000","last_active":"2023-03-03T06:26:31.603479+0000","last_peered":"2023-03-03T06:26:31.603479+0000","last_clean":"2023-03-03T06:26:31.603479+0000","last_became_active":"2023-03-03T06:26:29.988275+0000","last_became_peered":"2023-03-03T06:26:29.988275+0000","last_unstale":"2023-03-03T06:26:31.603479+0000","last_undegraded":"2023-03-03T06:26:31.603479+0000","last_fullsized":"2023-03-03T06:26:31.603479+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:59:27.261535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604576+0000","last_change":"2023-03-03T06:26:29.996958+0000","last_active":"2023-03-03T06:26:31.604576+0000","last_peered":"2023-03-03T06:26:31.604576+0000","last_clean":"2023-03-03T06:26:31.604576+0000","last_became_active":"2023-03-03T06:26:29.996674+0000","last_became_peered":"2023-03-03T06:26:29.996674+0000","last_unstale":"2023-03-03T06:26:31.604576+0000","last_undegraded":"2023-03-03T06:26:31.604576+0000","last_fullsized":"2023-03-03T06:26:31.604576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:59.942632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603317+0000","last_change":"2023-03-03T06:26:29.991061+0000","last_active":"2023-03-03T06:26:31.603317+0000","last_peered":"2023-03-03T06:26:31.603317+0000","last_clean":"2023-03-03T06:26:31.603317+0000","last_became_active":"2023-03-03T06:26:29.990798+0000","last_became_peered":"2023-03-03T06:26:29.990798+0000","last_unstale":"2023-03-03T06:26:31.603317+0000","last_undegraded":"2023-03-03T06:26:31.603317+0000","last_fullsized":"2023-03-03T06:26:31.603317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:16:59.983104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.340133+0000","last_change":"2023-03-03T06:26:29.999930+0000","last_active":"2023-03-03T06:26:31.340133+0000","last_peered":"2023-03-03T06:26:31.340133+0000","last_clean":"2023-03-03T06:26:31.340133+0000","last_became_active":"2023-03-03T06:26:29.999600+0000","last_became_peered":"2023-03-03T06:26:29.999600+0000","last_unstale":"2023-03-03T06:26:31.340133+0000","last_undegraded":"2023-03-03T06:26:31.340133+0000","last_fullsized":"2023-03-03T06:26:31.340133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:33:04.879138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.605098+0000","last_change":"2023-03-03T06:26:29.994374+0000","last_active":"2023-03-03T06:26:31.605098+0000","last_peered":"2023-03-03T06:26:31.605098+0000","last_clean":"2023-03-03T06:26:31.605098+0000","last_became_active":"2023-03-03T06:26:29.994156+0000","last_became_peered":"2023-03-03T06:26:29.994156+0000","last_unstale":"2023-03-03T06:26:31.605098+0000","last_undegraded":"2023-03-03T06:26:31.605098+0000","last_fullsized":"2023-03-03T06:26:31.605098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:16:59.983104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339494+0000","last_change":"2023-03-03T06:26:29.999568+0000","last_active":"2023-03-03T06:26:31.339494+0000","last_peered":"2023-03-03T06:26:31.339494+0000","last_clean":"2023-03-03T06:26:31.339494+0000","last_became_active":"2023-03-03T06:26:29.999079+0000","last_became_peered":"2023-03-03T06:26:29.999079+0000","last_unstale":"2023-03-03T06:26:31.339494+0000","last_undegraded":"2023-03-03T06:26:31.339494+0000","last_fullsized":"2023-03-03T06:26:31.339494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:05:09.656203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979971+0000","last_change":"2023-03-03T06:26:29.985844+0000","last_active":"2023-03-03T06:26:30.979971+0000","last_peered":"2023-03-03T06:26:30.979971+0000","last_clean":"2023-03-03T06:26:30.979971+0000","last_became_active":"2023-03-03T06:26:29.985472+0000","last_became_peered":"2023-03-03T06:26:29.985472+0000","last_unstale":"2023-03-03T06:26:30.979971+0000","last_undegraded":"2023-03-03T06:26:30.979971+0000","last_fullsized":"2023-03-03T06:26:30.979971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:23:03.697201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350578+0000","last_change":"2023-03-03T06:26:29.998176+0000","last_active":"2023-03-03T06:26:31.350578+0000","last_peered":"2023-03-03T06:26:31.350578+0000","last_clean":"2023-03-03T06:26:31.350578+0000","last_became_active":"2023-03-03T06:26:29.997903+0000","last_became_peered":"2023-03-03T06:26:29.997903+0000","last_unstale":"2023-03-03T06:26:31.350578+0000","last_undegraded":"2023-03-03T06:26:31.350578+0000","last_fullsized":"2023-03-03T06:26:31.350578+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:56:43.325864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601865+0000","last_change":"2023-03-03T06:26:29.988236+0000","last_active":"2023-03-03T06:26:31.601865+0000","last_peered":"2023-03-03T06:26:31.601865+0000","last_clean":"2023-03-03T06:26:31.601865+0000","last_became_active":"2023-03-03T06:26:29.987956+0000","last_became_peered":"2023-03-03T06:26:29.987956+0000","last_unstale":"2023-03-03T06:26:31.601865+0000","last_undegraded":"2023-03-03T06:26:31.601865+0000","last_fullsized":"2023-03-03T06:26:31.601865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:15:41.761505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339239+0000","last_change":"2023-03-03T06:26:29.986847+0000","last_active":"2023-03-03T06:26:31.339239+0000","last_peered":"2023-03-03T06:26:31.339239+0000","last_clean":"2023-03-03T06:26:31.339239+0000","last_became_active":"2023-03-03T06:26:29.986600+0000","last_became_peered":"2023-03-03T06:26:29.986600+0000","last_unstale":"2023-03-03T06:26:31.339239+0000","last_undegraded":"2023-03-03T06:26:31.339239+0000","last_fullsized":"2023-03-03T06:26:31.339239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:04:07.748246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601342+0000","last_change":"2023-03-03T06:26:30.001261+0000","last_active":"2023-03-03T06:26:31.601342+0000","last_peered":"2023-03-03T06:26:31.601342+0000","last_clean":"2023-03-03T06:26:31.601342+0000","last_became_active":"2023-03-03T06:26:30.000954+0000","last_became_peered":"2023-03-03T06:26:30.000954+0000","last_unstale":"2023-03-03T06:26:31.601342+0000","last_undegraded":"2023-03-03T06:26:31.601342+0000","last_fullsized":"2023-03-03T06:26:31.601342+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:02:13.806900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979662+0000","last_change":"2023-03-03T06:26:29.978874+0000","last_active":"2023-03-03T06:26:30.979662+0000","last_peered":"2023-03-03T06:26:30.979662+0000","last_clean":"2023-03-03T06:26:30.979662+0000","last_became_active":"2023-03-03T06:26:29.978584+0000","last_became_peered":"2023-03-03T06:26:29.978584+0000","last_unstale":"2023-03-03T06:26:30.979662+0000","last_undegraded":"2023-03-03T06:26:30.979662+0000","last_fullsized":"2023-03-03T06:26:30.979662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:21:37.963069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979703+0000","last_change":"2023-03-03T06:26:29.988769+0000","last_active":"2023-03-03T06:26:30.979703+0000","last_peered":"2023-03-03T06:26:30.979703+0000","last_clean":"2023-03-03T06:26:30.979703+0000","last_became_active":"2023-03-03T06:26:29.987811+0000","last_became_peered":"2023-03-03T06:26:29.987811+0000","last_unstale":"2023-03-03T06:26:30.979703+0000","last_undegraded":"2023-03-03T06:26:30.979703+0000","last_fullsized":"2023-03-03T06:26:30.979703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:21:33.192200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978069+0000","last_change":"2023-03-03T06:26:29.994714+0000","last_active":"2023-03-03T06:26:30.978069+0000","last_peered":"2023-03-03T06:26:30.978069+0000","last_clean":"2023-03-03T06:26:30.978069+0000","last_became_active":"2023-03-03T06:26:29.994112+0000","last_became_peered":"2023-03-03T06:26:29.994112+0000","last_unstale":"2023-03-03T06:26:30.978069+0000","last_undegraded":"2023-03-03T06:26:30.978069+0000","last_fullsized":"2023-03-03T06:26:30.978069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:52:11.032392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604443+0000","last_change":"2023-03-03T06:26:29.998500+0000","last_active":"2023-03-03T06:26:31.604443+0000","last_peered":"2023-03-03T06:26:31.604443+0000","last_clean":"2023-03-03T06:26:31.604443+0000","last_became_active":"2023-03-03T06:26:29.997941+0000","last_became_peered":"2023-03-03T06:26:29.997941+0000","last_unstale":"2023-03-03T06:26:31.604443+0000","last_undegraded":"2023-03-03T06:26:31.604443+0000","last_fullsized":"2023-03-03T06:26:31.604443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:58.611186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350701+0000","last_change":"2023-03-03T06:26:29.990605+0000","last_active":"2023-03-03T06:26:31.350701+0000","last_peered":"2023-03-03T06:26:31.350701+0000","last_clean":"2023-03-03T06:26:31.350701+0000","last_became_active":"2023-03-03T06:26:29.990373+0000","last_became_peered":"2023-03-03T06:26:29.990373+0000","last_unstale":"2023-03-03T06:26:31.350701+0000","last_undegraded":"2023-03-03T06:26:31.350701+0000","last_fullsized":"2023-03-03T06:26:31.350701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:11:04.865446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979175+0000","last_change":"2023-03-03T06:26:29.990564+0000","last_active":"2023-03-03T06:26:30.979175+0000","last_peered":"2023-03-03T06:26:30.979175+0000","last_clean":"2023-03-03T06:26:30.979175+0000","last_became_active":"2023-03-03T06:26:29.990307+0000","last_became_peered":"2023-03-03T06:26:29.990307+0000","last_unstale":"2023-03-03T06:26:30.979175+0000","last_undegraded":"2023-03-03T06:26:30.979175+0000","last_fullsized":"2023-03-03T06:26:30.979175+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:13:06.431985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603339+0000","last_change":"2023-03-03T06:26:29.981830+0000","last_active":"2023-03-03T06:26:31.603339+0000","last_peered":"2023-03-03T06:26:31.603339+0000","last_clean":"2023-03-03T06:26:31.603339+0000","last_became_active":"2023-03-03T06:26:29.981546+0000","last_became_peered":"2023-03-03T06:26:29.981546+0000","last_unstale":"2023-03-03T06:26:31.603339+0000","last_undegraded":"2023-03-03T06:26:31.603339+0000","last_fullsized":"2023-03-03T06:26:31.603339+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:59.942632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350346+0000","last_change":"2023-03-03T06:26:29.993027+0000","last_active":"2023-03-03T06:26:31.350346+0000","last_peered":"2023-03-03T06:26:31.350346+0000","last_clean":"2023-03-03T06:26:31.350346+0000","last_became_active":"2023-03-03T06:26:29.992744+0000","last_became_peered":"2023-03-03T06:26:29.992744+0000","last_unstale":"2023-03-03T06:26:31.350346+0000","last_undegraded":"2023-03-03T06:26:31.350346+0000","last_fullsized":"2023-03-03T06:26:31.350346+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:18:22.675879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978210+0000","last_change":"2023-03-03T06:26:29.992888+0000","last_active":"2023-03-03T06:26:30.978210+0000","last_peered":"2023-03-03T06:26:30.978210+0000","last_clean":"2023-03-03T06:26:30.978210+0000","last_became_active":"2023-03-03T06:26:29.992652+0000","last_became_peered":"2023-03-03T06:26:29.992652+0000","last_unstale":"2023-03-03T06:26:30.978210+0000","last_undegraded":"2023-03-03T06:26:30.978210+0000","last_fullsized":"2023-03-03T06:26:30.978210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:49:57.004597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603915+0000","last_change":"2023-03-03T06:26:29.571025+0000","last_active":"2023-03-03T06:26:31.603915+0000","last_peered":"2023-03-03T06:26:31.603915+0000","last_clean":"2023-03-03T06:26:31.603915+0000","last_became_active":"2023-03-03T06:26:29.570424+0000","last_became_peered":"2023-03-03T06:26:29.570424+0000","last_unstale":"2023-03-03T06:26:31.603915+0000","last_undegraded":"2023-03-03T06:26:31.603915+0000","last_fullsized":"2023-03-03T06:26:31.603915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:38:28.612334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.972571+0000","last_change":"2023-03-03T06:26:06.451129+0000","last_active":"2023-03-03T06:26:29.972571+0000","last_peered":"2023-03-03T06:26:29.972571+0000","last_clean":"2023-03-03T06:26:29.972571+0000","last_became_active":"2023-03-03T06:26:06.450789+0000","last_became_peered":"2023-03-03T06:26:06.450789+0000","last_unstale":"2023-03-03T06:26:29.972571+0000","last_undegraded":"2023-03-03T06:26:29.972571+0000","last_fullsized":"2023-03-03T06:26:29.972571+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:52:27.201396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.987573+0000","last_change":"2023-03-03T06:23:34.884171+0000","last_active":"2023-03-03T06:26:29.987573+0000","last_peered":"2023-03-03T06:26:29.987573+0000","last_clean":"2023-03-03T06:26:29.987573+0000","last_became_active":"2023-03-03T06:23:34.883852+0000","last_became_peered":"2023-03-03T06:23:34.883852+0000","last_unstale":"2023-03-03T06:26:29.987573+0000","last_undegraded":"2023-03-03T06:26:29.987573+0000","last_fullsized":"2023-03-03T06:26:29.987573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973480+0000","last_change":"2023-03-03T06:25:05.431790+0000","last_active":"2023-03-03T06:26:29.973480+0000","last_peered":"2023-03-03T06:26:29.973480+0000","last_clean":"2023-03-03T06:26:29.973480+0000","last_became_active":"2023-03-03T06:25:04.595837+0000","last_became_peered":"2023-03-03T06:25:04.595837+0000","last_unstale":"2023-03-03T06:26:29.973480+0000","last_undegraded":"2023-03-03T06:26:29.973480+0000","last_fullsized":"2023-03-03T06:26:29.973480+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:08:49.614056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019659870000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976890+0000","last_change":"2023-03-03T06:26:07.437458+0000","last_active":"2023-03-03T06:26:29.976890+0000","last_peered":"2023-03-03T06:26:29.976890+0000","last_clean":"2023-03-03T06:26:29.976890+0000","last_became_active":"2023-03-03T06:26:05.455059+0000","last_became_peered":"2023-03-03T06:26:05.455059+0000","last_unstale":"2023-03-03T06:26:29.976890+0000","last_undegraded":"2023-03-03T06:26:29.976890+0000","last_fullsized":"2023-03-03T06:26:29.976890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:39:32.379296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076999999999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.351001+0000","last_change":"2023-03-03T06:26:29.996341+0000","last_active":"2023-03-03T06:26:31.351001+0000","last_peered":"2023-03-03T06:26:31.351001+0000","last_clean":"2023-03-03T06:26:31.351001+0000","last_became_active":"2023-03-03T06:26:29.995625+0000","last_became_peered":"2023-03-03T06:26:29.995625+0000","last_unstale":"2023-03-03T06:26:31.351001+0000","last_undegraded":"2023-03-03T06:26:31.351001+0000","last_fullsized":"2023-03-03T06:26:31.351001+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:20:21.223307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350450+0000","last_change":"2023-03-03T06:26:29.573062+0000","last_active":"2023-03-03T06:26:31.350450+0000","last_peered":"2023-03-03T06:26:31.350450+0000","last_clean":"2023-03-03T06:26:31.350450+0000","last_became_active":"2023-03-03T06:26:29.572784+0000","last_became_peered":"2023-03-03T06:26:29.572784+0000","last_unstale":"2023-03-03T06:26:31.350450+0000","last_undegraded":"2023-03-03T06:26:31.350450+0000","last_fullsized":"2023-03-03T06:26:31.350450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:20:22.657411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976638+0000","last_change":"2023-03-03T06:26:06.449467+0000","last_active":"2023-03-03T06:26:29.976638+0000","last_peered":"2023-03-03T06:26:29.976638+0000","last_clean":"2023-03-03T06:26:29.976638+0000","last_became_active":"2023-03-03T06:26:06.449164+0000","last_became_peered":"2023-03-03T06:26:06.449164+0000","last_unstale":"2023-03-03T06:26:29.976638+0000","last_undegraded":"2023-03-03T06:26:29.976638+0000","last_fullsized":"2023-03-03T06:26:29.976638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:24:59.293612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.987486+0000","last_change":"2023-03-03T06:23:34.884977+0000","last_active":"2023-03-03T06:26:29.987486+0000","last_peered":"2023-03-03T06:26:29.987486+0000","last_clean":"2023-03-03T06:26:29.987486+0000","last_became_active":"2023-03-03T06:23:34.884695+0000","last_became_peered":"2023-03-03T06:23:34.884695+0000","last_unstale":"2023-03-03T06:26:29.987486+0000","last_undegraded":"2023-03-03T06:26:29.987486+0000","last_fullsized":"2023-03-03T06:26:29.987486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:24:46.383859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.986204+0000","last_change":"2023-03-03T06:25:05.432050+0000","last_active":"2023-03-03T06:26:29.986204+0000","last_peered":"2023-03-03T06:26:29.986204+0000","last_clean":"2023-03-03T06:26:29.986204+0000","last_became_active":"2023-03-03T06:25:04.595433+0000","last_became_peered":"2023-03-03T06:25:04.595433+0000","last_unstale":"2023-03-03T06:26:29.986204+0000","last_undegraded":"2023-03-03T06:26:29.986204+0000","last_fullsized":"2023-03-03T06:26:29.986204+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016573409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977749+0000","last_change":"2023-03-03T06:26:08.372799+0000","last_active":"2023-03-03T06:26:29.977749+0000","last_peered":"2023-03-03T06:26:29.977749+0000","last_clean":"2023-03-03T06:26:29.977749+0000","last_became_active":"2023-03-03T06:26:05.456439+0000","last_became_peered":"2023-03-03T06:26:05.456439+0000","last_unstale":"2023-03-03T06:26:29.977749+0000","last_undegraded":"2023-03-03T06:26:29.977749+0000","last_fullsized":"2023-03-03T06:26:29.977749+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:53:21.026591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029954599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350492+0000","last_change":"2023-03-03T06:26:29.992008+0000","last_active":"2023-03-03T06:26:31.350492+0000","last_peered":"2023-03-03T06:26:31.350492+0000","last_clean":"2023-03-03T06:26:31.350492+0000","last_became_active":"2023-03-03T06:26:29.991746+0000","last_became_peered":"2023-03-03T06:26:29.991746+0000","last_unstale":"2023-03-03T06:26:31.350492+0000","last_undegraded":"2023-03-03T06:26:31.350492+0000","last_fullsized":"2023-03-03T06:26:31.350492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:23:10.925900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"84'1","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604529+0000","last_change":"2023-03-03T06:26:29.568180+0000","last_active":"2023-03-03T06:26:31.604529+0000","last_peered":"2023-03-03T06:26:31.604529+0000","last_clean":"2023-03-03T06:26:31.604529+0000","last_became_active":"2023-03-03T06:26:29.567868+0000","last_became_peered":"2023-03-03T06:26:29.567868+0000","last_unstale":"2023-03-03T06:26:31.604529+0000","last_undegraded":"2023-03-03T06:26:31.604529+0000","last_fullsized":"2023-03-03T06:26:31.604529+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:10:58.998423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977339+0000","last_change":"2023-03-03T06:26:06.450751+0000","last_active":"2023-03-03T06:26:29.977339+0000","last_peered":"2023-03-03T06:26:29.977339+0000","last_clean":"2023-03-03T06:26:29.977339+0000","last_became_active":"2023-03-03T06:26:06.450457+0000","last_became_peered":"2023-03-03T06:26:06.450457+0000","last_unstale":"2023-03-03T06:26:29.977339+0000","last_undegraded":"2023-03-03T06:26:29.977339+0000","last_fullsized":"2023-03-03T06:26:29.977339+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:10:40.752610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":74,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976770+0000","last_change":"2023-03-03T06:23:34.884492+0000","last_active":"2023-03-03T06:26:29.976770+0000","last_peered":"2023-03-03T06:26:29.976770+0000","last_clean":"2023-03-03T06:26:29.976770+0000","last_became_active":"2023-03-03T06:23:34.884189+0000","last_became_peered":"2023-03-03T06:23:34.884189+0000","last_unstale":"2023-03-03T06:26:29.976770+0000","last_undegraded":"2023-03-03T06:26:29.976770+0000","last_fullsized":"2023-03-03T06:26:29.976770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:35:03.616256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976656+0000","last_change":"2023-03-03T06:25:05.636259+0000","last_active":"2023-03-03T06:26:29.976656+0000","last_peered":"2023-03-03T06:26:29.976656+0000","last_clean":"2023-03-03T06:26:29.976656+0000","last_became_active":"2023-03-03T06:25:04.438244+0000","last_became_peered":"2023-03-03T06:25:04.438244+0000","last_unstale":"2023-03-03T06:26:29.976656+0000","last_undegraded":"2023-03-03T06:26:29.976656+0000","last_fullsized":"2023-03-03T06:26:29.976656+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:36.640289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001044636,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975527+0000","last_change":"2023-03-03T06:26:07.442491+0000","last_active":"2023-03-03T06:26:29.975527+0000","last_peered":"2023-03-03T06:26:29.975527+0000","last_clean":"2023-03-03T06:26:29.975527+0000","last_became_active":"2023-03-03T06:26:05.446612+0000","last_became_peered":"2023-03-03T06:26:05.446612+0000","last_unstale":"2023-03-03T06:26:29.975527+0000","last_undegraded":"2023-03-03T06:26:29.975527+0000","last_fullsized":"2023-03-03T06:26:29.975527+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:27.368396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086796499999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978046+0000","last_change":"2023-03-03T06:26:29.987122+0000","last_active":"2023-03-03T06:26:30.978046+0000","last_peered":"2023-03-03T06:26:30.978046+0000","last_clean":"2023-03-03T06:26:30.978046+0000","last_became_active":"2023-03-03T06:26:29.986833+0000","last_became_peered":"2023-03-03T06:26:29.986833+0000","last_unstale":"2023-03-03T06:26:30.978046+0000","last_undegraded":"2023-03-03T06:26:30.978046+0000","last_fullsized":"2023-03-03T06:26:30.978046+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:35:05.098809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"84'2","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350992+0000","last_change":"2023-03-03T06:26:29.573754+0000","last_active":"2023-03-03T06:26:31.350992+0000","last_peered":"2023-03-03T06:26:31.350992+0000","last_clean":"2023-03-03T06:26:31.350992+0000","last_became_active":"2023-03-03T06:26:29.572322+0000","last_became_peered":"2023-03-03T06:26:29.572322+0000","last_unstale":"2023-03-03T06:26:31.350992+0000","last_undegraded":"2023-03-03T06:26:31.350992+0000","last_fullsized":"2023-03-03T06:26:31.350992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:17:42.347142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988574+0000","last_change":"2023-03-03T06:26:06.452897+0000","last_active":"2023-03-03T06:26:29.988574+0000","last_peered":"2023-03-03T06:26:29.988574+0000","last_clean":"2023-03-03T06:26:29.988574+0000","last_became_active":"2023-03-03T06:26:06.452623+0000","last_became_peered":"2023-03-03T06:26:06.452623+0000","last_unstale":"2023-03-03T06:26:29.988574+0000","last_undegraded":"2023-03-03T06:26:29.988574+0000","last_fullsized":"2023-03-03T06:26:29.988574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:01:06.426059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":66,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.982172+0000","last_change":"2023-03-03T06:23:34.884549+0000","last_active":"2023-03-03T06:26:29.982172+0000","last_peered":"2023-03-03T06:26:29.982172+0000","last_clean":"2023-03-03T06:26:29.982172+0000","last_became_active":"2023-03-03T06:23:34.884238+0000","last_became_peered":"2023-03-03T06:23:34.884238+0000","last_unstale":"2023-03-03T06:26:29.982172+0000","last_undegraded":"2023-03-03T06:26:29.982172+0000","last_fullsized":"2023-03-03T06:26:29.982172+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:00:44.653636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980141+0000","last_change":"2023-03-03T06:25:05.796597+0000","last_active":"2023-03-03T06:26:29.980141+0000","last_peered":"2023-03-03T06:26:29.980141+0000","last_clean":"2023-03-03T06:26:29.980141+0000","last_became_active":"2023-03-03T06:25:04.442672+0000","last_became_peered":"2023-03-03T06:25:04.442672+0000","last_unstale":"2023-03-03T06:26:29.980141+0000","last_undegraded":"2023-03-03T06:26:29.980141+0000","last_fullsized":"2023-03-03T06:26:29.980141+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:38:04.033310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000479903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.991024+0000","last_change":"2023-03-03T06:26:08.328330+0000","last_active":"2023-03-03T06:26:29.991024+0000","last_peered":"2023-03-03T06:26:29.991024+0000","last_clean":"2023-03-03T06:26:29.991024+0000","last_became_active":"2023-03-03T06:26:05.446246+0000","last_became_peered":"2023-03-03T06:26:05.446246+0000","last_unstale":"2023-03-03T06:26:29.991024+0000","last_undegraded":"2023-03-03T06:26:29.991024+0000","last_fullsized":"2023-03-03T06:26:29.991024+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:39.715402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041737700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601678+0000","last_change":"2023-03-03T06:26:29.997711+0000","last_active":"2023-03-03T06:26:31.601678+0000","last_peered":"2023-03-03T06:26:31.601678+0000","last_clean":"2023-03-03T06:26:31.601678+0000","last_became_active":"2023-03-03T06:26:29.997442+0000","last_became_peered":"2023-03-03T06:26:29.997442+0000","last_unstale":"2023-03-03T06:26:31.601678+0000","last_undegraded":"2023-03-03T06:26:31.601678+0000","last_fullsized":"2023-03-03T06:26:31.601678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:14:46.725540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978080+0000","last_change":"2023-03-03T06:26:29.573426+0000","last_active":"2023-03-03T06:26:30.978080+0000","last_peered":"2023-03-03T06:26:30.978080+0000","last_clean":"2023-03-03T06:26:30.978080+0000","last_became_active":"2023-03-03T06:26:29.573136+0000","last_became_peered":"2023-03-03T06:26:29.573136+0000","last_unstale":"2023-03-03T06:26:30.978080+0000","last_undegraded":"2023-03-03T06:26:30.978080+0000","last_fullsized":"2023-03-03T06:26:30.978080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:57.609446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.987488+0000","last_change":"2023-03-03T06:26:06.450956+0000","last_active":"2023-03-03T06:26:29.987488+0000","last_peered":"2023-03-03T06:26:29.987488+0000","last_clean":"2023-03-03T06:26:29.987488+0000","last_became_active":"2023-03-03T06:26:06.450642+0000","last_became_peered":"2023-03-03T06:26:06.450642+0000","last_unstale":"2023-03-03T06:26:29.987488+0000","last_undegraded":"2023-03-03T06:26:29.987488+0000","last_fullsized":"2023-03-03T06:26:29.987488+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:26:08.483621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":66,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980658+0000","last_change":"2023-03-03T06:23:34.888151+0000","last_active":"2023-03-03T06:26:29.980658+0000","last_peered":"2023-03-03T06:26:29.980658+0000","last_clean":"2023-03-03T06:26:29.980658+0000","last_became_active":"2023-03-03T06:23:34.887909+0000","last_became_peered":"2023-03-03T06:23:34.887909+0000","last_unstale":"2023-03-03T06:26:29.980658+0000","last_undegraded":"2023-03-03T06:26:29.980658+0000","last_fullsized":"2023-03-03T06:26:29.980658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:06:36.916808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.983923+0000","last_change":"2023-03-03T06:25:05.431373+0000","last_active":"2023-03-03T06:26:29.983923+0000","last_peered":"2023-03-03T06:26:29.983923+0000","last_clean":"2023-03-03T06:26:29.983923+0000","last_became_active":"2023-03-03T06:25:04.445948+0000","last_became_peered":"2023-03-03T06:25:04.445948+0000","last_unstale":"2023-03-03T06:26:29.983923+0000","last_undegraded":"2023-03-03T06:26:29.983923+0000","last_fullsized":"2023-03-03T06:26:29.983923+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001717028,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988952+0000","last_change":"2023-03-03T06:26:07.980649+0000","last_active":"2023-03-03T06:26:29.988952+0000","last_peered":"2023-03-03T06:26:29.988952+0000","last_clean":"2023-03-03T06:26:29.988952+0000","last_became_active":"2023-03-03T06:26:05.454516+0000","last_became_peered":"2023-03-03T06:26:05.454516+0000","last_unstale":"2023-03-03T06:26:29.988952+0000","last_undegraded":"2023-03-03T06:26:29.988952+0000","last_fullsized":"2023-03-03T06:26:29.988952+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:03:31.759096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051015700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603866+0000","last_change":"2023-03-03T06:26:29.994008+0000","last_active":"2023-03-03T06:26:31.603866+0000","last_peered":"2023-03-03T06:26:31.603866+0000","last_clean":"2023-03-03T06:26:31.603866+0000","last_became_active":"2023-03-03T06:26:29.993751+0000","last_became_peered":"2023-03-03T06:26:29.993751+0000","last_unstale":"2023-03-03T06:26:31.603866+0000","last_undegraded":"2023-03-03T06:26:31.603866+0000","last_fullsized":"2023-03-03T06:26:31.603866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:18:54.135489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"84'1","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604038+0000","last_change":"2023-03-03T06:26:29.560005+0000","last_active":"2023-03-03T06:26:31.604038+0000","last_peered":"2023-03-03T06:26:31.604038+0000","last_clean":"2023-03-03T06:26:31.604038+0000","last_became_active":"2023-03-03T06:26:29.559731+0000","last_became_peered":"2023-03-03T06:26:29.559731+0000","last_unstale":"2023-03-03T06:26:31.604038+0000","last_undegraded":"2023-03-03T06:26:31.604038+0000","last_fullsized":"2023-03-03T06:26:31.604038+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:12:52.087518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973922+0000","last_change":"2023-03-03T06:26:06.451372+0000","last_active":"2023-03-03T06:26:29.973922+0000","last_peered":"2023-03-03T06:26:29.973922+0000","last_clean":"2023-03-03T06:26:29.973922+0000","last_became_active":"2023-03-03T06:26:06.450997+0000","last_became_peered":"2023-03-03T06:26:06.450997+0000","last_unstale":"2023-03-03T06:26:29.973922+0000","last_undegraded":"2023-03-03T06:26:29.973922+0000","last_fullsized":"2023-03-03T06:26:29.973922+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:01:49.694064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":216,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.982091+0000","last_change":"2023-03-03T06:23:34.888876+0000","last_active":"2023-03-03T06:26:29.982091+0000","last_peered":"2023-03-03T06:26:29.982091+0000","last_clean":"2023-03-03T06:26:29.982091+0000","last_became_active":"2023-03-03T06:23:34.887913+0000","last_became_peered":"2023-03-03T06:23:34.887913+0000","last_unstale":"2023-03-03T06:26:29.982091+0000","last_undegraded":"2023-03-03T06:26:29.982091+0000","last_fullsized":"2023-03-03T06:26:29.982091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:09:17.459700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988696+0000","last_change":"2023-03-03T06:23:34.884737+0000","last_active":"2023-03-03T06:26:29.988696+0000","last_peered":"2023-03-03T06:26:29.988696+0000","last_clean":"2023-03-03T06:26:29.988696+0000","last_became_active":"2023-03-03T06:23:34.884437+0000","last_became_peered":"2023-03-03T06:23:34.884437+0000","last_unstale":"2023-03-03T06:26:29.988696+0000","last_undegraded":"2023-03-03T06:26:29.988696+0000","last_fullsized":"2023-03-03T06:26:29.988696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.989232+0000","last_change":"2023-03-03T06:25:05.796271+0000","last_active":"2023-03-03T06:26:29.989232+0000","last_peered":"2023-03-03T06:26:29.989232+0000","last_clean":"2023-03-03T06:26:29.989232+0000","last_became_active":"2023-03-03T06:25:04.595414+0000","last_became_peered":"2023-03-03T06:25:04.595414+0000","last_unstale":"2023-03-03T06:26:29.989232+0000","last_undegraded":"2023-03-03T06:26:29.989232+0000","last_fullsized":"2023-03-03T06:26:29.989232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:07:03.140630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027036600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.987722+0000","last_change":"2023-03-03T06:26:07.743464+0000","last_active":"2023-03-03T06:26:29.987722+0000","last_peered":"2023-03-03T06:26:29.987722+0000","last_clean":"2023-03-03T06:26:29.987722+0000","last_became_active":"2023-03-03T06:26:05.446609+0000","last_became_peered":"2023-03-03T06:26:05.446609+0000","last_unstale":"2023-03-03T06:26:29.987722+0000","last_undegraded":"2023-03-03T06:26:29.987722+0000","last_fullsized":"2023-03-03T06:26:29.987722+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:57.199464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000302202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339661+0000","last_change":"2023-03-03T06:26:29.993832+0000","last_active":"2023-03-03T06:26:31.339661+0000","last_peered":"2023-03-03T06:26:31.339661+0000","last_clean":"2023-03-03T06:26:31.339661+0000","last_became_active":"2023-03-03T06:26:29.987404+0000","last_became_peered":"2023-03-03T06:26:29.987404+0000","last_unstale":"2023-03-03T06:26:31.339661+0000","last_undegraded":"2023-03-03T06:26:31.339661+0000","last_fullsized":"2023-03-03T06:26:31.339661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:50:11.014971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350443+0000","last_change":"2023-03-03T06:26:29.574893+0000","last_active":"2023-03-03T06:26:31.350443+0000","last_peered":"2023-03-03T06:26:31.350443+0000","last_clean":"2023-03-03T06:26:31.350443+0000","last_became_active":"2023-03-03T06:26:29.574626+0000","last_became_peered":"2023-03-03T06:26:29.574626+0000","last_unstale":"2023-03-03T06:26:31.350443+0000","last_undegraded":"2023-03-03T06:26:31.350443+0000","last_fullsized":"2023-03-03T06:26:31.350443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:16:44.453163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.972925+0000","last_change":"2023-03-03T06:26:06.452197+0000","last_active":"2023-03-03T06:26:29.972925+0000","last_peered":"2023-03-03T06:26:29.972925+0000","last_clean":"2023-03-03T06:26:29.972925+0000","last_became_active":"2023-03-03T06:26:06.451673+0000","last_became_peered":"2023-03-03T06:26:06.451673+0000","last_unstale":"2023-03-03T06:26:29.972925+0000","last_undegraded":"2023-03-03T06:26:29.972925+0000","last_fullsized":"2023-03-03T06:26:29.972925+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:20:18.222822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":75,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.985963+0000","last_change":"2023-03-03T06:23:34.881594+0000","last_active":"2023-03-03T06:26:29.985963+0000","last_peered":"2023-03-03T06:26:29.985963+0000","last_clean":"2023-03-03T06:26:29.985963+0000","last_became_active":"2023-03-03T06:23:34.881241+0000","last_became_peered":"2023-03-03T06:23:34.881241+0000","last_unstale":"2023-03-03T06:26:29.985963+0000","last_undegraded":"2023-03-03T06:26:29.985963+0000","last_fullsized":"2023-03-03T06:26:29.985963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:38:09.513172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977601+0000","last_change":"2023-03-03T06:25:05.636335+0000","last_active":"2023-03-03T06:26:29.977601+0000","last_peered":"2023-03-03T06:26:29.977601+0000","last_clean":"2023-03-03T06:26:29.977601+0000","last_became_active":"2023-03-03T06:25:04.443299+0000","last_became_peered":"2023-03-03T06:25:04.443299+0000","last_unstale":"2023-03-03T06:26:29.977601+0000","last_undegraded":"2023-03-03T06:26:29.977601+0000","last_fullsized":"2023-03-03T06:26:29.977601+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:13:38.046974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090290399999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.978161+0000","last_change":"2023-03-03T06:26:08.372573+0000","last_active":"2023-03-03T06:26:29.978161+0000","last_peered":"2023-03-03T06:26:29.978161+0000","last_clean":"2023-03-03T06:26:29.978161+0000","last_became_active":"2023-03-03T06:26:05.456694+0000","last_became_peered":"2023-03-03T06:26:05.456694+0000","last_unstale":"2023-03-03T06:26:29.978161+0000","last_undegraded":"2023-03-03T06:26:29.978161+0000","last_fullsized":"2023-03-03T06:26:29.978161+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:29:46.689179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000304698,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339587+0000","last_change":"2023-03-03T06:26:29.992025+0000","last_active":"2023-03-03T06:26:31.339587+0000","last_peered":"2023-03-03T06:26:31.339587+0000","last_clean":"2023-03-03T06:26:31.339587+0000","last_became_active":"2023-03-03T06:26:29.991700+0000","last_became_peered":"2023-03-03T06:26:29.991700+0000","last_unstale":"2023-03-03T06:26:31.339587+0000","last_undegraded":"2023-03-03T06:26:31.339587+0000","last_fullsized":"2023-03-03T06:26:31.339587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:37:26.220185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"84'2","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.351010+0000","last_change":"2023-03-03T06:26:29.566442+0000","last_active":"2023-03-03T06:26:31.351010+0000","last_peered":"2023-03-03T06:26:31.351010+0000","last_clean":"2023-03-03T06:26:31.351010+0000","last_became_active":"2023-03-03T06:26:29.566177+0000","last_became_peered":"2023-03-03T06:26:29.566177+0000","last_unstale":"2023-03-03T06:26:31.351010+0000","last_undegraded":"2023-03-03T06:26:31.351010+0000","last_fullsized":"2023-03-03T06:26:31.351010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:03:55.874849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976722+0000","last_change":"2023-03-03T06:26:06.443291+0000","last_active":"2023-03-03T06:26:29.976722+0000","last_peered":"2023-03-03T06:26:29.976722+0000","last_clean":"2023-03-03T06:26:29.976722+0000","last_became_active":"2023-03-03T06:26:06.442961+0000","last_became_peered":"2023-03-03T06:26:06.442961+0000","last_unstale":"2023-03-03T06:26:29.976722+0000","last_undegraded":"2023-03-03T06:26:29.976722+0000","last_fullsized":"2023-03-03T06:26:29.976722+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:10:59.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":79,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975754+0000","last_change":"2023-03-03T06:23:35.312453+0000","last_active":"2023-03-03T06:26:29.975754+0000","last_peered":"2023-03-03T06:26:29.975754+0000","last_clean":"2023-03-03T06:26:29.975754+0000","last_became_active":"2023-03-03T06:23:35.312179+0000","last_became_peered":"2023-03-03T06:23:35.312179+0000","last_unstale":"2023-03-03T06:26:29.975754+0000","last_undegraded":"2023-03-03T06:26:29.975754+0000","last_fullsized":"2023-03-03T06:26:29.975754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:23:33.864332+0000","last_clean_scrub_stamp":"2023-03-03T06:23:33.864332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:12:17.615036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.974370+0000","last_change":"2023-03-03T06:25:05.431854+0000","last_active":"2023-03-03T06:26:29.974370+0000","last_peered":"2023-03-03T06:26:29.974370+0000","last_clean":"2023-03-03T06:26:29.974370+0000","last_became_active":"2023-03-03T06:25:04.438570+0000","last_became_peered":"2023-03-03T06:25:04.438570+0000","last_unstale":"2023-03-03T06:26:29.974370+0000","last_undegraded":"2023-03-03T06:26:29.974370+0000","last_fullsized":"2023-03-03T06:26:29.974370+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897279,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976688+0000","last_change":"2023-03-03T06:26:07.437294+0000","last_active":"2023-03-03T06:26:29.976688+0000","last_peered":"2023-03-03T06:26:29.976688+0000","last_clean":"2023-03-03T06:26:29.976688+0000","last_became_active":"2023-03-03T06:26:05.452653+0000","last_became_peered":"2023-03-03T06:26:05.452653+0000","last_unstale":"2023-03-03T06:26:29.976688+0000","last_undegraded":"2023-03-03T06:26:29.976688+0000","last_fullsized":"2023-03-03T06:26:29.976688+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:37:33.832389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072507799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603733+0000","last_change":"2023-03-03T06:26:29.998549+0000","last_active":"2023-03-03T06:26:31.603733+0000","last_peered":"2023-03-03T06:26:31.603733+0000","last_clean":"2023-03-03T06:26:31.603733+0000","last_became_active":"2023-03-03T06:26:29.998292+0000","last_became_peered":"2023-03-03T06:26:29.998292+0000","last_unstale":"2023-03-03T06:26:31.603733+0000","last_undegraded":"2023-03-03T06:26:31.603733+0000","last_fullsized":"2023-03-03T06:26:31.603733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:17:58.611186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603531+0000","last_change":"2023-03-03T06:26:29.573982+0000","last_active":"2023-03-03T06:26:31.603531+0000","last_peered":"2023-03-03T06:26:31.603531+0000","last_clean":"2023-03-03T06:26:31.603531+0000","last_became_active":"2023-03-03T06:26:29.573778+0000","last_became_peered":"2023-03-03T06:26:29.573778+0000","last_unstale":"2023-03-03T06:26:31.603531+0000","last_undegraded":"2023-03-03T06:26:31.603531+0000","last_fullsized":"2023-03-03T06:26:31.603531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:18:21.674140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.978263+0000","last_change":"2023-03-03T06:26:06.453007+0000","last_active":"2023-03-03T06:26:29.978263+0000","last_peered":"2023-03-03T06:26:29.978263+0000","last_clean":"2023-03-03T06:26:29.978263+0000","last_became_active":"2023-03-03T06:26:06.452711+0000","last_became_peered":"2023-03-03T06:26:06.452711+0000","last_unstale":"2023-03-03T06:26:29.978263+0000","last_undegraded":"2023-03-03T06:26:29.978263+0000","last_fullsized":"2023-03-03T06:26:29.978263+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:31:13.721015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973414+0000","last_change":"2023-03-03T06:25:05.431441+0000","last_active":"2023-03-03T06:26:29.973414+0000","last_peered":"2023-03-03T06:26:29.973414+0000","last_clean":"2023-03-03T06:26:29.973414+0000","last_became_active":"2023-03-03T06:25:04.443840+0000","last_became_peered":"2023-03-03T06:25:04.443840+0000","last_unstale":"2023-03-03T06:26:29.973414+0000","last_undegraded":"2023-03-03T06:26:29.973414+0000","last_fullsized":"2023-03-03T06:26:29.973414+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017814980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.972996+0000","last_change":"2023-03-03T06:26:07.736641+0000","last_active":"2023-03-03T06:26:29.972996+0000","last_peered":"2023-03-03T06:26:29.972996+0000","last_clean":"2023-03-03T06:26:29.972996+0000","last_became_active":"2023-03-03T06:26:05.453335+0000","last_became_peered":"2023-03-03T06:26:05.453335+0000","last_unstale":"2023-03-03T06:26:29.972996+0000","last_undegraded":"2023-03-03T06:26:29.972996+0000","last_fullsized":"2023-03-03T06:26:29.972996+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:10:33.067696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049195100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978729+0000","last_change":"2023-03-03T06:26:29.992449+0000","last_active":"2023-03-03T06:26:30.978729+0000","last_peered":"2023-03-03T06:26:30.978729+0000","last_clean":"2023-03-03T06:26:30.978729+0000","last_became_active":"2023-03-03T06:26:29.992195+0000","last_became_peered":"2023-03-03T06:26:29.992195+0000","last_unstale":"2023-03-03T06:26:30.978729+0000","last_undegraded":"2023-03-03T06:26:30.978729+0000","last_fullsized":"2023-03-03T06:26:30.978729+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:37:03.828171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350613+0000","last_change":"2023-03-03T06:26:29.568978+0000","last_active":"2023-03-03T06:26:31.350613+0000","last_peered":"2023-03-03T06:26:31.350613+0000","last_clean":"2023-03-03T06:26:31.350613+0000","last_became_active":"2023-03-03T06:26:29.568376+0000","last_became_peered":"2023-03-03T06:26:29.568376+0000","last_unstale":"2023-03-03T06:26:31.350613+0000","last_undegraded":"2023-03-03T06:26:31.350613+0000","last_fullsized":"2023-03-03T06:26:31.350613+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:46:35.478618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.984063+0000","last_change":"2023-03-03T06:26:06.453235+0000","last_active":"2023-03-03T06:26:29.984063+0000","last_peered":"2023-03-03T06:26:29.984063+0000","last_clean":"2023-03-03T06:26:29.984063+0000","last_became_active":"2023-03-03T06:26:06.452943+0000","last_became_peered":"2023-03-03T06:26:06.452943+0000","last_unstale":"2023-03-03T06:26:29.984063+0000","last_undegraded":"2023-03-03T06:26:29.984063+0000","last_fullsized":"2023-03-03T06:26:29.984063+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:19:54.056197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988965+0000","last_change":"2023-03-03T06:25:05.797366+0000","last_active":"2023-03-03T06:26:29.988965+0000","last_peered":"2023-03-03T06:26:29.988965+0000","last_clean":"2023-03-03T06:26:29.988965+0000","last_became_active":"2023-03-03T06:25:04.439424+0000","last_became_peered":"2023-03-03T06:25:04.439424+0000","last_unstale":"2023-03-03T06:26:29.988965+0000","last_undegraded":"2023-03-03T06:26:29.988965+0000","last_fullsized":"2023-03-03T06:26:29.988965+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:35:12.599265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020575500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976779+0000","last_change":"2023-03-03T06:26:07.437096+0000","last_active":"2023-03-03T06:26:29.976779+0000","last_peered":"2023-03-03T06:26:29.976779+0000","last_clean":"2023-03-03T06:26:29.976779+0000","last_became_active":"2023-03-03T06:26:05.453270+0000","last_became_peered":"2023-03-03T06:26:05.453270+0000","last_unstale":"2023-03-03T06:26:29.976779+0000","last_undegraded":"2023-03-03T06:26:29.976779+0000","last_fullsized":"2023-03-03T06:26:29.976779+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:04:09.013384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047089700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350722+0000","last_change":"2023-03-03T06:26:29.996216+0000","last_active":"2023-03-03T06:26:31.350722+0000","last_peered":"2023-03-03T06:26:31.350722+0000","last_clean":"2023-03-03T06:26:31.350722+0000","last_became_active":"2023-03-03T06:26:29.995934+0000","last_became_peered":"2023-03-03T06:26:29.995934+0000","last_unstale":"2023-03-03T06:26:31.350722+0000","last_undegraded":"2023-03-03T06:26:31.350722+0000","last_fullsized":"2023-03-03T06:26:31.350722+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:10:58.185189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979684+0000","last_change":"2023-03-03T06:26:29.569034+0000","last_active":"2023-03-03T06:26:30.979684+0000","last_peered":"2023-03-03T06:26:30.979684+0000","last_clean":"2023-03-03T06:26:30.979684+0000","last_became_active":"2023-03-03T06:26:29.568736+0000","last_became_peered":"2023-03-03T06:26:29.568736+0000","last_unstale":"2023-03-03T06:26:30.979684+0000","last_undegraded":"2023-03-03T06:26:30.979684+0000","last_fullsized":"2023-03-03T06:26:30.979684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:23:21.280466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.986268+0000","last_change":"2023-03-03T06:26:06.450801+0000","last_active":"2023-03-03T06:26:29.986268+0000","last_peered":"2023-03-03T06:26:29.986268+0000","last_clean":"2023-03-03T06:26:29.986268+0000","last_became_active":"2023-03-03T06:26:06.450471+0000","last_became_peered":"2023-03-03T06:26:06.450471+0000","last_unstale":"2023-03-03T06:26:29.986268+0000","last_undegraded":"2023-03-03T06:26:29.986268+0000","last_fullsized":"2023-03-03T06:26:29.986268+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:52:12.324536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977051+0000","last_change":"2023-03-03T06:25:05.636038+0000","last_active":"2023-03-03T06:26:29.977051+0000","last_peered":"2023-03-03T06:26:29.977051+0000","last_clean":"2023-03-03T06:26:29.977051+0000","last_became_active":"2023-03-03T06:25:04.433771+0000","last_became_peered":"2023-03-03T06:25:04.433771+0000","last_unstale":"2023-03-03T06:26:29.977051+0000","last_undegraded":"2023-03-03T06:26:29.977051+0000","last_fullsized":"2023-03-03T06:26:29.977051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:33:58.284544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079784699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980099+0000","last_change":"2023-03-03T06:26:07.742584+0000","last_active":"2023-03-03T06:26:29.980099+0000","last_peered":"2023-03-03T06:26:29.980099+0000","last_clean":"2023-03-03T06:26:29.980099+0000","last_became_active":"2023-03-03T06:26:05.457838+0000","last_became_peered":"2023-03-03T06:26:05.457838+0000","last_unstale":"2023-03-03T06:26:29.980099+0000","last_undegraded":"2023-03-03T06:26:29.980099+0000","last_fullsized":"2023-03-03T06:26:29.980099+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:15:50.857364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066852600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350703+0000","last_change":"2023-03-03T06:26:29.994223+0000","last_active":"2023-03-03T06:26:31.350703+0000","last_peered":"2023-03-03T06:26:31.350703+0000","last_clean":"2023-03-03T06:26:31.350703+0000","last_became_active":"2023-03-03T06:26:29.993929+0000","last_became_peered":"2023-03-03T06:26:29.993929+0000","last_unstale":"2023-03-03T06:26:31.350703+0000","last_undegraded":"2023-03-03T06:26:31.350703+0000","last_fullsized":"2023-03-03T06:26:31.350703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:30:36.430656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350556+0000","last_change":"2023-03-03T06:26:29.573287+0000","last_active":"2023-03-03T06:26:31.350556+0000","last_peered":"2023-03-03T06:26:31.350556+0000","last_clean":"2023-03-03T06:26:31.350556+0000","last_became_active":"2023-03-03T06:26:29.568854+0000","last_became_peered":"2023-03-03T06:26:29.568854+0000","last_unstale":"2023-03-03T06:26:31.350556+0000","last_undegraded":"2023-03-03T06:26:31.350556+0000","last_fullsized":"2023-03-03T06:26:31.350556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:50:21.092941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973123+0000","last_change":"2023-03-03T06:26:06.451985+0000","last_active":"2023-03-03T06:26:29.973123+0000","last_peered":"2023-03-03T06:26:29.973123+0000","last_clean":"2023-03-03T06:26:29.973123+0000","last_became_active":"2023-03-03T06:26:06.451325+0000","last_became_peered":"2023-03-03T06:26:06.451325+0000","last_unstale":"2023-03-03T06:26:29.973123+0000","last_undegraded":"2023-03-03T06:26:29.973123+0000","last_fullsized":"2023-03-03T06:26:29.973123+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:18:30.022652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.986746+0000","last_change":"2023-03-03T06:25:05.797098+0000","last_active":"2023-03-03T06:26:29.986746+0000","last_peered":"2023-03-03T06:26:29.986746+0000","last_clean":"2023-03-03T06:26:29.986746+0000","last_became_active":"2023-03-03T06:25:04.446290+0000","last_became_peered":"2023-03-03T06:25:04.446290+0000","last_unstale":"2023-03-03T06:26:29.986746+0000","last_undegraded":"2023-03-03T06:26:29.986746+0000","last_fullsized":"2023-03-03T06:26:29.986746+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:23:37.795335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050239399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.982016+0000","last_change":"2023-03-03T06:26:07.979900+0000","last_active":"2023-03-03T06:26:29.982016+0000","last_peered":"2023-03-03T06:26:29.982016+0000","last_clean":"2023-03-03T06:26:29.982016+0000","last_became_active":"2023-03-03T06:26:05.451502+0000","last_became_peered":"2023-03-03T06:26:05.451502+0000","last_unstale":"2023-03-03T06:26:29.982016+0000","last_undegraded":"2023-03-03T06:26:29.982016+0000","last_fullsized":"2023-03-03T06:26:29.982016+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:36.121253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075614699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.977858+0000","last_change":"2023-03-03T06:26:29.994976+0000","last_active":"2023-03-03T06:26:30.977858+0000","last_peered":"2023-03-03T06:26:30.977858+0000","last_clean":"2023-03-03T06:26:30.977858+0000","last_became_active":"2023-03-03T06:26:29.994713+0000","last_became_peered":"2023-03-03T06:26:29.994713+0000","last_unstale":"2023-03-03T06:26:30.977858+0000","last_undegraded":"2023-03-03T06:26:30.977858+0000","last_fullsized":"2023-03-03T06:26:30.977858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:35:39.394419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604175+0000","last_change":"2023-03-03T06:26:29.576059+0000","last_active":"2023-03-03T06:26:31.604175+0000","last_peered":"2023-03-03T06:26:31.604175+0000","last_clean":"2023-03-03T06:26:31.604175+0000","last_became_active":"2023-03-03T06:26:29.575819+0000","last_became_peered":"2023-03-03T06:26:29.575819+0000","last_unstale":"2023-03-03T06:26:31.604175+0000","last_undegraded":"2023-03-03T06:26:31.604175+0000","last_fullsized":"2023-03-03T06:26:31.604175+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:00:37.258566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980514+0000","last_change":"2023-03-03T06:26:06.452639+0000","last_active":"2023-03-03T06:26:29.980514+0000","last_peered":"2023-03-03T06:26:29.980514+0000","last_clean":"2023-03-03T06:26:29.980514+0000","last_became_active":"2023-03-03T06:26:06.452326+0000","last_became_peered":"2023-03-03T06:26:06.452326+0000","last_unstale":"2023-03-03T06:26:29.980514+0000","last_undegraded":"2023-03-03T06:26:29.980514+0000","last_fullsized":"2023-03-03T06:26:29.980514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:38.158241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975604+0000","last_change":"2023-03-03T06:25:05.429793+0000","last_active":"2023-03-03T06:26:29.975604+0000","last_peered":"2023-03-03T06:26:29.975604+0000","last_clean":"2023-03-03T06:26:29.975604+0000","last_became_active":"2023-03-03T06:25:04.436400+0000","last_became_peered":"2023-03-03T06:25:04.436400+0000","last_unstale":"2023-03-03T06:26:29.975604+0000","last_undegraded":"2023-03-03T06:26:29.975604+0000","last_fullsized":"2023-03-03T06:26:29.975604+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038039399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988749+0000","last_change":"2023-03-03T06:26:07.980824+0000","last_active":"2023-03-03T06:26:29.988749+0000","last_peered":"2023-03-03T06:26:29.988749+0000","last_clean":"2023-03-03T06:26:29.988749+0000","last_became_active":"2023-03-03T06:26:05.454441+0000","last_became_peered":"2023-03-03T06:26:05.454441+0000","last_unstale":"2023-03-03T06:26:29.988749+0000","last_undegraded":"2023-03-03T06:26:29.988749+0000","last_fullsized":"2023-03-03T06:26:29.988749+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:17:18.231389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000408503,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978043+0000","last_change":"2023-03-03T06:26:29.987627+0000","last_active":"2023-03-03T06:26:30.978043+0000","last_peered":"2023-03-03T06:26:30.978043+0000","last_clean":"2023-03-03T06:26:30.978043+0000","last_became_active":"2023-03-03T06:26:29.987347+0000","last_became_peered":"2023-03-03T06:26:29.987347+0000","last_unstale":"2023-03-03T06:26:30.978043+0000","last_undegraded":"2023-03-03T06:26:30.978043+0000","last_fullsized":"2023-03-03T06:26:30.978043+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:27:55.297108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601936+0000","last_change":"2023-03-03T06:26:29.571462+0000","last_active":"2023-03-03T06:26:31.601936+0000","last_peered":"2023-03-03T06:26:31.601936+0000","last_clean":"2023-03-03T06:26:31.601936+0000","last_became_active":"2023-03-03T06:26:29.571157+0000","last_became_peered":"2023-03-03T06:26:29.571157+0000","last_unstale":"2023-03-03T06:26:31.601936+0000","last_undegraded":"2023-03-03T06:26:31.601936+0000","last_fullsized":"2023-03-03T06:26:31.601936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:25:29.912343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973472+0000","last_change":"2023-03-03T06:26:06.454265+0000","last_active":"2023-03-03T06:26:29.973472+0000","last_peered":"2023-03-03T06:26:29.973472+0000","last_clean":"2023-03-03T06:26:29.973472+0000","last_became_active":"2023-03-03T06:26:06.453645+0000","last_became_peered":"2023-03-03T06:26:06.453645+0000","last_unstale":"2023-03-03T06:26:29.973472+0000","last_undegraded":"2023-03-03T06:26:29.973472+0000","last_fullsized":"2023-03-03T06:26:29.973472+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:14:22.612704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988910+0000","last_change":"2023-03-03T06:25:05.796890+0000","last_active":"2023-03-03T06:26:29.988910+0000","last_peered":"2023-03-03T06:26:29.988910+0000","last_clean":"2023-03-03T06:26:29.988910+0000","last_became_active":"2023-03-03T06:25:04.437104+0000","last_became_peered":"2023-03-03T06:25:04.437104+0000","last_unstale":"2023-03-03T06:26:29.988910+0000","last_undegraded":"2023-03-03T06:26:29.988910+0000","last_fullsized":"2023-03-03T06:26:29.988910+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:10:21.043057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027269099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977177+0000","last_change":"2023-03-03T06:26:07.442040+0000","last_active":"2023-03-03T06:26:29.977177+0000","last_peered":"2023-03-03T06:26:29.977177+0000","last_clean":"2023-03-03T06:26:29.977177+0000","last_became_active":"2023-03-03T06:26:05.449262+0000","last_became_peered":"2023-03-03T06:26:05.449262+0000","last_unstale":"2023-03-03T06:26:29.977177+0000","last_undegraded":"2023-03-03T06:26:29.977177+0000","last_fullsized":"2023-03-03T06:26:29.977177+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:24:58.288956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054354700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339034+0000","last_change":"2023-03-03T06:26:29.992649+0000","last_active":"2023-03-03T06:26:31.339034+0000","last_peered":"2023-03-03T06:26:31.339034+0000","last_clean":"2023-03-03T06:26:31.339034+0000","last_became_active":"2023-03-03T06:26:29.992397+0000","last_became_peered":"2023-03-03T06:26:29.992397+0000","last_unstale":"2023-03-03T06:26:31.339034+0000","last_undegraded":"2023-03-03T06:26:31.339034+0000","last_fullsized":"2023-03-03T06:26:31.339034+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:59:20.867226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"84'2","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.602426+0000","last_change":"2023-03-03T06:26:29.569925+0000","last_active":"2023-03-03T06:26:31.602426+0000","last_peered":"2023-03-03T06:26:31.602426+0000","last_clean":"2023-03-03T06:26:31.602426+0000","last_became_active":"2023-03-03T06:26:29.569668+0000","last_became_peered":"2023-03-03T06:26:29.569668+0000","last_unstale":"2023-03-03T06:26:31.602426+0000","last_undegraded":"2023-03-03T06:26:31.602426+0000","last_fullsized":"2023-03-03T06:26:31.602426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:56:42.324125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973335+0000","last_change":"2023-03-03T06:26:06.452106+0000","last_active":"2023-03-03T06:26:29.973335+0000","last_peered":"2023-03-03T06:26:29.973335+0000","last_clean":"2023-03-03T06:26:29.973335+0000","last_became_active":"2023-03-03T06:26:06.451741+0000","last_became_peered":"2023-03-03T06:26:06.451741+0000","last_unstale":"2023-03-03T06:26:29.973335+0000","last_undegraded":"2023-03-03T06:26:29.973335+0000","last_fullsized":"2023-03-03T06:26:29.973335+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:44:37.307316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.983796+0000","last_change":"2023-03-03T06:25:05.431187+0000","last_active":"2023-03-03T06:26:29.983796+0000","last_peered":"2023-03-03T06:26:29.983796+0000","last_clean":"2023-03-03T06:26:29.983796+0000","last_became_active":"2023-03-03T06:25:04.442929+0000","last_became_peered":"2023-03-03T06:25:04.442929+0000","last_unstale":"2023-03-03T06:26:29.983796+0000","last_undegraded":"2023-03-03T06:26:29.983796+0000","last_fullsized":"2023-03-03T06:26:29.983796+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001551871,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975613+0000","last_change":"2023-03-03T06:26:07.442810+0000","last_active":"2023-03-03T06:26:29.975613+0000","last_peered":"2023-03-03T06:26:29.975613+0000","last_clean":"2023-03-03T06:26:29.975613+0000","last_became_active":"2023-03-03T06:26:05.452515+0000","last_became_peered":"2023-03-03T06:26:05.452515+0000","last_unstale":"2023-03-03T06:26:29.975613+0000","last_undegraded":"2023-03-03T06:26:29.975613+0000","last_fullsized":"2023-03-03T06:26:29.975613+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:53:58.001196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043871,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979010+0000","last_change":"2023-03-03T06:26:29.988571+0000","last_active":"2023-03-03T06:26:30.979010+0000","last_peered":"2023-03-03T06:26:30.979010+0000","last_clean":"2023-03-03T06:26:30.979010+0000","last_became_active":"2023-03-03T06:26:29.987928+0000","last_became_peered":"2023-03-03T06:26:29.987928+0000","last_unstale":"2023-03-03T06:26:30.979010+0000","last_undegraded":"2023-03-03T06:26:30.979010+0000","last_fullsized":"2023-03-03T06:26:30.979010+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:00:44.001277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339628+0000","last_change":"2023-03-03T06:26:29.561974+0000","last_active":"2023-03-03T06:26:31.339628+0000","last_peered":"2023-03-03T06:26:31.339628+0000","last_clean":"2023-03-03T06:26:31.339628+0000","last_became_active":"2023-03-03T06:26:29.561656+0000","last_became_peered":"2023-03-03T06:26:29.561656+0000","last_unstale":"2023-03-03T06:26:31.339628+0000","last_undegraded":"2023-03-03T06:26:31.339628+0000","last_fullsized":"2023-03-03T06:26:31.339628+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:21:32.190461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977730+0000","last_change":"2023-03-03T06:26:06.445426+0000","last_active":"2023-03-03T06:26:29.977730+0000","last_peered":"2023-03-03T06:26:29.977730+0000","last_clean":"2023-03-03T06:26:29.977730+0000","last_became_active":"2023-03-03T06:26:06.445155+0000","last_became_peered":"2023-03-03T06:26:06.445155+0000","last_unstale":"2023-03-03T06:26:29.977730+0000","last_undegraded":"2023-03-03T06:26:29.977730+0000","last_fullsized":"2023-03-03T06:26:29.977730+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:28.373052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.985430+0000","last_change":"2023-03-03T06:25:05.796211+0000","last_active":"2023-03-03T06:26:29.985430+0000","last_peered":"2023-03-03T06:26:29.985430+0000","last_clean":"2023-03-03T06:26:29.985430+0000","last_became_active":"2023-03-03T06:25:04.436647+0000","last_became_peered":"2023-03-03T06:25:04.436647+0000","last_unstale":"2023-03-03T06:26:29.985430+0000","last_undegraded":"2023-03-03T06:26:29.985430+0000","last_fullsized":"2023-03-03T06:26:29.985430+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:27:07.330548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980612+0000","last_change":"2023-03-03T06:26:07.743198+0000","last_active":"2023-03-03T06:26:29.980612+0000","last_peered":"2023-03-03T06:26:29.980612+0000","last_clean":"2023-03-03T06:26:29.980612+0000","last_became_active":"2023-03-03T06:26:05.457593+0000","last_became_peered":"2023-03-03T06:26:05.457593+0000","last_unstale":"2023-03-03T06:26:29.980612+0000","last_undegraded":"2023-03-03T06:26:29.980612+0000","last_fullsized":"2023-03-03T06:26:29.980612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:45:02.381708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056405099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604997+0000","last_change":"2023-03-03T06:26:29.998199+0000","last_active":"2023-03-03T06:26:31.604997+0000","last_peered":"2023-03-03T06:26:31.604997+0000","last_clean":"2023-03-03T06:26:31.604997+0000","last_became_active":"2023-03-03T06:26:29.997923+0000","last_became_peered":"2023-03-03T06:26:29.997923+0000","last_unstale":"2023-03-03T06:26:31.604997+0000","last_undegraded":"2023-03-03T06:26:31.604997+0000","last_fullsized":"2023-03-03T06:26:31.604997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:29.968161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979053+0000","last_change":"2023-03-03T06:26:29.562256+0000","last_active":"2023-03-03T06:26:30.979053+0000","last_peered":"2023-03-03T06:26:30.979053+0000","last_clean":"2023-03-03T06:26:30.979053+0000","last_became_active":"2023-03-03T06:26:29.561993+0000","last_became_peered":"2023-03-03T06:26:29.561993+0000","last_unstale":"2023-03-03T06:26:30.979053+0000","last_undegraded":"2023-03-03T06:26:30.979053+0000","last_fullsized":"2023-03-03T06:26:30.979053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:40:07.812959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.982937+0000","last_change":"2023-03-03T06:26:06.451152+0000","last_active":"2023-03-03T06:26:29.982937+0000","last_peered":"2023-03-03T06:26:29.982937+0000","last_clean":"2023-03-03T06:26:29.982937+0000","last_became_active":"2023-03-03T06:26:06.450402+0000","last_became_peered":"2023-03-03T06:26:06.450402+0000","last_unstale":"2023-03-03T06:26:29.982937+0000","last_undegraded":"2023-03-03T06:26:29.982937+0000","last_fullsized":"2023-03-03T06:26:29.982937+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:51:58.204120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.986070+0000","last_change":"2023-03-03T06:25:05.431681+0000","last_active":"2023-03-03T06:26:29.986070+0000","last_peered":"2023-03-03T06:26:29.986070+0000","last_clean":"2023-03-03T06:26:29.986070+0000","last_became_active":"2023-03-03T06:25:04.443599+0000","last_became_peered":"2023-03-03T06:25:04.443599+0000","last_unstale":"2023-03-03T06:26:29.986070+0000","last_undegraded":"2023-03-03T06:26:29.986070+0000","last_fullsized":"2023-03-03T06:26:29.986070+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001546473,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975384+0000","last_change":"2023-03-03T06:26:07.443410+0000","last_active":"2023-03-03T06:26:29.975384+0000","last_peered":"2023-03-03T06:26:29.975384+0000","last_clean":"2023-03-03T06:26:29.975384+0000","last_became_active":"2023-03-03T06:26:05.457518+0000","last_became_peered":"2023-03-03T06:26:05.457518+0000","last_unstale":"2023-03-03T06:26:29.975384+0000","last_undegraded":"2023-03-03T06:26:29.975384+0000","last_fullsized":"2023-03-03T06:26:29.975384+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:20:03.378440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000254758,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978405+0000","last_change":"2023-03-03T06:26:29.995956+0000","last_active":"2023-03-03T06:26:30.978405+0000","last_peered":"2023-03-03T06:26:30.978405+0000","last_clean":"2023-03-03T06:26:30.978405+0000","last_became_active":"2023-03-03T06:26:29.995699+0000","last_became_peered":"2023-03-03T06:26:29.995699+0000","last_unstale":"2023-03-03T06:26:30.978405+0000","last_undegraded":"2023-03-03T06:26:30.978405+0000","last_fullsized":"2023-03-03T06:26:30.978405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:17:07.516450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.977624+0000","last_change":"2023-03-03T06:26:29.568469+0000","last_active":"2023-03-03T06:26:30.977624+0000","last_peered":"2023-03-03T06:26:30.977624+0000","last_clean":"2023-03-03T06:26:30.977624+0000","last_became_active":"2023-03-03T06:26:29.566577+0000","last_became_peered":"2023-03-03T06:26:29.566577+0000","last_unstale":"2023-03-03T06:26:30.977624+0000","last_undegraded":"2023-03-03T06:26:30.977624+0000","last_fullsized":"2023-03-03T06:26:30.977624+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:02:54.108310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980036+0000","last_change":"2023-03-03T06:26:06.457581+0000","last_active":"2023-03-03T06:26:29.980036+0000","last_peered":"2023-03-03T06:26:29.980036+0000","last_clean":"2023-03-03T06:26:29.980036+0000","last_became_active":"2023-03-03T06:26:06.457382+0000","last_became_peered":"2023-03-03T06:26:06.457382+0000","last_unstale":"2023-03-03T06:26:29.980036+0000","last_undegraded":"2023-03-03T06:26:29.980036+0000","last_fullsized":"2023-03-03T06:26:29.980036+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:16:49.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.974606+0000","last_change":"2023-03-03T06:25:05.432320+0000","last_active":"2023-03-03T06:26:29.974606+0000","last_peered":"2023-03-03T06:26:29.974606+0000","last_clean":"2023-03-03T06:26:29.974606+0000","last_became_active":"2023-03-03T06:25:04.436727+0000","last_became_peered":"2023-03-03T06:25:04.436727+0000","last_unstale":"2023-03-03T06:26:29.974606+0000","last_undegraded":"2023-03-03T06:26:29.974606+0000","last_fullsized":"2023-03-03T06:26:29.974606+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014361980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.989153+0000","last_change":"2023-03-03T06:26:08.328407+0000","last_active":"2023-03-03T06:26:29.989153+0000","last_peered":"2023-03-03T06:26:29.989153+0000","last_clean":"2023-03-03T06:26:29.989153+0000","last_became_active":"2023-03-03T06:26:05.457908+0000","last_became_peered":"2023-03-03T06:26:05.457908+0000","last_unstale":"2023-03-03T06:26:29.989153+0000","last_undegraded":"2023-03-03T06:26:29.989153+0000","last_fullsized":"2023-03-03T06:26:29.989153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:52:27.784873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048973500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978050+0000","last_change":"2023-03-03T06:26:29.992919+0000","last_active":"2023-03-03T06:26:30.978050+0000","last_peered":"2023-03-03T06:26:30.978050+0000","last_clean":"2023-03-03T06:26:30.978050+0000","last_became_active":"2023-03-03T06:26:29.992622+0000","last_became_peered":"2023-03-03T06:26:29.992622+0000","last_unstale":"2023-03-03T06:26:30.978050+0000","last_undegraded":"2023-03-03T06:26:30.978050+0000","last_fullsized":"2023-03-03T06:26:30.978050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T18:23:22.282206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"84'1","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603484+0000","last_change":"2023-03-03T06:26:29.565602+0000","last_active":"2023-03-03T06:26:31.603484+0000","last_peered":"2023-03-03T06:26:31.603484+0000","last_clean":"2023-03-03T06:26:31.603484+0000","last_became_active":"2023-03-03T06:26:29.565302+0000","last_became_peered":"2023-03-03T06:26:29.565302+0000","last_unstale":"2023-03-03T06:26:31.603484+0000","last_undegraded":"2023-03-03T06:26:31.603484+0000","last_fullsized":"2023-03-03T06:26:31.603484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:36:30.587345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.972610+0000","last_change":"2023-03-03T06:26:06.457173+0000","last_active":"2023-03-03T06:26:29.972610+0000","last_peered":"2023-03-03T06:26:29.972610+0000","last_clean":"2023-03-03T06:26:29.972610+0000","last_became_active":"2023-03-03T06:26:06.456849+0000","last_became_peered":"2023-03-03T06:26:06.456849+0000","last_unstale":"2023-03-03T06:26:29.972610+0000","last_undegraded":"2023-03-03T06:26:29.972610+0000","last_fullsized":"2023-03-03T06:26:29.972610+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:31:59.618203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976990+0000","last_change":"2023-03-03T06:25:05.635968+0000","last_active":"2023-03-03T06:26:29.976990+0000","last_peered":"2023-03-03T06:26:29.976990+0000","last_clean":"2023-03-03T06:26:29.976990+0000","last_became_active":"2023-03-03T06:25:04.443619+0000","last_became_peered":"2023-03-03T06:25:04.443619+0000","last_unstale":"2023-03-03T06:26:29.976990+0000","last_undegraded":"2023-03-03T06:26:29.976990+0000","last_fullsized":"2023-03-03T06:26:29.976990+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:51:15.780667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077929799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.984144+0000","last_change":"2023-03-03T06:26:07.442869+0000","last_active":"2023-03-03T06:26:29.984144+0000","last_peered":"2023-03-03T06:26:29.984144+0000","last_clean":"2023-03-03T06:26:29.984144+0000","last_became_active":"2023-03-03T06:26:05.453329+0000","last_became_peered":"2023-03-03T06:26:05.453329+0000","last_unstale":"2023-03-03T06:26:29.984144+0000","last_undegraded":"2023-03-03T06:26:29.984144+0000","last_fullsized":"2023-03-03T06:26:29.984144+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:10:58.480669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000663498,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339910+0000","last_change":"2023-03-03T06:26:29.999400+0000","last_active":"2023-03-03T06:26:31.339910+0000","last_peered":"2023-03-03T06:26:31.339910+0000","last_clean":"2023-03-03T06:26:31.339910+0000","last_became_active":"2023-03-03T06:26:29.998771+0000","last_became_peered":"2023-03-03T06:26:29.998771+0000","last_unstale":"2023-03-03T06:26:31.339910+0000","last_undegraded":"2023-03-03T06:26:31.339910+0000","last_fullsized":"2023-03-03T06:26:31.339910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:37:28.651873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"84'1","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.977292+0000","last_change":"2023-03-03T06:26:29.556472+0000","last_active":"2023-03-03T06:26:30.977292+0000","last_peered":"2023-03-03T06:26:30.977292+0000","last_clean":"2023-03-03T06:26:30.977292+0000","last_became_active":"2023-03-03T06:26:29.556199+0000","last_became_peered":"2023-03-03T06:26:29.556199+0000","last_unstale":"2023-03-03T06:26:30.977292+0000","last_undegraded":"2023-03-03T06:26:30.977292+0000","last_fullsized":"2023-03-03T06:26:30.977292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:05:34.578653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988551+0000","last_change":"2023-03-03T06:26:06.453164+0000","last_active":"2023-03-03T06:26:29.988551+0000","last_peered":"2023-03-03T06:26:29.988551+0000","last_clean":"2023-03-03T06:26:29.988551+0000","last_became_active":"2023-03-03T06:26:06.452775+0000","last_became_peered":"2023-03-03T06:26:06.452775+0000","last_unstale":"2023-03-03T06:26:29.988551+0000","last_undegraded":"2023-03-03T06:26:29.988551+0000","last_fullsized":"2023-03-03T06:26:29.988551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:31:00.339823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973767+0000","last_change":"2023-03-03T06:25:05.432139+0000","last_active":"2023-03-03T06:26:29.973767+0000","last_peered":"2023-03-03T06:26:29.973767+0000","last_clean":"2023-03-03T06:26:29.973767+0000","last_became_active":"2023-03-03T06:25:04.435759+0000","last_became_peered":"2023-03-03T06:25:04.435759+0000","last_unstale":"2023-03-03T06:26:29.973767+0000","last_undegraded":"2023-03-03T06:26:29.973767+0000","last_fullsized":"2023-03-03T06:26:29.973767+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:39:33.013837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001646893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.981872+0000","last_change":"2023-03-03T06:26:07.979888+0000","last_active":"2023-03-03T06:26:29.981872+0000","last_peered":"2023-03-03T06:26:29.981872+0000","last_clean":"2023-03-03T06:26:29.981872+0000","last_became_active":"2023-03-03T06:26:05.452094+0000","last_became_peered":"2023-03-03T06:26:05.452094+0000","last_unstale":"2023-03-03T06:26:29.981872+0000","last_undegraded":"2023-03-03T06:26:29.981872+0000","last_fullsized":"2023-03-03T06:26:29.981872+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:46:11.362865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000772757,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979184+0000","last_change":"2023-03-03T06:26:29.986369+0000","last_active":"2023-03-03T06:26:30.979184+0000","last_peered":"2023-03-03T06:26:30.979184+0000","last_clean":"2023-03-03T06:26:30.979184+0000","last_became_active":"2023-03-03T06:26:29.986106+0000","last_became_peered":"2023-03-03T06:26:29.986106+0000","last_unstale":"2023-03-03T06:26:30.979184+0000","last_undegraded":"2023-03-03T06:26:30.979184+0000","last_fullsized":"2023-03-03T06:26:30.979184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:30:04.123198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"84'2","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979455+0000","last_change":"2023-03-03T06:26:29.561218+0000","last_active":"2023-03-03T06:26:30.979455+0000","last_peered":"2023-03-03T06:26:30.979455+0000","last_clean":"2023-03-03T06:26:30.979455+0000","last_became_active":"2023-03-03T06:26:29.560973+0000","last_became_peered":"2023-03-03T06:26:29.560973+0000","last_unstale":"2023-03-03T06:26:30.979455+0000","last_undegraded":"2023-03-03T06:26:30.979455+0000","last_fullsized":"2023-03-03T06:26:30.979455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:35:04.097070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973843+0000","last_change":"2023-03-03T06:26:06.451616+0000","last_active":"2023-03-03T06:26:29.973843+0000","last_peered":"2023-03-03T06:26:29.973843+0000","last_clean":"2023-03-03T06:26:29.973843+0000","last_became_active":"2023-03-03T06:26:06.451034+0000","last_became_peered":"2023-03-03T06:26:06.451034+0000","last_unstale":"2023-03-03T06:26:29.973843+0000","last_undegraded":"2023-03-03T06:26:29.973843+0000","last_fullsized":"2023-03-03T06:26:29.973843+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:43:29.025900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.987804+0000","last_change":"2023-03-03T06:26:07.743530+0000","last_active":"2023-03-03T06:26:29.987804+0000","last_peered":"2023-03-03T06:26:29.987804+0000","last_clean":"2023-03-03T06:26:29.987804+0000","last_became_active":"2023-03-03T06:26:05.450200+0000","last_became_peered":"2023-03-03T06:26:05.450200+0000","last_unstale":"2023-03-03T06:26:29.987804+0000","last_undegraded":"2023-03-03T06:26:29.987804+0000","last_fullsized":"2023-03-03T06:26:29.987804+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:43:07.459264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035572099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.972769+0000","last_change":"2023-03-03T06:25:05.431490+0000","last_active":"2023-03-03T06:26:29.972769+0000","last_peered":"2023-03-03T06:26:29.972769+0000","last_clean":"2023-03-03T06:26:29.972769+0000","last_became_active":"2023-03-03T06:25:04.443163+0000","last_became_peered":"2023-03-03T06:25:04.443163+0000","last_unstale":"2023-03-03T06:26:29.972769+0000","last_undegraded":"2023-03-03T06:26:29.972769+0000","last_fullsized":"2023-03-03T06:26:29.972769+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:04:49.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020118839999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.977899+0000","last_change":"2023-03-03T06:26:29.989724+0000","last_active":"2023-03-03T06:26:30.977899+0000","last_peered":"2023-03-03T06:26:30.977899+0000","last_clean":"2023-03-03T06:26:30.977899+0000","last_became_active":"2023-03-03T06:26:29.989443+0000","last_became_peered":"2023-03-03T06:26:29.989443+0000","last_unstale":"2023-03-03T06:26:30.977899+0000","last_undegraded":"2023-03-03T06:26:30.977899+0000","last_fullsized":"2023-03-03T06:26:30.977899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:22:14.553934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"84'2","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601913+0000","last_change":"2023-03-03T06:26:29.561645+0000","last_active":"2023-03-03T06:26:31.601913+0000","last_peered":"2023-03-03T06:26:31.601913+0000","last_clean":"2023-03-03T06:26:31.601913+0000","last_became_active":"2023-03-03T06:26:29.561378+0000","last_became_peered":"2023-03-03T06:26:29.561378+0000","last_unstale":"2023-03-03T06:26:31.601913+0000","last_undegraded":"2023-03-03T06:26:31.601913+0000","last_fullsized":"2023-03-03T06:26:31.601913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:20:20.221568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.973395+0000","last_change":"2023-03-03T06:26:06.454499+0000","last_active":"2023-03-03T06:26:29.973395+0000","last_peered":"2023-03-03T06:26:29.973395+0000","last_clean":"2023-03-03T06:26:29.973395+0000","last_became_active":"2023-03-03T06:26:06.453966+0000","last_became_peered":"2023-03-03T06:26:06.453966+0000","last_unstale":"2023-03-03T06:26:29.973395+0000","last_undegraded":"2023-03-03T06:26:29.973395+0000","last_fullsized":"2023-03-03T06:26:29.973395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:36:07.476248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977252+0000","last_change":"2023-03-03T06:26:07.442340+0000","last_active":"2023-03-03T06:26:29.977252+0000","last_peered":"2023-03-03T06:26:29.977252+0000","last_clean":"2023-03-03T06:26:29.977252+0000","last_became_active":"2023-03-03T06:26:05.447268+0000","last_became_peered":"2023-03-03T06:26:05.447268+0000","last_unstale":"2023-03-03T06:26:29.977252+0000","last_undegraded":"2023-03-03T06:26:29.977252+0000","last_fullsized":"2023-03-03T06:26:29.977252+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:10:58.480669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078222399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975224+0000","last_change":"2023-03-03T06:25:05.430443+0000","last_active":"2023-03-03T06:26:29.975224+0000","last_peered":"2023-03-03T06:26:29.975224+0000","last_clean":"2023-03-03T06:26:29.975224+0000","last_became_active":"2023-03-03T06:25:04.596481+0000","last_became_peered":"2023-03-03T06:25:04.596481+0000","last_unstale":"2023-03-03T06:26:29.975224+0000","last_undegraded":"2023-03-03T06:26:29.975224+0000","last_fullsized":"2023-03-03T06:26:29.975224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044860800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339170+0000","last_change":"2023-03-03T06:26:29.986042+0000","last_active":"2023-03-03T06:26:31.339170+0000","last_peered":"2023-03-03T06:26:31.339170+0000","last_clean":"2023-03-03T06:26:31.339170+0000","last_became_active":"2023-03-03T06:26:29.985499+0000","last_became_peered":"2023-03-03T06:26:29.985499+0000","last_unstale":"2023-03-03T06:26:31.339170+0000","last_undegraded":"2023-03-03T06:26:31.339170+0000","last_fullsized":"2023-03-03T06:26:31.339170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:27:35.210679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"84'4","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978163+0000","last_change":"2023-03-03T06:26:29.570027+0000","last_active":"2023-03-03T06:26:30.978163+0000","last_peered":"2023-03-03T06:26:30.978163+0000","last_clean":"2023-03-03T06:26:30.978163+0000","last_became_active":"2023-03-03T06:26:29.569263+0000","last_became_peered":"2023-03-03T06:26:29.569263+0000","last_unstale":"2023-03-03T06:26:30.978163+0000","last_undegraded":"2023-03-03T06:26:30.978163+0000","last_fullsized":"2023-03-03T06:26:30.978163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:30:20.418498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988860+0000","last_change":"2023-03-03T06:26:06.452412+0000","last_active":"2023-03-03T06:26:29.988860+0000","last_peered":"2023-03-03T06:26:29.988860+0000","last_clean":"2023-03-03T06:26:29.988860+0000","last_became_active":"2023-03-03T06:26:06.452090+0000","last_became_peered":"2023-03-03T06:26:06.452090+0000","last_unstale":"2023-03-03T06:26:29.988860+0000","last_undegraded":"2023-03-03T06:26:29.988860+0000","last_fullsized":"2023-03-03T06:26:29.988860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:55:25.087974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.989115+0000","last_change":"2023-03-03T06:26:07.980394+0000","last_active":"2023-03-03T06:26:29.989115+0000","last_peered":"2023-03-03T06:26:29.989115+0000","last_clean":"2023-03-03T06:26:29.989115+0000","last_became_active":"2023-03-03T06:26:05.457769+0000","last_became_peered":"2023-03-03T06:26:05.457769+0000","last_unstale":"2023-03-03T06:26:29.989115+0000","last_undegraded":"2023-03-03T06:26:29.989115+0000","last_fullsized":"2023-03-03T06:26:29.989115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:46:56.893095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059490200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.974824+0000","last_change":"2023-03-03T06:25:05.429739+0000","last_active":"2023-03-03T06:26:29.974824+0000","last_peered":"2023-03-03T06:26:29.974824+0000","last_clean":"2023-03-03T06:26:29.974824+0000","last_became_active":"2023-03-03T06:25:04.438903+0000","last_became_peered":"2023-03-03T06:25:04.438903+0000","last_unstale":"2023-03-03T06:26:29.974824+0000","last_undegraded":"2023-03-03T06:26:29.974824+0000","last_fullsized":"2023-03-03T06:26:29.974824+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:33:23.927718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040434999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350374+0000","last_change":"2023-03-03T06:26:29.988541+0000","last_active":"2023-03-03T06:26:31.350374+0000","last_peered":"2023-03-03T06:26:31.350374+0000","last_clean":"2023-03-03T06:26:31.350374+0000","last_became_active":"2023-03-03T06:26:29.988102+0000","last_became_peered":"2023-03-03T06:26:29.988102+0000","last_unstale":"2023-03-03T06:26:31.350374+0000","last_undegraded":"2023-03-03T06:26:31.350374+0000","last_fullsized":"2023-03-03T06:26:31.350374+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:25:30.914082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"84'1","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.351079+0000","last_change":"2023-03-03T06:26:29.565911+0000","last_active":"2023-03-03T06:26:31.351079+0000","last_peered":"2023-03-03T06:26:31.351079+0000","last_clean":"2023-03-03T06:26:31.351079+0000","last_became_active":"2023-03-03T06:26:29.565318+0000","last_became_peered":"2023-03-03T06:26:29.565318+0000","last_unstale":"2023-03-03T06:26:31.351079+0000","last_undegraded":"2023-03-03T06:26:31.351079+0000","last_fullsized":"2023-03-03T06:26:31.351079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:47:21.008848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975496+0000","last_change":"2023-03-03T06:26:06.456012+0000","last_active":"2023-03-03T06:26:29.975496+0000","last_peered":"2023-03-03T06:26:29.975496+0000","last_clean":"2023-03-03T06:26:29.975496+0000","last_became_active":"2023-03-03T06:26:06.455710+0000","last_became_peered":"2023-03-03T06:26:06.455710+0000","last_unstale":"2023-03-03T06:26:29.975496+0000","last_undegraded":"2023-03-03T06:26:29.975496+0000","last_fullsized":"2023-03-03T06:26:29.975496+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:15:17.648669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976874+0000","last_change":"2023-03-03T06:25:05.635716+0000","last_active":"2023-03-03T06:26:29.976874+0000","last_peered":"2023-03-03T06:26:29.976874+0000","last_clean":"2023-03-03T06:26:29.976874+0000","last_became_active":"2023-03-03T06:25:04.433896+0000","last_became_peered":"2023-03-03T06:25:04.433896+0000","last_unstale":"2023-03-03T06:26:29.976874+0000","last_undegraded":"2023-03-03T06:26:29.976874+0000","last_fullsized":"2023-03-03T06:26:29.976874+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:37:35.209807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060132199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980556+0000","last_change":"2023-03-03T06:26:07.742995+0000","last_active":"2023-03-03T06:26:29.980556+0000","last_peered":"2023-03-03T06:26:29.980556+0000","last_clean":"2023-03-03T06:26:29.980556+0000","last_became_active":"2023-03-03T06:26:05.445510+0000","last_became_peered":"2023-03-03T06:26:05.445510+0000","last_unstale":"2023-03-03T06:26:29.980556+0000","last_undegraded":"2023-03-03T06:26:29.980556+0000","last_fullsized":"2023-03-03T06:26:29.980556+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:48:14.934957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054098000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350742+0000","last_change":"2023-03-03T06:26:29.985224+0000","last_active":"2023-03-03T06:26:31.350742+0000","last_peered":"2023-03-03T06:26:31.350742+0000","last_clean":"2023-03-03T06:26:31.350742+0000","last_became_active":"2023-03-03T06:26:29.984967+0000","last_became_peered":"2023-03-03T06:26:29.984967+0000","last_unstale":"2023-03-03T06:26:31.350742+0000","last_undegraded":"2023-03-03T06:26:31.350742+0000","last_fullsized":"2023-03-03T06:26:31.350742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:25:23.406448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350563+0000","last_change":"2023-03-03T06:26:29.569685+0000","last_active":"2023-03-03T06:26:31.350563+0000","last_peered":"2023-03-03T06:26:31.350563+0000","last_clean":"2023-03-03T06:26:31.350563+0000","last_became_active":"2023-03-03T06:26:29.567040+0000","last_became_peered":"2023-03-03T06:26:29.567040+0000","last_unstale":"2023-03-03T06:26:31.350563+0000","last_undegraded":"2023-03-03T06:26:31.350563+0000","last_fullsized":"2023-03-03T06:26:31.350563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:39:56.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.983067+0000","last_change":"2023-03-03T06:26:06.451354+0000","last_active":"2023-03-03T06:26:29.983067+0000","last_peered":"2023-03-03T06:26:29.983067+0000","last_clean":"2023-03-03T06:26:29.983067+0000","last_became_active":"2023-03-03T06:26:06.450833+0000","last_became_peered":"2023-03-03T06:26:06.450833+0000","last_unstale":"2023-03-03T06:26:29.983067+0000","last_undegraded":"2023-03-03T06:26:29.983067+0000","last_fullsized":"2023-03-03T06:26:29.983067+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:43:08.463920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.985898+0000","last_change":"2023-03-03T06:25:05.431768+0000","last_active":"2023-03-03T06:26:29.985898+0000","last_peered":"2023-03-03T06:26:29.985898+0000","last_clean":"2023-03-03T06:26:29.985898+0000","last_became_active":"2023-03-03T06:25:04.596711+0000","last_became_peered":"2023-03-03T06:25:04.596711+0000","last_unstale":"2023-03-03T06:26:29.985898+0000","last_undegraded":"2023-03-03T06:26:29.985898+0000","last_fullsized":"2023-03-03T06:26:29.985898+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:55:28.106622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001569261,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.980956+0000","last_change":"2023-03-03T06:26:07.980395+0000","last_active":"2023-03-03T06:26:29.980956+0000","last_peered":"2023-03-03T06:26:29.980956+0000","last_clean":"2023-03-03T06:26:29.980956+0000","last_became_active":"2023-03-03T06:26:05.451720+0000","last_became_peered":"2023-03-03T06:26:05.451720+0000","last_unstale":"2023-03-03T06:26:29.980956+0000","last_undegraded":"2023-03-03T06:26:29.980956+0000","last_fullsized":"2023-03-03T06:26:29.980956+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T08:49:56.977188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081553799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.340041+0000","last_change":"2023-03-03T06:26:30.000255+0000","last_active":"2023-03-03T06:26:31.340041+0000","last_peered":"2023-03-03T06:26:31.340041+0000","last_clean":"2023-03-03T06:26:31.340041+0000","last_became_active":"2023-03-03T06:26:29.999981+0000","last_became_peered":"2023-03-03T06:26:29.999981+0000","last_unstale":"2023-03-03T06:26:31.340041+0000","last_undegraded":"2023-03-03T06:26:31.340041+0000","last_fullsized":"2023-03-03T06:26:31.340041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:23:27.191250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"84'8","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978964+0000","last_change":"2023-03-03T06:26:29.559643+0000","last_active":"2023-03-03T06:26:30.978964+0000","last_peered":"2023-03-03T06:26:30.978964+0000","last_clean":"2023-03-03T06:26:30.978964+0000","last_became_active":"2023-03-03T06:26:29.559304+0000","last_became_peered":"2023-03-03T06:26:29.559304+0000","last_unstale":"2023-03-03T06:26:30.978964+0000","last_undegraded":"2023-03-03T06:26:30.978964+0000","last_fullsized":"2023-03-03T06:26:30.978964+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:34:13.624083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.974742+0000","last_change":"2023-03-03T06:26:06.452749+0000","last_active":"2023-03-03T06:26:29.974742+0000","last_peered":"2023-03-03T06:26:29.974742+0000","last_clean":"2023-03-03T06:26:29.974742+0000","last_became_active":"2023-03-03T06:26:06.452457+0000","last_became_peered":"2023-03-03T06:26:06.452457+0000","last_unstale":"2023-03-03T06:26:29.974742+0000","last_undegraded":"2023-03-03T06:26:29.974742+0000","last_fullsized":"2023-03-03T06:26:29.974742+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:25:06.801245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988820+0000","last_change":"2023-03-03T06:25:05.616017+0000","last_active":"2023-03-03T06:26:29.988820+0000","last_peered":"2023-03-03T06:26:29.988820+0000","last_clean":"2023-03-03T06:26:29.988820+0000","last_became_active":"2023-03-03T06:25:04.443176+0000","last_became_peered":"2023-03-03T06:25:04.443176+0000","last_unstale":"2023-03-03T06:26:29.988820+0000","last_undegraded":"2023-03-03T06:26:29.988820+0000","last_fullsized":"2023-03-03T06:26:29.988820+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:38:47.576162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034461600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.972534+0000","last_change":"2023-03-03T06:26:07.736472+0000","last_active":"2023-03-03T06:26:29.972534+0000","last_peered":"2023-03-03T06:26:29.972534+0000","last_clean":"2023-03-03T06:26:29.972534+0000","last_became_active":"2023-03-03T06:26:05.453291+0000","last_became_peered":"2023-03-03T06:26:05.453291+0000","last_unstale":"2023-03-03T06:26:29.972534+0000","last_undegraded":"2023-03-03T06:26:29.972534+0000","last_fullsized":"2023-03-03T06:26:29.972534+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:30:11.313163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050543599999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.977784+0000","last_change":"2023-03-03T06:26:29.987064+0000","last_active":"2023-03-03T06:26:30.977784+0000","last_peered":"2023-03-03T06:26:30.977784+0000","last_clean":"2023-03-03T06:26:30.977784+0000","last_became_active":"2023-03-03T06:26:29.986772+0000","last_became_peered":"2023-03-03T06:26:29.986772+0000","last_unstale":"2023-03-03T06:26:30.977784+0000","last_undegraded":"2023-03-03T06:26:30.977784+0000","last_fullsized":"2023-03-03T06:26:30.977784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:34:14.625823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"84'2","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.602097+0000","last_change":"2023-03-03T06:26:29.571199+0000","last_active":"2023-03-03T06:26:31.602097+0000","last_peered":"2023-03-03T06:26:31.602097+0000","last_clean":"2023-03-03T06:26:31.602097+0000","last_became_active":"2023-03-03T06:26:29.570908+0000","last_became_peered":"2023-03-03T06:26:29.570908+0000","last_unstale":"2023-03-03T06:26:31.602097+0000","last_undegraded":"2023-03-03T06:26:31.602097+0000","last_fullsized":"2023-03-03T06:26:31.602097+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:11:03.863707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977684+0000","last_change":"2023-03-03T06:26:06.443325+0000","last_active":"2023-03-03T06:26:29.977684+0000","last_peered":"2023-03-03T06:26:29.977684+0000","last_clean":"2023-03-03T06:26:29.977684+0000","last_became_active":"2023-03-03T06:26:06.442962+0000","last_became_peered":"2023-03-03T06:26:06.442962+0000","last_unstale":"2023-03-03T06:26:29.977684+0000","last_undegraded":"2023-03-03T06:26:29.977684+0000","last_fullsized":"2023-03-03T06:26:29.977684+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T17:24:03.091741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976064+0000","last_change":"2023-03-03T06:25:05.430594+0000","last_active":"2023-03-03T06:26:29.976064+0000","last_peered":"2023-03-03T06:26:29.976064+0000","last_clean":"2023-03-03T06:26:29.976064+0000","last_became_active":"2023-03-03T06:25:04.435012+0000","last_became_peered":"2023-03-03T06:25:04.435012+0000","last_unstale":"2023-03-03T06:26:29.976064+0000","last_undegraded":"2023-03-03T06:26:29.976064+0000","last_fullsized":"2023-03-03T06:26:29.976064+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:06:52.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052988999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.984863+0000","last_change":"2023-03-03T06:26:08.327756+0000","last_active":"2023-03-03T06:26:29.984863+0000","last_peered":"2023-03-03T06:26:29.984863+0000","last_clean":"2023-03-03T06:26:29.984863+0000","last_became_active":"2023-03-03T06:26:05.445673+0000","last_became_peered":"2023-03-03T06:26:05.445673+0000","last_unstale":"2023-03-03T06:26:29.984863+0000","last_undegraded":"2023-03-03T06:26:29.984863+0000","last_fullsized":"2023-03-03T06:26:29.984863+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:13:53.100665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034731200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604233+0000","last_change":"2023-03-03T06:26:29.997825+0000","last_active":"2023-03-03T06:26:31.604233+0000","last_peered":"2023-03-03T06:26:31.604233+0000","last_clean":"2023-03-03T06:26:31.604233+0000","last_became_active":"2023-03-03T06:26:29.997550+0000","last_became_peered":"2023-03-03T06:26:29.997550+0000","last_unstale":"2023-03-03T06:26:31.604233+0000","last_undegraded":"2023-03-03T06:26:31.604233+0000","last_fullsized":"2023-03-03T06:26:31.604233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:05:35.580392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.978083+0000","last_change":"2023-03-03T06:26:29.568857+0000","last_active":"2023-03-03T06:26:30.978083+0000","last_peered":"2023-03-03T06:26:30.978083+0000","last_clean":"2023-03-03T06:26:30.978083+0000","last_became_active":"2023-03-03T06:26:29.568626+0000","last_became_peered":"2023-03-03T06:26:29.568626+0000","last_unstale":"2023-03-03T06:26:30.978083+0000","last_undegraded":"2023-03-03T06:26:30.978083+0000","last_fullsized":"2023-03-03T06:26:30.978083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:07:39.572654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.979230+0000","last_change":"2023-03-03T06:26:06.447479+0000","last_active":"2023-03-03T06:26:29.979230+0000","last_peered":"2023-03-03T06:26:29.979230+0000","last_clean":"2023-03-03T06:26:29.979230+0000","last_became_active":"2023-03-03T06:26:06.447180+0000","last_became_peered":"2023-03-03T06:26:06.447180+0000","last_unstale":"2023-03-03T06:26:29.979230+0000","last_undegraded":"2023-03-03T06:26:29.979230+0000","last_fullsized":"2023-03-03T06:26:29.979230+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T12:31:38.218862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.989191+0000","last_change":"2023-03-03T06:25:05.615943+0000","last_active":"2023-03-03T06:26:29.989191+0000","last_peered":"2023-03-03T06:26:29.989191+0000","last_clean":"2023-03-03T06:26:29.989191+0000","last_became_active":"2023-03-03T06:25:04.443824+0000","last_became_peered":"2023-03-03T06:25:04.443824+0000","last_unstale":"2023-03-03T06:26:29.989191+0000","last_undegraded":"2023-03-03T06:26:29.989191+0000","last_fullsized":"2023-03-03T06:26:29.989191+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:22:11.723607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059238800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.983160+0000","last_change":"2023-03-03T06:26:08.327670+0000","last_active":"2023-03-03T06:26:29.983160+0000","last_peered":"2023-03-03T06:26:29.983160+0000","last_clean":"2023-03-03T06:26:29.983160+0000","last_became_active":"2023-03-03T06:26:05.457767+0000","last_became_peered":"2023-03-03T06:26:05.457767+0000","last_unstale":"2023-03-03T06:26:29.983160+0000","last_undegraded":"2023-03-03T06:26:29.983160+0000","last_fullsized":"2023-03-03T06:26:29.983160+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:48:18.572579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038899699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.350450+0000","last_change":"2023-03-03T06:26:29.993824+0000","last_active":"2023-03-03T06:26:31.350450+0000","last_peered":"2023-03-03T06:26:31.350450+0000","last_clean":"2023-03-03T06:26:31.350450+0000","last_became_active":"2023-03-03T06:26:29.993553+0000","last_became_peered":"2023-03-03T06:26:29.993553+0000","last_unstale":"2023-03-03T06:26:31.350450+0000","last_undegraded":"2023-03-03T06:26:31.350450+0000","last_fullsized":"2023-03-03T06:26:31.350450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:39:50.979298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"84'3","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.603866+0000","last_change":"2023-03-03T06:26:29.563874+0000","last_active":"2023-03-03T06:26:31.603866+0000","last_peered":"2023-03-03T06:26:31.603866+0000","last_clean":"2023-03-03T06:26:31.603866+0000","last_became_active":"2023-03-03T06:26:29.563679+0000","last_became_peered":"2023-03-03T06:26:29.563679+0000","last_unstale":"2023-03-03T06:26:31.603866+0000","last_undegraded":"2023-03-03T06:26:31.603866+0000","last_fullsized":"2023-03-03T06:26:31.603866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:05:35.389897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975911+0000","last_change":"2023-03-03T06:26:06.450830+0000","last_active":"2023-03-03T06:26:29.975911+0000","last_peered":"2023-03-03T06:26:29.975911+0000","last_clean":"2023-03-03T06:26:29.975911+0000","last_became_active":"2023-03-03T06:26:06.450543+0000","last_became_peered":"2023-03-03T06:26:06.450543+0000","last_unstale":"2023-03-03T06:26:29.975911+0000","last_undegraded":"2023-03-03T06:26:29.975911+0000","last_fullsized":"2023-03-03T06:26:29.975911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:56:19.213028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.986412+0000","last_change":"2023-03-03T06:25:05.796744+0000","last_active":"2023-03-03T06:26:29.986412+0000","last_peered":"2023-03-03T06:26:29.986412+0000","last_clean":"2023-03-03T06:26:29.986412+0000","last_became_active":"2023-03-03T06:25:04.444571+0000","last_became_peered":"2023-03-03T06:25:04.444571+0000","last_unstale":"2023-03-03T06:26:29.986412+0000","last_undegraded":"2023-03-03T06:26:29.986412+0000","last_fullsized":"2023-03-03T06:26:29.986412+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:46:48.500233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050328500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.977762+0000","last_change":"2023-03-03T06:26:07.438150+0000","last_active":"2023-03-03T06:26:29.977762+0000","last_peered":"2023-03-03T06:26:29.977762+0000","last_clean":"2023-03-03T06:26:29.977762+0000","last_became_active":"2023-03-03T06:26:05.457047+0000","last_became_peered":"2023-03-03T06:26:05.457047+0000","last_unstale":"2023-03-03T06:26:29.977762+0000","last_undegraded":"2023-03-03T06:26:29.977762+0000","last_fullsized":"2023-03-03T06:26:29.977762+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:55:24.083318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035894099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601822+0000","last_change":"2023-03-03T06:26:29.995009+0000","last_active":"2023-03-03T06:26:31.601822+0000","last_peered":"2023-03-03T06:26:31.601822+0000","last_clean":"2023-03-03T06:26:31.601822+0000","last_became_active":"2023-03-03T06:26:29.994406+0000","last_became_peered":"2023-03-03T06:26:29.994406+0000","last_unstale":"2023-03-03T06:26:31.601822+0000","last_undegraded":"2023-03-03T06:26:31.601822+0000","last_fullsized":"2023-03-03T06:26:31.601822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:43:53.138737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"84'6","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.604167+0000","last_change":"2023-03-03T06:26:29.570172+0000","last_active":"2023-03-03T06:26:31.604167+0000","last_peered":"2023-03-03T06:26:31.604167+0000","last_clean":"2023-03-03T06:26:31.604167+0000","last_became_active":"2023-03-03T06:26:29.569909+0000","last_became_peered":"2023-03-03T06:26:29.569909+0000","last_unstale":"2023-03-03T06:26:31.604167+0000","last_undegraded":"2023-03-03T06:26:31.604167+0000","last_fullsized":"2023-03-03T06:26:31.604167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:24:29.811063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.982980+0000","last_change":"2023-03-03T06:26:06.454242+0000","last_active":"2023-03-03T06:26:29.982980+0000","last_peered":"2023-03-03T06:26:29.982980+0000","last_clean":"2023-03-03T06:26:29.982980+0000","last_became_active":"2023-03-03T06:26:06.453973+0000","last_became_peered":"2023-03-03T06:26:06.453973+0000","last_unstale":"2023-03-03T06:26:29.982980+0000","last_undegraded":"2023-03-03T06:26:29.982980+0000","last_fullsized":"2023-03-03T06:26:29.982980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:04:10.018040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.984001+0000","last_change":"2023-03-03T06:25:05.431475+0000","last_active":"2023-03-03T06:26:29.984001+0000","last_peered":"2023-03-03T06:26:29.984001+0000","last_clean":"2023-03-03T06:26:29.984001+0000","last_became_active":"2023-03-03T06:25:04.596724+0000","last_became_peered":"2023-03-03T06:25:04.596724+0000","last_unstale":"2023-03-03T06:26:29.984001+0000","last_undegraded":"2023-03-03T06:26:29.984001+0000","last_fullsized":"2023-03-03T06:26:29.984001+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:24:11.828930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015785179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.985686+0000","last_change":"2023-03-03T06:26:07.443588+0000","last_active":"2023-03-03T06:26:29.985686+0000","last_peered":"2023-03-03T06:26:29.985686+0000","last_clean":"2023-03-03T06:26:29.985686+0000","last_became_active":"2023-03-03T06:26:05.450433+0000","last_became_peered":"2023-03-03T06:26:05.450433+0000","last_unstale":"2023-03-03T06:26:29.985686+0000","last_undegraded":"2023-03-03T06:26:29.985686+0000","last_fullsized":"2023-03-03T06:26:29.985686+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:43:27.368396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037040499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339055+0000","last_change":"2023-03-03T06:26:29.986645+0000","last_active":"2023-03-03T06:26:31.339055+0000","last_peered":"2023-03-03T06:26:31.339055+0000","last_clean":"2023-03-03T06:26:31.339055+0000","last_became_active":"2023-03-03T06:26:29.985829+0000","last_became_peered":"2023-03-03T06:26:29.985829+0000","last_unstale":"2023-03-03T06:26:31.339055+0000","last_undegraded":"2023-03-03T06:26:31.339055+0000","last_fullsized":"2023-03-03T06:26:31.339055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T13:40:54.496835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:30.979955+0000","last_change":"2023-03-03T06:26:29.559592+0000","last_active":"2023-03-03T06:26:30.979955+0000","last_peered":"2023-03-03T06:26:30.979955+0000","last_clean":"2023-03-03T06:26:30.979955+0000","last_became_active":"2023-03-03T06:26:29.559285+0000","last_became_peered":"2023-03-03T06:26:29.559285+0000","last_unstale":"2023-03-03T06:26:30.979955+0000","last_undegraded":"2023-03-03T06:26:30.979955+0000","last_fullsized":"2023-03-03T06:26:30.979955+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T07:27:54.295369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.983506+0000","last_change":"2023-03-03T06:26:06.457868+0000","last_active":"2023-03-03T06:26:29.983506+0000","last_peered":"2023-03-03T06:26:29.983506+0000","last_clean":"2023-03-03T06:26:29.983506+0000","last_became_active":"2023-03-03T06:26:06.457553+0000","last_became_peered":"2023-03-03T06:26:06.457553+0000","last_unstale":"2023-03-03T06:26:29.983506+0000","last_undegraded":"2023-03-03T06:26:29.983506+0000","last_fullsized":"2023-03-03T06:26:29.983506+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:10:34.072352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.982246+0000","last_change":"2023-03-03T06:25:05.615550+0000","last_active":"2023-03-03T06:26:29.982246+0000","last_peered":"2023-03-03T06:26:29.982246+0000","last_clean":"2023-03-03T06:26:29.982246+0000","last_became_active":"2023-03-03T06:25:04.445574+0000","last_became_peered":"2023-03-03T06:25:04.445574+0000","last_unstale":"2023-03-03T06:26:29.982246+0000","last_undegraded":"2023-03-03T06:26:29.982246+0000","last_fullsized":"2023-03-03T06:26:29.982246+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T15:15:06.370284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061229600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.975449+0000","last_change":"2023-03-03T06:26:07.442151+0000","last_active":"2023-03-03T06:26:29.975449+0000","last_peered":"2023-03-03T06:26:29.975449+0000","last_clean":"2023-03-03T06:26:29.975449+0000","last_became_active":"2023-03-03T06:26:05.452500+0000","last_became_peered":"2023-03-03T06:26:05.452500+0000","last_unstale":"2023-03-03T06:26:29.975449+0000","last_undegraded":"2023-03-03T06:26:29.975449+0000","last_fullsized":"2023-03-03T06:26:29.975449+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T11:04:02.946022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068804900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.601480+0000","last_change":"2023-03-03T06:26:29.994050+0000","last_active":"2023-03-03T06:26:31.601480+0000","last_peered":"2023-03-03T06:26:31.601480+0000","last_clean":"2023-03-03T06:26:31.601480+0000","last_became_active":"2023-03-03T06:26:29.993735+0000","last_became_peered":"2023-03-03T06:26:29.993735+0000","last_unstale":"2023-03-03T06:26:31.601480+0000","last_undegraded":"2023-03-03T06:26:31.601480+0000","last_fullsized":"2023-03-03T06:26:31.601480+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:29.542164+0000","last_clean_scrub_stamp":"2023-03-03T06:26:29.542164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T06:52:51.314233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-03-03T06:26:31.339739+0000","last_change":"2023-03-03T06:26:29.562511+0000","last_active":"2023-03-03T06:26:31.339739+0000","last_peered":"2023-03-03T06:26:31.339739+0000","last_clean":"2023-03-03T06:26:31.339739+0000","last_became_active":"2023-03-03T06:26:29.561255+0000","last_became_peered":"2023-03-03T06:26:29.561255+0000","last_unstale":"2023-03-03T06:26:31.339739+0000","last_undegraded":"2023-03-03T06:26:31.339739+0000","last_fullsized":"2023-03-03T06:26:31.339739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:28.540424+0000","last_clean_scrub_stamp":"2023-03-03T06:26:28.540424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T16:27:59.342691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.988870+0000","last_change":"2023-03-03T06:26:06.443276+0000","last_active":"2023-03-03T06:26:29.988870+0000","last_peered":"2023-03-03T06:26:29.988870+0000","last_clean":"2023-03-03T06:26:29.988870+0000","last_became_active":"2023-03-03T06:26:06.442958+0000","last_became_peered":"2023-03-03T06:26:06.442958+0000","last_unstale":"2023-03-03T06:26:29.988870+0000","last_undegraded":"2023-03-03T06:26:29.988870+0000","last_fullsized":"2023-03-03T06:26:29.988870+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:05.429327+0000","last_clean_scrub_stamp":"2023-03-03T06:26:05.429327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T09:09:04.949854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.976871+0000","last_change":"2023-03-03T06:25:05.635776+0000","last_active":"2023-03-03T06:26:29.976871+0000","last_peered":"2023-03-03T06:26:29.976871+0000","last_clean":"2023-03-03T06:26:29.976871+0000","last_became_active":"2023-03-03T06:25:04.444243+0000","last_became_peered":"2023-03-03T06:25:04.444243+0000","last_unstale":"2023-03-03T06:26:29.976871+0000","last_undegraded":"2023-03-03T06:26:29.976871+0000","last_fullsized":"2023-03-03T06:26:29.976871+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:25:03.412455+0000","last_clean_scrub_stamp":"2023-03-03T06:25:03.412455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T10:00:41.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066956899999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-03-03T06:26:29.974447+0000","last_change":"2023-03-03T06:26:07.736704+0000","last_active":"2023-03-03T06:26:29.974447+0000","last_peered":"2023-03-03T06:26:29.974447+0000","last_clean":"2023-03-03T06:26:29.974447+0000","last_became_active":"2023-03-03T06:26:05.450014+0000","last_became_peered":"2023-03-03T06:26:05.450014+0000","last_unstale":"2023-03-03T06:26:29.974447+0000","last_undegraded":"2023-03-03T06:26:29.974447+0000","last_fullsized":"2023-03-03T06:26:29.974447+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-03-03T06:26:04.424671+0000","last_clean_scrub_stamp":"2023-03-03T06:26:04.424671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-03-04T14:19:56.105815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040139800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11340,"kb_used_data":1604,"kb_used_omap":0,"kb_used_meta":9728,"kb_avail":94360500,"statfs":{"total":96636764160,"available":96625152000,"internally_reserved":0,"allocated":1642496,"data_stored":1118783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9961472},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.503},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71099999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.44800000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.504,"15min":0.502},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.64900000000000002,"5min":0.745,"15min":0.745},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70399999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56299999999999994,"15min":0.56499999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68200000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.379},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72799999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63400000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56899999999999995,"15min":0.57299999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70699999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.439}]},{"osd":5,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70899999999999996,"5min":0.746,"15min":0.746},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.749,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71299999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.85399999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.53800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10260,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361580,"statfs":{"total":96636764160,"available":96626257920,"internally_reserved":0,"allocated":1060864,"data_stored":530391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76700000000000002,"5min":2.278,"15min":2.278},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":3.109,"5min":3.109,"15min":3.109},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.70999999999999996,"5min":0.751,"15min":0.751},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.629},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58399999999999996}]},{"osd":4,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.74399999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.71199999999999997}]},{"osd":5,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71799999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.623,"15min":0.625},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83299999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.69899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11400,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":9792,"kb_avail":94360440,"statfs":{"total":96636764160,"available":96625090560,"internally_reserved":0,"allocated":1638400,"data_stored":1118657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":10027008},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35199999999999998,"15min":0.35299999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52000000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.378},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.34799999999999998,"15min":0.34499999999999997},"min":{"1min":0.28199999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.47299999999999998,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.314,"15min":0.312},"min":{"1min":0.25600000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.372,"15min":0.37},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.27100000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48799999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.314},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.372,"15min":0.375},"min":{"1min":0.23999999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.502,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.45700000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80800000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.623},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47299999999999998}]},{"osd":6,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.443,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.503,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.82299999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10380,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":9344,"kb_avail":94361460,"statfs":{"total":96636764160,"available":96626135040,"internally_reserved":0,"allocated":1052672,"data_stored":528932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9568256},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.41199999999999998,"15min":0.42799999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.50700000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.45100000000000001,"15min":0.46899999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52000000000000002,"5min":1.827,"15min":1.827},"last":0.252}]},{"osd":2,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.41999999999999998,"15min":0.432},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65600000000000003,"5min":1.722,"15min":1.722},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.44700000000000001,"15min":0.46100000000000002},"min":{"1min":0.27400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61799999999999999,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.47499999999999998,"15min":0.49199999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.58799999999999997,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.46000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.1870000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.37}]},{"osd":4,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.63400000000000001,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73699999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.434,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84699999999999998,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.45700000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92000000000000004,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.66100000000000003,"15min":0.67300000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86799999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.64700000000000002,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82199999999999995,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.67600000000000005,"15min":0.68999999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81100000000000005,"5min":1.835,"15min":1.835},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Mar 3 06:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.66400000000000003,"15min":0.67600000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88400000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.746,"5min":1.732,"15min":1.732},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10052,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":9024,"kb_avail":94361788,"statfs":{"total":96636764160,"available":96626470912,"internally_reserved":0,"allocated":1044480,"data_stored":528289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9240576},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.33900000000000002,"15min":0.33100000000000002},"min":{"1min":0.23899999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.26600000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51700000000000002,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.70599999999999996,"15min":0.75},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.238,"5min":7.4820000000000002,"15min":7.4820000000000002},"last":0.372}]},{"osd":3,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.52100000000000002,"15min":0.46400000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":8.6039999999999992,"5min":8.6039999999999992,"15min":8.6039999999999992},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.76300000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1240000000000001,"5min":1.224,"15min":1.224},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.69699999999999995},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4359999999999999,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.46600000000000003}]},{"osd":5,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1479999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73399999999999999,"15min":0.72999999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.597,"5min":1.968,"15min":1.968},"last":0.50800000000000001}]},{"osd":6,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.72699999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2430000000000001,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.439},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.67600000000000005,"15min":0.66600000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Mar 3 06:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.78000000000000003,"15min":0.79500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1910000000000001,"5min":4.1390000000000002,"15min":4.1390000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.198,"5min":1.387,"15min":1.387},"last":0.54500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10308,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":9280,"kb_avail":94361532,"statfs":{"total":96636764160,"available":96626208768,"internally_reserved":0,"allocated":1044480,"data_stored":528821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9502720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.38400000000000001,"15min":0.39400000000000002},"min":{"1min":0.24099999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.502,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52300000000000002,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.373}]},{"osd":1,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.37,"15min":0.379},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.47799999999999998,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.314},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.43099999999999999,"15min":0.436},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.624,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.32700000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.64700000000000002,"5min":1.3,"15min":1.3},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.441,"15min":0.44900000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66500000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.434}]},{"osd":4,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.44600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90500000000000003,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.497},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.48699999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.624,"15min":0.628},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0029999999999999,"5min":1.383,"15min":1.383},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60399999999999998,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.66100000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95999999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":5.2640000000000002,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Mar 3 06:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":1.587,"15min":1.587},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.69699999999999995,"15min":0.67500000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":5.2510000000000003,"5min":5.2510000000000003,"15min":5.2510000000000003},"last":0.70699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10568,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":9536,"kb_avail":94361272,"statfs":{"total":96636764160,"available":96625942528,"internally_reserved":0,"allocated":1048576,"data_stored":528347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9764864},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75800000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.349,"5min":0.67800000000000005,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":14.449999999999999,"5min":14.449999999999999,"15min":14.449999999999999},"last":0.64100000000000001}]},{"osd":1,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":0.64700000000000002,"15min":0.56699999999999995},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.686,"5min":10.686,"15min":10.686},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.53600000000000003,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":3.9060000000000001,"5min":3.9060000000000001,"15min":3.9060000000000001},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.42499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.65800000000000003,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.61799999999999999,"15min":0.58299999999999996},"min":{"1min":0.48199999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":4.6379999999999999,"5min":4.6379999999999999,"15min":4.6379999999999999},"last":0.57099999999999995}]},{"osd":3,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.44800000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.65900000000000003,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.7389999999999999,"5min":6.7389999999999999,"15min":6.7389999999999999},"last":0.75800000000000001}]},{"osd":5,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.57599999999999996,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":4.5910000000000002,"5min":4.5910000000000002,"15min":4.5910000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38600000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.43099999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.432},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.64900000000000002,"15min":0.627},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":4.6749999999999998,"5min":4.6749999999999998,"15min":4.6749999999999998},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Mar 3 06:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.66700000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64100000000000001,"15min":0.64200000000000002},"min":{"1min":0.49299999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10236,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":9216,"kb_avail":94361604,"statfs":{"total":96636764160,"available":96626282496,"internally_reserved":0,"allocated":1036288,"data_stored":527294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9437184},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.49299999999999999},"min":{"1min":0.34699999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69199999999999995,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.432},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.315,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53100000000000003}]},{"osd":1,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52200000000000002,"15min":0.51900000000000002},"min":{"1min":0.38800000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.5},{"interface":"front","average":{"1min":0.495,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53700000000000003,"15min":0.54000000000000004},"min":{"1min":0.36599999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54300000000000004}]},{"osd":3,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.42399999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.67100000000000004,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.76000000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.78500000000000003,"5min":0.88,"15min":0.88},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67500000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82599999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Mar 3 06:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.72799999999999998,"5min":0.747,"15min":0.747},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.64300000000000002,"15min":0.65100000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80300000000000005,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.61699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-03-03T06:26:34.515 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-03-03T06:26:34.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-03-03T06:26:34.540 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-03-03T06:26:34.538+0000 7fbb0f217700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-03T06:26:34.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.670+0000 7f83ef1ab700 1 Processor -- start 2023-03-03T06:26:34.672 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.670+0000 7f83ef1ab700 1 -- start start 2023-03-03T06:26:34.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.670+0000 7f83ef1ab700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83e8143040 0x7f83e80b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:34.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.670+0000 7f83ef1ab700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e80b1cf0 0x7f83e815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:34.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.670+0000 7f83ef1ab700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f83e815d900 0x7f83e80cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:34.674 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.670+0000 7f83ef1ab700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e806c710 con 0x7f83e8143040 2023-03-03T06:26:34.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.670+0000 7f83ef1ab700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e80b2160 con 0x7f83e815d900 2023-03-03T06:26:34.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.670+0000 7f83ef1ab700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e815e0f0 con 0x7f83e80b1cf0 2023-03-03T06:26:34.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83ecf47700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83e8143040 0x7f83e80b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:34.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83ecf47700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f83e8143040 0x7f83e80b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46582/0 (socket says 172.21.15.5:46582) 2023-03-03T06:26:34.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83ecf47700 1 -- 172.21.15.5:0/3913541082 learned_addr learned my addr 172.21.15.5:0/3913541082 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:34.675 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83e7fff700 1 --2- 172.21.15.5:0/3913541082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e80b1cf0 0x7f83e815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83ed748700 1 --2- 172.21.15.5:0/3913541082 >> v2:172.21.15.191:3300/0 conn(0x7f83e815d900 0x7f83e80cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83ecf47700 1 -- 172.21.15.5:0/3913541082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e80b1cf0 msgr2=0x7f83e815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83ecf47700 1 --2- 172.21.15.5:0/3913541082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e80b1cf0 0x7f83e815d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83ecf47700 1 -- 172.21.15.5:0/3913541082 >> v2:172.21.15.191:3300/0 conn(0x7f83e815d900 msgr2=0x7f83e80cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83ecf47700 1 --2- 172.21.15.5:0/3913541082 >> v2:172.21.15.191:3300/0 conn(0x7f83e815d900 0x7f83e80cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83ecf47700 1 -- 172.21.15.5:0/3913541082 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e806bd70 con 0x7f83e8143040 2023-03-03T06:26:34.676 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83ecf47700 1 --2- 172.21.15.5:0/3913541082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e8143040 0x7f83e80b17b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f83e8071330 tx=0x7f83dc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0afa7a9d594e582 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:34.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83e77fe700 1 -- 172.21.15.5:0/3913541082 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00dcf0 con 0x7f83e8143040 2023-03-03T06:26:34.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83e77fe700 1 -- 172.21.15.5:0/3913541082 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc00de50 con 0x7f83e8143040 2023-03-03T06:26:34.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.671+0000 7f83e77fe700 1 -- 172.21.15.5:0/3913541082 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc010690 con 0x7f83e8143040 2023-03-03T06:26:34.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.672+0000 7f83ef1ab700 1 -- 172.21.15.5:0/3913541082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e8143040 msgr2=0x7f83e80b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:34.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.672+0000 7f83ef1ab700 1 --2- 172.21.15.5:0/3913541082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e8143040 0x7f83e80b17b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f83e8071330 tx=0x7f83dc00bea0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.672+0000 7f83ef1ab700 1 -- 172.21.15.5:0/3913541082 shutdown_connections 2023-03-03T06:26:34.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.672+0000 7f83ef1ab700 1 --2- 172.21.15.5:0/3913541082 >> v2:172.21.15.191:3300/0 conn(0x7f83e815d900 0x7f83e80cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.677 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.672+0000 7f83ef1ab700 1 --2- 172.21.15.5:0/3913541082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e8143040 0x7f83e80b17b0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.672+0000 7f83ef1ab700 1 --2- 172.21.15.5:0/3913541082 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e80b1cf0 0x7f83e815d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.672+0000 7f83ef1ab700 1 -- 172.21.15.5:0/3913541082 >> 172.21.15.5:0/3913541082 conn(0x7f83e80d09c0 msgr2=0x7f83e80cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:34.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.672+0000 7f83ef1ab700 1 -- 172.21.15.5:0/3913541082 shutdown_connections 2023-03-03T06:26:34.678 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.672+0000 7f83ef1ab700 1 -- 172.21.15.5:0/3913541082 wait complete. 2023-03-03T06:26:34.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.673+0000 7f83ef1ab700 1 Processor -- start 2023-03-03T06:26:34.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.673+0000 7f83ef1ab700 1 -- start start 2023-03-03T06:26:34.680 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83ef1ab700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e80b1cf0 0x7f83e81f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:34.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83ef1ab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e8143040 0x7f83e8159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:34.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83ef1ab700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83e815d900 0x7f83e80aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:34.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83ef1ab700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e815b570 con 0x7f83e8143040 2023-03-03T06:26:34.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83ef1ab700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e815a4d0 con 0x7f83e815d900 2023-03-03T06:26:34.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83ef1ab700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e815a7b0 con 0x7f83e80b1cf0 2023-03-03T06:26:34.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83e7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e8143040 0x7f83e8159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:34.681 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83e7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e8143040 0x7f83e8159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46590/0 (socket says 172.21.15.5:46590) 2023-03-03T06:26:34.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83e7fff700 1 -- 172.21.15.5:0/1342397750 learned_addr learned my addr 172.21.15.5:0/1342397750 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:34.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83ed748700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83e815d900 0x7f83e80aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:34.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83ecf47700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e80b1cf0 0x7f83e81f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:34.682 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83e7fff700 1 -- 172.21.15.5:0/1342397750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e80b1cf0 msgr2=0x7f83e81f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:34.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83e7fff700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e80b1cf0 0x7f83e81f5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83e7fff700 1 -- 172.21.15.5:0/1342397750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83e815d900 msgr2=0x7f83e80aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:34.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83e7fff700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83e815d900 0x7f83e80aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83e7fff700 1 -- 172.21.15.5:0/1342397750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc00b7f0 con 0x7f83e8143040 2023-03-03T06:26:34.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.674+0000 7f83ecf47700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e80b1cf0 0x7f83e81f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:34.684 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.675+0000 7f83e7fff700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e8143040 0x7f83e8159a50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f83d400e870 tx=0x7f83d400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:34.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.675+0000 7f83e57fa700 1 -- 172.21.15.5:0/1342397750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4013680 con 0x7f83e8143040 2023-03-03T06:26:34.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.675+0000 7f83e57fa700 1 -- 172.21.15.5:0/1342397750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d40137e0 con 0x7f83e8143040 2023-03-03T06:26:34.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.675+0000 7f83ef1ab700 1 -- 172.21.15.5:0/1342397750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e806c330 con 0x7f83e8143040 2023-03-03T06:26:34.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.675+0000 7f83e57fa700 1 -- 172.21.15.5:0/1342397750 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4013b90 con 0x7f83e8143040 2023-03-03T06:26:34.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.675+0000 7f83ef1ab700 1 -- 172.21.15.5:0/1342397750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e806c050 con 0x7f83e8143040 2023-03-03T06:26:34.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.676+0000 7f83ef1ab700 1 -- 172.21.15.5:0/1342397750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e815dd40 con 0x7f83e8143040 2023-03-03T06:26:34.685 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.677+0000 7f83e57fa700 1 -- 172.21.15.5:0/1342397750 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f83d4019030 con 0x7f83e8143040 2023-03-03T06:26:34.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.677+0000 7f83e57fa700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83cc0682f0 0x7f83cc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:34.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.677+0000 7f83ecf47700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83cc0682f0 0x7f83cc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:34.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.677+0000 7f83e57fa700 1 -- 172.21.15.5:0/1342397750 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7445+0+0 (secure 0 0 0) 0x7f83d4085ed0 con 0x7f83e8143040 2023-03-03T06:26:34.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.678+0000 7f83ecf47700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83cc0682f0 0x7f83cc06a7a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00bee0 tx=0x7f83dc013000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:34.686 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.681+0000 7f83e57fa700 1 -- 172.21.15.5:0/1342397750 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f83d40521c0 con 0x7f83e8143040 2023-03-03T06:26:34.953 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.952+0000 7f83ef1ab700 1 -- 172.21.15.5:0/1342397750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f83e80b3ce0 con 0x7f83e8143040 2023-03-03T06:26:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.955+0000 7f83e57fa700 1 -- 172.21.15.5:0/1342397750 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7f83d40557e0 con 0x7f83e8143040 2023-03-03T06:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.957+0000 7f83ef1ab700 1 -- 172.21.15.5:0/1342397750 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83cc0682f0 msgr2=0x7f83cc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.957+0000 7f83ef1ab700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83cc0682f0 0x7f83cc06a7a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00bee0 tx=0x7f83dc013000 comp rx=0 tx=0).stop 2023-03-03T06:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.957+0000 7f83ef1ab700 1 -- 172.21.15.5:0/1342397750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e8143040 msgr2=0x7f83e8159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.957+0000 7f83ef1ab700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e8143040 0x7f83e8159a50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f83d400e870 tx=0x7f83d400eb80 comp rx=0 tx=0).stop 2023-03-03T06:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.957+0000 7f83ef1ab700 1 -- 172.21.15.5:0/1342397750 shutdown_connections 2023-03-03T06:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.957+0000 7f83ef1ab700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83e815d900 0x7f83e80aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.957+0000 7f83ef1ab700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f83cc0682f0 0x7f83cc06a7a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.957+0000 7f83ef1ab700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f83e80b1cf0 0x7f83e81f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.957+0000 7f83ef1ab700 1 --2- 172.21.15.5:0/1342397750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83e8143040 0x7f83e8159a50 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:34.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.957+0000 7f83ef1ab700 1 -- 172.21.15.5:0/1342397750 >> 172.21.15.5:0/1342397750 conn(0x7f83e80d09c0 msgr2=0x7f83e80cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:34.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.957+0000 7f83ef1ab700 1 -- 172.21.15.5:0/1342397750 shutdown_connections 2023-03-03T06:26:34.961 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:34.957+0000 7f83ef1ab700 1 -- 172.21.15.5:0/1342397750 wait complete. 2023-03-03T06:26:34.961 INFO:teuthology.orchestra.run.smithi005.stderr:updated caps for client.0 2023-03-03T06:26:34.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-03-03T06:26:35.096 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.094+0000 7f6cf3c88700 1 Processor -- start 2023-03-03T06:26:35.097 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.094+0000 7f6cf3c88700 1 -- start start 2023-03-03T06:26:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.095+0000 7f6cf3c88700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0af450 0x7f6cec0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.098 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.095+0000 7f6cf3c88700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6cec0b1f80 0x7f6cec0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.095+0000 7f6cf3c88700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cec06b590 con 0x7f6cec0af080 2023-03-03T06:26:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.095+0000 7f6cf3c88700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cec06b870 con 0x7f6cec0b1f80 2023-03-03T06:26:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.095+0000 7f6cf3c88700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec06bb50 con 0x7f6cec0af450 2023-03-03T06:26:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.095+0000 7f6cf2225700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6cec0b1f80 0x7f6cec0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.095+0000 7f6cf2225700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6cec0b1f80 0x7f6cec0cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46600/0 (socket says 172.21.15.5:46600) 2023-03-03T06:26:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.095+0000 7f6cf2225700 1 -- 172.21.15.5:0/252057641 learned_addr learned my addr 172.21.15.5:0/252057641 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:35.099 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.095+0000 7f6cf1223700 1 --2- 172.21.15.5:0/252057641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0af450 0x7f6cec0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.095+0000 7f6cf2225700 1 -- 172.21.15.5:0/252057641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0af450 msgr2=0x7f6cec0cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.095+0000 7f6cf2225700 1 --2- 172.21.15.5:0/252057641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0af450 0x7f6cec0cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.095+0000 7f6cf2225700 1 -- 172.21.15.5:0/252057641 >> v1:172.21.15.191:6789/0 conn(0x7f6cec0af080 legacy=0x7f6cec0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.096+0000 7f6cf2225700 1 -- 172.21.15.5:0/252057641 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec06be30 con 0x7f6cec0b1f80 2023-03-03T06:26:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.096+0000 7f6cf2225700 1 --2- 172.21.15.5:0/252057641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cec0b1f80 0x7f6cec0cd9c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009e50 tx=0x7f6ce400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd454ae46b72cc9 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.096+0000 7f6cf0a22700 1 -- 172.21.15.5:0/252057641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce400e070 con 0x7f6cec0b1f80 2023-03-03T06:26:35.100 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.096+0000 7f6cf0a22700 1 -- 172.21.15.5:0/252057641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce400b9c0 con 0x7f6cec0b1f80 2023-03-03T06:26:35.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.096+0000 7f6cf0a22700 1 -- 172.21.15.5:0/252057641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce400bd70 con 0x7f6cec0b1f80 2023-03-03T06:26:35.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.096+0000 7f6cf3c88700 1 -- 172.21.15.5:0/252057641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cec0b1f80 msgr2=0x7f6cec0cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.096+0000 7f6cf3c88700 1 --2- 172.21.15.5:0/252057641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cec0b1f80 0x7f6cec0cd9c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009e50 tx=0x7f6ce400b330 comp rx=0 tx=0).stop 2023-03-03T06:26:35.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.096+0000 7f6cf3c88700 1 -- 172.21.15.5:0/252057641 shutdown_connections 2023-03-03T06:26:35.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.096+0000 7f6cf3c88700 1 --2- 172.21.15.5:0/252057641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cec0b1f80 0x7f6cec0cd9c0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.096+0000 7f6cf3c88700 1 --2- 172.21.15.5:0/252057641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0af450 0x7f6cec0cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.096+0000 7f6cf3c88700 1 -- 172.21.15.5:0/252057641 >> 172.21.15.5:0/252057641 conn(0x7f6cec06ea70 msgr2=0x7f6cec0cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:35.101 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.097+0000 7f6cf3c88700 1 -- 172.21.15.5:0/252057641 shutdown_connections 2023-03-03T06:26:35.102 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.097+0000 7f6cf3c88700 1 -- 172.21.15.5:0/252057641 wait complete. 2023-03-03T06:26:35.103 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.098+0000 7f6cf3c88700 1 Processor -- start 2023-03-03T06:26:35.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.098+0000 7f6cf3c88700 1 -- start start 2023-03-03T06:26:35.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.098+0000 7f6cf3c88700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cec0af080 0x7f6cec0c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.098+0000 7f6cf3c88700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0af450 0x7f6cec155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.098+0000 7f6cf3c88700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0b1f80 0x7f6cec0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.098+0000 7f6cf3c88700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec1f25f0 con 0x7f6cec0af080 2023-03-03T06:26:35.104 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.098+0000 7f6cf3c88700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec0b58a0 con 0x7f6cec0b1f80 2023-03-03T06:26:35.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.098+0000 7f6cf3c88700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec1f28b0 con 0x7f6cec0af450 2023-03-03T06:26:35.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf1a24700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cec0af080 0x7f6cec0c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf1a24700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cec0af080 0x7f6cec0c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46602/0 (socket says 172.21.15.5:46602) 2023-03-03T06:26:35.105 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf1a24700 1 -- 172.21.15.5:0/513414214 learned_addr learned my addr 172.21.15.5:0/513414214 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:35.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf2225700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0b1f80 0x7f6cec0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf1223700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0af450 0x7f6cec155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf1a24700 1 -- 172.21.15.5:0/513414214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0af450 msgr2=0x7f6cec155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf1a24700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0af450 0x7f6cec155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf1a24700 1 -- 172.21.15.5:0/513414214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0b1f80 msgr2=0x7f6cec0b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.106 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf1a24700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0b1f80 0x7f6cec0b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf1a24700 1 -- 172.21.15.5:0/513414214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce4009b30 con 0x7f6cec0af080 2023-03-03T06:26:35.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf1223700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0af450 0x7f6cec155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:35.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf1a24700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cec0af080 0x7f6cec0c5a10 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00c4e0 tx=0x7f6cdc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:35.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6ce27fc700 1 -- 172.21.15.5:0/513414214 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc0052d0 con 0x7f6cec0af080 2023-03-03T06:26:35.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6ce27fc700 1 -- 172.21.15.5:0/513414214 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc005430 con 0x7f6cec0af080 2023-03-03T06:26:35.107 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf3c88700 1 -- 172.21.15.5:0/513414214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cec06d370 con 0x7f6cec0af080 2023-03-03T06:26:35.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6ce27fc700 1 -- 172.21.15.5:0/513414214 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc0038c0 con 0x7f6cec0af080 2023-03-03T06:26:35.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.099+0000 7f6cf3c88700 1 -- 172.21.15.5:0/513414214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cec06c110 con 0x7f6cec0af080 2023-03-03T06:26:35.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.100+0000 7f6cf3c88700 1 -- 172.21.15.5:0/513414214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cec06cb70 con 0x7f6cec0af080 2023-03-03T06:26:35.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.101+0000 7f6ce27fc700 1 -- 172.21.15.5:0/513414214 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6cdc019030 con 0x7f6cec0af080 2023-03-03T06:26:35.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.101+0000 7f6ce27fc700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6cd00682f0 0x7f6cd006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.101+0000 7f6cf1223700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6cd00682f0 0x7f6cd006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.108 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.101+0000 7f6ce27fc700 1 -- 172.21.15.5:0/513414214 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7445+0+0 (secure 0 0 0) 0x7f6cdc085530 con 0x7f6cec0af080 2023-03-03T06:26:35.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.102+0000 7f6cf1223700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6cd00682f0 0x7f6cd006a7a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6cec071860 tx=0x7f6ce8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:35.109 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.106+0000 7f6ce27fc700 1 -- 172.21.15.5:0/513414214 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6cdc051820 con 0x7f6cec0af080 2023-03-03T06:26:35.344 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.342+0000 7f6cf3c88700 1 -- 172.21.15.5:0/513414214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cec04e6e0 con 0x7f6cec0af080 2023-03-03T06:26:35.345 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.343+0000 7f6ce27fc700 1 -- 172.21.15.5:0/513414214 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4647 (secure 0 0 0) 0x7f6cdc054e40 con 0x7f6cec0af080 2023-03-03T06:26:35.345 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-03-03T06:26:35.345 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/4062636088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":4062636088},{"type":"v1","addr":"172.21.15.191:6835","nonce":4062636088}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6836/2778601100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6835","nonce":2778601100},{"type":"v1","addr":"172.21.15.5:6836","nonce":2778601100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/441439845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":441439845},{"type":"v1","addr":"172.21.15.191:6834","nonce":441439845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-03-03T06:26:29.968069+0000","modified":"2023-03-03T06:26:32.976138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6636},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6636":{"gid":6636,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.5:6837/2017156082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2017156082},{"type":"v1","addr":"172.21.15.5:6837","nonce":2017156082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-03-03T06:26:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.344+0000 7f6cf3c88700 1 -- 172.21.15.5:0/513414214 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6cd00682f0 msgr2=0x7f6cd006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.344+0000 7f6cf3c88700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6cd00682f0 0x7f6cd006a7a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6cec071860 tx=0x7f6ce8008040 comp rx=0 tx=0).stop 2023-03-03T06:26:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.344+0000 7f6cf3c88700 1 -- 172.21.15.5:0/513414214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cec0af080 msgr2=0x7f6cec0c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.344+0000 7f6cf3c88700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cec0af080 0x7f6cec0c5a10 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00c4e0 tx=0x7f6cdc00c7f0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.347 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.344+0000 7f6cf3c88700 1 -- 172.21.15.5:0/513414214 shutdown_connections 2023-03-03T06:26:35.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.344+0000 7f6cf3c88700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cec0b1f80 0x7f6cec0b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.344+0000 7f6cf3c88700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cec0af080 0x7f6cec0c5a10 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.344+0000 7f6cf3c88700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f6cd00682f0 0x7f6cd006a7a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.344+0000 7f6cf3c88700 1 --2- 172.21.15.5:0/513414214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6cec0af450 0x7f6cec155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.348 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.344+0000 7f6cf3c88700 1 -- 172.21.15.5:0/513414214 >> 172.21.15.5:0/513414214 conn(0x7f6cec06ea70 msgr2=0x7f6cec0cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:35.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.345+0000 7f6cf3c88700 1 -- 172.21.15.5:0/513414214 shutdown_connections 2023-03-03T06:26:35.349 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.345+0000 7f6cf3c88700 1 -- 172.21.15.5:0/513414214 wait complete. 2023-03-03T06:26:35.349 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 40 2023-03-03T06:26:35.761 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-03-03T06:26:29.968069+0000', 'modified': '2023-03-03T06:26:32.976138+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6636}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6636': {'gid': 6636, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.5:6837/2017156082', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6834', 'nonce': 2017156082}, {'type': 'v1', 'addr': '172.21.15.5:6837', 'nonce': 2017156082}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-03-03T06:26:35.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-03-03T06:26:35.762 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-03-03T06:26:35.894 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.892+0000 7f2ef013b700 1 Processor -- start 2023-03-03T06:26:35.895 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.892+0000 7f2ef013b700 1 -- start start 2023-03-03T06:26:35.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.893+0000 7f2ef013b700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2ee80cb710 0x7f2ee80cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.896 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.893+0000 7f2ef013b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ee80b43b0 0x7f2ee815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.893+0000 7f2ef013b700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee815f2a0 con 0x7f2ee80cff20 2023-03-03T06:26:35.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.893+0000 7f2ef013b700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee80cd820 con 0x7f2ee80cb710 2023-03-03T06:26:35.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.893+0000 7f2ef013b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80cf550 con 0x7f2ee80b43b0 2023-03-03T06:26:35.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eeded7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2ee80cb710 0x7f2ee80cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eee6d8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ee80b43b0 0x7f2ee815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eed6d6700 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f2ee80cff20 0x7f2ee80b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.5:50982/0 (socket says 172.21.15.5:50982) 2023-03-03T06:26:35.897 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eeded7700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2ee80cb710 0x7f2ee80cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.5:46970/0 (socket says 172.21.15.5:46970) 2023-03-03T06:26:35.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eed6d6700 1 -- 172.21.15.5:0/2191725010 learned_addr learned my addr 172.21.15.5:0/2191725010 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:35.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eee6d8700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ee80b43b0 0x7f2ee815e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.5:44692/0 (socket says 172.21.15.5:44692) 2023-03-03T06:26:35.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eeced5700 1 -- 172.21.15.5:0/2191725010 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722283430 0 0) 0x7f2ee815f2a0 con 0x7f2ee80cff20 2023-03-03T06:26:35.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eeced5700 1 -- 172.21.15.5:0/2191725010 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ed40035b0 con 0x7f2ee80cff20 2023-03-03T06:26:35.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eeded7700 1 -- 172.21.15.5:0/2191725010 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ee80b43b0 msgr2=0x7f2ee815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:35.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eeded7700 1 --2- 172.21.15.5:0/2191725010 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ee80b43b0 0x7f2ee815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eeded7700 1 -- 172.21.15.5:0/2191725010 >> v1:172.21.15.191:6789/0 conn(0x7f2ee80cff20 legacy=0x7f2ee80b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.898 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eeded7700 1 -- 172.21.15.5:0/2191725010 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee815efc0 con 0x7f2ee80cb710 2023-03-03T06:26:35.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eee6d8700 1 --2- 172.21.15.5:0/2191725010 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ee80b43b0 0x7f2ee815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-03-03T06:26:35.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.894+0000 7f2eeded7700 1 --2- 172.21.15.5:0/2191725010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ee80cb710 0x7f2ee80cf9e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009840 tx=0x7f2ed8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd37745eb299b0b server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:35.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.895+0000 7f2eeced5700 1 -- 172.21.15.5:0/2191725010 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8011830 con 0x7f2ee80cb710 2023-03-03T06:26:35.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.895+0000 7f2eeced5700 1 -- 172.21.15.5:0/2191725010 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed8011990 con 0x7f2ee80cb710 2023-03-03T06:26:35.899 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.895+0000 7f2eeced5700 1 -- 172.21.15.5:0/2191725010 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8011d00 con 0x7f2ee80cb710 2023-03-03T06:26:35.901 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.895+0000 7f2ef013b700 1 -- 172.21.15.5:0/2191725010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ee80cb710 msgr2=0x7f2ee80cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.895+0000 7f2ef013b700 1 --2- 172.21.15.5:0/2191725010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ee80cb710 0x7f2ee80cf9e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009840 tx=0x7f2ed8009b50 comp rx=0 tx=0).stop 2023-03-03T06:26:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.895+0000 7f2ef013b700 1 -- 172.21.15.5:0/2191725010 shutdown_connections 2023-03-03T06:26:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.895+0000 7f2ef013b700 1 --2- 172.21.15.5:0/2191725010 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ee80b43b0 0x7f2ee815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.895+0000 7f2ef013b700 1 --2- 172.21.15.5:0/2191725010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ee80cb710 0x7f2ee80cf9e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.895+0000 7f2ef013b700 1 -- 172.21.15.5:0/2191725010 >> 172.21.15.5:0/2191725010 conn(0x7f2ee8070050 msgr2=0x7f2ee8070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.895+0000 7f2ef013b700 1 -- 172.21.15.5:0/2191725010 shutdown_connections 2023-03-03T06:26:35.902 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.895+0000 7f2ef013b700 1 -- 172.21.15.5:0/2191725010 wait complete. 2023-03-03T06:26:35.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.896+0000 7f2ef013b700 1 Processor -- start 2023-03-03T06:26:35.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.896+0000 7f2ef013b700 1 -- start start 2023-03-03T06:26:35.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.897+0000 7f2ef013b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee80b43b0 0x7f2ee80c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.897+0000 7f2ef013b700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ee80cb710 0x7f2ee80c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.897+0000 7f2ef013b700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ee80cff20 0x7f2ee8150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.897+0000 7f2ef013b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80cab30 con 0x7f2ee80b43b0 2023-03-03T06:26:35.903 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.897+0000 7f2ef013b700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80cae10 con 0x7f2ee80cb710 2023-03-03T06:26:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.897+0000 7f2ef013b700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80c8750 con 0x7f2ee80cff20 2023-03-03T06:26:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.897+0000 7f2eeded7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee80b43b0 0x7f2ee80c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.897+0000 7f2eeded7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee80b43b0 0x7f2ee80c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46616/0 (socket says 172.21.15.5:46616) 2023-03-03T06:26:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.897+0000 7f2eeded7700 1 -- 172.21.15.5:0/1692022133 learned_addr learned my addr 172.21.15.5:0/1692022133 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.897+0000 7f2eee6d8700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ee80cff20 0x7f2ee8150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.897+0000 7f2eed6d6700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ee80cb710 0x7f2ee80c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.898+0000 7f2eeded7700 1 -- 172.21.15.5:0/1692022133 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ee80cff20 msgr2=0x7f2ee8150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.904 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.898+0000 7f2eeded7700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ee80cff20 0x7f2ee8150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.898+0000 7f2eeded7700 1 -- 172.21.15.5:0/1692022133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ee80cb710 msgr2=0x7f2ee80c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.898+0000 7f2eeded7700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ee80cb710 0x7f2ee80c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.898+0000 7f2eeded7700 1 -- 172.21.15.5:0/1692022133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee0009a70 con 0x7f2ee80b43b0 2023-03-03T06:26:35.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.898+0000 7f2eeded7700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee80b43b0 0x7f2ee80c9230 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80090b0 tx=0x7f2ed8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:35.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.898+0000 7f2ede7fc700 1 -- 172.21.15.5:0/1692022133 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8004550 con 0x7f2ee80b43b0 2023-03-03T06:26:35.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.898+0000 7f2ede7fc700 1 -- 172.21.15.5:0/1692022133 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed801f070 con 0x7f2ee80b43b0 2023-03-03T06:26:35.905 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.898+0000 7f2ede7fc700 1 -- 172.21.15.5:0/1692022133 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80038a0 con 0x7f2ee80b43b0 2023-03-03T06:26:35.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.898+0000 7f2ef013b700 1 -- 172.21.15.5:0/1692022133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed80094a0 con 0x7f2ee80b43b0 2023-03-03T06:26:35.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.898+0000 7f2ef013b700 1 -- 172.21.15.5:0/1692022133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee80cf1e0 con 0x7f2ee80b43b0 2023-03-03T06:26:35.906 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.900+0000 7f2ede7fc700 1 -- 172.21.15.5:0/1692022133 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2ed800f050 con 0x7f2ee80b43b0 2023-03-03T06:26:35.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.900+0000 7f2ede7fc700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2ecc0682f0 0x7f2ecc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.900+0000 7f2ede7fc700 1 -- 172.21.15.5:0/1692022133 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7445+0+0 (secure 0 0 0) 0x7f2ed8021070 con 0x7f2ee80b43b0 2023-03-03T06:26:35.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.900+0000 7f2eed6d6700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2ecc0682f0 0x7f2ecc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.901+0000 7f2eed6d6700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2ecc0682f0 0x7f2ecc06a7a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80c5e10 tx=0x7f2ee4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:35.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.902+0000 7f2efc2c4b80 1 Processor -- start 2023-03-03T06:26:35.911 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.902+0000 7f2efc2c4b80 1 -- start start 2023-03-03T06:26:35.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2efc2c4b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211258320 0x5602112586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2efc2c4b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56021120a330 0x560211232fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2efc2c4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 0x560211233520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2efc2c4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602110f9bc0 con 0x560211237700 2023-03-03T06:26:35.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2efc2c4b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560211168350 con 0x56021120a330 2023-03-03T06:26:35.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2efc2c4b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x560211161880 con 0x560211258320 2023-03-03T06:26:35.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2eee6d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 0x560211233520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.912 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2eee6d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 0x560211233520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46628/0 (socket says 172.21.15.5:46628) 2023-03-03T06:26:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2eee6d8700 1 -- 172.21.15.5:0/2120299766 learned_addr learned my addr 172.21.15.5:0/2120299766 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2eeded7700 1 --2- 172.21.15.5:0/2120299766 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211258320 0x5602112586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2eed6d6700 1 --2- 172.21.15.5:0/2120299766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56021120a330 0x560211232fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2eee6d8700 1 -- 172.21.15.5:0/2120299766 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211258320 msgr2=0x5602112586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2eee6d8700 1 --2- 172.21.15.5:0/2120299766 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211258320 0x5602112586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2eee6d8700 1 -- 172.21.15.5:0/2120299766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56021120a330 msgr2=0x560211232fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:35.913 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2eee6d8700 1 --2- 172.21.15.5:0/2120299766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56021120a330 0x560211232fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2eee6d8700 1 -- 172.21.15.5:0/2120299766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560210fe35e0 con 0x560211237700 2023-03-03T06:26:35.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2eeded7700 1 --2- 172.21.15.5:0/2120299766 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211258320 0x5602112586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:35.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.903+0000 7f2eed6d6700 1 --2- 172.21.15.5:0/2120299766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56021120a330 0x560211232fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:35.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.904+0000 7f2eee6d8700 1 --2- 172.21.15.5:0/2120299766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 0x560211233520 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0011560 tx=0x7f2ee0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec2123e7370053d server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:35.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.904+0000 7f2ecb7fe700 1 -- 172.21.15.5:0/2120299766 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee000e040 con 0x560211237700 2023-03-03T06:26:35.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.904+0000 7f2ecb7fe700 1 -- 172.21.15.5:0/2120299766 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee000f040 con 0x560211237700 2023-03-03T06:26:35.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.904+0000 7f2ecb7fe700 1 -- 172.21.15.5:0/2120299766 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0003e40 con 0x560211237700 2023-03-03T06:26:35.914 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.904+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/2120299766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 msgr2=0x560211233520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.904+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/2120299766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 0x560211233520 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0011560 tx=0x7f2ee0009750 comp rx=0 tx=0).stop 2023-03-03T06:26:35.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.904+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/2120299766 shutdown_connections 2023-03-03T06:26:35.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.904+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/2120299766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 0x560211233520 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.904+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/2120299766 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211258320 0x5602112586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.904+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/2120299766 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56021120a330 0x560211232fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.904+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/2120299766 >> 172.21.15.5:0/2120299766 conn(0x560211204720 msgr2=0x560211209c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:35.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.904+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/2120299766 shutdown_connections 2023-03-03T06:26:35.915 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.904+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/2120299766 wait complete. 2023-03-03T06:26:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.905+0000 7f2efc2c4b80 1 -- start start 2023-03-03T06:26:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.905+0000 7f2efc2c4b80 1 Processor -- start 2023-03-03T06:26:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2efc2c4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56021120a330 0x56021122b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2efc2c4b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211237700 0x560211233fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2efc2c4b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560211258320 0x56021123cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2efc2c4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x560210fe58d0 con 0x56021120a330 2023-03-03T06:26:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2efc2c4b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56021126a730 con 0x560211258320 2023-03-03T06:26:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2efc2c4b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x560211234830 con 0x560211237700 2023-03-03T06:26:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2efc2c4b80 10 client.0 _ll_register_callbacks cb 0x5602110ff630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T06:26:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2eeded7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56021120a330 0x56021122b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2eeded7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56021120a330 0x56021122b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46630/0 (socket says 172.21.15.5:46630) 2023-03-03T06:26:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2eeded7700 1 -- 172.21.15.5:0/1227646806 learned_addr learned my addr 172.21.15.5:0/1227646806 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2eed6d6700 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211237700 0x560211233fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2eee6d8700 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560211258320 0x56021123cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.917 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2eeded7700 1 -- 172.21.15.5:0/1227646806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211237700 msgr2=0x560211233fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2eeded7700 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211237700 0x560211233fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2eeded7700 1 -- 172.21.15.5:0/1227646806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560211258320 msgr2=0x56021123cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2eeded7700 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560211258320 0x56021123cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2eeded7700 1 -- 172.21.15.5:0/1227646806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee0011230 con 0x56021120a330 2023-03-03T06:26:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2eee6d8700 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560211258320 0x56021123cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.906+0000 7f2eed6d6700 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211237700 0x560211233fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2eeded7700 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56021120a330 0x56021122b440 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009fd0 tx=0x7f2ed805f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de01b44d0bd97d6 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2ec8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-03-03T06:26:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2ec8ff9700 1 -- 172.21.15.5:0/1227646806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed805f490 con 0x56021120a330 2023-03-03T06:26:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2ec8ff9700 1 -- 172.21.15.5:0/1227646806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 7445+0+0 (secure 0 0 0) 0x7f2ed805f5f0 con 0x56021120a330 2023-03-03T06:26:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/1227646806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56021112f140 con 0x56021120a330 2023-03-03T06:26:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2ec8ff9700 1 -- 172.21.15.5:0/1227646806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ed8053680 con 0x56021120a330 2023-03-03T06:26:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2efc2c4b80 10 client.6789 fetch_fsmap learned FSMap version 40 2023-03-03T06:26:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/1227646806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x560210f8fd90 con 0x56021120a330 2023-03-03T06:26:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2ec8ff9700 1 -- 172.21.15.5:0/1227646806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56021112f140 con 0x56021120a330 2023-03-03T06:26:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2ec8ff9700 1 -- 172.21.15.5:0/1227646806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 40) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2ed80537e0 con 0x56021120a330 2023-03-03T06:26:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2efc2c4b80 10 client.6789 fetch_fsmap finished waiting for FSMap version 40 2023-03-03T06:26:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2efc2c4b80 10 client.6789 resolve_mds: resolved name 'a' to daemon mds.a 2023-03-03T06:26:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2efc2c4b80 20 client.6789 populate_metadata read hostname 'smithi005' 2023-03-03T06:26:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.5:6834/2017156082,v1:172.21.15.5:6837/2017156082] conn(0x560211269bb0 0x560211275b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2efc2c4b80 4 client.6789 mds_command: new command op to 6636 tid=0[{"prefix": "get_command_descriptions"}] 2023-03-03T06:26:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/1227646806 --> [v2:172.21.15.5:6834/2017156082,v1:172.21.15.5:6837/2017156082] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560210fe5f10 con 0x560211269bb0 2023-03-03T06:26:35.920 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.907+0000 7f2eed6d6700 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.5:6834/2017156082,v1:172.21.15.5:6837/2017156082] conn(0x560211269bb0 0x560211275b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2eed6d6700 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.5:6834/2017156082,v1:172.21.15.5:6837/2017156082] conn(0x560211269bb0 0x560211275b00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb24ad74bd608482 server_cookie=58c0f4f76522d7ae in_seq=0 out_seq=0 2023-03-03T06:26:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2ec8ff9700 10 client.6789 ms_handle_connect on v2:172.21.15.5:6834/2017156082 2023-03-03T06:26:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2ec8ff9700 1 -- 172.21.15.5:0/1227646806 <== mds.0 v2:172.21.15.5:6834/2017156082 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18278 (crc 0 0 0) 0x560210fe5f10 con 0x560211269bb0 2023-03-03T06:26:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2ec8ff9700 10 client.6789 handle_command_reply: tid=0 2023-03-03T06:26:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2efc2c4b80 1 client.6789 shutdown 2023-03-03T06:26:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/1227646806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56021120a330 msgr2=0x56021122b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.921 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56021120a330 0x56021122b440 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009fd0 tx=0x7f2ed805f920 comp rx=0 tx=0).stop 2023-03-03T06:26:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/1227646806 shutdown_connections 2023-03-03T06:26:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560211258320 0x56021123cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56021120a330 0x56021122b440 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.5:6834/2017156082,v1:172.21.15.5:6837/2017156082] conn(0x560211269bb0 0x560211275b00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/1227646806 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211237700 0x560211233fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2ec8ff9700 0 client.6789 ms_handle_reset on v2:172.21.15.5:6834/2017156082 2023-03-03T06:26:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.908+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/1227646806 >> 172.21.15.5:0/1227646806 conn(0x560211204720 msgr2=0x560211209b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:35.922 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.909+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/1227646806 shutdown_connections 2023-03-03T06:26:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.909+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/1227646806 wait complete. 2023-03-03T06:26:35.923 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.909+0000 7f2efc2c4b80 20 client.6789 trim_cache size 0 max 16384 2023-03-03T06:26:35.928 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.927+0000 7f2efc2c4b80 1 Processor -- start 2023-03-03T06:26:35.929 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.927+0000 7f2efc2c4b80 1 -- start start 2023-03-03T06:26:35.930 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.927+0000 7f2efc2c4b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56021120a330 0x560211233fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.927+0000 7f2efc2c4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 0x5602112520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.927+0000 7f2efc2c4b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211258320 0x560211279d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.927+0000 7f2efc2c4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x56021120fe30 con 0x560211237700 2023-03-03T06:26:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.927+0000 7f2efc2c4b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56021120fa20 con 0x56021120a330 2023-03-03T06:26:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.927+0000 7f2efc2c4b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x560211201870 con 0x560211258320 2023-03-03T06:26:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.927+0000 7f2eed6d6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 0x5602112520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.931 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.927+0000 7f2eed6d6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 0x5602112520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46638/0 (socket says 172.21.15.5:46638) 2023-03-03T06:26:35.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.927+0000 7f2eed6d6700 1 -- 172.21.15.5:0/1885754373 learned_addr learned my addr 172.21.15.5:0/1885754373 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:35.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.928+0000 7f2eee6d8700 1 --2- 172.21.15.5:0/1885754373 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211258320 0x560211279d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.928+0000 7f2eeded7700 1 --2- 172.21.15.5:0/1885754373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56021120a330 0x560211233fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.928+0000 7f2eed6d6700 1 -- 172.21.15.5:0/1885754373 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211258320 msgr2=0x560211279d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:35.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.928+0000 7f2eed6d6700 1 --2- 172.21.15.5:0/1885754373 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211258320 0x560211279d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.928+0000 7f2eed6d6700 1 -- 172.21.15.5:0/1885754373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56021120a330 msgr2=0x560211233fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:35.932 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.928+0000 7f2eed6d6700 1 --2- 172.21.15.5:0/1885754373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56021120a330 0x560211233fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.928+0000 7f2eed6d6700 1 -- 172.21.15.5:0/1885754373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560211128140 con 0x560211237700 2023-03-03T06:26:35.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.928+0000 7f2eeded7700 1 --2- 172.21.15.5:0/1885754373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56021120a330 0x560211233fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:35.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.928+0000 7f2eee6d8700 1 --2- 172.21.15.5:0/1885754373 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211258320 0x560211279d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:35.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.928+0000 7f2eed6d6700 1 --2- 172.21.15.5:0/1885754373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 0x5602112520a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4000f60 tx=0x7f2ee4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2240cf9390f52192 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:35.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.928+0000 7f2ecbfff700 1 -- 172.21.15.5:0/1885754373 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400fbb0 con 0x560211237700 2023-03-03T06:26:35.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.928+0000 7f2ecbfff700 1 -- 172.21.15.5:0/1885754373 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee400fd10 con 0x560211237700 2023-03-03T06:26:35.933 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.928+0000 7f2ecbfff700 1 -- 172.21.15.5:0/1885754373 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400fea0 con 0x560211237700 2023-03-03T06:26:35.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.929+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/1885754373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 msgr2=0x5602112520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.929+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/1885754373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 0x5602112520a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4000f60 tx=0x7f2ee4000ed0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.929+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/1885754373 shutdown_connections 2023-03-03T06:26:35.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.929+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/1885754373 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x560211258320 0x560211279d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.929+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/1885754373 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56021120a330 0x560211233fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.929+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/1885754373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211237700 0x5602112520a0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.929+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/1885754373 >> 172.21.15.5:0/1885754373 conn(0x560211204720 msgr2=0x56021120dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:35.934 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.929+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/1885754373 shutdown_connections 2023-03-03T06:26:35.935 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.929+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/1885754373 wait complete. 2023-03-03T06:26:35.937 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.929+0000 7f2efc2c4b80 1 -- start start 2023-03-03T06:26:35.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.929+0000 7f2efc2c4b80 1 Processor -- start 2023-03-03T06:26:35.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.930+0000 7f2efc2c4b80 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56021120a330 0x5602112a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.930+0000 7f2efc2c4b80 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560211237700 0x5602112509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.930+0000 7f2efc2c4b80 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211258320 0x560211232320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.930+0000 7f2efc2c4b80 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602112c41e0 con 0x560211258320 2023-03-03T06:26:35.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.930+0000 7f2efc2c4b80 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560211251360 con 0x560211237700 2023-03-03T06:26:35.938 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.930+0000 7f2efc2c4b80 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x5602112515b0 con 0x56021120a330 2023-03-03T06:26:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.930+0000 7f2efc2c4b80 10 client.0 _ll_register_callbacks cb 0x5602110ff630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-03-03T06:26:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.930+0000 7f2eee6d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211258320 0x560211232320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.930+0000 7f2eee6d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211258320 0x560211232320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46646/0 (socket says 172.21.15.5:46646) 2023-03-03T06:26:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.930+0000 7f2eeded7700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56021120a330 0x5602112a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.930+0000 7f2eee6d8700 1 -- 172.21.15.5:0/648799075 learned_addr learned my addr 172.21.15.5:0/648799075 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.930+0000 7f2eed6d6700 1 --2- 172.21.15.5:0/648799075 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560211237700 0x5602112509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2eee6d8700 1 -- 172.21.15.5:0/648799075 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56021120a330 msgr2=0x5602112a5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:35.939 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2eee6d8700 1 --2- 172.21.15.5:0/648799075 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56021120a330 0x5602112a5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2eee6d8700 1 -- 172.21.15.5:0/648799075 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560211237700 msgr2=0x5602112509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2eee6d8700 1 --2- 172.21.15.5:0/648799075 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560211237700 0x5602112509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2eee6d8700 1 -- 172.21.15.5:0/648799075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee401d040 con 0x560211258320 2023-03-03T06:26:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2eee6d8700 1 --2- 172.21.15.5:0/648799075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211258320 0x560211232320 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0000f80 tx=0x7f2ee0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786324f408934e43 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2ec8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2023-03-03T06:26:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2ec8ff9700 1 -- 172.21.15.5:0/648799075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0023070 con 0x560211258320 2023-03-03T06:26:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2ec8ff9700 1 -- 172.21.15.5:0/648799075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 7445+0+0 (secure 0 0 0) 0x7f2ee0003e00 con 0x560211258320 2023-03-03T06:26:35.940 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/648799075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56021111f160 con 0x560211258320 2023-03-03T06:26:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2ec8ff9700 1 -- 172.21.15.5:0/648799075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ee000e040 con 0x560211258320 2023-03-03T06:26:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2efc2c4b80 10 client.6795 fetch_fsmap learned FSMap version 40 2023-03-03T06:26:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/648799075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x560210fb6200 con 0x560211258320 2023-03-03T06:26:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2ec8ff9700 1 -- 172.21.15.5:0/648799075 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56021111f160 con 0x560211258320 2023-03-03T06:26:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2ec8ff9700 1 -- 172.21.15.5:0/648799075 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 40) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2ee001b030 con 0x560211258320 2023-03-03T06:26:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2efc2c4b80 10 client.6795 fetch_fsmap finished waiting for FSMap version 40 2023-03-03T06:26:35.941 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2efc2c4b80 10 client.6795 resolve_mds: resolved name 'a' to daemon mds.a 2023-03-03T06:26:35.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2efc2c4b80 20 client.6795 populate_metadata read hostname 'smithi005' 2023-03-03T06:26:35.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/648799075 >> [v2:172.21.15.5:6834/2017156082,v1:172.21.15.5:6837/2017156082] conn(0x5602112552d0 0x5602112556a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:35.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2efc2c4b80 4 client.6795 mds_command: new command op to 6636 tid=0[{"prefix": "status"}] 2023-03-03T06:26:35.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.931+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/648799075 --> [v2:172.21.15.5:6834/2017156082,v1:172.21.15.5:6837/2017156082] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560211109170 con 0x5602112552d0 2023-03-03T06:26:35.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2eeded7700 1 --2- 172.21.15.5:0/648799075 >> [v2:172.21.15.5:6834/2017156082,v1:172.21.15.5:6837/2017156082] conn(0x5602112552d0 0x5602112556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:35.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2ec8ff9700 10 client.6795 ms_handle_connect on v2:172.21.15.5:6834/2017156082 2023-03-03T06:26:35.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2eeded7700 1 --2- 172.21.15.5:0/648799075 >> [v2:172.21.15.5:6834/2017156082,v1:172.21.15.5:6837/2017156082] conn(0x5602112552d0 0x5602112556a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa87d2604becabdc server_cookie=d191dceab83942bd in_seq=0 out_seq=0 2023-03-03T06:26:35.942 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2ec8ff9700 1 -- 172.21.15.5:0/648799075 <== mds.0 v2:172.21.15.5:6834/2017156082 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x560211109170 con 0x5602112552d0 2023-03-03T06:26:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2ec8ff9700 10 client.6795 handle_command_reply: tid=0 2023-03-03T06:26:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2efc2c4b80 1 client.6795 shutdown 2023-03-03T06:26:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/648799075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211258320 msgr2=0x560211232320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/648799075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211258320 0x560211232320 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0000f80 tx=0x7f2ee0004b40 comp rx=0 tx=0).stop 2023-03-03T06:26:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/648799075 shutdown_connections 2023-03-03T06:26:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/648799075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560211258320 0x560211232320 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.943 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/648799075 >> [v2:172.21.15.5:6834/2017156082,v1:172.21.15.5:6837/2017156082] conn(0x5602112552d0 0x5602112556a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/648799075 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56021120a330 0x5602112a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2efc2c4b80 1 --2- 172.21.15.5:0/648799075 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560211237700 0x5602112509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2ec8ff9700 0 client.6795 ms_handle_reset on v2:172.21.15.5:6834/2017156082 2023-03-03T06:26:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/648799075 >> 172.21.15.5:0/648799075 conn(0x560211204720 msgr2=0x560211233fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/648799075 shutdown_connections 2023-03-03T06:26:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.932+0000 7f2efc2c4b80 1 -- 172.21.15.5:0/648799075 wait complete. 2023-03-03T06:26:35.944 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.933+0000 7f2efc2c4b80 20 client.6795 trim_cache size 0 max 16384 2023-03-03T06:26:35.945 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2023-03-03T06:26:35.945 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6", 2023-03-03T06:26:35.945 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2023-03-03T06:26:35.945 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 6636, 2023-03-03T06:26:35.945 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2023-03-03T06:26:35.945 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2023-03-03T06:26:35.946 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2023-03-03T06:26:35.946 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 5.9636173399999999, 2023-03-03T06:26:35.946 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 40, 2023-03-03T06:26:35.946 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 85, 2023-03-03T06:26:35.946 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 85, 2023-03-03T06:26:35.946 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 12.304230369000001 2023-03-03T06:26:35.946 INFO:teuthology.orchestra.run.smithi005.stdout:} 2023-03-03T06:26:35.947 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.933+0000 7f2ef013b700 1 -- 172.21.15.5:0/1692022133 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2ecc0682f0 msgr2=0x7f2ecc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.933+0000 7f2ef013b700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2ecc0682f0 0x7f2ecc06a7a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2ee80c5e10 tx=0x7f2ee4009040 comp rx=0 tx=0).stop 2023-03-03T06:26:35.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.933+0000 7f2ef013b700 1 -- 172.21.15.5:0/1692022133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee80b43b0 msgr2=0x7f2ee80c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:35.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.933+0000 7f2ef013b700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee80b43b0 0x7f2ee80c9230 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80090b0 tx=0x7f2ed8004750 comp rx=0 tx=0).stop 2023-03-03T06:26:35.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.933+0000 7f2ef013b700 1 -- 172.21.15.5:0/1692022133 shutdown_connections 2023-03-03T06:26:35.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.933+0000 7f2ef013b700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7f2ecc0682f0 0x7f2ecc06a7a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.933+0000 7f2ef013b700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2ee80cff20 0x7f2ee8150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.948 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.933+0000 7f2ef013b700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ee80b43b0 0x7f2ee80c9230 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.933+0000 7f2ef013b700 1 --2- 172.21.15.5:0/1692022133 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ee80cb710 0x7f2ee80c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.933+0000 7f2ef013b700 1 -- 172.21.15.5:0/1692022133 >> 172.21.15.5:0/1692022133 conn(0x7f2ee8070050 msgr2=0x7f2ee80b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.933+0000 7f2ef013b700 1 -- 172.21.15.5:0/1692022133 shutdown_connections 2023-03-03T06:26:35.949 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:35.933+0000 7f2ef013b700 1 -- 172.21.15.5:0/1692022133 wait complete. 2023-03-03T06:26:35.949 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-03-03T06:26:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.073+0000 7fd9c2f13700 1 Processor -- start 2023-03-03T06:26:36.075 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.073+0000 7fd9c2f13700 1 -- start start 2023-03-03T06:26:36.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.073+0000 7fd9c2f13700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd9bc159550 0x7fd9bc15dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:36.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9c2f13700 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9bc06e3f0 con 0x7fd9bc0cebc0 2023-03-03T06:26:36.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9c2f13700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9bc06e6d0 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9c2f13700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9bc06c6d0 con 0x7fd9bc159550 2023-03-03T06:26:36.077 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9c14b0700 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd9bc0cebc0 0x7fd9bc0cb260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36496/0 (socket says 172.21.15.5:36496) 2023-03-03T06:26:36.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9c14b0700 1 -- 172.21.15.5:0/664945396 learned_addr learned my addr 172.21.15.5:0/664945396 (peer_addr_for_me v1:172.21.15.5:0/0) 2023-03-03T06:26:36.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9c0caf700 1 --2- 172.21.15.5:0/664945396 >> v2:172.21.15.191:3300/0 conn(0x7fd9bc159550 0x7fd9bc15dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:36.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9bb7fe700 1 -- 172.21.15.5:0/664945396 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789099371 0 0) 0x7fd9bc06e3f0 con 0x7fd9bc0cebc0 2023-03-03T06:26:36.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9bb7fe700 1 -- 172.21.15.5:0/664945396 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9ac0035b0 con 0x7fd9bc0cebc0 2023-03-03T06:26:36.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9bb7fe700 1 -- 172.21.15.5:0/664945396 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733619280 0 0) 0x7fd9bc06e6d0 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9bb7fe700 1 -- 172.21.15.5:0/664945396 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9bc06e3f0 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.078 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9bb7fe700 1 -- 172.21.15.5:0/664945396 <== mon.0 v1:172.21.15.5:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4282848301 0 0) 0x7fd9ac0035b0 con 0x7fd9bc0cebc0 2023-03-03T06:26:36.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9c0caf700 1 -- 172.21.15.5:0/664945396 >> v1:172.21.15.191:6789/0 conn(0x7fd9bc06d1b0 legacy=0x7fd9bc06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:36.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9c0caf700 1 -- 172.21.15.5:0/664945396 >> v1:172.21.15.5:6789/0 conn(0x7fd9bc0cebc0 legacy=0x7fd9bc0cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:36.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.074+0000 7fd9c0caf700 1 -- 172.21.15.5:0/664945396 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc06c9b0 con 0x7fd9bc159550 2023-03-03T06:26:36.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.075+0000 7fd9c0caf700 1 --2- 172.21.15.5:0/664945396 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc159550 0x7fd9bc15dd10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009840 tx=0x7fd9b0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79bfbf2fd0449901 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:36.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.075+0000 7fd9bb7fe700 1 -- 172.21.15.5:0/664945396 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b40019f0 con 0x7fd9bc159550 2023-03-03T06:26:36.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.075+0000 7fd9bb7fe700 1 -- 172.21.15.5:0/664945396 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b0004030 con 0x7fd9bc159550 2023-03-03T06:26:36.079 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.075+0000 7fd9bb7fe700 1 -- 172.21.15.5:0/664945396 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00043c0 con 0x7fd9bc159550 2023-03-03T06:26:36.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.075+0000 7fd9c2f13700 1 -- 172.21.15.5:0/664945396 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc159550 msgr2=0x7fd9bc15dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:36.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.075+0000 7fd9c2f13700 1 --2- 172.21.15.5:0/664945396 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc159550 0x7fd9bc15dd10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009840 tx=0x7fd9b0009b50 comp rx=0 tx=0).stop 2023-03-03T06:26:36.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.075+0000 7fd9c2f13700 1 -- 172.21.15.5:0/664945396 shutdown_connections 2023-03-03T06:26:36.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.075+0000 7fd9c2f13700 1 --2- 172.21.15.5:0/664945396 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc159550 0x7fd9bc15dd10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:36.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.075+0000 7fd9c2f13700 1 -- 172.21.15.5:0/664945396 >> 172.21.15.5:0/664945396 conn(0x7fd9bc0cfd00 msgr2=0x7fd9bc0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:36.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.075+0000 7fd9c2f13700 1 -- 172.21.15.5:0/664945396 shutdown_connections 2023-03-03T06:26:36.082 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.075+0000 7fd9c2f13700 1 -- 172.21.15.5:0/664945396 wait complete. 2023-03-03T06:26:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.076+0000 7fd9c2f13700 1 Processor -- start 2023-03-03T06:26:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.077+0000 7fd9c2f13700 1 -- start start 2023-03-03T06:26:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.077+0000 7fd9c2f13700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9bc06d1b0 0x7fd9bc0cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.077+0000 7fd9c2f13700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc0cebc0 0x7fd9bc153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.077+0000 7fd9c2f13700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc159550 0x7fd9bc0c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.077+0000 7fd9c2f13700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0c56f0 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.083 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.077+0000 7fd9c2f13700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0cb760 con 0x7fd9bc0cebc0 2023-03-03T06:26:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.077+0000 7fd9c2f13700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0c3d30 con 0x7fd9bc159550 2023-03-03T06:26:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9c0caf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9bc06d1b0 0x7fd9bc0cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9c0caf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9bc06d1b0 0x7fd9bc0cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46658/0 (socket says 172.21.15.5:46658) 2023-03-03T06:26:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9c0caf700 1 -- 172.21.15.5:0/3453603504 learned_addr learned my addr 172.21.15.5:0/3453603504 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9bbfff700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc0cebc0 0x7fd9bc153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9c14b0700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc159550 0x7fd9bc0c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9c0caf700 1 -- 172.21.15.5:0/3453603504 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc159550 msgr2=0x7fd9bc0c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:36.084 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9c0caf700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc159550 0x7fd9bc0c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9c0caf700 1 -- 172.21.15.5:0/3453603504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc0cebc0 msgr2=0x7fd9bc153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9c0caf700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc0cebc0 0x7fd9bc153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9c0caf700 1 -- 172.21.15.5:0/3453603504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b00094a0 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9c14b0700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc159550 0x7fd9bc0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9c0caf700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9bc06d1b0 0x7fd9bc0cb220 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009790 tx=0x7fd9b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9b97fa700 1 -- 172.21.15.5:0/3453603504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0003d80 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9b97fa700 1 -- 172.21.15.5:0/3453603504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b001f070 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9c2f13700 1 -- 172.21.15.5:0/3453603504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9bc06d600 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9b97fa700 1 -- 172.21.15.5:0/3453603504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0011870 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.078+0000 7fd9c2f13700 1 -- 172.21.15.5:0/3453603504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9bc06cc90 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.079+0000 7fd9c2f13700 1 -- 172.21.15.5:0/3453603504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9bc159920 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.086 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.080+0000 7fd9b97fa700 1 -- 172.21.15.5:0/3453603504 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd9b002a020 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.080+0000 7fd9b97fa700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9a00682f0 0x7fd9a006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.080+0000 7fd9bbfff700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9a00682f0 0x7fd9a006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.080+0000 7fd9b97fa700 1 -- 172.21.15.5:0/3453603504 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7445+0+0 (secure 0 0 0) 0x7fd9b0087630 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.081+0000 7fd9bbfff700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9a00682f0 0x7fd9a006a7a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc154d80 tx=0x7fd9a8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.085+0000 7fd9b97fa700 1 -- 172.21.15.5:0/3453603504 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd9b0053920 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.326 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.324+0000 7fd9c2f13700 1 -- 172.21.15.5:0/3453603504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd9bc06d840 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.327 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.325+0000 7fd9b97fa700 1 -- 172.21.15.5:0/3453603504 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd9b0056f40 con 0x7fd9bc06d1b0 2023-03-03T06:26:36.327 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-03-03T06:26:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.327+0000 7fd9c2f13700 1 -- 172.21.15.5:0/3453603504 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9a00682f0 msgr2=0x7fd9a006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.327+0000 7fd9c2f13700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9a00682f0 0x7fd9a006a7a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc154d80 tx=0x7fd9a8009040 comp rx=0 tx=0).stop 2023-03-03T06:26:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.327+0000 7fd9c2f13700 1 -- 172.21.15.5:0/3453603504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9bc06d1b0 msgr2=0x7fd9bc0cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.327+0000 7fd9c2f13700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9bc06d1b0 0x7fd9bc0cb220 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009790 tx=0x7fd9b0004750 comp rx=0 tx=0).stop 2023-03-03T06:26:36.329 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.327+0000 7fd9c2f13700 1 -- 172.21.15.5:0/3453603504 shutdown_connections 2023-03-03T06:26:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.327+0000 7fd9c2f13700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fd9a00682f0 0x7fd9a006a7a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.327+0000 7fd9c2f13700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd9bc159550 0x7fd9bc0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.327+0000 7fd9c2f13700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9bc06d1b0 0x7fd9bc0cb220 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.327+0000 7fd9c2f13700 1 --2- 172.21.15.5:0/3453603504 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd9bc0cebc0 0x7fd9bc153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.327+0000 7fd9c2f13700 1 -- 172.21.15.5:0/3453603504 >> 172.21.15.5:0/3453603504 conn(0x7fd9bc0cfd00 msgr2=0x7fd9bc0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.327+0000 7fd9c2f13700 1 -- 172.21.15.5:0/3453603504 shutdown_connections 2023-03-03T06:26:36.330 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:36.327+0000 7fd9c2f13700 1 -- 172.21.15.5:0/3453603504 wait complete. 2023-03-03T06:26:36.341 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-03-03T06:26:36.341 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-03-03T06:26:36.341 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2023-03-03T06:26:36.342 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-03-03T06:26:36.342 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-03-03T06:26:36.342 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-03-03T06:26:36.342 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-03-03T06:26:36.343 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-03-03T06:26:36.343 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:26:36.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:36.344 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2023-03-03T06:26:36.361 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-03-03T06:26:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-03-03T06:26:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2023-03-03T06:26:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2023-03-03T06:26:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:36.362 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:26:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2023-03-03T06:26:36.362 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:26:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2023-03-03T06:26:36.362 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-03-03T06:26:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:26:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-03-03T06:26:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42347sec preferred_lft 42347sec 2023-03-03T06:26:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2023-03-03T06:26:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:36.363 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-03-03T06:26:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:26:36.363 INFO:teuthology.orchestra.run.smithi005.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-03-03T06:26:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 6a:b3:10:0c:df:06 brd ff:ff:ff:ff:ff:ff 2023-03-03T06:26:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-03-03T06:26:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::3415:96ff:fe7c:a178/64 scope link 2023-03-03T06:26:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:36.364 INFO:teuthology.orchestra.run.smithi005.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-03T06:26:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 76:7c:c4:80:40:be brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-03-03T06:26:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::747c:c4ff:fe80:40be/64 scope link 2023-03-03T06:26:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:36.368 INFO:teuthology.orchestra.run.smithi005.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-03-03T06:26:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 6a:b3:10:0c:df:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-03-03T06:26:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::68b3:10ff:fe0c:df06/64 scope link 2023-03-03T06:26:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2023-03-03T06:26:36.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:36.369 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-03-03T06:26:36.427 INFO:teuthology.orchestra.run.smithi005.stdout:1 2023-03-03T06:26:36.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:36.429 DEBUG:teuthology.orchestra.run.smithi005:> route 2023-03-03T06:26:36.487 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2023-03-03T06:26:36.488 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-03-03T06:26:36.488 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-03-03T06:26:36.488 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-03-03T06:26:36.488 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-03-03T06:26:36.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:36.489 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec bash -c ' 2023-03-03T06:26:36.489 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2023-03-03T06:26:36.490 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-03-03T06:26:36.490 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-03-03T06:26:36.490 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-03-03T06:26:36.491 DEBUG:teuthology.orchestra.run.smithi005:> ') 2023-03-03T06:26:36.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:36.596 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2023-03-03T06:26:36.613 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-03-03T06:26:36.613 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-03-03T06:26:36.613 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:26:36.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:36.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2023-03-03T06:26:36.680 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:26:36.681 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-03-03T06:26:36.738 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-03-03T06:26:36.738 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-03-03T06:26:36.739 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-03-03T06:26:36.795 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-03-03T06:26:36.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:36.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:26:36.882 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:26:36.882 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:26:36.913 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:26:36.914 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:26:36.914 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:26:36.914 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:26:36.914 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:26:36.915 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:26:36.915 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:26:36.915 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:26:36.987 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-03-03T06:26:36.987 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-03-03T06:26:36.987 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.191:3300,172.21.15.191:3301" 2023-03-03T06:26:36.988 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6.cephfs=/ 2023-03-03T06:26:36.988 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.5:3300/172.21.15.191:3300/172.21.15.191:3301" will pass to kernel 2023-03-03T06:26:36.988 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: v2 mount support check returned 2 2023-03-03T06:26:36.988 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: kernel does not support v2 syntax 2023-03-03T06:26:36.988 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2023-03-03T06:26:36.988 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790" 2023-03-03T06:26:36.988 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.191:6789,172.21.15.191:6790:/ 2023-03-03T06:26:36.988 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=b57ae1a4-b8cd-4b2e-b2f7-64f801d49eb6" will pass to kernel 2023-03-03T06:26:36.989 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-03-03T06:26:36.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:36.990 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-03-03T06:26:37.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:37.018 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-03-03T06:26:37.100 INFO:teuthology.orchestra.run.smithi005.stdout:client5750 2023-03-03T06:26:37.100 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2023-03-03T06:26:37.100 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2023-03-03T06:26:37.157 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-03-03T06:26:37.337 INFO:teuthology.orchestra.run.smithi005.stdout:{"mds_max_snaps_per_dir":"100"} 2023-03-03T06:26:37.338 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-03-03T06:26:37.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:37.338 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps) 2023-03-03T06:26:37.361 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps false --yes-i-really-mean-it 2023-03-03T06:26:37.530 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.528+0000 7fc207048700 1 Processor -- start 2023-03-03T06:26:37.531 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.528+0000 7fc207048700 1 -- start start 2023-03-03T06:26:37.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.529+0000 7fc207048700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc2000cfcd0 0x7fc2000ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:37.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.529+0000 7fc207048700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2000cebd0 0x7fc20006c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:37.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.529+0000 7fc207048700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2000b3bb0 con 0x7fc2000d00a0 2023-03-03T06:26:37.533 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.529+0000 7fc207048700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2000cd960 con 0x7fc2000cfcd0 2023-03-03T06:26:37.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.529+0000 7fc207048700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20006d080 con 0x7fc2000cebd0 2023-03-03T06:26:37.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.529+0000 7fc204de4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc2000cfcd0 0x7fc2000ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:37.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.529+0000 7fc204de4700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc2000cfcd0 0x7fc2000ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46668/0 (socket says 172.21.15.5:46668) 2023-03-03T06:26:37.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.529+0000 7fc204de4700 1 -- 172.21.15.5:0/4062500121 learned_addr learned my addr 172.21.15.5:0/4062500121 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:37.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.530+0000 7fc1fffff700 1 --2- 172.21.15.5:0/4062500121 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2000cebd0 0x7fc20006c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:37.534 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.530+0000 7fc204de4700 1 -- 172.21.15.5:0/4062500121 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2000cebd0 msgr2=0x7fc20006c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:37.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.530+0000 7fc204de4700 1 --2- 172.21.15.5:0/4062500121 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2000cebd0 0x7fc20006c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:37.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.530+0000 7fc204de4700 1 -- 172.21.15.5:0/4062500121 >> v1:172.21.15.191:6789/0 conn(0x7fc2000d00a0 legacy=0x7fc200159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:37.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.530+0000 7fc204de4700 1 -- 172.21.15.5:0/4062500121 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2000cdbb0 con 0x7fc2000cfcd0 2023-03-03T06:26:37.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.530+0000 7fc204de4700 1 --2- 172.21.15.5:0/4062500121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2000cfcd0 0x7fc2000ce690 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400bb90 tx=0x7fc1f400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662ebfea75ba2a58 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:37.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.530+0000 7fc1ff7fe700 1 -- 172.21.15.5:0/4062500121 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f400dd30 con 0x7fc2000cfcd0 2023-03-03T06:26:37.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.530+0000 7fc1ff7fe700 1 -- 172.21.15.5:0/4062500121 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f400de90 con 0x7fc2000cfcd0 2023-03-03T06:26:37.535 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.530+0000 7fc1ff7fe700 1 -- 172.21.15.5:0/4062500121 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4010690 con 0x7fc2000cfcd0 2023-03-03T06:26:37.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.531+0000 7fc207048700 1 -- 172.21.15.5:0/4062500121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2000cfcd0 msgr2=0x7fc2000ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:37.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.531+0000 7fc207048700 1 --2- 172.21.15.5:0/4062500121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2000cfcd0 0x7fc2000ce690 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400bb90 tx=0x7fc1f400bea0 comp rx=0 tx=0).stop 2023-03-03T06:26:37.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.531+0000 7fc207048700 1 -- 172.21.15.5:0/4062500121 shutdown_connections 2023-03-03T06:26:37.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.531+0000 7fc207048700 1 --2- 172.21.15.5:0/4062500121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2000cfcd0 0x7fc2000ce690 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:37.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.531+0000 7fc207048700 1 --2- 172.21.15.5:0/4062500121 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2000cebd0 0x7fc20006c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:37.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.531+0000 7fc207048700 1 -- 172.21.15.5:0/4062500121 >> 172.21.15.5:0/4062500121 conn(0x7fc2000b2ce0 msgr2=0x7fc2000b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:37.536 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.531+0000 7fc207048700 1 -- 172.21.15.5:0/4062500121 shutdown_connections 2023-03-03T06:26:37.537 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.531+0000 7fc207048700 1 -- 172.21.15.5:0/4062500121 wait complete. 2023-03-03T06:26:37.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.532+0000 7fc207048700 1 Processor -- start 2023-03-03T06:26:37.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.532+0000 7fc207048700 1 -- start start 2023-03-03T06:26:37.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc207048700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2000cebd0 0x7fc2001f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:37.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc207048700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2000cfcd0 0x7fc2000cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:37.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc207048700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2000d00a0 0x7fc2000cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:37.539 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc207048700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20014f560 con 0x7fc2000cfcd0 2023-03-03T06:26:37.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc207048700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2001493a0 con 0x7fc2000cebd0 2023-03-03T06:26:37.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc207048700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc200158470 con 0x7fc2000d00a0 2023-03-03T06:26:37.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc1fffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2000cfcd0 0x7fc2000cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:37.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc1fffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2000cfcd0 0x7fc2000cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46676/0 (socket says 172.21.15.5:46676) 2023-03-03T06:26:37.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc1fffff700 1 -- 172.21.15.5:0/3867025129 learned_addr learned my addr 172.21.15.5:0/3867025129 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:37.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc204de4700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2000cebd0 0x7fc2001f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:37.540 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc2055e5700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2000d00a0 0x7fc2000cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:37.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc1fffff700 1 -- 172.21.15.5:0/3867025129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2000d00a0 msgr2=0x7fc2000cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:37.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc1fffff700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2000d00a0 0x7fc2000cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:37.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc1fffff700 1 -- 172.21.15.5:0/3867025129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2000cebd0 msgr2=0x7fc2001f52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:37.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc1fffff700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2000cebd0 0x7fc2001f52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:37.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc1fffff700 1 -- 172.21.15.5:0/3867025129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f400b7f0 con 0x7fc2000cfcd0 2023-03-03T06:26:37.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.533+0000 7fc204de4700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2000cebd0 0x7fc2001f52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-03-03T06:26:37.541 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.534+0000 7fc1fffff700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2000cfcd0 0x7fc2000cb270 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00e9b0 tx=0x7fc1ec00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:37.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.534+0000 7fc1fd7fa700 1 -- 172.21.15.5:0/3867025129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec009710 con 0x7fc2000cfcd0 2023-03-03T06:26:37.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.534+0000 7fc1fd7fa700 1 -- 172.21.15.5:0/3867025129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec00c850 con 0x7fc2000cfcd0 2023-03-03T06:26:37.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.534+0000 7fc207048700 1 -- 172.21.15.5:0/3867025129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2000ce170 con 0x7fc2000cfcd0 2023-03-03T06:26:37.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.534+0000 7fc1fd7fa700 1 -- 172.21.15.5:0/3867025129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec00cbc0 con 0x7fc2000cfcd0 2023-03-03T06:26:37.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.534+0000 7fc207048700 1 -- 172.21.15.5:0/3867025129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2000cde90 con 0x7fc2000cfcd0 2023-03-03T06:26:37.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.535+0000 7fc207048700 1 -- 172.21.15.5:0/3867025129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc200159b60 con 0x7fc2000cfcd0 2023-03-03T06:26:37.542 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.535+0000 7fc1fd7fa700 1 -- 172.21.15.5:0/3867025129 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc1ec019030 con 0x7fc2000cfcd0 2023-03-03T06:26:37.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.536+0000 7fc1fd7fa700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc1e40682f0 0x7fc1e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:37.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.536+0000 7fc1fd7fa700 1 -- 172.21.15.5:0/3867025129 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7445+0+0 (secure 0 0 0) 0x7fc1ec086170 con 0x7fc2000cfcd0 2023-03-03T06:26:37.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.536+0000 7fc204de4700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc1e40682f0 0x7fc1e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:37.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.537+0000 7fc204de4700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc1e40682f0 0x7fc1e406a7a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400bee0 tx=0x7fc1f4013000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:37.543 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.541+0000 7fc1fd7fa700 1 -- 172.21.15.5:0/3867025129 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc1ec052460 con 0x7fc2000cfcd0 2023-03-03T06:26:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.782+0000 7fc207048700 1 -- 172.21.15.5:0/3867025129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc20004e6e0 con 0x7fc2000cfcd0 2023-03-03T06:26:38.000 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:37.998+0000 7fc1fd7fa700 1 -- 172.21.15.5:0/3867025129 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true}]=0 disabled new snapshots v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc1ec021070 con 0x7fc2000cfcd0 2023-03-03T06:26:38.002 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.000+0000 7fc207048700 1 -- 172.21.15.5:0/3867025129 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc1e40682f0 msgr2=0x7fc1e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:38.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.000+0000 7fc207048700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc1e40682f0 0x7fc1e406a7a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400bee0 tx=0x7fc1f4013000 comp rx=0 tx=0).stop 2023-03-03T06:26:38.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.000+0000 7fc207048700 1 -- 172.21.15.5:0/3867025129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2000cfcd0 msgr2=0x7fc2000cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:38.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.000+0000 7fc207048700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2000cfcd0 0x7fc2000cb270 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00e9b0 tx=0x7fc1ec00ed70 comp rx=0 tx=0).stop 2023-03-03T06:26:38.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.000+0000 7fc207048700 1 -- 172.21.15.5:0/3867025129 shutdown_connections 2023-03-03T06:26:38.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.000+0000 7fc207048700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fc1e40682f0 0x7fc1e406a7a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:38.003 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.000+0000 7fc207048700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc2000d00a0 0x7fc2000cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.000+0000 7fc207048700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2000cebd0 0x7fc2001f52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.000+0000 7fc207048700 1 --2- 172.21.15.5:0/3867025129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2000cfcd0 0x7fc2000cb270 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.000+0000 7fc207048700 1 -- 172.21.15.5:0/3867025129 >> 172.21.15.5:0/3867025129 conn(0x7fc2000b2ce0 msgr2=0x7fc2000cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.000+0000 7fc207048700 1 -- 172.21.15.5:0/3867025129 shutdown_connections 2023-03-03T06:26:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.000+0000 7fc207048700 1 -- 172.21.15.5:0/3867025129 wait complete. 2023-03-03T06:26:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:disabled new snapshots 2023-03-03T06:26:38.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:38.015 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-03-03T06:26:38.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-03-03T06:26:38.034 INFO:teuthology.orchestra.run.smithi005.stderr:mkdir: cannot create directory ‘test-allow-snaps/.snap/snap00’: Operation not permitted 2023-03-03T06:26:38.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-03-03T06:26:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.201+0000 7fea5c2b5700 1 Processor -- start 2023-03-03T06:26:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.201+0000 7fea5c2b5700 1 -- start start 2023-03-03T06:26:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.202+0000 7fea5c2b5700 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fea540af110 0x7fea540cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.202+0000 7fea5c2b5700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea540b2250 0x7fea540cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.202+0000 7fea5c2b5700 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea540cb810 con 0x7fea540cb3b0 2023-03-03T06:26:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.202+0000 7fea5c2b5700 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea540cd990 con 0x7fea540b2250 2023-03-03T06:26:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.202+0000 7fea5c2b5700 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea540cdf50 con 0x7fea540af110 2023-03-03T06:26:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.202+0000 7fea59850700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea540b2250 0x7fea540cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.203+0000 7fea59850700 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fea540b2250 0x7fea540cae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46682/0 (socket says 172.21.15.5:46682) 2023-03-03T06:26:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.203+0000 7fea59850700 1 -- 172.21.15.5:0/2762567047 learned_addr learned my addr 172.21.15.5:0/2762567047 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.203+0000 7fea5a051700 1 --2- 172.21.15.5:0/2762567047 >> v2:172.21.15.191:3300/0 conn(0x7fea540af110 0x7fea540cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.203+0000 7fea59850700 1 -- 172.21.15.5:0/2762567047 >> v2:172.21.15.191:3300/0 conn(0x7fea540af110 msgr2=0x7fea540cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.203+0000 7fea59850700 1 --2- 172.21.15.5:0/2762567047 >> v2:172.21.15.191:3300/0 conn(0x7fea540af110 0x7fea540cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.203+0000 7fea59850700 1 -- 172.21.15.5:0/2762567047 >> v1:172.21.15.191:6789/0 conn(0x7fea540cb3b0 legacy=0x7fea540ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-03-03T06:26:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.203+0000 7fea59850700 1 -- 172.21.15.5:0/2762567047 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea540cf690 con 0x7fea540b2250 2023-03-03T06:26:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.203+0000 7fea59850700 1 --2- 172.21.15.5:0/2762567047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea540b2250 0x7fea540cae70 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fea54071b00 tx=0x7fea50009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07088ed769b8d44 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.203+0000 7fea5904f700 1 -- 172.21.15.5:0/2762567047 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50004230 con 0x7fea540b2250 2023-03-03T06:26:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.203+0000 7fea5904f700 1 -- 172.21.15.5:0/2762567047 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea50004390 con 0x7fea540b2250 2023-03-03T06:26:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.203+0000 7fea5904f700 1 -- 172.21.15.5:0/2762567047 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea500036a0 con 0x7fea540b2250 2023-03-03T06:26:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.204+0000 7fea5c2b5700 1 -- 172.21.15.5:0/2762567047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea540b2250 msgr2=0x7fea540cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.204+0000 7fea5c2b5700 1 --2- 172.21.15.5:0/2762567047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea540b2250 0x7fea540cae70 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fea54071b00 tx=0x7fea50009bd0 comp rx=0 tx=0).stop 2023-03-03T06:26:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.204+0000 7fea5c2b5700 1 -- 172.21.15.5:0/2762567047 shutdown_connections 2023-03-03T06:26:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.204+0000 7fea5c2b5700 1 --2- 172.21.15.5:0/2762567047 >> v2:172.21.15.191:3300/0 conn(0x7fea540af110 0x7fea540cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.204+0000 7fea5c2b5700 1 --2- 172.21.15.5:0/2762567047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea540b2250 0x7fea540cae70 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.204+0000 7fea5c2b5700 1 -- 172.21.15.5:0/2762567047 >> 172.21.15.5:0/2762567047 conn(0x7fea540cc840 msgr2=0x7fea540ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.204+0000 7fea5c2b5700 1 -- 172.21.15.5:0/2762567047 shutdown_connections 2023-03-03T06:26:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.204+0000 7fea5c2b5700 1 -- 172.21.15.5:0/2762567047 wait complete. 2023-03-03T06:26:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.205+0000 7fea5c2b5700 1 Processor -- start 2023-03-03T06:26:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.205+0000 7fea5c2b5700 1 -- start start 2023-03-03T06:26:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5c2b5700 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea540af110 0x7fea5406bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5c2b5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea540b2250 0x7fea541f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5c2b5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea540cb3b0 0x7fea541f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5c2b5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea540b40f0 con 0x7fea540cb3b0 2023-03-03T06:26:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5c2b5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea541f70f0 con 0x7fea540b2250 2023-03-03T06:26:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5c2b5700 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea541f6e10 con 0x7fea540af110 2023-03-03T06:26:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5a852700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea540cb3b0 0x7fea541f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5a852700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea540cb3b0 0x7fea541f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46692/0 (socket says 172.21.15.5:46692) 2023-03-03T06:26:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5a852700 1 -- 172.21.15.5:0/215144734 learned_addr learned my addr 172.21.15.5:0/215144734 (peer_addr_for_me v2:172.21.15.5:0/0) 2023-03-03T06:26:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5a051700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea540af110 0x7fea5406bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea59850700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea540b2250 0x7fea541f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5a852700 1 -- 172.21.15.5:0/215144734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea540af110 msgr2=0x7fea5406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5a852700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea540af110 0x7fea5406bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5a852700 1 -- 172.21.15.5:0/215144734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea540b2250 msgr2=0x7fea541f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5a852700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea540b2250 0x7fea541f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5a852700 1 -- 172.21.15.5:0/215144734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea50009550 con 0x7fea540cb3b0 2023-03-03T06:26:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea59850700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea540b2250 0x7fea541f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-03-03T06:26:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.206+0000 7fea5a852700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea540cb3b0 0x7fea541f67e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c7a0 tx=0x7fea4c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.207+0000 7fea4affd700 1 -- 172.21.15.5:0/215144734 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c003e10 con 0x7fea540cb3b0 2023-03-03T06:26:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.207+0000 7fea4affd700 1 -- 172.21.15.5:0/215144734 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c005070 con 0x7fea540cb3b0 2023-03-03T06:26:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.207+0000 7fea4affd700 1 -- 172.21.15.5:0/215144734 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c005420 con 0x7fea540cb3b0 2023-03-03T06:26:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.207+0000 7fea5c2b5700 1 -- 172.21.15.5:0/215144734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea540cdbe0 con 0x7fea540cb3b0 2023-03-03T06:26:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.207+0000 7fea5c2b5700 1 -- 172.21.15.5:0/215144734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5406c850 con 0x7fea540cb3b0 2023-03-03T06:26:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.208+0000 7fea5c2b5700 1 -- 172.21.15.5:0/215144734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5406d3d0 con 0x7fea540cb3b0 2023-03-03T06:26:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.208+0000 7fea4affd700 1 -- 172.21.15.5:0/215144734 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fea4c010070 con 0x7fea540cb3b0 2023-03-03T06:26:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.208+0000 7fea4affd700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea380682f0 0x7fea3806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-03-03T06:26:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.209+0000 7fea4affd700 1 -- 172.21.15.5:0/215144734 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7445+0+0 (secure 0 0 0) 0x7fea4c085430 con 0x7fea540cb3b0 2023-03-03T06:26:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.209+0000 7fea5a051700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea380682f0 0x7fea3806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-03-03T06:26:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.209+0000 7fea5a051700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea380682f0 0x7fea3806a7a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fea4400a950 tx=0x7fea44008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-03-03T06:26:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.213+0000 7fea4affd700 1 -- 172.21.15.5:0/215144734 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fea4c051720 con 0x7fea540cb3b0 2023-03-03T06:26:38.456 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:38.454+0000 7fea5c2b5700 1 -- 172.21.15.5:0/215144734 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fea5404e6e0 con 0x7fea540cb3b0 2023-03-03T06:26:39.007 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:39.005+0000 7fea4affd700 1 -- 172.21.15.5:0/215144734 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v42) v1 ==== 167+0+0 (secure 0 0 0) 0x7fea4c0170d0 con 0x7fea540cb3b0 2023-03-03T06:26:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:39.008+0000 7fea5c2b5700 1 -- 172.21.15.5:0/215144734 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea380682f0 msgr2=0x7fea3806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:39.008+0000 7fea5c2b5700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea380682f0 0x7fea3806a7a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fea4400a950 tx=0x7fea44008040 comp rx=0 tx=0).stop 2023-03-03T06:26:39.011 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:39.008+0000 7fea5c2b5700 1 -- 172.21.15.5:0/215144734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea540cb3b0 msgr2=0x7fea541f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-03-03T06:26:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:39.008+0000 7fea5c2b5700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea540cb3b0 0x7fea541f67e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c7a0 tx=0x7fea4c00cb60 comp rx=0 tx=0).stop 2023-03-03T06:26:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:39.008+0000 7fea5c2b5700 1 -- 172.21.15.5:0/215144734 shutdown_connections 2023-03-03T06:26:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:39.008+0000 7fea5c2b5700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea540cb3b0 0x7fea541f67e0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:39.012 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:39.008+0000 7fea5c2b5700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.5:6832/96507,v1:172.21.15.5:6833/96507] conn(0x7fea380682f0 0x7fea3806a7a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:39.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:39.008+0000 7fea5c2b5700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fea540af110 0x7fea5406bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:39.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:39.008+0000 7fea5c2b5700 1 --2- 172.21.15.5:0/215144734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fea540b2250 0x7fea541f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-03-03T06:26:39.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:39.008+0000 7fea5c2b5700 1 -- 172.21.15.5:0/215144734 >> 172.21.15.5:0/215144734 conn(0x7fea540cc840 msgr2=0x7fea5415f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-03-03T06:26:39.013 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:39.008+0000 7fea5c2b5700 1 -- 172.21.15.5:0/215144734 shutdown_connections 2023-03-03T06:26:39.014 INFO:teuthology.orchestra.run.smithi005.stderr:2023-03-03T06:26:39.008+0000 7fea5c2b5700 1 -- 172.21.15.5:0/215144734 wait complete. 2023-03-03T06:26:39.014 INFO:teuthology.orchestra.run.smithi005.stderr:enabled new snapshots 2023-03-03T06:26:39.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:39.027 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-03-03T06:26:39.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:39.070 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps/.snap/snap00) 2023-03-03T06:26:39.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-03-03T06:26:39.134 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps) 2023-03-03T06:26:39.192 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-03-03T06:26:39.191+0000 7fbb11a1c700 -1 mds.0.cache.den(0x601 10000000000) newly corrupt dentry to be committed: [dentry #0x100/stray1/10000000000 [4,head] auth NULL (dn xlock x=1 by 0x5603c57f7800) (dversion lock w=1 last_client=5750) pv=7 v=1 ap=2 ino=(nil) state=1342177281|new | request=1 lock=2 authpin=1 0x5603c5804500] 2023-03-03T06:26:39.193 INFO:tasks.ceph.mds.a.smithi005.stderr:2023-03-03T06:26:39.191+0000 7fbb11a1c700 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x601is fatal because it is a system directory for this rank 2023-03-03T06:26:40.006 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T06:26:40.004+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-03-03T06:26:40.006 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T06:26:40.004+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-03-03T06:26:40.016 INFO:tasks.ceph.mds.a.smithi005.stderr: -3828> 2023-03-03T06:26:34.538+0000 7fbb0f217700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-03-03T06:26:40.022 INFO:tasks.ceph.mds.a.smithi005.stderr: -32> 2023-03-03T06:26:39.191+0000 7fbb11a1c700 -1 mds.0.cache.den(0x601 10000000000) newly corrupt dentry to be committed: [dentry #0x100/stray1/10000000000 [4,head] auth NULL (dn xlock x=1 by 0x5603c57f7800) (dversion lock w=1 last_client=5750) pv=7 v=1 ap=2 ino=(nil) state=1342177281|new | request=1 lock=2 authpin=1 0x5603c5804500] 2023-03-03T06:26:40.022 INFO:tasks.ceph.mds.a.smithi005.stderr: -30> 2023-03-03T06:26:39.191+0000 7fbb11a1c700 -1 mds.0.damage notify_dentry Damage to dentries in fragment * of ino 0x601is fatal because it is a system directory for this rank 2023-03-03T06:26:40.049 INFO:tasks.ceph.mds.a.smithi005.stdout:starting mds.a at 2023-03-03T06:26:47.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:26:47.580 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:27:17.662 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:27:17.667 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:27:47.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:27:47.735 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:28:17.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:28:17.816 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:28:47.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:28:47.885 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:29:17.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:29:17.957 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:29:48.029 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:29:48.033 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:30:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T06:29:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T06:30:18.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:30:18.108 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:30:48.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:30:48.189 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:31:18.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:31:18.259 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:31:39.182 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-03-03T06:31:39.183 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_c7c3cc84dcd2bd1fdc61d0abde9057ccda2484b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-03-03T06:31:48.328 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:31:48.331 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:32:18.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:32:18.402 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:32:48.471 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:32:48.474 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:33:18.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:33:18.554 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:33:48.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:33:48.626 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:34:18.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:34:18.957 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:34:49.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:34:49.023 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:35:19.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:35:19.084 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:35:49.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:35:49.148 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:36:19.226 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:36:19.229 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:36:49.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:36:49.300 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:37:19.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:37:19.369 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:37:49.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:37:49.470 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:38:19.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:38:19.571 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:38:49.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:38:49.634 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:39:19.720 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:39:19.723 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:39:49.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:39:49.808 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:40:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T06:39:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T06:40:19.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:40:19.871 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:40:49.935 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:40:49.938 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:41:20.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:41:20.009 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:41:50.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:41:50.081 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:42:20.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:42:20.169 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:42:50.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:42:50.294 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:43:20.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:43:20.379 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:43:50.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:43:50.452 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:44:20.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:44:20.515 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:44:50.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:44:50.587 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:45:20.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:45:20.700 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:45:50.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:45:50.789 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:46:20.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:46:20.861 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:46:50.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:46:50.933 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:47:21.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:47:21.022 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:47:51.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:47:51.093 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:48:21.218 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:48:21.221 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:48:51.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:48:51.306 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:49:21.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:49:21.391 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:49:51.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:49:51.452 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:50:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T06:49:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T06:50:21.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:50:21.521 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:50:51.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:50:51.597 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:51:21.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:51:21.683 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:51:51.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:51:51.753 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:52:21.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:52:21.818 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:52:51.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:52:51.890 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:53:21.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:53:21.966 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:53:52.055 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:53:52.058 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:54:22.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:54:22.122 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:54:52.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:54:52.203 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:55:22.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:55:22.274 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:55:52.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:55:52.345 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:56:22.441 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:56:22.444 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:56:52.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:56:52.516 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:57:22.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:57:22.596 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:57:52.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:57:52.690 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:58:22.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:58:22.767 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:58:52.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:58:52.845 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:59:22.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:59:22.986 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:59:53.124 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T06:59:53.127 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:00:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T06:59:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T07:00:23.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:00:23.220 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:00:53.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:00:53.320 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:01:23.395 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:01:23.399 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:01:53.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:01:53.515 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:02:23.615 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:02:23.618 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:02:53.695 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:02:53.699 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:03:23.766 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:03:23.770 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:03:53.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:03:53.850 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:04:23.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:04:23.987 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:04:54.114 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:04:54.117 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:05:24.261 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:05:24.265 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:05:54.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:05:54.330 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:06:24.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:06:24.482 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:06:54.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:06:54.587 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:07:24.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:07:24.741 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:07:54.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:07:54.929 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:08:25.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:08:25.009 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:08:55.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:08:55.080 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:09:25.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:09:25.170 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:09:55.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:09:55.241 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:10:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T07:10:00.000+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T07:10:25.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:10:25.367 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:10:55.449 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:10:55.453 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:11:25.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:11:25.516 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:11:55.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:11:55.587 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:12:25.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:12:25.667 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:12:55.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:12:55.735 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:13:25.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:13:25.806 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:13:55.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:13:55.944 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:14:26.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:14:26.040 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:14:56.178 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:14:56.181 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:15:26.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:15:26.273 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:15:56.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:15:56.391 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:16:26.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:16:26.524 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:16:56.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:16:56.645 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:17:26.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:17:26.783 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:17:56.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:17:56.912 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:18:26.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:18:26.988 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:18:57.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:18:57.136 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:19:27.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:19:27.441 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:19:57.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:19:57.521 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:20:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T07:19:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T07:20:27.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:20:27.658 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:20:57.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:20:57.745 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:21:27.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:21:27.875 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:21:58.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:21:58.038 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:22:28.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:22:28.215 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:22:58.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:22:58.346 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:23:28.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:23:28.466 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:23:58.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:23:58.630 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:24:28.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:24:28.702 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:24:58.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:24:58.787 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:25:28.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:25:28.857 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:25:58.983 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:25:58.986 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:26:29.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:26:29.074 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:26:59.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:26:59.219 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:27:29.338 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:27:29.342 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:27:59.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:27:59.413 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:28:29.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:28:29.475 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:28:59.619 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:28:59.623 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:29:29.686 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:29:29.689 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:29:59.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:29:59.839 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:30:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T07:29:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T07:30:29.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:30:29.977 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:31:00.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:31:00.130 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:31:30.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:31:30.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:32:00.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:32:00.556 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:32:30.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:32:30.627 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:33:00.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:33:00.706 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:33:30.840 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:33:30.843 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:34:00.953 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:34:00.956 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:34:31.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:34:31.085 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:35:01.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:35:01.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:35:31.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:35:31.377 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:36:01.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:36:01.516 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:36:31.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:36:31.661 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:37:01.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:37:01.807 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:37:31.891 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:37:31.894 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:38:02.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:38:02.040 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:38:32.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:38:32.169 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:39:02.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:39:02.307 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:39:32.434 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:39:32.437 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:40:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T07:39:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T07:40:02.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:40:02.507 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:40:32.642 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:40:32.645 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:41:02.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:41:02.733 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:41:32.794 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:41:32.797 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:42:02.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:42:02.941 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:42:33.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:42:33.037 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:43:03.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:43:03.183 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:43:33.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:43:33.278 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:44:03.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:44:03.416 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:44:33.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:44:33.562 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:45:03.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:45:03.875 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:45:34.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:45:34.037 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:46:04.155 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:46:04.158 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:46:34.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:46:34.287 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:47:04.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:47:04.434 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:47:34.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:47:34.555 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:48:04.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:48:04.617 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:48:34.768 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:48:34.771 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:49:04.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:49:04.838 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:49:34.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:49:34.912 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:50:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T07:49:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T07:50:05.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:50:05.085 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:50:35.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:50:35.163 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:51:05.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:51:05.309 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:51:35.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:51:35.422 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:52:05.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:52:05.567 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:52:35.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:52:35.672 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:53:05.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:53:05.801 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:53:35.894 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:53:35.896 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:54:05.957 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:54:05.960 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:54:36.036 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:54:36.040 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:55:06.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:55:06.210 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:55:36.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:55:36.348 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:56:06.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:56:06.460 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:56:36.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:56:36.614 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:57:06.908 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:57:06.911 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:57:36.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:57:36.973 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:58:07.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:58:07.104 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:58:37.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:58:37.184 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:59:07.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:59:07.320 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:59:37.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T07:59:37.440 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:00:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T07:59:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T08:00:07.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:00:07.587 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:00:37.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:00:37.716 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:01:07.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:01:07.828 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:01:37.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:01:37.884 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:02:07.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:02:07.972 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:02:38.104 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:02:38.108 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:03:08.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:03:08.246 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:03:38.355 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:03:38.359 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:04:08.476 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:04:08.479 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:04:38.639 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:04:38.643 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:05:08.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:05:08.804 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:05:38.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:05:38.934 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:06:09.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:06:09.021 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:06:39.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:06:39.086 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:07:09.226 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:07:09.229 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:07:39.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:07:39.368 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:08:09.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:08:09.438 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:08:39.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:08:39.575 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:09:09.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:09:09.705 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:09:39.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:09:39.842 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:10:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T08:10:00.000+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T08:10:09.918 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:10:09.921 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:10:40.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:10:40.059 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:11:10.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:11:10.203 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:11:40.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:11:40.300 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:12:10.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:12:10.454 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:12:40.581 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:12:40.584 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:13:10.719 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:13:10.721 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:13:40.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:13:40.859 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:14:10.994 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:14:10.997 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:14:41.069 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:14:41.073 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:15:11.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:15:11.197 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:15:41.307 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:15:41.310 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:16:11.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:16:11.405 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:16:41.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:16:41.551 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:17:11.678 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:17:11.681 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:17:41.832 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:17:41.835 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:18:12.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:18:12.015 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:18:42.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:18:42.102 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:19:12.178 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:19:12.182 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:19:42.307 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:19:42.310 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:20:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T08:19:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T08:20:12.453 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:20:12.457 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:20:42.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:20:42.610 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:21:12.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:21:12.706 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:21:42.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:21:42.827 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:22:12.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:22:12.915 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:22:43.041 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:22:43.044 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:23:13.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:23:13.116 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:23:43.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:23:43.179 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:24:13.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:24:13.307 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:24:43.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:24:43.420 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:25:13.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:25:13.582 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:25:43.659 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:25:43.661 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:26:13.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:26:13.799 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:26:44.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:26:44.062 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:27:14.129 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:27:14.133 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:27:44.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:27:44.220 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:28:14.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:28:14.349 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:28:44.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:28:44.488 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:29:14.613 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:29:14.616 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:29:44.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:29:44.703 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:30:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T08:29:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T08:30:14.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:30:14.860 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:30:44.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:30:44.955 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:31:15.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:31:15.101 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:31:45.161 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:31:45.164 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:32:15.306 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:32:15.309 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:32:45.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:32:45.464 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:33:15.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:33:15.552 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:33:45.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:33:45.689 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:34:15.832 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:34:15.834 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:34:45.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:34:45.906 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:35:16.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:35:16.076 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:35:46.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:35:46.223 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:36:16.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:36:16.284 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:36:46.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:36:46.419 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:37:16.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:37:16.551 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:37:46.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:37:46.664 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:38:16.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:38:16.827 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:38:46.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:38:46.972 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:39:17.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:39:17.093 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:39:47.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:39:47.231 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:40:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T08:39:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T08:40:17.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:40:17.328 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:40:47.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:40:47.483 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:41:17.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:41:17.619 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:41:47.678 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:41:47.681 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:42:17.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:42:17.745 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:42:47.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:42:47.816 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:43:17.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:43:17.945 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:43:48.088 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:43:48.091 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:44:18.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:44:18.196 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:44:48.331 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:44:48.334 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:45:18.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:45:18.436 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:45:48.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:45:48.587 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:46:18.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:46:18.691 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:46:48.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:46:48.838 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:47:18.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:47:18.958 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:47:49.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:47:49.029 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:48:19.163 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:48:19.166 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:48:49.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:48:49.288 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:49:19.414 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:49:19.417 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:49:49.535 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:49:49.538 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:50:00.002 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T08:49:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T08:50:19.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:50:19.701 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:50:49.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:50:49.770 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:51:19.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:51:19.844 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:51:49.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:51:49.989 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:52:20.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:52:20.117 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:52:50.261 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:52:50.264 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:53:20.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:53:20.401 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:53:50.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:53:50.522 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:54:20.598 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:54:20.602 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:54:50.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:54:50.795 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:55:20.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:55:20.868 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:55:50.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:55:50.942 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:56:21.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:56:21.006 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:56:51.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:56:51.123 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:57:21.188 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:57:21.192 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:57:51.338 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:57:51.340 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:58:21.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:58:21.571 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:58:51.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:58:51.649 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:59:21.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:59:21.830 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:59:51.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T08:59:51.927 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:00:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T08:59:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T09:00:22.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:00:22.078 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:00:52.137 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:00:52.141 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:01:22.275 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:01:22.279 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:01:52.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:01:52.383 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:02:22.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:02:22.529 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:02:52.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:02:52.659 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:03:22.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:03:22.738 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:03:52.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:03:52.893 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:04:23.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:04:23.014 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:04:53.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:04:53.168 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:05:23.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:05:23.315 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:05:53.441 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:05:53.444 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:06:23.571 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:06:23.574 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:06:53.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:06:53.695 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:07:23.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:07:23.792 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:07:53.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:07:53.863 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:08:23.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:08:23.992 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:08:54.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:08:54.339 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:09:24.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:09:24.492 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:09:54.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:09:54.597 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:10:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T09:09:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T09:10:24.740 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:10:24.743 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:10:54.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:10:54.838 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:11:24.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:11:24.976 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:11:55.069 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:11:55.072 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:12:25.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:12:25.202 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:12:55.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:12:55.368 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:13:25.466 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:13:25.469 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:13:55.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:13:55.614 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:14:25.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:14:25.777 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:14:55.879 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:14:55.881 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:15:26.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:15:26.010 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:15:56.112 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:15:56.115 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:16:26.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:16:26.227 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:16:56.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:16:56.365 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:17:26.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:17:26.529 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:17:56.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:17:56.600 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:18:26.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:18:26.696 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:18:56.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:18:56.768 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:19:26.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:19:26.837 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:19:56.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:19:56.910 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:20:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T09:19:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T09:20:27.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:20:27.096 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:20:57.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:20:57.234 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:21:27.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:21:27.380 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:21:57.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:21:57.509 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:22:27.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:22:27.590 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:22:57.773 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:22:57.776 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:23:27.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:23:27.856 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:23:57.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:23:57.977 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:24:28.128 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:24:28.130 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:24:58.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:24:58.220 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:25:28.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:25:28.356 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:25:58.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:25:58.477 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:26:28.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:26:28.615 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:26:58.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:26:58.744 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:27:28.820 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:27:28.823 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:27:58.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:27:58.890 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:28:29.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:28:29.016 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:28:59.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:28:59.148 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:29:29.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:29:29.283 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:29:59.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:29:59.412 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:30:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T09:29:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T09:30:29.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:30:29.733 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:30:59.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:30:59.837 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:31:29.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:31:29.951 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:32:00.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:32:00.062 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:32:30.205 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:32:30.208 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:33:00.360 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:33:00.364 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:33:30.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:33:30.475 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:34:00.610 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:34:00.613 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:34:30.723 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:34:30.726 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:35:00.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:35:00.880 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:35:30.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:35:30.951 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:36:01.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:36:01.114 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:36:31.240 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:36:31.243 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:37:01.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:37:01.312 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:37:31.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:37:31.484 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:38:01.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:38:01.606 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:38:31.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:38:31.694 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:39:01.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:39:01.840 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:39:31.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:39:31.978 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:40:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T09:39:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T09:40:02.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:40:02.082 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:40:32.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:40:32.245 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:41:02.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:41:02.333 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:41:32.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:41:32.453 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:42:02.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:42:02.549 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:42:32.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:42:32.661 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:43:02.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:43:02.808 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:43:32.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:43:32.871 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:44:02.998 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:44:03.001 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:44:33.135 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:44:33.137 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:45:03.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:45:03.275 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:45:33.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:45:33.414 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:46:03.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:46:03.577 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:46:33.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:46:33.715 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:47:03.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:47:03.844 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:47:34.154 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:47:34.156 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:48:04.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:48:04.243 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:48:34.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:48:34.373 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:49:04.491 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:49:04.494 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:49:34.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:49:34.642 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:50:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T09:49:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T09:50:04.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:50:04.736 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:50:34.881 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:50:34.884 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:51:04.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:51:04.988 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:51:35.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:51:35.150 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:52:05.227 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:52:05.230 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:52:35.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:52:35.368 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:53:05.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:53:05.497 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:53:35.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:53:35.601 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:54:05.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:54:05.739 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:54:35.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:54:35.910 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:55:06.036 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:55:06.039 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:55:36.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:55:36.178 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:56:06.320 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:56:06.323 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:56:36.382 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:56:36.385 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:57:06.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:57:06.655 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:57:36.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:57:36.736 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:58:06.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:58:06.857 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:58:36.966 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:58:36.969 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:59:07.112 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:59:07.115 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:59:37.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T09:59:37.227 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:00:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T09:59:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T10:00:07.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:00:07.332 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:00:37.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:00:37.453 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:01:07.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:01:07.591 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:01:37.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:01:37.696 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:02:07.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:02:07.816 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:02:37.876 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:02:37.879 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:03:08.005 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:03:08.008 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:03:38.110 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:03:38.113 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:04:08.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:04:08.285 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:04:38.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:04:38.380 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:05:08.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:05:08.466 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:05:38.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:05:38.598 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:06:08.758 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:06:08.761 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:06:38.895 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:06:38.898 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:07:09.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:07:09.028 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:07:39.172 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:07:39.175 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:08:09.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:08:09.258 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:08:39.389 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:08:39.392 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:09:09.469 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:09:09.472 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:09:39.539 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:09:39.543 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:10:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T10:09:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T10:10:09.653 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:10:09.656 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:10:39.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:10:39.802 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:11:09.953 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:11:09.956 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:11:40.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:11:40.102 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:12:10.178 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:12:10.181 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:12:40.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:12:40.302 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:13:10.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:13:10.391 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:13:40.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:13:40.604 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:14:10.680 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:14:10.683 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:14:40.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:14:40.828 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:15:10.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:15:10.965 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:15:41.091 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:15:41.094 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:16:11.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:16:11.242 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:16:41.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:16:41.383 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:17:11.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:17:11.468 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:17:41.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:17:41.599 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:18:11.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:18:11.737 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:18:41.848 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:18:41.852 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:19:11.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:19:11.990 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:19:42.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:19:42.137 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:20:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T10:19:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T10:20:12.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:20:12.257 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:20:42.437 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:20:42.439 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:21:12.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:21:12.550 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:21:42.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:21:42.639 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:22:12.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:22:12.702 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:22:42.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:22:42.766 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:23:12.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:23:12.838 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:23:42.897 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:23:42.900 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:24:13.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:24:13.054 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:24:43.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:24:43.184 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:25:13.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:25:13.339 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:25:43.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:25:43.419 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:26:13.490 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:26:13.494 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:26:43.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:26:43.578 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:27:13.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:27:13.708 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:27:43.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:27:43.769 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:28:13.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:28:13.927 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:28:44.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:28:44.098 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:29:14.224 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:29:14.227 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:29:44.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:29:44.298 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:30:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T10:29:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T10:30:14.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:30:14.386 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:30:44.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:30:44.484 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:31:14.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:31:14.631 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:31:44.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:31:44.736 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:32:14.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:32:14.815 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:32:44.976 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:32:44.979 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:33:15.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:33:15.092 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:33:45.218 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:33:45.221 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:34:15.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:34:15.300 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:34:45.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:34:45.475 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:35:15.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:35:15.611 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:35:45.722 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:35:45.725 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:36:15.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:36:15.787 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:36:45.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:36:45.850 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:37:15.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:37:15.923 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:37:45.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:37:45.986 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:38:16.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:38:16.048 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:38:46.191 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:38:46.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:39:16.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:39:16.308 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:39:46.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:39:46.438 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:40:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T10:39:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T10:40:16.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:40:16.519 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:40:46.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:40:46.683 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:41:16.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:41:16.811 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:41:46.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:41:46.917 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:42:16.988 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:42:16.991 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:42:47.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:42:47.068 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:43:17.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:43:17.222 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:43:47.307 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:43:47.310 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:44:17.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:44:17.383 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:44:47.535 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:44:47.537 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:45:17.622 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:45:17.625 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:45:47.695 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:45:47.698 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:46:17.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:46:17.786 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:46:47.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:46:47.941 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:47:18.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:47:18.013 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:47:48.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:47:48.152 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:48:18.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:48:18.273 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:48:48.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:48:48.436 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:49:18.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:49:18.500 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:49:48.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:49:48.638 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:50:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T10:49:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T10:50:18.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:50:18.718 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:50:48.795 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:50:48.798 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:51:18.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:51:18.881 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:51:48.946 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:51:48.949 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:52:19.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:52:19.054 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:52:49.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:52:49.118 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:53:19.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:53:19.272 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:53:49.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:53:49.395 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:54:19.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:54:19.516 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:54:49.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:54:49.596 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:55:19.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:55:19.782 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:55:49.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:55:49.873 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:56:20.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:56:20.100 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:56:50.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:56:50.183 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:57:20.310 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:57:20.313 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:57:50.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:57:50.460 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:58:20.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:58:20.573 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:58:50.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:58:50.905 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:59:20.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:59:20.967 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:59:51.036 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T10:59:51.039 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:00:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T10:59:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T11:00:21.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:00:21.111 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:00:51.246 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:00:51.249 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:01:21.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:01:21.411 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:01:51.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:01:51.477 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:02:21.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:02:21.631 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:02:51.740 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:02:51.743 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:03:21.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:03:21.848 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:03:51.916 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:03:51.920 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:04:22.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:04:22.049 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:04:52.168 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:04:52.172 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:05:22.315 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:05:22.318 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:05:52.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:05:52.414 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:06:22.565 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:06:22.568 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:06:52.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:06:52.647 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:07:22.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:07:22.744 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:07:52.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:07:52.942 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:08:23.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:08:23.030 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:08:53.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:08:53.168 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:09:23.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:09:23.272 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:09:53.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:09:53.411 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:10:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T11:09:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T11:10:23.538 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:10:23.541 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:10:53.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:10:53.695 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:11:23.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:11:23.767 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:11:53.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:11:53.855 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:12:23.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:12:23.977 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:12:54.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:12:54.041 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:13:24.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:13:24.126 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:13:54.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:13:54.198 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:14:24.277 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:14:24.280 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:14:54.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:14:54.352 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:15:24.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:15:24.431 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:15:54.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:15:54.520 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:16:24.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:16:24.608 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:16:54.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:16:54.680 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:17:24.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:17:24.818 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:17:54.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:17:54.966 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:18:25.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:18:25.056 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:18:55.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:18:55.128 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:19:25.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:19:25.196 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:19:55.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:19:55.343 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:20:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T11:20:00.000+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T11:20:25.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:20:25.428 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:20:55.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:20:55.577 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:21:25.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:21:25.649 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:21:55.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:21:55.770 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:22:25.914 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:22:25.917 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:22:56.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:22:56.048 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:23:26.157 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:23:26.161 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:23:56.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:23:56.234 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:24:26.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:24:26.331 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:24:56.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:24:56.402 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:25:26.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:25:26.531 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:25:56.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:25:56.644 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:26:26.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:26:26.799 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:26:56.934 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:26:56.937 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:27:27.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:27:27.100 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:27:57.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:27:57.222 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:28:27.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:28:27.285 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:28:57.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:28:57.427 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:29:27.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:29:27.548 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:29:57.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:29:57.702 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:30:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T11:29:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T11:30:27.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:30:27.842 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:30:57.943 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:30:57.946 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:31:28.123 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:31:28.126 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:31:58.185 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:31:58.188 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:32:28.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:32:28.343 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:32:58.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:32:58.483 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:33:28.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:33:28.545 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:33:58.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:33:58.691 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:34:28.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:34:28.770 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:34:58.897 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:34:58.899 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:35:29.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:35:29.012 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:35:59.172 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:35:59.175 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:36:29.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:36:29.246 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:36:59.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:36:59.309 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:37:29.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:37:29.430 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:37:59.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:37:59.501 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:38:29.645 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:38:29.648 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:38:59.790 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:38:59.793 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:39:29.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:39:29.868 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:39:59.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:39:59.994 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:40:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T11:39:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T11:40:30.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:40:30.070 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:41:00.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:41:00.144 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:41:30.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:41:30.222 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:42:00.375 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:42:00.378 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:42:30.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:42:30.533 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:43:00.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:43:00.673 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:43:30.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:43:30.736 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:44:00.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:44:00.872 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:44:30.998 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:44:31.000 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:45:01.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:45:01.147 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:45:31.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:45:31.318 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:46:01.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:46:01.447 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:46:31.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:46:31.569 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:47:01.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:47:01.672 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:47:31.782 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:47:31.786 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:48:01.896 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:48:01.899 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:48:32.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:48:32.021 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:49:02.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:49:02.104 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:49:32.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:49:32.175 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:50:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T11:49:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T11:50:02.330 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:50:02.332 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:50:32.459 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:50:32.462 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:51:02.581 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:51:02.584 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:51:32.711 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:51:32.715 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:52:02.816 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:52:02.819 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:52:32.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:52:32.973 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:53:03.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:53:03.196 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:53:33.332 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:53:33.335 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:54:03.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:54:03.488 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:54:33.659 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:54:33.662 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:55:03.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:55:03.803 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:55:33.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:55:33.941 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:56:04.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:56:04.063 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:56:34.198 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:56:34.201 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:57:04.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:57:04.297 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:57:34.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:57:34.426 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:58:04.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:58:04.497 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:58:34.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:58:34.707 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:59:04.769 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:59:04.772 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:59:34.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T11:59:34.885 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:00:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T11:59:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T12:00:04.945 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:00:04.948 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:00:35.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:00:35.086 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:01:05.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:01:05.200 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:01:35.333 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:01:35.337 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:02:05.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:02:05.467 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:02:35.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:02:35.530 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:03:05.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:03:05.677 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:03:35.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:03:35.839 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:04:05.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:04:06.002 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:04:36.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:04:36.147 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:05:06.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:05:06.213 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:05:36.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:05:36.365 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:06:06.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:06:06.578 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:06:36.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:06:36.640 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:07:06.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:07:06.753 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:07:36.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:07:36.841 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:08:06.984 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:08:06.988 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:08:37.054 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:08:37.057 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:09:07.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:09:07.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:09:37.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:09:37.300 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:10:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T12:09:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T12:10:07.434 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:10:07.437 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:10:37.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:10:37.583 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:11:07.652 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:11:07.655 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:11:37.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:11:37.818 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:12:07.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:12:07.972 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:12:38.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:12:38.068 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:13:08.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:13:08.224 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:13:38.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:13:38.352 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:14:08.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:14:08.506 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:14:38.591 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:14:38.594 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:15:08.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:15:08.664 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:15:38.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:15:38.733 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:16:08.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:16:08.874 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:16:38.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:16:38.962 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:17:09.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:17:09.108 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:17:39.251 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:17:39.254 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:18:09.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:18:09.325 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:18:39.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:18:39.471 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:19:09.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:19:09.584 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:19:39.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:19:39.730 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:20:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T12:19:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T12:20:09.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:20:09.859 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:20:39.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:20:39.989 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:21:10.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:21:10.135 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:21:40.211 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:21:40.215 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:22:10.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:22:10.344 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:22:40.420 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:22:40.423 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:23:10.565 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:23:10.569 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:23:40.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:23:40.682 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:24:10.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:24:10.828 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:24:40.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:24:40.974 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:25:11.092 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:25:11.095 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:25:41.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:25:41.242 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:26:11.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:26:11.312 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:26:41.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:26:41.383 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:27:11.527 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:27:11.530 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:27:41.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:27:41.661 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:28:11.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:28:11.816 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:28:41.891 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:28:41.894 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:29:12.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:29:12.041 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:29:42.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:29:42.136 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:30:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T12:29:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T12:30:12.279 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:30:12.282 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:30:42.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:30:42.428 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:31:12.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:31:12.800 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:31:42.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:31:42.865 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:32:12.922 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:32:12.925 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:32:43.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:32:43.055 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:33:13.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:33:13.184 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:33:43.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:33:43.338 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:34:13.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:34:13.401 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:34:43.619 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:34:43.622 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:35:13.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:35:13.694 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:35:43.811 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:35:43.815 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:36:13.883 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:36:13.886 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:36:43.990 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:36:43.993 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:37:14.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:37:14.111 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:37:44.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:37:44.204 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:38:14.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:38:14.346 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:38:44.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:38:44.432 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:39:14.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:39:14.554 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:39:44.671 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:39:44.674 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:40:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T12:40:00.000+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T12:40:14.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:40:14.738 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:40:44.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:40:44.924 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:41:14.994 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:41:14.997 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:41:45.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:41:45.129 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:42:15.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:42:15.232 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:42:45.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:42:45.412 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:43:15.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:43:15.557 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:43:45.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:43:45.670 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:44:15.729 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:44:15.732 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:44:45.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:44:45.804 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:45:15.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:45:15.942 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:45:46.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:45:46.072 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:46:16.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:46:16.193 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:46:46.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:46:46.321 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:47:16.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:47:16.485 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:47:46.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:47:46.615 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:48:16.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:48:16.735 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:48:46.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:48:46.806 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:49:17.000 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:49:17.004 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:49:47.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:49:47.066 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:50:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T12:49:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T12:50:17.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:50:17.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:50:47.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:50:47.308 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:51:17.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:51:17.471 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:51:47.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:51:47.566 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:52:17.719 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:52:17.722 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:52:47.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:52:47.802 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:53:17.918 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:53:17.922 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:53:48.040 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:53:48.043 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:54:18.161 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:54:18.163 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:54:48.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:54:48.293 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:55:18.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:55:18.422 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:55:48.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:55:48.500 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:56:18.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:56:18.641 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:56:48.725 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:56:48.728 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:57:18.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:57:18.833 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:57:48.896 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:57:48.899 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:58:19.048 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:58:19.052 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:58:49.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:58:49.197 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:59:19.333 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:59:19.336 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:59:49.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T12:59:49.464 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:00:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T12:59:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T13:00:19.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:00:19.536 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:00:49.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:00:49.616 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:01:19.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:01:19.704 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:01:49.780 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:01:49.783 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:02:20.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:02:20.026 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:02:50.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:02:50.102 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:03:20.168 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:03:20.171 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:03:50.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:03:50.327 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:04:20.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:04:20.439 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:04:50.590 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:04:50.593 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:05:20.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:05:20.781 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:05:50.891 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:05:50.894 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:06:20.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:06:20.974 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:06:51.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:06:51.037 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:07:21.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:07:21.173 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:07:51.291 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:07:51.294 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:08:21.389 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:08:21.392 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:08:51.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:08:51.529 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:09:21.598 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:09:21.601 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:09:51.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:09:51.685 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:10:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T13:09:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T13:10:21.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:10:21.826 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:10:51.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:10:51.965 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:11:22.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:11:22.036 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:11:52.178 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:11:52.182 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:12:22.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:12:22.313 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:12:52.471 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:12:52.474 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:13:22.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:13:22.577 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:13:52.671 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:13:52.674 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:14:22.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:14:22.753 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:14:52.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:14:52.839 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:15:22.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:15:22.921 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:15:53.055 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:15:53.058 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:16:23.143 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:16:23.147 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:16:53.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:16:53.284 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:17:23.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:17:23.422 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:17:53.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:17:53.575 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:18:23.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:18:23.688 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:18:53.822 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:18:53.825 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:19:23.935 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:19:23.938 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:19:54.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:19:54.102 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:20:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T13:19:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T13:20:24.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:20:24.240 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:20:54.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:20:54.370 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:21:24.520 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:21:24.525 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:21:54.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:21:54.611 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:22:24.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:22:24.766 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:22:55.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:22:55.013 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:23:25.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:23:25.142 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:23:55.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:23:55.255 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:24:25.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:24:25.401 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:24:55.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:24:55.473 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:25:25.625 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:25:25.628 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:25:55.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:25:55.741 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:26:25.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:26:25.878 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:26:55.937 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:26:55.941 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:27:26.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:27:26.112 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:27:56.222 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:27:56.224 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:28:26.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:28:26.330 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:28:56.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:28:56.476 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:29:26.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:29:26.605 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:29:56.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:29:56.718 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:30:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T13:29:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T13:30:26.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:30:26.808 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:30:56.894 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:30:56.897 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:31:26.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:31:26.982 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:31:57.110 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:31:57.114 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:32:27.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:32:27.260 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:32:57.393 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:32:57.396 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:33:27.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:33:27.476 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:33:57.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:33:57.614 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:34:27.707 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:34:27.710 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:34:57.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:34:57.791 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:35:27.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:35:27.878 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:35:57.996 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:35:57.999 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:36:28.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:36:28.113 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:36:58.231 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:36:58.234 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:37:28.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:37:28.347 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:37:58.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:37:58.485 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:38:28.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:38:28.590 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:38:58.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:38:58.744 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:39:28.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:39:28.857 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:39:58.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:39:58.927 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:40:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T13:39:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T13:40:29.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:40:29.074 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:40:59.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:40:59.220 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:41:29.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:41:29.375 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:41:59.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:41:59.521 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:42:29.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:42:29.667 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:43:00.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:43:00.022 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:43:30.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:43:30.084 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:44:00.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:44:00.222 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:44:30.333 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:44:30.336 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:45:00.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:45:00.465 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:45:30.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:45:30.581 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:46:00.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:46:00.707 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:46:30.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:46:30.871 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:47:01.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:47:01.017 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:47:31.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:47:31.163 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:48:01.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:48:01.293 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:48:31.369 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:48:31.372 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:49:01.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:49:01.518 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:49:31.645 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:49:31.648 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:50:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T13:49:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T13:50:01.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:50:01.795 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:50:31.896 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:50:31.900 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:51:02.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:51:02.037 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:51:32.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:51:32.183 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:52:02.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:52:02.523 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:52:32.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:52:32.581 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:53:02.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:53:02.713 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:53:32.789 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:53:32.792 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:54:02.927 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:54:02.929 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:54:33.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:54:33.076 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:55:03.161 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:55:03.166 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:55:33.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:55:33.294 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:56:03.420 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:56:03.423 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:56:33.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:56:33.511 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:57:03.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:57:03.599 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:57:33.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:57:33.720 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:58:03.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:58:03.782 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:58:33.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:58:33.895 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:59:03.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:59:03.966 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:59:34.092 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T13:59:34.096 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:00:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T14:00:00.000+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T14:00:04.187 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:00:04.190 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:00:34.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:00:34.446 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:01:04.510 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:01:04.513 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:01:34.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:01:34.588 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:02:04.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:02:04.719 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:02:34.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:02:34.838 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:03:04.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:03:04.985 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:03:35.045 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:03:35.050 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:04:05.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:04:05.186 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:04:35.294 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:04:35.298 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:05:05.374 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:05:05.377 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:05:35.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:05:35.448 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:06:05.617 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:06:05.623 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:06:35.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:06:35.775 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:07:05.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:07:05.895 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:07:36.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:07:36.097 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:08:06.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:08:06.221 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:08:36.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:08:36.368 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:09:06.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:09:06.448 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:09:36.589 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:09:36.593 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:10:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T14:09:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T14:10:06.657 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:10:06.671 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:10:36.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:10:36.875 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:11:07.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:11:07.009 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:11:37.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:11:37.087 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:12:07.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:12:07.243 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:12:37.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:12:37.319 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:13:07.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:13:07.464 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:13:37.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:13:37.662 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:14:07.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:14:07.790 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:14:37.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:14:37.851 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:15:07.996 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:15:07.999 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:15:38.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:15:38.070 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:16:08.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:16:08.217 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:16:38.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:16:38.354 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:17:08.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:17:08.418 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:17:38.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:17:38.487 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:18:08.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:18:08.617 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:18:38.727 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:18:38.730 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:19:08.881 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:19:08.884 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:19:38.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:19:38.955 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:20:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T14:19:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T14:20:09.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:20:09.049 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:20:39.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:20:39.215 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:21:09.365 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:21:09.369 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:21:39.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:21:39.439 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:22:09.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:22:09.601 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:22:39.720 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:22:39.724 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:23:09.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:23:09.986 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:23:40.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:23:40.056 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:24:10.200 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:24:10.203 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:24:40.321 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:24:40.325 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:25:10.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:25:10.454 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:25:40.590 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:25:40.594 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:26:10.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:26:10.731 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:26:40.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:26:40.862 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:27:10.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:27:11.000 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:27:41.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:27:41.097 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:28:11.257 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:28:11.260 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:28:41.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:28:41.415 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:29:11.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:29:11.471 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:29:41.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:29:41.627 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:30:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T14:29:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T14:30:11.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:30:11.787 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:30:41.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:30:41.911 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:31:11.978 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:31:11.981 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:31:42.124 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:31:42.127 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:32:12.187 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:32:12.190 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:32:42.250 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:32:42.253 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:33:12.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:33:12.322 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:33:42.452 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:33:42.456 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:34:12.565 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:34:12.568 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:34:42.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:34:42.717 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:35:12.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:35:12.779 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:35:42.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:35:42.891 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:36:13.092 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:36:13.095 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:36:43.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:36:43.259 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:37:13.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:37:13.315 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:37:43.382 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:37:43.385 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:38:13.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:38:13.457 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:38:43.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:38:43.549 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:39:13.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:39:13.676 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:39:43.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:39:43.806 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:40:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T14:39:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T14:40:13.965 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:40:13.969 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:40:44.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:40:44.091 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:41:14.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:41:14.170 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:41:44.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:41:44.308 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:42:14.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:42:14.394 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:42:44.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:42:44.468 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:43:14.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:43:14.598 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:43:44.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:43:44.720 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:44:14.771 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:44:14.775 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:44:44.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:44:44.863 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:45:14.998 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:45:15.002 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:45:45.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:45:45.164 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:46:15.323 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:46:15.326 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:46:45.453 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:46:45.456 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:47:15.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:47:15.594 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:47:45.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:47:45.716 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:48:15.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:48:15.863 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:48:46.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:48:46.010 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:49:16.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:49:16.098 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:49:46.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:49:46.203 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:50:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T14:49:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T14:50:16.321 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:50:16.325 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:50:46.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:50:46.386 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:51:16.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:51:16.465 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:51:46.535 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:51:46.539 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:52:16.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:52:16.626 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:52:46.771 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:52:46.774 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:53:16.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:53:16.920 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:53:46.996 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:53:47.002 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:54:17.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:54:17.163 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:54:47.223 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:54:47.227 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:55:17.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:55:17.301 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:55:47.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:55:47.477 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:56:17.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:56:17.600 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:56:47.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:56:47.687 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:57:17.821 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:57:17.824 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:57:47.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:57:47.947 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:58:18.091 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:58:18.095 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:58:48.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:58:48.234 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:59:18.369 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:59:18.372 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:59:48.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T14:59:48.501 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:00:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T14:59:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T15:00:18.585 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:00:18.588 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:00:48.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:00:48.737 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:01:18.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:01:18.841 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:01:49.009 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:01:49.013 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:02:19.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:02:19.169 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:02:49.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:02:49.301 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:03:19.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:03:19.419 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:03:49.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:03:49.550 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:04:19.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:04:19.618 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:04:49.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:04:49.759 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:05:19.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:05:19.861 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:05:50.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:05:50.017 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:06:20.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:06:20.139 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:06:50.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:06:50.285 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:07:20.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:07:20.347 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:07:50.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:07:50.421 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:08:20.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:08:20.500 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:08:50.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:08:50.580 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:09:20.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:09:20.660 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:09:50.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:09:50.789 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:10:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T15:09:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T15:10:20.932 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:10:20.935 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:10:51.054 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:10:51.057 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:11:21.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:11:21.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:11:51.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:11:51.350 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:12:21.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:12:21.422 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:12:51.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:12:51.577 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:13:21.678 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:13:21.681 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:13:51.817 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:13:51.820 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:14:21.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:14:21.958 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:14:52.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:14:52.104 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:15:22.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:15:22.184 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:15:52.262 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:15:52.266 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:16:22.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:16:22.354 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:16:52.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:16:52.415 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:17:22.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:17:22.554 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:17:52.613 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:17:52.617 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:18:22.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:18:22.686 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:18:52.766 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:18:52.769 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:19:22.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:19:22.831 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:19:52.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:19:52.902 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:20:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T15:19:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T15:20:22.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:20:22.974 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:20:53.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:20:53.062 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:21:23.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:21:23.153 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:21:53.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:21:53.305 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:22:23.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:22:23.459 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:22:53.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:22:53.598 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:23:23.662 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:23:23.665 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:23:53.830 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:23:53.834 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:24:23.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:24:23.913 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:24:53.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:24:53.985 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:25:24.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:25:24.140 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:25:54.316 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:25:54.319 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:26:24.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:26:24.397 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:26:54.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:26:54.547 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:27:24.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:27:24.702 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:27:54.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:27:54.773 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:28:24.883 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:28:24.887 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:28:54.965 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:28:54.969 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:29:25.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:29:25.046 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:29:55.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:29:55.136 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:30:00.001 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T15:29:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T15:30:25.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:30:25.283 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:30:55.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:30:55.356 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:31:25.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:31:25.485 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:31:55.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:31:55.640 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:32:25.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:32:25.737 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:32:55.806 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:32:55.809 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:33:25.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:33:25.873 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:33:56.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:33:56.028 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:34:26.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:34:26.108 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:34:56.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:34:56.172 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:35:26.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:35:26.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:35:56.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:35:56.322 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:36:26.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:36:26.421 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:36:56.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:36:56.489 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:37:26.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:37:26.561 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:37:56.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:37:56.717 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:38:26.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:38:26.788 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:38:56.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:38:56.858 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:39:26.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:39:26.923 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:39:56.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:39:56.994 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:40:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T15:39:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T15:40:27.061 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:40:27.064 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:40:57.143 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:40:57.146 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:41:27.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:41:27.242 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:41:57.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:41:57.323 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:42:27.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:42:27.411 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:42:57.472 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:42:57.476 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:43:27.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:43:27.548 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:43:57.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:43:57.627 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:44:27.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:44:27.699 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:44:57.773 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:44:57.776 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:45:27.840 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:45:27.843 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:45:57.900 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:45:57.903 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:46:27.976 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:46:27.979 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:46:58.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:46:58.045 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:47:28.128 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:47:28.131 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:47:58.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:47:58.204 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:48:28.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:48:28.276 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:48:58.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:48:58.348 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:49:28.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:49:28.410 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:49:58.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:49:58.531 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:50:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T15:49:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T15:50:28.589 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:50:28.592 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:50:58.666 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:50:58.669 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:51:28.806 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:51:28.809 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:51:58.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:51:58.872 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:52:28.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:52:28.968 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:52:59.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:52:59.032 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:53:29.092 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:53:29.096 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:53:59.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:53:59.222 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:54:29.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:54:29.301 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:54:59.360 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:54:59.364 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:55:29.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:55:29.442 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:55:59.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:55:59.514 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:56:29.590 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:56:29.593 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:56:59.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:56:59.649 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:57:29.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:57:29.739 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:57:59.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:57:59.806 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:58:29.879 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:58:29.883 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:59:00.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:59:00.007 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:59:30.091 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T15:59:30.094 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:00:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T15:59:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T16:00:00.153 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:00:00.156 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:00:30.259 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:00:30.262 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:01:00.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:01:00.340 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:01:30.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:01:30.415 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:02:00.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:02:00.583 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:02:30.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:02:30.754 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:03:00.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:03:00.911 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:03:31.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:03:31.021 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:04:01.155 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:04:01.159 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:04:31.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:04:31.238 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:05:01.381 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:05:01.384 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:05:31.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:05:31.496 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:06:01.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:06:01.551 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:06:31.640 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:06:31.644 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:07:01.704 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:07:01.707 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:07:31.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:07:31.796 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:08:01.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:08:01.877 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:08:31.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:08:31.947 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:09:02.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:09:02.028 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:09:32.121 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:09:32.124 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:10:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T16:09:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T16:10:02.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:10:02.179 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:10:32.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:10:32.307 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:11:02.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:11:02.411 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:11:32.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:11:32.557 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:12:02.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:12:02.671 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:12:32.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:12:32.800 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:13:02.934 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:13:02.938 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:13:33.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:13:33.075 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:14:03.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:14:03.212 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:14:33.291 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:14:33.294 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:15:03.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:15:03.387 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:15:33.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:15:33.447 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:16:03.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:16:03.519 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:16:33.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:16:33.667 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:17:03.768 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:17:03.772 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:17:33.914 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:17:33.918 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:18:04.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:18:04.005 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:18:34.114 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:18:34.118 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:19:04.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:19:04.271 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:19:34.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:19:34.393 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:19:59.999 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T16:19:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T16:20:04.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:20:04.522 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:20:34.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:20:34.677 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:21:04.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:21:04.848 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:21:34.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:21:34.985 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:22:05.103 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:22:05.107 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:22:35.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:22:35.186 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:23:05.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:23:05.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:23:35.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:23:35.325 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:24:05.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:24:05.407 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:24:35.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:24:35.485 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:25:05.562 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:25:05.565 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:25:35.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:25:35.738 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:26:05.797 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:26:05.801 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:26:35.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:26:35.874 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:27:05.934 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:27:05.937 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:27:36.007 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:27:36.010 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:28:06.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:28:06.109 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:28:36.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:28:36.189 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:29:06.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:29:06.251 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:29:36.412 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:29:36.415 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:29:59.999 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T16:29:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T16:30:06.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:30:06.478 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:30:36.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:30:36.548 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:31:06.676 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:31:06.679 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:31:36.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:31:36.753 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:32:06.814 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:32:06.818 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:32:36.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:32:36.889 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:33:06.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:33:06.962 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:33:37.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:33:37.135 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:34:07.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:34:07.271 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:34:37.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:34:37.403 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:35:07.536 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:35:07.539 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:35:37.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:35:37.742 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:36:07.803 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:36:07.807 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:36:37.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:36:37.929 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:37:08.047 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:37:08.050 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:37:38.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:37:38.195 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:38:08.330 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:38:08.333 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:38:38.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:38:38.453 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:39:08.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:39:08.524 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:39:38.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:39:38.581 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:39:59.999 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T16:39:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T16:40:08.722 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:40:08.725 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:40:38.869 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:40:38.873 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:41:08.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:41:08.941 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:41:39.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:41:39.096 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:42:09.205 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:42:09.209 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:42:39.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:42:39.338 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:43:09.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:43:09.405 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:43:39.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:43:39.510 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:44:09.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:44:09.566 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:44:39.642 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:44:39.645 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:45:09.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:45:09.718 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:45:39.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:45:39.789 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:46:09.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:46:09.844 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:46:39.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:46:39.972 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:47:10.123 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:47:10.126 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:47:40.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:47:40.272 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:48:10.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:48:10.477 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:48:40.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:48:40.614 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:49:10.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:49:10.760 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:49:40.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:49:40.906 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:49:59.999 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T16:49:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T16:50:10.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:50:10.985 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:50:41.128 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:50:41.131 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:51:11.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:51:11.294 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:51:41.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:51:41.449 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:52:11.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:52:11.520 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:52:41.657 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:52:41.661 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:53:11.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:53:11.803 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:53:41.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:53:41.906 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:54:12.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:54:12.045 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:54:42.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:54:42.102 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:55:12.250 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:55:12.253 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:55:42.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:55:42.391 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:56:12.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:56:12.504 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:56:42.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:56:42.659 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:57:12.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:57:12.721 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:57:42.840 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:57:42.844 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:58:12.995 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:58:12.998 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:58:43.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:58:43.173 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:59:13.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:59:13.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:59:43.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:59:43.387 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T16:59:59.999 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T16:59:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T17:00:13.488 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:00:13.491 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:00:43.617 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:00:43.620 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:01:13.721 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:01:13.725 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:01:43.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:01:43.871 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:02:14.030 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:02:14.034 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:02:44.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:02:44.130 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:03:14.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:03:14.239 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:03:44.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:03:44.397 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:04:14.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:04:14.500 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:04:44.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:04:44.630 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:05:14.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:05:14.767 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:05:44.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:05:44.856 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:06:14.998 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:06:15.001 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:06:45.078 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:06:45.082 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:07:15.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:07:15.219 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:07:45.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:07:45.374 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:08:15.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:08:15.510 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:08:45.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:08:45.582 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:09:15.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:09:15.736 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:09:45.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:09:45.849 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:10:00.000 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T17:09:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T17:10:15.983 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:10:15.986 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:10:46.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:10:46.150 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:11:16.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:11:16.305 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:11:46.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:11:46.408 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:12:16.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:12:16.595 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:12:46.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:12:46.742 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:13:16.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:13:16.857 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:13:47.047 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:13:47.050 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:14:17.110 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:14:17.113 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:14:47.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:14:47.192 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:15:17.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:15:17.272 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:15:47.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:15:47.342 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:16:17.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:16:17.511 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:16:47.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:16:47.576 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:17:17.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:17:17.705 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:17:47.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:17:47.790 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:18:17.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:18:17.847 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:18:47.930 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:18:47.933 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:19:17.994 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:19:17.997 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:19:48.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:19:48.078 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:19:59.998 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T17:19:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T17:20:18.137 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:20:18.140 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:20:48.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:20:48.213 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:21:18.273 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:21:18.277 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:21:48.350 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:21:48.353 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:22:18.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:22:18.417 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:22:48.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:22:48.486 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:23:18.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:23:18.590 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:23:48.676 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:23:48.679 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:24:18.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:24:18.750 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:24:48.811 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:24:48.814 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:25:18.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:25:18.876 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:25:48.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:25:48.952 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:26:19.041 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:26:19.044 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:26:49.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:26:49.121 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:27:19.190 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:27:19.194 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:27:49.261 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:27:49.264 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:28:19.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:28:19.338 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:28:49.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:28:49.416 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:29:19.508 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:29:19.511 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:29:49.582 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:29:49.586 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:29:59.998 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T17:29:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T17:30:19.651 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:30:19.655 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:30:49.729 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:30:49.739 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:31:19.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:31:19.803 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:31:49.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:31:49.866 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:32:19.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:32:19.954 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:32:50.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:32:50.084 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:33:20.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:33:20.141 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:33:50.226 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:33:50.231 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:34:20.300 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:34:20.303 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:34:50.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:34:50.374 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:35:20.434 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:35:20.438 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:35:50.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:35:50.502 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:36:20.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:36:20.583 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:36:50.650 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:36:50.654 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:37:20.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:37:20.717 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:37:50.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:37:50.782 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:38:20.843 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:38:20.846 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:38:50.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:38:50.918 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:39:21.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:39:21.015 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:39:51.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:39:51.086 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:39:59.999 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T17:40:00.000+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T17:40:21.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:40:21.147 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:40:51.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:40:51.233 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:41:21.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:41:21.357 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:41:51.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:41:51.477 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:42:21.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:42:21.614 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:42:51.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:42:51.753 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:43:21.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:43:21.891 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:43:52.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:43:52.027 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:44:22.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:44:22.100 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:44:52.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:44:52.270 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:45:22.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:45:22.340 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:45:52.491 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:45:52.495 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:46:22.571 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:46:22.575 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:46:52.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:46:52.703 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:47:22.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:47:22.815 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:47:52.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:47:52.961 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:48:23.088 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:48:23.091 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:48:53.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:48:53.171 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:49:23.246 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:49:23.250 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:49:53.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:49:53.327 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:49:59.998 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T17:49:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T17:50:23.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:50:23.450 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:50:53.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:50:53.588 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:51:23.722 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:51:23.725 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:51:53.818 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:51:53.821 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:52:23.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:52:23.942 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:52:54.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:52:54.021 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:53:24.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:53:24.169 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:53:54.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:53:54.248 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:54:24.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:54:24.419 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:54:54.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:54:54.522 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:55:24.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:55:24.652 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:55:54.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:55:54.731 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:56:24.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:56:24.868 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:56:54.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:56:54.972 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:57:25.040 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:57:25.043 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:57:55.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:57:55.148 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:58:25.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:58:25.286 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:58:55.395 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:58:55.399 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:59:25.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:59:25.537 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:59:55.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:59:55.691 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T17:59:59.999 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T17:59:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T18:00:25.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:00:25.778 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:00:55.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:00:55.908 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:01:26.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:01:26.136 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:01:56.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:01:56.208 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:02:26.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:02:26.420 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:02:56.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:02:56.558 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:03:26.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:03:26.638 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:03:56.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:03:56.766 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:04:26.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:04:26.845 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:04:56.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:04:56.976 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:05:27.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:05:27.064 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:05:57.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:05:57.151 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:06:27.226 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:06:27.229 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:06:57.389 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:06:57.392 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:07:27.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:07:27.471 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:07:57.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:07:57.617 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:08:27.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:08:27.688 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:08:57.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:08:57.837 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:09:27.902 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:09:27.906 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:09:58.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:09:58.169 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:09:59.999 INFO:tasks.ceph.mon.a.smithi005.stderr:2023-03-03T18:09:59.999+0000 7f1b3a993700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline; 1 mds daemon damaged 2023-03-03T18:10:28.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:10:28.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:10:58.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:10:58.325 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:11:28.403 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:11:28.406 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:11:58.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:11:58.484 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:12:28.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:12:28.558 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:12:58.626 DEBUG:teuthology.orchestra.run.smithi005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:12:58.629 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-03-03T18:13:17.153 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-03-03T18:13:17.154 DEBUG:teuthology.task.console_log:Killing console logger for smithi005 2023-03-03T18:13:17.155 DEBUG:teuthology.task.console_log:Killing console logger for smithi191 2023-03-03T18:13:17.155 DEBUG:teuthology.exit:Finished running handlers